Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev/22.04 #50

Merged
merged 9 commits into from
May 26, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion New-language-adaptation/German/README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<img src="http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png" style="width: 90px; float: right;">
<img src="http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_new-language-adaptation-german-readme/nvidia_logo.png" style="width: 90px; float: right;">

# The Making of RIVA German ASR Service

Expand Down
2 changes: 1 addition & 1 deletion New-language-adaptation/Hindi/README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<img src="http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png" style="width: 90px; float: right;">
<img src="http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_new-language-adaptation-hindi-readme/nvidia_logo.png" style="width: 90px; float: right;">

# The Making of RIVA Hindi ASR Service

Expand Down
4 changes: 2 additions & 2 deletions New-language-adaptation/Mandarin/README.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@

<img src="http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png" style="width: 90px; float: right;">
<img src="http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_new-language-adaptation-mandarin-readme/nvidia_logo.png" style="width: 90px; float: right;">

# The Making of the Riva Mandarin ASR Service

Expand Down Expand Up @@ -33,7 +33,7 @@ Proprietary datasets:
- 4 speech datasets: 1018 hours.
- 3 speech datasets: 510 hours.

In total, we have 2707 hours of Mandarin speech audio data.
In total, we have 2707 hours (320GB) of Mandarin speech audio data.

## 2. Data preparation

Expand Down
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
<img src="http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_all_tutorials-readme/nvidia_logo.png" style="width: 90px; float: right;">

# Riva Speech Skills Tutorials

The best way to get started with Riva is to start with the tutorials.
Expand Down
2 changes: 1 addition & 1 deletion asr-how-to-improve-recognition-for-specific-words.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
<img src="http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png" style="width: 90px; float: right;">
<img src="http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_asr-how-to-improve-recognition-for-specific-words/nvidia_logo.png" style="width: 90px; float: right;">

# How to Improve Recognition of Specific Words

Expand Down
2 changes: 1 addition & 1 deletion asr-python-advanced-customize-vocabulary-and-lexicon.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_asr-python-advanced-customize-vocabulary-and-lexicon/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How to Customize Riva ASR Vocabulary and Pronunciation with Lexicon Mapping\n",
"\n",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_asr-python-advanced-finetune-am-citrinet-for-noisy-audio-withtao/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How to improve accuracy on specific speech patterns by fine-tuning the Acoustic Model (Citrinet) in the Riva ASR pipeline \n",
"\n",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_asr-python-advanced-finetune-am-citrinet-tao-deployment/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How to deploy custom Acoustic Model (Citrinet) trained with TAO Toolkit on Riva\n",
"This tutorial walks you through the deployment of custom acoustic model (Citrinet) trained with TAO Toolkit on Riva."
Expand Down
6 changes: 4 additions & 2 deletions asr-python-advanced-finetune-am-citrinet-tao-finetuning.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_asr-python-advanced-finetune-am-citrinet-tao-finetuning/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How to fine-tune a Riva ASR Acoustic Model (Citrinet) with TAO Toolkit\n",
"This tutorial walks you through how to fine-tune a Riva ASR acoustic model (Citrinet) with TAO Toolkit."
Expand Down Expand Up @@ -651,7 +651,9 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"In this section, we are going to run inference on the tlt checkpoint with TAO Toolkit. \n For real-time inference and best latency, we need to deploy this model on Riva - Refer to [How to deploy custom Acoustic Model (Citrinet) trained with TAO Toolkit on Riva](https://github.com/nvidia-riva/tutorials/blob/dev/22.04-citrinet/asr-python-advanced-finetune-am-citrinet-tao-deployment.ipynb) tutorial. \n You might have to work with the infer.yaml file to select the files you want for inference."
"In this section, we are going to run inference on the tlt checkpoint with TAO Toolkit. \n",
" For real-time inference and best latency, we need to deploy this model on Riva - Refer to [How to deploy custom Acoustic Model (Citrinet) trained with TAO Toolkit on Riva](https://github.com/nvidia-riva/tutorials/blob/dev/22.04-citrinet/asr-python-advanced-finetune-am-citrinet-tao-deployment.ipynb) tutorial. \n",
" You might have to work with the infer.yaml file to select the files you want for inference."
]
},
{
Expand Down
4 changes: 2 additions & 2 deletions asr-python-advanced-tao-ngram-pretrain.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_asr-python-advanced-tao-ngram-pretrain/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How to pretrain a Riva ASR Language Modeling (n-gram) with TAO Toolkit\n",
"This tutorial walks you through the pretraining of Riva ASR language modeling (n-gram) with Train Adapt Optimize (TAO) Toolkit."
Expand Down Expand Up @@ -96,7 +96,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"### Installing and setting up TAO\n",
"### Installing and setting up TAO\n",
"Install TAO Toolkit inside a Python virtual environment. We recommend performing this step first and then launching the tutorial from the virtual environment.\n",
"\n",
"It's a simple `pip` install."
Expand Down
2 changes: 1 addition & 1 deletion asr-python-advanced-wordboosting.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -5,7 +5,7 @@
"id": "2bf1191b",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_asr-python-advanced-wordboosting/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How do I boost specific words at runtime with word boosting?\n",
"\n",
Expand Down
2 changes: 1 addition & 1 deletion asr-python-basics.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_asr-python-basics/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How do I use Riva ASR APIs with out-of-the-box models?\n",
"\n",
Expand Down
2 changes: 2 additions & 0 deletions deploy-eks.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,5 @@
<img src="http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_asr_deploy-eks/nvidia_logo.png" style="width: 90px; float: right;">

# How to Deploy Riva at Scale on AWS with EKS

This is an example of deploying and scaling Riva Speech Skills on Amazon Web Services (AWS) Elastic Kubernetes Service (EKS)
Expand Down
2 changes: 1 addition & 1 deletion tts-python-advanced-customization-with-ssml.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_tts_tts-python-advanced-customization-with-ssml/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How do I customize Riva TTS audio output with SSML?\n",
"\n",
Expand Down
2 changes: 1 addition & 1 deletion tts-python-advanced-pretrain-tts-tao-deployment.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_tts_tts-python-advanced-pretrain-tts-tao-deployment/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How to Deploy a custom TTS Models (FastPitch and HiFi-GAN) trained with TAO Toolkit Riva"
]
Expand Down
2 changes: 1 addition & 1 deletion tts-python-advanced-pretrain-tts-tao-training.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_tts_tts-python-advanced-pretrain-tts-tao-training/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How to train Riva TTS models (FastPitch and HiFiGAN) with TAO Toolkit"
]
Expand Down
2 changes: 1 addition & 1 deletion tts-python-basics.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"<img src=\"http://developer.download.nvidia.com/compute/machine-learning/frameworks/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"<img src=\"http://developer.download.nvidia.com/notebooks/dlsw-notebooks/riva_tts_tts-python-basics/nvidia_logo.png\" style=\"width: 90px; float: right;\">\n",
"\n",
"# How do I use Riva TTS APIs with out-of-the-box models?\n",
"\n",
Expand Down