From 9c81c52d02d73d2ab0a62e0aa24a2d8f951301b9 Mon Sep 17 00:00:00 2001 From: Cassie Esvelt Date: Fri, 27 Jan 2023 15:31:13 -0800 Subject: [PATCH 1/2] add example links --- docs/_tutorials/autotuning.md | 4 ++++ docs/_tutorials/azure.md | 4 +++- 2 files changed, 7 insertions(+), 1 deletion(-) diff --git a/docs/_tutorials/autotuning.md b/docs/_tutorials/autotuning.md index 303087d298a7..f27df4fa82d9 100644 --- a/docs/_tutorials/autotuning.md +++ b/docs/_tutorials/autotuning.md @@ -120,3 +120,7 @@ Note that the performance metric used in autotuning is calculated using the timi Tuning completed in 0:27:33.988447. Total number of experiments: 13. As we can see the DeepSpeed Autotuner can select a better than hand-tuned configuration with a reasonable number of experiments. Examples in [Autotuning Hugging Face Examples](https://github.com/microsoft/DeepSpeedExamples/tree/master/autotuning/hf#autotuning-hugging-face-examples) would demonstrate the effectiveness of autotuning across different models. + +### DeepSpeed Autotuning with AzureML + +To try DeepSpeed autotuning with AzureML, please see the example [here](https://github.com/Azure/azureml-examples/tree/main/cli/jobs/deepspeed/deepspeed-autotuning). \ No newline at end of file diff --git a/docs/_tutorials/azure.md b/docs/_tutorials/azure.md index a2c558444844..6c7cded7b27c 100644 --- a/docs/_tutorials/azure.md +++ b/docs/_tutorials/azure.md @@ -9,7 +9,9 @@ If you don't already have an Azure account please see more details here: [https: # DeepSpeed on Azure via AzureML -The recommended and simplest method to try DeepSpeed on Azure is through [AzureML](https://azure.microsoft.com/en-us/services/machine-learning/). Please take a look at easy-to-use examples for Megatron-DeepSpeed, Transformers and CIFAR training [here](https://github.com/Azure/azureml-examples/tree/main/python-sdk/workflows/train/deepspeed). +The recommended and simplest method to try DeepSpeed on Azure is through [AzureML](https://azure.microsoft.com/en-us/services/machine-learning/). A training example and a DeepSpeed autotuning example using AzureML v2 can be found [here](https://github.com/Azure/azureml-examples/tree/main/cli/jobs/deepspeed). + +For AzureML v1 examples, please take a look at easy-to-use examples for Megatron-DeepSpeed, Transformers and CIFAR training [here](https://github.com/Azure/azureml-examples/tree/main/v1/python-sdk/workflows/train/deepspeed). > Our [Megatron-DeepSpeed](https://github.com/microsoft/megatron-deepspeed) contains the most up to date [recipe](https://github.com/microsoft/Megatron-DeepSpeed/tree/main/examples/azureml) for end-to-end training on AzureML. From 45e773361798ea3c5b95b369ec4fb29b9c26db6b Mon Sep 17 00:00:00 2001 From: Cassie Esvelt Date: Fri, 27 Jan 2023 15:48:10 -0800 Subject: [PATCH 2/2] add blank line --- docs/_tutorials/autotuning.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/_tutorials/autotuning.md b/docs/_tutorials/autotuning.md index f27df4fa82d9..38648daa89f2 100644 --- a/docs/_tutorials/autotuning.md +++ b/docs/_tutorials/autotuning.md @@ -123,4 +123,4 @@ As we can see the DeepSpeed Autotuner can select a better than hand-tuned config ### DeepSpeed Autotuning with AzureML -To try DeepSpeed autotuning with AzureML, please see the example [here](https://github.com/Azure/azureml-examples/tree/main/cli/jobs/deepspeed/deepspeed-autotuning). \ No newline at end of file +To try DeepSpeed autotuning with AzureML, please see the example [here](https://github.com/Azure/azureml-examples/tree/main/cli/jobs/deepspeed/deepspeed-autotuning).