Distributed Training On NVIDIA DGX Station A100 | Deep Learning Tutorial 43 (Tensorflow & Python)

Using tensorflow mirrored strategy we will perform distributed training on NVIDIA DGX Station A100 System. Distributed training is used to split the training workload on different GPUs on a multi GPU system. We will see how performance can be optimized and training times can be reduced using this approach.

Code: https://github.com/codebasics/deep-learning-keras-tf-tutorial/blob/master/43_distributed_training/dgx_benchamrking_tf_mirrored_stratergy.ipynb
Deep learning playlist: https://www.youtube.com/playlist?list=PLeo1K3hjS3uu7CxAacxVndI4bE_o3BDtO
Machine learning playlist : https://www.youtube.com/playlist?list=PLeo1K3hjS3uvCeTYTeyfe0-rN5r8zn9rw  

DGX station A100: https://www.nvidia.com/en-us/data-center/dgx-station-a100/

🔖Hashtags🔖

#deeplearningmultigpu #deeplearninggpusetup #tensorflowdistributedtraining #tensorflowmirroredstratergy #distributedtraining #dgxa100 #nvidiadgxa100

Do you want to learn technology from me? Check https://resources.codebasics.io/4IYKT8 for my affordable video courses.

🌎 Website: https://resources.codebasics.io/4IYKT8

🎥 Codebasics Hindi channel: https://www.youtube.com/channel/UCTmFBhuhMibVoSfYom1uXEg

#️⃣ Social Media #️⃣
🔗 Discord: https://discord.gg/r42Kbuk
📸 Instagram: https://www.instagram.com/codebasicshub/
🔊 Facebook: https://www.facebook.com/codebasicshub
📱 Twitter: https://twitter.com/codebasicshub
📝 Linkedin (Personal): https://www.linkedin.com/in/dhavalsays/
📝 Linkedin (Codebasics): https://www.linkedin.com/company/codebasics/

❗❗ DISCLAIMER: All opinions expressed in this video are of my own and not that of my employers’.