AWS-Optimized TensorFlow Now Scales to 256 GPUs
The AWS Deep Learning AMIs for Ubuntu and Amazon Linux now support distributed training of TensorFlow deep learning models with near-linear scaling efficiency up to 256 GPUs. The AWS Deep Learning AMIs come pre-built with an enhanced version of TensorFlow that is integrated with an optimized version of the Horovod distributed training framework to provide this level of scalability. With this enhancement, you can now train the ResNet50 model with TensorFlow-Horovod in just under 15 minutes.
The AWS Deep Learning AMIs for Ubuntu and Amazon Linux now support distributed training of TensorFlow deep learning models with near-linear scaling efficiency up to 256 GPUs. The AWS Deep Learning AMIs come pre-built with an enhanced version of TensorFlow that is integrated with an optimized version of the Horovod distributed training framework to provide this level of scalability. With this enhancement, you can now train the ResNet50 model with TensorFlow-Horovod in just under 15 minutes.
Get started quickly with the AWS Deep Learning AMIs using the tutorials in our developer guide.