Amazon SageMaker Now Supports G4 and R5 instances for Real-Time Inference
Amazon SageMaker customers can now select G4 and R5 instances when deploying their machine learning models for real-time inferences. Amazon SageMaker is a modular, fully-managed platform that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale. G4 instances are optimized for machine learning application deployments such as image classification, object detection, recommendation engines, automated speech recognition and language translation that need access to low level GPU software libraries. R5 instances are memory optimized instances with EBS-optimized burst support, enabling customers to reduce costs by right-sizing instances based on their memory and compute requirements.
Amazon SageMaker customers can now select G4 and R5 instances when deploying their machine learning models for real-time inferences. Amazon SageMaker is a modular, fully-managed platform that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale. G4 instances are optimized for machine learning application deployments such as image classification, object detection, recommendation engines, automated speech recognition and language translation that need access to low level GPU software libraries. R5 instances are memory optimized instances with EBS-optimized burst support, enabling customers to reduce costs by right-sizing instances based on their memory and compute requirements.
G4 instances deliver the industry’s most cost-effective GPU platform for deploying machine learning models in production and graphics-intensive applications. G4 instances provide the latest generation NVIDIA T4 Tensor Core GPUs, AWS custom second generation Intel® Xeon® Scalable (Cascade Lake) processors, up to 50 Gbps of networking throughput, and up to 900 GB of local NVMe storage. To learn about G4 instances, visit the product pages.
R5 instances are memory optimized instances powered by the AWS Nitro System, a combination of dedicated hardware and lightweight hypervisor which delivers practically all of the compute and memory resources of the host hardware to your instances. R5 instances offer Intel Xeon Platinum 8000 series processors with a sustained all core frequency of up to 3.1 GHz. In addition, R5 instances add EBS-optimized burst support, enabling higher peak throughput for smaller sizes (up to 3.5Gbps). To learn more about R5 instances, visit the product pages.
G4 instances in Amazon SageMaker are available in the US (N. Virginia, Ohio, Oregon, and N. California), Europe (Frankfurt, Ireland, and London), and Asia Pacific (Seoul and Tokyo) AWS Regions. R5 instances in Amazon SageMaker are available in the US (N. Virginia, Ohio, Oregon, and N. California), Europe (Frankfurt, Ireland, London, Paris, Stockholm), Asia Pacific (Seoul, Tokyo, Sydney, Singapore, Mumbai, and Hong Kong), Canada (Central), and AWS GovCloud (US-West) AWS Regions.
Visit the Amazon SageMaker product pages for more information.