dcn-as logo
Story image

AWS launches new EC2 instance powered by NVIDIA GPUs

05 Nov 2020

Amazon Web Services (AWS) and NVIDIA have announced the general availability of Amazon EC2 P4d, which is the result of a collaboration that brings AWS cloud compute together with the power of the NVIDIA A100 Tensor Core GPU.

The EC2 P4d, designed for machine learning and high-performance computing environment, features eight A100 GPUs and 400 Gbps of network bandwidth.

AWS explains that data science is pushing the boundaries of machine learning for a range of use cases like natural language processing, object detection, and perception model training for autonomous vehicles. However, progress is often inhibited by long training times and slower development.

“The pace at which our customers have used AWS services to build, train, and deploy machine learning applications has been extraordinary. At the same time, we have heard from those customers that they want an even lower-cost way to train their massive machine learning models,” says AWS EC2 vice president Dave Brown.

“Now, with EC2 UltraClusters of P4d instances powered by NVIDIA’s latest A100 GPUs and petabit-scale networking, we’re making supercomputing-class performance available to virtually everyone.”

Each P4d instance doubles the performance of the previous P3 instances, which could result in lower machine learning training costs, according to AWS.

The P4d is built on the AWS Nitro System, which enables customers to launch P4d in EC2 UltraClusters with on-demand and scalable access to over 4,000 GPUs. This, AWS declares, is akin to ‘supercomputer-class performance’.

The P4d is also supported on AWS services such as Amazon Elastic Container Service (Amazon ACS), Amazon Elastic Kubernetes Service (Amazon EKS), as well as fully-managed experiences on Amazon SageMaker. 

Further, the P4d can also leverage all the optimized, containerized software available from NGC, including HPC applications, AI frameworks, pre-trained models, Helm charts and inference software like TensorRT and Triton Inference Server.

NVIDIA’s Accelerated Computing general manager and vice president Ian Buck adds, “The first decade of GPU cloud computing has brought over 100 exaflops of AI compute to the market. With the arrival of the Amazon EC2 P4d instance powered by NVIDIA A100 GPUs, the next decade of GPU cloud computing is off to a great start.”

“NVIDIA and AWS are making it possible for applications to continue pushing the boundaries of AI across a wide array of applications. We can’t wait to see what customers will do with it.”

 P4d instances are available in US East (N. Virginia) and US West (Oregon), with availability planned for additional regions soon.

Story image
Equinix accelerates new data centre development with US$144m investment
"The SG5 IBX data centre aims to create more opportunities for enterprises in the region to build a strong digital foundation, enabling them to develop into the digital leaders of tomorrow.” More
Story image
NEXTDC and PCCW Global launch new cloud infrastructure integration
"Teaming AXON with Console Connect’s Network-as-a-Service platform forms a powerful, globally available ecosystem that will deliver the reliable, secure and easy-to-manage interconnectivity that businesses are increasingly relying on.”More
Story image
Huawei plans to train 150,000 datacom engineers over three years
Huawei recognises the need for new network and architecture requirements as digital transformation and networks develop. As such, the company developed a new set of ‘talent cultivation standards’.More
Story image
Google Cloud launches new Data Migration Service
"With Database Migration Service, we’re delivering a simplified and highly compatible product experience so that, no matter where our customers are starting from, they have an easy, and secure way to migrate their databases to Cloud SQL.”More
Story image
CX firm Qualtrics to launch Singapore data center
Qualtrics aims to open a new data center in Singapore as the company continues its expansion efforts across Southeast Asia.More
Story image
Google Anthos makes the move to bare metal cloud
“Now, with the option of running Anthos on bare metal, there are even more ways to enjoy the benefits of this modern cloud application stack.”More