Latest News

Amazon announces new AI chip as it deepens Nvidia relationship


In this article


Amazon Web Services CEO Adam Selipsky speaks at the Collision conference in Toronto on June 27, 2023.
Chloe Ellingson | Bloomberg | Getty Images

AmazonNvidia’s H200 AI graphics processing units.

Amazon Web Services is trying to stand out as a cloud provider with a variety of cost-effective options. It won’t just sell cheap Amazon-branded products, though. Just as in its online retail marketplace, Amazon’s cloud will feature top-of-the-line products. Specifically, that means highly sought after GPUs from top AI chipmaker Nvidia.

The dual-pronged approach might put AWS in a better position to go up against its top competitor. Earlier this month MicrosoftMaia 100, and also saying the Azure cloud will have Nvidia H200 GPUs.

The Graviton4 processors are based on Arm architecture and consume less energy than chips from IntelAMD

More than 50,000 AWS customers are already using Graviton chips. Startup Databricks and Amazon-backed Anthropic, an OpenAI competitor, plan to build models with the new Trainium2 chips, which will boast four times better performance than the original model, Amazon said.

AWS said it will operate more than 16,000 Nvidia GH200 Grace Hopper Superchips, which contain H100 GPUs and Nvidia’s Arm-based general-purpose processors, for Nvidia’s research and development group. Other AWS customers won’t be able to use these chips.

Demand for Nvidia GPUs has skyrocketed since startup OpenAI released its ChatGPT chatbot last year, wowing people with its abilities to summarize information and compose human-like text. It led to a shortage of Nvidia’s chips as companies raced to incorporate similar generative AI technologies into their products.

Normally, the introduction of an AI chip from a cloud provider might present a challenge to Nvidia, but in this case, Amazon is simultaneously expanding its collaboration with Nvidia. At the same time, AWS customers will have another option to consider for AI computing if they aren’t able to secure the latest Nvidia GPUs.

Amazon is the leader in cloud computing but has been renting out GPUs in its cloud for over a decade. In 2018 it followed cloud challengers AlibabaGoogle

AWS has launched more than 200 cloud products since 2006, when it released its EC2 and S3 services for computing and storing data. Not all of them have been hits. Some go without updates for a long time and a rare few are discontinued, freeing up Amazon to reallocate resources. However, the company continues to invest in the Graviton and Trainium programs, suggesting that Amazon senses demand.

AWS didn’t announce release dates for virtual-machine instances with Nvidia H200 chips, or instances relying on its Trainium2 silicon. Customers can start testing Graviton4 virtual-machine instances now before they become commercially available in the next few months.

WATCH: Analysts are going to have to raise their AWS growth estimates, says Deepwater’s Gene Munster

New Battery Crushes Tesla’s Tech, Unveils A Solid-State Marvel With 300% Higher Energy Density, 15-minute Ultra-Fast Charge

Previous article

These stocks have gone too far, too fast during this rally and analysts expect them to fall

Next article

You may also like


Leave a reply

Your email address will not be published. Required fields are marked *

More in Latest News