Amazon Web Services CEO Adam Selipsky speaks at the Collision conference in Toronto on June 27, 2023.
Chloe Ellingson | Bloomberg | Getty Images
Amazon‘s AWS cloud unit announced its new Trainium2 artificial intelligence chip and the general-purpose Graviton4 processor during its Reinvent conference in Las Vegas on Tuesday. The company also said it will offer access to Nvidia’s latest H200 AI graphics processing units.
Amazon Web Services is trying to stand out as a cloud provider with a variety of cost-effective options. It won’t just sell cheap Amazon-branded products, though. Just as in its online retail marketplace, Amazon’s cloud will feature top-of-the-line products. Specifically, that means highly sought after GPUs from top AI chipmaker Nvidia.
The dual-pronged approach might put AWS in a better position to go up against its top competitor. Earlier this month Microsoft took a similar dual-pronged approach by revealing its inaugural AI chip, the Maia 100, and also saying the Azure cloud will have Nvidia H200 GPUs.
The Graviton4 processors are based on Arm architecture and consume less energy than chips from Intel or AMD. Graviton4 promises 30% better performance than the existing Graviton3 chips, enabling what AWS said is better output for the price. Inflation has been higher than usual, inspiring central bankers to hike interest rates. Organizations that want to keep using AWS but lower their cloud bills to better deal with the economy might wish to consider moving to Graviton.
More than 50,000 AWS customers are already using Graviton chips. Startup Databricks and Amazon-backed Anthropic, an OpenAI competitor, plan to build models with the new Trainium2 chips, which will boast four times better performance than the original model, Amazon said.
AWS said it will operate more than 16,000 Nvidia GH200 Grace Hopper Superchips, which contain H100 GPUs and Nvidia’s Arm-based general-purpose processors, for Nvidia’s research and development group. Other AWS customers…
Read the full article here