Amazon Boosts AI Chip Efforts to Surpass Nvidia

Published Date: 27/07/2024

Amazon's AI chip efforts aim to reduce reliance on Nvidia, offering cheaper and faster alternatives for complex calculations and data processing.

In a bid to reduce its dependence on Nvidia's costly artificial intelligence chips, Amazon is accelerating its AI chip development to offer customers more affordable and efficient solutions. Inside Amazon's chip lab in Austin, Texas, a team of engineers is working tirelessly to perfect the company's new server design, packed with Amazon's AI chips that rival those of market leader Nvidia.

Amazon Web Services (AWS), the main growth driver for the company, has been utilizing Nvidia chips to power its artificial intelligence cloud business. However, by developing its own processors, Amazon aims to limit its reliance on costly Nvidia chips, often referred to as the 'Nvidia tax.' Through its homegrown chips, Amazon wants to enable customers to compute complex calculations and process enormous amounts of data more cheaply.

The company's rivals, Microsoft and Alphabet, are also pursuing similar strategies. Amazon's customers are increasingly demanding cheaper alternatives to Nvidia, according to Rami Sinno, the director of engineering for Amazon's Annapurna Labs, which is part of its cloud business AWS. Amazon acquired Annapurna Labs in 2015.

While Amazon's AI chip efforts are still in their early stages, the company's workhorse chip, Graviton, has been under development for nearly a decade and is now on its fourth generation. The AI chips, Trainium and Inferentia, are newer designs. David Brown, Vice President, Compute and Networking at AWS, explained that Amazon's AI chips offer up to 40%, 50% in some cases, of improved price and performance, making them half as expensive as running the same model with Nvidia.

AWS, which accounts for just under a fifth of Amazon's overall revenue, saw sales surge 17% to $25 billion in the January-March quarter, compared with a year earlier. The company controls roughly a third of the cloud computing market, with Microsoft's Azure holding about 25%. During its recent Prime Day, Amazon deployed a quarter million Graviton chips and 80,000 of its custom AI chips to handle the surge in activity across its platforms, generating a record $14.2 billion in sales, according to Adobe Analytics.

Amazon Web Services (AWS) is a subsidiary of Amazon that provides on-demand cloud computing platforms to individuals, companies, and governments. AWS offers a broad range of services, including computing power, storage, databases, analytics, machine learning, and more.

Amazon is a multinational technology company that focuses on e-commerce, cloud computing, digital streaming, and artificial intelligence. Founded in 1994 by Jeff Bezos, Amazon is headquartered in Seattle, Washington.

FAQS:

Q: What is Amazon's motivation for developing its own AI chips?

A: Amazon wants to reduce its reliance on costly Nvidia chips and offer customers more affordable and efficient solutions for complex calculations and data processing.

Q: What is the 'Nvidia tax'?

A: The 'Nvidia tax' refers to the costly Nvidia chips used to power Amazon's artificial intelligence cloud business.

Q: What is Amazon's goal with its AI chip development?

A: Amazon aims to enable customers to compute complex calculations and process enormous amounts of data more cheaply through its homegrown chips.

Q: How does Amazon's AI chip performance compare to Nvidia's?

A: Amazon's AI chips offer up to 40%, 50% in some cases, of improved price and performance, making them half as expensive as running the same model with Nvidia.

Q: What is the market share of AWS in the cloud computing market?

A: AWS controls roughly a third of the cloud computing market, with Microsoft's Azure holding about 25%.

More Topics :