Andy Jassy says Amazon’s Nvidia competitor chip is already a multibillion-dollar business
Amazon's Trainium2 Chip: A Multibillion-Dollar Business with a Bright Future
Amazon's CEO Andy Jassy recently revealed that the company's Nvidia-competitor AI chip, Trainium2, has already become a multibillion-dollar business with substantial traction. The chip, which is 4x faster and uses less power than its predecessor, Trainium2, has 1M+ chips in production and 100K+ companies using it as the majority of Bedrock usage today. Bedrock is Amazon's AI app development tool that allows companies to pick and choose among many AI models.
Amazon's AI Chip is Winning in the Cloud Market
According to Jassy, Amazon's AI chip is winning among the company's enormous roster of cloud customers because it has price-performance advantages over other GPU options that are compelling. In other words, it works better and costs less than those "other GPUs" out there on the market. This is Amazon's classic MO, offering its own homegrown tech at lower prices.
Anthropic's Project Rainier: A Big Chunk of Trainium2's Revenue
AWS CEO Matt Garman offered even more insight in an interview with CRN, about one customer responsible for a big chunk of those billions in revenue: Anthropic. Garman said, "We've seen some enormous traction from Trainium2, particularly from our partners at Anthropic who we've announced Project Rainier, where there's over 500,000 Trainium2 chips helping them build the next generations of models for Claude."
Project Rainier: Amazon's Most Ambitious AI Cluster of Servers
Project Rainier is Amazon's most ambitious AI cluster of servers, spread across multiple data centers in the U.S. and built to serve Anthropic's skyrocketing needs. It came online in October. Amazon is, of course, a major investor in Anthropic. In exchange, Anthropic made AWS its primary model training partner, even though Anthropic is now also offered on Microsoft's cloud via Nvidia's chips.
Only a Few Companies Can Compete with Nvidia
Indeed, only a few U.S. companies like Google, Microsoft, Amazon, and Meta have all the engineering pieces — silicon chip design expertise, homegrown high-speed interconnect, and networking technology — to even attempt true competition with Nvidia. Remember, Nvidia cornered the market on one major high-performance networking tech in 2019 when CEO Jensen Huang outbid Intel and Microsoft to buy InfiniBand hardware maker Mellanox.
Amazon's Plan for Interoperability with Nvidia's GPUs
Still, Amazon may have a plan for that. As we previously reported, the next generation of its AI chip, Trainium4, will be built to interoperate with Nvidia's GPUs in the same system. Whether that helps peel more business away from Nvidia or simply reinforces its dominance, but on AWS's cloud, remains to be seen.
Implications and Forward-Looking Thoughts
It may not matter to Amazon. If it is already on track to make multibillion dollars from the Trainium2 chip, and the next generation will be that much better, it may be winner enough. The implications of Amazon's success in the AI chip market are significant, as it could potentially disrupt the dominance of Nvidia and other players in the industry. As the AI chip market continues to evolve, it will be interesting to see how Amazon's Trainium4 chip performs and whether it can maintain its lead in the market.
Conclusion
Amazon's Trainium2 chip has already become a multibillion-dollar business with substantial traction, and its next generation, Trainium4, is expected to be even better. The implications of Amazon's success in the AI chip market are significant, and it will be interesting to see how the company continues to evolve and innovate in this space. As the AI chip market continues to grow and evolve, it will be exciting to see how Amazon's Trainium4 chip performs and whether it can maintain its lead in the market.
