What is Amazon's Trainium chip?

Trainium is Amazon's custom silicon designed to improve the economic efficiency of AI operations.

How many customers use Amazon Bedrock for AI?

Over 50 customers have processed more than one trillion tokens each on Amazon Bedrock.

What new AI hardware is Amazon developing?

Amazon is developing Trainium4, which combines with Graviton CPUs and NVLink Fusion for a rack-scale AI computer.

Home / Technology / Amazon's Trainium Chips Accelerate AI Pace

Amazon's Trainium Chips Accelerate AI Pace

3 Dec

•

Summary

Amazon is developing custom silicon, Trainium, to improve AI economics.
Trainium4 combined with Graviton CPUs and NVLink Fusion forms a rack-scale AI computer.
Over 50 customers have processed more than 1 trillion tokens each on Bedrock.

Amazon's Trainium Chips Accelerate AI Pace

Amazon is intensifying its focus on custom silicon development, with the unveiling of Trainium aimed at enhancing the economic efficiency of its artificial intelligence operations. The company's commitment to custom chips underscores a strategy to accelerate its AI capabilities and potentially speed up the release cadence of new hardware.

The latest iteration, Trainium4, is poised to integrate seamlessly with ARM Graviton CPUs and NVIDIA's NVLink Fusion technology. This powerful combination is set to form a sophisticated rack-scale AI computer, signifying a significant step forward in developing specialized hardware for demanding AI workloads.

Beyond hardware advancements, Amazon's cloud AI service, Bedrock, is demonstrating remarkable adoption. The company announced that more than 50 clients have each surpassed the milestone of processing over one trillion tokens through the platform, highlighting its growing influence in the AI-as-a-service market.