What is the new Nvidia Groq 3 LPU chip designed for?

The Nvidia Groq 3 LPU chip is designed to improve chatbot performance by being optimized to run large language models.

When is the Nvidia Groq 3 LPU expected to ship and who will use it?

The Groq 3 LPU is in production and expected to ship in Q3, with major AI companies like OpenAI, Anthropic, and Meta anticipated to adopt the technology.

Home / Technology / Nvidia Unveils Groq 3 LPU for AI Chatbots

Nvidia Unveils Groq 3 LPU for AI Chatbots

Q: How will Nvidia's Groq 3 LPU work with existing Nvidia technology?

The Groq 3 LPU will be paired with Nvidia's 'Vera Rubin' platform, which includes Rubin GPUs and Vera CPUs, to jointly compute AI models and increase efficiency.

17 Mar

•

Summary

Nvidia introduces the Groq 3 LPU chip for optimized AI chatbot performance.
The LPU licenses technology from AI company Groq, founded in 2016.
LPUs will work with Nvidia's Rubin GPUs for enhanced AI model computations.

Nvidia Unveils Groq 3 LPU for AI Chatbots

Nvidia is set to release its new Groq 3 LPU processor, specifically designed to enhance the performance of large language models and AI chatbots. This development stems from Nvidia's December licensing agreement with Groq, an AI company established in 2016 that specializes in LPU technology for speed and energy efficiency.

The Groq 3 LPU will complement Nvidia's upcoming 'Vera Rubin' platform, which includes Rubin GPUs and Vera CPUs for data centers. While LPUs use faster SRAM with limited capacity, they will be deployed in large batches alongside Nvidia's GPUs. This combined approach aims to optimize AI workloads, particularly for longer prompts, with Nvidia projecting a potential 35x throughput increase for trillion-parameter models.