⚡ Nvidia licenses Groq inference technology in reported $20B strategic deal
Nvidia is taking a non-exclusive license to Groq’s AI inference technology and hiring Groq’s founder Jonathan Ross and president Sunny Madra in a reported $20B strategic deal. Groq remains independent under new CEO Simon Edwards.
Groq’s core asset is its LPU, a deterministic inference chip that runs LLMs on a fixed execution schedule, delivering predictable low latency versus GPUs’ dynamic behavior. The design favors on-chip SRAM over off-chip HBM, reducing memory stalls and power use, with tradeoffs in model size. I
Nvidia is taking a non-exclusive license to Groq’s AI inference technology and hiring Groq’s founder Jonathan Ross and president Sunny Madra in a reported $20B strategic deal. Groq remains independent under new CEO Simon Edwards.
Groq’s core asset is its LPU, a deterministic inference chip that runs LLMs on a fixed execution schedule, delivering predictable low latency versus GPUs’ dynamic behavior. The design favors on-chip SRAM over off-chip HBM, reducing memory stalls and power use, with tradeoffs in model size. I
