Groq's CEO: A conversation with Jonathan Ross

At RAISE Summit, Jonathan Ross, Co-Founder & CEO of Groq, shares insights on the company’s bold expansion into Europe with its first EU data center in Helsinki. In this keynote, Ross explains how Groq is redefining inference compute with LPUs (Language Processing Units), a chip architecture purpose-built for low-latency, energy-efficient inference—using one-third the energy of GPUs and air cooling instead of scarce liquid-cooled facilities.
‍

Key discussion points include:

• Data center strategy: Why Groq chose Europe, the compute gap vs. the U.S., and how Helsinki was operational in just weeks.
• Air cooling breakthrough: Chips designed to consume less power and avoid the bottlenecks of external memory.
• Vertical integration: Owning the full stack—from chip architecture to runtime—without relying on third-party networking or kernels.
• Inference economics: Why Groq believes inference is a high-volume, low-margin business, and how that benefits end users.
• GPUs vs. LPUs: Why Groq’s architecture excels in inference, freeing GPUs for training workloads.
• Sovereign AI: Lessons from Saudi Arabia and Canada, and why Europe needs its own compute infrastructure.
• Scaling challenges: Supporting 20–30% monthly customer growth while leaping from 10M to 20M tokens per second in just six weeks.
• Misconceptions about Groq: Running massive models more efficiently, supporting 128k context, and excelling with mixture-of-experts workloads.

If you want to understand the future of AI infrastructure, sovereign compute, and inference economics, don’t miss this session with Jonathan Ross. Like, comment, and subscribe for more exclusive talks from the leaders shaping AI at RAISE Summit