{"data":{"slug":"groq-lpu","etype":"chip","name":"Groq LPU","cat":"AI Accelerator","subtitle":"The deterministic inference engine famous for extreme tokens-per-second.","summary":"Groq's Language Processing Unit strips out caches and dynamic scheduling: the compiler knows exactly where every byte is every cycle, using 230 MB of on-chip SRAM at 80 TB/s. Made on GlobalFoundries 14 nm — proof that architecture, not process node, drives its speed — LPU racks serve open models at hundreds to thousands of tokens per second. Founded by TPU creator Jonathan Ross; valued in the billions on 2024–25 raises with a major Saudi deployment deal.","attrs":[{"g":"Overview","l":"Designer","v":"Groq"},{"g":"Overview","l":"Architecture","v":"Tensor streaming, deterministic"},{"b":"Vendor spec","g":"Manufacturing","l":"Foundry / process","v":"GlobalFoundries 14 nm"},{"b":"Vendor spec","g":"Memory","l":"On-chip memory","v":"230 MB SRAM, ~80 TB/s"},{"b":"Vendor spec","g":"Compute","l":"INT8","u":"TOPS","v":"750"},{"b":"Vendor spec","g":"Overview","l":"Scale model","v":"Hundreds of chips pipelined per model; no HBM anywhere"}],"kf":{"node":"GF 14 nm","year":2020,"class":"AI Accelerator","memory":"230 MB SRAM","designer":"Groq"},"aliases":["LPU","Groq"],"ticker":null,"exchange":null,"hq":null,"founded":null,"website":null,"status":"Shipping","region":null,"asof":"2026-01-15","sources":[{"url":"https://groq.com/","label":"Groq"}]},"meta":{"found":true,"count":1,"served_from":"site cache (no live upstream calls)","as_of":"2026-10-14T03:59:13+00:00","disclaimer":"Research and information only — not investment advice. Structured records carry basis labels (vendor spec / reported / estimate); market quotes are delayed/indicative.","attribution":"Records compiled from vendor documentation, official filings and reputable public reporting; market quotes via financial data providers. See /data-sources."}}