OpenAI Built Its Own Chip in 9 Months

Richard Ho, VP of Hardware at OpenAI, details the development of 'Jalapeño,' OpenAI's first custom AI accelerator. The chip aims to drastically lower inference costs and empower full stack control, achieving a remarkable 9-month tape-out by leveraging AI in chip design. Jalapeño's blank-slate architecture brings memory and compute closer, delivering both high throughput and low latency, outperforming competitors even without speculative decoding, and proving that AI can supercharge expert productivity in complex engineering fields.