SRAM

The Future of Frontier Model Architectures with Walter Goodwin, Founder & CEO of Fractile

The Future of Frontier Model Architectures with Walter Goodwin, Founder & CEO of Fractile

Walter Goodwin, founder and CEO of full-stack AI chip company Fractile, discusses the bets behind his company's inference chips, including memory bandwidth as the key constraint, the value of owning the entire chip stack, compressing the gap between chip design and deployment, and how the accelerator market may evolve as frontier labs pursue faster inference.

Inference at Scale:Breaking the Memory Wall

Inference at Scale:Breaking the Memory Wall

Sid Sheth, CEO of d-matrix, details their memory-centric approach to AI inference hardware, focusing on their Digital In-Memory Compute (DIMC) architecture. He explains how DIMC, an augmented SRAM technology, minimizes data movement to solve the memory bottleneck, delivering significant gains in latency and energy efficiency, particularly for the 'decode' phase of large language models.