Jun 28, 2026

Voice In, Visuals Out: The Agony and the Ecstasy - Allen Pike, Forestwalk Labs

Allen Pike (Forestwalk Labs) discusses the power of "voice-in, visuals-out" AI experiences, a paradigm championed by Andrej Karpathy. He highlights the critical challenge of latency in real-time AI interactions and shares three key techniques for achieving low-latency, delightful user experiences: utilizing fast models, employing short inference intervals, and implementing stable caching regimens.

Apr 20, 2026

How We Cut LLM Latency 70% With TensorRT in Production

An engineering leader details the journey of self-hosting LLMs at enterprise scale, covering how his team slashed latency by 70% with TensorRT-LLM, optimized GPU costs through counterintuitive scaling, and built a verticalized AI platform for HR tech. The summary explores practical solutions for cold starts, KV cache optimization, and managing the cultural adoption of AI coding agents in engineering teams.