Posts

The Messy Reality of Scale: Synthetic Data and Pre-Training — Marah Abdin & Robert McHardy, poolside

The Messy Reality of Scale: Synthetic Data and Pre-Training — Marah Abdin & Robert McHardy, poolside

Poolside discusses their innovative approaches to synthetic data generation, pre-training validation, and distributed training challenges. They highlight how modular data pipelines, rigorous replica hash checks, and numerical stability fixes enabled them to scale their LLMs, culminating in the 118B parameter Laguna S model designed for agentic coding, which shows strong early results against leading open-weight models.

Evals-Driven Development for a Mental Health AI Coach — Akele Reed & Dave Revere, SonderMind

Evals-Driven Development for a Mental Health AI Coach — Akele Reed & Dave Revere, SonderMind

SonderMind's AI mental health coach, Sonder, pioneers an eval-driven development approach balancing effectiveness and safety. This involves a clinical feedback loop turning human therapist insights into machine-readable evaluations, an Ethics Engine with modular, LLM-as-a-judge guardrails for evolving clinical guidelines, and a shift from single-prompt agents to a Supervisor/Executor/Evaluator architecture with human oversight to ensure safety and quality in high-stakes mental health conversations. They also open-source clinically reviewed datasets to foster community safety.

Loop Engineering from First Principles — Kyle Mistele, HumanLayer

Loop Engineering from First Principles — Kyle Mistele, HumanLayer

Kyle Mistele, in this presentation, argues that fixing the problem of unreviewable 40,000-line pull requests generated by coding agents doesn't lie in better prompts but in better, control theory-inspired loops. He details how to build agentic control loops with distinct sensors, controllers, and actuators, ensuring incremental, verifiable code changes. Using a practical example of RPC API migration, he demonstrates how to implement these loops with tools like ASGrep, integrate them into CI/CD, enable human feedback, and manage workflow to prevent overwhelming reviewers, ultimately leading to more robust and readable agent-generated code.

Why Large? Tiny LMs & Agents on Edge/Robotics — Cormac Brick, Google

Why Large? Tiny LMs & Agents on Edge/Robotics — Cormac Brick, Google

Cormac Brick from Google AI Edge discusses how the increasing constraint of DRAM cost on edge devices necessitates the development and deployment of increasingly smaller AI models. He outlines the work of his team in optimizing models like Gemma, achieving 2.9 bits per weight for a 2 billion parameter model capable of running on a Raspberry Pi at 7.6 tokens/second, or on an NPU at 31 tokens/second decode for vision tasks. The talk delves into 'tiny models' (50M-500M parameters) that extend AI to older devices and enable features like robust voice-to-function calling via fine-tuning with synthetic data, exemplified by an offline voice dictation app.

What Actually Makes A Startup Durable

What Actually Makes A Startup Durable

YC partners discuss how founders should navigate the AI era, emphasizing the rapid decrease in AI costs, the evolving definition of a 'hard problem' for startups, the critical importance of human connection and co-founders, and practical advice on building AI-native loops, pivoting, and achieving distribution in a world where software is easy to build.

What Big Tech Missed And How Startups Can Still Win

What Big Tech Missed And How Startups Can Still Win

Alexandre LeBrun, CEO of AMI Labs, discusses his career building and selling AI companies, emphasizing his strategy of tackling problems "20 years too early." He delves into AMI Labs' contrarian bet on "world models" over traditional LLMs, highlighting their ability to learn directly from real-world sensory data, unlike LLMs which learn from human-written text. LeBrun explains how this approach is critical for developing intelligent robots and avoiding the pitfalls of Vision-Language Assistants (VLAs). He also touches upon the challenges of securing talent, data, and compute for such an ambitious project, the strategic choice of location, and the importance of holding an extremely large vision while solving a narrow problem for early founders.