Posts

How Harvey Built a Research Lab on a Budget | Gabe Pereyra

How Harvey Built a Research Lab on a Budget | Gabe Pereyra

Gabe Pereyra of Harvey details a playbook for application companies to compete with frontier AI labs by leveraging the ecosystem. Key strategies include building specialized benchmarks like Legal Agent Bench, using domain experts for synthetic data generation to overcome sensitive client data issues, partnering with multiple 'neo labs' for post-training, and developing robust model serving and evaluation infrastructure. He emphasizes open-sourcing data for validation and the 'Moneyball' philosophy for success, addressing challenges like talent acquisition and long-context management in the Q&A.

How Companies Are Building Their Own Intelligence | Sonya Huang, Sequoia Capital

How Companies Are Building Their Own Intelligence | Sonya Huang, Sequoia Capital

Sonya Huang of Sequoia Capital discusses the strategic imperative for companies to embrace "sovereign AI" by owning their AI models and weights. She identifies cost, speed, performance, and controlling destiny as the four driving forces behind this shift. Huang argues that the competitive landscape is moving towards owning the intelligence layer, positioning application companies as the new innovation labs. She provides a practical, opinionated framework covering strategy (what to own vs. rent), team building, ensuring external legibility of research, and a technical roadmap for implementation, emphasizing how open-weight models now enable frontier-level performance through ownership and customization.

The RAG Mistake Almost Every Team Is Making (with Pete Johnson)

The RAG Mistake Almost Every Team Is Making (with Pete Johnson)

Pete Johnson, Field CTO of AI at MongoDB, discusses effective AI strategies, why most organizations struggle with AI ROI, and how to build reliable AI systems. He covers the importance of choosing the right embedding models for RAG pipelines, introduces Matryoshka embeddings, and explains the evolution of agentic memory to combat token maxing and ensure consistency in production AI.

Agents, codebases, and teams — Aditya Khandelwal, Amazon AGI Lab

Agents, codebases, and teams — Aditya Khandelwal, Amazon AGI Lab

Aditya Khandelwal argues that scaling AI agent adoption within engineering teams is a leadership challenge, not an individual contributor problem. He highlights common pitfalls like agent "babysitting" and "slop," and provides a playbook emphasizing progressive disclosure, high-value automation, robust feedback loops, and a critical mindset shift to successfully integrate agents into team workflows.

Why Deep Networks Don’t Need to Memorize Everything — Matthieu Wyart

Why Deep Networks Don’t Need to Memorize Everything — Matthieu Wyart

Matthieu Wyart, a statistical physicist, argues that deep networks discover abstractions by recovering hidden data hierarchies, allowing them to escape the curse of dimensionality. He explains how this mechanism, combined with predicting latent representations instead of raw tokens, can significantly improve sample efficiency. The discussion also covers the physics of rough loss landscapes, machine creativity, diffusion models, and a theoretical framework for neural scaling laws.

Peter Steinberger: What Happens When 4.7 Million People Let It Cook

Peter Steinberger: What Happens When 4.7 Million People Let It Cook

Peter Steinberger, founder of OpenClaw, shares the candid story of building one of the world's largest open-source AI projects. Starting from a personal annoyance, OpenClaw went viral, leading to both immense success and unforeseen challenges, including burnout, security pressures, and feature creep. He offers invaluable lessons on product-market fit, managing hyper-growth in open source, the peril of dependencies, and the philosophy that "fun is velocity" in building impactful technology.