Fine tuning

How Companies Are Building Their Own Intelligence | Sonya Huang, Sequoia Capital

How Companies Are Building Their Own Intelligence | Sonya Huang, Sequoia Capital

Sonya Huang of Sequoia Capital discusses the strategic imperative for companies to embrace "sovereign AI" by owning their AI models and weights. She identifies cost, speed, performance, and controlling destiny as the four driving forces behind this shift. Huang argues that the competitive landscape is moving towards owning the intelligence layer, positioning application companies as the new innovation labs. She provides a practical, opinionated framework covering strategy (what to own vs. rent), team building, ensuring external legibility of research, and a technical roadmap for implementation, emphasizing how open-weight models now enable frontier-level performance through ownership and customization.

Decagon’s Playbook for Building Enterprise AI Applications

Decagon’s Playbook for Building Enterprise AI Applications

Jesse Zhang and Ashwin Sreenivas, co-founders of Decagon, discuss their company's transition to open-source models for enterprise AI, emphasizing how fine-tuned small models outperform frontier models on specific tasks. They delve into the role of application-layer companies in an AI-first world, their product-driven 'glass box' approach for enterprises, and the transformative power of their 'Duet Autopilot' agent, which builds other AI agents. The conversation also covers AI's impact on jobs, highlighting the Jevons Paradox in customer support.

Persona Engineering: A Field Guide to AI Synthetic Personas — Ishan Anand, InsightSciences.ai

Persona Engineering: A Field Guide to AI Synthetic Personas — Ishan Anand, InsightSciences.ai

Ishan Anand discusses synthetic personas for market research, drawing parallels to weather forecasting. He outlines three key failure modes—latent confounders, prompt sensitivity, and difficulty predicting actions—and explores techniques like fine-tuning and calibrated prompting to overcome them. Anand stresses the importance of validating personas against human data using distributional metrics and establishing a "noise floor" based on human-to-human consistency, advocating for their use as economic actors and complements to, rather than replacements for, human research.

Why Large? Tiny LMs & Agents on Edge/Robotics — Cormac Brick, Google

Why Large? Tiny LMs & Agents on Edge/Robotics — Cormac Brick, Google

Cormac Brick from Google AI Edge discusses how the increasing constraint of DRAM cost on edge devices necessitates the development and deployment of increasingly smaller AI models. He outlines the work of his team in optimizing models like Gemma, achieving 2.9 bits per weight for a 2 billion parameter model capable of running on a Raspberry Pi at 7.6 tokens/second, or on an NPU at 31 tokens/second decode for vision tasks. The talk delves into 'tiny models' (50M-500M parameters) that extend AI to older devices and enable features like robust voice-to-function calling via fine-tuning with synthetic data, exemplified by an offline voice dictation app.

Open Models: Kimi K3, Qwen 3.8, Xi's WAIC Speech, Distillation, The Open-Closed Gap, and What's Next

Open Models: Kimi K3, Qwen 3.8, Xi's WAIC Speech, Distillation, The Open-Closed Gap, and What's Next

Nathan Lambert and Florian Brand discuss the accelerating open model landscape, focusing on the surge in Chinese models like Kimi K3 and GLM 5.2. They explore the reasons behind China's progress, the evolving US ecosystem, the cybersecurity implications of open-source bans, and debunk common misconceptions about distillation, particularly challenging Ben Thompson's recent claims. The episode concludes with predictions and a frontier model tier list.

Is Fine-Tuning Still Needed? LLMs, RAG, & LoRA

Is Fine-Tuning Still Needed? LLMs, RAG, & LoRA

This summary explores the evolving role of fine-tuning in modern AI workflows, comparing it with advanced techniques like RAG, LoRA, and enhanced generative AI capabilities. It discusses the historical benefits, current limitations due to rapidly advancing frontier models, and outlines a practical decision framework for customizing machine learning models and designing efficient AI systems.