Oct 08, 2026

How Standard Kernel uses compound AI systems to optimize code and extract maximum GPU performance

Chris from Standard Kernel explains how the company uses two autonomous optimization systems, one for whole workloads and one for individual CUDA kernels, to speed up AI inference. He walks through a roughly 2x vLLM speedup on Qwen with a CoreWeave team, details the kernel generation search and the correctness checks needed for frontier-model-written kernels, and presents case studies including 11x faster world models, faster time-series and LLM serving, and customer-driven requirements.

Oct 08, 2026

$450K TO TRAIN A FRONTIER AI MODEL?

Thomson Reuters CTO Joel Hron explains why the company built Thomson, a domain-specific frontier model adapted from open-weight checkpoints like Qwen 3.5, using decades of proprietary legal and tax content and expert judgment. The conversation covers the training lifecycle from realignment and continual pre-training to agentic RL, the economics ($450K final run versus roughly $40M total), team structure, CoCounsel orchestration, verification challenges in legal and tax, and the future balance between open-weight and frontier models.

Sep 23, 2026

Skill issue: stop deploying vision language models, use them with Skills — Merve Noyan, Hugging Face

Merve Noyan discusses the pitfalls of directly using large Vision Language Models (VLMs) at runtime due to performance limitations and restrictive licensing. She introduces "Web Vision," a toolkit that enables efficient training of smaller, task-specific computer vision models using a novel "vibe training" methodology. This approach leverages VLMs for initial labeling and judgment, followed by training efficient models like RF-DETR, all while adhering to Apache 2.0 licenses and costing only a few dollars.

Jun 29, 2026

Frontier results, on device - RL Nabors, Arize

RL Nabors discusses the significant costs associated with using frontier AI models, covering security, latency, and financial implications. She introduces a framework for right-sizing AI solutions by leveraging smaller, task-specific models and Small Language Models (SLMs). The framework details how to prove task feasibility, establish success criteria with golden datasets, conduct capability evaluations (using tools like Phoenix), and select the most appropriate "Small And Good Enough" (SAGE) model. Nabors further demonstrates how prompt engineering, particularly few-shot prompting, and post-processing can close performance gaps with larger models, while advocating for continuous regression evaluations to maintain performance integrity. The overarching message is to "prototype big, deploy small" to optimize AI deployments.