Building successful AI applications requires a sophisticated engineering approach that goes beyond prompt engineering. This involves creating intentionally engineered evaluations (evals) that reflect user feedback, focusing on "context engineering" to optimize tool definitions and outputs, and maintaining a flexible, model-agnostic architecture to adapt to the rapidly evolving AI landscape.
KREA.ai's cofounder Diego Rodriguez discusses the critical failure of current AI evaluation metrics in understanding human perception and aesthetics, advocating for a new paradigm of personalized, perceptually-aware evals.
BlackRock engineers Vaibhav Page and Infant Vasanth introduce a modular, Kubernetes-native AI framework designed to accelerate the development of custom knowledge applications for investment operations, reducing deployment time from months to days.
An exploration of designing AI-native user experiences by treating AI systems as "coworkers." This summary covers a framework for AI interaction (invisible, ambient, inline, conversational), a design philosophy based on "feeling the material" and "courting emergence," and novel UX patterns for collaborative AI tools.
Sourcegraph CTO Beyang Liu discusses the evolution from chat-based coding assistants to autonomous AI agents like AMP. He explains how new models with tool-use and reasoning capabilities are creating a paradigm shift, moving developers from micromanaging AI to instructing it at a high level, dramatically increasing productivity by automating complex coding tasks.
General Partners from a16z analyze the current AI landscape, revealing that AI companies are growing faster and larger than anticipated. They discuss the fragmentation of the market, the innovator's dilemma facing SaaS incumbents, and the emergence of new moats like brand. The conversation emphasizes a shift from hype to tangible ROI, citing examples like Cursor, and outlines a nuanced investment strategy for a market defined by both unprecedented growth and rapid wipeouts.