Learn how W&B Weave's online evaluations enable real-time monitoring of AI applications in production, allowing teams to track performance, catch failures, and iterate on quality over time using LLM-as-a-judge scores.
This summary covers a deep dive into the paper "A Survey of Context Engineering for Large Language Models". The discussion reframes the conversation from simple prompt engineering to a more systematic approach of building information environments for LLMs. It explores the foundational components of context engineering—generation, processing, and management—and their application in advanced systems like Retrieval-Augmented Generation (RAG), memory, tool use, and multi-agent systems.
Tudor Girba introduces "Moldable Development," a paradigm where developers create thousands of custom tools to analyze and interact with their specific software context. He demonstrates this live using Glamorous Toolkit, transforming an unstructured text file into a browsable system with custom views, all within minutes.
Experts from IBM X-Force discuss the alleged retirement of the Scattered Lapsus$ Hunters cybercrime gang, the ethics and implications of AI-powered ransomware, critical software supply chain vulnerabilities exposed by the recent npm hack, growing threats to Operational Technology (OT), and the emergence of AI-driven hiring fraud.
Edwin Chen, founder and CEO of Surge AI, shares the company's origin story, its rapid, bootstrapped growth, and its research-driven philosophy on data. He critiques traditional data labeling, explains why metrics like inter-annotator agreement fail for complex tasks, and offers a sharp analysis of benchmark hacking. Chen also details the future of data, from multimodal and agentic reasoning in rich RL environments to the need for hyper-specialized expertise for scientific discovery.
Box CEO Aaron Levie discusses the paradigm shift from cloud to AI, arguing that AI will augment jobs by automating non-strategic work and create massive opportunities for startups to tackle previously unsolvable problems with unstructured data. He covers the evolution of SaaS business models, the 'build vs. buy' debate, and offers key advice for founders in the AI era.