Learn how W&B Weave's online evaluations enable real-time monitoring of AI applications in production, allowing teams to track performance, catch failures, and iterate on quality over time using LLM-as-a-judge scores.
This summary covers a deep dive into the paper "A Survey of Context Engineering for Large Language Models". The discussion reframes the conversation from simple prompt engineering to a more systematic approach of building information environments for LLMs. It explores the foundational components of context engineering—generation, processing, and management—and their application in advanced systems like Retrieval-Augmented Generation (RAG), memory, tool use, and multi-agent systems.
Experts from IBM X-Force discuss the alleged retirement of the Scattered Lapsus$ Hunters cybercrime gang, the ethics and implications of AI-powered ransomware, critical software supply chain vulnerabilities exposed by the recent npm hack, growing threats to Operational Technology (OT), and the emergence of AI-driven hiring fraud.
A deep dive into the architectural and economic foundations of memory for AI agents. The talk explores the core tradeoffs between classical data storage and dynamic agent behavior, introduces a human-inspired framework for memory, and discusses practical strategies and future directions for building reliable, evolving AI systems.
Jerry from LlamaIndex explains why naive Retrieval-Augmented Generation (RAG) fails in production and dives deep into advanced data quality techniques—from parsing complex documents and hierarchical indexing to chunking best practices—required to build robust, high-quality LLM applications.
Dell's Shirish Gupta and Ish Shah discuss the complexities developers face in leveraging on-device accelerators like NPUs and GPUs. They introduce Dell ProAI Studio, a solution designed to abstract away hardware-specific toolchains, enabling developers to easily run AI workloads locally for benefits like speed, cost, security, and offline capability.