W&B Models is the system of record for the entire model development lifecycle. This guide explores how to monitor training, tune hyperparameters, track artifacts and lineage for reproducibility, and automate MLOps workflows like evaluation and deployment using a central platform.
Lior Gavish, CTO and co-founder of Monte Carlo Data, discusses the critical transition from data observability to agent observability. He covers the widespread adoption of AI agents in data teams, the new challenges they introduce for monitoring, and why traditional tools fall short in providing the necessary insights into agent performance, security, and governance.
Jure Leskovec introduces Relational Foundation Models (RFMs), a new class of models based on graph neural networks that learn directly from raw, multi-table enterprise data. This approach bypasses manual feature engineering, leading to more accurate, faster-to-deploy, and easier-to-maintain predictive models for tasks like churn prediction, fraud detection, and recommendation systems.
Hitachi's Financial Business Unit developed a specialized LLM to automate the review of system design documents, addressing the inadequacy of general-purpose AI for mission-critical systems. This presentation details the model's development using Continued Pre-training and LoRA on proprietary data, its integration into a multi-agent architecture, and the use of Weights & Biases for MLOps, which led to a 70% reduction in manual review workload.
Drawing from their experience at Liberty Mutual, a Fortune 100 company, Garth Gilmour and Stuart Greenlees share nine hard-won lessons from deploying Generative AI for 5,000 developers. This "from the trenches" talk moves beyond the hype to discuss the real-world challenges of scaling AI, including managing spiraling costs, the complexities of RAG, the difference between shipping and adoption, and the necessity of building a governed platform. They detail their mistakes, solutions, and the evolution of their strategy for architecture, developer education, and model management.
A detailed overview of a modular, five-agent system designed to combat the entire lifecycle of digital misinformation. Based on an ICWSM research paper, this practitioner's guide details the roles of the Classifier, Indexer, Extractor, Corrector, and Verifier agents. The system emphasizes scalability, explainability, and high precision, moving beyond the limitations of single-LLM solutions. The talk covers the complete blueprint, from agent coordination and MLOps to holistic evaluation and optimization strategies for production environments.