Semantic routing

Guardians of the State: An Air-Gapped AI Fortress for Consumer Data — Rachna Srivastava, DFPI

Guardians of the State: An Air-Gapped AI Fortress for Consumer Data — Rachna Srivastava, DFPI

Rachna Srivastava discusses building a legally defensible AI system for financial fraud detection, emphasizing that generative AI has eroded traditional trust. Her team at DFPI engineered an offline, hardware-secured data pipeline using Kafka, Spark, and semantic routing to ensure explainability, reproducibility, and auditability. They implemented a one-way data diode for secure learning and Apache Iceberg for time-travel queries, asserting that "trust is a physical property" built into the system's core.

The 100-Tool Agent Is a Trap - Sohail Shaikh & Ankush Rastogi, Prosodica

The 100-Tool Agent Is a Trap - Sohail Shaikh & Ankush Rastogi, Prosodica

This session unveils the "Fat Agent" trap in LLM agent architectures, where loading an entire tool catalog into the system prompt causes severe latency, cost, and accuracy problems. It presents the Semantic Tool Router pattern, a practical solution leveraging Just-in-Time Context Injection and vector search (RAG for tools) to dynamically provide only relevant tools, dramatically reducing prompt size, enhancing performance, and improving reliability across frontier models like GPT-4o and Gemini 2.0.