Harbor

Shipping AI Into 5 Major Banks Without a 12-Month Compliance Wait — Al Chen, Cisco

Shipping AI Into 5 Major Banks Without a 12-Month Compliance Wait — Al Chen, Cisco

Al Chen explains what it takes to get AI observability software through the security and compliance reviews of major banks. He covers build pipelines, agent-driven CVE remediation with verifiable exploit tests, ClickHouse backup and restore verification, PII and MNPI leakage through LLM judges, and the tradeoffs of zero leakage and data sovereignty, with an emphasis on showing evidence to shorten time to production.

When to Build Your Own Agent Harness | Harrison Chase, LangChain

When to Build Your Own Agent Harness | Harrison Chase, LangChain

Harrison Chase, co-founder of LangChain, delves into the critical role of the 'harness' in LLM agents, explaining how it orchestrates models and context. He covers customizing harnesses with middleware and sub-agents, the trade-offs between off-the-shelf and custom solutions for in- and out-of-distribution tasks, and the importance of evaluations and observability for continuous agent improvement. The discussion culminates in the 'data flywheel' concept and the `LangSmith Engine` for automating agent intelligence through iterative refinement.