Groq

AI Agents Don't Read Your Policy Docs. They Hit Your APIs — Gravitee

AI Agents Don't Read Your Policy Docs. They Hit Your APIs — Gravitee

Sam, CTO at Gravity, argues that AI agent governance must be enforced in infrastructure rather than in prompts or policy documents. Through five live demos against a hotel-booking agent, he shows a gateway blocking destructive tool calls, preventing data exfiltration, rate-limiting runaway agents, serving cached semantic responses, and rejecting oversized prompts before any LLM call. He also covers observability, vendor decoupling via LLM routing, trimming bloated MCP tool lists, and managing shadow AI.

The Inference Frontier: from 100 to 10,000 tokens per second — Sean Lie, Cerebras CTO

The Inference Frontier: from 100 to 10,000 tokens per second — Sean Lie, Cerebras CTO

Cerebras CTO Sean Lie discusses the

Podcast Crossover: AIE, AGI, frontier lab strategy with ​ ⁨@matthew_berman⁩  and @swyxtv

Podcast Crossover: AIE, AGI, frontier lab strategy with ​ ⁨@matthew_berman⁩ and @swyxtv

Matt, the organizer of the AI.engineer conference, shares insights into its origin, the challenges of early adoption, and its current value as a neutral ground for AI labs. He delves into AI hardware trends, discussing specialized chips like Etched, and gives a nuanced take on Anthropic's Fable, addressing performance concerns and compute limitations. The conversation then explores OpenAI's rumored equity offer to the US government, discussing implications for regulation and societal involvement. Matt shares his perspective on AI existential risk and alignment, emphasizing the need for pragmatic engineering solutions. Finally, he outlines the limitations of current LLMs, the critical need for data efficiency, and offers strategic advice for "Agent Labs" navigating the "model capability overhang" versus multi-model agnosticism.