Open router

Stripe buys OpenRouter, Ramp’s AI Index & IBM’s OpenAI deal

Stripe buys OpenRouter, Ramp’s AI Index & IBM’s OpenAI deal

This episode explores the dynamic landscape of the AI industry, dissecting IBM's strategic alliance with OpenAI for enterprise AI integration, Stripe's acquisition of OpenRouter to capitalize on AI token routing, and insights from Ramp's AI Index revealing evolving AI spend and the rise of open-source models. It highlights the shift from model-centric to infrastructure and governance-centric AI, and touches on the ethical implications of AI-drafted legislation.

The State of Model Routing — NVIDIA, Cognition, OpenRouter

The State of Model Routing — NVIDIA, Cognition, OpenRouter

A deep dive into model routing strategies for AI/ML production, featuring experts from Cognition, OpenRouter, and NVIDIA. Key topics include optimizing costs with multi-model systems, delegating tasks between frontier and smaller models, managing context efficiently (sidekicks, compaction), and adapting to dynamic task complexities. The panel discusses the fragility of naive routing, the cost implications of in-distribution vs. out-of-distribution tasks, and the evolution of auto-routers driven by real-world usage patterns like OpenClaw's heartbeats. Insights also cover NVIDIA's Flex Run for dynamic model sizing, hallucination probes for detecting model limitations, and the future of hybrid local/cloud routing and model collaboration.