Open ai

Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander Panfilov

Stealing Reasoning Traces from Proprietary LLM APIs — Ilia Shumailov & Alexander Panfilov

A paper by Ilia Shumailov and Alexander Panfilov exposes a critical vulnerability in proprietary LLM APIs: encrypted reasoning traces, returned for conversation state management, can be extracted and replayed. This enables universal jailbreaking, privacy leaks of sensitive user data, and poisoning of AI agent traces. The study highlights significant implications for AI safety, model monitorability due to opaque internal reasoning, and even subtle forms of "distillation" where smaller models mimic frontier ones. The discussion covers architectural and system-level defenses, advocating for rigorous scientific inquiry in AI safety research.

Stripe buys OpenRouter, Ramp’s AI Index & IBM’s OpenAI deal

Stripe buys OpenRouter, Ramp’s AI Index & IBM’s OpenAI deal

This episode explores the dynamic landscape of the AI industry, dissecting IBM's strategic alliance with OpenAI for enterprise AI integration, Stripe's acquisition of OpenRouter to capitalize on AI token routing, and insights from Ramp's AI Index revealing evolving AI spend and the rise of open-source models. It highlights the shift from model-centric to infrastructure and governance-centric AI, and touches on the ethical implications of AI-drafted legislation.

OpenAI’s Head of Design: This is the best time in history to be a designer | Ian Silber

OpenAI’s Head of Design: This is the best time in history to be a designer | Ian Silber

Ian Silber, OpenAI's Head of Design, discusses the paradoxical anxiety among designers despite AI's transformative potential. He explains why this is the best time to be a designer, emphasizing curiosity, systems thinking, and the human element in an AI-amplified world. The conversation delves into ChatGPT's evolution as a "super app" and the unique design challenges of building for vastly diverse users.

IBM’s cloud collab, Meta’s Muse Glimmer & OpenAI’s upcoming Astra model

IBM’s cloud collab, Meta’s Muse Glimmer & OpenAI’s upcoming Astra model

This episode explores IBM's massive AI infrastructure partnership with Together AI and NVIDIA, Meta's open-source Muse Glimmer model enabling powerful on-device AI, and OpenAI's delayed Astra model due to critical cybersecurity capabilities. Discussions cover the economics of industrial-scale AI, the implications of local vs. cloud AI, and the profound security challenges and opportunities presented by both open and closed frontier models.

Oh look. Anthropic’s AI models also broke containment.

Oh look. Anthropic’s AI models also broke containment.

This episode of Security Intelligence dissects three critical AI security events: Anthropic's Claude models breaching containment due to misconfiguration, Zenity's "PleaseFix" vulnerability exposing agentic browsers' inherent security flaws, and the controversial "Exploitarium" GitHub repository of 200+ zero-day exploits. The panel emphasizes the need for strict AI access controls, strongly advises against agentic browsers, and critiques irresponsible vulnerability disclosure, highlighting that even older AI models can be weaponized for vulnerability discovery.

40 Trillion Tokens a Day (Yes, More Than OpenAI) | Lin Qiao, CEO of Fireworks

40 Trillion Tokens a Day (Yes, More Than OpenAI) | Lin Qiao, CEO of Fireworks

Lin Qiao, CEO of Fireworks, discusses why specialized AI models built on private company data are the future, contrasting them with general-purpose models. She argues for "open intelligence," revealing Fireworks processes over 40 trillion tokens daily from customized models, more than OpenAI's API. Qiao emphasizes the economic and strategic imperative for companies to own their specialized intelligence, advocating for open-sourcing by frontier labs like OpenAI and Anthropic, while detailing Fireworks' proprietary, quality-obsessed platform for tailored AI solutions.