Real time ai

Runway’s Bet Beyond Video: World Models, Robotics, and the Neural OS — Anastasis Germanidis

Runway’s Bet Beyond Video: World Models, Robotics, and the Neural OS — Anastasis Germanidis

Anastasis Germanidis, co-founder of Runway, discusses the company's journey from early generative creative tools to frontier video models, emphasizing their pivot towards general-purpose world simulation. He details the evolution of Gen-1, Gen-2, and Gen-3 (scaling 10x after Sora's release), highlighting the importance of controllability and the inevitability of real-time generation. The conversation delves into cutting-edge applications like Interface World Models (a fully neural operating system) and World Models for Robotics, where third-person video data and robust simulation are key to training intelligent agents.

How Real-Time AI Video Is Changing How Creators Work

How Real-Time AI Video Is Changing How Creators Work

fal's H3 Max significantly accelerates generative video, achieving real-time capabilities and substantial cost reductions through advanced model post-training and system optimizations. The discussion covers its technical "secret sauce," the emergence of continuous, controllable video experiences like H3 Max Director, and fal's strategic shift to focus on granular controllability and quality for professional Hollywood workflows, including precise camera, lighting, and motion controls.

Realtime Voice Agents with Frontier Intelligence — Bohan Li, EliseAI

Realtime Voice Agents with Frontier Intelligence — Bohan Li, EliseAI

Bohan Li of EliseAI unveils a sophisticated architecture for real-time voice agents that merges high intelligence with low latency, akin to a self-driving car's perception, planning, and control systems. Key innovations include a speculative transcriber combining fast streaming with accurate contextual correction, background agents for offloading LLM tool calls and enabling eager generation, and a clever prefix cache for speech synthesis that seamlessly blends pre-cached audio with dynamically generated speech to mask underlying processing delays.

Going In Deep On Data | YC Paper Club

Going In Deep On Data | YC Paper Club

Three experts discuss the evolving landscape of data in AI, covering its critical role in model performance, challenges in sourcing and evaluating expert data, the development of advanced data generation techniques for diffusion models, and the complexities of multilingual pre-training.

Why Robotics Still Isn't Solved - But Could Be Soon | YC Paper Club

Why Robotics Still Isn't Solved - But Could Be Soon | YC Paper Club

This Paper Club delves into the current state of robotics, addressing roadblocks like the sim-to-real gap and embodiment drift. Speakers present advancements in multi-scale memory for long-horizon tasks, self-supervised embodied reasoning, zero-shot dexterous manipulation via massive simulation, and the economic imperative of teleoperation-first robotics companies, concluding with optimizations for efficient, real-time World Action Models.

The New Primitives: Building AI Native Software — Kwindla Kramer, Daily

The New Primitives: Building AI Native Software — Kwindla Kramer, Daily

Kwindla Hultman Kramer argues that current AI agents are akin to 1995 web pages – a foundational primitive, not the ultimate destination. Drawing a historical parallel, he predicts the emergence of "AI native software" that will build upon and surpass agents, much like web applications evolved from simple web pages. He illustrates this through computing history, highlighting transformative shifts like VisiCalc's impact on accounting and the vision of Apple's Knowledge Navigator, and concludes by showcasing a game, Gradient Bang, that demonstrates the core primitives of this future AI native software.