Varant Zanoyan and Nikhil Simha Raprolu of Zipline AI explain why traditional feature stores are the wrong abstraction. They detail the journey of Chronon, the open-source engine born at Airbnb and battle-tested at Stripe, which focuses on compute, orchestration, and real-time correctness to solve the hardest data engineering challenges in ML, from fraud detection to powering modern AI agents with features and embeddings.
David Jayatillake, VP of AI at Cube.dev, discusses the critical role of a headless, open-source semantic layer in the modern data stack. He argues against proprietary, BI-tool-specific semantic layers that create vendor lock-in and advocates for a decoupled approach. The conversation explores how AI agents can automate the entire data pipeline—from ingestion and transformation to generating and querying the semantic layer—and compares the functionalities of semantic layers and feature stores, highlighting the crucial difference of temporality.
Rakesh Kumar from Lyft details the evolution of their real-time feature generation platform, from cron jobs to a sophisticated streaming architecture using Apache Beam and Flink. Key discussions include solving the 'hot shard' problem with geohashes, building a custom geospatial feature store, and optimizing pipelines with YAML-based configurations.