Streaming

Real-time Feature Generation at Lyft // Rakesh Kumar // MLOps Podcast #334

Real-time Feature Generation at Lyft // Rakesh Kumar // MLOps Podcast #334

Rakesh Kumar from Lyft details the evolution of their real-time feature generation platform, from cron jobs to a sophisticated streaming architecture using Apache Beam and Flink. Key discussions include solving the 'hot shard' problem with geohashes, building a custom geospatial feature store, and optimizing pipelines with YAML-based configurations.