Ekaterina Gorshkova, author of "Kafka for Architects", discusses her journey with Apache Kafka, from its early adoption in enterprise integration to its modern role as a foundational layer for AI and ML systems. The conversation covers key architectural decisions, the limitations of Kafka, and why the real challenges are often organizational rather than technical.
Félix GV, architect of LinkedIn's Venice database, explains its unbundled, planetary-scale architecture. He covers their rigorous chaos engineering practices, the trade-offs between consistency and availability in a derived data system, and an experimental integration with DuckDB for advanced analytics and data exploration.
Jacqueline Cheong and Robin Tang, founders of real-time data streaming platform Artie, discuss their journey from identifying the critical need for fresh data at companies like OpenDoor to building a production-ready solution, acquiring their first major customer Substack via a cold email, and navigating the complex technical challenges of real-time data processing at scale.