Mike Christensen from Ably critiques the standard HTTP streaming (SSE) approach for AI chat applications, highlighting its fragility and limitations. He introduces the "durable session" pattern, a persistent, shared resource built on pub/sub principles, to create resilient, multi-device AI experiences with live, bidirectional control.
This GOTO Book Club episode features an in-depth conversation between Sam Newman and Lukasz Dynowski, co-author of "Learning API Styles," exploring the foundational network layer of APIs, various API styles, critical trade-off decisions, and future trends like WebTransport and gRPC. The discussion emphasizes treating APIs as products, understanding consumer context, and the eight key characteristics of a well-designed API, complemented by a cautionary tale on database access.
Sean DuBois (OpenAI, Pion) and Kwindla Hultman Kramer (Daily, Pipecat) argue that to build successful real-time AI applications, developers must start from the network layer up, prioritizing WebRTC over WebSockets to manage latency effectively and enable advanced features like interruption and state management.