Cohort analysis

Your Agents Need a Save Button - Hamza Tahir, ZenML

Your Agents Need a Save Button - Hamza Tahir, ZenML

Most AI agents lack a "save button" for persistent state, making debugging and optimization challenging. This talk introduces the concept of a durable runtime with checkpointing, allowing developers to replay agent executions, perform "what-if" analyses (e.g., swapping models, mocking tools), and conduct cohort-based evaluations using production data. The open-source tool Kitaru is demonstrated as a solution to build, debug, and improve agents at scale by capturing full execution state, not just traces.

See How Customers Actually Use Your Product

See How Customers Actually Use Your Product

Founders often make the mistake of relying on aggregate user metrics like DAU, which obscure how individuals truly use a product. This video introduces the 'dot plot,' a powerful visualization tool mapping individual user activity over time. It reveals hidden patterns, helps identify retention issues, and pinpoints features driving engagement, offering deeper insights than traditional metrics and proving invaluable for both B2C and B2B product health analysis.