See How Customers Actually Use Your Product
Founders often make the mistake of relying on aggregate user metrics like DAU, which obscure how individuals truly use a product. This video introduces the 'dot plot,' a powerful visualization tool mapping individual user activity over time. It reveals hidden patterns, helps identify retention issues, and pinpoints features driving engagement, offering deeper insights than traditional metrics and proving invaluable for both B2C and B2B product health analysis.
Founders often make the critical mistake of over-relying on aggregate user metrics like Daily Active Users (DAU) or Monthly Active Users (MAU). While these metrics can show growth, they frequently mask the true state of product engagement and user value, failing to answer how individual users interact, which features they utilize, or their frequency and pacing of use.
The Dot Plot: Visualizing Individual User Engagement
To address this limitation, the speaker introduces the ‘dot plot,’ a simple yet powerful visualization tool:
- Structure: It’s a two-dimensional grid. Each row represents a unique, individual user, and each column corresponds to a specific time period, typically a day. This daily granularity is crucial for capturing detailed usage patterns.
- Event Tracking: A ‘dot’ is placed in a cell when a user performs a chosen ‘value-representative’ event on that specific day. This event should signify that the user is gaining real value from the product (e.g., ’listening to a song’ for a music app, ‘sharing a photo’ for a photo app, ‘processing an invoice’ for a B2B tool). Low-value events like ‘opened the app’ or ‘signed in’ should be avoided as they inflate perceived engagement.
- Enriching Data: Dot plots can be enhanced by using different symbols (e.g., a ring for a user’s onboarding day) or shading to track user attributes or states (e.g., iOS vs. Android user, country of origin, demographic information). Rows can then be sorted based on these attributes, allowing for targeted analysis of specific user segments.
Key Insights and Benefits Derived from Dot Plots
This visualization tool provides profound insights that aggregate metrics cannot:
- Revealing Hidden Patterns: Dot plots enable the human brain to detect nuanced usage patterns. For instance, in a music streaming app, one might distinguish between ‘weekday worktime listeners’ and ‘weekend-only users,’ informing product development and user targeting strategies.
- Identifying Retention Issues: They quickly highlight users who try the product once and never return, signaling potential problems with onboarding, initial value proposition, or product stickiness.
- Understanding Feature Impact: By using distinct symbols for different features (e.g., ‘S’ for search, ‘P’ for playlist), founders can identify which specific features drive sustained engagement and retention. For example, joining a public playlist might correlate with a long streak of daily usage.
- Scalability for All User Sizes: While invaluable for early-stage startups with a small user base (where every user can be visualized), dot plots scale to millions or even billions of users. This is achieved by sampling specific user segments (e.g., ‘iOS users in France,’ ‘web users in the US making >$80,000/year’) and generating dot plots for these samples to analyze targeted cohorts.
- Early Churn Detection in B2B: For B2B products, dot plots are crucial for identifying at-risk contracts. An example shared illustrates an $80,000/year contract where only 3 of 10 purchased seats ever activated, and those sporadically. A dot plot would have clearly shown this low engagement, indicating high churn risk before the contract champion departed.
- Superiority over DAU Graphs: A direct comparison demonstrates that a flat or slightly growing DAU graph (e.g., 2, 3, 2, 2, 2, 2, 1, 0, 1) offers minimal insight, whereas the corresponding dot plot provides a rich understanding of diverse individual behaviors.
Common Mistakes to Avoid
To ensure effective use of dot plots, founders should:
- Select Value-Representative Events: Avoid tracking superficial actions like ‘app opened.’ Focus on actions where the user derives tangible value.
- Maintain Granular Time Periods: Opt for daily or even sub-daily granularity. Weekly periods obscure critical short-term usage patterns.
Complementary Analytics Tool
Dot plots are best used in conjunction with cohort retention curves. While cohort curves indicate if groups of users are retained over time, dot plots provide the qualitative understanding of how those individuals are actually using the product. Together, these two tools offer a comprehensive view of product health, enabling founders to ask targeted questions, prioritize feature development, and address product weaknesses that aggregate metrics alone would never reveal. The implementation is straightforward, primarily a logs visualization that modern AI coding tools can generate rapidly, and for early-stage companies, a dot plot can serve as the primary dashboard.