Files of Actionable metrics guide
wondelai/
metrics.md
Show the full text270 lines
Actionable Metrics Guide
Metrics are the language of validated learning. The wrong metrics create the illusion of progress while the startup drifts toward failure. The right metrics force honest conversations and drive real decisions. This guide covers how to select, implement, and use metrics that actually matter.
Actionable vs Vanity Metrics
Vanity Metrics
Vanity metrics make you feel good but do not inform decisions. They go up and to the right even when the product is failing.
Common vanity metrics:
- Total registered users (includes dead accounts)
- Total page views (says nothing about engagement quality)
- Total downloads (says nothing about retention)
- Total revenue without context (growing because of more users, not better product)
- Social media followers (does not correlate with business outcomes)
- Press mentions (feels good, rarely converts)
Why they are dangerous: Vanity metrics can be manipulated, misinterpreted, and used to justify continuing a failing strategy. A startup with 100,000 registered users and 500 active users is failing, but the first number gets reported to investors.
Actionable Metrics
Actionable metrics directly inform decisions. If the metric changes, you change your behavior.
Properties of actionable metrics:
- Tied to a specific, repeatable action
- Measured per cohort, not in aggregate
- Have a clear cause-and-effect relationship with product changes
- Can be independently verified
Examples of actionable metrics:
| Vanity Version | Actionable Version | Why It Is Better |
|---|---|---|
| Total users | Weekly new signups by acquisition channel | Shows which channels work and whether growth is accelerating |
| Total revenue | Revenue per user by cohort | Shows whether product improvements increase monetization |
| Page views | Pages per session by user segment | Shows engagement depth and content effectiveness |
| App downloads | Day-7 retention rate by cohort | Shows whether users find lasting value |
| Email subscribers | Email open rate by campaign type | Shows content relevance and audience engagement |
The Three A's of Metrics
Every metric you track should pass the Three A's test:
Actionable
A metric is actionable if it demonstrates clear cause and effect. When you make a product change and the metric moves, you can attribute the change to your action.
Test: "If this metric drops by 20%, do I know what to do?" If the answer is no, the metric is not actionable.
Example: Onboarding completion rate is actionable. If it drops, you investigate and fix the onboarding flow. Total signups is less actionable because it depends on marketing spend, seasonality, and press coverage.
Accessible
A metric is accessible if the entire team can understand it and access it easily.
Test: "Can every team member explain what this metric means and find the current value in under 60 seconds?"
Implementation:
- Use simple, human-readable dashboards
- Display metrics on a shared screen or Slack channel
- Define every metric in a shared glossary
- Avoid jargon and complex calculations in primary dashboards
- Report metrics in absolute numbers alongside percentages (percentages without context mislead)
Auditable
A metric is auditable if the data can be verified and traced to individual customer behavior.
Test: "Can I look at the underlying data and verify this number is correct? Can I talk to real customers whose behavior contributed to this metric?"
Implementation:
- Ensure data pipelines are transparent and well-documented
- Maintain the ability to drill down from aggregate metrics to individual events
- Cross-check automated reports against manual spot checks periodically
- Keep raw event data accessible (do not only store aggregates)
Cohort Analysis Step-by-Step
Step 1: Define Your Cohort
A cohort groups users by a shared experience within a defined time window.
Common cohort definitions:
- Acquisition cohort: Users who signed up in the same week/month
- Behavioral cohort: Users who completed a specific action (e.g., made first purchase)
- Channel cohort: Users acquired through the same marketing channel
Step 2: Choose Your Metric
Select the metric that best reflects the hypothesis you are testing.
| Goal | Metric | Measurement |
|---|---|---|
| Product stickiness | Retention rate | % of users active in period N who return in period N+1 |
| Monetization | Revenue per user | Total cohort revenue divided by cohort size |
| Engagement | Core actions per user | Average number of key actions per active user per period |
| Growth | Referral rate | Number of invites sent that convert, per cohort member |
Step 3: Build the Cohort Table
Retention cohort table example:
| Signup Week | Size | Week 1 | Week 2 | Week 3 | Week 4 | Week 8 | Week 12 |
|---|---|---|---|---|---|---|---|
| Jan 1-7 | 200 | 42% | 28% | 22% | 18% | 12% | 9% |
| Jan 8-14 | 180 | 45% | 31% | 25% | 20% | 14% | 11% |
| Jan 15-21 | 220 | 48% | 35% | 28% | 23% | 16% | - |
| Jan 22-28 | 250 | 50% | 37% | 30% | 25% | - | - |
| Feb 1-7 | 230 | 53% | 39% | 32% | - | - | - |
Step 4: Read the Table
Read across rows: How does a single cohort degrade over time? This is the retention curve. Steeper = worse retention.
Read down columns: How do newer cohorts compare to older ones at the same age? Improving = product is getting better. Declining = product is getting worse.
The key insight: If newer cohorts retain better at the same age, your product improvements are working. If they retain worse, something is going wrong despite growth.
Step 5: Act on Findings
| Pattern | What It Means | Action |
|---|---|---|
| Newer cohorts retain better | Product improvements are working | Continue current strategy; double down on winning changes |
| Newer cohorts retain worse | Product or acquisition quality is declining | Investigate recent changes; audit acquisition channels |
| Retention flattens at a certain week | Product has a natural engagement ceiling | Focus on deepening value for retained users |
| Retention drops sharply in Week 1 | Onboarding or first-use experience is broken | Redesign activation flow |
| Later cohorts are larger but retain worse | Growth is outpacing product quality | Slow growth; fix retention before scaling |
Pirate Metrics (AARRR) Aligned With Lean Startup
Dave McClure's Pirate Metrics framework maps cleanly to lean startup stages:
Acquisition
Question: How do users find you?
| Metric | Formula | Good Benchmark |
|---|---|---|
| Visitor-to-signup rate | Signups / Unique visitors | 2-5% for B2C, 5-15% for B2B |
| Cost per acquisition (CPA) | Marketing spend / New signups | Varies by industry; must be below LTV |
| Channel mix | % of signups by source | No single channel > 50% (diversification) |
Activation
Question: Do users have a great first experience?
| Metric | Formula | Good Benchmark |
|---|---|---|
| Onboarding completion rate | Users completing setup / Signups | 60-80% |
| Time to first value | Time from signup to core action | Under 5 minutes for consumer; under 1 day for B2B |
| Aha moment conversion | Users reaching key milestone / Signups | 40-70% |
Retention
Question: Do users come back?
| Metric | Formula | Good Benchmark |
|---|---|---|
| Day 1 / Day 7 / Day 30 retention | Active on Day N / Cohort size | Varies by category (see below) |
| Weekly active / Monthly active ratio | WAU / MAU | 25%+ is healthy |
| Churn rate | Users lost / Total users per period | Under 5% monthly for SaaS |
Retention benchmarks by category:
| Category | Day 1 | Day 7 | Day 30 |
|---|---|---|---|
| Social/messaging | 50-70% | 30-50% | 20-35% |
| E-commerce | 25-40% | 10-20% | 5-15% |
| SaaS (B2B) | 80-95% | 70-85% | 60-80% |
| Mobile gaming | 35-50% | 15-25% | 5-15% |
| Productivity tools | 40-60% | 25-40% | 15-30% |
Revenue
Question: How do you make money?
| Metric | Formula | Good Benchmark |
|---|---|---|
| Average revenue per user (ARPU) | Total revenue / Active users | Depends on pricing model |
| Lifetime value (LTV) | ARPU multiplied by average lifespan | 3x+ CAC |
| Conversion to paid | Paid users / Total active users | 2-5% freemium; 15-30% free trial |
| Net revenue retention | (Starting MRR + expansion - contraction - churn) / Starting MRR | 100%+ for B2B SaaS |
Referral
Question: Do users tell others?
| Metric | Formula | Good Benchmark |
|---|---|---|
| Viral coefficient (K) | Invites per user multiplied by conversion rate of invites | Above 0.5 is strong; above 1.0 is viral |
| Net Promoter Score (NPS) | % Promoters minus % Detractors | 40+ is excellent |
| Referral rate | Users who refer / Total active users | 10%+ indicates strong word of mouth |
| Organic traffic share | Organic visits / Total visits | 40%+ suggests brand strength |
Metric Selection by Stage
Pre-Product-Market Fit
Focus on engagement and retention. Revenue metrics are premature.
Primary metrics:
- Retention (Week 1, Week 4 by cohort)
- Core action completion rate
- Qualitative: Sean Ellis test ("How would you feel if you could no longer use this product?")
- NPS from active users
- Session frequency
Do not optimize: CAC, LTV, revenue, viral coefficient. These are meaningless without product-market fit.
Post-Product-Market Fit (Pre-Scale)
Focus on unit economics and channel efficiency.
Primary metrics:
- LTV and LTV/CAC ratio
- CAC by channel
- Monthly retention and churn by cohort
- Revenue per user trends
- Activation rate
Do not optimize: Brand awareness, market share, total revenue. Scale metrics come after unit economics are healthy.
Growth Stage
Focus on efficiency at scale and sustainable growth.
Primary metrics:
- Net revenue retention
- Payback period (months to recover CAC)
- Gross margin
- Growth rate (month over month)
- Channel saturation indicators
Dashboard Design Principles
Principle 1: One Page, One Story
Each dashboard should answer one question. Do not combine acquisition, engagement, and revenue on a single screen. Create separate views for separate questions.
Principle 2: Show Trends, Not Snapshots
A single number is meaningless without context. Always show the metric over time (at least 8 weeks) and compare to the previous period.
Principle 3: Cohort by Default
Default views should show cohort data. Aggregate views should require a deliberate click or toggle. This prevents the team from accidentally reading vanity numbers.
Principle 4: Include Absolute Numbers
Percentages without absolute numbers mislead. "50% conversion rate" sounds great until you learn the sample was 4 users. Always show both the percentage and the underlying count.
Principle 5: Highlight Decisions, Not Data
Add annotations to the dashboard showing when experiments launched. This creates a visual connection between actions and results.
Common Metric Mistakes and Corrections
| Mistake | Why It Is Wrong | Correction |
|---|---|---|
| Tracking 30+ metrics simultaneously | Attention is diluted; team cannot focus | Pick 3-5 primary metrics per stage |
| Celebrating total user growth while retention declines | Growth masks product problems | Always lead with cohort retention |
| Measuring weekly without cohort segmentation | Cannot distinguish product improvement from marketing spend | Segment every metric by cohort |
| Setting metric targets after seeing results | Confirmation bias; any result looks like success | Set targets before running experiments |
| Ignoring qualitative data because "we have the numbers" | Numbers tell you what; interviews tell you why | Pair every quantitative metric with 5-10 customer conversations per month |
| Optimizing a metric that does not connect to business outcomes | Local optimization without global impact | Map every metric to a business outcome (retention to LTV, activation to retention, etc.) |
| Changing metric definitions mid-experiment | Results become incomparable | Lock definitions before experiments start; create new metrics if needed |
Good metrics create honest conversations. Bad metrics create comfortable delusions. The discipline of innovation accounting is choosing honesty over comfort.
| 1 | # Actionable Metrics Guide |
| 2 | |
| 3 | Metrics are the language of validated learning. The wrong metrics create the illusion of progress while the startup drifts toward failure. The right metrics force honest conversations and drive real decisions. This guide covers how to select, implement, and use metrics that actually matter. |
| 4 | |
| 5 | ## Actionable vs Vanity Metrics |
| 6 | |
| 7 | ### Vanity Metrics |
| 8 | |
| 9 | Vanity metrics make you feel good but do not inform decisions. They go up and to the right even when the product is failing. |
| 10 | |
| 11 | **Common vanity metrics:** |
| 12 | Total registered users (includes dead accounts) |
| 13 | Total page views (says nothing about engagement quality) |
| 14 | Total downloads (says nothing about retention) |
| 15 | Total revenue without context (growing because of more users, not better product) |
| 16 | Social media followers (does not correlate with business outcomes) |
| 17 | Press mentions (feels good, rarely converts) |
| 18 | |
| 19 | **Why they are dangerous:** Vanity metrics can be manipulated, misinterpreted, and used to justify continuing a failing strategy. A startup with 100,000 registered users and 500 active users is failing, but the first number gets reported to investors. |
| 20 | |
| 21 | ### Actionable Metrics |
| 22 | |
| 23 | Actionable metrics directly inform decisions. If the metric changes, you change your behavior. |
| 24 | |
| 25 | **Properties of actionable metrics:** |
| 26 | Tied to a specific, repeatable action |
| 27 | Measured per cohort, not in aggregate |
| 28 | Have a clear cause-and-effect relationship with product changes |
| 29 | Can be independently verified |
| 30 | |
| 31 | **Examples of actionable metrics:** |
| 32 | |
| 33 | | Vanity Version | Actionable Version | Why It Is Better | |
| 34 | |---------------|-------------------|-----------------| |
| 35 | | Total users | Weekly new signups by acquisition channel | Shows which channels work and whether growth is accelerating | |
| 36 | | Total revenue | Revenue per user by cohort | Shows whether product improvements increase monetization | |
| 37 | | Page views | Pages per session by user segment | Shows engagement depth and content effectiveness | |
| 38 | | App downloads | Day-7 retention rate by cohort | Shows whether users find lasting value | |
| 39 | | Email subscribers | Email open rate by campaign type | Shows content relevance and audience engagement | |
| 40 | |
| 41 | ## The Three A's of Metrics |
| 42 | |
| 43 | Every metric you track should pass the Three A's test: |
| 44 | |
| 45 | ### Actionable |
| 46 | |
| 47 | A metric is actionable if it demonstrates clear cause and effect. When you make a product change and the metric moves, you can attribute the change to your action. |
| 48 | |
| 49 | **Test:** "If this metric drops by 20%, do I know what to do?" If the answer is no, the metric is not actionable. |
| 50 | |
| 51 | **Example:** Onboarding completion rate is actionable. If it drops, you investigate and fix the onboarding flow. Total signups is less actionable because it depends on marketing spend, seasonality, and press coverage. |
| 52 | |
| 53 | ### Accessible |
| 54 | |
| 55 | A metric is accessible if the entire team can understand it and access it easily. |
| 56 | |
| 57 | **Test:** "Can every team member explain what this metric means and find the current value in under 60 seconds?" |
| 58 | |
| 59 | **Implementation:** |
| 60 | Use simple, human-readable dashboards |
| 61 | Display metrics on a shared screen or Slack channel |
| 62 | Define every metric in a shared glossary |
| 63 | Avoid jargon and complex calculations in primary dashboards |
| 64 | Report metrics in absolute numbers alongside percentages (percentages without context mislead) |
| 65 | |
| 66 | ### Auditable |
| 67 | |
| 68 | A metric is auditable if the data can be verified and traced to individual customer behavior. |
| 69 | |
| 70 | **Test:** "Can I look at the underlying data and verify this number is correct? Can I talk to real customers whose behavior contributed to this metric?" |
| 71 | |
| 72 | **Implementation:** |
| 73 | Ensure data pipelines are transparent and well-documented |
| 74 | Maintain the ability to drill down from aggregate metrics to individual events |
| 75 | Cross-check automated reports against manual spot checks periodically |
| 76 | Keep raw event data accessible (do not only store aggregates) |
| 77 | |
| 78 | ## Cohort Analysis Step-by-Step |
| 79 | |
| 80 | ### Step 1: Define Your Cohort |
| 81 | |
| 82 | A cohort groups users by a shared experience within a defined time window. |
| 83 | |
| 84 | **Common cohort definitions:** |
| 85 | **Acquisition cohort:** Users who signed up in the same week/month |
| 86 | **Behavioral cohort:** Users who completed a specific action (e.g., made first purchase) |
| 87 | **Channel cohort:** Users acquired through the same marketing channel |
| 88 | |
| 89 | ### Step 2: Choose Your Metric |
| 90 | |
| 91 | Select the metric that best reflects the hypothesis you are testing. |
| 92 | |
| 93 | | Goal | Metric | Measurement | |
| 94 | |------|--------|-------------| |
| 95 | | Product stickiness | Retention rate | % of users active in period N who return in period N+1 | |
| 96 | | Monetization | Revenue per user | Total cohort revenue divided by cohort size | |
| 97 | | Engagement | Core actions per user | Average number of key actions per active user per period | |
| 98 | | Growth | Referral rate | Number of invites sent that convert, per cohort member | |
| 99 | |
| 100 | ### Step 3: Build the Cohort Table |
| 101 | |
| 102 | **Retention cohort table example:** |
| 103 | |
| 104 | | Signup Week | Size | Week 1 | Week 2 | Week 3 | Week 4 | Week 8 | Week 12 | |
| 105 | |------------|------|--------|--------|--------|--------|--------|---------| |
| 106 | | Jan 1-7 | 200 | 42% | 28% | 22% | 18% | 12% | 9% | |
| 107 | | Jan 8-14 | 180 | 45% | 31% | 25% | 20% | 14% | 11% | |
| 108 | | Jan 15-21 | 220 | 48% | 35% | 28% | 23% | 16% | - | |
| 109 | | Jan 22-28 | 250 | 50% | 37% | 30% | 25% | - | - | |
| 110 | | Feb 1-7 | 230 | 53% | 39% | 32% | - | - | - | |
| 111 | |
| 112 | ### Step 4: Read the Table |
| 113 | |
| 114 | **Read across rows:** How does a single cohort degrade over time? This is the retention curve. Steeper = worse retention. |
| 115 | |
| 116 | **Read down columns:** How do newer cohorts compare to older ones at the same age? Improving = product is getting better. Declining = product is getting worse. |
| 117 | |
| 118 | **The key insight:** If newer cohorts retain better at the same age, your product improvements are working. If they retain worse, something is going wrong despite growth. |
| 119 | |
| 120 | ### Step 5: Act on Findings |
| 121 | |
| 122 | | Pattern | What It Means | Action | |
| 123 | |---------|--------------|--------| |
| 124 | | Newer cohorts retain better | Product improvements are working | Continue current strategy; double down on winning changes | |
| 125 | | Newer cohorts retain worse | Product or acquisition quality is declining | Investigate recent changes; audit acquisition channels | |
| 126 | | Retention flattens at a certain week | Product has a natural engagement ceiling | Focus on deepening value for retained users | |
| 127 | | Retention drops sharply in Week 1 | Onboarding or first-use experience is broken | Redesign activation flow | |
| 128 | | Later cohorts are larger but retain worse | Growth is outpacing product quality | Slow growth; fix retention before scaling | |
| 129 | |
| 130 | ## Pirate Metrics (AARRR) Aligned With Lean Startup |
| 131 | |
| 132 | Dave McClure's Pirate Metrics framework maps cleanly to lean startup stages: |
| 133 | |
| 134 | ### Acquisition |
| 135 | |
| 136 | **Question:** How do users find you? |
| 137 | |
| 138 | | Metric | Formula | Good Benchmark | |
| 139 | |--------|---------|----------------| |
| 140 | | Visitor-to-signup rate | Signups / Unique visitors | 2-5% for B2C, 5-15% for B2B | |
| 141 | | Cost per acquisition (CPA) | Marketing spend / New signups | Varies by industry; must be below LTV | |
| 142 | | Channel mix | % of signups by source | No single channel > 50% (diversification) | |
| 143 | |
| 144 | ### Activation |
| 145 | |
| 146 | **Question:** Do users have a great first experience? |
| 147 | |
| 148 | | Metric | Formula | Good Benchmark | |
| 149 | |--------|---------|----------------| |
| 150 | | Onboarding completion rate | Users completing setup / Signups | 60-80% | |
| 151 | | Time to first value | Time from signup to core action | Under 5 minutes for consumer; under 1 day for B2B | |
| 152 | | Aha moment conversion | Users reaching key milestone / Signups | 40-70% | |
| 153 | |
| 154 | ### Retention |
| 155 | |
| 156 | **Question:** Do users come back? |
| 157 | |
| 158 | | Metric | Formula | Good Benchmark | |
| 159 | |--------|---------|----------------| |
| 160 | | Day 1 / Day 7 / Day 30 retention | Active on Day N / Cohort size | Varies by category (see below) | |
| 161 | | Weekly active / Monthly active ratio | WAU / MAU | 25%+ is healthy | |
| 162 | | Churn rate | Users lost / Total users per period | Under 5% monthly for SaaS | |
| 163 | |
| 164 | **Retention benchmarks by category:** |
| 165 | |
| 166 | | Category | Day 1 | Day 7 | Day 30 | |
| 167 | |----------|-------|-------|--------| |
| 168 | | Social/messaging | 50-70% | 30-50% | 20-35% | |
| 169 | | E-commerce | 25-40% | 10-20% | 5-15% | |
| 170 | | SaaS (B2B) | 80-95% | 70-85% | 60-80% | |
| 171 | | Mobile gaming | 35-50% | 15-25% | 5-15% | |
| 172 | | Productivity tools | 40-60% | 25-40% | 15-30% | |
| 173 | |
| 174 | ### Revenue |
| 175 | |
| 176 | **Question:** How do you make money? |
| 177 | |
| 178 | | Metric | Formula | Good Benchmark | |
| 179 | |--------|---------|----------------| |
| 180 | | Average revenue per user (ARPU) | Total revenue / Active users | Depends on pricing model | |
| 181 | | Lifetime value (LTV) | ARPU multiplied by average lifespan | 3x+ CAC | |
| 182 | | Conversion to paid | Paid users / Total active users | 2-5% freemium; 15-30% free trial | |
| 183 | | Net revenue retention | (Starting MRR + expansion - contraction - churn) / Starting MRR | 100%+ for B2B SaaS | |
| 184 | |
| 185 | ### Referral |
| 186 | |
| 187 | **Question:** Do users tell others? |
| 188 | |
| 189 | | Metric | Formula | Good Benchmark | |
| 190 | |--------|---------|----------------| |
| 191 | | Viral coefficient (K) | Invites per user multiplied by conversion rate of invites | Above 0.5 is strong; above 1.0 is viral | |
| 192 | | Net Promoter Score (NPS) | % Promoters minus % Detractors | 40+ is excellent | |
| 193 | | Referral rate | Users who refer / Total active users | 10%+ indicates strong word of mouth | |
| 194 | | Organic traffic share | Organic visits / Total visits | 40%+ suggests brand strength | |
| 195 | |
| 196 | ## Metric Selection by Stage |
| 197 | |
| 198 | ### Pre-Product-Market Fit |
| 199 | |
| 200 | Focus on engagement and retention. Revenue metrics are premature. |
| 201 | |
| 202 | **Primary metrics:** |
| 203 | Retention (Week 1, Week 4 by cohort) |
| 204 | Core action completion rate |
| 205 | Qualitative: Sean Ellis test ("How would you feel if you could no longer use this product?") |
| 206 | NPS from active users |
| 207 | Session frequency |
| 208 | |
| 209 | **Do not optimize:** CAC, LTV, revenue, viral coefficient. These are meaningless without product-market fit. |
| 210 | |
| 211 | ### Post-Product-Market Fit (Pre-Scale) |
| 212 | |
| 213 | Focus on unit economics and channel efficiency. |
| 214 | |
| 215 | **Primary metrics:** |
| 216 | LTV and LTV/CAC ratio |
| 217 | CAC by channel |
| 218 | Monthly retention and churn by cohort |
| 219 | Revenue per user trends |
| 220 | Activation rate |
| 221 | |
| 222 | **Do not optimize:** Brand awareness, market share, total revenue. Scale metrics come after unit economics are healthy. |
| 223 | |
| 224 | ### Growth Stage |
| 225 | |
| 226 | Focus on efficiency at scale and sustainable growth. |
| 227 | |
| 228 | **Primary metrics:** |
| 229 | Net revenue retention |
| 230 | Payback period (months to recover CAC) |
| 231 | Gross margin |
| 232 | Growth rate (month over month) |
| 233 | Channel saturation indicators |
| 234 | |
| 235 | ## Dashboard Design Principles |
| 236 | |
| 237 | ### Principle 1: One Page, One Story |
| 238 | |
| 239 | Each dashboard should answer one question. Do not combine acquisition, engagement, and revenue on a single screen. Create separate views for separate questions. |
| 240 | |
| 241 | ### Principle 2: Show Trends, Not Snapshots |
| 242 | |
| 243 | A single number is meaningless without context. Always show the metric over time (at least 8 weeks) and compare to the previous period. |
| 244 | |
| 245 | ### Principle 3: Cohort by Default |
| 246 | |
| 247 | Default views should show cohort data. Aggregate views should require a deliberate click or toggle. This prevents the team from accidentally reading vanity numbers. |
| 248 | |
| 249 | ### Principle 4: Include Absolute Numbers |
| 250 | |
| 251 | Percentages without absolute numbers mislead. "50% conversion rate" sounds great until you learn the sample was 4 users. Always show both the percentage and the underlying count. |
| 252 | |
| 253 | ### Principle 5: Highlight Decisions, Not Data |
| 254 | |
| 255 | Add annotations to the dashboard showing when experiments launched. This creates a visual connection between actions and results. |
| 256 | |
| 257 | ## Common Metric Mistakes and Corrections |
| 258 | |
| 259 | | Mistake | Why It Is Wrong | Correction | |
| 260 | |---------|----------------|------------| |
| 261 | | Tracking 30+ metrics simultaneously | Attention is diluted; team cannot focus | Pick 3-5 primary metrics per stage | |
| 262 | | Celebrating total user growth while retention declines | Growth masks product problems | Always lead with cohort retention | |
| 263 | | Measuring weekly without cohort segmentation | Cannot distinguish product improvement from marketing spend | Segment every metric by cohort | |
| 264 | | Setting metric targets after seeing results | Confirmation bias; any result looks like success | Set targets before running experiments | |
| 265 | | Ignoring qualitative data because "we have the numbers" | Numbers tell you what; interviews tell you why | Pair every quantitative metric with 5-10 customer conversations per month | |
| 266 | | Optimizing a metric that does not connect to business outcomes | Local optimization without global impact | Map every metric to a business outcome (retention to LTV, activation to retention, etc.) | |
| 267 | | Changing metric definitions mid-experiment | Results become incomparable | Lock definitions before experiments start; create new metrics if needed | |
| 268 | |
| 269 | Good metrics create honest conversations. Bad metrics create comfortable delusions. The discipline of innovation accounting is choosing honesty over comfort. |
| 270 |
Discussion
Browse more free Claude skills.