According to my research I think Airbnb, Facebook, and Slack each chose a North Star metric to show whether people were actually getting value from their product. Airbnb for example focused on nights booked because it reflected completed stays. Facebook found that users who added seven friends within their first 10 days were more likely to keep using the platform. Connecting quickly also helped users to see its immediate value. Slack focused on teams that sent 2,000 messages. Its team found that 93% of teams that reached this level were still using Slack, that simply meant that regular conversations made it part of daily work. However, these metrics could be misleading if teams focused only on hitting the number. Airbnb might chase more bookings instead of better stays, Facebook users might add random friends, and Slack teams might send unnecessary messages. Hence the metric could rise without improving the experience.
My takeaway from this week reading is that a North Star metric should show real customer value, not only activity or just numbers. This connects to Goodhart’s Law from the reading: “When a measure becomes a target, it ceases to be a good measure.” Once a company rewards teams for hitting one number, people may increase it without helping users. For our meeting-notes product, I would not use the number of meetings recorded as the main metric. A team could record many meetings but never use the notes. I would rather measure how many action items are completed because of the notes, and whether users find the summaries accurate and useful. Combining a clear metric with user feedback will give us a better picture of whether the product is helping. A metric should guide decisions, but should not replace understanding users.
