Alex Ho
  • 西班牙朝聖之路
  • 京都旅行筆記
  • 東京旅行推薦景點

The North Star Metrics in Product Management

by Alex Ho

image

(Image source: vector_corp )

Table of Contents

  • North Star Metric Intro
  • Backgrounds of creating a North Star Metric for product teams
  • What is the North Star Metric (NSM)
  • How North Star Metric can help product teams
  • Key points of a good NSM
  • North Star Metric vs. One Metric That Matters
  • Example North Star Metrics from tech firms
  • References

North Star Metric Intro

Backgrounds of creating a North Star Metric for product teams

  1. While building a product, we might use multiple metrics to measure things such as
    1. How serious a problem is
    2. Estimate the impact
    3. Design the success metrics in an experiments
    4. Monitor the performance of a product or business
  2. We can easily list down a bunch of metrics that are important to our product and business, but the long list might overwhelm our team and in the end we still don’t know what to focus to help the product growth.
  3. Customers pay money to us (directly or indirectly, depends on our business types) if they feel they get value from our product or service. The money is the revenue of our product or business.

What is the North Star Metric (NSM)

NSM

  1. Represents the number that we should keep improving in order to achieve the long-term growth for our product / service / business.
  2. Reflects the values we created for our customers and is tied to our business growth.
  3. Should be able to cover both user engagement and monetization initiatives of our product
  4. Can drive some other relevant secondary metrics (often called One Metric That Matters, OMTM ) which help the product grow as well.

How North Star Metric can help product teams

NSM helps us to

  1. Focus on one single metric that contributes to the product growth
  2. Make sure we are brining correct and enough value to customers
  3. Make all members in a team (or various teams in a company) aligned and clearly understand the ultimate goal (even though each team might have different sub-metrics to work on)

Key points of a good NSM

  1. A good NSM should cover both user engagement and monetization initiatives of our product.
    1. Example of a not-so-good NSM: “e-commerce orders placed per month”. It simply emphasizes too much on monetization or marketing KPI (e.g. ), and there can be no way to judge if customers are satisfied with the orders they placed or not.
    2. Example of a better NSM: “the number or e-commerce orders fulfilled without customer complaint tickets”. It covers both customer satisficaion and business monetization. p
  2. NSM should be tied to the business growth.
  3. NSM should be measurable quantitatively.
    1. Example: To measure if customers are satisfied or not, we might use metrics such as “number of customer service tickets raised”, “length of time that customer wait in the customer service phone call”, and etc.
  4. NSM can be measured over a short period of time such as one hour, one day, one week, or one month. But not “one year” as it will take too long before we know if we are all good or not.
  5. NSM should not be easily falsified.
    1. Examples: “5-star rating” can be easily falsified if a restaurant prizes customers to do so.
  6. NSM should not be changed from time to time.
  7. NSM should not be easily impacted by external factors that we can not control, such as weather, mood of customers, and etc.

Notes: “Revenue” might not be a good North Star Metric

  1. Regardless of the product or service we build, we all purse getting reasonable revenue. And we expect the revenue to continuously grow. Therefore, the revenue should be an ultimate outcome based on the value that we deliver to the customers, instead of the NSM.

North Star Metric vs. One Metric That Matters

It is true that a NSM helps us focus. But it’s also true that there is definitely not just only one important metric in your product. Besides one NSM, we might need to closely look into other metrics that emphasize areas such as quality, efficiency, and etc.

So here comes the OMTO (One Metric That Matters).

We can consider OMTM as

  • An input of a NSM (then you can consider NSM as the output of your product system)
  • A sub-metric that is very import as well (besides the NSM).

Therefore, practically we can set up one NSM together with several OMTMs to monitor if the product is on track with both business growth, quality, efficiency, and any other important aspects.

Comparison between NSM and OMTM

North Star metric (NSM)
One Metric That Matters (OMTM)
For whom
For the entire company
For each department in the company (or each features under one single product) can have different OMTMs to focus on
OMTM is the sub-focus of the NSM
When the NSM is enhanced, it often means that the relevant OMTMs are improved
Each OMTM contributes to the company’s NSM.
Length of focus
For long-term growth Only changed when the entire company changes the business direction.
Can be relatively short-term Because a OMTM can be changed when each team decides what-to-focus in the coming month, quarter, or year (in order to meet the NSM in the long run)

Example North Star Metrics from tech firms

Company
North Star Metric
Explanation
Facebook
MAU
One-sided platform
AirBnB
Number of nights booked
For a “two-sided platform”, a good NSM should connect both sides in the platform. The NSM combines the value both the booker and the landlord. (After booker sends the application for a room, landlord should approve and thus the room is “booked”)
Uber
Completed rides per week
Two-sided platform Customer requests for a ride. Driver picks up and drops off the customer. Then it’s a “completed ride”.
Spotify
Time spent listening
Lots of OMTMs contribute to this final NSM. For example: Increase time spent per user session - Number of playlist created - Times that user use “Discover (new song)” features Times that user comeback to use Spotify over a period of time - Number of clicks on the push notification of “new album realized from an artist you followed”
Amazon
Number of purchases per month
Linkedin
MAU
Similar to Facebook
Quora
Number of answers to questions
If it is “number of questions asked”, then it cannot ensure “the user satisfaction they get after their questions are answered by other users”.
Leverage
LTV / CPC
LTV (user lifetime value) CPC (a.k.a CaC) Cost to acquire a customer. E.g. Marketing spending and sales expenditure ( LTV / CPC ) can represent how much value the users can generate for $X that we invest in the customer acquisition cost. In short, it means the ROI of customer acquisition cost.
WhatsApp
Number of messages Sent
Slack
Messages sent within the organization
Some said it is DAU actually. We might prefer “lots of users send at least one message in one day” rather than “small amount of users send lots of messages in one day”
Shopify
Customer’s GMV
Salesforce
Average records created per account
A “record” is the system or data repository of an organization.
Zoom
Number of weekly hosted meetings
DocuSign
Number of signed envelopes

References

The 2-Step Process That Companies Like Airbnb and Facebook Use to Find Their North Star Metric

I'm a big fan of metrics. Prior to starting my own business, I spent eight years working as a high-frequency trader where literally everything I did was based on metrics. I'd create algorithms that would trade stocks at microsecond speeds for fractions of a penny based solely on financial data.

www.inc.com

The 2-Step Process That Companies Like Airbnb and Facebook Use to Find Their North Star Metric
What is your "North Star Metric"? + 8 steps to find your NSM immediately

In this article, I walk you step-by-step through the concept of "North Star Metric": What is the meaning of North Star Metric (NSM)? What are good examples of North Star Metrics? And also 8 simple questions to find your North Star Metric.

growwithward.com

What is your "North Star Metric"? + 8 steps to find your NSM immediately
How Facebook's "7 friends in 10 days" got everyone confused about correlation and causation

With easy access to more data than we've ever had before, it's important we don't make logical errors that lead us to false conclusions. "We've noticed that people who share during their trial tend to be more likely to convert. How can we get more people to share during their trial?"

medium.com

Collection of 22 SaaS North Star Metrics

What's a North Star Metric? The North Star Metric is the single metric that captures the core value that the product delivers to customers. It's a metric where any team can rally behind to create aliment along with value with customers.

www.linkedin.com

Collection of 22 SaaS North Star Metrics

About Alex

  • Software Product Manager. Work experiences in Taipei, Singapore, and Shanghai.
  • Currently based in Taipei City, Taiwan.
  • Contact me via: alex.ho.helloworld@gmail.com
強化能力, 抵抗預設反應, 反脆弱強化能力, 抵抗預設反應, 反脆弱
強化能力, 抵抗預設反應, 反脆弱
溝通 & 談判 & 衝突管理溝通 & 談判 & 衝突管理
溝通 & 談判 & 衝突管理
底層邏輯, 思維, 認知偏誤 底層邏輯, 思維, 認知偏誤
底層邏輯, 思維, 認知偏誤
多模型思維 (運用多種思維模型去理解複雜的世界)多模型思維 (運用多種思維模型去理解複雜的世界)
多模型思維 (運用多種思維模型去理解複雜的世界)
解決問題, 分析問題, Problem-solving解決問題, 分析問題, Problem-solving
解決問題, 分析問題, Problem-solving
統計學、機率統計學、機率
統計學、機率
心理學, 快思慢想, 情緒管理心理學, 快思慢想, 情緒管理
心理學, 快思慢想, 情緒管理
Alex Ho

西班牙朝聖之路

京都旅行景點推薦

東京旅行推薦景點