Tyranny of Outcomes

"Outcomes over outputs."

So often we talk about measuring work by the impact it creates, not whether we did it. A goal of "ship Foo in Q3" isn’t nearly as good as "35 new users are using Foo" or "retention increased 12% after releasing Foo."

This extreme focus on outcomes can have an undesired effect on product teams. The team might stop doing anything that doesn’t directly drive a business metric. They can start choosing only metrics that they know how to move - which tend to be the easy, well-understood problems. For teams with quarterly goals, it can lead to focusing on short-term metrics that can move in a few weeks.

It is tempting to use output goals as a solution for these problems. "Establish a baseline for retention" or "learn why users aren’t adopting new features."

But a better way is to re-frame these outputs as an outcome. An outcome is simply a behavior change in a person. "Increase retention by 12%" is a behavior change in your customer - more of them stick around.

This is a great way to handle goals when you don’t really know yet what the business outcome looks like. It can help teams address long-term, ill-defined problems.

If you want to "learn why users aren’t adopting new features," think about why you don’t already know this. Why is it hard for you to get this answer? Is it because you don’t have product analytics? Then your outcome could be "answer two new questions about product usage each week." If it’s because you’re not talking weekly with customers, then perhaps your goal could be "product teams have spoken to 20 customers." Those are outcomes. They are measuring a behavior change in your team. Before, the world looked one way, but after you made changes, it looks a different way.

If your goal is "ship the new feature in time for the September marketing event" then ask yourself why shipping itself is the goal. Perhaps you’ve had trouble hitting deadlines before and you want to fix that with iterations and continuous delivery. The behavior you want to change is all about how you ship, so frame your goal that way. This might turn into "Demonstrate continuous delivery by shipping 6 releases this quarter that each improve the new feature needed for the September marketing event."

Recently Written

Input metrics lead to outcomes (Sep 1)
An easy to understand example of using input metrics to track progress toward an outcome.
Lagging Outcomes (Aug 22)
Long-term things often end up off a team's goals because they can't see how to define measurable outcomes for them. Here's how to solve that.
Tyranny of Outcomes (Aug 19)
An extreme focus on outcomes can have an undesired effect on product teams.
The Trap of The Sales-Led Product (Dec 10)
It’s not a winning way to build a product company.
The Hidden Cost of Custom Customer Features (Dec 7)
One-off features will cost you more than you think and make your customers unhappy.
Domain expertise in Product Management (Nov 16)
When you're hiring software product managers, hire for product management skills. Looking for domain experts will reduce the pool of people you can hire and might just be worse for your product.
Strategy Means Saying No (Oct 27)
An oft-overlooked aspect of strategy is to define what you are not doing. There are lots of adjacent problems you can attack. Strategy means defining which ones you will ignore.
Understanding vision, strategy, and execution (Oct 24)
Vision is what you're trying to do. Strategy is broad strokes on how you'll get there. Execution is the tasks you complete to complete the strategy.


What I'm Reading


Adam Kalsey

+1 916 600 2497


Public Key

© 1999-2023 Adam Kalsey.