The Beautiful Mess

Share this post

TMB 5/52: Powerful Ideas > Perfect Measures

cutlefish.substack.com

TMB 5/52: Powerful Ideas > Perfect Measures

John Cutler
Feb 3, 2022
30
2
Share this post

TMB 5/52: Powerful Ideas > Perfect Measures

cutlefish.substack.com

Powerful ideas, imperfectly measured, are more useful than perfect measures for not-so-powerful ideas.

Example:

The goal of your business is to transform how other companies do business. "That happens outside our product, we can't measure it," says the data scientist. But is it impossible to measure? I would argue otherwise. How to Measure Anything: Finding the Value of Intangibles in Business by Douglas W. Hubbard is a good start. One option might a regular cadence of structured interviews focusing on 2nd order impacts. While we're at it, we might measure other powerful ideas like trust and flexibility.

Another example:

We hypothesize that thoughtfully written content acquires customers more effectively. The powerful ideas is the idea that (we think) it is worth spending time to write good (8+ out of 10 level) content! While content quality might be subjective, it would be a mistake to not try to measure this and test our hypothesis. As a start, we could classify each of the existing posts on our site. Even a coarse-grained categorization scheme can work. And then look at customer acquisition, and downstream retention.

Don't skip your powerful ideas. Get them down. Map them out. Consider minimally viable measurement. Reducing uncertainty a small amount for a powerful idea is more valuable than being 100% certain about a generic ideas.

2
Share this post

TMB 5/52: Powerful Ideas > Perfect Measures

cutlefish.substack.com
2 Comments
Ulises Arvizu
Writes Iterative Thinking
Feb 3, 2022

Interesting point, I'm gonna check the book!!

Expand full comment
Reply
Nick Swekosky
Writes PG Inbox
Feb 3, 2022

I just put a hold on 'How to Measure Anything' at my local library. Thanks for the recommendation!

Do you have any other books or articles you might recommend about how product managers can improve at defining metrics?

Expand full comment
Reply
TopNewCommunity

No posts

Ready for more?

© 2023 John Cutler
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing