The Paradox of Skill
Expect luck to matter more as elite competitors become equally skilled.
- Difficulty
- Moderate
- Time to result
- ~ongoing to results
- Steps
- 6
- Confidence
- 97%
The Paradox of Skill explains why luck can become more influential even as a field becomes more skilled. Every activity lies somewhere on a spectrum between pure skill and pure luck. As training, global talent discovery, and competitive selection raise the average level of play, weak participants disappear and the remaining competitors become increasingly similar in ability. Because the variation in skill shrinks, small uncontrollable events account for a larger share of the differences in observed outcomes. This does not mean skill has become unimportant; elite skill is often required merely to enter the competition. The model therefore recommends judging the quality of a process separately from a single result, examining repeated performance, and resisting the impulse to claim complete personal credit for success or blame for failure.
Origin
The hosts discuss Michael Mauboussin's book The Success Equation and his talk about separating luck from skill, using elite basketball, investing, and startups as examples.
Core principles
- 01Outcomes usually combine skill and luck rather than reflecting either alone.
- 02The relative influence of luck depends on the activity and competitive environment.
- 03Higher average skill can reduce the variation in skill among participants.
- 04When skill differences narrow, random variation explains more of the observed results.
- 05Evaluate decisions by their process as well as their outcomes.
How to run it
- 1
Map the activity
Place the activity on a continuum from predominantly luck-based to predominantly skill-based. Identify the mechanisms through which each component affects the outcome.
Pro tip Compare whether deliberate practice reliably improves results and whether weaker participants can occasionally defeat experts.
Watch out Do not force an activity into a binary label of either luck or skill.
- 2
Measure the selection pressure
Determine how strongly the field selects for top performers through training, credentials, competition, or global recruitment.
Pro tip A highly filtered field usually has a high minimum skill threshold.
Watch out A high average skill level does not guarantee that skill explains differences among the remaining competitors.
- 3
Assess skill variance
Estimate how much ability varies among the actual participants rather than across the general population. Narrow differences indicate that random events may have greater explanatory power.
Pro tip Use comparable peer groups rather than contrasting professionals with novices.
Watch out Do not confuse the absence of visible differences with the absence of elite skill.
- 4
Identify random drivers
List injuries, timing, market conditions, opponent behavior, and other factors that affect results but are not under the decision-maker's control.
Pro tip Distinguish foreseeable risks from truly unpredictable events.
Watch out Calling every unexplained outcome luck can conceal a weak process.
- 5
Evaluate process separately
Judge whether the decisions were reasonable using information available at the time, then evaluate the outcome as separate evidence.
Pro tip Record the decision rationale before the result is known to reduce hindsight bias.
Watch out A good outcome can follow a bad decision, and a bad outcome can follow a good one.
- 6
Look for repetition
Use performance across many comparable trials to estimate whether an apparent advantage persists beyond random variation.
Pro tip Increase the sample size before making strong claims about exceptional ability.
Watch out Repeated observations still require comparable conditions to be meaningful.
In the wild
Professional basketball is highly skill-based, but global selection admits only exceptional players. Because competitors are all near the top of the skill distribution, differences between them become smaller and a bounce, injury, or momentary event can have a larger effect on who wins a particular game.
→ Luck explains more game-to-game variation even though elite skill remains necessary to participate.
An investor backs a company after disciplined market, team, and product analysis, but an unexpected regulatory change harms the business. The investor reviews whether the original process incorporated the information available at the time instead of judging the decision solely by the loss.
→ The firm improves its process without learning the false lesson that every unsuccessful investment was irrational.
Common mistakes
Treating outcomes as proof
A single win does not prove superior skill, and a single loss does not prove incompetence when outcomes are noisy.
Assuming luck replaces skill
Greater outcome variance among elite performers does not negate the extraordinary skill required to enter the field.
Using luck as an excuse
Uncertainty should encourage process evaluation, not provide cover for avoidable errors or poor preparation.
Is it for you?
Best for
It is best for evaluating performance in investing, sports, entrepreneurship, hiring, and other noisy competitive domains.
Not ideal for
It is not sufficient by itself for deterministic tasks where outcomes can be directly traced to controlled inputs.
From the transcript
“The paradox of skill is that even in things that are highly skill based, as the level of play gets higher, so imagine the you…”
“As basketball, which is very skill-based, as the level of play gets higher and higher, and the parity of skill amongst the players gets more…”
“The variation in skill gets so minute. Uh that luck is magnified.”
From the episode
Virgin America