Computing Instead of Thinking
Taleb criticizes the use of precise probability calculations when the rules and relevant risks are poorly understood. A model’s numerical answer can conceal uncertainty about its assumptions, while attribution bias can discourage learning from failure.
THE IDEA
COMPUTING INSTEAD OF THINKING
Mathematical probability developed through gambling theory. In finance, an entire industry of “risk measurers” emerged, specializing in the application of these probability methods to assess risks in the social sciences. Certainly, the odds in games where the rules are clearly and explicitly defined are computable and the risks consequently measured. But not in the real world. For mother nature did not endow us with clear rules. The game is not a deck of cards (we do not even know how many colors there are). But somehow people “measure” risks, particularly if they are paid for it. Hume’s problem of induction and the occurrence of black swans make this confidence especially questionable.
I have waged a war against the charlatanism of some prominent financial economists for a long time. The points are as follows. One Harry Markowitz received something called the Nobel Memorial Prize in Economics (which in fact is not even a Nobel Prize, as it is granted by the Swedish Central Bank in honor of Alfred Nobel—it was never in the will of the famous man). What is his achievement? Creating an elaborate method of computing future risk if one knows future uncertainty; in other words, if the world had clearly defined rules one picks up in a rulebook of the kind one finds in a Monopoly package. Now, I explained the point to a cab driver who laughed at the fact that someone ever thought that there was any scientific method to understanding markets and predicting their attributes. Somehow when one gets involved in financial economics, owing to the culture of the field, one becomes likely to forget these basic facts (pressure to publish to keep one’s standing among the other academics).
In the summer of 1998 (recounted in Chapters 1 and 5 of Fooled by Randomness), losses at Long Term Capital Management (“LTCM”) threatened the wider financial system. The Greenwich, Connecticut, fund had for principals two of Dr. Markowitz’s colleagues, “Nobels” as well. They are Drs. Robert Merton (the one in Chapter 3 trouncing Shiller) and Myron Scholes. Somehow they thought they could scientifically “measure” their risks. They made absolutely no allowance in the LTCM episode for the possibility of their not understanding markets and their methods being wrong. That was not a hypothesis to be considered. I happen to specialize in black swans. Suddenly I started getting some irritating fawning respect. Drs. Merton and Scholes helped put your humble author on the map and caused interest in his ideas. The fact that these “scientists” pronounced the catastrophic losses a “ten sigma” event reveals a Wittgenstein’s ruler problem: Someone saying this is a ten sigma either (a) knows what he is talking about with near perfection (the prior assumption is that it has one possibility of being unqualified in several billion billions), knows his probabilities, and it is an event that happens once every several times the history of the universe; or (b) just does not know what he is talking about when he talks about probability (with a high degree of certainty), and it is an event that has a probability higher than once every several times the history of the universe. I will let the reader pick from these two mutually exclusive interpretations which one is more plausible.
Note that the conclusions also reflect on the Nobel committee who sanctified the ideas of the gentlemen involved: Conditional on these events, did they make a mistake or were these events unusual? Is the Nobel committee composed of infallible judges? Where is Charles Sanders Peirce to talk to us about papal infallibilism? Where is Karl Popper to warn us against taking science—and scientific institutions—seriously? In a few decades will we look upon the Nobel economics committee with the same smirk as when we look at the respected “scientific” establishments of the Middle Ages that promoted (against all observational evidence) the idea that the heart was a center of heat? We have been getting things wrong in the past and we laugh at our past institutions; it is time to figure out that we should avoid enshrining the present ones.
One would think that when scientists make a mistake, they develop a new science that incorporates what has been learned from it. When academics blow up trading, one would expect them to integrate such information in their theories and make some heroic statement to the effect that they were wrong, but that now they have learned something about the real world. Nothing of the sort. Instead they complain about the behavior of their counterparts in the market who pounced on them like vultures, thus exacerbating their downfall. Accepting what has happened, clearly the courageous thing to do, would invalidate the ideas they have built throughout an entire academic career. All of the principals who engaged in a discussion of the LTCM events partook of a masquerade of science by adducing ad hoc explanations and putting the blame on a rare event (problem of induction: How did they know it was a rare event?). They spent their energy defending themselves rather than trying to make a buck with what they learned. Again, compare them with Soros, who walks around telling whoever has the patience to listen to him that he is fallible. My lesson from Soros is to start every meeting at my boutique by convincing everyone that we are a bunch of idiots who know nothing and are mistake-prone, but happen to be endowed with the rare privilege of knowing it.
The scientist’s behavior while facing the refutation of his ideas has been studied in depth as part of the so-called attribution bias. You attribute your successes to skills, but your failures to randomness. This explains why these scientists attributed their failures to the “ten sigma” rare event, indicative of the thought that they were right but that luck played against them. Why? It is a human heuristic that makes us actually believe so in order not to kill our self-esteem and keep us going against adversity.
Meehl’s 1954 work on clinical and statistical prediction provides a way to compare expert judgments with a statistical alternative. Attribution bias is a separate obstacle to learning from the resulting record: it can sustain confidence by explaining away failures. The reported finding that 80 to 90% of people think they are above average (and above the median) in many things illustrates this misplaced confidence.
When to use it
Financial risk management: Use models as tools but always consider model limitations and extreme events.
Project planning: Avoid overconfidence in timelines by acknowledging unknown unknowns.
Policy-making: Be wary of relying solely on quantitative forecasts without qualitative judgment.
Personal decisions: When facing uncertain outcomes, seek multiple perspectives rather than trusting a single predictive framework.
FROM THEORY TO EVERYDAY LIFE
In practice
Long-Term Capital Management (LTCM) Collapse
Taleb uses LTCM’s losses to criticize confidence in risk models. In his account, describing the loss as a ten-sigma event protected the assumption that the model was sound, rather than prompting the question of whether its probabilities were wrong.
Attribution Bias in Expert Prediction
Taleb cites Paul Meehl’s 1954 work on prediction as a challenge to confidence in expert judgment. He also describes attribution bias: explaining successes as skill and failures as bad luck. A comparison of predictive performance and an explanation of how people defend their performance are distinct claims.
A MOMENT TO REFLECT
Put it to work.
In what areas of your life do you rely on mathematical or statistical models? Are the rules of those systems as clear as a deck of cards?
Think of a time when you or others blamed failure on a 'rare event.' Could that event have been foreseen if you had considered model uncertainty?
How does the attribution bias (success = skill, failure = luck) affect your own decision-making? How can you guard against it?
Often confused with
References
- Clinical vs. Statistical Prediction: A Theoretical Analysis and a Review of the Evidence — Paul E. Meehl (1954)
- An Enquiry Concerning Human Understanding — David Hume (1748)
CONTINUE THE CONVERSATION
Source texts
- Fooled by Randomness The Hidden Role of Chance in the Markets and in Life (Nassim Nicholas Taleb)