Falsifiability
The principle that a scientific theory must be able to be proven wrong by conceivable observations; if it cannot be falsified, it is not empirical science.
THE IDEA
Falsifiability
Karl Popper wrote “A theory is part of empirical science if and only if it conflicts with possible experiences and is therefore in principle falsifiable by experience.” The idea here is that if you can’t prove something wrong, you can’t really prove it right either.
Thus, in Popper’s words, science requires testability: “If observation shows that the predicted effect is definitely absent, then the theory is simply refuted.” This means a good theory must have an element of risk to it—namely, it has to risk being wrong. It must be able to be proven wrong under stated conditions.
In a true science, as opposed to a pseudo-science, the following statement can be easily made: “If x happens, it would show demonstrably that theory y is not true.” We can then design an experiment, a physical one or sometimes a thought experiment, to figure out if x actually does happen*.* Falsification is the opposite of verification; you must try to show the theory is incorrect, and if you fail to do so, you actually strengthen it. To understand how this works in practice, think of evolution. As mutations appear, natural selection eliminates what doesn’t work, thereby strengthening the fitness of the rest of the population.
Consider Popper’s discussion of the concept of falsifiability in the context of Freud’s psychoanalytic theory, which is broadly about the role of repressed childhood memories influencing our unconscious, in turn affecting our behavior. Popper was careful to say that it is not possible to prove that Freudianism was either true or not true, at least in part. We can say that we simply don’t know whether it’s true because it does not make specific testable predictions. It may have many kernels of truth in it, but we can’t tell. The theory would have to be restated in a way to allow for experience to refute it.
Another interesting piece of Popper’s work was an attack on what he called “historicism”—the idea that history has fixed laws or trends that inevitably lead to certain outcomes. This is where we use examples from the past to make definite conclusions about what is going to happen in the future.
Popper considered this kind of thinking pseudoscience, or worse—a dangerous ideology that tempts wannabe state planners and utopians to control society. He did not consider such historicist doctrines falsifiable. There is no way, for example, to test whether there is a Law of Increasing Technological Complexity in human society, which many are tempted to claim these days, because it is not actually a testable hypothesis. Instead of calling them interpretations, we call them laws, or some similarly connotative word that implies an unchanging and universal state that is not open to debate, giving them an authority that they haven’t earned. Too frequently, these postulated laws become immune to falsifying evidence—any new evidence is interpreted through the lens of the theory.
«A theory is part of empirical science if and only if it conflicts with possible experiences and is therefore in principle falsifiable by experience.» Karl Popper
For example, we can certainly find confirmations for the idea that humans have progressed, in a specifically defined way, toward increasing technological complexity. But is that a Law of history, in the inviolable sense? Was it always going to be this way? No matter what the starting conditions or developments along the way, were humans always going to increase our technological prowess? We really can’t say.
Here we hit on the problem of trying to assert any fundamental laws by which human history must inevitably progress. Trend is not destiny. Even if we can derive and understand certain laws of human biological nature, the trends of history itself are dependent on conditions, and conditions change.
Bertrand Russell’s classic example of the chicken that gets fed every day is a great illustration of this concept. Daily feedings have been going on for as long as the chicken has observed, and thus it supposes that these feedings are a guaranteed part of its life and will continue in perpetuity. The feedings appear as a law until the day the chicken gets its head chopped off. They are then revealed to be a trend, not a predictor of the future state of affairs.
Another way to look at it is how we tend to view the worst events in history. We tend to assume that the worst that has happened is the worst that can happen, and then prepare for that. We forget that “the worst” smashed a previous understanding of what was the worst. Therefore, we need to prepare more for the extremes allowable by physics rather than what has happened until now.
Applying the filter of falsifiability helps us sort through which theories are more robust. If they can’t ever be proven false because we have no way of testing them, then the best we can do is try to determine their probability of being true.
When to use it
Evaluating whether a new management theory is scientifically grounded or merely a pseudoscience.
Designing a product experiment: formulate a hypothesis that can be clearly disproven by user behavior.
Assessing economic forecasts: distinguish between trend-based predictions and claims of immutable laws.
In personal relationships, test assumptions about people's behavior by clearly defining what evidence would prove you wrong.
FROM THEORY TO EVERYDAY LIFE
In practice
Freudian Psychoanalysis
Popper argued that Freud's theory of repressed childhood memories influencing unconscious behavior cannot be proven false because it makes no specific testable predictions. Thus, it is not scientific by the criterion of falsifiability.
Law of Increasing Technological Complexity
Many claim that human history shows a law of increasing technological complexity. However, this cannot be tested as a universal law because it is not falsifiable—we cannot demonstrate it would always happen under any conditions.
Bertrand Russell's Chicken
A chicken that is fed every day comes to believe feedings are a guaranteed law of its life. But when the farmer eventually chops off its head, the 'law' is revealed as merely a trend. Treating an unfalsifiable trend as an immutable law leaves the chicken unprepared for a reversal.
A MOMENT TO REFLECT
Put it to work.
Can you identify a belief you hold that might not be falsifiable? How could you restate it to make testable predictions?
Recall a time when you treated a historical trend as an inevitable law. How did that assumption affect your decisions?
Think of a current popular theory or claim. How would you design an experiment that could falsify it?
References
- The Logic of Scientific Discovery — Karl Popper (1959)
CONTINUE THE CONVERSATION
Source texts
- The Great Mental Models Volume 1 General Thinking Concepts