Skip to main content
Scientific Principles

Domain Specificity of Inductive Rules

The researchers propose that people apply statistical reasoning more readily when the sample space and role of chance are clear and the domain encourages it. They compare objectively measured events with subjective judgments to examine this domain specificity.

THE IDEA

DOMAIN SPECIFICITY OF INDUCTIVE RULES

One of the major implications of the present viewpoint is that there should be a substantial degree of domain specificity of statistical reasoning. Its use should be rare for domains in which (1) it is hard to discern the sample space and the sampling process, (2) the role of chance in producing events is unclear, and (3) no cultural prescription for statistical reasoning exists. We have noted that many of the studies showing people’s failures in statistical reasoning examined judgments about events characterized by one or more of these factors. We have also noted that some of people’s few demonstrated successes in statistical reasoning have been observed for people’s reasoning about sports and academic achievements that seem to be characterized by clearer distributions for events, a more obvious role of chance, and, probably, cultural prescriptions as well. These observations were made across studies, across tasks, and across subject populations, however.

To demonstrate that the same subjects dealing with the same tasks in the same experiment are more likely to reason statistically for some events characterized by uncertainty than for others, Jepson, Krantz, and Nisbett (1983) presented subjects with two broad classes of problems. The first class of problems dealt with events that are assessable by objective means, such as abilities, achievements, and physical illness. The second class dealt with events that are assessable only by subjective means, for example, personal preferences among objects, assessments of leadership potential, and judgments about the need for sexual fidelity in relationships. It was reasoned that, in general, it is relatively easy to apply statistical reasoning to objective events because one is likely to have some idea of their distributions (or to be able to guess what the distributions might look like because the units of measurement and the sample space are likely to be relatively clear). In general, also, the role of chance is likely to be relatively transparent for those objectively assessable events that in fact have been observed under repeated, relatively fixed conditions. Finally, cultural prescriptions to reason statistically probably exist for many such events. In contrast, none of these things is true for most events that can be assessed only by subjective means. The original objective and subjective sample problems, and the experiment’s results, are not included in this excerpt.

When to use it

  • Educators designing lessons on statistical reasoning can focus on objective domains (sports, grades) before introducing subjective domains to build intuition.

  • Researchers in psychology can structure experiments by carefully choosing event types to test whether participants apply statistical reasoning uniformly or only in certain domains.

  • Individuals can improve decision-making by assessing whether the situation is objectively defined (clear data) and then deliberately applying statistical thinking, rather than relying on intuition for subjective events.

FROM THEORY TO EVERYDAY LIFE

In practice

01

Objective Event Example (Abilities)

Consider a coach evaluating the performance of basketball players. The coach has data on points scored per game over a season (clear sample space, repeated measures). The role of chance (e.g., variation due to opponent strength, fatigue) is transparent. Cultural norms often encourage statistical reasoning in sports. Thus, the coach is likely to use statistics to assess players, e.g., comparing averages and variability.

02

Subjective Event Example (Personal Preferences)

Someone compares two friends’ taste in movies without defining which films count or what better taste means. Anecdotes may dominate because the comparison and sample are unclear. Preferences can be measured, but doing so requires an explicit question and a comparable set of observations.

✳

A MOMENT TO REFLECT

Put it to work.

  1. Think of a decision you made recently that involved uncertainty. Was the event objectively assessable or subjectively assessable? How might your reasoning have differed if it were the other type?

  2. Why do you think cultural prescriptions for statistical reasoning exist for sports and academics but not for personal tastes? Can you think of a domain where such prescriptions should be encouraged?

  3. Imagine you are designing a curriculum to teach statistical reasoning. Based on domain specificity, which types of problems would you start with and why?

References

  1. Domain specificity of inductive rules — Jepson, D. H., Krantz, D. H., & Nisbett, R. E. (1983)

CONTINUE THE CONVERSATION

Source texts

  • Heuristics and Biases The Psychology of Intuitive Judgment (Thomas Gilovich, Dale Griffin, Daniel Kahneman)
← More scientific principles