Thank you for visiting this site. This article covers “The False Positive Paradox.”
Receiving a “positive” result on a medical test is naturally alarming. But even with a test that is 99% accurate, a positive result may mean the actual probability of having the disease is well below 50%. This is not mathematical sleight of hand — it is a hard fact of probability theory.
A Concrete Example
A famous survey conducted at Harvard Medical School posed a similar problem to doctors and medical students. About half gave the wrong answer — a trap that even experts fall into.
Suppose a disease has a prevalence of 0.1% (1 in 1,000 people). The test has these properties:
- Probability of correctly identifying a sick person as positive (sensitivity): 99%
- Probability of correctly identifying a healthy person as negative (specificity): 99%
At first glance this seems like an excellent test. But let’s look at what happens when 10,000 people are tested.
Of the 10,000 people, 10 have the disease (0.1%) and 9,990 are healthy.
Of the 10 sick people, 9 are correctly identified as positive (sensitivity 99%). Of the 9,990 healthy people, 100 are incorrectly identified as positive (1% false positive rate).
Total positive results: 9 + 100 = 109. Of those, only 9 actually have the disease.
The probability of actually having the disease after testing positive is only 9 ÷ 109 ≈ about 9%.
(Note: the diagram uses the rounded figures of 10 true positives and 100 false positives for clarity.)
Why Does This Happen?
The key is the low prevalence of the disease.
Because the disease is rare, the vast majority of people being tested are healthy. Even a 99%-accurate test incorrectly flags 1% of healthy people as positive. The 1% of the overwhelming majority of healthy people swamps the small number of true positives.
This demonstrates that the prior probability (prevalence) fundamentally shapes how results should be interpreted. Looking only at test accuracy is insufficient for a correct judgment.
There is an intuitive way to think about this. Before testing, the probability that you have the disease is only 0.1%. No matter what the test shows, you start from that very low baseline. A 99% accurate test provides strong evidence — but it is not enough to overcome a starting point as low as 0.1%.
Bayes’ Theorem
The mathematics behind this paradox is Bayes’ theorem.
The probability of actually having the disease after a positive result (positive predictive value) must be calculated taking into account not just test accuracy but also prevalence. The rarer the disease, the higher the chance that a positive result is a false positive.
Conversely, for a disease with high prevalence (say, 50%), a positive result from a 99%-accurate test would mean more than a 99% probability of actually having the disease. The same test means something entirely different depending on the population being tested.
Real-World Impact
This paradox has a significant impact on real healthcare.
Large-scale screening programs face exactly this problem. Testing large numbers of healthy people produces many false positives, leading to unnecessary follow-up tests and anxiety. This is one reason why some screening programs target only high-risk populations.
During the COVID-19 pandemic, the value of mass testing of asymptomatic people was actively debated through this lens. Interpreting results correctly requires knowing the infection rate in the tested population, not just the test accuracy.
Beyond Medicine
The False Positive Paradox applies well beyond healthcare.
Terrorist detection: Even if an airport facial recognition system can detect terrorists with 99.9% accuracy, if there is only one terrorist among a million passengers, the vast majority of alerts will be false. Hundreds of innocent people are wrongly flagged, creating chaos.
Spam filters: Even a highly accurate spam filter will incorrectly classify a meaningful number of legitimate emails as spam when legitimate messages vastly outnumber spam.
Court evidence: If a DNA match is reported as a 1-in-a-million probability, but the suspect pool was drawn from an entire large city’s population, the meaning of that “match” is very different from what intuition suggests.
The Power of Retesting
The most practical remedy for the False Positive Paradox is retesting. Consider what happens if a person who tested positive takes the test a second time.
The first positive result raised the probability of having the disease from 0.1% to about 9%. Using this 9% as the new prior, if the second test also comes back positive, the probability of actually having the disease jumps to approximately 91%. This is the logical foundation for confirmatory (secondary) testing.
Summary
This article covered “The False Positive Paradox.”
Even highly accurate tests produce many false positives when testing for rare diseases — a fact that runs counter to intuition. Understanding numbers correctly requires Bayesian thinking, as this paradox vividly illustrates.
To return to the full list of paradoxes, follow the link below.
Thank you for reading. We hope to see you in the next article.
