Survivorship bias

From RationalWiki
Revision as of 22:39, 24 November 2020 by Rairyu75 (talk | contribs) (Typo)
Jump to navigation Jump to search
Cogito ergo sum
Logic and rhetoric
Icon logic.svg
Key articles
General logic
Bad logic
Diagoras, who is called the atheist, being at Samothrace, one of his friends showed him several pictures of people who had endured very dangerous storms; "See," says he, "you who deny a providence, how many have been saved by their prayers to the Gods." "Ay," says Diagoras, "I see those who were saved, but where are those painted who were shipwrecked?"
—Cicero, On the Nature of the Gods

Survivorship bias is a cognitive bias that occurs when focusing on what made it past a threshold, while overlooking what didn’t. It’s a specific type of selection bias.

An in-depth example

The following comes courtesy of You Are Not So Smart.[1]

Suppose you're trying to help the military decide how best to arm their planes for future bombing runs. They let you look over the planes that made it back, and you note that some areas get shot heavily, while other areas hardly get shot at all. So, you should increase the armor on the areas that get shot, right?

Wrong! These are the planes that got shot and survived. It stands to reason that on some planes, the areas where you don't see any damage did get shot, and they didn't survive. So those are the areas you reinforce. This was the brilliant deduction of Abraham Wald, a Hungarian-born Jewish statistician who fled Europe to work for the US military during World War II, which also goes to show that one shouldn't try to kill your best thinkers.[note 1]

Other examples

Survivorship bias is also at play when considering the quality of artistic works throughout history. It's easy to look at Shakespeare and think that writers today are much less intelligent than they were in his day, but there were also plenty of writers of Shakespeare's day whose work wasn't as good, and so either didn't survive into the modern era or lacked the influence on Anglophone discourse that Shakespeare achieved.[note 2] Used in this way, survivorship bias can lead to nostalgia for an imagined glorious past, hence the pop-culture terms 'nostalgia filter' or 'nostalgia goggles' which describe this effect.[2]

Survivorship bias can obscure the effects of workplace exposure upon health problems. When new employees with prior exposure to, say asbestos[3] or silica[4] are inappropriately combined with employees without prior exposure, the apparent exposure effect is reduced. Employees exposed at prior jobs become ill sooner than previously unexposed employees making exposure at the current employee appear negligible.

Michael Shermer of Scientific American cites survivor bias in books about business success and rags-to-riches stories. In one example, he observes that Steve Jobs dropped out of university to start up Apple Computer, which became a billion-dollar business, but that the failures made by those imitating Jobs' path to success were ignored.[5]

Notes

  1. Or anybody else, for that matter. But then, this lesson is hopefully more obvious than the first one.
  2. But note that this is not the whole story: Shakespeare and Chaucer both wrote before there was a concept of intellectual property and large parts were unoriginal. Comparing Shakespeare with more original works written later is a bad comparison.

References