RationalWiki Upgrade 2017

The new server & MediaWiki instance are ready.

To complete the migration, we (Tim) will:

  • Switch to read-only mode today at about 06:00 UTC 28 June
  • Load the database from about 10:00 UTC 26 June
  • Restore normal activity today at about 10:00 UTC 28 June

All edits made between about 10:00 UTC 26 June and about 06:00 UTC 28 June will be lost. If it's important, save it offwiki.

from FuzzyCatPotato (Talk), group Site wide (urgent) at 00:24, 28 June 2017

Dunning-Kruger effect

From RationalWiki
(Redirected from Dunning-Kruger)
Jump to: navigation, search
Bronze-level article
Tell me about
your mother


Icon psychology.svg
For our next session...
Popping into your mind
I am wiser than this man, for neither of us appears to know anything great and good; but he fancies he knows something, although he knows nothing; whereas I, as I do not know anything, so I do not fancy I do. In this trifling particular, then, I appear to be wiser than he, because I do not fancy I know what I do not know.
—attributed to Socrates, from Plato, Apology

The Dunning-Kruger effect (also Mount Stupid[1] or Smug Snake[2]), named after David Dunning and Justin Kruger of Cornell University, occurs where people fail to adequately assess their level of competence — or specifically, their incompetence — at a task and thus consider themselves much more competent than everyone else. This lack of awareness is attributed to their lower level of competence robbing them of the ability to critically analyse their performance, leading to a significant overestimation of themselves.

In simple words it's "people who are too stupid to know how stupid they are".

The inverse also applies: competent people tend to underestimate their ability compared to others; this is known as impostor syndrome.

The principle is illustrated indirectly by the common saying that "I've learned enough about ________ to know what I don't know." The implication is that someone who hasn't learned much about the subject would have no appreciation for how much there is to learn about it, and so might grossly overestimate their level of understanding.

If you have no doubts whatsoever about your competence, you could just be that damn good. On the other hand...


[edit] The effect

One of the painful things about our time is that those who feel certainty are stupid, and those with any imagination and understanding are filled with doubt and indecision.
Bertrand Russell, The Triumph of Stupidity

The Dunning-Kruger effect is a slightly more specific case of the bias known as illusory superiority, where people tend to overestimate their good points in comparison to others around them, while concurrently underestimating their negative points. The effect has been shown by experiment in several ways, but in this case Dunning and Kruger tested students on a series of criteria such as humour, grammar, and logic and compared the actual test results with each student's own estimation of their performance.

Those who scored well on these tests were shown, consistently, to underestimate their performance. This is not terribly surprising and can be explained as a form of psychological projection: those who found the tasks easy (and thus scored highly) mistakenly thought that they would also be easy for others. This is similar to the aforementioned "impostor syndrome" — found notably in graduate students and high-achieving women — whereby high achievers fail to recognise their talents as they think that others must be equally good.

More interestingly, and the subject of what became known as the Dunning-Kruger effect, those who scored lowest on the test were found to have "grossly overestimated" their scores. And what about the underachievers who overestimated their performance? In the words of Dunning and Kruger:

This overestimation occurs, in part, because people who are unskilled in these domains suffer a dual burden: Not only do these people reach erroneous conclusions and make unfortunate choices, but their incompetence robs them of the metacognitive ability to realize it.

It is worth noting that the original study was focused specifically on competence, as opposed to intelligence - Dunning and Kruger were more concerned with the empirical, measurable factors of how well a person could perform a task (even "simple" or "stupid" tasks) and that person's perception of how they performed that task, rather than the more nebulous concept of comparative "intelligence" or "education." However, the inspiration for the entire study was a desperately under-educated Pittsburgher who possessed badly flawed reasoning skills (see below). The term is still properly meant to describe a disconnect between perceived and empirical competence, rather than IQ or intelligence.

[edit] In a nutshell

[edit] A little knowledge can be dangerous

A little knowledge of the Dunning-Kruger effect could give you impostor syndrome![citation NOT needed]
It is not in our human nature to imagine that we are wrong.
—Kathryn Schulz[3]
This isn't my first rodeo.
—Guy at his second rodeo

The effect can also be summarised by the phrase "a little knowledge is a dangerous thing."[4] A small amount of knowledge can mislead a person into thinking that they're an expert because this small amount of knowledge isn't a well known fact.

For a potent example, consider former children's TV presenter and "science advocate" Johnny Ball, who in 2009 stunned audiences by denying the existence of climate change. His reasoning was based on the fact that water vapour as a greenhouse gas is much more prevalent, potent, and thus much more powerful than carbon dioxide — and because combustion reactions also produce water, it should be water vapour we're worried about, not carbon dioxide.[5] Sound reasoning to an amateur, but anyone minimally qualified in atmospheric chemistry would tell you that the water isn't a problem because the atmosphere has a way of getting rid of excess water — it's called rain. Thus its concentration (for given temperatures and pressures) remains more or less constant globally.

Ball's premise is also used by some critics against the hydrogen economy: because hydrogen vehicles emit water vapour from their exhaust, they are seen to be more damaging to the environment than petrol driven vehicles. An ill-informed and unsound argument — hydrogen fuel cell vehicles emit approximately the same amount of water per mile as vehicles using gasoline-powered internal combustion engines.[6] The difference is that while water vapour remains in the atmosphere only a few days or weeks, and hydrogen gas about two years, carbon dioxide lingers for more than a century.[7]

[edit] Origins

Comparison of actual score vs perceived score. A well-calibrated and honest set of predictions would follow a straight line (i.e., prediction of ability matches the outcome). However, experimentally it was found that people consistently over-estimated their ability. Graphed as a proportion of the over-estimate, those in the lowest quartile were guilty of the most significant over-estimation.[8]
The fool doth think he is wise, but the wise man knows himself to be a fool.
—Touchstone, in As You Like It by William Shakespeare

Dunning and Kruger properly proved its existence in their seminal, 2000 Ig Nobel Prize winning[9] paper "Unskilled and Unaware of It,"[10] doubtless at great risk to personal sanity.

They were famously inspired by McArthur Wheeler, a Pittsburgh man who attempted to rob a bank while his face was covered in lemon juice. Wheeler had learned that lemon juice could be used as "invisible ink" (that is, the old childhood experiment of making the juice appear when heated); he therefore got the idea that unheated lemon juice would render his facial features unrecognizable or "invisible."

After he was effortlessly caught (as he made no other attempts to conceal himself during the robberies), he was presented with video surveillance footage of him robbing the banks in question, fully recognizable. At this, he expressed apparently sincere surprise and lack of understanding as to why his plan did not work - he was not competent enough to see the logical gaps in his thinking and plan.[11]

The idea that people who don't know that they don't know ("Dunning-Kruger effect" is so much less confusing than any "know-know" phrase) isn't particularly new. The Bertrand Russell quote is from the mid 1930s, and even earlier, Charles Darwin, in The Descent of Man in 1871, stated "ignorance more frequently begets confidence than does knowledge." Even back in ancient Greece, Plato's Apology attributed to Socrates the quote at the top, which today is often summed up as, roughly, "the wisest people know that they know nothing."

In his 1996 book Rush Limbaugh is a Big Fat Idiot, Al Franken described the phenomenon of "pseudo-certainty" which was rampantly being displayed by pundits and politicians such as Rush Limbaugh and Newt Gingrich, who would use "common sense" as the basis for their confidently-made assertions, but without actually backing them up with time-consuming research or pesky facts. Franken prefers the term "being a fucking moron."

[edit] Locally relevant examples

Those who think they know never learn.
—from the Tao Te Ching

[edit] See also

[edit] External links

[edit] References

Articles on Cognitive biases
  Clustering illusion  -  Cognitive biases-related stubs  -  Confabulation  -  Confirmation bias  -  Demonization  -  Experimenter bias  -  Framing  -  Frequency illusion  -  Gambler's fallacy  -  Hindsight bias  -  Hostile media effect  -  Just world hypothesis  -  Outcome bias  -  Overconfidence effect  -  Overgeneralization  -  Response bias  -  Selection bias  -  Survivorship bias  -  Ultimate attribution error  -  Walled garden  
Personal tools