Information icon.svg Results for the 2024 RationalWiki Moderator Election have now been posted. Thank you for participating in this election, and congratulations to the winners!
Bronze-level article

Dunning–Kruger effect

From RationalWiki
Jump to navigation Jump to search
Despite its popularity, this graph is not an accurate representation of the effect.
Tell me about
your mother

Psychology
Icon psychology.svg
For our next session...
Popping into your mind
I am wiser than this man, for neither of us appears to know anything great and good; but he fancies he knows something, although he knows nothing; whereas I, as I do not know anything, so I do not fancy I do. In this trifling particular, then, I appear to be wiser than he, because I do not fancy I know what I do not know.
—attributed to Socrates, from Plato, Apology
To be ignorant of one's ignorance is the malady of the ignorant
Amos Bronson AlcottWikipedia

The Dunning-Kruger effect (also known as Mount Stupid[1] or Smug Snake[2]) is named after David Dunning and Justin Kruger for their seminal paper of 1999.[3] In a stroke of irony, the original paper showcasing the effect was intrinsically flawed from an autocorrelationWikipedia mistake. Using data generated by uniform noise erroneously supported the same result.[4]

The proposed effect would occur where people fail to adequately assess their level of competence — or specifically, their incompetence — at a task and thus consider themselves much more competent than everyone else. This lack of awareness is attributed to their lower level of competence, which robs them of the ability to critically analyse their performance, leading to a significant overestimation of themselves. In simple words: "people who are too ignorant to know how ignorant they are". When people do not recognize their own mental illness, this is known as "anosognosia"; this is common for people with bipolar disorder or schizophrenia.[5]

The inverse also applies: the unusually competent people tend to underestimate their ability compared to others; this is known as impostor syndrome.

While noting the autocorrelation mistake, a 2023 paper further argued that the original work of Dunning and Kruger did not show what was claimed, but instead had only shown that people of all competence levels overestimated their competence; Dunning and Kruger's research had used a small and narrow sample size of 45 undergraduate students.[6][7]

Nonetheless, David Dunning maintains there have been subsequent studies that support the original claims.[8] In particular, there was a 2021 study of 3500 participants performing logic and grammar tests that concluded there was overconfidence among the worst performers.[9] Dunning concludes that the effect appears largely related to psychological conditions; systemic misconceptions about a task exacerbates the outcome.

The effect found in the Dunning-Kruger study can also be explained by regression to the mean.[10] In simple words, someone who is nearly the worst at a given task might overestimate their talent, but can hardly underestimate it. Even a perfectly rational agent's guess will naturally tend to be above reality as long as there is some uncertainty regarding their score. This means that no matter how many times it is successfully replicated, this study design cannot in principle show that describing the "Dunning-Kruger effect" as a psychological phenomenon is justified.[11] Dunning addresses this in a 2011 paper of his, stating that the argument is "relabeling" the effect at best, and not sufficient in explaining the results at its worst. He concludes that there are methods of estimating this dynamic and that accounting for it has negligible impact on the results. [12]

A finding that is more well established is that people across the board tend to overestimate themselves.

The principle is illustrated indirectly by the common saying that "I've learned enough about ________ to know what I don't know." The implication is that someone who hasn't learned much about the subject would have no appreciation for how much there is to learn about it, and so might grossly overestimate their level of understanding. This is considered by many people to be a truism.Wikipedia

The effect[edit]

One of the painful things about our time is that those who feel certainty are stupid, and those with any imagination and understanding are filled with doubt and indecision.
Bertrand Russell, The Triumph of Stupidity

The Dunning-Kruger effect is related to illusory superiority,Wikipedia where people tend to overestimate their good points in comparison to others around them, while concurrently underestimating their negative points. The effect has been shown by experiment in several ways, but in this case Dunning and Kruger tested students on a series of criteria such as humour, grammar, and logic, and compared the actual test results with each student's own estimation of their performance.

Those who scored well on these tests were shown, consistently, to underestimate their performance. This can be explained as a form of psychological projection: those who found the tasks easy (and thus scored highly) mistakenly thought that they would also be easy for others. This is similar to the aforementioned "impostor syndrome" — found notably in graduate students and high-achieving women — whereby high achievers fail to recognize their talents as they think that others must be equally good.

Those who scored lowest on the test were found to have "grossly overestimated" their scores, thus displaying what became known as the Dunning-Kruger effect. And what about the underachievers who overestimated their performance? In the words of Dunning and Kruger:[13]

This overestimation occurs, in part, because people who are unskilled in these domains suffer a dual burden: Not only do these people reach erroneous conclusions and make unfortunate choices, but their incompetence robs them of the metacognitive ability to realize it.

The original study was focused specifically on competence, as opposed to intelligence — Dunning and Kruger were more concerned with the empirical, measurable factors of how well a person could perform a task (even "simple" or "stupid" tasks) and that person's perception of how they performed that task, rather than the more nebulous concept of comparative "intelligence" or "education". However, the inspiration for the entire study was a desperately under-educated Pittsburgher who possessed badly flawed reasoning skills (see below). The term is still properly meant to describe a disconnect between perceived and empirical competence, rather than IQ or intelligence.

A little knowledge can be dangerous[edit]

A little knowledge of the Dunning-Kruger effect could give you impostor syndrome![citation NOT needed]
It is not in our human nature to imagine that we are wrong.
—Kathryn Schulz[14]
Now, think about how much the average person knows about your area of specialty. Not only do they know comparatively little, they likely have no idea how little they know and how much specialized knowledge even exists. Furthermore, most of what they think they know is likely misleading.

Now realize that you are as ignorant as the average person is in every other area of knowledge in which you are not expert. The Dunning-Kruger effect is not just about dumb people not realizing how dumb they are. It is about basic human psychology and cognitive biases.
—Steven Novella[15]:49

The effect can also be summarised by the phrase "a little knowledge is a dangerous thing."[16] A small amount of knowledge can mislead a person into thinking that they're an expert because this small amount of knowledge isn't a well-known fact.

For a potent example, consider former children's TV presenter and "science advocate" Johnny Ball, who in 2009 stunned audiences by denying the existence of climate change. His reasoning was based on the fact that water vapour as a greenhouse gas is much more prevalent, potent, and thus much more powerful than carbon dioxide — and because combustion reactions also produce water, it should be water vapour we're worried about, not carbon dioxide.[17] Sound reasoning to an amateur, but anyone minimally qualified in atmospheric chemistry would tell you that the water isn't a problem because the atmosphere has a way of getting water to the ground — precipitation, that is, rain, snow, or hail. Thus its concentration (for given temperatures and pressures) remains more or less constant globally.[note 1]

Ball's premise is also used by some critics against the hydrogen economy: because hydrogen vehicles emit water vapour from their exhaust, they are seen to be more damaging to the environment than petrol-driven vehicles. An ill-informed and unsound argument — hydrogen fuel cell vehicles emit approximately the same amount of water per mile as vehicles using gasoline-powered internal combustion engines.[18] The difference is that while water vapour remains in the atmosphere for only a few days or weeks, and hydrogen gas for about two years, carbon dioxide lingers for more than a century.[19]

Origins[edit]

Comparison of actual score vs perceived score. A well-calibrated and honest set of predictions is intended to follow a straight line (i.e., prediction of ability matches the outcome). However, even a dataset of uniform noise gives the appearance of overconfidence.[4] Graphed as a proportion of the over-estimate, those in the lowest quartile were seemingly guilty of the most significant over-estimation.[13]
The fool doth think he is wise, but the wise man knows himself to be a fool.
—Touchstone, in As You Like It by William Shakespeare

Dunning and Kruger properly proved its existence with the 2000 Ig Nobel Prize winning[20] paper "Unskilled and Unaware of It",[13] doubtless at great risk to personal sanity.

They were famously inspired by McArthur Wheeler, a Pittsburgh man who attempted to rob a bank while his face was covered in lemon juice.[21] Wheeler had learned that lemon juice could be used as "invisible ink" (that is, the old childhood experiment of making the juice appear when heated); he therefore got the idea that unheated lemon juice would render his facial features unrecognizable or "invisible".[22]

After he was effortlessly caught (as he made no other attempts to conceal himself during the robberies), he was presented with video surveillance footage of him robbing the banks in question, fully recognizable. At this, he expressed apparently sincere surprise and lack of understanding as to why his plan did not work — he was not competent enough to see the logical gaps in his thinking and plan.[23]

The idea that people who don't know that they don't know ("Dunning-Kruger effect" is so much less confusingWikipedia than any "know-know" phrase) isn't particularly new. The Bertrand Russell quote is from the mid-1930s, and even earlier, Charles Darwin, in The Descent of Man in 1871, stated "ignorance more frequently begets confidence than does knowledge." Even back in ancient Greece, Plato's Apology attributed to Socrates the quote at the top, which today is often summed up as, roughly, "the wisest people know that they know nothing."

In his 1996 book Rush Limbaugh is a Big Fat Idiot, Al Franken described the phenomenon of "pseudo-certainty", which at the time of writing and onwards, was rampantly being displayed by pundits and politicians such as Rush Limbaugh and Newt Gingrich, who would use "common sense" as the basis for their cocky assertions. Franken prefers the term "being a fucking moron."[24]:12

Some examples[edit]

Those who think they know never learn. —from the Tao Te Ching

See also[edit]

External links[edit]

Notes[edit]

  1. Granted, there are also mechanisms that remove carbon dioxide from the atmosphere, but those tend to be properties of other things, such as the ecosystem, rather than of the atmosphere itself. Furthermore, whereas water vapor in the atmosphere tends to stay at an equilibrium due to properties of water itself (i.e. it reaches a maximum level of saturation in the atmosphere, forms into clouds, aggregates further into denser-than-air clusters,Wikipedia and falls as precipitation), the things that remove carbon dioxide from the atmosphere (such as plants performing photosynthesis) can only absorb so much carbon dioxide at a time and can easily be overwhelmed (especially if humans reduce the absorption capacity through activities such as deforestation).Wikipedia

References[edit]

  1. Willingness to Opine on a Topic vs. Knowledge of That Topic Saturday Morning Breakfast Cereal.
  2. Smug Snake TV Tropes.
  3. Unskilled and unaware of it: how difficulties in recognizing one's own incompetence lead to inflated self-assessments by Justin Kruger & David Dunning (1999) J. Pers. Soc. Psychol. 77(6):1121-34. doi:10.1037//0022-3514.77.6.1121.
  4. 4.0 4.1 The Dunning-Kruger Effect is Autocorrelation by Blair Fix (April 8th, 2022) Economics from the Top Down.
  5. What Is Anosognosia? by Smitha Bhandari (October 20, 2020) WebMD.
  6. Debunking the Dunning-Kruger effect – the least skilled people know how much they don’t know, but everyone thinks they are better than average by Eric C. Gaze (May 8, 2023 8.19am EDT) The Conversation.
  7. Random Number Simulations Reveal How Random Noise Affects the Measurements and Graphical Portrayals of Self-Assessed Competency by Edward Nuhfer et al. (2023) Numeracy 9(1):4. doi:10.5038/1936-4660.9.1.4.
  8. The Dunning-Kruger effect and its discontents by David Dunning (07 March 2022) The British Psychological Society.
  9. A rational model of the dunning–kruger effect supports insensitivity to evidence in low performers By Rachel Jansen et al. (2021) Nature Human Behaviour 5: 756–763. doi:10.1038/s41562-021-01057-0
  10. https://digitalcommons.usf.edu/cgi/viewcontent.cgi?article=1215&context=numeracy
  11. https://www.sciencedirect.com/science/article/abs/pii/S0160289620300271
  12. Chapter five - The Dunning–Kruger Effect: On Being Ignorant of One's Own Ignorance by David Dunning (2011). Advances in Experimental Social Psychology 44: 247–296. doi:10.1016/B978-0-12-385522-0.00005-6
  13. 13.0 13.1 13.2 Cite error: Invalid <ref> tag; no text was provided for refs named dunning
  14. Being Wrong: Adventures in the Margin of Error by Kathryn Schulz (2010) Ecco. ISBN 0061176052.
  15. The Skeptic's Guide to the Universe by Steven Novella (2018), Grand Central Publishing. ISBN 1538760517.
  16. "Phrases.org.uk The meaning and origin of the expression: A little knowledge is a dangerous thing", The Phrase Finder.
  17. It's not the end of the World by Johnny Ball (Dec 21, 2009) Daily Express.
  18. Water Emissions from Fuel Cell Vehicles Energy Efficiency and Renewable Energy, U.S. Department of Energy (archived from January 27, 2007).
  19. Dialogue: Fuel Cells and Water Vapor (Winter 2006-2007) Earthwise: Union of Concerned Scientists 9(1). Archived from April 23, 2011.
  20. The 2000 Ig Nobel Prize Winners Improbable Research.
  21. Why losers have delusions of grandeur (May 23, 2010 | 5:28am) New York Post.
  22. Why a bank robber thought covering himself in lemon juice would help him get away with it by Kate Fehlhaber (May 19, 2017) Quartz.
  23. The Burglar With the Lemon Juice Disguise by Vaughan Bell (February 11, 2010) Mind Hacks.
  24. Rush Limbaugh Is a Big Fat Idiot and Other Observations by Al Franken (Delacorte Press, 1996) ISBN 0-385-31474-4
  25. Gene Ray: @Wisest_Human Twitter.