Response bias

Tell me about your mother Psychology

For our next session...

Cognitive biases Mental health Superstition Famed psychologists

Popping into your mind

Reaction formation Cognitive dissonance Myers-Briggs Type Indicator Choice theory Confirmation bias Personality cult Ultimate attribution error Journal of Individual Differences Bad faith v - t - e

Response bias is the name of a group of cognitive biases which commonly influence the results of surveys, questionnaires, interviews, and polls. Like statistics, it's a great way to lie while still being honest, although honest mistakes are also common.

Types

Acquiescence bias

Acquiescence bias is the tendency for people to respond positively ("yeah, sure") to survey questions when in doubt.

For example, 55% of respondents agree and 42% disagree with the statement, "The best way to ensure peace is through military strength", but when given the choice between the former and "Diplomacy is the best way to ensure peace" only 33% agree with the first statement, and 55% percent agree with the second.

The Pew Research Center recommends that it is better practice to offer respondents a choice between alternative statements, than to simply ask whether they agree with something.

Social desirability bias

Respondents eschew answers that are considered socially undesirable. This is especially common on topics such as drugs, immigration, personal finances, health, religion, sex, and personal achievements.

Some examples:

• About 15% of US males report visiting a prostitute at least once in their life, but other surveys also show that men report a lot more sexual partners than women do, so something doesn't add up here. Once you account for the prostitution, the numbers do seem to add up though, and you end up with about 23% of males who've paid for sex.
• Responses will differ on topics such as feminism or sex depending on the gender of the researcher (especially when the participant is male).

Demand characteristics

This is the tendency of participants to (subconsciously) fit their behaviour to what is perceived to be the expected or desired behaviour.

Some examples:

• Rape myths were more accepted when the researcher was dressed conservatively than when the researcher was dressed provocatively.
• When informed that the survey's interest was menstrual cycle symptoms, women reported significantly more negative symptoms than women who were not told the survey's interest.

Extreme responding

The tendency to only select the most extreme responses in a survey where one is expected to choose from a scale (eg. to choose "Strongly agree" over "somewhat agree").

References

Articles on Cognitive biases

  Selection bias  -  Outcome bias  -  Confirmation bias  -  Clustering illusion  -  Demonization  -  Hindsight bias  -  Confabulation  -  Framing  -  Just world fallacy  -  Overconfidence effect  -  Walled garden  -  Survivorship bias  -  Frequency illusion  -  Overgeneralization  -  Experimenter bias  -  Dunning–Kruger effect  -  Moral licensing  -  Ultimate attribution error  -  Gambler's fallacy  -  Delusion  -  Viés de seleção  -  Conjunction fallacy  -  Outgroup