Essay:Dirty little secrets in psychological research

From RationalWiki
Jump to: navigation, search
Essay.svg This essay is an original work by Etaroced.
It does not necessarily reflect the views expressed in RationalWiki's Mission Statement, but we welcome discussion of a broad range of ideas.
Unless otherwise stated, this is original content, released under CC-BY-SA 3.0 or any later version. See RationalWiki:Copyrights.
Feel free to make comments on the talk page, which will probably be far more interesting, and might reflect a broader range of RationalWiki editors' thoughts.
  1. Ethic boards never read your application, they glance over it briefly to make sure you aren't killing your subjects, then demand pages of revisions from predefined list for every application. These revision requests often include suggestions you painstakingly point out in your application that you are doing anyway.
  2. Undergraduates are used for almost all research participants. Undergraduates are amazingly dense, with vast majorities of them being completely unable to understand even the simplest of tasks. Huge amounts of data are worthless because participants do worse than randomly pressing keys with your forehead.
  3. Desperate to justify the time and costs, experimenters spend countless hours finding ways to group data in some way that it looks salvageable. This is often accompanied by randomly pasting data into "black box" statistic programs and running thousands of two-way comparisons till you find something that is significant.
  4. 99.99999999 percent of all published research will never even attempt to be replicated. You will be safe with your post-hoc black box analysis cause no one has time to make sure it is real effect.