Feeling the Future: Experimental Evidence for Anomalous Retroactive Influences on Cognition and Affect
|The wonderful world of|
|...and their strange powers|
|Persons of interest|
"Feeling the Future: Experimental Evidence for Anomalous Retroactive Influences on Cognition and Affect" is a paper submitted to and published in the Journal of Personality and Social Psychology by Daryl J. Bem of Cornell University that claims to offer strong evidence for the case of precognition in humans. In gained some notoriety during its "in press" phase in late 2010, with several pop science organisations and blog posts covering the experiment and attempting to understand it.
The paper introduces some ingenious methodologies for rigorous study of certain kinds of psychic claims. The ingenious part comes from taking well-established psychological tests and reversing the order that the individual tests are administered. For instance, in one test participants are asked to type certain words, selected at random from a list, and then are asked to recall words from the full list. The result is that they are capable of recalling more of the words that they had previously typed. In Bem's research, this is turned on its head' students were asked to recall words from a list and then asked to type a random selection of them. The result being that these students recalled the words that they would later type - the ones selected at random that they had no prior knowledge of at the time of the recall test. This suggests that their minds were somehow aware of what words they would experience in the future and selected them from the full list in advance!
However, the statistical analysis and subject selection criteria are highly suspect and the significant effects are likely a product of experimenter bias.
A response by E.J. Wagenmakers et al. highlights some of the major issues that call into question the validity of the analysis by Bem.
- Bem has published his own research methodology and encourages the formulation of hypotheses after data analysis. This form of post-hoc analysis makes it very difficult to determine accurate statistical significance. It also explains why Bem offers specific hypotheses that seem odd a priori, such as erotic images having a greater precognitive effect. Constructing hypotheses from the same data range used to test those hypotheses is a classic example of the Texas sharpshooter fallacy
- The paper uses the fallacy of the transposed conditional to make the case for psi powers. Essentially mixing up the difference between the probability of data given a hypothesis versus the probability of a hypothesis given data.
- Wagenmakers' analysis of the data using a Bayesian t-test removes the significant effects claimed by Bem.
Any new result in any field of science requires extensive independent replication before it can be accepted as valid. This is no different for psychic powers, drug studies, or theories of physics. At least one replication of one of the tasks Bem used has failed to show significance, and hopefully others will attempt additional replications. Researcher Richard Wiseman is attempting to create a registry of replication attempts to control for publication bias.
In the end the paper offers some promising methods but should not be taken as evidence for precognition without extensive independent replication of the results, particularly since there are significant questions about the introduction of bias into the analysis of the data.
In March of 2012 the news broke of a failed replication attempt. Bem tried to brush it off by suggesting that because the group attempting replication was skeptical this would negatively influence the results.
- In press version.
- Journal of Personality and Social Psychology, 100, 407-425. (Published version, March 2011)
- ↑ 1.0 1.1 New Scientist, "Is this evidence that we can see the future?", Peter Aldhous, 11 November 2010.
- ↑ "Why Psychologists Must Change the Way They Analyze Their Data: The Case of Psi"
- ↑ Are you conducting a replication of Daryl Bem's 'Feeling the Future' experiments?
- ↑ Bem’s psychic study cast into doubt as it fails replication attempts, Doubtful News.