Hawthorne effect

The Hawthorne Effect, in experimental testing, is subject's behavioral change if the subject is aware of being observed. It sometimes leads to fallacious conclusions involving magical thinking if it is not carefully accounted for. It is strongly related to the confirmation bias. This effect highlights the importance of double-blinded trials. While the Hawthorne effect is demonstrably present in the short term, it tends to deteriorate over time as the subject becomes habituated to the presence of the observer. It is named after a series of experiments at a Western Electric factory at Hawthorne, Chicago in the late 1920s and early 30s, which showed the effect. More recent studies have confirmed it.

The original study focused on the productivity of factory workers. Experimenters tried various changes to the factory environment and looked at the workers' productivity to try and find out which would improve factory output. They found that making a lot of different changes improved workers' performance: increasing the amount of lighting, changing working hours, introducing rest breaks, etc. But some of the results proved highly unintuitive: increasing lighting increased performance, but putting lighting back to the original level also caused an increase in performance. They concluded that simply by taking an interest in the workers they were improving their productivity, apart from any actual change they made. This doesn't mean that properly conducted double-blinded tests wouldn't show variation in performance with changes to the environment, but does show that it's important to conduct properly blinded tests to eliminate other factors influencing behavior.

As another example, if a researcher were to visit a non-technological people living in a remote part of the world, obtain permission to live with them and learn about their style of life and immediately begins documenting, there is a strong possibility he or she may produce an inaccurate representation. A far better approach would be to first live with the group for some significant length of time in order to allow its members to get used to his or her presence, and only then begin.

One real-world example of the Hawthorne Effect is displayed, possibly, in response to high-stakes educational testing. School systems commonly respond to testing under No Child Left Behind by taking measures that improve schools' performance on standardized tests (e.g. selective retention of students in critical years, limited effort to deter low-performing students from dropping out, reclassification of students as special-needs) without necessarily improving their educational success. (In general terms, it is usually much easier to manipulate — "game," if you prefer — statistics that represent reality than it is to change the underlying reality itself.)