RationalWiki will be going through an upgrade cycle this weekend. This will cause some down time, details are at the tech blog. As a reminder, we try and add information to the tech blog during any outage, you can always refer to it for details or as a form of communication if the site is down.

from Tmtoulouse (Talk), group Site wide (urgent) at 15:23, 18 April 2014

Regression to the mean

From RationalWiki
Jump to: navigation, search

Regression to the mean is the technical term for things evening out. Specifically, it refers to the tendency of a random variable that is highly distinct from the norm to return to "normal."

[edit] Examples

For example, if a researcher gave a large group of people a test of some sort and selected the top-performing 5%, these people would be likely to score worse, on average, if re-tested. Similarly, the bottom 5% would be likely to score better on a retest. In either case, the extremes of the distribution are likely to "regress to the mean" due to simple luck and natural random variation in the results.

One way of thinking about "regression to the mean" is in terms of sports performance. In order to win a football championship, for example, it is not enough only to be a good team -- one needs to be both good and lucky. The team at the top of the standings in mid-season is likely to have been both good and lucky to that point, but cannot count on still being lucky for the rest of the season. For this reason, the team that is at the top of the standings at midseason is more likely to drop in standings than to remain at the top, and more likely to remain at the top than to improve (how does one improve from "the top," anyway?).

This observation has been tagged the "Sports Illustrated Jinx". The jinx states that a player or team featured on the cover of a sports magazine such as SI is likely to have a disappointing year the following season (or even a disappointing game the following week). But if you think about it, a player is only likely to make the cover once, and for some surprisingly good performance - something truly spectacular that requires not only their superlative skill, but also lots of luck to beat the superlative skill of their competitors. Athletes on the cover of Sports Illustrated are likely to be at the very top of their game, and at the top, the most likely direction to move next is down. The next year, although the player may still be as skilled, he or she will not be as lucky, and post scores closer to "typical".

A good example of how regression to the mean can seem to prove the effectiveness of almost any intervention is that of the installation of road traffic safety measures - say speed cameras, a very common device in the UK. A flukey cluster of accidents one year seems to show that a stretch of road is becoming more dangerous. "Hey, we need a speed camera!" In the year after the camera is installed, the number of accidents is roughly average. "See, the speed camera has been effective in reducing accidents!" "But we've got the same accident rate as we always had" "Isn't that geat? Think how many accidents we'd be having if the speed camera hadn't nipped the accident rate rise in the bud!" "Let's remove it and show it's not necessary." "You wanna gamble with kids' lives!?"

If you are a speed camera salesman, offer to the mayor to install a camera FREE for *one* year at last year's accident blackspot. A year later, the mayor won't dare refuse to leave it in place (if he looks as though he might, ring the town newspaper). Kerching! Got another camera? Where's THIS year's blackspot?

[edit] In medicine

Unfortunately, much of the effects claimed by alternative medicine can often be explained simply as regression to the mean, and this plays a part in the anecdotal evidence used to support it. Many symptoms will come and go in an apparently random fashion if recorded in an objective way - headaches, for example, tend to disappear without the aid of any treatment over time. People seek treatment when their symptoms are particularly severe, like those on the cover of Sports Illustrated the symptoms are at their respective "top". Regression to the mean, therefore, suggests that if symptoms are excessively severe this week, then next week they should be less severe simply by random fluctuations. If treatment is only sought when these symptoms are at their worst there will almost always be a coincidental recovery. This appears even if the treatment has no effectiveness whatsoever.

This is accounted for in controlled trials by placebo control. A treatment group and a control group will both experience equal levels of "treatment", and so the tendency for symptoms to disappear on their own is covered by the control group. If the treatment group shows a statistically significant increase in the speed that symptoms regress, it can be attributed to the effects of the treatment, not the placebo effect or regression to the mean.

[edit] See also

Personal tools