Regression to the mean
Regression to the mean is the technical term for things evening out and a plausible mechanism for homeopathy and other woo. Specifically, it refers to the tendency of a random variable that is highly distinct from the norm to return to "normal". On average, every observation is likely to be somewhat close to the mean, whether or not it follows a really unusual value. It only becomes most obvious when a strange result (e.g. a hole-in-one in golf) is followed by something much more ordinary (a double-bogey).
 In medicine
Unfortunately, much of the effects claimed by alternative medicine can often be explained simply as regression to the mean. When Aunt Jane's acne gets better after rubbing mint leaves on her face, that's
just weird "anecdotal evidence" based almost entirely on regression to the mean. Many symptoms will come and go in an apparently random fashion if recorded in an objective way - headaches, for example, tend to disappear without the aid of any treatment over time. People seek treatment when their symptoms are particularly severe, like those on the cover of Sports Illustrated the symptoms are at their respective "top". Regression to the mean, therefore, suggests that if symptoms are excessively severe this week, then next week they should be less severe simply by random fluctuations. If treatment is only sought when these symptoms are at their worst there will almost always be a coincidental recovery. This appears even if the treatment has no effectiveness whatsoever.
A placebo control group in a controlled trials removes the effect of regression to the mean. Both groups, on average, experience a tendency to regress to the mean. If the treatment group shows a statistically significant increase in the speed that symptoms regress, it can be attributed to the effects of the treatment, not the placebo effect or regression to the mean.
 Other examples
For example, if a researcher gave a large group of people a test of some sort and selected the top-performing 5%, these people would be likely to score worse, on average, if re-tested. Similarly, the bottom 5% would be likely to score better on a retest. In either case, the extremes of the distribution are likely to "regress to the mean" due to simple luck and natural random variation in the results.
One way of thinking about "regression to the mean" is in terms of sports performance. In order to win a football championship, for example, it is not enough only to be a good team -- one needs to be both good and lucky. The team at the top of the standings in mid-season is likely to have been both good and lucky to that point, but cannot count on still being lucky for the rest of the season. For this reason, the team that is at the top of the standings at midseason is more likely to drop in standings than to remain at the top, and more likely to remain at the top than to improve (how does one improve from "the top," anyway?).
This observation has been tagged the "Sports Illustrated Jinx". The jinx states that a player or team featured on the cover of a sports magazine such as SI is likely to have a disappointing year the following season (or even a disappointing game the following week). But if you think about it, a player is only likely to make the cover once, and for some surprisingly good performance - something truly spectacular that requires not only their superlative skill, but also lots of luck to beat the superlative skill of their competitors. Athletes on the cover of Sports Illustrated are likely to be at the very top of their game, and at the top, the most likely direction to move next is down. The next year, although the player may still be as skilled, he or she will not be as lucky, and post scores closer to "typical".
 Traffic cameras
A good example of how regression to the mean can seem to prove the effectiveness of almost any intervention is that of the installation of road traffic safety measures - say speed cameras, a very common device in the UK. A flukey cluster of accidents one year seems to show that a stretch of road is becoming more dangerous. "Hey, we need a speed camera!" In the year after the camera is installed, the number of accidents is roughly average. "See, the speed camera has been effective in reducing accidents!" "But we've got the same accident rate as we always had" "Isn't that geat? Think how many accidents we'd be having if the speed camera hadn't nipped the accident rate rise in the bud!" "Let's remove it and show it's not necessary." "You wanna gamble with kids' lives!?"
If you are a speed camera salesman, offer to the mayor to install a camera FREE for *one* year at last year's accident blackspot. A year later, the mayor won't dare refuse to leave it in place (if he looks as though he might, ring the town newspaper). Kerching! Got another camera? Where's THIS year's blackspot?
- ↑ Do the math using calculus, expected values and other headache-inducing tools of statisticians.
- ↑ If you're not familiar with golf, consider yourself lucky.
- ↑ The effect would be big if test-takers answered randomly