Information icon.svg Voting in the 2024 RationalWiki Moderator Election is closed, votes are being counted
Bronze-level article

Gaussian distribution

From RationalWiki
Jump to navigation Jump to search
A graph of the Gaussian distribution probability density function.
Gaussian density plot illustrating the probability of being n standard deviations away from the mean.
Part of a
convergent series on

Mathematics
Icon math.svg
1+1=11
We are number one

A Gaussian distribution or Gauss distribution is a statistical model that describes a particular way that data can be distributed around the mean, the average. It is also sometimes called the normal distribution, the Laplace–Gauss distribution, or the bell curve (because its graph looks like a bell).[note 1] It's incredibly useful for analyzing certain kinds of data in physics, medicine, anthropology, and many other types of science. At the same time, it is often misinterpreted and misused, especially by racialists.

Definition[edit]

A standard Gaussian distribution is such that the mean is zero, the variance is one (unit variance), and the most likely something can occur is 1 (100%). As such, the probability density function of the standard Gaussian distribution may be written as: . This makes the distribution technically in the exponential family of distributions. The Gaussian distribution is a specific kind of the more general Gaussian functionWikipedia.

In general, the Gaussian distribution with mean μ and standard deviation σ is equivalent to the standard Gaussian multiplied by σ, then added to μ.

In multiple dimensions, a random vector may be said to follow a multivariate Gaussian distribution or multinormal distribution if and only if every linear combination of its components follows a univariate Gaussian distribution. The distribution of a multinormal random variable is uniquely determined by its mean and the variances and covariances of its components.[1][note 2]

Occurrences in Statistics[edit]

According to the central limit theorem, the average and sum of n identically distributed random variables with finite variance approaches a Gaussian distribution as n becomes large.[2]

The Maxwell-Herschel Theorem states that the multivariate standard normal distribution[note 3] multiplied by a constant is the only rotationally invariant[note 4] distribution where the coordinates are independent.[3][4] James Clerk MaxwellWikipedia used this fact to derive a description of the distribution of velocities of particles in an ideal gas, since he assumed that particle velocities would follow a distribution with these properties.[5]

Gauss used it to model errors in astronomical observations[6] on the basis that if a series of independent observations are assumed to be identically distributed around some mean value which happens to be equal to the sample mean, then the probability of the sample is maximized if the distribution of the observations is assumed to be Gaussian.

The "continuity correction" is a relatively simple fix that stats students everwhere trip over. The Gaussian Distribution is continuous, so discrete outcomes need to be approximated by intervals with bounds equal to the discrete outcome ± 0.5.[7][note 5] The need is best demonstrated through an absurd case. Let's say you want to know the odds of getting exactly 50 heads out of 100 flips of a fair coin. Using a binomial distribution to find the exact odds will give you (100 choose 50)*.5^100, or about 7.96%. If you apply the normal approximation without the continuity correction, you would get Φ(0) - Φ(0) = 0.5 - 0.5 = 0[note 6] chance of this happening.[note 7] Obviously the chance of getting 50 heads is greater than 0%. Instead, you should calculate the probability that X~N(μ=50, σ=5)[8] is between 49.5 and 50.5, which will give you 7.97%, which is a pretty good estimate of the actual probability.

Where it applies[edit]

Some examples of things that follow a Gaussian distribution:

  • IQ - IQ scores are by definition fit or normed so that they follow a Gaussian curve.[9] When high IQ societies talk about being "3 standard deviations above the norm" or allowing only the "top 1%", this is what they're going on about.
  • Manufacturing and other process errors. This is where "six sigma" gets its name, the idea of the chance of an error occurring being more than six standard deviations from the mean
  • Distance between stars and planets - In fact, Gauss encountered the normal distribution by studying the orbits of the planets.[6] Pierre-Simon de LaplaceWikipedia used Gaussian distribution to show that the motion of planets remained invariant over time and so, contrary to Isaac Newton, there was no need for some sort of deity to come in and realign the Solar System.[10]
  • Accuracy of projectiles - In ballistics, the circular error probableWikipedia describes the chances of a missile or other projectile landing within a certain distance of a target. It follows Gaussian probabilities and often appears in analyses regarding nuclear missiles and nuclear war.[11]
  • Errors in scientific observations and measurements - observational errors are often an aggregate of many smaller sources, and thus per the Central Limit Theorem will be approximately normal. In fact, an earlier name for the Gaussian distribution was the "law of errors".[6]

Where it doesn't apply[edit]

  • As the Gaussian distribution is a continuous distribution, it will not be a good model for discrete data unless the discrete data is sufficiently granular (although it may still be a good model for the average of many observations of a discrete outcome.) Discrete data usually includes counts, such as amount of votes a candidate got, number of goats per square mile, or amount of times you got heads after flipping a coin five times.
  • It is not a good model for the lifespan of, for example, a product or an organism; usually different distributions are used instead.[12][13] This is especially the case if there is a chance that some units might be defective, as they will drive a high early failure rate, while wear over time leads to a higher failure rate of non-defective units, resulting in a "bathtub-shaped" curve.[14]

Use by Eugenicists[edit]

Adolphe Quetelet sought to prove that various physical attributes of humans followed a Gaussian distribution, and sought to prove this by measuring physical attributes in many subjects.[15] He believed that individual humans represent deviations from an "average man" representative of all of humanity.[16] Quetelet's ideas would influence the eugenics movement and its supporters, such as Francis Galton.[15]

Galton assumed that Quetelet's demonstration that various biometric traits followed a Gaussian distribution should also hold for traits of ability such as intelligence.[17] Francis Galton derived the concept of regression to determine how genetic traits were inherited.[17] He observed that tall parents tended to have tall children, but that those children were not on average as tall as their parents, a phenomenon he described as "regression to mediocrity".[17][note 8] Galton saw this as an improvement on and explanation for Quetelet's observations.[17]

While IQ tests originally expressed scores as a quotient between a person's "mental age" by their actual age,[note 9][18] this was only meaningful when testing children. IQ tests began using "deviation IQs" based on relative comparisons of performance between a test-taker against a sample used to norm the test in order to be able to measure adult intelligence, especially David Wechsler's 1939 test.[19] These IQ test scores were fit to a Gaussian distribution because intelligence was assumed to follow such a distribution.[20][17] Intelligence testing has historically been of interest to eugenicists as a way of identifying who is exceptional and who is defective.

In practice, intelligence in humans is... weird. An IQ test can identify someone who is exceptionally dumb or intelligent, but a person who scores a few points higher or lower is not necessarily "smarter" or "dumber", just able to solve whatever pattern the IQ test is testing; at best the IQ test is the map, not the territory. Richard Feynman scored an IQ of "only" 124[21], which would put him in the "significantly above average" category but much less than the "genius level" one would expect of a Nobel-prize winning Physicist, or any random physicist for that matter; the average IQ of Physicists is 128.[22] He would not be allowed to join Mensa with that IQ, but he was probably smart enough to notice that anyone bragging about going to such a meeting was advertising the schedule of when their wife would be all alone. Meanwhile, plenty of "geniuses" fail to achieve success and plenty of people with below average intelligence manage to do quite well and establish businesses.

Furthermore, as anyone who has done studies on intelligence can assure you, a penguin scores consistently as highly as non-English speakers.[23]

See also[edit]

Notes[edit]

  1. Though this isn't terribly useful since the graph for many other distributions look like bells, such as the Student's t-distributionWikipedia and some versions of the logistic distributionWikipedia and the Weibull distribution.Wikipedia While they're in a different class of distributions, the Poisson distributionWikipedia and binomial distributionWikipedia look like bells too. In fairness, however, as the parameters increase, those other distributions become the Gaussian distribution.
  2. This means that if two multinormal random vectors have the same mean, and their components have the same variances and covariances, then they must have the same distribution.
  3. This is defined as a vector composed of multiple independent standard univariate normal distributions
  4. This means that applying an orthonormal (i.e. distance-preserving and origin-preserving) transformation to the vector does not change its distribution
  5. Technically it'll be slightly different from .5 depending on where you are in the curve, but the actual differences are so miniscule and no human alive could do the math in a reasonable amount of time, so it can be safely ignored
  6. Φ denotes the cumulative distribution function of the standard normal distribution.
  7. The same will happen when computing the odds of getting any specific number of heads, for that matter.
  8. This can be thought of as a predecessor to the modern concept of regression to the mean.
  9. Hence the term "Intelligence Quotient".

References[edit]

  1. Multivariate Normal Distribution, Applied Multivariate Statistical Analysis, Penn State University.
  2. Weisstein, Eric W., Central Limit Theorem, Wolfram MathWorld.
  3. Kolditz, Tobias, Herschel-Maxwell Derivation of the Normal Distribution. October 26, 2020.
  4. Jaynes, E. T., The central, Gaussian or normal distribution, Probability Theory. 2002.
  5. Gyenis, Balázs, Maxwell and the normal distribution: A colored story of probability, independence, and tendency toward equilibrium, History and Philosophy of Physics. February 5, 2017.
  6. 6.0 6.1 6.2 Sedgewick, Robert; Wayne, Kevin; and Dondero, Robert. Gaussian Distribution, Introduction to Programming in Python. June 2015.
  7. Campbell, Russell Bruce, Continuity correction factor.
  8. Glen, Stephanie. Normal Approximation to the Binomial, Statistics How To.
  9. Spielman, et al., Measures of Intelligence, Psychology: OpenStax. August 7, 2019.
  10. Pannekoek, Antonie, The planetary theory of Laplace, Popular Astronomy (56). 1948.
  11. Wellenstein, A. (n.d.) MISSILEMAP Frequently Asked Questions (FAQ). Restricted Data.
  12. Tian, Lu, Survival Distributions, Hazard Functions, Cumulative Hazards, BIO 224, Stanford University.
  13. Rodríguez, Germán, Survival Models, Generalized Linear Models. September 2010.
  14. Wilkins, Dennis J., The Bathtub Curve and Product Failure Behavior, Reliability HotWire, November 2002.
  15. 15.0 15.1 Eknoyan, Garabed, Adolphe Quetelet (1796–1874)—the average man and indices of obesity, Nephrology Dialysis Transplantation (23)1. January 2008.
  16. Rose, Todd, How the Idea of a ‘Normal’ Person Got Invented, The Atlantic. February 18, 2016.
  17. 17.0 17.1 17.2 17.3 17.4 Krashniak, Adam; Lamm, Ehud, Francis Galton’s regression towards mediocrity and the stability of types, Studies in History and Philosophy of Science (86). April 2021.
  18. Intelligence Quotient (IQ), Glossary of Important Assessment and Measurement Terms, National Council on Measurement in Education.
  19. Psychological Testing: Intelligence Quotient, MentalHelp.net.
  20. Brock, Stephen E., Descriptive Statistics and Psychological Testing, Psychology in the Schools, 2020.
  21. Alexander, Scott. So you’ve learned you’ve got a “pitifully” low IQ. How worried should you be?, Vox. October 23, 2017.
  22. McLain, Sylvia. If physicists are smarter than social scientists, are religious people dumb?, The Guardian. February 27, 2014.
  23. Monty Python, Penguin Intelligence, Dailymotion.