Sample Variance Distribution
Let N samples be taken from a population with central moments mu_n. The sample variance m_2 is then given by
where m=x^_ is the sample mean.
The expected value of m_2 for a sample size N is then given by
| [画像: <s^2>=<m_2>=(N-1)/Nmu_2. ] |
(2)
|
Similarly, the expected variance of the sample variance is given by
(Kenney and Keeping 1951, p. 164; Rose and Smith 2002, p. 264).
The algebra of deriving equation (4) by hand is rather tedious, but can be performed as follows. Begin by noting that
| var(x)=<x^2>-<x>^2, |
(5)
|
so
| var(s^2)=<s^4>-<s^2>^2. |
(6)
|
The value of <s^2> is already known from equation (◇), so it remains only to find <s^4>. The algebra is simplified considerably by immediately transforming variables to x_i^'=x_i-mu and performing computations with respect to these central variables. Since the variance does not depend on the mean mu of the underlying distribution, the result obtained using the transformed variables will give an identical result while immediately eliminating expectation values of sums of terms containing odd powers of x_i (which equal 0). To determine <s^4>, expand equation (6) to obtain
![画像:<[1/Nsumx_i^2-(1/Nsumx_i)^2]^2>](/index.cgi/larger-text/https://mathworld.wolfram.com/images/equations/SampleVarianceDistribution/Inline27.svg){kind=link}
Working on the first term of (10),
The second term of (◇) is given by
and the third term by
Plugging (◇)-(19) into (◇) then gives
![画像:1/(N^2)[Nmu_4+N(N-1)mu_2^2]-2/(N^3)[Nmu_4+N(N-1)mu_2^2]+1/(N^4)[Nmu_4+3N(N-1)mu_2^2]](/index.cgi/larger-text/https://mathworld.wolfram.com/images/equations/SampleVarianceDistribution/Inline60.svg){kind=link}
![画像:(1/N-2/(N^2)+1/(N^3))mu_4+[(N-1)/N-(2(N-1))/(N^2)+(3(N-1))/(N^3)]mu_2^2](/index.cgi/larger-text/https://mathworld.wolfram.com/images/equations/SampleVarianceDistribution/Inline63.svg){kind=link}
![画像:((N-1)[(N-1)mu_4+(N^2-2N+3)mu_2^2])/(N^3)](/index.cgi/larger-text/https://mathworld.wolfram.com/images/equations/SampleVarianceDistribution/Inline69.svg){kind=link}
(Kenney and Keeping 1951, p. 164). Plugging (◇) and (23) into (◇) then gives
![画像:((N-1)[(N-1)mu_4-(N-3)mu_2^2])/(N^3),](/index.cgi/larger-text/https://mathworld.wolfram.com/images/equations/SampleVarianceDistribution/Inline75.svg){kind=link}
as before.
For a normal distribution, mu_2=sigma^2 and mu_4=3sigma^4, so
The third ane fourth moments of s_(Gaussian)^2 are given by
giving the skewness and kurtosis excess of the distribution of the s_(Gaussian)^2 as
as computed by Student. Student also conjectured that the underlying distribution is Pearson type III distribution
where Gamma(z) is the gamma function--a conjecture that was subsequently proven by R. A. Fisher. Curves are illustrated above for sigma=1 and N varying from N=1 to 10.
See also
Mean Distribution, Sample, Sample Variance, Sample Variance Computation, Standard Deviation Distribution, VarianceExplore with Wolfram|Alpha
References
Kenney, J. F. and Keeping, E. S. Mathematics of Statistics, Pt. 2, 2nd ed. Princeton, NJ: Van Nostrand, 1951.Rose, C. and Smith, M. D. Mathematical Statistics with Mathematica. New York: Springer-Verlag, 2002.Referenced on Wolfram|Alpha
Sample Variance DistributionCite this as:
Weisstein, Eric W. "Sample Variance Distribution." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/SampleVarianceDistribution.html