maths.free › Probability Theory › Probability › Central Tendency

Central Tendency

Consider the following two situations: Situation 1. A small town decides to hold a lottery to raise funds for charitable purposes.

Central Tendency

Consider the following two situations:

Situation 1. A small town decides to hold a lottery to raise funds for charitable purposes. A total of \(10,001\) tickets are sold, and the tickets are labeled with numbers from the set \(\{0,1,2,\dots,10,000\}\). At a public ceremony, duplicate tickets are placed in a big box, and the mayor draws the winning ticket from out of the box. Just to heighten the suspense as to who has actually won the prize, the mayor reports that the winning number is at least \(7,500\). The citizens ooh and aah and they can't wait to see who among them will be the final winner.
Situation 2. Behind a curtain, a fair coin is tossed \(10,000\) times, and the number of heads is recorded by an observer, who is reputed to be honest and impartial. Again, the outcome is an integer in the set \(\{0,1,2,\dots,10,000\}\). The observer then emerges from behind the curtain and announces that the number of heads is at least than \(7,500\). There is a pause and then someone says What? Are you out of your mind?

So we have two probability spaces, both with sample space \(S=\{0,1,2,\dots,10,000\}\). For each, we have a random variable \(X\), the winning ticket number in the first situation, and the number of heads in the second. In each case, the expected value, \(E(X)\), of the random variable \(X\) is \(5,000\). In the first case, we are not all that surprised at an outcome far from the expected value, while in the second, it seems intuitively clear that this is an extraordinary occurrence. The mathematical concept here is referred to as central tendency, and it helps us to understand just how likely a random variable is to stray from its expected value.

For starters, we have the following elementary result.

To make Markov's inequality more concrete, we see that on the basis of this trivial result, the probability that either the winning lottery ticket or the number of heads is at least \(7,500\) is at most \(5000/7500=2/3\). So nothing alarming here in either case. Since we still feel that the two cases are quite different, a more subtle measure will be required.

Variance and Standard Deviation

Again, let \((S,P)\) be a probability space and let \(X\) be a random variable. The quantity \(E((X-E(X))^2)\) is called the variance of \(X\) and is denoted \(\var(X)\). Evidently, the variance of \(X\) is a non-negative number. The standard deviation of \(X\), denoted \(\sigma_X\) is then defined as the quantity \(\sqrt{\var(x)}\), , \(\sigma_X^2 =\var(X)\).

Example

For the spinner shown at the beginning of the chapter, let \(X(i)=i^2\) when the pointer stops in region\(i\). Then we have already noted that the expectation \(E(X)\) of the random variable \(X\) is \(109/8\). It follows that the variance \(\var(X)\) is: \[\begin{aligned}\var(X) =\amp(1^2-\frac{109}{8})^2\frac{1}{8}+(2^2-\frac{109}{8})^2\frac{1}{4}+ (3^2-\frac{109}{8})^2\frac{1}{8}+(4^2-\frac{109}{8})^2\frac{1}{8} \\ \amp+ (5^2-\frac{109}{8})^2\frac{3}{8} \\ =\amp (108^2+105^2+100^2+93^2+84^2)/512 \\ =\amp 48394/512\end{aligned}\] It follows that the standard deviation \(\sigma_X\) of \(X\) is then \(\sqrt{48394/512}\approx 9.722\).

Variance (and standard deviation) are quite useful tools in discussions of just how likely a random variable is to be near its expected value. This is reflected in the following theorem.

Theorem: Chebyshev's Inequality

Let \(X\) be a random variable in a probability space \((S,P)\), and let \(k>0\) be a positive real number. If the expectation \(E(X)\) of \(X\) is \(\mu\) and the standard deviation is \(\sigma_X\), then \[\begin{aligned}\end{aligned}\]

Proof

Let \(A=\{r\in \reals:|r-\mu|>k\sigma_X\}\).

Then we have: \[\begin{aligned}\var(X) \amp = E((X-\mu)^2) \\ \amp = \sum_{r\in \reals}(r-\mu)^2\prob(X=r) \\ \amp \ge \sum_{r\in A}(r-\mu)^2\prob(X=r) \\ \amp \ge k^2\sigma_X^2\sum_{r\in A}\prob(X=r) \\ \amp \ge k^2\sigma_X^2\prob(|X-\mu|>k\sigma_X).\end{aligned}\] Since \(\var(X)=\sigma_X^2\), we may now deduce that \(1/k^2\geq \prob(|X-\mu|)>k\sigma_X)\). Therefore, since \(\prob(|X-\mu|\le k\sigma_X)=1-\prob(|X-\mu|> k\sigma_X)\), we conclude that \[\begin{aligned}\end{aligned}\]

Condensed: the full section is in Keller & Trotter, Applied Combinatorics.

现在轮到你没有计算器能解决这一个问题, 但其中的碎片是可以计算的。请在下面尝试一个, 或者输入您自己的。

保持你自己的工作

免费账户在每一课上都添加注解, 记录你完成的, 在一个地方解决的, 以及您可以询问的关于此页的导师。数学本身向每个人开放, 是否签名。

签名上签名登录

此处所用符号

输入完整定义、图片和其中每个字母的含义的符号。

人们对人们提出的问题

What is the difference between probability and statistics?

Probability goes from a known model to what the data should look like; statistics goes from data back to the model. Probability theory is the deductive half.

What does the law of large numbers promise?

That the average of many independent samples converges to the expected value. It says nothing about any single trial.

本页部分内容从 Keller & Trotter, Applied Combinatorics (CC BY-SA 4.0). 在这里进行浓缩和重新解释;错误属于我们。

Central Tendency

Variance and Standard Deviation

此处所用符号

人们对人们提出的问题

更多 Probability Theory