CH 07
CH 07
SAMPLING
DISTRIBUTIONS
PARAMETERS AND STATISTICS
2
➢ Parameter: a numerical value associated with a
population. It is considered fixed and
unchanging.
Ex: population mean , population standard
deviation , and population proportion p
➢ Statistic: functions of the random sample
Ex: sample mean 𝑋ത , sample standard deviation 𝑠,
and sample proportion 𝑝ො
Note:
▪ Statistic refers to a sample quantity
▪ Parameter refers to a population quantity
▪ Statistic is a random variable
▪ In practice, parameters are unknown constants
3
Ex:
(1) X = the in-city gas mileage of a certain car
X and X are unknown
(2) Y = the commuting distance of workers in a large
city from their home to principal place of work
Y and Y are unknown
(3) W = the lifetime of light bulbs made by a certain
manufacturer W and W are unknown
4
SAMPLING DISTRIBUTION
➢ Sampling distribution: the probability
distribution of a statistic.
➢ One of major objectives of statistics is to use
the information of sample to approximate the
information of population.
➢ To estimate “ characteristics” of the population,
we take a random sample from the population.
Then we use the sample data to compute sample
statistics, such as the sample mean, sample
standard deviation, sample proportion. Use
sample statistics to estimate population
parameter. 5
➢ The sampling distribution of sample means is the
distribution of the sample means obtained when
we repeatedly draw samples of the same size
from the same population
➢ Statistical inference about a population parameters
is prime importance in most practical studies
➢ The central limit theorem (CLT) forms a
theoretical base for statistics. It is used to estimate
population parameters and hypothesis testing.
6
MEAN AND STANDARD DEVIATION OF 𝑋ത
Theorem 1 :
• Given a polulation with ,
• Take a sample of size n : X 1 , X 2 , , X n
• Consider statistic (sample mean) :
X1 + X 2 + + X n
X=
n
Then
2
X = , = 2
X
, X =
n n
𝜎
𝜎𝑋ത = when n /N ≤ .05 where N = population size
𝑛
7
Theorem 2 : X is normal when sampling from
a normal population. If the normal population
has mean and standard deviation , then
2
X = , X = 2
, X =
n n
𝜎
𝜎𝑋ത = when n /N ≤ .05 where N = population size
𝑛
8
Sampling distributions of 𝑋ത when population is normal
9
Theorem 3 (CLT) : Whatever the population, the distribution
of X is approximat ely normal when n is large (n 30).
More specific: In random sampling from an arbitrary
population with mean and standard deviation ,
when n 30, the distribution of X is approximat ely
normal with
2
X = , X =
2
, X = .
n n
That is, the distribution of X N ( , ).
n
Note : If population is normal, then X is exactly normal
distribution for all n, small or large.
𝜎
𝜎𝑋ത = when n /N ≤ .05 where N = population size
𝑛
10
Sampling distributions of 𝑋ത when population is not normal
11
Ex: To get an intuitive understanding of its most
important consequences of the central limit theorem:
As the sample size increases , the sampling distribution
of sample means approaches a normal distribution.
Let’s look at the last four digits of social insurance numbers
from each of 50 different students. See the table on next slide.
12
Group SIN digits mean Group SIN digits mean
1 1 8 6 4 4.75 26 7 3 1 1 3.00
2 5 3 3 6 4.25 27 9 1 1 3 3.50
3 9 8 8 8 8.25 28 8 6 5 9 7.00
4 5 1 2 5 3.25 29 5 6 4 1 4.00
5 9 3 3 5 5.00 30 9 3 9 5 6.50
6 4 2 6 2 3.50 31 6 0 7 3 4.00
7 7 7 1 6 5.25 32 8 2 9 6 6.25
8 9 1 5 4 4.75 33 0 2 8 6 4.00
9 5 3 3 9 5.00 34 2 0 9 7 4.50
10 7 8 4 1 5.00 35 5 8 9 0 5.50
11 0 5 6 1 3.00 36 6 5 4 9 6.00
12 9 8 2 2 5.25 37 4 8 7 6 6.25
13 6 1 5 7 4.75 38 7 1 2 0 2.50
14 8 1 3 0 3.00 39 2 9 5 0 4.00
15 5 9 6 9 7.25 40 8 3 2 2 3.75
16 6 2 3 4 3.75 41 2 7 1 6 4.00
17 7 4 0 7 4.50 42 6 7 7 1 5.25
18 5 7 5 6 5.75 43 2 3 3 9 4.25
19 4 1 5 7 4.25 44 2 4 7 5 4.50
20 1 2 0 6 2.25 45 5 4 3 7 4.75
21 4 0 2 8 3.50 46 0 4 3 8 3.75
22 3 1 2 5 2.75 47 2 5 8 6 5.25
23 0 3 4 0 1.75 48 7 1 3 4 3.75
24 1 5 1 0 1.75 49 8 3 7 0 4.50 13
25 9 7 4 0 5.00 50 5 6 6 7 6.00
(a) If we combine the four digits from each into one big
collection of 200 numbers. Then we have an
approximately uniform distribution with the graph shown
below. The mean of the distribution is 4.5 and the standard
deviation is 2.8.
30
25
20
15
10
0
0 1 2 3 4 5 6 7 8 9
14
(b) Now look at sample means. We have 50 sample
means. Even though the original collection of data has
an approximately uniform distribution, the sample
means have a distribution that is approximately
normal. It is a truly fascinating and intriguing
phenomenon in statistics.
18
16
14
12
10
8
6
4
2
0
0 1 2 3 4 5 6 7 8 9
15
SHAPE OF SAMPLING DISTRIBUTION OF 𝑋ത
16
𝑆𝑜𝑙𝑢𝑡𝑖𝑜𝑛:
𝐿𝑒𝑡 µ and σ be the mean and standard deviation of SAT scores
of examinees and let 𝜇𝑋ത and 𝜎𝑋ത 𝑡ℎ𝑒 𝑚𝑒𝑎𝑛 𝑎𝑛𝑑 𝑠𝑡𝑎𝑛𝑑𝑎𝑟𝑑
𝑑𝑒𝑣𝑖𝑎𝑡𝑖𝑜𝑛 of the sampling distribution of 𝑋ത 𝑟𝑒𝑠𝑝𝑒𝑐𝑡𝑖𝑣𝑒𝑙𝑦.
𝜇 = 1020 𝑎𝑛𝑑 𝜎 = 153
(a)
𝜇𝑋ത = 𝜇 = 1020
𝜎 153
𝜎𝑋ത = = = 38.250 ത
𝑋~𝑁(1020, 38.250)
𝑛 16
17
(b)
𝜇𝑋ത = 𝜇 = 1020
𝜎 153
𝜎𝑋ത = = = 21.637 ത
𝑋~𝑁(1020, 21.637)
𝑛 50
18
(c)
𝜇𝑋ത = 𝜇 = 1020
𝜎 153
𝜎𝑋ത = = = 4.838 ത
𝑋~𝑁(1020, 4.838)
𝑛 1000
19
APPLICATION OF SAMPLING
DISTRIBUTION OF 𝑋ത
Example 7-5 (Application Example)
24
POPULATION AND SAMPLE PROPORTIONS
𝑋 𝑥
𝑝= , 𝑝ො =
𝑁 𝑛
POPULATION AND SAMPLE
PROPORTIONS
where
◼ N = total number of elements in the population
◼ n = total number of elements in the sample
◼ X = number of elements in the population that
possess a specific characteristic
◼ x = number of elements in the sample that
possess a specific characteristic
Example 7-7
𝑋 563282
𝑝= = = 0.71
𝑁 789654
𝑥 158
𝑝ො = = = 0.66
𝑛 240
Sampling Distribution of the Sample Proportion p̂
p̂
p̂
Example 7-8
𝟓!
𝑻𝒐𝒕𝒂𝒍 𝒏𝒖𝒎𝒃𝒆𝒓 𝒐𝒇 𝒔𝒂𝒎𝒑𝒍𝒆𝒔 = 𝟓𝑪𝟑 = = 𝟏𝟎
𝟑! 𝟓 − 𝟑 !
Table 7.7 All Possible Samples of Size 3 and the
Value of 𝑝ො for Each Sample
Table 7.8 Frequency and Relative Frequency
Distribution of 𝑝ො when the Sample Size Is 3
Table 7.9 Sampling Distribution of 𝑝ො when the
Sample Size is 3
Mean and Standard Deviation of 𝑝ො
pˆ = p
Mean and Standard Deviation of 𝑝ො
41
𝑃 0.53 < 𝑝Ƹ < 0.55
0.53 − 𝜇𝑝Ƹ 𝑝Ƹ − 𝜇𝑝ො 0.55 − 𝜇𝑝Ƹ
=𝑃 < <
𝜎𝑝Ƹ 𝜎𝑝ො 𝜎𝑝Ƹ
0.53−0.51 0.55−0.51
=𝑃 <𝑍<
0.01542725 0.01542725
= 𝑃 1.30 < 𝑍 < 2.59
= 0.9952 − 0.9032 = 0.0920
42
Example 7-11 (Application example)
43
Example 7-11: Solution
𝑝𝑞 0.53 × 0.47
𝜇𝑝ො = 𝑝 = 0.53 𝑎𝑛𝑑 𝜎𝑝ො = = = 0.02495496
𝑛 400