Conditional Probability:: A B A B
Conditional Probability:: A B A B
1
Definition
The conditional probability of the event A given
the event B is defined by
2
Notes:
3
Example:
339 physicians are classified as given in the table
below. A physician is to be selected at random.
(1) Find the probability that:
(a) the selected physician is aged 40 – 49
(b) the selected physician smokes occasionally
(c) the selected physician is aged 40 – 49 and
smokes occasionally
(2) Find the probability that the selected physician
is aged
40 – 49 given that the physician smokes
occasionally.
4
5
Solution:
6
7
8
Note:
9
Note:
𝑃(𝐴|𝐵) = 𝑃(𝐴) means that knowing B has no
effect on the probability of occurrence of A. In
this case A is independent of B.
𝑃(𝐴|𝐵) > 𝑃(𝐴) means that knowing B increases
the probability of occurrence of A.
𝑃(𝐴|𝐵) < 𝑃(𝐴) means that knowing B decreases
the probability of occurrence of A.
10
Independent Events
Definition:
Two events A and B are independent if and only if
𝑃(𝐴|𝐵) = 𝑃(𝐴) and 𝑃(𝐵|𝐴) = 𝑃(𝐵). Otherwise A
and B are dependent.
Example:
In the previous example, we found that
𝑃 𝐴3 𝐵2 ≠ 𝑃 𝐴3
Therefore, the events 𝐴3 and 𝐵2 are dependent, i.e.,
they are not independent. Also, we can verify that
𝑃 𝐵2 𝐴3 ≠ 𝑃 𝐵2
11
Multiplicative Rule
Theorem:
If 𝑃(𝐴) ≠ 0 and 𝑃(𝐵) ≠ 0, then:
𝑃(𝐴 ∩ 𝐵) = 𝑃(𝐴) 𝑃(𝐵|𝐴)
= 𝑃(𝐵) 𝑃(𝐴|𝐵)
12
Example
Suppose we have a fuse box containing 20
fuses of which 5 are defective (D) and 15 are
non-defective (N). If 2 fuses are selected at
random and removed from the box in
succession without replacing the first, what is
the probability that both fuses are defective?
13
Solution:
Define the following events:
A = {the first fuse is defective}
B = {the second fuse is defective}
𝐴 ∩ 𝐵 ={the first fuse is defective and the second
fuse is defective} = {both fuses are defective}
14
15
Theorem
16
Note:
17
Theorem (𝑘 = 3)
18
Bayes' Rule
Definition:
The events 𝐴1 , 𝐴2 ,…, and 𝐴𝑛 constitute a partition
of the sample space 𝑆 if:
𝑛
𝐴𝑖 = 𝐴1 ∪ 𝐴2 ∪ ⋯ ∪ 𝐴𝑛 = 𝑆
𝑖=1
𝐴𝑖 ∩ 𝐴𝑗 = ∅, ∀ 𝑖≠𝑗
19
Theorem: (Total Probability)
If the events 𝐴1 , 𝐴2 ,…, and 𝐴𝑛 constitute a partition
of the sample space 𝑆 such that
𝑃(𝐴𝑘 ) ≠ 0 for 𝑘 = 1,2, … , 𝑛,
then for any event B:
𝑛 𝑛
𝑃 𝐵 = 𝑃 𝐴𝑘 ∩ 𝐵 = 𝑃 𝐴𝑘 . 𝑃(𝐵 𝐴𝑘 )
𝑘=1 𝑘=1
20
21
22
Example
Three machines 𝐴1 , 𝐴2 and 𝐴3 make 20%,
30%, and 50%, respectively, of the products.
It is known that 1%, 4%, and 7% of the
products made by each machine, respectively,
are defective. If a finished product is
randomly selected, what is the probability
that it is defective?
23
Solution:
24
25
26
Question:
If it is known that the selected product is
defective, what is the probability that it is
made by machine 𝐴1 ?
Answer:
28
29
Example
In the previous example, if it is known that
the selected product is defective, what is the
probability that it is made by:
(a) machine 𝐴2 ?
(b) machine 𝐴3 ?
30
Solution:
31
32
33
Note:
P(𝐴1 |B) = 0.0408, P(𝐴2 |B) = 0.2449, P(𝐴3 |B) = 0.7142
3
𝑃 𝐴𝑘 𝐵 = 1
𝑘=1