Class 12 Maths Chapter 13: Probability Notes

Key Probability Definitions

Conditional Probability

The probability of an event A occurring, given that another event B has already occurred (P(A|B)). It is calculated as P(A ∩ B) / P(B), provided P(B) > 0.

Independent Events

Two events A and B are independent if the occurrence of one does not affect the probability of the other. Mathematically, P(A ∩ B) = P(A)P(B), or equivalently, P(A|B) = P(A) and P(B|A) = P(B).

Mutually Exclusive Events

Two events A and B are mutually exclusive if they cannot occur at the same time, meaning their intersection is an empty set (A ∩ B = Ø), so P(A ∩ B) = 0.

Random Variable

A real-valued function whose domain is the sample space of a random experiment. It assigns a numerical value to each outcome of the experiment.

Probability Distribution

A table or function that describes all possible values of a random variable and the probability associated with each value. For discrete random variables, it's a probability mass function (PMF).

Mean of a Random Variable (Expectation)

For a discrete random variable X, the mean (E[X]) is the weighted average of its possible values, where the weights are their corresponding probabilities: E[X] = Σx_i * P(X=x_i).

Variance of a Random Variable

A measure of the spread or dispersion of the probability distribution around its mean. Var(X) = E[X^2] - (E[X])^2 = Σx_i^2 * P(X=x_i) - (E[X])^2.

Understanding Conditional Probability and Bayes' Theorem

Conditional probability is a cornerstone of advanced probability theory and crucial for real-world applications. It deals with how the probability of an event changes when we have prior knowledge about the occurrence of another related event. The formula is:

$P(A|B) = \frac{P(A \cap B)}{P(B)}$

Here, $P(A|B)$ is read as "the probability of A given B". This concept naturally leads to the Multiplication Rule of Probability: $P(A \cap B) = P(B) P(A|B) = P(A) P(B|A)$. If events A and B are independent, then $P(A|B) = P(A)$, simplifying $P(A \cap B) = P(A)P(B)$.

Total Probability Theorem provides a way to find the probability of an event B when we have a set of mutually exclusive and exhaustive events $E_1, E_2, \dots, E_n$. It states:

$P(B) = \sum_{i=1}^{n} P(B|E_i)P(E_i)$

This theorem is the basis for Bayes' Theorem, a fundamental concept in statistics and machine learning. Bayes' Theorem allows us to update our belief about the probability of an event (a hypothesis) given new evidence. It essentially reverses the conditioning. If we want to find $P(E_i|B)$ (the probability of a specific cause $E_i$ given that effect $B$ has occurred), Bayes' Theorem states:

$P(E_i|B) = \frac{P(B|E_i)P(E_i)}{\sum_{j=1}^{n} P(B|E_j)P(E_j)}$

The denominator is simply $P(B)$ from the Total Probability Theorem. Understanding the intuition behind Bayes' Theorem — that it calculates the posterior probability of a cause based on the likelihood of the evidence given that cause and the prior probability of the cause — is more important than just memorizing the formula. It's often used in diagnostic testing and decision-making under uncertainty.

Key Formulas and Must-Remember Points

• Conditional Probability: $P(A|B) = \frac{P(A \cap B)}{P(B)}$, for $P(B) \neq 0$.
• Multiplication Rule: $P(A \cap B) = P(A)P(B|A) = P(B)P(A|B)$.
• Independent Events: A and B are independent if $P(A \cap B) = P(A)P(B)$. This implies $P(A|B) = P(A)$ and $P(B|A) = P(B)$.
• Total Probability Theorem: If $E_1, E_2, \dots, E_n$ form a partition of the sample space (mutually exclusive and exhaustive), then $P(A) = \sum_{i=1}^{n} P(A|E_i)P(E_i)$.
• Bayes' Theorem: $P(E_i|A) = \frac{P(A|E_i)P(E_i)}{\sum_{j=1}^{n} P(A|E_j)P(E_j)}$.
• Mean (Expectation) of a Discrete Random Variable X: $E(X) = \sum x_i P(X=x_i)$.
• Variance of a Discrete Random Variable X: $Var(X) = E(X^2) - [E(X)]^2$, where $E(X^2) = \sum x_i^2 P(X=x_i)$.
• Bernoulli Trials: A sequence of independent trials where each trial has only two outcomes (success/failure) and the probability of success remains constant.
• Binomial Distribution: If X denotes the number of successes in 'n' Bernoulli trials, then $P(X=k) = \binom{n}{k} p^k q^{n-k}$, where $p$ is probability of success, $q=1-p$ is probability of failure.

Worked Example: Bayes' Theorem

• {"title":"Problem","description":"A factory has two machines, M1 and M2. Machine M1 produces 60% of the items, and M2 produces 40%. 2% of items produced by M1 are defective, and 3% of items produced by M2 are defective. An item is chosen randomly and found to be defective. What is the probability that it was produced by machine M1?"}
• {"title":"Solution","description":"Let D be the event that the item is defective. Let M1 be the event that the item is from Machine 1, and M2 be the event that the item is from Machine 2.\nGiven:\n$P(M1) = 0.60$\n$P(M2) = 0.40$\n$P(D|M1) = 0.02$\n$P(D|M2) = 0.03$\n\nWe need to find $P(M1|D)$. Using Bayes' Theorem:\n$P(M1|D) = \\frac{P(D|M1)P(M1)}{P(D|M1)P(M1) + P(D|M2)P(M2)}$\n$P(M1|D) = \\frac{(0.02)(0.60)}{(0.02)(0.60) + (0.03)(0.40)}$\n$P(M1|D) = \\frac{0.012}{0.012 + 0.012}$\n$P(M1|D) = \\frac{0.012}{0.024} = 0.5$\n\nSo, the probability that the defective item was produced by machine M1 is 0.5 or 50%."}

Steps for Probability Distribution of a Discrete Random Variable

1. Identify the Random Variable (X) — Clearly define what X represents (e.g., number of heads in two coin tosses, number of defective items in a sample).
2. Determine the Sample Space and Possible Values of X — List all possible outcomes of the experiment. For each outcome, determine the value of X. This gives the range of X.
3. Calculate Probability for Each Value — For each possible value 'x' of X, calculate P(X=x) by summing the probabilities of all outcomes that result in that value. Ensure $P(X=x) \ge 0$ for all x.
4. Verify Condition — The sum of all probabilities must be 1: $\sum P(X=x) = 1$. If not, recheck your calculations.
5. Construct the Distribution — Present the probability distribution as a table showing each value of X and its corresponding probability P(X=x).

Exam Tip: Avoiding Common Pitfalls

Many students confuse $P(A|B)$ with $P(B|A)$. Always read the question carefully to identify which event is given and which probability is being asked. For Bayes' Theorem problems, clearly define your events ($E_1, E_2, \dots, A$) and list all given probabilities $P(E_i)$ and $P(A|E_i)$ before plugging them into the formula. A tree diagram can be extremely helpful for visualizing the probabilities in conditional probability and total probability problems, especially when there are multiple stages or conditions. Double-check that probabilities sum to 1 where applicable, and that probabilities are always between 0 and 1.

Practice Questions with Solutions

• Q: If $P(A) = 0.4$, $P(B) = 0.5$, and $P(A \cap B) = 0.2$, are A and B independent events? A: For independence, $P(A \cap B)$ must equal $P(A)P(B)$. Here, $P(A)P(B) = 0.4 \times 0.5 = 0.2$. Since $P(A \cap B) = 0.2$, A and B are independent events.
• Q: State the formula for the variance of a discrete random variable X. A: $Var(X) = E(X^2) - [E(X)]^2$, where $E(X^2) = \sum x_i^2 P(X=x_i)$ and $E(X) = \sum x_i P(X=x_i)$.
• Q: In a binomial distribution, what do 'n' and 'p' represent? A: In a binomial distribution $B(n,p)$, 'n' represents the number of Bernoulli trials (fixed number of independent trials), and 'p' represents the probability of success on a single trial.
• Q: When is Bayes' Theorem typically used? A: Bayes' Theorem is used to find the conditional probability of a cause given an observed effect, or to update the probability of a hypothesis in light of new evidence.

Frequently Asked Questions