Combinations of Random Variables

This lesson consolidates results about linear combinations of random variables, covering both the general case and the special case of normal distributions. It also addresses the distribution of sample statistics and their role in inference.

---

General Results (Any Distribution)

For any random variables $X$X and $Y$Y (not necessarily independent):

Result	Formula
$E(aX + bY)$E(aX+bY)	$aE(X) + bE(Y)$aE(X)+bE(Y)
$\text{Var}(aX + bY)$Var(aX+bY)	$a^2\text{Var}(X) + b^2\text{Var}(Y) + 2ab\text{Cov}(X,Y)$a2Var(X)+b2Var(Y)+2abCov(X,Y)

If $X$X and $Y$Y are independent, then $\text{Cov}(X,Y) = 0$Cov(X,Y)=0:

$\text{Var}(aX + bY) = a^2\text{Var}(X) + b^2\text{Var}(Y)$Var(aX+bY)=a2Var(X)+b2Var(Y)

Special Cases

Combination	$E$E	$\text{Var}$Var (independent)
$X + Y$X+Y	$E(X) + E(Y)$E(X)+E(Y)	$\text{Var}(X) + \text{Var}(Y)$Var(X)+Var(Y)
$X - Y$X−Y	$E(X) - E(Y)$E(X)−E(Y)	$\text{Var}(X) + \text{Var}(Y)$Var(X)+Var(Y)
$3X$3X	$3E(X)$3E(X)	$9\text{Var}(X)$9Var(X)
$X + 5$X+5	$E(X) + 5$E(X)+5	$\text{Var}(X)$Var(X)

Exam Tip: The variance of $X - Y$X−Y is $\text{Var}(X) + \text{Var}(Y)$Var(X)+Var(Y) (plus, not minus) when $X$X and $Y$Y are independent. This is tested frequently and is a common source of errors.

---

Sum of Independent Identically Distributed (i.i.d.) Variables