This is a beta course, so its structure, chapters, and examples may continue to change.
Comprehensive Exercises
I. Random Events and Probability
Problem 1
A bag holds 5 white balls and 3 black balls. Two balls are drawn at random. Find: (1) the probability that both are white; (2) the probability that one is white and one is black.
classical probabilitycombinationscomputing a probability
Approach:
Drawing balls from a bag is a classical probability problem: first count the total number of ways to draw, then count the favourable ways for each condition, and finally get the two probabilities from “favourable / total”.
Steps:
Total number of ways: C82=28
(1) Both white: C52=10, so the probability P1=2810=145
(2) One white and one black: C51C31=15, so the probability P2=2815
Answer: (1) 145; (2) 2815.
Problem 2
A factory has three machines A, B and C producing the same product, with output shares of 25%, 35% and 40% and defect rates of 5%, 4% and 2% respectively. One product is taken at random. Find: (1) the probability that it is defective; (2) if it is defective, the probability that machine A produced it.
the law of total probabilityBayes' theoremconditional probability
Approach:
To find the probability of a defective product you first use the law of total probability to combine the defect rates of the three machines; then the reverse question — “given that it is defective” — calls for Bayes’ theorem to find the probability that it came from machine A.
Steps:
Let A1,A2,A3 denote that the product was made by machines A, B and C respectively, and let B denote that the product taken is defective.
P(A1)=0.25,P(A2)=0.35,P(A3)=0.40
P(B∣A1)=0.05,P(B∣A2)=0.04,P(B∣A3)=0.02
(1) The law of total probability: P(B)=∑i=13P(Ai)P(B∣Ai)=0.25×0.05+0.35×0.04+0.40×0.02=0.0125+0.014+0.008=0.0345
The probability density of a random variable X is f(x)={ax+b,0,0<x<1otherwise, and E(X)=127. Find: (1) the constants a,b; (2) D(X).
probability densitymathematical expectationvariancea continuous random variable
Approach:
The density function contains unknown constants, so first use the normalisation condition to set up one equation, then use the given expectation to set up another, solve the system to fix a and b, and then compute the variance with the formula for a continuous random variable.
Steps:
(1) By normalisation: ∫01(ax+b)dx=2a+b=1
E(X)=∫01x(ax+b)dx=3a+2b=127
Solve the system: {2a+b=13a+2b=127
From the first equation b=1−2a, substitute into the second: 3a+21−4a=12712a=121, so a=1 and b=21
Let X∼N(0,1) and Y=X2. Find the covariance and the correlation coefficient of X and Y, and decide whether they are independent.
covariancecorrelation coefficientindependencethe normal distribution
Approach:
First find the mathematical expectations of X and Y together with E(XY), and then use the definitions of the covariance and the correlation coefficient; independence has to be judged from the functional relationship, and cannot be read off a correlation coefficient of zero alone.
Steps:
E(X)=0, and E(Y)=E(X2)=D(X)+[E(X)]2=1
E(XY)=E(X3)=0 (the odd-order moments of the standard normal distribution are 0)
Uncorrelated but not independent: since Y=X2, X and Y have a determinate functional relationship, and so they are clearly not independent.
Answer: The covariance is 0, the correlation coefficient is 0, and X and Y are uncorrelated but not independent.
III. The Law of Large Numbers and the Central Limit Theorem
Problem 5
An insurance company has 10000 people insured, each paying 12 yuan a year in premiums. The probability that a person dies within a year is 0.006, and on death their family may claim 1000 yuan from the company. Use the central limit theorem to find the probability that the company’s profit over the year is at least 60000 yuan.
the central limit theoremthe binomial distributionnormal approximationthe insurance problem
Approach:
Translate “a profit of at least 60000 yuan” into an inequality on the number of deaths, apply the normal approximation to the binomial distribution for the number of deaths (the central limit theorem), and then use the normal distribution to compute the required probability.
Steps:
Let X be the number of deaths in the year, so X∼B(10000,0.006)
E(X)=np=10000×0.006=60
D(X)=np(1−p)=60×0.994=59.64, and σ=59.64≈7.723
Profit = income − payouts = 10000×12−1000X=120000−1000X
A profit of at least 60000 yuan: 120000−1000X≥60000, that is, X≤60
By the central limit theorem, X is approximately N(60,59.64)
P(X≤60)≈Φ(7.72360−60)=Φ(0)=0.5
Answer: The probability that the company’s profit is at least 60000 yuan is approximately 0.5.
IV. Parameter Estimation
Problem 6
The probability density of the population X is f(x)={θxθ−1,0,0<x<1otherwise, where θ>0 is an unknown parameter, and X1,X2,…,Xn is a sample from X. Find the method-of-moments estimator and the maximum likelihood estimator of θ.
method of momentsmaximum likelihood estimationparameter estimationa continuous population
Approach:
The method of moments equates the sample moments to the population moments, while the maximum likelihood estimator is obtained by writing out the likelihood function, taking the logarithm, differentiating and solving for the estimator. For both methods you have to write the population density clearly first.
Steps:
Method of moments:
E(X)=∫01x⋅θxθ−1dx=θ∫01xθdx=θ+1θ
Setting Xˉ=θ+1θ and solving gives θ^=1−XˉXˉ
Maximum likelihood estimation:
The likelihood function is L(θ)=∏i=1nθxiθ−1=θn(∏i=1nxi)θ−1
The log-likelihood is lnL=nlnθ+(θ−1)∑i=1nlnxi
Differentiating: dθdlnL=θn+∑i=1nlnxi=0
Solving gives θ^=−∑i=1nlnXin
Answer: The method-of-moments estimator is θ^=1−XˉXˉ; the maximum likelihood estimator is θ^=−∑i=1nlnXin.
Problem 7
Let the population X∼N(μ,σ2), where both μ and σ2 are unknown. A sample of size 9 is drawn from the population and gives xˉ=10 and s2=4. Find the confidence interval for μ with confidence level 0.95. (t0.025(8)=2.306)
interval estimationconfidence intervalthe t-distributiona normal population
Approach:
When the population variance is unknown you use the t-distribution: first construct the pivotal quantity, then substitute the sample mean and the sample standard deviation, and use the given t-quantile to compute the confidence interval.
Steps:
Since σ2 is unknown, use the t-distribution: S/nXˉ−μ∼t(n−1)
The confidence level 1−α=0.95, so α=0.05, and tα/2(n−1)=t0.025(8)=2.306
The confidence interval is (xˉ−tα/2ns,xˉ+tα/2ns)
xˉ=10, s=2, n=9, and ns=32
The confidence interval is (10−2.306×32,10+2.306×32)=(10−1.537,10+1.537)=(8.463,11.537)
Answer: The confidence interval for μ with confidence level 0.95 is (8.463,11.537).
V. Hypothesis Testing
Problem 8
The life X of a certain component made by a factory satisfies X∼N(μ,σ2), where both μ and σ2 are unknown. Sixteen items are drawn at random from a batch and the mean life is measured as xˉ=240 hours with sample standard deviation s=8 hours. At the significance level α=0.05, can it be concluded that the mean life of this batch of components is greater than 235 hours? (t0.05(15)=1.753)
hypothesis testinga one-sided testthe t-testthe mean of a normal population
Approach:
This is a t-test with unknown variance and a one-sided alternative hypothesis: first compute the test statistic, then compare it with the one-sided critical value, and answer accordingly.
Steps:
State the hypotheses: H0:μ≤235, H1:μ>235 (a right-tailed test)
The test statistic is t=S/nXˉ−μ0∼t(n−1) (when H0 holds)
The rejection region is t>tα(n−1)=t0.05(15)=1.753
Compute the statistic: t=8/16240−235=25=2.5
Since 2.5>1.753, the value falls in the rejection region, so H0 is rejected.
Answer: At the significance level α=0.05, H0 is rejected, and it can be concluded that the mean life of this batch of components is greater than 235 hours.
Problem 9
A machine tool cuts a certain part whose diameter satisfies X∼N(μ,σ2). When it is working normally, σ2=0.0482. On a certain day 9 parts cut by this machine are sampled and the sample variance is s2=0.0064. At the significance level α=0.05, is the machine working normally? (χ0.0252(8)=17.535, χ0.9752(8)=2.180)
hypothesis testingthe chi-square testtesting a variancethe variance of a normal population
Approach:
This is a chi-square test of the variance of a single normal population: first compute the test statistic, then compare it with the two given chi-square quantiles, and decide whether to reject the hypothesis that the variance equals the normal value.
Steps:
State the hypotheses: H0:σ2=0.0482=0.002304, H1:σ2=0.002304 (a two-sided test)
The test statistic is χ2=σ02(n−1)S2∼χ2(n−1) (when H0 holds)
The rejection region is χ2<χ1−α/22(n−1)=2.180 or χ2>χα/22(n−1)=17.535
Compute the statistic: χ2=0.0023048×0.0064=0.0023040.0512≈22.22
Since 22.22>17.535, the value falls in the rejection region, so H0 is rejected.
Answer: At the significance level α=0.05, H0 is rejected, and the machine is judged to be working abnormally — its variance has changed significantly.