Course Summary
The course begins with the basic laws of random events and probability (sample spaces, the definition of probability, conditional probability, and independence), then introduces random variables and their numerical characteristics (expectation, variance, covariance), then uses the law of large numbers and the central limit theorem to reveal the certainty hidden behind a large number of random phenomena, and finally turns to the two inference methods of mathematical statistics: parameter estimation and hypothesis testing. Looking back over the whole course, the thread that runs through it is: from the probability of individual random events, to the overall numerical characteristics of random variables, to the limit theorems that bring certainty in the large-sample limit, and finally to estimating and testing a population from a sample.
| Topic | Core content | Key methods |
|---|---|---|
| Random Events and Probability | Sample spaces and events, the definition of probability, conditional probability, independence of events | The addition formula, the multiplication formula, the total probability formula, Bayes’ formula |
| Random Variables and Their Distributions | Discrete and continuous random variables, distribution laws and probability densities, distribution functions | Deriving a distribution law or a density, integrating to get the probability of an interval |
| Numerical Characteristics | Mathematical expectation, variance and standard deviation, the expectation and variance of common distributions, covariance and the correlation coefficient | Compute by definition or by formula; simplify with the properties () |
| The Law of Large Numbers and the Central Limit Theorem | Chebyshev’s inequality, the law of large numbers, the central limit theorem | Chebyshev gives an upper bound on a probability; standardise independent identically distributed variables to approximate normality |
| Parameter Estimation | Point estimation, the method of moments, maximum likelihood estimation, interval estimation and confidence intervals | Replace population moments with sample moments in the method of moments; differentiate the likelihood function and take its maximum |
| Hypothesis Testing | The idea of significance testing, the two kinds of error, tests for one and for two normal populations | Propose the hypotheses → choose a statistic → compute the critical value → draw the conclusion |
The limit theorems bridge random phenomena and statistical inference, and together with the numerical characteristics they form one of the two hard-core parts of this course, so be sure to remember their conditions and conclusions.
| Theorem | Core result | How to use it |
|---|---|---|
| Chebyshev’s Inequality | An upper bound on the probability of an event follows from the expectation and the variance alone | |
| The Law of Large Numbers | Under independent repeated trials, the sample mean converges in probability to the expectation | Frequencies stabilise at probabilities; it provides the theoretical basis for parameter estimation |
| The Central Limit Theorem | The sum of a large number of independent identically distributed random variables with finite variance, once standardised, is approximately standard normal | Whatever the original distribution, the sum (or the mean) is approximately normal in the large-sample limit, which is the bedrock of statistical inference |
| Expectation | (discrete) or (continuous), | The expectation is a “weighted average”; linearity lets you split it up and add it up |
| Variance | , | It measures how far a variable deviates from its expectation; the variances of independent variables add |
| Covariance and Correlation Coefficient | , | ; means uncorrelated, and independence implies uncorrelatedness |
Key takeaway: Chebyshev’s inequality “uses the variance to bound the probability”; the law of large numbers says “the sample mean settles at the expectation”; the central limit theorem says “the sum of many independent random variables is approximately normal” — the last one is the fundamental reason why the normal distribution can be used in parameter estimation and hypothesis testing.
When you meet a problem in probability theory or mathematical statistics, choose a method along the following path:
- Draw the sample space and judge independence first: whenever conditional probability appears use the multiplication formula and the total probability formula; to “reason backwards from the result to the cause” use Bayes’ formula.
- Compute numerical characteristics by definition and property: for expectation and variance write the definition first, then simplify with linearity and independence; for covariance compute first and then subtract .
- Recognise the scenario before the limit theorems: as soon as the question asks to “bound a probability from above” use Chebyshev’s inequality; when it asks for “the probability that the sum or mean of many independent identically distributed variables falls in an interval” standardise with the central limit theorem and look up the normal table.
- Separate point estimation from interval estimation: for point estimation use the method of moments or maximum likelihood estimation (take the logarithm of the likelihood function and then differentiate); for interval estimation choose a pivotal quantity first, then apply the confidence interval formula.
- Work through hypothesis testing in four steps: propose the null and alternative hypotheses → choose a suitable statistic and fix the significance level → compute the sample statistic and the critical value → if the value falls in the rejection region, reject the null hypothesis, and keep both kinds of error in mind.
- 1
Exploring Functions in Advanced Mathematics
PrerequisiteFunctions are a core idea of advanced mathematics. This course walks through foundational concepts, key properties, and classic constants so you can read, reason, and compute with confidence.
Go to course - 2
Sequences
PrerequisiteSequences bridge discrete thinking and calculus. This track covers core definitions, limits, convergence, and classic models.
Go to course - 3
Probability and Mathematical Statistics
Current courseStudy the laws of random phenomena, learn methods of data analysis and inference, and master the science of extracting information from data.
Go to course
