Applications in Probability Theory
A Two-Dimensional Continuous Random Variable
Definition
A definition is a precise description of what a concept, a term, or an object means. Understanding definitions is the foundation of learning any field, and every concept has its own exact meaning.
Suppose is a two-dimensional continuous random variable. If there is a nonnegative integrable function such that for any plane region ,
then is called the joint probability density function of (or simply the joint density).
The joint density satisfies:
- Nonnegativity:
- Normalisation:
The Geometric Meaning of a Probability
equals the volume of the cylinder with curved top whose base is the region and whose top is the surface .
Mathematical formula
A formula is a symbolic expression of quantitative relations and structural patterns, and an essential tool for solving mathematical problems. Key formulas should be mastered and applied flexibly.
From the joint density you can obtain the probability density of and of themselves (the marginal densities):
The marginal density is the integral of the joint density over the other variable — it “compresses” a two-dimensional distribution into one dimension.
Mathematical formula
A formula is a symbolic expression of quantitative relations and structural patterns, and an essential tool for solving mathematical problems. Key formulas should be mastered and applied flexibly.
When , the conditional probability density of given is:
When , the conditional probability density of given is:
Theorem
A theorem is a proposition that has been rigorously proved, and it is the foundation of mathematical reasoning. A theorem usually states its conditions and its conclusion, and is an important part of any mathematical system.
The necessary and sufficient condition for the random variables and to be mutually independent is:
for almost every .
The Expectation of a Function of a Two-Dimensional Random Variable
Mathematical formula
A formula is a symbolic expression of quantitative relations and structural patterns, and an essential tool for solving mathematical problems. Key formulas should be mastered and applied flexibly.
Suppose is a function of a two-dimensional random variable. Then:
In particular:
The Covariance and the Correlation Coefficient
Mathematical formula
A formula is a symbolic expression of quantitative relations and structural patterns, and an essential tool for solving mathematical problems. Key formulas should be mastered and applied flexibly.
The covariance:
The correlation coefficient:
If are independent, then (the converse does not hold).
Example 1: The Normalisation and the Probabilities of a Joint Density
Suppose the joint density of a two-dimensional random variable is:
Find: (1) the constant ; (2) ; (3) the marginal densities .
Approach:
Use the normalisation to find , a double integral to find the probability, and a single integral to find the marginal densities.
Steps:
(1) The normalisation: so .
(2) : The region
(3) The marginal densities: (for ), and 0 otherwise. (for ), and 0 otherwise.
Answer: (1) ; (2) ; (3) (for )
Example 2: A Uniform Distribution and the Expectation
Suppose is uniformly distributed over the region . Find and .
Approach:
First find the area of the region to get the joint density, and then use the double integral to find the expectation.
Steps:
- The area of the region:
- The joint density:
Answer: and
Example 3: The Probability of a Normal Distribution
Suppose follows the two-dimensional normal distribution with joint density:
Find .
Approach:
The region is a disk, so use polar coordinates.
Steps:
- Polar coordinates:
Answer:
(This is the distribution function of the chi-square distribution with 2 degrees of freedom.)
Exercise 1
Suppose the joint density of is . Decide whether and are independent, and find .
Approach:
Find the marginal densities and decide whether there is independence; then compute the probability with a double integral.
Steps:
- The marginal densities: (for ) (for )
- , so are independent.
Answer: are independent (both follow an exponential distribution with parameter 1), and .
Exercise 2
Suppose is uniformly distributed over the disk . Find the covariance .
Approach:
Use the symmetry: , and then compute .
Steps:
- The joint density: (for )
- By symmetry,
- The integrand is an odd function of (or of ), and the region of integration is symmetric about the -axis (or the -axis), so the integral is 0.
Answer:
(Note: a zero covariance does not imply independence; in this problem are in fact not independent.)
Symbols Used in This Article
| Symbol | Type | Pronunciation/Explanation | Meaning in This Article |
|---|---|---|---|
| Joint probability density | joint probability density | The joint density function of a two-dimensional random variable | |
| Marginal probability density | marginal density | The marginal probability density of | |
| Marginal probability density | marginal density | The marginal probability density of | |
| Conditional probability density | conditional density | The density of given | |
| Mathematical expectation | expected value | The expectation of the random variable | |
| Covariance | covariance | The covariance of and | |
| Correlation coefficient | correlation coefficient | The correlation coefficient of and | |
| Variance | variance | The variance of the random variable |
Key Terms
| English term | Pronunciation | Note |
|---|---|---|
| joint probability density | /dʒɔɪnt ˌprɒbəˈbɪləti ˈdɛnsəti/ | the density function of a two-dimensional random variable |
| marginal probability density | /ˈmɑːrdʒɪnəl ˌprɒbəˈbɪləti ˈdɛnsəti/ | the probability density of a single variable |
| conditional probability density | /kənˈdɪʃənəl ˌprɒbəˈbɪləti ˈdɛnsəti/ | the density of a conditional distribution |
| expected value / expectation | /ɪkˈspɛktɪd ˈvæljuː/ | the average value of a random variable |
| covariance | /koʊˈvɛriəns/ | the extent to which two variables vary together |
| correlation coefficient | /ˌkɒrəˈleɪʃən ˌkoʊɪˈfɪʃənt/ | the normalised covariance |
| independence | /ˌɪndɪˈpɛndəns/ | no association between the random variables |
| uniform distribution | /ˈjuːnɪfɔːrm ˌdɪstrɪˈbjuːʃən/ | a distribution with constant probability density |
| bivariate normal distribution | /baɪˈvɛriət ˈnɔːrməl ˌdɪstrɪˈbjuːʃən/ | the two-dimensional normal distribution |
| chi-square distribution | /kaɪ skwɛər ˌdɪstrɪˈbjuːʃən/ | the distribution of the sum of squares of standard normal variables |
