Odds, Probability & Bankroll
Likelihood vs probability
Likelihood measures how well a statistical model explains observed data by treating the data as fixed and varying the parameters; probability predicts how likely an event is under a fixed model.
- Core difference
- Probability assumes a fixed model and asks how likely data are; likelihood assumes fixed data and asks which parameter values make the data most plausible.1
- Likelihood function
- Written as \(\mathcal{L}(\theta \mid x)\), it is the probability of the data expressed as a function of the parameters.3
- Range
- Probability values lie between 0 and 1; likelihood values are not probabilities and have no fixed upper bound.5
- Common usage
- In everyday language 'likelihood' is often a synonym for 'probability', but in statistics the two are distinct.4
Key points
- Probability answers 'how likely is this outcome under a known model?'; likelihood answers 'which model parameters best explain the data we saw?'.2
- Maximum likelihood estimation finds the parameter values that maximise the likelihood function, a standard method for fitting models to data.6
- A likelihood ratio compares two parameter values or models; for example, \(\Lambda(\theta_1:\theta_2 \mid x) = \mathcal{L}(\theta_1 \mid x) / \mathcal{L}(\theta_2 \mid x)\).3
- Example: The probability of rolling a 6 on a fair die is 1/6; the likelihood compares how plausible a fair-die model is versus a loaded-die model given the same observed rolls.5
Likelihood vs probability example
Suppose you flip a coin ten times and get seven heads. Probability asks: if the coin is fair (heads probability 0.5), how likely is exactly seven heads? The answer is about 0.117. Likelihood asks: given that we observed seven heads, what value of the heads probability makes that data most plausible? The maximum-likelihood estimate is 0.7.2
Where this term is used
Related terms
Sources
- 4 Maximum Likelihood Parameter Estimation groups.inf.ed.ac.uk Defines likelihood as a function of parameters with fixed data, contrasting with probability.
- What is the likelihood function, arxiv.org Explains the likelihood function and gives a coin-flip example distinguishing likelihood from probability.
- Likelihood function en.wikipedia.org Provides the formal definition of the likelihood function and the likelihood ratio formula.
- Foundations of statistics - Wikipedia en.wikipedia.org Notes that in common usage 'likelihood' is often a synonym for 'probability'.
- Probability en.wikipedia.org Defines probability and its 0–1 range, and gives the fair-die example.
- 6 Bayesian Parameter Estimation groups.inf.ed.ac.uk Describes maximum likelihood estimation as a method for fitting models.
Sources are drawn from regulators, universities and published research, and each one is labelled with what it actually is — a preprint is not called a paper. Bookmaker and affiliate pages are never cited here, because a page that sells betting is not a neutral authority on it.