Gambling terms, explained straight

Odds, Probability & Bankroll

Likelihood vs probability

Likelihood measures how well a statistical model explains observed data by treating the data as fixed and varying the parameters; probability predicts how likely an event is under a fixed model.

Core difference
Probability assumes a fixed model and asks how likely data are; likelihood assumes fixed data and asks which parameter values make the data most plausible.1
Likelihood function
Written as \(\mathcal{L}(\theta \mid x)\), it is the probability of the data expressed as a function of the parameters.3
Range
Probability values lie between 0 and 1; likelihood values are not probabilities and have no fixed upper bound.5
Common usage
In everyday language 'likelihood' is often a synonym for 'probability', but in statistics the two are distinct.4

Key points

  • Probability answers 'how likely is this outcome under a known model?'; likelihood answers 'which model parameters best explain the data we saw?'.2
  • Maximum likelihood estimation finds the parameter values that maximise the likelihood function, a standard method for fitting models to data.6
  • A likelihood ratio compares two parameter values or models; for example, \(\Lambda(\theta_1:\theta_2 \mid x) = \mathcal{L}(\theta_1 \mid x) / \mathcal{L}(\theta_2 \mid x)\).3
  • Example: The probability of rolling a 6 on a fair die is 1/6; the likelihood compares how plausible a fair-die model is versus a loaded-die model given the same observed rolls.5

Likelihood vs probability example

Suppose you flip a coin ten times and get seven heads. Probability asks: if the coin is fair (heads probability 0.5), how likely is exactly seven heads? The answer is about 0.117. Likelihood asks: given that we observed seven heads, what value of the heads probability makes that data most plausible? The maximum-likelihood estimate is 0.7.2

Where this term is used

Sources

  1. 4 Maximum Likelihood Parameter Estimation groups.inf.ed.ac.uk Defines likelihood as a function of parameters with fixed data, contrasting with probability.
  2. What is the likelihood function, arxiv.org Explains the likelihood function and gives a coin-flip example distinguishing likelihood from probability.
  3. Likelihood function en.wikipedia.org Provides the formal definition of the likelihood function and the likelihood ratio formula.
  4. Foundations of statistics - Wikipedia en.wikipedia.org Notes that in common usage 'likelihood' is often a synonym for 'probability'.
  5. Probability en.wikipedia.org Defines probability and its 0–1 range, and gives the fair-die example.
  6. 6 Bayesian Parameter Estimation groups.inf.ed.ac.uk Describes maximum likelihood estimation as a method for fitting models.

Sources are drawn from regulators, universities and published research, and each one is labelled with what it actually is — a preprint is not called a paper. Bookmaker and affiliate pages are never cited here, because a page that sells betting is not a neutral authority on it.