Probability and statistics: The idea
In plain words
The idea explained without jargon
Chance follows rules. Probability gives each possible outcome a number from 0 (cannot happen) to 1 (certain), and it has rules for combining those numbers, so the odds of a whole game can be worked out from the odds of its parts. Statistics works the other way round: from a sample of data it estimates what is true of the whole, and says how sure we can be. One bridge between the two is the law of large numbers: if an experiment is repeated a large number of times, the relative frequency of an event matches its probability [2]. Another is the inverse problem that Bayes tackled, recovering the original probability from the outcomes of trials [5].
as of 2026-11-12
Key equation
The equation that sums it up, and what each symbol means
- Equation
- 0 <= P(A) <= 1; P(everything that can happen) = 1; P(A or B) = P(A) + P(B) when A and B cannot both happen
- Symbols
- {"P(A)":"the probability of event A, a number between 0 and 1","A, B":"two events, such as 'the die shows a six' and 'the die shows a one'","P(everything that can happen)":"the probability that something in the full list of outcomes happens, which is certain"}
- Note
- These are the three rules behind Kolmogorov's axioms, simplified: the full third axiom covers any countable list of events no two of which can happen together. His 1933 monograph built probability theory in a rigorous way from fundamental axioms [3].
as of 2026-11-12
An analogy
A picture from everyday life that makes the idea easier to hold
Probability is a weather forecast for a coin or a die: it cannot say what the next throw will be, but it says how the throws will spread out if you make many. The picture stops being true for single events. A forecast that rain is likely on most days in a season tells you little about whether it will rain on one particular day, and a probability is not a promise.
as of 2026-11-12
Sources
- Jacob Bernoulli (1655 - 1705) - Biography - MacTutor History of Mathematics MacTutor History of Mathematics, University of St Andrews
- Andrey Kolmogorov (1903 - 1987) - Biography - MacTutor History of Mathematics MacTutor History of Mathematics, University of St Andrews
- Thomas Bayes Advances Probability Theory | History | Research Starters | EBSCOhost EBSCO Research Starters (article by Thomas Drucker), 2023