Material Insights · Understanding the Material World

Probability and statistics: The idea

In plain words

The idea explained without jargon

Chance follows rules. Probability gives each possible outcome a number from 0 (cannot happen) to 1 (certain), and it has rules for combining those numbers, so the odds of a whole game can be worked out from the odds of its parts. Statistics works the other way round: from a sample of data it estimates what is true of the whole, and says how sure we can be. One bridge between the two is the law of large numbers: if an experiment is repeated a large number of times, the relative frequency of an event matches its probability [2]. Another is the inverse problem that Bayes tackled, recovering the original probability from the outcomes of trials [5].

as of 2026-11-12

Key equation

The equation that sums it up, and what each symbol means

Equation
0 <= P(A) <= 1; P(everything that can happen) = 1; P(A or B) = P(A) + P(B) when A and B cannot both happen
Symbols
{"P(A)":"the probability of event A, a number between 0 and 1","A, B":"two events, such as 'the die shows a six' and 'the die shows a one'","P(everything that can happen)":"the probability that something in the full list of outcomes happens, which is certain"}
Note
These are the three rules behind Kolmogorov's axioms, simplified: the full third axiom covers any countable list of events no two of which can happen together. His 1933 monograph built probability theory in a rigorous way from fundamental axioms [3].

as of 2026-11-12

An analogy

A picture from everyday life that makes the idea easier to hold

Probability is a weather forecast for a coin or a die: it cannot say what the next throw will be, but it says how the throws will spread out if you make many. The picture stops being true for single events. A forecast that rain is likely on most days in a season tells you little about whether it will rain on one particular day, and a probability is not a promise.

as of 2026-11-12

Sources

  1. Jacob Bernoulli (1655 - 1705) - Biography - MacTutor History of Mathematics MacTutor History of Mathematics, University of St Andrews
  2. Andrey Kolmogorov (1903 - 1987) - Biography - MacTutor History of Mathematics MacTutor History of Mathematics, University of St Andrews
  3. Thomas Bayes Advances Probability Theory | History | Research Starters | EBSCOhost EBSCO Research Starters (article by Thomas Drucker), 2023