# Probability and statistics: The idea

Source page: https://www.materialinsights.org/science/probability_theory/sci-idea/

#### In plain words

The idea explained without jargon

Chance follows rules. Probability gives each possible outcome a number from 0 (cannot happen) to 1 (certain), and it has rules for combining those numbers, so the odds of a whole game can be worked out from the odds of its parts. Statistics works the other way round: from a sample of data it estimates what is true of the whole, and says how sure we can be. One bridge between the two is the law of large numbers: if an experiment is repeated a large number of times, the relative frequency of an event matches its probability ^[2]. Another is the inverse problem that Bayes tackled, recovering the original probability from the outcomes of trials ^[5].

as of 2026-11-12

#### Key equation

The equation that sums it up, and what each symbol means

**Equation**
: 0 <= P(A) <= 1; P(everything that can happen) = 1; P(A or B) = P(A) + P(B) when A and B cannot both happen

**Symbols**
: {"P(A)":"the probability of event A, a number between 0 and 1","A, B":"two events, such as 'the die shows a six' and 'the die shows a one'","P(everything that can happen)":"the probability that something in the full list of outcomes happens, which is certain"}

**Note**
: These are the three rules behind Kolmogorov's axioms, simplified: the full third axiom covers any countable list of events no two of which can happen together. His 1933 monograph built probability theory in a rigorous way from fundamental axioms ^[3].

as of 2026-11-12

#### An analogy

A picture from everyday life that makes the idea easier to hold

Probability is a weather forecast for a coin or a die: it cannot say what the next throw will be, but it says how the throws will spread out if you make many. The picture stops being true for single events. A forecast that rain is likely on most days in a season tells you little about whether it will rain on one particular day, and a probability is not a promise.

as of 2026-11-12

#### Sources

1. [Jacob Bernoulli (1655 - 1705) - Biography - MacTutor History of Mathematics](https://mathshistory.st-andrews.ac.uk/Biographies/Bernoulli_Jacob/) MacTutor History of Mathematics, University of St Andrews
2. [Andrey Kolmogorov (1903 - 1987) - Biography - MacTutor History of Mathematics](https://mathshistory.st-andrews.ac.uk/Biographies/Kolmogorov) MacTutor History of Mathematics, University of St Andrews
3. [Thomas Bayes Advances Probability Theory | History | Research Starters | EBSCOhost](https://www.ebsco.com/research-starters/history/thomas-bayes-advances-probability-theory) EBSCO Research Starters (article by Thomas Drucker), 2023

## Other sections

- [Summary](https://www.materialinsights.org/science/probability_theory/index.md)
- [Discovery](https://www.materialinsights.org/science/probability_theory/sci-discovery/index.md)
- [Technologies](https://www.materialinsights.org/science/probability_theory/sci-technologies/index.md)
