# Large language models: Evolution

Source page: https://www.materialinsights.org/technologies/large_language_models/tech-evolution/

#### Timeline

The milestones from first idea to today

| Year | Milestone |
|---|---|
| 1951 | Shannon publishes his measure of how predictable English text is ^[5] |
| 2000 | Bengio publishes a neural probabilistic language model ^[6] |
| 2017 | Google researchers describe the Transformer on 31 August ^[1] |
| 2020 | OpenAI opens its API, running GPT-3 family models, on 11 June ^[2] |
| 2022 | ChatGPT is launched in November ^[3] |
| 2024 | Output as good as GPT-3.5 costs 7 cents per million tokens, down from 20 dollars in 2022 ^[4] |
| 2025 | ChatGPT reaches 800 million weekly users, in October ^[3] |

as of 2026-11-11

#### Lineage

The technologies it came from and the ones that came from it
 Builds on

- [DL Deep learning](https://www.materialinsights.org/technologies/deep_neural_networks/) Language models are deep networks trained by backpropagation; Bengio's neural language model of 2000, which introduced word embeddings, was an early one ^[6].
- [GPU Graphics processing unit](https://www.materialinsights.org/technologies/graphics_processing_unit/) Models are trained and run on data-centre chips; Nvidia says reasoning AI drives demand for its Blackwell data-centre GPUs ^[7].
- [Cld Cloud computing](https://www.materialinsights.org/technologies/cloud_computing/) Models are offered as an online service through an API, as OpenAI's was from June 2020 ^[2].
 Works with

- [Srch Web search engine](https://www.materialinsights.org/technologies/web_search_engine/) Google adds AI Overviews, written by language models, to its search results ^[9].

as of 2026-11-11

#### Sources

1. [Transformer: A Novel Neural Network Architecture for Language Understanding](https://research.google/blog/transformer-a-novel-neural-network-architecture-for-language-understanding/) Google Research Blog (Jakob Uszkoreit), 2017
2. [OpenAI API](https://openai.com/index/openai-api/) OpenAI, 2020
3. [Sam Altman says ChatGPT has hit 800M weekly active users](https://techcrunch.com/2025/10/06/sam-altman-says-chatgpt-has-hit-800m-weekly-active-users/) TechCrunch (Rebecca Bellan), 2025
4. [AI Index 2025: State of AI in 10 Charts](https://hai.stanford.edu/news/ai-index-2025-state-of-ai-in-10-charts) Stanford Institute for Human-Centered AI (HAI), 2025
5. [Prediction and Entropy of Printed English](https://www.nokia.com/bell-labs/publications-and-media/publications/prediction-and-entropy-of-printed-english/) Nokia Bell Labs, publications (C. E. Shannon, Bell System Technical Journal), 1951
6. [Fathers of the Deep Learning Revolution Receive ACM A.M. Turing Award](https://www.eurekalert.org/news-releases/508417) Association for Computing Machinery, news release distributed on EurekAlert!, 2019
7. [NVIDIA Announces Financial Results for Fourth Quarter and Fiscal 2025](https://nvidianews.nvidia.com/news/nvidia-announces-financial-results-for-fourth-quarter-and-fiscal-2025) NVIDIA Newsroom, 2025
8. [Alphabet Announces Fourth Quarter and Fiscal Year 2024 Results (Exhibit 99.1)](https://www.sec.gov/Archives/edgar/data/1652044/000165204425000010/googexhibit991q42024.htm) Alphabet Inc., filed with the US SEC, 2025

## Other sections

- [Summary](https://www.materialinsights.org/technologies/large_language_models/index.md)
- [Overview](https://www.materialinsights.org/technologies/large_language_models/tech-overview/index.md)
- [Science](https://www.materialinsights.org/technologies/large_language_models/tech-science/index.md)
- [Energy footprint](https://www.materialinsights.org/technologies/large_language_models/tech-energy-footprint/index.md)
- [Industries](https://www.materialinsights.org/technologies/large_language_models/tech-industries/index.md)
