# Deep learning

Many-layered neural networks learn to recognise images, speech and patterns from data.

Source page: https://www.materialinsights.org/technologies/deep_neural_networks/

Computing and AI · AI and data · No. 290

- Digital age
- Readiness 9 of 9
- Process
 Computing and AI · Technology

An idea only a small group of researchers still backed in the early 2000s now recognises images, transcribes speech and translates text.

Chart: Illustration: Deep learning

##### Where it comes from

Chart: Map of where it comes from

Rosenblatt showed his perceptron in 1958. Hinton and colleagues made multilayer networks learnable with backpropagation in 1986; by 1998 such networks read bank cheques commercially, and in 2012 Toronto students almost halved the ImageNet error rate.

##### Three things to know

1. Backpropagation, the method that trains layered networks, was set out in a 1986 paper by Rumelhart, Hinton and Williams.
2. In 2012 a network trained on two graphics cards almost halved the error rate in the ImageNet image-recognition contest.
3. Hopfield and Hinton shared the 2024 Nobel Prize in Physics for work that made machine learning with neural networks possible.

##### The journey

1. 1 **Data**Millions of labelled examples, such as photos tagged with what they show
2. 2 **Network**Many layers of simple artificial neurons joined by adjustable weights
3. 3 **Training**Backpropagation nudges every weight to reduce the errors, on GPUs
4. 4 **Model**The trained weights now encode patterns found in the data
5. 5 **Use**The model labels new images, transcribes speech or flags fraud

##### Go deeper pick a tab to open it in full

## Other sections

- [Overview](https://www.materialinsights.org/technologies/deep_neural_networks/tech-overview/index.md)
- [Science](https://www.materialinsights.org/technologies/deep_neural_networks/tech-science/index.md)
- [Evolution](https://www.materialinsights.org/technologies/deep_neural_networks/tech-evolution/index.md)
- [Energy footprint](https://www.materialinsights.org/technologies/deep_neural_networks/tech-energy-footprint/index.md)
- [Industries](https://www.materialinsights.org/technologies/deep_neural_networks/tech-industries/index.md)
