# AI accelerator chip: Evolution

Source page: https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-evolution/

#### Timeline

The milestones of the product, each with a source

| Year | Event |
|---|---|
| 1989 | Intel announces the 80170 ETANN, an analogue neural-network chip with 64 neurons and 10,240 synapses; no sale is recorded in the pages opened ^[25]^[26]. |
| 2015 | Google's tensor processing unit (TPU) is deployed in its own data centres ^[27]. |
| 2016 | NVIDIA's Tesla P100, with HBM2 memory stacks in the same package (CoWoS), is bought in bulk by hyperscalers, and the first DGX-1 ships ^[52]^[53]. |
| 2017 | NVIDIA announces the Tesla V100, with 21.1 billion transistors, 640 tensor cores, 16 GB of memory on the module and a 300 W design power; shipping was set for the third quarter ^[28]. |
| 2024 | NVIDIA announces Blackwell with 208 billion transistors on two reticle-limit dies ^[14]. |
| 2025 | Google's seventh-generation TPU, Ironwood, arrives with 192 GB of HBM3e memory and liquid cooling ^[39]^[40]; Gartner counts more than USD 200 billion of AI processor sales in the year ^[36]. |
| 2026 | NVIDIA reports USD 193.7 billion of data-centre revenue for its fiscal year ^[5]; India approves Semicon 2.0 and has onboarded over 38,000 GPUs under the IndiaAI Mission ^[24]^[23]. |

as of 2026-11-16

#### Lineage

The products and technologies it evolved from and into
 Evolved from

- [GPU Graphics processing unit](https://www.materialinsights.org/technologies/graphics_processing_unit/) The data-centre GPU grew from the graphics chip: the Tesla V100 of 2017 added 640 tensor cores to a GPU die ^[28].
- [Integrated circuit (chip)](https://www.materialinsights.org/products/p_integrated_circuit_chip/) An early neural-network chip, Intel's ETANN of 1989, was an integrated circuit with 64 analogue neurons ^[25].

as of 2026-11-16

#### Recipe changes

How what it is made of changed over time, and what drove each change

| Change | From | To | Driver | Source |
|---|---|---|---|---|
| Memory on the package | 16 GB of memory on the Tesla V100 module, with an HBM2 interface (2017) | 80 GB of HBM3 on the H100 SXM and 192 GB of HBM3e on Google's Ironwood | Large models need more weights held close to the arithmetic units ^[28]^[4]^[39] | ^[28]^[4]^[39] |
| Number of logic dies | One die of 815 mm2 (V100) | Two reticle-limit dies joined by a 10 TB/s link (Blackwell) | A single die cannot grow past the reticle limit of 858 mm2 ^[28]^[14]^[43] | ^[28]^[14]^[43] |
| Power per package | 300 W (V100, 2017) | 700 W (H100 SXM) and 750 W (AMD MI300X) | More transistors and memory run faster, and cooling must remove the heat ^[28]^[4]^[51] | ^[28]^[4]^[51] |
| Cooling | Air cooling in the DGX H100 | Liquid cooling in Google's Ironwood | Not stated in the pages opened; Google says Ironwood gives 2x the performance per watt of its previous chip ^[40] | ^[21]^[40] |

as of 2026-11-16

#### What could improve it next

Directions for improvement, today's value and the limit

| Direction | Metric | Today | Limit | Unit | Source |
|---|---|---|---|---|---|
| Less embodied carbon per unit of compute | Embodied carbon intensity of Google TPUs | 38 | – | gCO2e per exaflop (TPU v6e; 114 for TPU v4i) | ^[3] |
| Stack chips in 3D instead of spreading them out in 2.5D | Rise in embodied emissions when compute units and HBM capacity are doubled | 141 | 89 | % increase (today 2.5D; limit shown is 3D) | ^[11] |
| Bigger interposers and more HBM stacks per package | Interposer size | two reticle-limit dies per GPU | 14 | reticle sizes (TSMC 2029 roadmap) | ^[43]^[14] |
| More work per watt | Performance per watt of Google's Ironwood against its predecessor | 2 | – | times | ^[40] |

as of 2026-11-16

#### Sources

1. [Life-cycle emissions of AI hardware: a cradle-to-grave approach and generational trends](https://arxiv.org/pdf/2502.01671) Schneider et al. (Google), arXiv preprint 2502.01671, 2025
2. [NVIDIA H100 Tensor Core GPU: specifications](https://www.nvidia.com/en-us/data-center/h100.html) NVIDIA, 2026
3. [NVIDIA Announces Financial Results for Fourth Quarter and Fiscal 2026](https://investor.nvidia.com/news/press-release-details/2026/NVIDIA-Announces-Financial-Results-for-Fourth-Quarter-and-Fiscal-2026) NVIDIA investor relations, 2026
4. [3D Integration Reduces Embodied Emissions Impact Of GPU Scaling (imec and VUB)](https://semiengineering.com/3d-integration-reduces-embodied-emissions-impact-of-gpu-scaling-imec-vub/) Semiconductor Engineering, 2026
5. [NVIDIA Blackwell Platform Arrives to Power a New Era of Computing](https://investor.nvidia.com/news/press-release-details/2024/NVIDIA-Blackwell-Platform-Arrives-to-Power-a-New-Era-of-Computing/) NVIDIA investor relations, 2024
6. [Introduction to NVIDIA DGX H100/H200 Systems (last updated 17 October 2026)](https://docs.nvidia.com/dgx/dgxh100-user-guide/introduction-to-dgxh100.html) NVIDIA, 2026
7. [IndiaAI Mission expands AI ecosystem with affordable compute and startup support](https://www.digitalindia.gov.in/press_release/indiaai-mission-expands-ai-ecosystem-with-affordable-compute-and-startup-support/) Digital India, Government of India, 2026
8. [Cabinet approval of Semicon 2.0 (Prime Minister's Office page)](https://www.pmindia.gov.in/?p=16882929) Prime Minister's Office, Government of India, 2026
9. [Neural Network Chip Joins the Collection](https://computerhistory.org/blog/neural-network-chip-joins-the-collection/) Computer History Museum, 2024
10. [John C. Dvorak on Intel's First Neural Network Chip](https://thechipletter.substack.com/p/john-c-dvorak-on-intels-first-neural) The Chip Letter (Substack), 2024
11. [In-Datacenter Performance Analysis of a Tensor Processing Unit (Jouppi et al.)](https://research.google/pubs/in-datacenter-performance-analysis-of-a-tensor-processing-unit/) Google Research, 2017
12. [NVIDIA Announces Tesla V100 with Volta GPU at GTC 2017](https://pcper.com/2017/05/nvidia-announces-tesla-v100-with-volta-gpu-at-gtc-2017/) PC Perspective, 2017
13. [By decade's end, AI will drive more than half of all chip sales (reporting Gartner)](https://www.nextplatform.com/ai/2026/01/13/by-decades-end-ai-will-drive-more-than-half-of-all-chip-sales/4092117) The Next Platform, 2026
14. [Google's Ironwood TPUs represent a bigger threat than Nvidia would have you believe](https://www.theregister.com/2025/11/06/googles_ironwood_tpus_ai/) The Register, 2025
15. [Google offers 7th-gen Ironwood TPUs for AI, with AI-inspired comparisons](https://www.theregister.com/2025/04/10/googles_7thgen_ironwood_tpus_debut/) The Register, 2025
16. [TSMC's next-gen CoWoS roadmap: over 14-reticle packages and a 48x leap in compute power expected by 2029](https://www.tomshardware.com/tech-industry/semiconductors/tsmcs-details-next-gen-cowos-roadmap-over-14-reticle-packages-and-48x-leap-in-compute-power-expected-by-2029-massive-size-enables-24-hbm5e-stacks-and-additional-memory-bandwidth-jump) Tom's Hardware, 2026
17. [AMD unveils Instinct MI300X GPU and MI300A APU, claims up to 1.6X lead over Nvidia's competing GPUs](https://www.tomshardware.com/pc-components/cpus/amd-unveils-instinct-mi300x-gpu-and-mi300a-apu-claims-up-to-16x-lead-over-nvidias-competing-gpus) Tom's Hardware, 2023
18. [NVIDIA Tesla P100: technical overview](https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/tesla-product-literature/nvidia-teslap100-techoverview.pdf) NVIDIA, 2016
19. [Deep Learning Drives Nvidia's Tesla Business To New Highs](https://www.nextplatform.com/2016/08/15/deep-learning-drives-nvidias-tesla-business-new-highs/) The Next Platform, 2016

## Other sections

- [Summary](https://www.materialinsights.org/products/p_ai_accelerator_chip/index.md)
- [Working](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-working/index.md)
- [Bill of materials](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-bom/index.md)
- [Use case](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-use/index.md)
- [Supply chain](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-supply/index.md)
- [Footprint](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-footprint/index.md)
- [Interventions](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-interventions/index.md)
