# AI accelerator chip

A chip built to run the arithmetic of neural networks, mainly in data centres.

Source page: https://www.materialinsights.org/products/p_ai_accelerator_chip/

Electronics and chips · No. 43

- Networked and AI age
 Electronics and chips · Product

Run at its 700 W limit for 80% of the year in a data centre with a PUE of 1.4, one H100 chip draws about 6,900 kWh a year (calculated), and use causes most of an AI chip's climate impact.

Chart: Illustration: AI accelerator chip

##### Where it comes from

Chart: Map of where it comes from

Intel announced the ETANN neural-network chip in 1989, but no sale of it is recorded, and Google ran its own TPU in its data centres from 2015 without selling it. NVIDIA's Tesla P100, with its memory stacks in the same package, went to cloud firms in 2016, and the V100 of 2017 added 640 tensor cores.

##### Three things to know

1. NVIDIA's H100 has 80 billion transistors on an 814 mm2 die and draws up to 700 W; its Blackwell successor holds 208 billion transistors on two dies.
2. In NVIDIA's HGX H100 board, memory makes 546 kg CO2e of its 1,312 kg CO2e footprint, 42%, against 25% for all the integrated circuits including the GPUs (values read from a chart).
3. Taken apart, one A100 module held 1,374 g of copper, 1,300 g of it in the heat sink; the GPU chip with its memory held 3.7 g of silicon and about 0.001 g of gold.

##### The journey

1. 1 **Logic die**A foundry such as TSMC prints the processor on a silicon wafer; the H100 die measures 814 mm2
2. 2 **Memory stacks**SK hynix, Samsung or Micron stack DRAM chips into high-bandwidth memory (HBM)
3. 3 **Packaging**CoWoS mounts the logic die and HBM side by side on a silicon interposer, then on a substrate
4. 4 **Baseboard and server**Eight packages sit on a baseboard inside a server built by contract assemblers
5. 5 **Use**A data centre runs the chip for years at hundreds of watts
6. 6 **End of life**No recovery rate is published; under a quarter of world e-waste is documented as recycled

[Try this in What if](https://www.materialinsights.org/analyse/what-if/?p=p_ai_accelerator_chip) Switch on levers and see what changes in India by 2036.

##### Go deeper pick a tab to open it in full

## Other sections

- [Working](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-working/index.md)
- [Bill of materials](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-bom/index.md)
- [Use case](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-use/index.md)
- [Supply chain](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-supply/index.md)
- [Footprint](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-footprint/index.md)
- [Evolution](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-evolution/index.md)
- [Interventions](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-interventions/index.md)
