# AI accelerator chip: Use case

Source page: https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-use/

#### Use cases

Each use, its share of demand and volume, how critical the product is to it and why, and the price paid

| Use case | Volume | Unit | Criticality | Reason | Year | Source |
|---|---|---|---|---|---|---|
| Training large AI models in data centres | 3.76 | million NVIDIA data-centre GPUs shipped in 2023 (training and inference together) | Essential | Training a large model needs thousands of accelerators working together; general-purpose processors are far too slow. | 2023 | ^[45] |
| Serving trained models to users (inference) in cloud data centres | – | – | Important | Small models can run on ordinary processors, but large ones need accelerators; operational time for inference is assumed at 40% against 80% for training. | 2024 | ^[22] |
| Public AI compute for research and start-ups, India | 38,000 | GPUs onboarded on the IndiaAI compute portal | Important | The state pools GPUs to rent out at an affordable rate, because buying chips is beyond most start-ups. | 2026 | ^[23] |

as of 2026-11-16. No source gives demand shares by use. TechInsights counts only NVIDIA units and the 2023 figure includes all uses [45].

#### Industries that buy it

The industries and kinds of firm that buy it, for which use case, and how critical it is to them
 Used by 4

- [Hyperscale cloud providers](https://www.materialinsights.org/industries/data_centres/) Training and serving models in cloud data centres · criticality essential NVIDIA names Amazon Web Services, Google, Meta, Microsoft, Oracle and others among the organisations expected to adopt Blackwell ^[14]; Google also builds its own TPUs ^[39].
- [Foundation model developers](https://www.materialinsights.org/industries/ai_platforms/) Training and running frontier models · criticality essential Anthropic has announced plans to use up to a million Google TPUs ^[39]; OpenAI is among Blackwell adopters ^[14].
- [Hyperscale clouds and GPU cloud operators](https://www.materialinsights.org/industries/ai_platforms/) Renting GPU time to firms that cannot buy chips · criticality important GPU cloud operators buy the same chips and resell their time; no share found.
- [Government IT and digital public infrastructure providers](https://www.materialinsights.org/industries/public_admin/) Pooled public AI compute (India) · criticality important The IndiaAI Mission has onboarded over 38,000 GPUs on a common compute portal ^[23].

as of 2026-11-16

#### What it competes with

The products and technologies that compete with it in each use case
 Competes with

- [Processor chip](https://www.materialinsights.org/products/p_processor_chip/) Inference and on-device AI General-purpose processors, and the neural-processing blocks built into them, can run small models, at lower speed and efficiency. No source opened measures how far they can replace accelerators.
- [Nm Neuromorphic computing](https://www.materialinsights.org/technologies/neuromorphic_computing/) Low-power inference at the edge An emerging approach that copies the brain's way of computing. No source opened compares its cost or speed with accelerators.

as of 2026-11-16

#### How it is used

Lifetime, use per year and utilisation, by variant

| Measure | Value | Unit | Variant | Place | Year | Source |
|---|---|---|---|---|---|---|
| Lifespan assumed for AI machines in a Google life-cycle study | 6 | years | Custom accelerator | World | 2025 | ^[3] |
| Average lifespan assumed for the A100 GPU in a cradle-to-grave study | 3 | years | Data-centre GPU | World | 2025 | ^[17] |
| Operational time of servers doing training (LBNL model assumption) | 80 | % of the year | Data-centre GPU | United States of America | 2024 | ^[22] |
| Operational time of servers doing inference (LBNL model assumption) | 40 | % of the year | Data-centre GPU | United States of America | 2024 | ^[22] |
| Average power of an 8-H100 node in saturated training, as a share of rated power | 78 | % (about) | Data-centre GPU | United States of America | 2024 | ^[22] |
| Average power usage effectiveness (PUE) of US data centres | 1.4 | ratio of facility to IT energy | Data-centre GPU | United States of America | 2023 | ^[22] |
| Share of average power that Google's TPU machines draw when idle | 60 | % | Custom accelerator | World | 2025 | ^[3] |
| Ratio of TDP to actual average power for TPUs (TDP overstates real use by this factor) | 2 to 6 | times | Custom accelerator | World | 2025 | ^[3] |

as of 2026-11-16. Hours in a year are 8,760. Estimates of utilisation and lifespan differ by study; the energy figure on the Footprint tab uses the LBNL operational time for training and the LBNL PUE.

#### Prices

Unit prices by market or use, with year and source

| Market | Value | Unit | Year | Source |
|---|---|---|---|---|
| NVIDIA H100, low end of analysts' estimates | 25,000 | USD per chip | 2024 | ^[46] |
| NVIDIA H100, high end of analysts' estimates | 40,000 | USD per chip | 2024 | ^[46] |
| NVIDIA Blackwell, low end of the chief executive's statement | 30,000 | USD per chip | 2024 | ^[46] |
| NVIDIA Blackwell, high end of the chief executive's statement | 40,000 | USD per chip | 2024 | ^[46] |
| Cost to make the GPUs of one DGX H100, per GPU (USD 26,600 divided by eight, calculated; not a price) | 3325 | USD per GPU | 2023 | ^[47] |

as of 2026-11-16. Unit values from trade data are calculated by the site and are not researched here.

#### Sources

1. [Life-cycle emissions of AI hardware: a cradle-to-grave approach and generational trends](https://arxiv.org/pdf/2502.01671) Schneider et al. (Google), arXiv preprint 2502.01671, 2025
2. [NVIDIA Blackwell Platform Arrives to Power a New Era of Computing](https://investor.nvidia.com/news/press-release-details/2024/NVIDIA-Blackwell-Platform-Arrives-to-Power-a-New-Era-of-Computing/) NVIDIA investor relations, 2024
3. [More than Carbon: Cradle-to-Grave environmental impacts of GenAI training on the Nvidia A100 GPU (arXiv:2509.00093v3)](https://arxiv.org/pdf/2509.00093) arXiv preprint, 2025
4. [2024 United States Data Center Energy Usage Report (LBNL-2001637)](https://eta-publications.lbl.gov/sites/default/files/2024-12/us_data_center_energy_usage_report_lbnl-2001637.pdf) Lawrence Berkeley National Laboratory, 2024
5. [IndiaAI Mission expands AI ecosystem with affordable compute and startup support](https://www.digitalindia.gov.in/press_release/indiaai-mission-expands-ai-ecosystem-with-affordable-compute-and-startup-support/) Digital India, Government of India, 2026
6. [Google's Ironwood TPUs represent a bigger threat than Nvidia would have you believe](https://www.theregister.com/2025/11/06/googles_ironwood_tpus_ai/) The Register, 2025
7. [Nvidia GPU shipments totaled 3.76m in 2023, equating to a 98% market share: report (TechInsights)](https://www.datacenterdynamics.com/en/news/nvidia-gpu-shipments-totaled-376m-in-2023-equating-to-a-98-market-share-report/) Data Center Dynamics
8. [Nvidia's latest AI chip will cost more than $30,000, CEO says](https://nbcsandiego.com/news/business/money-report/nvidias-latest-ai-chip-will-cost-more-than-30000-ceo-says/3465447) CNBC via NBC San Diego, 2024
9. [AI Server System BOM & Rack Cost: Historical Data & Chart (newest print March 2026)](https://siliconanalysts.com/market-data/ai-server-system-bom) Silicon Analysts, 2026

## Other sections

- [Summary](https://www.materialinsights.org/products/p_ai_accelerator_chip/index.md)
- [Working](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-working/index.md)
- [Bill of materials](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-bom/index.md)
- [Supply chain](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-supply/index.md)
- [Footprint](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-footprint/index.md)
- [Evolution](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-evolution/index.md)
- [Interventions](https://www.materialinsights.org/products/p_ai_accelerator_chip/prod-interventions/index.md)
