Material Insights · Understanding the Material World

Data centres: Engineering methods

Air, free cooling, cold plates or tanks of fluid

What this tab covers The engineering methods that can do this conversion, compared on efficiency, scale, economics, limitations and reliability.

There is one basic conversion, electricity to computation to heat, but several ways to build and cool the facility.

Comparison

MethodEfficiencyScaleEconomicsLimitationsReliability
Enterprise or legacy air-cooled data centre2Older and smaller sites tend to sit above the 1.54 average PUEUnder a few MWLow utilisation of servers and cooling raises cost per unit of computingCannot cool high-density AI racksDepends on redundancy level; power problems caused 45% of impactful outages in the 2025 survey
Hyperscale cloud campus with free cooling13Google fleet PUE 1.09 (2025)Hundreds of MW to over 1 GW per campus; a typical AI data centre uses as much electricity as 100,000 households, the largest under construction 20 times moreLowest cost per unit through scale and utilisationNeeds very large grid connections and land; evaporative cooling uses waterRedundancy spread across sites as well as within them
AI data centre with direct-to-chip liquid cooling1112GB200 NVL72 rack about 2.7 TFLOPS per watt (FP16 with sparsity, calculated); less fan power than air coolingRacks of up to about 132 kWHigher capital cost per MW; much more computing per square metrePlumbing in the white space, leak risk, new skillsPumps and quick-disconnect fittings add failure points
Immersion coolingRemoves almost all fan power; not quantified in the sources usedNiche, mostly pilots and crypto-miningSpecialised hardware and fluidsMaintenance is harder; some fluids are fluorinated chemicals under regulatory pressureLimited long-term data
Colocation2Close to industry average PUEFrom a few MW to hundreds of MWCustomers pay per kW of power reservedOperator controls the building, tenants control the IT, so efficiency incentives are splitSold on uptime guarantees

Efficiency gains in the building (PUE falling from 2.5 in 2007 to about 1.5) have largely been taken; the average has hardly moved since 2018, though the best hyperscalers reach 1.1. The bigger lever is now computing per watt inside the server and rack, and liquid cooling allows racks around 15 times denser than the average (calculated). The constraint has moved from efficiency to the sheer size of grid connections, with demand projected to more than double by 2030.

How each method works

Enterprise or legacy air-cooled data centre

Computer room air handlers blow chilled air into a raised floor or aisles; chillers make the cold water. Often small and run by the company itself.

Hyperscale cloud campus with free cooling

Very large, standardised halls use outside air or evaporative cooling for most of the year, high-efficiency power chains and custom servers, with software moving workloads between sites.

AI data centre with direct-to-chip liquid cooling

Cold plates on GPUs and CPUs carry warm water or coolant to coolant distribution units; the remaining heat in the air is removed conventionally.

Immersion cooling

Servers sit in tanks of dielectric (electrically insulating) fluid that carries heat away by circulation or by boiling and condensing.

Colocation

A developer builds and runs the facility and rents space, power and cooling to many customers who install their own servers.

Sources

  1. Energy and AI (World Energy Outlook special report) IEA, 2025
  2. Uptime Institute Global Data Center Survey 2025 Uptime Institute, 2025
  3. Data centers: efficiency (power usage effectiveness) Google, 2026
  4. NVIDIA GB200 NVL72 (specifications) Nvidia, 2025
  5. Vertiv and Nvidia collaborate on 7MW reference architecture for GB200 NVL72 DatacenterDynamics, 2024