Skip to main content

The Cooling Constraint

Key Insights Across the Series
#

  • The Thermal Density Ratio (TDR = peak heat flux (W/cm²) ÷ cooling infrastructure cost per watt dissipated) reveals that Moore's Law is not fundamentally a transistor law — it is a thermal management law; every successful doubling of transistor density in the semiconductor roadmap required a commensurate improvement in heat extraction capacity, and when cooling innovation slowed after 2005, single-core clock speeds plateaued simultaneously.
  • Modern AI GPU clusters operate at heat flux densities of approximately 100 W/cm² — comparable to nuclear reactor fuel rod surface flux — requiring liquid cooling infrastructure that now represents 40–50% of total data center capital expenditure for hyperscale AI facilities; the energy cost of cooling rivals the energy cost of computation.
  • The lithium-ion battery cell operates at peak electrochemical efficiency within a thermal window of approximately 15–35°C; outside this window, capacity fade accelerates at a rate of approximately 2% per degree Celsius above 40°C and internal resistance rises sharply below 0°C, meaning the thermal management system of an EV battery pack is as critical to long-term range as the chemistry of the cell itself.
  • The turbine inlet temperature (TIT) of a civil aviation gas turbine has risen from approximately 1,100K in early 1950s engines to approximately 1,950K in current LEAP and GEnx engines — sustained only by single-crystal nickel superalloy blades with internal cooling channels machined to tolerances of ±50 micrometres and thermal barrier coatings 100–200 micrometres thick; this 850K increase is responsible for the majority of aviation fuel efficiency improvements across eight decades.
  • Every major technological system that has hit a scaling plateau in the modern era — semiconductor clock speeds (2005), aviation fuel efficiency improvement rates (ongoing), EV fast-charging speeds, and AI training throughput per watt — has done so at a thermal boundary, not a design boundary; the engineering discipline of thermal management is the invisible governor of technological progress.

  1. Bergman, T. L., Lavine, A. S., Incropera, F. P., & Dewitt, D. P. (2011). Fundamentals of heat and mass transfer (7th ed.). Wiley.
  2. Waldrop, M. M. (2016). The chips are down for Moore's law. Nature, 530(7589), 144–147. https://doi.org/10.1038/530144a
  3. Garimella, S. V., Fleischer, A. S., Murthy, J. Y., Keshavarzi, A., Prasher, R., Patel, C., Bhavnani, S. H., Venkatasubramanian, R., Mahajan, R., Joshi, Y., Sammakia, B., Myers, B. A., Chorosinsky, L., Mroczka, B., Sherwood, G., & Schmidt, R. (2008). Thermal challenges in next-generation electronic systems. IEEE Transactions on Components and Packaging Technologies, 31(4), 801–815. https://doi.org/10.1109/TCAPT.2008.2001197
  4. Patterson, D. A., & Hennessy, J. L. (2021). Computer organization and design: ARM edition (2nd ed.). Morgan Kaufmann.
  5. International Energy Agency. (2023). Electricity 2024: Analysis and forecast to 2026. IEA. https://www.iea.org/reports/electricity-2024
  6. Uptime Institute. (2023). Global data center survey results 2023. Uptime Institute. https://uptimeinstitute.com/
  7. Pesaran, A. A. (2002). Battery thermal models for hybrid vehicle simulations. Journal of Power Sources, 110(2), 377–382. https://doi.org/10.1016/S0378-7753(02)00200-8
  8. Bandhauer, T. M., Garimella, S., & Fuller, T. F. (2011). A critical review of thermal issues in lithium-ion batteries. Journal of the Electrochemical Society, 158(3), R1–R25. https://doi.org/10.1149/1.3515880
  9. Reed, J. (2023). AI data centers and energy consumption. Lawrence Berkeley National Laboratory.
  10. Rolls-Royce Holdings. (2022). Technology and innovation: Turbine temperature history [Internal engineering briefing, published in annual report supplementary materials]. Rolls-Royce.
  11. Pollock, T. M., & Tin, S. (2006). Nickel-based superalloys for advanced turbine engines: Chemistry, microstructure, and properties. Journal of Propulsion and Power, 22(2), 361–374. https://doi.org/10.2514/1.18239
  12. Keshavarzi, A., & De, V. (2001). Challenges and design opportunities for nanoscale subthreshold and near-threshold operation. IEEE Micro, 30(4), 9–17.
  13. Moore, G. E. (1965). Cramming more components onto integrated circuits. Electronics, 38(8), 114–117.
  14. Dennard, R. H., Gaensslen, F. H., Yu, H.-N., Rideout, V. L., Bassous, E., & LeBlanc, A. R. (1974). Design of ion-implanted MOSFETs with very small physical dimensions. IEEE Journal of Solid-State Circuits, 9(5), 256–268. https://doi.org/10.1109/JSSC.1974.1050511
  15. United States Department of Energy. (2022). Data center energy efficiency. Office of Energy Efficiency & Renewable Energy. https://www.energy.gov/eere/buildings/data-centers-and-servers