The proliferation of artificial intelligence (AI) has increased the demand for more powerful chips that are being deployed in data centers to train complex large language models (LLMs), and also for moving those models into production through AI inference.
However, clustering together multiple powerful chips that consume a lot of electricity and generate a lot of heat also means that data centers now have two new challenges to tackle. The first is to find a way to reduce electricity […]
Artificial Intelligence (AI) Energy Consumption Is Jumping At a Scary Pace – Yahoo Finance