The new era of AI and its impact on data centers

Artificial intelligence has emerged as a transformative force, changing the way we process, analyze, and utilize data. With the AI market projected to reach a staggering $407 billion by 2027, this technology continues to revolutionize numerous industries, with an expected annual growth rate of 37.3% between 2023 and 2030.

By Marc Garner, SVP Secure Power Europe, Schneider Electric 

The AI market has the potential to grow even more, thanks to the boom in generative AI. 97% of business owners believe that ChatGPT will benefit their organizations, through uses such as streamlining communications, generating website copy, or translating information, but the surge in adoption will undoubtedly require greater investment and infrastructure for AI-powered solutions than ever. So, how do we accommodate the demands of this new AI-powered world?

Data centers serve as the critical infrastructure supporting the artificial intelligence ecosystem. Although AI requires large amounts of power, AI-driven data analytics can help bring data centers closer to net zero and play a positive role in tackling the sustainability challenge. Here, we explore the four key AI attributes and trends that underpin the physical infrastructure challenges of data centers: power, racks, cooling, and software management.

Read more about

Irina Peptine is the new Marketing Director of Schneider Electric Romania, Moldova and Armenia

read more

How to tackle increasing power-hungry AI applications

Power, cooling, racks and physical infrastructure are core to a data center’s success. Storing and processing data to train machine learning (ML) and large language models (LLMs) is steadily driving up energy consumption. For instance, researchers estimate that creating GPT-3 consumed 1,287 megawatt hours of electricity and generated 552 tons of CO2 — the equivalent of 123 gasoline-powered passenger vehicles driven for one year. What’s more, data centers are adopting high-density racks that can accommodate a larger number of servers in a smaller space, further driving up power requirements.

So how do we meet these increased power demands of AI, whilst minimizing its impact on the planet? Data centers are continually evolving to accommodate the increased power demands of AI clusters. Improving power distribution systems and energy efficiencies within data centers helps to minimize losses and ensures that power is delivered to servers in the most efficient way possible. As operators design and manage data centers, they must focus on energy-efficient hardware and software, while diversifying power sources to provide the secure and plentiful power AI needs to thrive.

Additions such as advanced power distribution units (PDUs), intelligent management and high-efficiency power systems, alongside renewable energy sources, enables data centers to reduce both energy costs and carbon emissions. However, the extreme rack power densities of AI training servers can create additional issues than power consumption — cooling, for example, can also create complex challenges for operators.

The transition from air-cooling to liquid cooling is a must to increase sustainability

Today sustainable and resilient data center design hinges on effective cooling. The demands that AI places on data centers mean powering high-density servers requires new cooling methodologies for both optimal performance and minimized downtime.

Although air cooling is commonplace in the industry and will still exist for years to come, a transition from air cooling to liquid cooling will become the preferred and necessary solution for data centers to cope with AI clusters effectively. This is due to traditional air-cooling systems becoming less efficient for high-density setups.

Here Direct-to-Chip liquid cooling, where a cooling fluid is circulated through the servers to absorb and dissipate heat, is quickly gaining popularity as a more effective to handle the concentrated heat generated by AI clusters.

Compared with air cooling, liquid cooling provides many benefits for data centers. From improved processor reliability and performance to space savings with higher rack densities to more thermal inertia with water in piping, liquid cooling increases energy efficiency, improves power utilization, and reduces water usage.

Turning the technology on itself

Another way for data center leaders to cope with the increasing demands of AI is to use the technology to their advantage. Data centers can benefit from using AI-powered automation, data analytics, and machine learning to find opportunities for efficiency gains and decarbonization. By using data insights more efficiently, we can drive new, more sustainable, behaviors.

This process is powered by physical infrastructure and software tools that support data center design and operation, including DCIM, EPMS, BMS, and digital twins. These applications decrease the risk of unexpected behavior with complex electrical networks and provide a digital replica of the data center to identify constrained power and cooling resources to inform layout decisions.

For instance, Equinix improved the energy efficiency of its data center by 9% using AI-based cooling, which enabled the company to reduce the energy consumption of cooling systems by regulating them more effectively and making the system more efficient.

Achieving more computing power within the same physical footprint

What’s clear is that AI applications are escalating power consumption in data centers at a time when they need to become more sustainable. Yet, AI is also providing the intelligence to design and operate data centers in a smarter, more energy-efficient way, and if deployed correctly, can help the planet’s journey toward net zero.

By combining the key attributes of data center physical infrastructure with the efficiency gains of AI, owners, operators and end-users can more effectively manage the power demands of high-density AI clusters while maintaining efficiency, reliability, and sustainability.