GDCEngine: an end-to-end machine learning engine for green data center control optimization with digital twins
The ever-increasing scales and power consumption of data centers (DCs) have brought challenges that aim to minimize energy costs while avoiding operational risk. Current industry practice mainly relies on the data centre infrastructure management (DCIM) system and requires extensive human expertise,...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Final Year Project |
Language: | English |
Published: |
Nanyang Technological University
2022
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/156572 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-156572 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1565722022-04-21T07:14:52Z GDCEngine: an end-to-end machine learning engine for green data center control optimization with digital twins Zhang, Xinyi Wen Yonggang School of Computer Science and Engineering YGWEN@ntu.edu.sg Engineering::Computer science and engineering::Computer applications Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence The ever-increasing scales and power consumption of data centers (DCs) have brought challenges that aim to minimize energy costs while avoiding operational risk. Current industry practice mainly relies on the data centre infrastructure management (DCIM) system and requires extensive human expertise, which is difficult to scale with the growing DC complexity. To advance DC management, we propose GDCEngine, an end-to-end green data center (GDC) AI engine that facilities the development and applications of machine learning (ML) approaches for DC optimizations. In GDCEngine, we develop three major components to support the training and evaluation of ML-based policies for different user groups. First, we develop the GDCSimulator module that integrates multiphysics digital twin simulation for evaluating ML-based policies without risking the physical system. Second, we develop the GDCPolicy module that incorporates advanced deep reinforcement learning algorithms for DC cooling control optimizations. Third, we design a no-code web interface to facilitate the usage of DC operators without intensive prior knowledge in ML. We use a case study to demonstrate the developed engine in optimizing a chilled water cooling DC based on our proposed Safari algorithms. The experimental evaluation shows that GDCEngine helps save 26% total power consumption compared with a conventional controller, and dramatically reduces thermal safety violations during the online learning stage. GDCEngine is a firm step towards transforming GDC ML research and application. Bachelor of Engineering (Computer Science) 2022-04-21T07:14:51Z 2022-04-21T07:14:51Z 2022 Final Year Project (FYP) Zhang, X. (2022). GDCEngine: an end-to-end machine learning engine for green data center control optimization with digital twins. Final Year Project (FYP), Nanyang Technological University, Singapore. https://hdl.handle.net/10356/156572 https://hdl.handle.net/10356/156572 en SCSE21-0267 application/pdf Nanyang Technological University |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Computer science and engineering::Computer applications Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence |
spellingShingle |
Engineering::Computer science and engineering::Computer applications Engineering::Computer science and engineering::Computing methodologies::Artificial intelligence Zhang, Xinyi GDCEngine: an end-to-end machine learning engine for green data center control optimization with digital twins |
description |
The ever-increasing scales and power consumption of data centers (DCs) have brought challenges that aim to minimize energy costs while avoiding operational risk. Current industry practice mainly relies on the data centre infrastructure management (DCIM) system and requires extensive human expertise, which is difficult to scale with the growing DC complexity. To advance DC management, we propose GDCEngine, an end-to-end green data center (GDC) AI engine that facilities the development and applications of machine learning (ML) approaches for DC optimizations. In GDCEngine, we develop three major components to support the training and evaluation of ML-based policies for different user groups. First, we develop the GDCSimulator module that integrates multiphysics digital twin simulation for evaluating ML-based policies without risking the physical system. Second, we develop the GDCPolicy module that incorporates advanced deep reinforcement learning algorithms for DC cooling control optimizations. Third, we design a no-code web interface to facilitate the usage of DC operators without intensive prior knowledge in ML. We use a case study to demonstrate the developed engine in optimizing a chilled water cooling DC based on our proposed Safari algorithms. The experimental evaluation shows that GDCEngine helps save 26% total power consumption compared with a conventional controller, and dramatically reduces thermal safety violations during the online learning stage. GDCEngine is a firm step towards transforming GDC ML research and application. |
author2 |
Wen Yonggang |
author_facet |
Wen Yonggang Zhang, Xinyi |
format |
Final Year Project |
author |
Zhang, Xinyi |
author_sort |
Zhang, Xinyi |
title |
GDCEngine: an end-to-end machine learning engine for green data center control optimization with digital twins |
title_short |
GDCEngine: an end-to-end machine learning engine for green data center control optimization with digital twins |
title_full |
GDCEngine: an end-to-end machine learning engine for green data center control optimization with digital twins |
title_fullStr |
GDCEngine: an end-to-end machine learning engine for green data center control optimization with digital twins |
title_full_unstemmed |
GDCEngine: an end-to-end machine learning engine for green data center control optimization with digital twins |
title_sort |
gdcengine: an end-to-end machine learning engine for green data center control optimization with digital twins |
publisher |
Nanyang Technological University |
publishDate |
2022 |
url |
https://hdl.handle.net/10356/156572 |
_version_ |
1731235747269181440 |