Open Access iconOpen Access

ARTICLE

crossmark

Multi-Agent Deep Reinforcement Learning-Based Resource Allocation in HPC/AI Converged Cluster

Jargalsaikhan Narantuya1,*, Jun-Sik Shin2, Sun Park2, JongWon Kim2

1 Department of Cloud, Kakao Enterprise Corp, Seongnam, 13494, Korea
2 AI Graduate School, Gwangju Institute of Science and Technology (GIST), Gwangju, 61005, Korea

* Corresponding Author: Jargalsaikhan Narantuya. Email: email

Computers, Materials & Continua 2022, 72(3), 4375-4395. https://doi.org/10.32604/cmc.2022.023318

Abstract

As the complexity of deep learning (DL) networks and training data grows enormously, methods that scale with computation are becoming the future of artificial intelligence (AI) development. In this regard, the interplay between machine learning (ML) and high-performance computing (HPC) is an innovative paradigm to speed up the efficiency of AI research and development. However, building and operating an HPC/AI converged system require broad knowledge to leverage the latest computing, networking, and storage technologies. Moreover, an HPC-based AI computing environment needs an appropriate resource allocation and monitoring strategy to efficiently utilize the system resources. In this regard, we introduce a technique for building and operating a high-performance AI-computing environment with the latest technologies. Specifically, an HPC/AI converged system is configured inside Gwangju Institute of Science and Technology (GIST), called GIST AI-X computing cluster, which is built by leveraging the latest Nvidia DGX servers, high-performance storage and networking devices, and various open source tools. Therefore, it can be a good reference for building a small or middle-sized HPC/AI converged system for research and educational institutes. In addition, we propose a resource allocation method for DL jobs to efficiently utilize the computing resources with multi-agent deep reinforcement learning (mDRL). Through extensive simulations and experiments, we validate that the proposed mDRL algorithm can help the HPC/AI converged cluster to achieve both system utilization and power consumption improvement. By deploying the proposed resource allocation method to the system, total job completion time is reduced by around 20% and inefficient power consumption is reduced by around 40%.

Keywords


Cite This Article

APA Style
Narantuya, J., Shin, J., Park, S., Kim, J. (2022). Multi-agent deep reinforcement learning-based resource allocation in HPC/AI converged cluster. Computers, Materials & Continua, 72(3), 4375-4395. https://doi.org/10.32604/cmc.2022.023318
Vancouver Style
Narantuya J, Shin J, Park S, Kim J. Multi-agent deep reinforcement learning-based resource allocation in HPC/AI converged cluster. Comput Mater Contin. 2022;72(3):4375-4395 https://doi.org/10.32604/cmc.2022.023318
IEEE Style
J. Narantuya, J. Shin, S. Park, and J. Kim "Multi-Agent Deep Reinforcement Learning-Based Resource Allocation in HPC/AI Converged Cluster," Comput. Mater. Contin., vol. 72, no. 3, pp. 4375-4395. 2022. https://doi.org/10.32604/cmc.2022.023318



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1632

    View

  • 835

    Download

  • 1

    Like

Share Link