Open Access iconOpen Access

ARTICLE

crossmark

Performance Evaluation of Multi-Agent Reinforcement Learning Algorithms

Abdulghani M. Abdulghani, Mokhles M. Abdulghani, Wilbur L. Walters, Khalid H. Abed*

Department of Electrical & Computer Engineering and Computer Science, Jackson State University, Jackson, MS 39217, USA

* Corresponding Author: Khalid H. Abed. Email: email

(This article belongs to the Special Issue: Intelligent Algorithms in Unmanned Systems and Swarms)

Intelligent Automation & Soft Computing 2024, 39(2), 337-352. https://doi.org/10.32604/iasc.2024.047017

Abstract

Multi-Agent Reinforcement Learning (MARL) has proven to be successful in cooperative assignments. MARL is used to investigate how autonomous agents with the same interests can connect and act in one team. MARL cooperation scenarios are explored in recreational cooperative augmented reality environments, as well as real-world scenarios in robotics. In this paper, we explore the realm of MARL and its potential applications in cooperative assignments. Our focus is on developing a multi-agent system that can collaborate to attack or defend against enemies and achieve victory with minimal damage. To accomplish this, we utilize the StarCraft Multi-Agent Challenge (SMAC) environment and train four MARL algorithms: Q-learning with Mixtures of Experts (QMIX), Value-Decomposition Network (VDN), Multi-agent Proximal Policy Optimizer (MAPPO), and Multi-Agent Actor Attention Critic (MAA2C). These algorithms allow multiple agents to cooperate in a specific scenario to achieve the targeted mission. Our results show that the QMIX algorithm outperforms the other three algorithms in the attacking scenario, while the VDN algorithm achieves the best results in the defending scenario. Specifically, the VDN algorithm reaches the highest value of battle won mean and the lowest value of dead allies mean. Our research demonstrates the potential for MARL algorithms to be used in real-world applications, such as controlling multiple robots to provide helpful services or coordinating teams of agents to accomplish tasks that would be impossible for a human to do. The SMAC environment provides a unique opportunity to test and evaluate MARL algorithms in a challenging and dynamic environment, and our results show that these algorithms can be used to achieve victory with minimal damage.

Keywords


Cite This Article

APA Style
Abdulghani, A.M., Abdulghani, M.M., Walters, W.L., Abed, K.H. (2024). Performance evaluation of multi-agent reinforcement learning algorithms. Intelligent Automation & Soft Computing, 39(2), 337-352. https://doi.org/10.32604/iasc.2024.047017
Vancouver Style
Abdulghani AM, Abdulghani MM, Walters WL, Abed KH. Performance evaluation of multi-agent reinforcement learning algorithms. Intell Automat Soft Comput . 2024;39(2):337-352 https://doi.org/10.32604/iasc.2024.047017
IEEE Style
A.M. Abdulghani, M.M. Abdulghani, W.L. Walters, and K.H. Abed "Performance Evaluation of Multi-Agent Reinforcement Learning Algorithms," Intell. Automat. Soft Comput. , vol. 39, no. 2, pp. 337-352. 2024. https://doi.org/10.32604/iasc.2024.047017



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 393

    View

  • 101

    Download

  • 0

    Like

Share Link