Open Access iconOpen Access

ARTICLE

Deep Reinforcement Learning-Based Job Shop Scheduling of Smart Manufacturing

Eman K. Elsayed1, Asmaa K. Elsayed2,*, Kamal A. Eldahshan3

1 School of Computers Science, Canadian International College (CIC). Department of Mathematics, Faculty of Science (Girls), AL-Azhar University, Cairo, 11511, Egypt
2 Department of Mathematics, Faculty of Science(Girls), AL-Azhar University, Cairo, 11511, Egypt
3 Department of Mathematics, Faculty of Science, AL-Azhar University, Cairo, 11511, Egypt

* Corresponding Author: Asmaa K. Elsayed. Email: email

Computers, Materials & Continua 2022, 73(3), 5103-5120. https://doi.org/10.32604/cmc.2022.030803

Abstract

Industry 4.0 production environments and smart manufacturing systems integrate both the physical and decision-making aspects of manufacturing operations into autonomous and decentralized systems. One of the key aspects of these systems is a production planning, specifically, Scheduling operations on the machines. To cope with this problem, this paper proposed a Deep Reinforcement Learning with an Actor-Critic algorithm (DRLAC). We model the Job-Shop Scheduling Problem (JSSP) as a Markov Decision Process (MDP), represent the state of a JSSP as simple Graph Isomorphism Networks (GIN) to extract nodes features during scheduling, and derive the policy of optimal scheduling which guides the included node features to the best next action of schedule. In addition, we adopt the Actor-Critic (AC) network’s training algorithm-based reinforcement learning for achieving the optimal policy of the scheduling. To prove the proposed model’s effectiveness, first, we will present a case study that illustrated a conflict between two job scheduling, secondly, we will apply the proposed model to a known benchmark dataset and compare the results with the traditional scheduling methods and trending approaches. The numerical results indicate that the proposed model can be adaptive with real-time production scheduling, where the average percentage deviation (APD) of our model achieved values between 0.009 and 0.21 compared with heuristic methods and values between 0.014 and 0.18 compared with other trending approaches.

Keywords


Cite This Article

E. K. Elsayed, A. K. Elsayed and K. A. Eldahshan, "Deep reinforcement learning-based job shop scheduling of smart manufacturing," Computers, Materials & Continua, vol. 73, no.3, pp. 5103–5120, 2022.



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1254

    View

  • 883

    Download

  • 0

    Like

Share Link