A. Sivaranjani^1,*, B. Vinod²

Intelligent Automation & Soft Computing, Vol.35, No.1, pp. 1135-1150, 2023, DOI:10.32604/iasc.2023.028126 - 06 June 2022

Abstract Autonomous navigation of mobile robots is a challenging task that requires them to travel from their initial position to their destination without collision in an environment. Reinforcement Learning methods enable a state action function in mobile robots suited to their environment. During trial-and-error interaction with its surroundings, it helps a robot to find an ideal behavior on its own. The Deep Q Network (DQN) algorithm is used in TurtleBot 3 (TB3) to achieve the goal by successfully avoiding the obstacles. But it requires a large number of training iterations. This research mainly focuses on a… More >

Eman K. Elsayed¹, Asmaa K. Elsayed^2,*, Kamal A. Eldahshan³

CMC-Computers, Materials & Continua, Vol.73, No.3, pp. 5103-5120, 2022, DOI:10.32604/cmc.2022.030803 - 28 July 2022

Abstract Industry 4.0 production environments and smart manufacturing systems integrate both the physical and decision-making aspects of manufacturing operations into autonomous and decentralized systems. One of the key aspects of these systems is a production planning, specifically, Scheduling operations on the machines. To cope with this problem, this paper proposed a Deep Reinforcement Learning with an Actor-Critic algorithm (DRLAC). We model the Job-Shop Scheduling Problem (JSSP) as a Markov Decision Process (MDP), represent the state of a JSSP as simple Graph Isomorphism Networks (GIN) to extract nodes features during scheduling, and derive the policy of optimal… More >

Yongjiang Zhao, Jae Hung Yoo, Chang Gyoon Lim^*

CMC-Computers, Materials & Continua, Vol.73, No.3, pp. 5671-5686, 2022, DOI:10.32604/cmc.2022.027443 - 28 July 2022

Abstract With the rapid economic growth and improved living standards, electricity has become an indispensable energy source in our lives. Therefore, the stability of the grid power supply and the conservation of electricity is critical. The following are some of the problems facing now: 1) During the peak power consumption period, it will pose a threat to the power grid. Enhancing and improving the power distribution infrastructure requires high maintenance costs. 2) The user's electricity schedule is unreasonable due to personal behavior, which will cause a waste of electricity. Controlling load as a vital part of More >

Sun Yang-Yang, Yao Jun-Ping^*, Li Xiao-Jun, Fan Shou-Xiang, Wang Zi-Wei

Journal on Artificial Intelligence, Vol.4, No.1, pp. 27-35, 2022, DOI:10.32604/jai.2022.027839 - 16 May 2022

Abstract Deep deterministic policy gradient (DDPG) has been proved to be effective in optimizing particle swarm optimization (PSO), but whether DDPG can optimize multi-objective discrete particle swarm optimization (MODPSO) remains to be determined. The present work aims to probe into this topic. Experiments showed that the DDPG can not only quickly improve the convergence speed of MODPSO, but also overcome the problem of local optimal solution that MODPSO may suffer. The research findings are of great significance for the theoretical research and application of MODPSO. More >

Yuping Deng¹, Tao Wu¹, Xi Chen^2,*, Amir Homayoon Ashrafzadeh³

Intelligent Automation & Soft Computing, Vol.34, No.2, pp. 1157-1174, 2022, DOI:10.32604/iasc.2022.022606 - 03 May 2022

Abstract In meteorological and electric power Internet of Things scenarios, in order to extend the service life of relevant facilities and reduce the cost of emergency repair, the intelligent inspection swarm is introduced to cooperate with monitoring tasks, which collect and process the current scene data through a variety of sensors and cameras, and complete tasks such as emergency handling and fault inspection. Due to the limitation of computing resources and battery life of patrol inspection equipment, it will cause problems such as slow response in emergency and long time for fault location. Mobile Edge Computing… More >

Fawad Salam Khan^1,4, Mohd Norzali Haji Mohd^1,*, Saiful Azrin B. M. Zulkifli², Ghulam E Mustafa Abro², Suhail Kazi³, Dur Muhammad Soomro¹

CMC-Computers, Materials & Continua, Vol.72, No.3, pp. 5741-5759, 2022, DOI:10.32604/cmc.2022.024927 - 21 April 2022

Abstract The evident change in the design of the autopilot system produced massive help for the aviation industry and it required frequent upgrades. Reinforcement learning delivers appropriate outcomes when considering a continuous environment where the controlling Unmanned Aerial Vehicle (UAV) required maximum accuracy. In this paper, we designed a hybrid framework, which is based on Reinforcement Learning and Deep Learning where the traditional electronic flight controller is replaced by using 3D hand gestures. The algorithm is designed to take the input from 3D hand gestures and integrate with the Deep Deterministic Policy Gradient (DDPG) to receive… More >

Jargalsaikhan Narantuya^1,*, Jun-Sik Shin², Sun Park², JongWon Kim²

CMC-Computers, Materials & Continua, Vol.72, No.3, pp. 4375-4395, 2022, DOI:10.32604/cmc.2022.023318 - 21 April 2022

Abstract As the complexity of deep learning (DL) networks and training data grows enormously, methods that scale with computation are becoming the future of artificial intelligence (AI) development. In this regard, the interplay between machine learning (ML) and high-performance computing (HPC) is an innovative paradigm to speed up the efficiency of AI research and development. However, building and operating an HPC/AI converged system require broad knowledge to leverage the latest computing, networking, and storage technologies. Moreover, an HPC-based AI computing environment needs an appropriate resource allocation and monitoring strategy to efficiently utilize the system resources. In… More >

Mesfer Al Duhayyim¹, Taiseer Abdalla Elfadil Eisa², Fahd N. Al-Wesabi^3,4, Abdelzahir Abdelmaboud⁵, Manar Ahmed Hamza^6,*, Abu Sarwar Zamani⁶, Mohammed Rizwanullah⁶, Radwa Marzouk^7,8

CMC-Computers, Materials & Continua, Vol.71, No.3, pp. 5699-5715, 2022, DOI:10.32604/cmc.2022.024431 - 14 January 2022

Abstract The Smart City concept revolves around gathering real time data from citizen, personal vehicle, public transports, building, and other urban infrastructures like power grid and waste disposal system. The understandings obtained from the data can assist municipal authorities handle assets and services effectually. At the same time, the massive increase in environmental pollution and degradation leads to ecological imbalance is a hot research topic. Besides, the progressive development of smart cities over the globe requires the design of intelligent waste management systems to properly categorize the waste depending upon the nature of biodegradability. Few of… More >

S. Lakshmi Durga¹, Ch. Rajeshwari¹, Khalid Hamed Allehaibi², Nishu Gupta^3,*, Nasser Nammas Albaqami⁴, Isha Bharti⁵, Ahmad Hoirul Basori⁶

Intelligent Automation & Soft Computing, Vol.33, No.1, pp. 1-19, 2022, DOI:10.32604/iasc.2022.022536 - 05 January 2022

Abstract In recent years, the demand for smart wireless communication technology has increased tremendously, and it urges to extend internet services globally with high reliability, less cost and minimal delay. In this connection, low earth orbit (LEO) satellites have played prominent role by reducing the terrestrial infrastructure facilities and providing global coverage all over the earth with the help of satellite internet of things (SIoT). LEO satellites provide wide coverage area to dynamically accessing network with limited resources. Presently, most resource allocation schemes are designed only for geostationary earth orbit (GEO) satellites. For LEO satellites, resource allocation… More >

Faizan Rasheed¹, Kok-Lim Alvin Yau², Rafidah Md Noor³, Yung-Wey Chong^4,*

CMC-Computers, Materials & Continua, Vol.71, No.2, pp. 2225-2247, 2022, DOI:10.32604/cmc.2022.022952 - 07 December 2021

Abstract This paper investigates the use of multi-agent deep Q-network (MADQN) to address the curse of dimensionality issue occurred in the traditional multi-agent reinforcement learning (MARL) approach. The proposed MADQN is applied to traffic light controllers at multiple intersections with busy traffic and traffic disruptions, particularly rainfall. MADQN is based on deep Q-network (DQN), which is an integration of the traditional reinforcement learning (RL) and the newly emerging deep learning (DL) approaches. MADQN enables traffic light controllers to learn, exchange knowledge with neighboring agents, and select optimal joint actions in a collaborative manner. A case study More >