Qian Wang¹, Ya Zhou^1,2,*

CMC-Computers, Materials & Continua, Vol.84, No.2, pp. 3835-3856, 2025, DOI:10.32604/cmc.2025.065465 - 03 July 2025

Abstract Edge computing has transformed smart grids by lowering latency, reducing network congestion, and enabling real-time decision-making. Nevertheless, devising an optimal task-offloading strategy remains challenging, as it must jointly minimise energy consumption and response time under fluctuating workloads and volatile network conditions. We cast the offloading problem as a Markov Decision Process (MDP) and solve it with Deep Reinforcement Learning (DRL). Specifically, we present a three-tier architecture—end devices, edge nodes, and a cloud server—and enhance Proximal Policy Optimization (PPO) to learn adaptive, energy-aware policies. A Convolutional Neural Network (CNN) extracts high-level features from system states, enabling More >

Chenxi Lyu¹, Chen Dong¹, Qiancheng Xiong¹, Yuzhong Chen¹, Qian Weng^1,*, Zhenyi Chen²

CMC-Computers, Materials & Continua, Vol.84, No.2, pp. 3371-3391, 2025, DOI:10.32604/cmc.2025.065153 - 03 July 2025

Abstract The rapid advancement of Industry 4.0 has revolutionized manufacturing, shifting production from centralized control to decentralized, intelligent systems. Smart factories are now expected to achieve high adaptability and resource efficiency, particularly in mass customization scenarios where production schedules must accommodate dynamic and personalized demands. To address the challenges of dynamic task allocation, uncertainty, and real-time decision-making, this paper proposes Pathfinder, a deep reinforcement learning-based scheduling framework. Pathfinder models scheduling data through three key matrices: execution time (the time required for a job to complete), completion time (the actual time at which a job is finished),… More >

Chao Li^1,3,#, Quanzhi Feng^1,3,#, Caichang Ding^2,*, Zhiwei Ye^1,3

CMC-Computers, Materials & Continua, Vol.84, No.2, pp. 3605-3621, 2025, DOI:10.32604/cmc.2025.063703 - 03 July 2025

Abstract The increasing adoption of unmanned aerial vehicles (UAVs) in urban low-altitude logistics systems, particularly for time-sensitive applications like parcel delivery and supply distribution, necessitates sophisticated coordination mechanisms to optimize operational efficiency. However, the limited capability of UAVs to extract state-action information in complex environments poses significant challenges to achieving effective cooperation in dynamic and uncertain scenarios. To address this, we presents an Improved Multi-Agent Hybrid Attention Critic (IMAHAC) framework that advances multi-agent deep reinforcement learning (MADRL) through two key innovations. Firstly, a Temporal Difference Error and Time-based Prioritized Experience Replay (TT-PER) mechanism that dynamically adjusts… More >

Shaowei He, Wenchao Cui^*, Gang Li, Hairun Xu, Xiang Chen, Yu Tai

CMC-Computers, Materials & Continua, Vol.84, No.1, pp. 861-886, 2025, DOI:10.32604/cmc.2025.063979 - 09 June 2025

Abstract The Virtual Power Plant (VPP), as an innovative power management architecture, achieves flexible dispatch and resource optimization of power systems by integrating distributed energy resources. However, due to significant differences in operational costs and flexibility of various types of generation resources, as well as the volatility and uncertainty of renewable energy sources (such as wind and solar power) and the complex variability of load demand, the scheduling optimization of virtual power plants has become a critical issue that needs to be addressed. To solve this, this paper proposes an intelligent scheduling method for virtual power… More >

Peiying Zhang^1,2,*, Yihong Yu^1,2, Jing Liu³, Chong Lv^1,2, Lizhuang Tan^4,5, Yulin Zhang^6,7,8

CMC-Computers, Materials & Continua, Vol.83, No.3, pp. 4393-4409, 2025, DOI:10.32604/cmc.2025.064654 - 19 May 2025

Abstract As Internet of Things (IoT) technologies continue to evolve at an unprecedented pace, intelligent big data control and information systems have become critical enablers for organizational digital transformation, facilitating data-driven decision making, fostering innovation ecosystems, and maintaining operational stability. In this study, we propose an advanced deployment algorithm for Service Function Chaining (SFC) that leverages an enhanced Practical Byzantine Fault Tolerance (PBFT) mechanism. The main goal is to tackle the issues of security and resource efficiency in SFC implementation across diverse network settings. By integrating blockchain technology and Deep Reinforcement Learning (DRL), our algorithm not… More >

Seyha Ros^1,#, Seungwoo Kang^1,#, Taikuong Iv¹, Inseok Song¹, Prohim Tam², Seokhoon Kim^1,3,*

CMC-Computers, Materials & Continua, Vol.83, No.2, pp. 1649-1665, 2025, DOI:10.32604/cmc.2025.062716 - 16 April 2025

Abstract Recently, Network Functions Virtualization (NFV) has become a critical resource for optimizing capability utilization in the 5G/B5G era. NFV decomposes the network resource paradigm, demonstrating the efficient utilization of Network Functions (NFs) to enable configurable service priorities and resource demands. Telecommunications Service Providers (TSPs) face challenges in network utilization, as the vast amounts of data generated by the Internet of Things (IoT) overwhelm existing infrastructures. IoT applications, which generate massive volumes of diverse data and require real-time communication, contribute to bottlenecks and congestion. In this context, Multi-access Edge Computing (MEC) is employed to support resource… More >

Hongxiao Wang¹, Hongshen Liu¹, Dingsen Zhang^1,*, Ziye Zhang¹, Yonghui Yue¹, Jie Chen²

CMC-Computers, Materials & Continua, Vol.83, No.2, pp. 1987-2001, 2025, DOI:10.32604/cmc.2025.060384 - 16 April 2025

Abstract Despite its immense potential, the application of digital twin technology in real industrial scenarios still faces numerous challenges. This study focuses on industrial assembly lines in sectors such as microelectronics, pharmaceuticals, and food packaging, where precision and speed are paramount, applying digital twin technology to the robotic assembly process. The innovation of this research lies in the development of a digital twin architecture and system for Delta robots that is suitable for real industrial environments. Based on this system, a deep reinforcement learning algorithm for obstacle avoidance path planning in Delta robots has been developed, More >

Yiqin Wang¹, Yufeng Wang^1,*, Jianhua Ma², Qun Jin³

CMC-Computers, Materials & Continua, Vol.82, No.3, pp. 4431-4449, 2025, DOI:10.32604/cmc.2025.059880 - 06 March 2025

Abstract Opportunistic mobile crowdsensing (MCS) non-intrusively exploits human mobility trajectories, and the participants’ smart devices as sensors have become promising paradigms for various urban data acquisition tasks. However, in practice, opportunistic MCS has several challenges from both the perspectives of MCS participants and the data platform. On the one hand, participants face uncertainties in conducting MCS tasks, including their mobility and implicit interactions among participants, and participants’ economic returns given by the MCS data platform are determined by not only their own actions but also other participants’ strategic actions. On the other hand, the platform can… More >

Taha Yacine Trad^1,*, Kheireddine Choutri¹, Mohand Lagha¹, Souham Meshoul², Fouad Khenfri³, Raouf Fareh⁴, Hadil Shaiba⁵

CMC-Computers, Materials & Continua, Vol.81, No.3, pp. 4757-4786, 2024, DOI:10.32604/cmc.2024.055634 - 19 December 2024

Abstract The popularity of quadrotor Unmanned Aerial Vehicles (UAVs) stems from their simple propulsion systems and structural design. However, their complex and nonlinear dynamic behavior presents a significant challenge for control, necessitating sophisticated algorithms to ensure stability and accuracy in flight. Various strategies have been explored by researchers and control engineers, with learning-based methods like reinforcement learning, deep learning, and neural networks showing promise in enhancing the robustness and adaptability of quadrotor control systems. This paper investigates a Reinforcement Learning (RL) approach for both high and low-level quadrotor control systems, focusing on attitude stabilization and position… More >

Li Wang^1,*, Xiaoyong Wang²

Energy Engineering, Vol.121, No.12, pp. 3953-3979, 2024, DOI:10.32604/ee.2024.056705 - 22 November 2024

Abstract Plug-in Hybrid Electric Vehicles (PHEVs) represent an innovative breed of transportation, harnessing diverse power sources for enhanced performance. Energy management strategies (EMSs) that coordinate and control different energy sources is a critical component of PHEV control technology, directly impacting overall vehicle performance. This study proposes an improved deep reinforcement learning (DRL)-based EMS that optimizes real-time energy allocation and coordinates the operation of multiple power sources. Conventional DRL algorithms struggle to effectively explore all possible state-action combinations within high-dimensional state and action spaces. They often fail to strike an optimal balance between exploration and exploitation, and… More >