Mohammad A Al Khaldy¹, Ahmad Nabot², Ahmad Al-Qerem^3,*, Mohammad Alauthman⁴, Amina Salhi^5,*, Suhaila Abuowaida⁶, Naceur Chihaoui⁷

CMES-Computer Modeling in Engineering & Sciences, Vol.145, No.1, pp. 673-697, 2025, DOI:10.32604/cmes.2025.070004 - 30 October 2025

Abstract The exponential growth of Internet of Things (IoT) devices has created unprecedented challenges in data processing and resource management for time-critical applications. Traditional cloud computing paradigms cannot meet the stringent latency requirements of modern IoT systems, while pure edge computing faces resource constraints that limit processing capabilities. This paper addresses these challenges by proposing a novel Deep Reinforcement Learning (DRL)-enhanced priority-based scheduling framework for hybrid edge-cloud computing environments. Our approach integrates adaptive priority assignment with a two-level concurrency control protocol that ensures both optimal performance and data consistency. The framework introduces three key innovations: (1)… More >

Jiayun Ding, Bin Chen^*, Yutong Lei, Wei Zhang

Energy Engineering, Vol.122, No.11, pp. 4561-4577, 2025, DOI:10.32604/ee.2025.067574 - 27 October 2025

Abstract In the field of low-carbon building systems, the combination of renewable energy and hydrogen energy systems is gradually gaining prominence. However, the uncertainty of supply and demand and the multi-energy flow coupling characteristics of this system pose challenges for its optimized scheduling. In light of this, this study focuses on electro-thermal-hydrogen trigeneration systems, first modelling the system’s scheduling optimization problem as a Markov decision process, thereby transforming it into a sequential decision problem. Based on this, this paper proposes a reinforcement learning algorithm based on deep deterministic policy gradient improvement, aiming to minimize system operating… More >

Diyar Wirya Omar Ameenulhakeem^*, Osman Nuri Uçan

CMC-Computers, Materials & Continua, Vol.85, No.3, pp. 5671-5702, 2025, DOI:10.32604/cmc.2025.070422 - 23 October 2025

Abstract Face antispoofing has received a lot of attention because it plays a role in strengthening the security of face recognition systems. Face recognition is commonly used for authentication in surveillance applications. However, attackers try to compromise these systems by using spoofing techniques such as using photos or videos of users to gain access to services or information. Many existing methods for face spoofing face difficulties when dealing with new scenarios, especially when there are variations in background, lighting, and other environmental factors. Recent advancements in deep learning with multi-modality methods have shown their effectiveness in… More >

Yiming Guo, Hongyu Ma^*

CMC-Computers, Materials & Continua, Vol.85, No.2, pp. 3485-3505, 2025, DOI:10.32604/cmc.2025.067590 - 23 September 2025

Abstract In dynamic 5G network environments, user mobility and heterogeneous network topologies pose dual challenges to the effort of improving performance of mobile edge caching. Existing studies often overlook the dynamic nature of user locations and the potential of device-to-device (D2D) cooperative caching, limiting the reduction of transmission latency. To address this issue, this paper proposes a joint optimization scheme for edge caching that integrates user mobility prediction with deep reinforcement learning. First, a Transformer-based geolocation prediction model is designed, leveraging multi-head attention mechanisms to capture correlations in historical user trajectories for accurate future location prediction.… More >

Thai-Viet Dang^1,*, Dinh-Manh-Cuong Tran¹, Nhu-Nghia Bui¹, Phan Xuan Tan^2,*

CMC-Computers, Materials & Continua, Vol.85, No.2, pp. 2651-2680, 2025, DOI:10.32604/cmc.2025.067500 - 23 September 2025

Abstract Precise and robust three-dimensional object detection (3DOD) presents a promising opportunity in the field of mobile robot (MR) navigation. Monocular 3DOD techniques typically involve extending existing two-dimensional object detection (2DOD) frameworks to predict the three-dimensional bounding box (3DBB) of objects captured in 2D RGB images. However, these methods often require multiple images, making them less feasible for various real-time scenarios. To address these challenges, the emergence of agile convolutional neural networks (CNNs) capable of inferring depth from a single image opens a new avenue for investigation. The paper proposes a novel ELDE-Net network designed to… More >

Cecilia Castro¹, Victor Leiva^2,*, Franco Basso^2,3

CMES-Computer Modeling in Engineering & Sciences, Vol.144, No.2, pp. 1481-1543, 2025, DOI:10.32604/cmes.2025.067992 - 31 August 2025

Abstract Metaverse technologies are increasingly promoted as game-changers in transport planning, connected-autonomous mobility, and immersive traveler services. However, the field lacks a systematic review of what has been achieved, where critical technical gaps remain, and where future deployments should be integrated. Using a transparent protocol-driven screening process, we reviewed 1589 records and retained 101 peer-reviewed journal and conference articles (2021–2025) that explicitly frame their contributions within a transport-oriented metaverse. Our review reveals a predominantly exploratory evidence base. Among the 101 studies reviewed, 17 (16.8%) apply fuzzy multi-criteria decision-making, 36 (35.6%) feature digital-twin visualizations or simulation-based testbeds,… More > Graphic Abstract

Abubakar Elsafi^*

CMES-Computer Modeling in Engineering & Sciences, Vol.144, No.2, pp. 1749-1766, 2025, DOI:10.32604/cmes.2025.066449 - 31 August 2025

Abstract Domain randomization is a widely adopted technique in deep reinforcement learning (DRL) to improve agent generalization by exposing policies to diverse environmental conditions. This paper investigates the impact of different reset strategies, normal, non-randomized, and randomized, on agent performance using the Deep Deterministic Policy Gradient (DDPG) and Twin Delayed DDPG (TD3) algorithms within the CarRacing-v2 environment. Two experimental setups were conducted: an extended training regime with DDPG for 1000 steps per episode across 1000 episodes, and a fast execution setup comparing DDPG and TD3 for 30 episodes with 50 steps per episode under constrained computational… More >

Taimoor Hassan¹, Ibrar Hussain^1,*, Hafiz Mahfooz Ul Haque², Hamid Turab Mirza³, Muhammad Nadeem Ali⁴, Byung-Seo Kim^4,*

CMC-Computers, Materials & Continua, Vol.85, No.1, pp. 2071-2094, 2025, DOI:10.32604/cmc.2025.068533 - 29 August 2025

Abstract Smart learning environments have been considered as vital sources and essential needs in modern digital education systems. With the rapid proliferation of smart and assistive technologies, smart learning processes have become quite convenient, comfortable, and financially affordable. This shift has led to the emergence of pervasive computing environments, where user’s intelligent behavior is supported by smart gadgets; however, it is becoming more challenging due to inconsistent behavior of Artificial intelligence (AI) assistive technologies in terms of networking issues, slow user responses to technologies and limited computational resources. This paper presents a context-aware predictive reasoning based… More >

Lei Lei¹, Chengfu Wu^2,*, Huaimin Chen²

CMC-Computers, Materials & Continua, Vol.85, No.1, pp. 1339-1363, 2025, DOI:10.32604/cmc.2025.067117 - 29 August 2025

Abstract This paper proposes a Multi-Agent Attention Proximal Policy Optimization (MA2PPO) algorithm aiming at the problems such as credit assignment, low collaboration efficiency and weak strategy generalization ability existing in the cooperative pursuit tasks of multiple unmanned aerial vehicles (UAVs). Traditional algorithms often fail to effectively identify critical cooperative relationships in such tasks, leading to low capture efficiency and a significant decline in performance when the scale expands. To tackle these issues, based on the proximal policy optimization (PPO) algorithm, MA2PPO adopts the centralized training with decentralized execution (CTDE) framework and introduces a dynamic decoupling mechanism,… More >

Mingoo Kwon, Kyeongmin Kim, Minseok Song^*

CMC-Computers, Materials & Continua, Vol.85, No.1, pp. 519-537, 2025, DOI:10.32604/cmc.2025.066754 - 29 August 2025

Abstract Efficient edge caching is essential for maximizing utility in video streaming systems, especially under constraints such as limited storage capacity and dynamically fluctuating content popularity. Utility, defined as the benefit obtained per unit of cache bandwidth usage, degrades when static or greedy caching strategies fail to adapt to changing demand patterns. To address this, we propose a deep reinforcement learning (DRL)-based caching framework built upon the proximal policy optimization (PPO) algorithm. Our approach formulates edge caching as a sequential decision-making problem and introduces a reward model that balances cache hit performance and utility by prioritizing More >