Taimoor Hassan¹, Ibrar Hussain^1,*, Hafiz Mahfooz Ul Haque², Hamid Turab Mirza³, Muhammad Nadeem Ali⁴, Byung-Seo Kim^4,*, Changheun Oh⁴

CMC-Computers, Materials & Continua, Vol.87, No.3, 2026, DOI:10.32604/cmc.2026.077510 - 09 April 2026

Abstract The expeditious proliferation of the smart computing paradigm has a remarkable upsurge towards Artificial Intelligence (AI) assistive reasoning with the incorporation of context-awareness. Context-awareness plays a significant role in fulfilling users’ needs whenever and wherever needed. Context-aware systems acquire contextual information from sensors/embedded sensors using smart gadgets and/or systems, perform reasoning using reinforcement learning (RL) or other reasoning techniques, and then adapt behavior. The core intention of using an RL-based reasoning strategy is to train agents to take the right actions at the right time and in the right place. Generally, agents are rewarded for… More >

Kiseok Kim^#, Taehoon Yoo^#, Sangmin Lee, Hwangnam Kim^*

CMC-Computers, Materials & Continua, Vol.87, No.3, 2026, DOI:10.32604/cmc.2026.077415 - 09 April 2026

Abstract Conventional Low-Rank Adaptation (LoRA) constrains weight updates to a static linear low-rank manifold, which is inherently limited when applied to Reinforcement Learning (RL) tasks for Unmanned Aerial Vehicle (UAV) applications. UAVs operate in highly dynamic and nonstationary environments where rapid variations in sensing and state transitions lead to complex, nonlinear input–output relationships. Such environmental complexity cannot be adequately modeled by a static Low-rank approximation, making conventional LoRA approaches insufficient for the high-dimensional dynamics required in UAV applications. To overcome these limitations, we propose an attention-enhanced LoRA that constructs an input-dependent and intrinsically nonlinear adaptation manifold.… More >

Hitesh Mohapatra^*

CMC-Computers, Materials & Continua, Vol.87, No.3, 2026, DOI:10.32604/cmc.2026.076726 - 09 April 2026

Abstract This review examines current approaches to real-time decision-making and task optimization in Internet of Things systems through the application of machine learning models deployed at the network edge. Existing literature shows that edge-based distributed intelligence reduces cloud dependency. It addresses transmission latency, device energy use, and bandwidth limits. Recent optimization strategies employ dynamic task offloading mechanisms to determine optimal workload placement across local devices and edge servers without centralized coordination. Empirical findings from the literature indicate performance improvements with latency reductions of approximately 32.8% and energy efficiency gains of 27.4% compared to conventional cloud-centric models.… More >

Udit Mamodiya^1,*, Indra Kishor², P. Satish Reddy³, K. Lakshmi Kalpana³, Radha Seelaboyina⁴, Harish Reddy Gantla⁵

CMC-Computers, Materials & Continua, Vol.87, No.3, 2026, DOI:10.32604/cmc.2026.076464 - 09 April 2026

Abstract The direct conversion of solid-state heat to electricity using thermoelectric materials has attracted attention; however, their effective application is limited because of the challenge of ensuring a balance between the microstructural features at the quantum, mesoscale, and continuum scales. Current computational and machine-learning methods have a small design space, wherein few to no interactions between the electronic structure, phonon transport, and device-level are considered. This makes it difficult to discover stable high-figure of merit (ZT) settings that are manufacturable and strong in the actual working environment. This study presents a multiscale hybrid optimization framework that… More >

A. Sivasangari^1,*, V. J. K. Kishor Sonti¹, J. Cruz Antony¹, E. Murali¹, D. Deepa¹, A. Happonen²

CMC-Computers, Materials & Continua, Vol.87, No.3, 2026, DOI:10.32604/cmc.2026.074429 - 09 April 2026

Abstract In the past two decades, Precision Agriculture has received research attention since the development of robotics. Agricultural robotic equipment and drones, which can be operated by farmers, are appearing more frequently and being used to make the process of farming easier and more productive. This paper attempts to develop a modified Q-learning algorithm. A reinforcement learning algorithm called Q-learning has Q-values that are updated in order to find the best routes for the robotic devices to follow while avoiding any obstacles. Different types of terrain and other factors that influence the development of good routes… More >

Fangxiang Hu¹, Qi Fu^1,2,*, Shiwen Zhang¹, Jing Huang¹

CMC-Computers, Materials & Continua, Vol.87, No.3, 2026, DOI:10.32604/cmc.2026.074154 - 09 April 2026

Abstract In the Internet of Vehicles (IoV) environment, the growing demand for computational resources from diverse vehicular applications often exceeds the capabilities of intelligent connected vehicles. Traditional approaches, which rely on one or more computational resources within the cloud-edge-device computing model, struggle to ensure overall service quality when handling high-density traffic flows and large-scale tasks. To address this issue, we propose a computational offloading scheme based on a cloud-edge-device collaborative 6G IoV edge computing model, namely, Multi-Agent Deep Reinforcement Learning-based and Server-weighted scoring Selection (MADRLSS), which aims to optimize dynamic offloading decisions and resource allocation. The… More >

Mohammed Abdullah Alsuwaiket^*

CMES-Computer Modeling in Engineering & Sciences, Vol.146, No.3, 2026, DOI:10.32604/cmes.2026.078169 - 30 March 2026

Abstract The healthcare field is fraught with challenges associated with severe class imbalance, wherein such critical conditions like sepsis, cardiac arrest, and drug adverse reactions are rare but have dire clinical consequences. This paper presents a new framework, Deep Reinforcement Adaptive Gradient Optimization Network to Mining Rare Events (DRAGON-MINE), to demonstrate how deep reinforcement learning can be used synergistically with adaptive gradient optimization and address the inherent weaknesses of current methods in the prediction of rare health events. The suggested architecture uses a dual-pathway consisting of a reinforcement learning agent to dynamically reweigh samples and an… More >

Ho Hai Quan^1,2, Le Huu Binh^1,*, Nguyen Dinh Hoa Cuong³, Le Duc Huy⁴

CMC-Computers, Materials & Continua, Vol.87, No.2, 2026, DOI:10.32604/cmc.2026.075549 - 12 March 2026

Abstract Wireless Sensor Networks (WSNs) play a crucial role in numerous Internet of Things (IoT) applications and next-generation communication systems, yet they continue to face challenges in balancing energy efficiency and reliable connectivity. This study proposes SAC-HTC (Soft Actor-Critic-based High-performance Topology Control), a deep reinforcement learning (DRL) method based on the Actor-Critic framework, implemented within a Software Defined Wireless Sensor Network (SDWSN) architecture. In this approach, sensor nodes periodically transmit state information, including coordinates, node degree, transmission power, and neighbor lists, to a centralized controller. The controller acts as the reinforcement learning (RL) agent, with the… More >

Chenglong Lu¹, Jiehui Li¹, Tonglin Chen^1,2,*, Changhua Zhou¹, Yixin Fan¹, Xinlin Ren¹, Ziyi Ju¹, Wei Wang¹

CMC-Computers, Materials & Continua, Vol.87, No.2, 2026, DOI:10.32604/cmc.2026.075400 - 12 March 2026

Abstract Existing methods for tracing water pollution sources typically integrate three-dimensional excitation-emission matrix (3D-EEM) fluorescence spectroscopy with similarity-based matching algorithms. However, these approaches exhibit high error rates in borderline cases and necessitate expert manual review, which limits scalability and introduces inconsistencies between algorithmic outputs and expert judgment. To address these limitations, we propose a large vision-language model (VLM) designed as an “expert agent” to automatically refine similarity scores, ensuring alignment with expert decisions and overcoming key application bottlenecks. The model consists of two core components: (1) rule-based similarity calculation module generate initial spectral similarity scores, and More >

Ahmad Salehiyan¹, Nuria Serrano², Francisco Hernando-Gallego³, Diego Martín^2,*, José Vicente Álvarez-Bravo²

CMC-Computers, Materials & Continua, Vol.87, No.2, 2026, DOI:10.32604/cmc.2026.075336 - 12 March 2026

Abstract The increasing integration of cyber-physical components in Industry 4.0 water infrastructures has heightened the risk of false data injection (FDI) attacks, posing critical threats to operational integrity, resource management, and public safety. Traditional detection mechanisms often struggle to generalize across heterogeneous environments or adapt to sophisticated, stealthy threats. To address these challenges, we propose a novel evolutionary optimized transformer-based deep reinforcement learning framework (Evo-Transformer-DRL) designed for robust and adaptive FDI detection in smart water infrastructures. The proposed architecture integrates three powerful paradigms: a transformer encoder for modeling complex temporal dependencies in multivariate time series, a… More >