Home / Advanced Search

  • Title/Keywords

  • Author/Affliations

  • Journal

  • Article Type

  • Start Year

  • End Year

Update SearchingClear
  • Articles
  • Online
Search Results (236)
  • Open Access

    ARTICLE

    Dynamic Decoupling-Driven Cooperative Pursuit for Multi-UAV Systems: A Multi-Agent Reinforcement Learning Policy Optimization Approach

    Lei Lei1, Chengfu Wu2,*, Huaimin Chen2

    CMC-Computers, Materials & Continua, Vol.85, No.1, pp. 1339-1363, 2025, DOI:10.32604/cmc.2025.067117 - 29 August 2025

    Abstract This paper proposes a Multi-Agent Attention Proximal Policy Optimization (MA2PPO) algorithm aiming at the problems such as credit assignment, low collaboration efficiency and weak strategy generalization ability existing in the cooperative pursuit tasks of multiple unmanned aerial vehicles (UAVs). Traditional algorithms often fail to effectively identify critical cooperative relationships in such tasks, leading to low capture efficiency and a significant decline in performance when the scale expands. To tackle these issues, based on the proximal policy optimization (PPO) algorithm, MA2PPO adopts the centralized training with decentralized execution (CTDE) framework and introduces a dynamic decoupling mechanism,… More >

  • Open Access

    ARTICLE

    Utility-Driven Edge Caching Optimization with Deep Reinforcement Learning under Uncertain Content Popularity

    Mingoo Kwon, Kyeongmin Kim, Minseok Song*

    CMC-Computers, Materials & Continua, Vol.85, No.1, pp. 519-537, 2025, DOI:10.32604/cmc.2025.066754 - 29 August 2025

    Abstract Efficient edge caching is essential for maximizing utility in video streaming systems, especially under constraints such as limited storage capacity and dynamically fluctuating content popularity. Utility, defined as the benefit obtained per unit of cache bandwidth usage, degrades when static or greedy caching strategies fail to adapt to changing demand patterns. To address this, we propose a deep reinforcement learning (DRL)-based caching framework built upon the proximal policy optimization (PPO) algorithm. Our approach formulates edge caching as a sequential decision-making problem and introduces a reward model that balances cache hit performance and utility by prioritizing More >

  • Open Access

    ARTICLE

    Optimization of Comprehensive Performance of Polylactic Acid by Chitosan Blend Modification

    Tingqiang Yan, Xiaodong Wang*, Yingjie Qiao*

    Journal of Renewable Materials, Vol.13, No.8, pp. 1587-1604, 2025, DOI:10.32604/jrm.2025.02025-0075 - 22 August 2025

    Abstract Polylactic acid (PLA), a biodegradable polymer, exhibits superior mechanical strength and processability. However, its broader adoption is hindered by inherent brittleness, low hydrophilicity, and sluggish crystallization kinetics. Chitosan (CS), a natural polysaccharide renowned for its biocompatibility and biodegradability, offers potential to address these limitations. While both materials have garnered significant attention in materials science, research on their integration via melt blending and the resulting performance enhancements for food-contact plastics remains understudied. This research comprehensively explores how different levels of CS content, from 0% to 10%, impact the characteristics of chitosan/polylactic acid (CS/PLA) composites. It specifically… More >

  • Open Access

    ARTICLE

    An IoT-Enabled Hybrid DRL-XAI Framework for Transparent Urban Water Management

    Qamar H. Naith1,*, H. Mancy2,3

    CMES-Computer Modeling in Engineering & Sciences, Vol.144, No.1, pp. 387-405, 2025, DOI:10.32604/cmes.2025.066917 - 31 July 2025

    Abstract Effective water distribution and transparency are threatened with being outrightly undermined unless the good name of urban infrastructure is maintained. With improved control systems in place to check leakage, variability of pressure, and conscientiousness of energy, issues that previously went unnoticed are now becoming recognized. This paper presents a grandiose hybrid framework that combines Multi-Agent Deep Reinforcement Learning (MADRL) with Shapley Additive Explanations (SHAP)-based Explainable AI (XAI) for adaptive and interpretable water resource management. In the methodology, the agents perform decentralized learning of the control policies for the pumps and valves based on the real-time… More >

  • Open Access

    ARTICLE

    A Deep Reinforcement Learning with Gumbel Distribution Approach for Contention Window Optimization in IEEE 802.11 Networks

    Yi-Hao Tu, Yi-Wei Ma*

    CMC-Computers, Materials & Continua, Vol.84, No.3, pp. 4563-4582, 2025, DOI:10.32604/cmc.2025.066899 - 30 July 2025

    Abstract This study introduces the Smart Exponential-Threshold-Linear with Double Deep Q-learning Network (SETL-DDQN) and an extended Gumbel distribution method, designed to optimize the Contention Window (CW) in IEEE 802.11 networks. Unlike conventional Deep Reinforcement Learning (DRL)-based approaches for CW size adjustment, which often suffer from overestimation bias and limited exploration diversity, leading to suboptimal throughput and collision performance. Our framework integrates the Gumbel distribution and extreme value theory to systematically enhance action selection under varying network conditions. First, SETL adopts a DDQN architecture (SETL-DDQN) to improve Q-value estimation accuracy and enhance training stability. Second, we incorporate a… More >

  • Open Access

    ARTICLE

    Slice-Based 6G Network with Enhanced Manta Ray Deep Reinforcement Learning-Driven Proactive and Robust Resource Management

    Venkata Satya Suresh kumar Kondeti1, Raghavendra Kulkarni1, Binu Sudhakaran Pillai2, Surendran Rajendran3,*

    CMC-Computers, Materials & Continua, Vol.84, No.3, pp. 4973-4995, 2025, DOI:10.32604/cmc.2025.066428 - 30 July 2025

    Abstract Next-generation 6G networks seek to provide ultra-reliable and low-latency communications, necessitating network designs that are intelligent and adaptable. Network slicing has developed as an effective option for resource separation and service-level differentiation inside virtualized infrastructures. Nonetheless, sustaining elevated Quality of Service (QoS) in dynamic, resource-limited systems poses significant hurdles. This study introduces an innovative packet-based proactive end-to-end (ETE) resource management system that facilitates network slicing with improved resilience and proactivity. To get around the drawbacks of conventional reactive systems, we develop a cost-efficient slice provisioning architecture that takes into account limits on radio, processing, and… More >

  • Open Access

    ARTICLE

    Simultaneous Depth and Heading Control for Autonomous Underwater Vehicle Docking Maneuvers Using Deep Reinforcement Learning within a Digital Twin System

    Yu-Hsien Lin*, Po-Cheng Chuang, Joyce Yi-Tzu Huang

    CMC-Computers, Materials & Continua, Vol.84, No.3, pp. 4907-4948, 2025, DOI:10.32604/cmc.2025.065995 - 30 July 2025

    Abstract This study proposes an automatic control system for Autonomous Underwater Vehicle (AUV) docking, utilizing a digital twin (DT) environment based on the HoloOcean platform, which integrates six-degree-of-freedom (6-DOF) motion equations and hydrodynamic coefficients to create a realistic simulation. Although conventional model-based and visual servoing approaches often struggle in dynamic underwater environments due to limited adaptability and extensive parameter tuning requirements, deep reinforcement learning (DRL) offers a promising alternative. In the positioning stage, the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm is employed for synchronized depth and heading control, which offers stable training, reduced overestimation… More >

  • Open Access

    ARTICLE

    Application of Various Optimisation Methods in the Multi-Optimisation for Tribological Properties of Al–B4C Composites

    Sandra Gajević1, Slavica Miladinović1, Jelena Jovanović1, Onur Güler2, Serdar Özkaya2, Blaža Stojanović1,*

    CMC-Computers, Materials & Continua, Vol.84, No.3, pp. 4341-4361, 2025, DOI:10.32604/cmc.2025.065645 - 30 July 2025

    Abstract This paper presents an investigation of the tribological performance of AA2024–B4C composites, with a specific focus on the influence of reinforcement and processing parameters. In this study three input parameters were varied: B4C weight percentage, milling time, and normal load, to evaluate their effects on two output parameters: wear loss and the coefficient of friction. AA2024 alloy was used as the matrix alloy, while B4C particles were used as reinforcement. Due to the high hardness and wear resistance of B4C, the optimized composite shows strong potential for use in aerospace structural elements and automotive brake components. The… More >

  • Open Access

    ARTICLE

    The Emergency Control Method for Multi-Scenario Sub-Synchronous Oscillation in Wind Power Grid Integration Systems Based on Transfer Learning

    Qing Zhu1, Denghui Guo1, Rui Ruan1, Zhidong Chai1, Chaoqun Wang2, Zhiwen Guan2,*

    Energy Engineering, Vol.122, No.8, pp. 3133-3154, 2025, DOI:10.32604/ee.2025.063165 - 24 July 2025

    Abstract This study presents an emergency control method for sub-synchronous oscillations in wind power grid-connected systems based on transfer learning, addressing the issue of insufficient generalization ability of traditional methods in complex real-world scenarios. By combining deep reinforcement learning with a transfer learning framework, cross-scenario knowledge transfer is achieved, significantly enhancing the adaptability of the control strategy. First, a sub-synchronous oscillation emergency control model for the wind power grid integration system is constructed under fixed scenarios based on deep reinforcement learning. A reward evaluation system based on the active power oscillation pattern of the system is… More >

  • Open Access

    REVIEW

    An Overview and Comparative Study of Traditional, Chaos-Based and Machine Learning Approaches in Pseudorandom Number Generation

    Issah Zabsonre Alhassan1,2,*, Gaddafi Abdul-Salaam1, Michael Asante1, Yaw Marfo Missah1, Alimatu Sadia Shirazu1

    Journal of Cyber Security, Vol.7, pp. 165-196, 2025, DOI:10.32604/jcs.2025.063529 - 07 July 2025

    Abstract Pseudorandom number generators (PRNGs) are foundational to modern cryptography, yet existing approaches face critical trade-offs between cryptographic security, computational efficiency, and adaptability to emerging threats. Traditional PRNGs (e.g., Mersenne Twister, LCG) remain widely used in low-security applications despite vulnerabilities to predictability attacks, while machine learning (ML)-driven and chaos-based alternatives struggle to balance statistical robustness with practical deployability. This study systematically evaluates traditional, chaos-based, and ML-driven PRNGs to identify design principles for next-generation systems capable of meeting the demands of high-security environment like blockchain and IoT. Using a framework that quantifies cryptographic robustness (via NIST SP… More >

Displaying 31-40 on page 4 of 236. Per Page