Home / Advanced Search

  • Title/Keywords

  • Author/Affliations

  • Journal

  • Article Type

  • Start Year

  • End Year

Update SearchingClear
  • Articles
  • Online
Search Results (83)
  • Open Access

    ARTICLE

    Deep Reinforcement Learning Empowered Edge Collaborative Caching Scheme for Internet of Vehicles

    Xin Liu1, Siya Xu1, Chao Yang2, Zhili Wang1,*, Hao Zhang3, Jingye Chi1, Qinghan Li4

    Computer Systems Science and Engineering, Vol.42, No.1, pp. 271-287, 2022, DOI:10.32604/csse.2022.022103 - 02 December 2021

    Abstract With the development of internet of vehicles, the traditional centralized content caching mode transmits content through the core network, which causes a large delay and cannot meet the demands for delay-sensitive services. To solve these problems, on basis of vehicle caching network, we propose an edge collaborative caching scheme. Road side unit (RSU) and mobile edge computing (MEC) are used to collect vehicle information, predict and cache popular content, thereby provide low-latency content delivery services. However, the storage capacity of a single RSU severely limits the edge caching performance and cannot handle intensive content requests… More >

  • Open Access

    ARTICLE

    Fleet Optimization of Smart Electric Motorcycle System Using Deep Reinforcement Learning

    Patikorn Anchuen, Peerapong Uthansakul*, Monthippa Uthansakul, Settawit Poochaya

    CMC-Computers, Materials & Continua, Vol.71, No.1, pp. 1925-1943, 2022, DOI:10.32604/cmc.2022.022444 - 03 November 2021

    Abstract Smart electric motorcycle-sharing systems based on the digital platform are one of the public transportations that we use in daily lives when the sharing economy is considered. This transportation provides convenience for users with low-cost systems while it also promotes an environmental conservation. Normally, users rent the vehicle to travel from the origin station to another station near their destination with a one-way trip in which the demand of renting and returning at each station is different. This leads to unbalanced vehicle rental systems. To avoid the full or empty inventory, the electric motorcycle-sharing rebalancing… More >

  • Open Access

    ARTICLE

    Optimal Deep Reinforcement Learning for Intrusion Detection in UAVs

    V. Praveena1, A. Vijayaraj2, P. Chinnasamy3, Ihsan Ali4,*, Roobaea Alroobaea5, Saleh Yahya Alyahyan6, Muhammad Ahsan Raza7

    CMC-Computers, Materials & Continua, Vol.70, No.2, pp. 2639-2653, 2022, DOI:10.32604/cmc.2022.020066 - 27 September 2021

    Abstract In recent years, progressive developments have been observed in recent technologies and the production cost has been continuously decreasing. In such scenario, Internet of Things (IoT) network which is comprised of a set of Unmanned Aerial Vehicles (UAV), has received more attention from civilian to military applications. But network security poses a serious challenge to UAV networks whereas the intrusion detection system (IDS) is found to be an effective process to secure the UAV networks. Classical IDSs are not adequate to handle the latest computer networks that possess maximum bandwidth and data traffic. In order… More >

  • Open Access

    ARTICLE

    A New Reward System Based on Human Demonstrations for Hard Exploration Games

    Wadhah Zeyad Tareq*, Mehmet Fatih Amasyali

    CMC-Computers, Materials & Continua, Vol.70, No.2, pp. 2401-2414, 2022, DOI:10.32604/cmc.2022.020036 - 27 September 2021

    Abstract The main idea of reinforcement learning is evaluating the chosen action depending on the current reward. According to this concept, many algorithms achieved proper performance on classic Atari 2600 games. The main challenge is when the reward is sparse or missing. Such environments are complex exploration environments like Montezuma’s Revenge, Pitfall, and Private Eye games. Approaches built to deal with such challenges were very demanding. This work introduced a different reward system that enables the simple classical algorithm to learn fast and achieve high performance in hard exploration environments. Moreover, we added some simple enhancements… More >

  • Open Access

    ARTICLE

    Blockchain-Based SQKD and IDS in Edge Enabled Smart Grid Network

    Abdullah Musaed Alkhiari1, Shailendra Mishra2,*, Mohammed AlShehri1

    CMC-Computers, Materials & Continua, Vol.70, No.2, pp. 2149-2169, 2022, DOI:10.32604/cmc.2022.019562 - 27 September 2021

    Abstract Smart Grid is a power grid that improves flexibility, reliability, and efficiency through smart meters. Due to extensive data exchange over the Internet, the smart grid faces many security challenges that have led to data loss, data compromise, and high power consumption. Moreover, the lack of hardware protection and physical attacks reduce the overall performance of the smart grid network. We proposed the BLIDSE model (Blockchain-based secure quantum key distribution and Intrusion Detection System in Edge Enables Smart Grid Network) to address these issues. The proposed model includes five phases: The first phase is blockchain-based… More >

  • Open Access

    ARTICLE

    Deep Reinforcement Learning Model for Blood Bank Vehicle Routing Multi-Objective Optimization

    Meteb M. Altaf1,*, Ahmed Samir Roshdy2, Hatoon S. AlSagri3

    CMC-Computers, Materials & Continua, Vol.70, No.2, pp. 3955-3967, 2022, DOI:10.32604/cmc.2022.019448 - 27 September 2021

    Abstract The overall healthcare system has been prioritized within development top lists worldwide. Since many national populations are aging, combined with the availability of sophisticated medical treatments, healthcare expenditures are rapidly growing. Blood banks are a major component of any healthcare system, which store and provide the blood products needed for organ transplants, emergency medical treatments, and routine surgeries. Timely delivery of blood products is vital, especially in emergency settings. Hence, blood delivery process parameters such as safety and speed have received attention in the literature, as well as other parameters such as delivery cost. In… More >

  • Open Access

    ARTICLE

    AI/ML in Security Orchestration, Automation and Response: Future Research Directions

    Johnson Kinyua1, Lawrence Awuah2,*

    Intelligent Automation & Soft Computing, Vol.28, No.2, pp. 527-545, 2021, DOI:10.32604/iasc.2021.016240 - 01 April 2021

    Abstract Today’s cyber defense capabilities in many organizations consist of a diversity of tools, products, and solutions, which are very challenging for Security Operations Centre (SOC) teams to manage in current advanced and dynamic cyber threat environments. Security researchers and industry practitioners have proposed security orchestration, automation, and response (SOAR) solutions designed to integrate and automate the disparate security tasks, processes, and applications in response to security incidents to empower SOC teams. The next big step for cyber threat detection, mitigation, and prevention efforts is to leverage AI/ML in SOAR solutions. AI/ML will act as a More >

  • Open Access

    ARTICLE

    Dynamic Pricing Model of E-Commerce Platforms Based on Deep Reinforcement Learning

    Chunli Yin1,*, Jinglong Han2

    CMES-Computer Modeling in Engineering & Sciences, Vol.127, No.1, pp. 291-307, 2021, DOI:10.32604/cmes.2021.014347 - 30 March 2021

    Abstract With the continuous development of artificial intelligence technology, its application field has gradually expanded. To further apply the deep reinforcement learning technology to the field of dynamic pricing, we build an intelligent dynamic pricing system, introduce the reinforcement learning technology related to dynamic pricing, and introduce existing research on the number of suppliers (single supplier and multiple suppliers), environmental models, and selection algorithms. A two-period dynamic pricing game model is designed to assess the optimal pricing strategy for e-commerce platforms under two market conditions and two consumer participation conditions. The first step is to analyze… More >

  • Open Access

    ARTICLE

    Deep Reinforcement Learning for Multi-Phase Microstructure Design

    Jiongzhi Yang, Srivatsa Harish, Candy Li, Hengduo Zhao, Brittney Antous, Pinar Acar*

    CMC-Computers, Materials & Continua, Vol.68, No.1, pp. 1285-1302, 2021, DOI:10.32604/cmc.2021.016829 - 22 March 2021

    Abstract This paper presents a de-novo computational design method driven by deep reinforcement learning to achieve reliable predictions and optimum properties for periodic microstructures. With recent developments in 3-D printing, microstructures can have complex geometries and material phases fabricated to achieve targeted mechanical performance. These material property enhancements are promising in improving the mechanical, thermal, and dynamic performance in multiple engineering systems, ranging from energy harvesting applications to spacecraft components. The study investigates a novel and efficient computational framework that integrates deep reinforcement learning algorithms into finite element-based material simulations to quantitatively model and design 3-D More >

  • Open Access

    ARTICLE

    Traffic Engineering in Dynamic Hybrid Segment Routing Networks

    Yingya Guo1,2,3,7, Kai Huang1, Cheng Hu4,*, Jiangyuan Yao5, Siyu Zhou6

    CMC-Computers, Materials & Continua, Vol.68, No.1, pp. 655-670, 2021, DOI:10.32604/cmc.2021.016364 - 22 March 2021

    Abstract The emergence of Segment Routing (SR) provides a novel routing paradigm that uses a routing technique called source packet routing. In SR architecture, the paths that the packets choose to route on are indicated at the ingress router. Compared with shortest-path-based routing in traditional distributed routing protocols, SR can realize a flexible routing by implementing an arbitrary flow splitting at the ingress router. Despite the advantages of SR, it may be difficult to update the existing IP network to a full SR deployed network, for economical and technical reasons. Updating partial of the traditional IP… More >

Displaying 71-80 on page 8 of 83. Per Page