K. M. Ameen Suhail¹, Syam Sankar¹, Ashok S. Kumar², Tsafack Nestor³, Naglaa F. Soliman^4,*, Abeer D. Algarni⁴, Walid El-Shafai⁵, Fathi E. Abd El-Samie^4,5

CMC-Computers, Materials & Continua, Vol.70, No.1, pp. 935-950, 2022, DOI:10.32604/cmc.2022.017069

Abstract Stock market is a place, where shares of different companies are traded. It is a collection of buyers’ and sellers’ stocks. In this digital era, analysis and prediction in the stock market have gained an essential role in shaping today's economy. Stock market analysis can be either fundamental or technical. Technical analysis can be performed either with technical indicators or through machine learning techniques. In this paper, we report a system that uses a Reinforcement Learning (RL) network and market sentiments to make decisions about stock market trading. The system uses sentiment analysis on daily market news to spot trends… More >

Daniel Godfrey¹, Beom-Su Kim¹, Haoran Miao¹, Babar Shah², Bashir Hayat³, Imran Khan⁴, Tae-Eung Sung⁵, Ki-Il Kim^1,*

CMC-Computers, Materials & Continua, Vol.68, No.3, pp. 3671-3692, 2021, DOI:10.32604/cmc.2021.017475

Abstract The end-to-end delay in a wired network is strongly dependent on congestion on intermediate nodes. Among lots of feasible approaches to avoid congestion efficiently, congestion-aware routing protocols tend to search for an uncongested path toward the destination through rule-based approaches in reactive/incident-driven and distributed methods. However, these previous approaches have a problem accommodating the changing network environments in autonomous and self-adaptive operations dynamically. To overcome this drawback, we present a new congestion-aware routing protocol based on a Q-learning algorithm in software-defined networks where logically centralized network operation enables intelligent control and management of network resources. In a proposed routing protocol,… More >

Jawad Tanveer¹, Amir Haider², Rashid Ali², Ajung Kim^1,*

CMC-Computers, Materials & Continua, Vol.68, No.3, pp. 3807-3823, 2021, DOI:10.32604/cmc.2021.016087

Abstract Drone applications in 5th generation (5G) networks mainly focus on services and use cases such as providing connectivity during crowded events, human-instigated disasters, unmanned aerial vehicle traffic management, internet of things in the sky, and situation awareness. 4G and 5G cellular networks face various challenges to ensure dynamic control and safe mobility of the drone when it is tasked with delivering these services. The drone can fly in three-dimensional space. The drone connectivity can suffer from increased handover cost due to several reasons, including variations in the received signal strength indicator, co-channel interference offered to the drone by neighboring cells,… More >

Johnson Kinyua¹, Lawrence Awuah^2,*

Intelligent Automation & Soft Computing, Vol.28, No.2, pp. 527-545, 2021, DOI:10.32604/iasc.2021.016240

Abstract Today’s cyber defense capabilities in many organizations consist of a diversity of tools, products, and solutions, which are very challenging for Security Operations Centre (SOC) teams to manage in current advanced and dynamic cyber threat environments. Security researchers and industry practitioners have proposed security orchestration, automation, and response (SOAR) solutions designed to integrate and automate the disparate security tasks, processes, and applications in response to security incidents to empower SOC teams. The next big step for cyber threat detection, mitigation, and prevention efforts is to leverage AI/ML in SOAR solutions. AI/ML will act as a force multiplier empowering SOC analysts… More >

Chunli Yin^1,*, Jinglong Han²

CMES-Computer Modeling in Engineering & Sciences, Vol.127, No.1, pp. 291-307, 2021, DOI:10.32604/cmes.2021.014347

Abstract With the continuous development of artificial intelligence technology, its application field has gradually expanded. To further apply the deep reinforcement learning technology to the field of dynamic pricing, we build an intelligent dynamic pricing system, introduce the reinforcement learning technology related to dynamic pricing, and introduce existing research on the number of suppliers (single supplier and multiple suppliers), environmental models, and selection algorithms. A two-period dynamic pricing game model is designed to assess the optimal pricing strategy for e-commerce platforms under two market conditions and two consumer participation conditions. The first step is to analyze the pricing strategies of e-commerce… More >

Jiongzhi Yang, Srivatsa Harish, Candy Li, Hengduo Zhao, Brittney Antous, Pinar Acar^*

CMC-Computers, Materials & Continua, Vol.68, No.1, pp. 1285-1302, 2021, DOI:10.32604/cmc.2021.016829

Abstract This paper presents a de-novo computational design method driven by deep reinforcement learning to achieve reliable predictions and optimum properties for periodic microstructures. With recent developments in 3-D printing, microstructures can have complex geometries and material phases fabricated to achieve targeted mechanical performance. These material property enhancements are promising in improving the mechanical, thermal, and dynamic performance in multiple engineering systems, ranging from energy harvesting applications to spacecraft components. The study investigates a novel and efficient computational framework that integrates deep reinforcement learning algorithms into finite element-based material simulations to quantitatively model and design 3-D printed periodic microstructures. These algorithms… More >

Yingya Guo^1,2,3,7, Kai Huang¹, Cheng Hu^4,*, Jiangyuan Yao⁵, Siyu Zhou⁶

CMC-Computers, Materials & Continua, Vol.68, No.1, pp. 655-670, 2021, DOI:10.32604/cmc.2021.016364

Abstract The emergence of Segment Routing (SR) provides a novel routing paradigm that uses a routing technique called source packet routing. In SR architecture, the paths that the packets choose to route on are indicated at the ingress router. Compared with shortest-path-based routing in traditional distributed routing protocols, SR can realize a flexible routing by implementing an arbitrary flow splitting at the ingress router. Despite the advantages of SR, it may be difficult to update the existing IP network to a full SR deployed network, for economical and technical reasons. Updating partial of the traditional IP network to the SR network,… More >

Arslan Musaddiq¹, Rashid Ali², Jin-Ghoo Choi¹, Byung-Seo Kim^3,*, Sung-Won Kim¹

CMC-Computers, Materials & Continua, Vol.67, No.1, pp. 799-814, 2021, DOI:10.32604/cmc.2021.014751

Abstract The Internet of Things (IoT) has numerous applications in every domain, e.g., smart cities to provide intelligent services to sustainable cities. The next-generation of IoT networks is expected to be densely deployed in a resource-constrained and lossy environment. The densely deployed nodes producing radically heterogeneous traffic pattern causes congestion and collision in the network. At the medium access control (MAC) layer, mitigating channel collision is still one of the main challenges of future IoT networks. Similarly, the standardized network layer uses a ranking mechanism based on hop-counts and expected transmission counts (ETX), which often does not adapt to the dynamic… More >

Janyl Jumadinova¹, Oliver Bonham-Carter¹, Hanzhong Zheng^1,2,*, Michael Camara¹, Dejie Shi³

Journal on Big Data, Vol.2, No.4, pp. 145-155, 2020, DOI:10.32604/jbd.2020.010090

Abstract Text mining has emerged as an effective method of handling and extracting useful information from the exponentially growing biomedical literature and biomedical databases. We developed a novel biomedical text mining model implemented by a multi-agent system and distributed computing mechanism. Our distributed system, TextMed, comprises of several software agents, where each agent uses a reinforcement learning method to update the sentiment of relevant text from a particular set of research articles related to specific keywords. TextMed can also operate on different physical machines to expedite its knowledge extraction by utilizing a clustering technique. We collected the biomedical textual data from… More >

Xuting Duan^1,2, Yuanhao Zhao^1,2, Kunxian Zheng^1,2,*, Daxin Tian^1,2, Jianshan Zhou^1,2,3, Jian Gao⁴

CMC-Computers, Materials & Continua, Vol.66, No.2, pp. 2127-2140, 2021, DOI:10.32604/cmc.2020.014484

Abstract Dynamic channel assignment (DCA) is significant for extending vehicular ad hoc network (VANET) capacity and mitigating congestion. However, the un-known global state information and the lack of centralized control make channel assignment performances a challenging task in a distributed vehicular direct communication scenario. In our preliminary field test for communication under V2X scenario, we find that the existing DCA technology cannot fully meet the communication performance requirements of VANET. In order to improve the communication performance, we firstly demonstrate the feasibility and potential of reinforcement learning (RL) method in joint channel selection decision and access fallback adaptation design in this… More >