Ehab Mahmoud Mohamed^{1, 2, *}, Sherief Hashima^{3, 4}, Kohei Hatano^{3, 5}, Hani Kasban⁴, Mohamed Rihan⁶

CMC-Computers, Materials & Continua, Vol.65, No.3, pp. 1987-2007, 2020, DOI:10.32604/cmc.2020.011816

Abstract The communication in the Millimeter-wave (mmWave) band, i.e., 30~300 GHz, is characterized by short-range transmissions and the use of antenna beamforming (BF). Thus, multiple mmWave access points (APs) should be installed to fully cover a target environment with gigabits per second (Gbps) connectivity. However, inter-beam interference prevents maximizing the sum rates of the established concurrent links. In this paper, a reinforcement learning (RL) approach is proposed for enabling mmWave concurrent transmissions by finding out beam directions that maximize the long-term average sum rates of the concurrent links. Specifically, the problem is formulated as a multiplayer multiarmed bandit (MAB), where mmWave… More >

Li Li^1,*, Yifei Wei¹, Lianping Zhang², Xiaojun Wang³

Journal of Cyber Security, Vol.2, No.3, pp. 141-150, 2020, DOI:10.32604/jcs.2020.010764

Abstract The rapid growth of Internet content, applications and services require more computing and storage capacity and higher bandwidth. Traditionally, internet services are provided from the cloud (i.e., from far away) and consumed on increasingly smart devices. Edge computing and caching provides these services from nearby smart devices. Blending both approaches should combine the power of cloud services and the responsiveness of edge networks. This paper investigates how to intelligently use the caching and computing capabilities of edge nodes/cloudlets through the use of artificial intelligence-based policies. We first analyze the scenarios of mobile edge networks with edge computing and caching abilities,… More >

Wanxin Zhang^1,*, Jihong Zhu²

CMES-Computer Modeling in Engineering & Sciences, Vol.124, No.3, pp. 1119-1130, 2020, DOI:10.32604/cmes.2020.010986

Abstract With the increasing demand for the automation of operations and processes in mechatronic systems, fault detection and diagnosis has become a major topic to guarantee the process performance. There exist numerous studies on the topic of applying artificial intelligence methods for fault detection and diagnosis. However, much of the focus has been given on the detection of faults. In terms of the diagnosis of faults, on one hand, assumptions are required, which restricts the diagnosis range. On the other hand, different faults with similar symptoms cannot be distinguished, especially when the model is not trained by plenty of data. In… More >

Jia‐Shing Sheu^a, I‐Chen Chen^b, Yi‐Syong Liao^a

Intelligent Automation & Soft Computing, Vol.25, No.2, pp. 395-404, 2019, DOI:10.31209/2019.100000101

Abstract This study proposed a household energy state monitoring system (HESMS) and a household energy load monitoring system (HELMS) for monitoring smart appliances. The HESMS applies reinforcement learning to receive changes in the external environment and the state of an electrical appliance, determines if the electrical appliance should be turned on, and controls the signals sent to the HELMS according to these decisions. The HELMS implements an ON/OFF control mechanism for household appliances according to the control signals and the power consumption state. The proposed systems are based on the wireless communication network and can monitor household appliances’ energy usage, control… More >

Yonghong Xie^{1, 3}, Liangyuan Hu^{1, 3}, Xingxing Chen^{2, 3}, Jim Feng⁴, Dezheng Zhang^{1, 3, *}

CMC-Computers, Materials & Continua, Vol.65, No.1, pp. 481-494, 2020, DOI:10.32604/cmc.2020.010297

Abstract As one of the most valuable assets in China, traditional medicine has a long history and contains pieces of knowledge. The diagnosis and treatment of Traditional Chinese Medicine (TCM) has benefited from the natural language processing technology. This paper proposes a knowledge-based syndrome reasoning method in computerassisted diagnosis. This method is based on the established knowledge graph of TCM and this paper introduces the reinforcement learning algorithm to mine the hidden relationship among the entities and obtain the reasoning path. According to this reasoning path, we could infer the path from the symptoms to the syndrome and get all possibilities… More >

Xinyue Lin¹, Jin Liu^{1, *}, Jianming Zhang², Se-Jung Lim³

CMC-Computers, Materials & Continua, Vol.65, No.1, pp. 387-404, 2020, DOI:10.32604/cmc.2020.010984

Abstract Neural Machine Translation (NMT) is an end-to-end learning approach for automated translation, overcoming the weaknesses of conventional phrase-based translation systems. Although NMT based systems have gained their popularity in commercial translation applications, there is still plenty of room for improvement. Being the most popular search algorithm in NMT, beam search is vital to the translation result. However, traditional beam search can produce duplicate or missing translation due to its target sequence selection strategy. Aiming to alleviate this problem, this paper proposed neural machine translation improvements based on a novel beam search evaluation function. And we use reinforcement learning to train… More >

Wei Fang^{1, 2, 3, ∗}, Lin Pang¹, Weinan Yi¹

Journal on Artificial Intelligence, Vol.2, No.1, pp. 39-58, 2020, DOI:10.32604/jai.2020.09789

Abstract In recent years, with the rapid development of human society, more and more complex tasks have emerged that require deep learning to automatically extract abstract feature representations from a large amount of data, and use reinforcement learning to learn the best strategy to complete the task. Through the combination of deep learning and reinforcement learning, end-to-end input and output can be achieved, and substantial breakthroughs have been made in many planning and decision-making systems with infinite states, such as games, in particular, AlphaGo, robotics, natural language processing, dialogue systems, machine translation, and computer vision. In this paper we have summarized… More >

Hanzhong Zheng¹, Dejie Shi^2,*

Journal of Cyber Security, Vol.2, No.2, pp. 85-96, 2020, DOI:10.32604/jcs.2020.010086

Abstract Distributed wireless sensor networks have been shown to be effective for environmental monitoring tasks, in which multiple sensors are deployed in a wide range of the environments to collect information or monitor a particular event, Wireless sensor networks, consisting of a large number of interacting sensors, have been successful in a variety of applications where they are able to share information using different transmission protocols through the communication network. However, the irregular and dynamic environment requires traditional wireless sensor networks to have frequent communications to exchange the most recent information, which can easily generate high communication cost through the collaborative… More >

Ningcheng Yuan¹, Chao Jia^{2, *}, Jizhao Lu³, Shaoyong Guo¹, Wencui Li³, Xuesong Qiu¹, Lei Shi⁴

CMC-Computers, Materials & Continua, Vol.64, No.3, pp. 1657-1671, 2020, DOI:10.32604/cmc.2020.09840

Abstract Container is an emerging virtualization technology and widely adopted in the cloud to provide services because of its lightweight, flexible, isolated and highly portable properties. Cloud services are often instantiated as clusters of interconnected containers. Due to the stochastic service arrival and complicated cloud environment, it is challenging to achieve an optimal container placement (CP) scheme. We propose to leverage Deep Reinforcement Learning (DRL) for solving CP problem, which is able to learn from experience interacting with the environment and does not rely on mathematical model or prior knowledge. However, applying DRL method directly dose not lead to a satisfying… More >

Xing Deng^{1, 2}, Haijian Shao^{1, *}, Chunlong Hu¹, Dengbiao Jiang¹, Yingtao Jiang³

CMES-Computer Modeling in Engineering & Sciences, Vol.122, No.1, pp. 273-301, 2020, DOI:10.32604/cmes.2020.08768

Abstract Accurate wind power forecasting in wind farm can effectively reduce the enormous impact on grid operation safety when high permeability intermittent power supply is connected to the power grid. Aiming to provide reference strategies for relevant researchers as well as practical applications, this paper attempts to provide the literature investigation and methods analysis of deep learning, enforcement learning and transfer learning in wind speed and wind power forecasting modeling. Usually, wind speed and wind power forecasting around a wind farm requires the calculation of the next moment of the definite state, which is usually achieved based on the state of… More >