Han Li¹, Tianding Chen^{2, *}, Hualiang Teng³, Yingtao Jiang⁴

CMES-Computer Modeling in Engineering & Sciences, Vol.118, No.2, pp. 253-274, 2019, DOI:10.31614/cmes.2019.05807

Abstract In any classical value-based reinforcement learning method, an agent, despite of its continuous interactions with the environment, is yet unable to quickly generate a complete and independent description of the entire environment, leaving the learning method to struggle with a difficult dilemma of choosing between the two tasks, namely exploration and exploitation. This problem becomes more pronounced when the agent has to deal with a dynamic environment, of which the configuration and/or parameters are constantly changing. In this paper, this problem is approached by first mapping a reinforcement learning scheme to a directed graph, and the set that contains all… More >

Yifei Wei^1,*, Zhaoying Wang¹, Da Guo¹, F. Richard Yu²

CMC-Computers, Materials & Continua, Vol.59, No.1, pp. 89-104, 2019, DOI:10.32604/cmc.2019.04836

Abstract To reduce the transmission latency and mitigate the backhaul burden of the centralized cloud-based network services, the mobile edge computing (MEC) has been drawing increased attention from both industry and academia recently. This paper focuses on mobile users’ computation offloading problem in wireless cellular networks with mobile edge computing for the purpose of optimizing the computation offloading decision making policy. Since wireless network states and computing requests have stochastic properties and the environment’s dynamics are unknown, we use the model-free reinforcement learning (RL) framework to formulate and tackle the computation offloading problem. Each mobile user learns through interactions with the… More >