Vehicular Network Edge Intelligent Management : A Deep Deterministic Policy Gradient Approach for Service Offloading Decision

• Published in: 2020 International Wireless Communications and Mobile Computing (IWCMC) pp. 905 - 910
• Main Authors: Ren, Yinlin, Yu, Xiuming, Chen, Xingyu, Guo, Shaoyong, Xue-Song, Qiu
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.06.2020
• Subjects: Computational modeling; Computer architecture; Deep Deterministic Policy Gradient (DDPG); Delays; Edge computing; Resource management; SDN; service offloading decision model; Task analysis; Vehicular ad hoc networks; vehicular edge computing (VEC)
• ISSN: 2376-6506
• DOI: 10.1109/IWCMC48107.2020.9148507

The development of edge computing has alleviated the problem of limited vehicular computing capabilities in VANET. The vehicular edge computing (VEC) provide resources for the implementation of multiple intelligent services. However, the mobility of vehicles and the diversity of edge computing nodes pose huge challenges for service offloading. Deep reinforcement learning (DRL) in artificial intelligence (AI) is an effective technology to solve such challenges. Based on this scenario, we first introduce a software-defined vehicular networks (SDV) architecture that takes full advantage of the characteristics of SDN technology and can effectively and dynamically obtain a global view in VANET to facilitate the management of resources in the network. Then, we propose a new intelligent service offloading decision model, which introduces the Deep Deterministic Policy Gradient (DDPG) algorithm in DRL to solve the joint optimization of service offloading with multiple constraints. Simulation results show that the DDPG-based service offloading model has better performance and better stability than similar algorithms.