Deep Reinforcement Learning Based Resource Management for Multi-Access Edge Computing in Vehicular Networks

• Published in: IEEE transactions on network science and engineering Vol. 7; no. 4; pp. 2416 - 2428
• Main Authors: Peng, Haixia, Shen, Xuemin
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.10.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Computational modeling; DDPG; Deep learning; deep reinforcement learning; Edge computing; Mobile computing; multi-access edge computing; multi-dimensional resource management; Optimization; Problem solving; Quality of service; Radio spectrum management; Resource allocation; Resource management; Servers; Task analysis; Vehicles; Vehicular networks; Wireless fidelity
• ISSN: 2327-4697; 2334-329X
• DOI: 10.1109/TNSE.2020.2978856

In this paper, we study joint allocation of the spectrum, computing, and storing resources in a multi-access edge computing (MEC)-based vehicular network. To support different vehicular applications, we consider two typical MEC architectures and formulate multi-dimensional resource optimization problems accordingly, which are usually with high computation complexity and overlong problem-solving time. Thus, we exploit reinforcement learning (RL) to transform the two formulated problems and solve them by leveraging the deep deterministic policy gradient (DDPG) and hierarchical learning architectures. Via off-line training, the network dynamics can be automatically learned and appropriate resource allocation decisions can be rapidly obtained to satisfy the quality-of-service (QoS) requirements of vehicular applications. From simulation results, the proposed resource management schemes can achieve high delay/QoS satisfaction ratios.