A Spiking Reinforcement Trajectory Planning for UAV-Assisted MEC Systems

• Published in: IEEE access Vol. 12; pp. 54452 - 54465
• Main Authors: Xia, Zeyang, Dong, Li, Jiang, Feibo
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Approximation algorithms; Autonomous aerial vehicles; Back propagation networks; Convergence; Deep learning; deep reinforcement learning; Edge computing; Energy consumption; Mixed integer; Mobile computing; Mobile edge computing; Multi-access edge computing; Neural networks; Nonlinear programming; Optimization; Resource allocation; Spiking; spiking neural network; Task analysis; Training; Trajectory; Trajectory planning; unmanned aerial vehicle; Unmanned aerial vehicles
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2024.3389288

This study aims to minimize the energy consumption of user equipments (UE) and unmanned aerial vehicles (UAV) in UAV-assisted mobile edge computing (MEC) systems through the optimization of UAV flight trajectories, user associations, and resource allocations. The problem is formally articulated as a mixed integer nonlinear programming (MINLP) problem. However, employing deep reinforcement learning (DRL) to address this challenge introduces computational complexity and convergence obstacles. In response to these challenges, we propose an efficient and robust approach known as spiking reinforcement trajectory planning (SRTP), which uniquely integrates spiking neural networks (SNN) with DRL. SRTP utilizes a Poisson encoding mechanism to seamlessly convert between spike and continuous signals, enabling collaborative learning between spike actor networks and deep critic networks. Additionally, a pseudo-spacetime backpropagation method is employed for accelerated training of the spike actor network. Experimental findings distinctly highlight SRTP's advantages, demonstrating a more streamlined network structure and faster convergence compared to conventional methodologies. This innovative methodology holds promise in addressing the computational complexities and convergence challenges associated with implementing DRL in UAV-assisted MEC systems.