Multi-Agent Deep Reinforcement Learning For Distributed Handover Management In Dense MmWave Networks

• Published in: Proceedings of the ... IEEE International Conference on Acoustics, Speech and Signal Processing (1998) pp. 8976 - 8980
• Main Authors: Sana, Mohamed, De Domenico, Antonio, Strinati, Emilio Calvanese, Clemente, Antonio
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.05.2020
• Subjects: Handover; Handover Management; Limiting; Millimeter wave communication; mmWave; Multi-Agent Deep Reinforcement Learning; Reinforcement learning; Speech processing; Throughput; Wireless communication
• ISSN: 2379-190X
• DOI: 10.1109/ICASSP40776.2020.9052936

The dense deployment of millimeter wave small cells combined with directional beamforming is a promising solution to enhance the network capacity of the current generation of wireless communications. However, the reliability of millimeter wave communication links can be affected by severe pathloss, blockage, and deafness. As a result, mobile users are subject to frequent handoffs, which deteriorate the user throughput and the battery lifetime of mobile terminals. To tackle this problem, our paper proposes a deep multi-agent reinforcement learning framework for distributed handover management called RHando (Reinforced Handover). We model users as agents that learn how to perform handover to optimize the network throughput while taking into account the associated cost. The proposed solution is fully distributed, thus limiting signaling and computation overhead. Numerical results show that the proposed solution can provide higher throughput compared to conventional schemes while considerably limiting the frequency of the handovers.