Context-Aware Indoor VLC/RF Heterogeneous Network Selection: Reinforcement Learning With Knowledge Transfer

• Published in: IEEE access Vol. 6; pp. 33275 - 33284
• Main Authors: Du, Zhiyong, Wang, Chunxi, Sun, Youming, Wu, Guofeng
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 01.01.2018; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Context; context-awareness; Convergence; Downlink; Indoor network selection; Intelligent networks; Knowledge management; Learning (artificial intelligence); Load modeling; Local area networks; Long Term Evolution; Machine learning; Optical communication; reinforcement learning; Statistical distributions; Throughput; Time dependence; Traffic information; transfer learning; Uplink; User satisfaction; visible light communication; Wireless LAN; Wireless networks
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2018.2844882

For the converged use of LTE, WLAN, and visible light communication in indoor scenarios, fine-grained and intelligent network selection is essential for ensuring high user quality of experience. To tackle the challenges associated with dynamic environments and complicated service requirements, we propose a context-aware solution for indoor network selection. Specifically, three-level contextual information is revealed and exploited in both the utility and algorithm designs. In particular, the contextual information about the asymmetric downlink-uplink features of network performance is used to design a fine-grained utility model. A context-aware learning algorithm sensitive to traffic type-location-time information is proposed. The time-location dependent periodic changing rule of load statistical distributions is further used to realize efficient online network selection via knowledge transfer. The simulation results show that the proposed algorithm can achieve much better performance with faster convergence speed than traditional reinforcement learning.