A survey on data analysis on large-Scale wireless networks: online stream processing, trends, and challenges

• Published in: Journal of internet services and applications Vol. 11; no. 1; pp. 1 - 48
• Main Authors: Medeiros, Dianne S. V., Cunha Neto, Helio N., Lopez, Martin Andreoni, S. Magalhães, Luiz Claudio, Fernandes, Natalia C., Vieira, Alex B., Silva, Edelberto F., F. Mattos, Diogo M.
• Format: Journal Article
• Language: English
• Published: London Springer London 19.10.2020; Brazilian Computing Society (SBC)
• Subjects: Big data; Computer Applications; Computer Communication Networks; Computer Science; Computer Systems Organization and Communication Networks; Data mining; Information Systems and Communication Service; IT in Business; Processor Architectures; Stream processing; Wireless; Wireless; Stream processing; Big data; Data mining
• ISSN: 1867-4828; 1869-0238
• DOI: 10.1186/s13174-020-00127-2

In this paper we focus on knowledge extraction from large-scale wireless networks through stream processing. We present the primary methods for sampling, data collection, and monitoring of wireless networks and we characterize knowledge extraction as a machine learning problem on big data stream processing. We show the main trends in big data stream processing frameworks. Additionally, we explore the data preprocessing, feature engineering, and the machine learning algorithms applied to the scenario of wireless network analytics. We address challenges and present research projects in wireless network monitoring and stream processing. Finally, future perspectives, such as deep learning and reinforcement learning in stream processing, are anticipated.