GeoMapViz: a framework for distributed management and geospatial data visualization based on massive spatiotemporal data streams

• Published in: IOP conference series. Earth and environmental science Vol. 1004; no. 1; pp. 12017 - 12037
• Main Authors: Xu, Qi, Xiang, Longgang, Wang, Haocheng, Guan, Xuefeng, Wu, Huayi
• Format: Journal Article
• Language: English
• Published: Bristol IOP Publishing 01.03.2022
• Subjects: Big Data; Computer networks; Construction; Data transmission; data visualization; Datasets; Distributed processing; distributed storage and index; Flow mapping; Information flow; Pyramids; Scientific visualization; Spatial data; Spatiotemporal data; spatiotemporal query; Technical services; thermal map; Thermal mapping; tile pyramid; Visualization
• ISSN: 1755-1307; 1755-1315
• DOI: 10.1088/1755-1315/1004/1/012017

Abstract Spatiotemporal big data have multisource, heterogeneous, high-dimensional and spatiotemporal associations. Due to the limited computing and network resources, while the spatiotemporal data to be rendered are large and dynamic, efficient visual analysis has always been a popular topic and has had difficulty in the research of spatiotemporal big data. As one of the important means of big data visualization, thermal maps play an important role in expressing data flow, information flow, and trajectory flow. At the same time, the development of a distributed computing framework also provides technical support for the online calculation and visualization of spatiotemporal data streams. In response to the above problems, this paper designs and implements GeoMapViz, a distributed management based on massive spatiotemporal data streams and a multiscale geographic spatial visualization framework, which is oriented by the expression of thermal maps of massive point datasets. First, based on the concept of the tile pyramid model and spatiotemporal cube, we propose a thermal map sequential tile pyramid (TS_Tile) model, which realizes scalable storage and efficient retrieval of data flow. GeoMapViz adopts a high-performance Flink stream computing cluster to implement the large-scale parallel construction of hierarchical tile pyramids, implements distributed storage and index construction of data based on HBase and Geomesa, and uses Geoserver to manage the map service to provide a spatiotemporal range query interface. Finally, through using an open dataset as a system simulation test, the results show that the TS_Tile model can effectively organize large-scale, time-space and multidimensional thermal map data, and the query and visualization of the heatmap can reach a subsecond response. Furthermore, GeoMapViz supports the integration of the thermal map and original flow and provides a feasible solution for the visual analysis of large-scale spatiotemporal data.