Distributed messaging and light streaming system for combating pandemics A case study on spatial analysis of COVID-19 Geo-tagged Twitter dataset

Real-time data processing and distributed messaging are problems that have been worked on for a long time. As the amount of spatial data being produced has increased, coupled with increasingly complex software solutions being developed, there is a need for platforms that address these needs. In this...

Full description

Saved in:
Bibliographic Details
Published inJournal of ambient intelligence and humanized computing Vol. 14; no. 2; pp. 773 - 787
Main Authors Özgüven, Yavuz Melih, Eken, Süleyman
Format Journal Article
LanguageEnglish
Published Berlin/Heidelberg Springer Berlin Heidelberg 2023
Subjects
Artificial Intelligence
Computational Intelligence
Engineering
Original Research
Robotics and Automation
User Interfaces and Human Computer Interaction
Topic-based publish-subscribe
Translation
Geo-tagged twitter data
Apache pulsar
Spatial analysis
Name entity recognition
Skyline query
Online AccessGet full text

Cover

More Information
Summary:Real-time data processing and distributed messaging are problems that have been worked on for a long time. As the amount of spatial data being produced has increased, coupled with increasingly complex software solutions being developed, there is a need for platforms that address these needs. In this paper, we present a distributed and light streaming system for combating pandemics and give a case study on spatial analysis of the COVID-19 geo-tagged Twitter dataset. In this system, three of the major components are the translation of tweets matching with user-defined bounding boxes, name entity recognition in tweets, and skyline queries. Apache Pulsar addresses all these components in this paper. With the proposed system, end-users have the capability of getting COVID-19 related information within foreign regions, filtering/searching location, organization, person, and miscellaneous based tweets, and performing skyline based queries. The evaluation of the proposed system is done based on certain characteristics and performance metrics. The study differs greatly from other studies in terms of using distributed computing and big data technologies on spatial data to combat COVID-19. It is concluded that Pulsar is designed to handle large amounts of long-term on disk persistence.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1868-5137
1868-5145
DOI:10.1007/s12652-021-03328-0