A survey on the evolution of stream processing systems

Stream processing has been an active research field for more than 20 years, but it is now witnessing its prime time due to recent successful efforts by the research community and numerous worldwide open-source communities. This survey provides a comprehensive overview of fundamental aspects of strea...

Full description

Saved in:
Bibliographic Details
Published inThe VLDB journal Vol. 33; no. 2; pp. 507 - 541
Main Authors Fragkoulis, Marios, Carbone, Paris, Kalavri, Vasiliki, Katsifodimos, Asterios
Format Journal Article
LanguageEnglish
Published Berlin/Heidelberg Springer Berlin Heidelberg 2024
Springer Nature B.V
Subjects
Computer Science
Data management
Database Management
Evolution
Fault tolerance
Reconfiguration
Regular Paper
Cloud applications
Stream processing
Fault-tolerance
Streaming analytics
Out of order
Functional areas
Research communities
Stream processing systems
Streaming analytic
Open source communities
Research fields
Information management
Prime time
Electric loads
Fault tolerance
Online AccessGet full text

Cover

More Information
Summary:Stream processing has been an active research field for more than 20 years, but it is now witnessing its prime time due to recent successful efforts by the research community and numerous worldwide open-source communities. This survey provides a comprehensive overview of fundamental aspects of stream processing systems and their evolution in the functional areas of out-of-order data management, state management, fault tolerance, high availability, load management, elasticity, and reconfiguration. We review noteworthy past research findings, outline the similarities and differences between the first  (’00–’10) and second  (’11–’23) generation of stream processing systems, and discuss future trends and open problems.
ISSN:1066-8888
0949-877X
0949-877X
DOI:10.1007/s00778-023-00819-8