ERSAP: Towards Better NP Data-Stream Analytics with Flow-Based Programming

This paper presents a framework based on a flow-based programming paradigm to design data-stream processing applications for NP. The developed framework encourages a functional decomposition of the overall data processing application into small mono-functional artifacts that are easy to understand,...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on nuclear science p. 1
Main Authors Gyurjyan, V., Abbott, D., Brei, N., Goodrich, M., Heyes, G., Jastrzembski, E., Lawrence, D., Raydo, B., Timmer, C.
Format Journal Article
LanguageEnglish
Published IEEE 03.02.2023
Subjects
Data processing
Engines
Physics
Program processors
Programming
Real-time systems
Transient analysis
Online AccessGet full text

Cover

More Information
Summary:This paper presents a framework based on a flow-based programming paradigm to design data-stream processing applications for NP. The developed framework encourages a functional decomposition of the overall data processing application into small mono-functional artifacts that are easy to understand, develop and debug. The fact that these artifacts (actors) are programmatically independent means they can be scaled and optimized independently, which is difficult for monolithic application components. One of the advantages of this approach is fault tolerance, where independent actors can come and go in the data stream without stopping or crashing the entire application. Because actors are loosely coupled, and data carries context, they can run in heterogeneous environments and utilize wide-ranging accelerators. This paper describes the main design concepts of this framework, presenting a proof-of-concept application and the results of processing on-beam calorimeter streaming data.
ISSN:0018-9499
1558-1578
DOI:10.1109/TNS.2023.3242548