StreamFitter: A Real Time Linear Regression Analysis System for Continuous Data Streams

• Published in: Database Systems for Advanced Applications pp. 458 - 461
• Main Authors: Nadungodage, Chandima Hewa, Xia, Yuni, Li, Fang, Lee, Jaehwan John, Ge, Jiaqi
• Format: Book Chapter
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2011
• Series: Lecture Notes in Computer Science
• Subjects: Data modeling; Data streams; Linear regression
• ISBN: 9783642201516; 3642201512
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-642-20152-3_39

In this demo, we present the StreamFitter system for real-time linear regression analysis on continuous data streams. In order to perform regression on data streams, it is necessary to continuously update the regression model while receiving new data. In this demo, we will present two approaches for on-line, multi-dimensional linear regression analysis of stream data, namely Incremental Mathematical Stream Regression (IMSR) and Approximate Stream Regression (ASR). These methods dynamically recompute the regression model, considering not only the data records of the current window, but also the synopsis of the previous data. Therefore, the refined parameters more accurately model the entire data stream. The demo will show that the proposed methods are not only efficient in time and space, but also generate better fitted regression functions compared to the traditional sliding window methods and well-adapted to data changes.