Data processing system

The invention discloses a data processing system. The data processing system comprises a data collection module, a data management module, a storage and retrieval module, a real-time calculating module, a mining calculating module, a scientific research practice module, a unified API module, a data...

Full description

Saved in:
Bibliographic Details
Main Authors CAI NIAN, LIU GUANGCONG
Format Patent
LanguageChinese
English
Published 29.06.2018
Subjects
CALCULATING
COMPUTING
COUNTING
ELECTRIC DIGITAL DATA PROCESSING
PHYSICS
Online AccessGet full text

Cover

More Information
Summary:The invention discloses a data processing system. The data processing system comprises a data collection module, a data management module, a storage and retrieval module, a real-time calculating module, a mining calculating module, a scientific research practice module, a unified API module, a data safety module and an operation and maintenance module, wherein the data collection module is used for obtaining original data according to a preset data collecting mode, the data management module is used for correcting the original data to obtain target data, the storage and retrieval module is used for storing the target data in a preset integrated heterogeneous database in a distributed storage mode, and providing detecting services for the outside, the real-time calculating module is used for calculating real-time streaming data based on Spark Stream, the mining calculating module is used for calculating the target data based on a preset algorithm model, the scientific research practicemodule is used for creati
Bibliography:Application Number: CN201810004876