Python-based data processing and analysis system and method

• Main Authors: YE XINYAO, ZHANG XIAOMING, ZHANG YUE, WANG FEI, WANG YANGONG, ZHU JIABING
• Format: Patent
• Language: Chinese; English
• Published: 10.10.2023
• Subjects: CALCULATING; COMPUTING; COUNTING; DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FORADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORYOR FORECASTING PURPOSES; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE,COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTINGPURPOSES, NOT OTHERWISE PROVIDED FOR

The invention discloses a Python-based data processing and analysis system and a Python-based data processing and analysis method, belongs to the technical field of data processing, and aims to solve the technical problem of how to provide a Python-based data processing and analysis method capable of meeting various business scenes and requirements. Comprising a data access module, a checking and updating module, a data reading module, a data processing module, a data writing module, a prediction analysis module, a log output module and a code structure module. After data cleaning, conversion and processing are conducted on the read data, the preprocessed data are written into the target table according to the data magnitude and the periodic updating characteristic of the target table. Meanwhile, based on historical data in the target table, the passenger flow volume can be predicted through an exponential smoothing algorithm, so that personnel allocation in the peak period is enhanced, and it is ensured that