Data extraction method and device, electronic equipment and storage medium

• Main Authors: QIU WEIYUAN, ZHANG DAPENG, YANG BO, QIN YIWEN, CHEN PENG, JIANG ZHANGPENG, AO YUGANG, LIU XINCHAO
• Format: Patent
• Language: Chinese; English
• Published: 09.05.2023
• Subjects: CALCULATING; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

The invention discloses a data extraction method to solve the problem that when data of an SAP system production library is extracted and synchronized through an ETL technology, the data extraction efficiency is low. The method comprises the steps of predicting extraction duration of each piece of sub-data in to-be-extracted data; according to the extraction duration of each piece of sub-data and the historical average extraction duration, performing data splitting and/or data merging processing on each piece of sub-data to obtain each piece of target sub-data with balanced extraction duration; wherein each piece of target sub-data meets the condition that the difference between the balanced extraction durations of different pieces of target sub-data is smaller than or equal to a preset duration difference threshold value; and according to a calling mode of calling different data extraction servers to extract the same quantity of target sub-data, respectively calling the data extraction servers to synchronous