Data processing method, device and equipment based on HBase data table and storage medium

• Main Authors: XU JILAI, LUO XIAOFENG, LIN FAQUAN, JIANG FAN, ZHANG YANTANG
• Format: Patent
• Language: Chinese; English
• Published: 06.01.2023
• Subjects: CALCULATING; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

The invention discloses a data processing method and device based on an HBase data table, equipment and a storage medium, and relates to the technical field of big data processing. Comprising the steps of obtaining the number of pre-partitions of an HBase data table according to space occupation information of the relational data table; counting the distribution frequency of at least one candidate character of the data field in the relational data table, and performing hash mapping on the candidate character to obtain a hash value of the candidate character; wherein the candidate characters are non-ASCII code characters; constructing a pre-partition mapping table according to at least one candidate character in the relational data table and the distribution frequency and the hash value of the candidate character; according to the number of partitions, the pre-partition mapping table and the distribution frequency of at least one candidate character in the relational data table, determining partition intervals