Lightweight distributed parallel computing system and method

• Main Authors: XU GUOQIANG, ZHANG GUANGMING, YIN JINYONG, YOU CHANGJUN, XU ZHENPENG, WANG WEIQIANG
• Format: Patent
• Language: Chinese; English
• Published: 15.05.2020
• Subjects: CALCULATING; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

The invention discloses a lightweight distributed parallel computing system and a method, and the system comprises a heterogeneous computing node module which comprises a plurality of host computing nodes in mutual communication, and two computing nodes are respectively provided with a resource management module and a distributed computing program APP software module; and the system further comprises an algorithm module. The method comprises the following steps: the APP software module converts the to-be-processed data into a distributed data set; the distributed data set and the algorithm module are respectively divided; a plurality of groups of distributed sub-data sets and processing data operators are obtained, division results are deployed to a plurality of available computing nodes,each processing data operator computes the corresponding distributed sub-data set, and all the computing results are integrated through an APP software module and then a final distributed parallel computing result is output.