Lightweight distributed parallel computing system and method

The invention discloses a lightweight distributed parallel computing system and a method, and the system comprises a heterogeneous computing node module which comprises a plurality of host computing nodes in mutual communication, and two computing nodes are respectively provided with a resource mana...

Full description

Saved in:
Bibliographic Details
Main Authors XU GUOQIANG, ZHANG GUANGMING, YIN JINYONG, YOU CHANGJUN, XU ZHENPENG, WANG WEIQIANG
Format Patent
LanguageChinese
English
Published 15.05.2020
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:The invention discloses a lightweight distributed parallel computing system and a method, and the system comprises a heterogeneous computing node module which comprises a plurality of host computing nodes in mutual communication, and two computing nodes are respectively provided with a resource management module and a distributed computing program APP software module; and the system further comprises an algorithm module. The method comprises the following steps: the APP software module converts the to-be-processed data into a distributed data set; the distributed data set and the algorithm module are respectively divided; a plurality of groups of distributed sub-data sets and processing data operators are obtained, division results are deployed to a plurality of available computing nodes,each processing data operator computes the corresponding distributed sub-data set, and all the computing results are integrated through an APP software module and then a final distributed parallel computing result is output.
Bibliography:Application Number: CN201911246879