Lightweight distributed parallel computing system and method
The invention discloses a lightweight distributed parallel computing system and a method, and the system comprises a heterogeneous computing node module which comprises a plurality of host computing nodes in mutual communication, and two computing nodes are respectively provided with a resource mana...
Saved in:
Main Authors | , , , , , |
---|---|
Format | Patent |
Language | Chinese English |
Published |
15.05.2020
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | The invention discloses a lightweight distributed parallel computing system and a method, and the system comprises a heterogeneous computing node module which comprises a plurality of host computing nodes in mutual communication, and two computing nodes are respectively provided with a resource management module and a distributed computing program APP software module; and the system further comprises an algorithm module. The method comprises the following steps: the APP software module converts the to-be-processed data into a distributed data set; the distributed data set and the algorithm module are respectively divided; a plurality of groups of distributed sub-data sets and processing data operators are obtained, division results are deployed to a plurality of available computing nodes,each processing data operator computes the corresponding distributed sub-data set, and all the computing results are integrated through an APP software module and then a final distributed parallel computing result is output. |
---|---|
Bibliography: | Application Number: CN201911246879 |