Distributed computing method and system, storage medium and electronic equipment

• Main Authors: ZHAO YAQIAN, GUO ZHENHUA, YAN RUIDONG, LIU LU, JIN LIANG, XU CONG
• Format: Patent
• Language: Chinese; English
• Published: 31.01.2023
• Subjects: CALCULATING; COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS; COMPUTING; COUNTING; ELECTRIC DIGITAL DATA PROCESSING; PHYSICS

The invention provides a distributed computing method and system, a storage medium and electronic equipment, and relates to the field of distributed computing, and the method comprises the steps: obtaining a distributed computing task; performing task decomposition on the distributed computing task to obtain sub-tasks, and distributing the sub-tasks to each computing node; in each computing node, training the subtask by using a training thread to obtain a training result, storing the training result in a first cache, and obtaining current global data by using a communication thread and storing the current global data in a second cache; after one iteration is completed, exchanging data in the first cache and the second cache; in the next iteration, taking the current global data as an initial value of the next training; iterating for a preset number of times to obtain a local solution corresponding to the computational node; and aggregating each local solution to obtain a training result of the distributed com