Node communication method and device during model training

• Main Authors: YU DIANHAI, TIAN GEXIAO, LI SHUKUN, LI ZHAOGENG, WANG YANPENG
• Format: Patent
• Language: Chinese; English
• Published: 02.08.2024
• Subjects: ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHICCOMMUNICATION

The invention provides a node communication method and device during model training, electronic equipment and a readable storage medium, and relates to the technical field of artificial intelligence such as large language models, machine learning, cloud services and big data. The node communication method during model training comprises the following steps: receiving to-be-processed training data by a first training node in a training cluster, and obtaining a target communication type corresponding to the to-be-processed training data; processing the to-be-processed training data through a to-be-trained model to obtain target data, and determining a target connection corresponding to the target data according to the target communication type; and determining a target bandwidth according to a target priority corresponding to the target connection, and sending the target data from the first training node to a target second training node corresponding to the target connection by using the target bandwidth throug