Adaptive cache pre-forwarding policy for distributed deep learning

• Published in: Computers & electrical engineering Vol. 82; pp. 106558 - 20
• Main Authors: Cheng, Sheng-Tzong, Hsu, Chih-Wei, Horng, Gwo-Jiun, Lin, Che-Hsuan
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier Ltd 01.03.2020; Elsevier BV
• Subjects: Algorithms; Cache, Reinforcement learning; Computer networks; Deep learning; Distributed computing; Distributed processing; Machine learning; Model accuracy; Network latency; Synchronism; Training; Deep learning; Distributed computing; Cache, Reinforcement learning

With the rapid growth of deep learning algorithms, several high-accuracy models have been developed and applied to many real-world domains. Deep learning is parallel and suitable for distributed computing, which can significantly improve the system throughput. However, there is a bottleneck for cros...