Computing infrastructure construction and optimization for high-performance computing and artificial intelligence

• Published in: CCF transactions on high performance computing (Online) Vol. 3; no. 4; pp. 331 - 343
• Main Authors: Su, Yun, Zhou, Jipeng, Ying, Jiangyong, Zhou, Mingyao, Zhou, Bin
• Format: Journal Article
• Language: English
• Published: Singapore Springer Singapore 01.12.2021; Springer Nature B.V
• Subjects: Accuracy; Antibiotics; Artificial intelligence; Chemistry; Computer Hardware; Computer Science; Computer Systems Organization and Communication Networks; High performance computing; Human subjects; Large-Scale AI in Classical HPC Environment and AI for Science; Methods; Neural networks; Partial differential equations; Pharmaceutical industry; Proteins; Quantum physics; R&D; Research & development; Review Paper; Simulation; Supercomputers; United States > US; AI Computing Center; AI Processor; High-performance computing; Artificial intelligence
• ISSN: 2524-4922; 2524-4930
• DOI: 10.1007/s42514-021-00080-x

The emergence of supercomputers has brought rapid development to human life and scientific research. Today, the new wave of artificial intelligence (AI) not only brings convenience to people's lives, but also changes the engineering and scientific high-performance computation. AI technologies provide more efficient and accurate computing methods for many fields. These ongoing changes pose new challenges to the design of computing infrastructures, which will be addressed in this survey in details. This survey first describes the distinguished progress of combining AI and high-performance computing (HPC) in scientific computation, analyzes several typical scenarios, and summarizes the characteristics of the corresponding requirements of computing resources. On this basis, this survey further lists four general methods for integrating AI computing with conventional HPC, as well as their key features and application scenarios. Finally, this survey introduces the design strategy of the Peng Cheng Cloud Brain II Supercomputing Center in improving AI computing capability and cluster communication efficiency, which helped it won the first place in the IO500 and AIPerf rankings.