TSM2X: High-performance tall-and-skinny matrix–matrix multiplication on GPUs

• Published in: Journal of parallel and distributed computing Vol. 151; pp. 70 - 85
• Main Authors: Rivera, Cody, Chen, Jieyang, Xiong, Nan, Zhang, Jing, Song, Shuaiwen Leon, Tao, Dingwen
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.05.2021
• Subjects: CUDA; GPU; Matrix–matrix multiplication; Performance optimization; Tall-and-skinny matrix; CUDA; Matrix–matrix multiplication; Performance optimization; Tall-and-skinny matrix; GPU

Linear algebra operations have been widely used in big data analytics and scientific computations. Many works have been done on optimizing linear algebra operations on GPUs with regular-shaped input. However, few works focus on fully utilizing GPU resources when the input is not regular-shaped. Curr...