MM-AutoSolver: A multimodal machine learning method for the auto-selection of iterative solvers and preconditioners

• Published in: Journal of parallel and distributed computing Vol. 205; p. 105144
• Main Authors: Xiong, Hantao, Yang, Wangdong, He, Weiqing, Lin, Shengle, Li, Keqin, Li, Kenli
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.11.2025
• Subjects: Auto-selection; HPC; Iterative solver; Multimodal machine learning; Preconditioner; Sparse linear systems; HPC; Auto-selection; Iterative solver; Preconditioner; Multimodal machine learning; Sparse linear systems
• ISSN: 0743-7315
• DOI: 10.1016/j.jpdc.2025.105144

The solution of large-scale sparse linear systems of the form Ax=b is an important research problem in the field of High-performance Computing (HPC). With the increasing scale of these systems and the development of both HPC software and hardware, iterative solvers along with appropriate preconditioners have become mainstream methods for efficiently solving these sparse linear systems that arise from real-world HPC applications. Among abundant combinations of iterative solvers and preconditioners, the automatic selection of the optimal one has become a vital problem for accelerating the solution of these sparse linear systems. Previous work has utilized machine learning or deep learning algorithms to tackle this problem, but fails to abstract and exploit sufficient features from sparse linear systems, thus unable to obtain satisfactory results. In this work, we propose to address the automatic selection of the optimal combination of iterative solvers and preconditioners through the powerful multimodal machine learning framework, in which features of different modalities can be fully extracted and utilized to improve the results. Based on the multimodal machine learning framework, we put forward a multimodal machine learning model called MM-AutoSolver for the auto-selection of the optimal combination for a given sparse linear system. The experimental results based on a new large-scale matrix collection showcase that the proposed MM-AutoSolver outperforms state-of-the-art methods in predictive performance and has the capability to significantly accelerate the solution of large-scale sparse linear systems in HPC applications. •A multimodal machine learning framework used for learning features of different modalities.•A multimodal model MM-AutoSolver is proposed to learn numerical features and structural features from sparse linear systems.•A performance evaluation of the predictive accuracy of MM-AutoSolver and its speedup is constructed.