PETSc/TAO Developments for Early Exascale Systems

The Portable Extensible Toolkit for Scientific Computation (PETSc) library provides scalable solvers for nonlinear time-dependent differential and algebraic equations and for numerical optimization via the Toolkit for Advanced Optimization (TAO). PETSc is used in dozens of scientific fields and is a...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Richard Tran Mills, Adams, Mark, Balay, Satish, Brown, Jed, Faibussowitsch, Jacob, Isaac, Toby, Knepley, Matthew, Munson, Todd, Suh, Hansol, Zampini, Stefano, Zhang, Hong, Zhang, Junchao
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 12.06.2024
Subjects
Differential equations
Libraries
Optimization
Performance evaluation
Portability
Solvers
Toolkits
Online AccessGet full text

Cover

More Information
Summary:The Portable Extensible Toolkit for Scientific Computation (PETSc) library provides scalable solvers for nonlinear time-dependent differential and algebraic equations and for numerical optimization via the Toolkit for Advanced Optimization (TAO). PETSc is used in dozens of scientific fields and is an important building block for many simulation codes. During the U.S. Department of Energy's Exascale Computing Project, the PETSc team has made substantial efforts to enable efficient utilization of the massive fine-grain parallelism present within exascale compute nodes and to enable performance portability across exascale architectures. We recap some of the challenges that designers of numerical libraries face in such an endeavor, and then discuss the many developments we have made, which include the addition of new GPU backends, features supporting efficient on-device matrix assembly, better support for asynchronicity and GPU kernel concurrency, and new communication infrastructure. We evaluate the performance of these developments on some pre-exascale systems as well the early exascale systems Frontier and Aurora, using compute kernel, communication layer, solver, and mini-application benchmark studies, and then close with a few observations drawn from our experiences on the tension between portable performance and other goals of numerical libraries.
ISSN:2331-8422