SVD-PINNs: Transfer Learning of Physics-Informed Neural Networks via Singular Value Decomposition

• Published in: 2022 IEEE Symposium Series on Computational Intelligence (SSCI) pp. 1443 - 1450
• Main Authors: Gao, Yihang, Cheung, Ka Chun, Ng, Michael K.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 04.12.2022
• Subjects: Costs; Deep learning; Explosives; Neural networks; Partial differential equations; Physics Informed Neural Networks; Singular Value Decomposition; Task analysis; Transfer learning
• DOI: 10.1109/SSCI51031.2022.10022281

Physics-informed neural networks (PINNs) have attracted significant attention for solving partial differential equations (PDEs) in recent years because they alleviate the curse of dimensionality that appears in traditional methods. However, the most disadvantage of PINNs is that one neural network corresponds to one PDE. In practice, we usually need to solve a class of PDEs, not just one. With the explosive growth of deep learning, many useful techniques in general deep learning tasks are also suitable for PINNs. Transfer learning methods may reduce the cost for PINNs in solving a class of PDEs. In this paper, we proposed a transfer learning method of PINNs via keeping singular vectors and optimizing singular values (namely SVD-PINNs). Numerical experiments on high dimensional PDEs (10-d linear parabolic equations and l0-d Allen-Cahn equations) show that SVD-PINNs work for solving a class of PDEs with different but close right-hand-side functions.