SympNets: Intrinsic structure-preserving symplectic networks for identifying Hamiltonian systems

• Published in: Neural networks Vol. 132; no. C; pp. 166 - 179
• Main Authors: Jin, Pengzhan, Zhang, Zhen, Zhu, Aiqing, Tang, Yifa, Karniadakis, George Em
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 01.12.2020; Elsevier
• Subjects: Computer Simulation; Deep Learning; Dynamical systems; Hamiltonian systems; Humans; Neural Networks, Computer; Physics-informed; Symplectic integrators; Symplectic maps; Deep learning; Symplectic maps; Hamiltonian systems; Physics-informed; Symplectic integrators; Dynamical systems
• ISSN: 0893-6080; 1879-2782; 1879-2782
• DOI: 10.1016/j.neunet.2020.08.017

We propose new symplectic networks (SympNets) for identifying Hamiltonian systems from data based on a composition of linear, activation and gradient modules. In particular, we define two classes of SympNets: the LA-SympNets composed of linear and activation modules, and the G-SympNets composed of gradient modules. Correspondingly, we prove two new universal approximation theorems that demonstrate that SympNets can approximate arbitrary symplectic maps based on appropriate activation functions. We then perform several experiments including the pendulum, double pendulum and three-body problems to investigate the expressivity and the generalization ability of SympNets. The simulation results show that even very small size SympNets can generalize well, and are able to handle both separable and non-separable Hamiltonian systems with data points resulting from short or long time steps. In all the test cases, SympNets outperform the baseline models, and are much faster in training and prediction. We also develop an extended version of SympNets to learn the dynamics from irregularly sampled data. This extended version of SympNets can be thought of as a universal model representing the solution to an arbitrary Hamiltonian system.