Sparse inference and active learning of stochastic differential equations from data

• Published in: Scientific reports Vol. 12; no. 1; p. 21691
• Main Authors: Huang, Yunfei, Mabrouk, Youssef, Gompper, Gerhard, Sabass, Benedikt
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 15.12.2022; Nature Publishing Group; Nature Portfolio
• Subjects: 631/57; 631/57/2272; 639/766/530; 639/766/747; Active learning; Algorithms; Bayes Theorem; Bayesian analysis; Computer applications; Differential equations; Humanities and Social Sciences; Mathematical models; multidisciplinary; Neural networks; Neural Networks, Computer; Science; Science (multidisciplinary); Stochasticity
• ISSN: 2045-2322; 2045-2322
• DOI: 10.1038/s41598-022-25638-9

Automatic machine learning of empirical models from experimental data has recently become possible as a result of increased availability of computational power and dedicated algorithms. Despite the successes of non-parametric inference and neural-network-based inference for empirical modelling, a physical interpretation of the results often remains challenging. Here, we focus on direct inference of governing differential equations from data, which can be formulated as a linear inverse problem. A Bayesian framework with a Laplacian prior distribution is employed for finding sparse solutions efficiently. The superior accuracy and robustness of the method is demonstrated for various cases, including ordinary, partial, and stochastic differential equations. Furthermore, we develop an active learning procedure for the automated discovery of stochastic differential equations. In this procedure, learning of the unknown dynamical equations is coupled to the application of perturbations to the measured system in a feedback loop. We show that active learning can significantly improve the inference of global models for systems with multiple energetic minima.