Physics-based polynomial neural networks for one-shot learning of dynamical systems from one or a few samples

This paper discusses an approach for incorporating prior physical knowledge into the neural network to improve data efficiency and the generalization of predictive models. If the dynamics of a system approximately follows a given differential equation, the Taylor mapping method can be used to initia...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Ivanov, Andrei, Iben, Uwe, Golovkina, Anna
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 28.05.2020
Subjects
Differential equations
Learning
Mapping
Neural networks
Pendulums
Polynomials
Prediction models
System dynamics
Training
X ray sources
Online AccessGet full text

Cover

More Information
Summary:This paper discusses an approach for incorporating prior physical knowledge into the neural network to improve data efficiency and the generalization of predictive models. If the dynamics of a system approximately follows a given differential equation, the Taylor mapping method can be used to initialize the weights of a polynomial neural network. This allows the fine-tuning of the model from one training sample of real system dynamics. The paper describes practical results on real experiments with both a simple pendulum and one of the largest worldwide X-ray source. It is demonstrated in practice that the proposed approach allows recovering complex physics from noisy, limited, and partial observations and provides meaningful predictions for previously unseen inputs. The approach mainly targets the learning of physical systems when state-of-the-art models are difficult to apply given the lack of training data.
ISSN:2331-8422