PANNA: Properties from Artificial Neural Network Architectures
Prediction of material properties from first principles is often a computationally expensive task. Recently, artificial neural networks and other machine learning approaches have been successfully employed to obtain accurate models at a low computational cost by leveraging existing example data. Her...
Saved in:
Published in | Computer physics communications Vol. 256; no. C; p. 107402 |
---|---|
Main Authors | , , , |
Format | Journal Article |
Language | English |
Published |
Netherlands
Elsevier B.V
01.11.2020
Elsevier |
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | Prediction of material properties from first principles is often a computationally expensive task. Recently, artificial neural networks and other machine learning approaches have been successfully employed to obtain accurate models at a low computational cost by leveraging existing example data. Here, we present a software package “Properties from Artificial Neural Network Architectures” (PANNA) that provides a comprehensive toolkit for creating neural network models for atomistic systems following the Behler–Parrinello topology. Besides the core routines for neural network training, it includes data parser, descriptor builder for Behler–Parrinello class of symmetry functions and force-field generator suitable for integration within molecular dynamics packages. PANNA offers a variety of activation and cost functions, regularization methods, as well as the possibility of using fully-connected networks with custom size for each atomic species. PANNA benefits from the optimization and hardware-flexibility of the underlying TensorFlow engine which allows it to be used on multiple CPU/GPU/TPU systems, making it possible to develop and optimize neural network models based on large datasets.
Program title: PANNA — Properties from Artificial Neural Network Architectures
CPC Library link to program files:http://dx.doi.org/10.17632/mcryj6cnnh.1
Licensing provisions: MIT
Programming language: Python, C++
Nature of problem: A workflow for machine learning atomistic properties and interatomic potentials using neural networks.
Solution method: This package first transforms the user supplied data into pairs of precomputed input (Behler–Parrinello [1] class of symmetry functions) and target output (energy and forces) for the neural network model. The data are then packed to enable efficient reading. A user-friendly interface to TensorFlow [2] is provided to instantiate and train neural network models with varying architectures within Behler–Parrinello topology and with varying training schedules. The training can be monitored and validated with the provided tools. The derivative of the target output with respect to the input can also be used jointly in training, e.g. in the case of energy and force training. The interface with molecular dynamics codes such as LAMMPS [3] allows the neural network model to be used as an interatomic potential.
Additional comments including restrictions and unusual features: The underlying neural network training engine, TensorFlow, is a prerequisite of PANNA. While there is a special LAMMPS integration performed via a patch distributed within PANNA, the network potentials can be deposited into OpenKIM [4] database and can be used with a wide range of molecular dynamics codes.
The package allows different network architectures to be used for each atomic species, with different trainability setting for each network layer. It provides tools of exchanging weights between atomic species, and provides the option of building a Radial Basis Function network. The software is parallelized to take advantage of hardware architectures with multiple CPU/GPU/TPUs. References:
[1] J. Behler and M. Parrinello, Generalized Neural-Network Representation of High-Dimensional Potential-Energy Surfaces, Phys. Rev. Lett. 98, 146401 (2007).
[2] M. Abadi et al., TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems (2015). URL: https://www.tensorflow.org
[3] S. Plimpton, Fast Parallel Algorithms for Short-Range Molecular Dynamics, J. Comp. Phys. 117 1-9 (1995). URL: http://lammps.sandia.gov
[4] E. B. Tadmor, R. S. Elliott, J. P. Sethna, R. E. Miller and C. A. Becker, The Potential of Atomistic Simulations and the Knowledgebase of Interatomic Models, JOM, 63, 17 (2011). URL: https://openkim.org |
---|---|
Bibliography: | USDOE Office of Science (SC), Basic Energy Sciences (BES) |
ISSN: | 0010-4655 1879-2944 |
DOI: | 10.1016/j.cpc.2020.107402 |