Interpolating moving least-squares methods for fitting potential energy surfaces: Applications to classical dynamics calculations

Deep potential for face-centered cubic Cu system at finite temperatures

Potential function is critical for molecular dynamics simulation and the state-of-the-art method generating potential functions used in molecular dynamics is based on machine learning with neural networks. This method provides...

Neural Network Potential Energy Surfaces for Small Molecules and Reactions

We review progress in neural network (NN)-based methods for the construction of interatomic potentials from discrete samples (such as ab initio energies) for applications in classical and quantum dynamics including reaction dynamics and computational spectroscopy. The main focus is on methods for building molecular potential energy surfaces (PES) in internal coordinates that explicitly include all many-body contributions, even though some of the methods we review limit the degree of coupling, due either to a desire to limit computational cost or to limited data. Explicit and direct treatment of all many-body contributions is only practical for sufficiently small molecules, which are therefore our primary focus. This includes small molecules on surfaces. We consider direct, single NN PES fitting as well as more complex methods that impose structure (such as a multibody representation) on the PES function, either through the architecture of one NN or by using multiple NNs. We show how NNs are effective in building representations with low-dimensional functions including dimensionality reduction. We consider NN-based approaches to build PESs in the sums-of-product form important for quantum dynamics, ways to treat symmetry, and issues related to sampling data distributions and the relation between PES errors and errors in observables. We highlight combinations of NNs with other ideas such as permutationally invariant polynomials or sums of environment-dependent atomic contributions, which have recently emerged as powerful tools for building highly accurate PESs for relatively large molecular and reactive systems.

A combined on-the-fly/interpolation procedure for evaluating energy values needed in molecular simulations

We propose an algorithm for molecular dynamics or Monte Carlo simulations that uses an interpolation procedure to estimate potential energy values from energies and gradients evaluated previously at points of a simplicial mesh. We chose an interpolation procedure that is exact for harmonic systems and considered two possible mesh types: Delaunay triangulation and an alternative anisotropic triangulation designed to improve performance in anharmonic systems. The mesh is generated and updated on the fly during the simulation. The procedure is tested on two-dimensional quartic oscillators and on the path integral Monte Carlo evaluation of the HCN/DCN equilibrium isotope effect.

Representing potential energy surfaces by high-dimensional neural network potentials

The development of interatomic potentials employing artificial neural networks has seen tremendous progress in recent years. While until recently the applicability of neural network potentials (NNPs) has been restricted to low-dimensional systems, this limitation has now been overcome and high-dimensional NNPs can be used in large-scale molecular dynamics simulations of thousands of atoms. NNPs are constructed by adjusting a set of parameters using data from electronic structure calculations, and in many cases energies and forces can be obtained with very high accuracy. Therefore, NNP-based simulation results are often very close to those gained by a direct application of first-principles methods. In this review, the basic methodology of high-dimensional NNPs will be presented with a special focus on the scope and the remaining limitations of this approach. The development of NNPs requires substantial computational effort as typically thousands of reference calculations are required. Still, if the problem to be studied involves very large systems or long simulation times this overhead is regained quickly. Further, the method is still limited to systems containing about three or four chemical elements due to the rapidly increasing complexity of the configuration space, although many atoms of each species can be present. Due to the ability of NNPs to describe even extremely complex atomic configurations with excellent accuracy irrespective of the nature of the atomic interactions, they represent a general and therefore widely applicable technique, e.g. for addressing problems in materials science, for investigating properties of interfaces, and for studying solvation processes.

Development of generalized potential-energy surfaces using many-body expansions, neural networks, and moiety energy approximations

A general method for the development of potential-energy hypersurfaces is presented. The method combines a many-body expansion to represent the potential-energy surface with two-layer neural networks (NN) for each M-body term in the summations. The total number of NNs required is significantly reduced by employing a moiety energy approximation. An algorithm is presented that efficiently adjusts all the coupled NN parameters to the database for the surface. Application of the method to four different systems of increasing complexity shows that the fitting accuracy of the method is good to excellent. For some cases, it exceeds that available by other methods currently in literature. The method is illustrated by fitting large databases of ab initio energies for Si(n) (n=3,4,...,7) clusters obtained from density functional theory calculations and for vinyl bromide (C(2)H(3)Br) and all products for dissociation into six open reaction channels (12 if the reverse reactions are counted as separate open channels) that include C-H and C-Br bond scissions, three-center HBr dissociation, and three-center H(2) dissociation. The vinyl bromide database comprises the ab initio energies of 71 969 configurations computed at MP4(SDQ) level with a 6-31G(d,p) basis set for the carbon and hydrogen atoms and Huzinaga's (4333/433/4) basis set augmented with split outer s and p orbitals (43321/4321/4) and a polarization f orbital with an exponent of 0.5 for the bromine atom. It is found that an expansion truncated after the three-body terms is sufficient to fit the Si(5) system with a mean absolute testing set error of 5.693x10(-4) eV. Expansions truncated after the four-body terms for Si(n) (n=3,4,5) and Si(n) (n=3,4,...,7) provide fits whose mean absolute testing set errors are 0.0056 and 0.0212 eV, respectively. For vinyl bromide, a many-body expansion truncated after the four-body terms provides fitting accuracy with mean absolute testing set errors that range between 0.0782 and 0.0808 eV. These errors correspond to mean percent errors that fall in the range 0.98%-1.01%. Our best result using the present method truncated after the four-body summation with 16 NNs yields a testing set error that is 20.3% higher than that obtained using a 15-dimensional (15-140-1) NN to fit the vinyl bromide database. This appears to be the price of the added simplicity of the many-body expansion procedure.

Using neural networks, optimized coordinates, and high-dimensional model representations to obtain a vinyl bromide potential surface

We demonstrate that it is possible to obtain good potentials using high-dimensional model representations (HDMRs) fitted with neural networks (NNs) from data in 12 dimensions and 15 dimensions. The HDMR represents the potential as a sum of lower-dimensional functions and our NN-based approach makes it possible to obtain all of these functions from one set of fitting points. To reduce the number of terms in the HDMR, we use optimized redundant coordinates. By using exponential neurons, one obtains a potential in sum-of-products form, which greatly facilitates quantum dynamics calculations. A 12-dimensional (reference) potential surface for vinyl bromide is first refitted to show that it can be represented as a sum of two-dimensional functions. To fit 3d functions of the original coordinates, to improve the potential, a huge amount of data would be required. Redundant coordinates avoid this problem. They enable us to bypass the combinatorial explosion of the number of terms which plagues all HDMR and multimode-type methods. We also fit to a set of approximately 70,000 ab initio points for vinyl bromide in 15 dimensions [M. Malshe et al., J. Chem. Phys. 127, 134105 (2007)] and show that it is possible to obtain a surface in sum-of-products form of quality similar to the quality of the full-dimensional fit. Although we obtain a full-dimensional surface, we limit the cost of the fitting by building it from fits of six-dimensional functions, each of which requires only a small NN.

Using redundant coordinates to represent potential energy surfaces with lower-dimensional functions

We propose a method for fitting potential energy surfaces with a sum of component functions of lower dimensionality. This form facilitates quantum dynamics calculations. We show that it is possible to reduce the dimensionality of the component functions by introducing new and redundant coordinates obtained with linear transformations. The transformations are obtained from a neural network. Different coordinates are used for different component functions and the new coordinates are determined as the potential is fitted. The quality of the fits and the generality of the method are illustrated by fitting reference potential surfaces of hydrogen peroxide and of the reaction OH+H(2)-->H(2)O+H.

Interpolating moving least-squares methods for fitting potential energy surfaces: Computing high-density potential energy surface data from low-density ab initio data points

A highly accurate and efficient method for molecular global potential energy surface (PES) construction and fitting is demonstrated. An interpolating-moving-least-squares (IMLS)-based method is developed using low-density ab initio Hessian values to compute high-density PES parameters suitable for accurate and efficient PES representation. The method is automated and flexible so that a PES can be optimally generated for classical trajectories, spectroscopy, or other applications. Two important bottlenecks for fitting PESs are addressed. First, high accuracy is obtained using a minimal density of ab initio points, thus overcoming the bottleneck of ab initio point generation faced in applications of modified-Shepard-based methods. Second, high efficiency is also possible (suitable when a huge number of potential energy and gradient evaluations are required during a trajectory calculation). This overcomes the bottleneck in high-order IMLS-based methods, i.e., the high cost/accuracy ratio for potential energy evaluations. The result is a set of hybrid IMLS methods in which high-order IMLS is used with low-density ab initio Hessian data to compute a dense grid of points at which the energy, Hessian, or even high-order IMLS fitting parameters are stored. A series of hybrid methods is then possible as these data can be used for neural network fitting, modified-Shepard interpolation, or approximate IMLS. Results that are indicative of the accuracy, efficiency, and scalability are presented for one-dimensional model potentials as well as for three-dimensional (HCN) and six-dimensional (HOOH) molecular PESs.

Interpolating moving least-squares methods for fitting potential energy surfaces: An application to the H2CN unimolecular reaction

Classical trajectories have been used to compute rates for the unimolecular reaction H2CN-->H+HCN on a fitted ab initio potential energy surface (PES). The ab initio energies were obtained from CCSD(T)/aug-cc-pvtz electronic structure calculations. The ab initio energies were fitted by the interpolating moving least-squares (IMLS) method. This work continues the development of the IMLS method for producing ab initio PESs for use in molecular dynamics simulations of many-atom systems. A dual-level scheme was used in which the preliminary selection of data points was done using a low-level theory and the points used for fitting the final PES were obtained at the desired higher level of theory. Classical trajectories were used on various low-level IMLS fits to tune the fit to the unimolecular reaction under study. Procedures for efficiently picking data points, selecting basis functions, and defining cutoff limits to exclude distant points were investigated. The accuracy of the fitted PES was assessed by comparing interpolated values of quantities to the corresponding ab initio values. With as little as 330 ab initio points classical trajectory rate constants were converged to 5%-10% and the rms error over the six-dimensional region sampled by the trajectories was a few tenths of a kcal/mol.

A random-sampling high dimensional model representation neural network for building potential energy surfaces

We combine the high dimensional model representation (HDMR) idea of Rabitz and co-workers [J. Phys. Chem. 110, 2474 (2006)] with neural network (NN) fits to obtain an effective means of building multidimensional potentials. We verify that it is possible to determine an accurate many-dimensional potential by doing low dimensional fits. The final potential is a sum of terms each of which depends on a subset of the coordinates. This form facilitates quantum dynamics calculations. We use NNs to represent HDMR component functions that minimize error mode term by mode term. This NN procedure makes it possible to construct high-order component functions which in turn enable us to determine a good potential. It is shown that the number of available potential points determines the order of the HDMR which should be used.

Molecular dynamics investigations of the dissociation of SiO2 on an ab initio potential energy surface obtained using neural network methods

The neural network (NN) procedure to interpolate ab initio data for the purpose of molecular dynamics (MD) simulations has been tested on the SiO(2) system. Unlike other similar NN studies, here, we studied the dissociation of SiO(2) without the initial use of any empirical potential. During the dissociation of SiO(2) into Si+O or Si+O(2), the spin multiplicity of the system changes from singlet to triplet in the first reaction and from singlet to pentet in the second. This paper employs four potential surfaces. The first is a NN fit [NN(STP)] to a database comprising the lowest of the singlet, triplet, and pentet energies obtained from density functional calculations in 6673 nuclear configurations. The other three potential surfaces are obtained from NN fits to the singlet, triplet, and pentet-state energies. The dissociation dynamics on the singlet-state and NN(STP) surfaces are reported. The results obtained using the singlet surface correspond to those expected if the reaction were to occur adiabatically. The dynamics on the NN(STP) surface represent those expected if the reaction follows a minimum-energy pathway. This study on a small system demonstrates the application of NNs for MD studies using ab initio data when the spin multiplicity of the system changes during the dissociation process.

A Nested Molecule-Independent Neural Network Approach for High-Quality Potential Fits†

It is shown that neural networks (NNs) are efficient and effective tools for fitting potential energy surfaces. For H2O, a simple NN approach works very well. To fit surfaces for HOOH and H2CO, we develop a nested neural network technique in which we first fit an approximate NN potential and then use another NN to fit the difference of the true potential and the approximate potential. The root-mean-square error (RMSE) of the H2O surface is 1 cm(-1). For the 6-D HOOH and H2CO surfaces, the nested approach does almost as well attaining a RMSE of 2 cm(-1). The quality of the NN surfaces is verified by calculating vibrational spectra. For all three molecules, most of the low-lying levels are within 1 cm(-1) of the exact results. On the basis of these results, we propose that the nested NN approach be considered a method of choice for both simple potentials, for which it is relatively easy to guess a good fitting function, and complicated (e.g., double well) potentials for which it is much harder to deduce an appropriate fitting function. The number of fitting parameters is only moderately larger for the 6-D than for the 3-D potentials, and for all three molecules, decreasing the desired RMSE increases only slightly the number of required fitting parameters (nodes). NN methods, and in particular the nested approach we propose, should be good universal potential fitting tools.

Theoretical investigation of the dissociation dynamics of vibrationally excited vinyl bromide on an ab initio potential-energy surface obtained using modified novelty sampling and feed-forward neural networks

The reaction dynamics of vibrationally excited vinyl bromide have been investigated using classical trajectory methods on a neural network potential surface that is fitted to an ab initio database of 12 122 configuration energies obtained from electronic structure calculations conducted at the MP4(SDQ) level of theory using a 6-31G(d,p) basis set for the carbon and hydrogen atoms and Huzinaga's (43334334) basis set augmented with split outer s and p orbitals (4332143214) and a polarization f orbital with an exponent of 0.5 for the bromine atom. The sampling of the 12-dimensional configuration hyperspace of vinyl bromide prior to execution of the electronic structure calculations is accomplished by combining novelty-sampling methods, chemical intuition, and trajectory sampling on empirical and neural network surfaces. The final potential is obtained using a two-layer feed-forward neural network comprising 38 and 1 neurons, respectively, with hyperbolic tangent sigmoid and linear transfer functions in the hidden and output layers, respectively. The fitting is accomplished using the Levenberg-Marquardt algorithm with early stopping and Bayesian regularization methods to avoid overfitting. The interpolated potentials have a standard deviation from the ab initio results of 0.0578 eV, which is within the range generally regarded as "chemical accuracy" for the purposes of electronic structure calculations. It is shown that the potential surface may be easily and conveniently transferred from one research group to another. The files required for transfer of the vinyl bromide surface can be obtained from the Electronic Physics Auxiliary Publication Service. Total dissociation rate coefficients for vinyl bromide are obtained at five different excitation energies between 4.50 and 6.44 eV. Branching ratios into each of the six open reaction channels are computed at 24 vibrational energies in the range between 4.00 and 6.44 eV. The distribution of vibrational energies in HBr formed via three-center dissociation from vinyl bromide is determined and compared with previous theoretical and experimental results. It is concluded that the combination of ab initio electronic structure calculations, novelty sampling with chemical intuition and trajectories on empirical analytic surfaces, and feed-forward neural networks provides a viable framework in which to execute purely ab initio molecular-dynamics studies on complex systems with multiple open reaction channels.

Interpolating moving least-squares methods for fitting potential-energy surfaces: Further improvement of efficiency via cutoff strategies

In standard applications of interpolating moving least squares (IMLS) for fitting a potential-energy surface (PES), all available ab initio points are used. Because remote ab initio points negligibly influence IMLS accuracy and increase IMLS time-to-solution, we present two methods to locally restrict the number of points included in a particular fit. The fixed radius cutoff (FRC) method includes ab initio points within a hypersphere of fixed radius. The density adaptive cutoff (DAC) method includes points within a hypersphere of variable radius depending on the point density. We test these methods by fitting a six-dimensional analytical PES for hydrogen peroxide. Both methods reduce the IMLS time-to-solution by about an order of magnitude relative to that when no cutoff method is used. The DAC method is more robust and efficient than the FRC method.

Ab initio potential-energy surfaces for complex, multichannel systems using modified novelty sampling and feedforward neural networks

A neural network/trajectory approach is presented for the development of accurate potential-energy hypersurfaces that can be utilized to conduct ab initio molecular dynamics (AIMD) and Monte Carlo studies of gas-phase chemical reactions, nanometric cutting, and nanotribology, and of a variety of mechanical properties of importance in potential microelectromechanical systems applications. The method is sufficiently robust that it can be applied to a wide range of polyatomic systems. The overall method integrates ab initio electronic structure calculations with importance sampling techniques that permit the critical regions of configuration space to be determined. The computed ab initio energies and gradients are then accurately interpolated using neural networks (NN) rather than arbitrary parametrized analytical functional forms, moving interpolation or least-squares methods. The sampling method involves a tight integration of molecular dynamics calculations with neural networks that employ early stopping and regularization procedures to improve network performance and test for convergence. The procedure can be initiated using an empirical potential surface or direct dynamics. The accuracy and interpolation power of the method has been tested for two cases, the global potential surface for vinyl bromide undergoing unimolecular decomposition via four different reaction channels and nanometric cutting of silicon. The results show that the sampling methods permit the important regions of configuration space to be easily and rapidly identified, that convergence of the NN fit to the ab initio electronic structure database can be easily monitored, and that the interpolation accuracy of the NN fits is excellent, even for systems involving five atoms or more. The method permits a substantial computational speed and accuracy advantage over existing methods, is robust, and relatively easy to implement.

Interpolating moving least-squares methods for fitting potential energy surfaces: Analysis of an application to a six-dimensional system

The basic formal and numerical aspects of different degree interpolated moving least-squares (IMLS) methods are applied to a six-dimensional potential energy surface (PES) of the HOOH molecule, for which an analytic ("exact") potential is available in the literature. The results of systematic investigations of the effects of weight function parameters, the degree and partial degree of IMLS, the number of data points allowed, and the optimal automatic point selection of data points up to full third-degree IMLS fits are reported. With partial reduction of cross terms and automatic point selection the full six-dimensional HOOH PES can be fit over a range of 100 kcal/mol to an accuracy of less than 1 kcal/mol with approximately 1350 ab initio points.