Parametrization of analytic interatomic potential functions using neural networks

Compensation States Approach in the Hybrid Diabatization Scheme: Extension to Multidimensional Data and Properties

The diabatization of reactive systems for more than just a couple of states is a very demanding problem and generally requires advanced diabatization techniques. Especially for dissociative processes, the drastic changes in the adiabatic wave functions often would require large diabatic state bases, which quickly become impractical. Recently, we addressed this problem by the compensation states approach developed in the context of our hybrid diabatization scheme. This scheme utilizes wave function as well as energy data in combination with a diabatic potential model. In regions where the initial diabatic state basis becomes insufficient for an appropriate representation of the adiabatic states, new model states are generated. The new model states compensate for the state space not spanned by the initial diabatic basis. Such a compensation state is obtained by projecting the initial diabatic state space out of the adiabatic wave function. This yields a very efficient basis representation of the electronic Hamiltonian. The present work presents two new aspects. First, it is shown how other operators like the spin-orbit operator in the framework of the Effective Relativistic Coupling by Asymptotic Representation (ERCAR) can be evaluated in this compact model state space without losing the correct wave function information and accuracy. Second, the extension of the approach to multidimensional potential energy surface models is presented for methyl iodide including the C-I dissociation coordinate and the angular H3C-I bending coordinates.

The effective relativistic coupling by asymptotic representation approach for molecules with multiple relativistic atoms

The Effective Relativistic Coupling by Asymptotic Representation (ERCAR) approach is a method to generate fully coupled diabatic potential energy surfaces (PESs) including relativistic effects, especially spin-orbit coupling. The spin-orbit coupling of a full molecule is determined only by the atomic states of selected relativistically treated atoms. The full molecular coupling effect is obtained by a diabatization with respect to asymptotic states, resulting in the correct geometry dependence of the spin-orbit effect. The ERCAR approach has been developed over the last decade and initially only for molecules with a single relativistic atom. This work presents its extension to molecules with more than a single relativistic atom using the iodine molecule as a proof-of-principle example. The theory for the general multiple atomic ERCAR approach is given. In this case, the diabatic basis is defined at the asymptote where all relativistic atoms are separated from the remaining molecular fragment. The effective spin-orbit operator is then a sum of spin-orbit operators acting on isolated relativistic atoms. PESs for the iodine molecule are developed within the new approach and it is shown that the resulting fine structure states are in good agreement with spin-orbit ab initio calculations.

Neural Network Potential Energy Surfaces for Small Molecules and Reactions

We review progress in neural network (NN)-based methods for the construction of interatomic potentials from discrete samples (such as ab initio energies) for applications in classical and quantum dynamics including reaction dynamics and computational spectroscopy. The main focus is on methods for building molecular potential energy surfaces (PES) in internal coordinates that explicitly include all many-body contributions, even though some of the methods we review limit the degree of coupling, due either to a desire to limit computational cost or to limited data. Explicit and direct treatment of all many-body contributions is only practical for sufficiently small molecules, which are therefore our primary focus. This includes small molecules on surfaces. We consider direct, single NN PES fitting as well as more complex methods that impose structure (such as a multibody representation) on the PES function, either through the architecture of one NN or by using multiple NNs. We show how NNs are effective in building representations with low-dimensional functions including dimensionality reduction. We consider NN-based approaches to build PESs in the sums-of-product form important for quantum dynamics, ways to treat symmetry, and issues related to sampling data distributions and the relation between PES errors and errors in observables. We highlight combinations of NNs with other ideas such as permutationally invariant polynomials or sums of environment-dependent atomic contributions, which have recently emerged as powerful tools for building highly accurate PESs for relatively large molecular and reactive systems.

Physically informed artificial neural networks for atomistic modeling of materials

Large-scale atomistic computer simulations of materials heavily rely on interatomic potentials predicting the energy and Newtonian forces on atoms. Traditional interatomic potentials are based on physical intuition but contain few adjustable parameters and are usually not accurate. The emerging machine-learning (ML) potentials achieve highly accurate interpolation within a large DFT database but, being purely mathematical constructions, suffer from poor transferability to unknown structures. We propose a new approach that can drastically improve the transferability of ML potentials by informing them of the physical nature of interatomic bonding. This is achieved by combining a rather general physics-based model (analytical bond-order potential) with a neural-network regression. This approach, called the physically informed neural network (PINN) potential, is demonstrated by developing a general-purpose PINN potential for Al. We suggest that the development of physics-based ML potentials is the most effective way forward in the field of atomistic simulations.

Study of Li atom diffusion in amorphous Li3PO4 with neural network potential

To clarify atomic diffusion in amorphous materials, which is important in novel information and energy devices, theoretical methods having both reliability and computational speed are eagerly anticipated. In the present study, we applied neural network (NN) potentials, a recently developed machine learning technique, to the study of atom diffusion in amorphous materials, using Li₃PO₄ as a benchmark material. The NN potential was used together with the nudged elastic band, kinetic Monte Carlo, and molecular dynamics methods to characterize Li vacancy diffusion behavior in the amorphous Li₃PO₄ model. By comparing these results with corresponding DFT calculations, we found that the average error of the NN potential is 0.048 eV in calculating energy barriers of diffusion paths, and 0.041 eV in diffusion activation energy. Moreover, the diffusion coefficients obtained from molecular dynamics are always consistent with those from ab initio molecular dynamics simulation, while the computation speed of the NN potential is 3-4 orders of magnitude faster than DFT. Lastly, the structure of amorphous Li₃PO₄ and the ion transport properties in it were studied with the NN potential using a large supercell model containing more than 1000 atoms. The formation of P₂O₇ units was observed, which is consistent with the experimental characterization. The Li diffusion activation energy was estimated to be 0.55 eV, which agrees well with the experimental measurements.

Dynamics and stability of icosahedral Fe–Pt nanoparticles

An ab initio theoretical study on icosahedral Fe–Pt clusters – one of the most interesting nanoalloys with high application potential.

Representing potential energy surfaces by high-dimensional neural network potentials

The development of interatomic potentials employing artificial neural networks has seen tremendous progress in recent years. While until recently the applicability of neural network potentials (NNPs) has been restricted to low-dimensional systems, this limitation has now been overcome and high-dimensional NNPs can be used in large-scale molecular dynamics simulations of thousands of atoms. NNPs are constructed by adjusting a set of parameters using data from electronic structure calculations, and in many cases energies and forces can be obtained with very high accuracy. Therefore, NNP-based simulation results are often very close to those gained by a direct application of first-principles methods. In this review, the basic methodology of high-dimensional NNPs will be presented with a special focus on the scope and the remaining limitations of this approach. The development of NNPs requires substantial computational effort as typically thousands of reference calculations are required. Still, if the problem to be studied involves very large systems or long simulation times this overhead is regained quickly. Further, the method is still limited to systems containing about three or four chemical elements due to the rapidly increasing complexity of the configuration space, although many atoms of each species can be present. Due to the ability of NNPs to describe even extremely complex atomic configurations with excellent accuracy irrespective of the nature of the atomic interactions, they represent a general and therefore widely applicable technique, e.g. for addressing problems in materials science, for investigating properties of interfaces, and for studying solvation processes.

Communication: Hybrid ensembles for improved force matching

Force matching is a method for parameterizing empirical potentials in which the empirical parameters are fitted to a reference potential energy surface (PES). Typically, training data are sampled from a canonical ensemble generated with either the empirical potential or the reference PES. In this Communication, we show that sampling from either ensemble risks excluding critical regions of configuration space, leading to fitted potentials that deviate significantly from the reference PES. We present a hybrid ensemble which combines the Boltzmann probabilities of both potential surfaces into the fitting procedure, and we demonstrate that this technique improves the quality and stability of empirical potentials.

Input vector optimization of feed-forward neural networks for fitting ab initio potential-energy databases

The variation in the fitting accuracy of neural networks (NNs) when used to fit databases comprising potential energies obtained from ab initio electronic structure calculations is investigated as a function of the number and nature of the elements employed in the input vector to the NN. Ab initio databases for H(2)O(2), HONO, Si(5), and H(2)C[Double Bond]CHBr were employed in the investigations. These systems were chosen so as to include four-, five-, and six-body systems containing first, second, third, and fourth row elements with a wide variety of chemical bonding and whose conformations cover a wide range of structures that occur under high-energy machining conditions and in chemical reactions involving cis-trans isomerizations, six different types of two-center bond ruptures, and two different three-center dissociation reactions. The ab initio databases for these systems were obtained using density functional theory/B3LYP, MP2, and MP4 methods with extended basis sets. A total of 31 input vectors were investigated. In each case, the elements of the input vector were chosen from interatomic distances, inverse powers of the interatomic distance, three-body angles, and dihedral angles. Both redundant and nonredundant input vectors were investigated. The results show that among all the input vectors investigated, the set employed in the Z-matrix specification of the molecular configurations in the electronic structure calculations gave the lowest NN fitting accuracy for both Si(5) and vinyl bromide. The underlying reason for this result appears to be the discontinuity present in the dihedral angle for planar geometries. The use of trigometric functions of the angles as input elements produced significantly improved fitting accuracy as this choice eliminates the discontinuity. The most accurate fitting was obtained when the elements of the input vector were taken to have the form R(ij) (-n), where the R(ij) are the interatomic distances. When the Levenberg-Marquardt procedure was modified to permit error minimization with respect to n as well as the weights and biases of the NN, the optimum powers were all found to lie in the range of 1.625-2.38 for the four systems studied. No statistically significant increase in fitting accuracy was achieved for vinyl bromide when a different value of n was employed and optimized for each bond type. The rate of change in the fitting error with n is found to be very small when n is near its optimum value. Consequently, good fitting accuracy can be achieved by employing a value of n in the middle of the above range. The use of interparticle distances as elements of the input vector rather than the Z-matrix variables employed in the electronic structure calculations is found to reduce the rms fitting errors by factors of 8.86 and 1.67 for Si(5) and vinyl bromide, respectively. If the interparticle distances are replaced with input elements of the form R(ij) (-n) with n optimized, further reductions in the rms error by a factor of 1.31 to 2.83 for the four systems investigated are obtained. A major advantage of using this procedure to increase NN fitting accuracy rather than increasing the number of neurons or the size of the database is that the required increase in computational effort is very small.