Molecular dissociation of hydrogen peroxide (HOOH) on a neural network ab initio potential surface with a new configuration sampling method involving gradient fitting

Fundamental Invariant Neural Network (FI-NN) Potential Energy Surface for the OH + CH3OH Reaction with Analytical Forces

The hydrogen abstraction reaction of OH + CH3OH plays a great role in combustion and atmospheric and interstellar chemistry and has been extensively studied theoretically and experimentally. Theoretically, the numerical gradients with respect to the Cartesian coordinates of atoms in molecular simulations on our recent potential energy surface (PES) for the title reaction trained using the permutationally invariant polynomial neural network (PIP-NN) approach hinder the extensive calculation because of the unaffordable computation cost. To address this issue, we in this work report a new full-dimensional accurate analytical PES for the title reaction using the fundamental invariant neural network (FI-NN) approach based on 140,192 points of the quality UCCSD(T)-F12a/AVTZ. Besides, the spin-orbit (SO) corrections of OH in the entrance channel were determined at the level of complete active space self-consistent field with the AVTZ basis set. As a compromise between computational cost and efficiency, the Δ-machine learning approach was employed to construct the SO-corrected PES. Based on this new FI-NN PES with analytical forces, thermal rate coefficients and various dynamic properties, including the integral cross sections, the differential cross sections, and the product energy partitioning, were determined by running a total of 5.5 million trajectories. The use of analytical gradients of the FI-NN PES accelerated simulations and about 99% of computation cost was saved, compared to that for the PIP-NN PES with numerical gradients. Such a significant acceleration is achieved mainly by replacing PIPs with FIs.

Machine Learning of Reactive Potentials

In the past two decades, machine learning potentials (MLPs) have driven significant developments in chemical, biological, and material sciences. The construction and training of MLPs enable fast and accurate simulations and analysis of thermodynamic and kinetic properties. This review focuses on the application of MLPs to reaction systems with consideration of bond breaking and formation. We review the development of MLP models, primarily with neural network and kernel-based algorithms, and recent applications of reactive MLPs (RMLPs) to systems at different scales. We show how RMLPs are constructed, how they speed up the calculation of reactive dynamics, and how they facilitate the study of reaction trajectories, reaction rates, free energy calculations, and many other calculations. Different data sampling strategies applied in building RMLPs are also discussed with a focus on how to collect structures for rare events and how to further improve their performance with active learning.

A machine learning potential for simulating infrared spectra of nanosilicate clusters

The use of machine learning (ML) in chemical physics has enabled the construction of interatomic potentials having the accuracy of ab initio methods and a computational cost comparable to that of classical force fields. Training an ML model requires an efficient method for the generation of training data. Here, we apply an accurate and efficient protocol to collect training data for constructing a neural network-based ML interatomic potential for nanosilicate clusters. Initial training data are taken from normal modes and farthest point sampling. Later on, the set of training data is extended via an active learning strategy in which new data are identified by the disagreement between an ensemble of ML models. The whole process is further accelerated by parallel sampling over structures. We use the ML model to run molecular dynamics simulations of nanosilicate clusters with various sizes, from which infrared spectra with anharmonicity included can be extracted. Such spectroscopic data are needed for understanding the properties of silicate dust grains in the interstellar medium and in circumstellar environments.

A Hessian-based assessment of atomic forces for training machine learning interatomic potentials

In recent years, many types of machine learning potentials (MLPs) have been introduced, which are able to represent high-dimensional potential-energy surfaces (PESs) with close to first-principles accuracy. Most current MLPs rely on atomic energy contributions given as a function of the local chemical environments. Frequently, in addition to total energies, atomic forces are also used to construct the potentials, as they provide detailed local information about the PES. Since many systems are too large for electronic structure calculations, obtaining reliable reference forces from smaller subsystems, such as molecular fragments or clusters, can substantially simplify the construction of the training sets. Here, we propose a method to determine structurally converged molecular fragments, providing reliable atomic forces based on an analysis of the Hessian. The method, which serves as a locality test and allows us to estimate the importance of long-range interactions, is illustrated for a series of molecular model systems and the metal–organic framework MOF-5 as an example for a complex organic–inorganic hybrid material.

Deep potential for face-centered cubic Cu system at finite temperatures

Potential function is critical for molecular dynamics simulation and the state-of-the-art method generating potential functions used in molecular dynamics is based on machine learning with neural networks. This method provides...

Permutationally Invariant Polynomial Expansions with Unrestricted Complexity

A general strategy is presented for constructing and validating permutationally invariant polynomial (PIP) expansions for chemical systems of any stoichiometry. Demonstrations are made for three categories of gas-phase dynamics and kinetics: collisional energy-transfer trajectories for predicting pressure-dependent kinetics, three-body collisions for describing transient van der Waals adducts relevant to atmospheric chemistry, and nonthermal reactivity via quasiclassical trajectories. In total, 30 systems are considered with up to 15 atoms and 39 degrees of freedom. Permutational invariance is enforced in PIP expansions with as many as 13 million terms and 13 permutationally distinct atom types by taking advantage of petascale computational resources. The quality of the PIP expansions is demonstrated through the systematic convergence of in-sample and out-of-sample errors with respect to both the number of training data and the order of the expansion, and these errors are shown to predict errors in the dynamics for both reactive and nonreactive applications. The parallelized code distributed as part of this work enables the automation of PIP generation for complex systems with multiple channels and flexible user-defined symmetry constraints and for automatically removing unphysical unconnected terms from the basis set expansions, all of which are required for simulating complex reactive systems.

Dissociation of hydrogen peroxide in water and methanol through a biased molecular dynamics investigation

The two dissociation channels of HOOH, namely, HOOH and HOOH, in water and methanol are investigated using umbrella-sampling ab initio molecular dynamics. Our potential of mean force calculations reveals the HOOH dissociation to be more favorable in methanol with a free energy barrier of 7.56 kcal/mol, while the HOOH dissociation possesses a free energy barrier of 11.46 kcal/mol. In water, the HOOH dissociation channel is more favorable (8.25 kcal/mol), while the HOOH dissociation process requires a higher free energy (11.28 kcal/mol). Such reaction favorability can be explained by inspecting the formation of secondary radical species during the course of multiple hydrogen donating-accepting processes in each reaction channel. The radical species, that is, H₃ O^• (observed in water) and CH₃ OH₂ ^• (observed in methanol), are the first subordinate species upon the HOOH dissociation. For the HOOH dissociation channel in methanol, the secondary species such as water and formaldehyde can be observed, while the re-generation of HOOH in water can be spotted.

Transferable Multilevel Attention Neural Network for Accurate Prediction of Quantum Chemistry Properties via Multitask Learning

The development of efficient models for predicting specific properties through machine learning is of great importance for the innovation of chemistry and material science. However, predicting global electronic structure properties like Frontier molecular orbital highest occupied molecular orbital (HOMO) and lowest unoccupied molecular orbital (LUMO) energy levels and their HOMO-LUMO gaps from the small-sized molecule data to larger molecules remains a challenge. Here, we develop a multilevel attention neural network, named DeepMoleNet, to enable chemical interpretable insights being fused into multitask learning through (1) weighting contributions from various atoms and (2) taking the atom-centered symmetry functions (ACSFs) as the teacher descriptor. The efficient prediction of 12 properties including dipole moment, HOMO, and Gibbs free energy within chemical accuracy is achieved by using multiple benchmarks, both at the equilibrium and nonequilibrium geometries, including up to 110,000 records of data in QM9, 400,000 records in MD17, and 280,000 records in ANI-1ccx for random split evaluation. The good transferability for predicting larger molecules outside the training set is demonstrated in both equilibrium QM9 and Alchemy data sets at the density functional theory (DFT) level. Additional tests on nonequilibrium molecular conformations from DFT-based MD17 data set and ANI-1ccx data set with coupled cluster accuracy as well as the public test sets of singlet fission molecules, biomolecules, long oligomers, and protein with up to 140 atoms show reasonable predictions for thermodynamics and electronic structure properties. The proposed multilevel attention neural network is applicable to high-throughput screening of numerous chemical species in both equilibrium and nonequilibrium molecular spaces to accelerate rational designs of drug-like molecules, material candidates, and chemical reactions.

Neural Network Potential Energy Surfaces for Small Molecules and Reactions

We review progress in neural network (NN)-based methods for the construction of interatomic potentials from discrete samples (such as ab initio energies) for applications in classical and quantum dynamics including reaction dynamics and computational spectroscopy. The main focus is on methods for building molecular potential energy surfaces (PES) in internal coordinates that explicitly include all many-body contributions, even though some of the methods we review limit the degree of coupling, due either to a desire to limit computational cost or to limited data. Explicit and direct treatment of all many-body contributions is only practical for sufficiently small molecules, which are therefore our primary focus. This includes small molecules on surfaces. We consider direct, single NN PES fitting as well as more complex methods that impose structure (such as a multibody representation) on the PES function, either through the architecture of one NN or by using multiple NNs. We show how NNs are effective in building representations with low-dimensional functions including dimensionality reduction. We consider NN-based approaches to build PESs in the sums-of-product form important for quantum dynamics, ways to treat symmetry, and issues related to sampling data distributions and the relation between PES errors and errors in observables. We highlight combinations of NNs with other ideas such as permutationally invariant polynomials or sums of environment-dependent atomic contributions, which have recently emerged as powerful tools for building highly accurate PESs for relatively large molecular and reactive systems.

Quantum Chemistry in the Age of Machine Learning

As the quantum chemistry (QC) community embraces machine learning (ML), the number of new methods and applications based on the combination of QC and ML is surging. In this Perspective, a view of the current state of affairs in this new and exciting research field is offered, challenges of using machine learning in quantum chemistry applications are described, and potential future developments are outlined. Specifically, examples of how machine learning is used to improve the accuracy and accelerate quantum chemical research are shown. Generalization and classification of existing techniques are provided to ease the navigation in the sea of literature and to guide researchers entering the field. The emphasis of this Perspective is on supervised machine learning.

Machine learning for interatomic potential models

The use of supervised machine learning to develop fast and accurate interatomic potential models is transforming molecular and materials research by greatly accelerating atomic-scale simulations with little loss of accuracy. Three years ago, Jörg Behler published a perspective in this journal providing an overview of some of the leading methods in this field. In this perspective, we provide an updated discussion of recent developments, emerging trends, and promising areas for future research in this field. We include in this discussion an overview of three emerging approaches to developing machine-learned interatomic potential models that have not been extensively discussed in existing reviews: moment tensor potentials, message-passing networks, and symbolic regression.

Instanton rate constant calculations using interpolated potential energy surfaces in nonredundant, rotationally and translationally invariant coordinates

A trivial flaw in the utilization of artificial neural networks in interpolating chemical potential energy surfaces (PES) whose descriptors are Cartesian coordinates is their dependence on simple translations and rotations of the molecule under consideration. A different set of descriptors can be chosen to circumvent this problem, internuclear distances, inverse internuclear distances or z-matrix coordinates are three such descriptors. The objective is to use an interpolated PES in instanton rate constant calculations, hence information on the energy, gradient, and Hessian is required at coordinates in the vicinity of the tunneling path. Instanton theory relies on smoothly fitted Hessians, therefore we use energy, gradients, and Hessians in the training procedure. A major challenge is presented in the proper back-transformation of the output gradients and Hessians from internal coordinates to Cartesian coordinates. We perform comparisons between our method, a previous approach and on-the-fly rate constant calcuations on the hydrogen abstraction from methanol and on the hydrogen addition to isocyanic acid. © 2018Wiley Periodicals, Inc.

Ab Initio Investigation of O-H Dissociation from the Al-OH2 Complex Using Molecular Dynamics and Neural Network Fitting

The dissociation dynamics of the O-H bond in Al-OH2 is investigated on an approximated ab initio potential energy surface (PES). By adopting a dynamic sampling method, we obtain a database of 92 834 configurations. The potential energy for each point is calculated using MP2/6-311G (3df, 2p) calculations; then, a 60-neuron feed-forward neural network is utilized to fit the data to construct an analytic PES. The root-mean-square error (rmse) for the training set is reported as 0.0036 eV, while the rmse for the independent testing set is 0.0034 eV. Such excellent fitting accuracy indeed confirms the reliability of the constructed PES. Subsequently, quasi-classical molecular dynamics (MD) trajectories are performed on the constructed PES at various levels of vibrational excitation in the range of 1.03 to 2.23 eV to investigate the probability of O-H bond dissociation. The results indicate a linear relationship between reaction probability and internal energy, from which we can determine the minimum activation internal energy required for the dissociation as 0.62 eV. Moreover, the O-H bond rupture is shown to be highly correlated with the formation of Al-O bond.

High-Dimensional Neural Network Potentials for Organic Reactions and an Improved Training Algorithm

Artificial neural networks (NNs) represent a relatively recent approach for the prediction of molecular potential energies, suitable for simulations of large molecules and long time scales. By using NNs to fit electronic structure data, it is possible to obtain empirical potentials of high accuracy combined with the computational efficiency of conventional force fields. However, as opposed to the latter, changing bonding patterns and unusual coordination geometries can be described due to the underlying flexible functional form of the NNs. One of the most promising approaches in this field is the high-dimensional neural network (HDNN) method, which is especially adapted to the prediction of molecular properties. While HDNNs have been mostly used to model solid state systems and surface interactions, we present here the first application of the HDNN approach to an organic reaction, the Claisen rearrangement of allyl vinyl ether to 4-pentenal. To construct the corresponding HDNN potential, a new training algorithm is introduced. This algorithm is termed "element-decoupled" global extended Kalman filter (ED-GEKF) and is based on the decoupled Kalman filter. Using a metadynamics trajectory computed with density functional theory as reference data, we show that the ED-GEKF exhibits superior performance - both in terms of accuracy and training speed - compared to other variants of the Kalman filter hitherto employed in HDNN training. In addition, the effect of including forces during ED-GEKF training on the resulting potentials was studied.

Representing potential energy surfaces by high-dimensional neural network potentials

The development of interatomic potentials employing artificial neural networks has seen tremendous progress in recent years. While until recently the applicability of neural network potentials (NNPs) has been restricted to low-dimensional systems, this limitation has now been overcome and high-dimensional NNPs can be used in large-scale molecular dynamics simulations of thousands of atoms. NNPs are constructed by adjusting a set of parameters using data from electronic structure calculations, and in many cases energies and forces can be obtained with very high accuracy. Therefore, NNP-based simulation results are often very close to those gained by a direct application of first-principles methods. In this review, the basic methodology of high-dimensional NNPs will be presented with a special focus on the scope and the remaining limitations of this approach. The development of NNPs requires substantial computational effort as typically thousands of reference calculations are required. Still, if the problem to be studied involves very large systems or long simulation times this overhead is regained quickly. Further, the method is still limited to systems containing about three or four chemical elements due to the rapidly increasing complexity of the configuration space, although many atoms of each species can be present. Due to the ability of NNPs to describe even extremely complex atomic configurations with excellent accuracy irrespective of the nature of the atomic interactions, they represent a general and therefore widely applicable technique, e.g. for addressing problems in materials science, for investigating properties of interfaces, and for studying solvation processes.

Input vector optimization of feed-forward neural networks for fitting ab initio potential-energy databases

The variation in the fitting accuracy of neural networks (NNs) when used to fit databases comprising potential energies obtained from ab initio electronic structure calculations is investigated as a function of the number and nature of the elements employed in the input vector to the NN. Ab initio databases for H(2)O(2), HONO, Si(5), and H(2)C[Double Bond]CHBr were employed in the investigations. These systems were chosen so as to include four-, five-, and six-body systems containing first, second, third, and fourth row elements with a wide variety of chemical bonding and whose conformations cover a wide range of structures that occur under high-energy machining conditions and in chemical reactions involving cis-trans isomerizations, six different types of two-center bond ruptures, and two different three-center dissociation reactions. The ab initio databases for these systems were obtained using density functional theory/B3LYP, MP2, and MP4 methods with extended basis sets. A total of 31 input vectors were investigated. In each case, the elements of the input vector were chosen from interatomic distances, inverse powers of the interatomic distance, three-body angles, and dihedral angles. Both redundant and nonredundant input vectors were investigated. The results show that among all the input vectors investigated, the set employed in the Z-matrix specification of the molecular configurations in the electronic structure calculations gave the lowest NN fitting accuracy for both Si(5) and vinyl bromide. The underlying reason for this result appears to be the discontinuity present in the dihedral angle for planar geometries. The use of trigometric functions of the angles as input elements produced significantly improved fitting accuracy as this choice eliminates the discontinuity. The most accurate fitting was obtained when the elements of the input vector were taken to have the form R(ij) (-n), where the R(ij) are the interatomic distances. When the Levenberg-Marquardt procedure was modified to permit error minimization with respect to n as well as the weights and biases of the NN, the optimum powers were all found to lie in the range of 1.625-2.38 for the four systems studied. No statistically significant increase in fitting accuracy was achieved for vinyl bromide when a different value of n was employed and optimized for each bond type. The rate of change in the fitting error with n is found to be very small when n is near its optimum value. Consequently, good fitting accuracy can be achieved by employing a value of n in the middle of the above range. The use of interparticle distances as elements of the input vector rather than the Z-matrix variables employed in the electronic structure calculations is found to reduce the rms fitting errors by factors of 8.86 and 1.67 for Si(5) and vinyl bromide, respectively. If the interparticle distances are replaced with input elements of the form R(ij) (-n) with n optimized, further reductions in the rms error by a factor of 1.31 to 2.83 for the four systems investigated are obtained. A major advantage of using this procedure to increase NN fitting accuracy rather than increasing the number of neurons or the size of the database is that the required increase in computational effort is very small.