Construction of reactive potential energy surfaces with Gaussian process regression: active data selection

Chemistry-Informed Generative Model for Classical Dynamics Simulations

In this work, a chemistry-informed generative model was proposed, leading to the chemistry-informed generative adversarial network (CI-GAN) approach. To easily build the input database for complex molecular systems, an image-input algorithm is also implemented, leading to the capability to directly recognize the molecular image. Extensive test calculations and analysis on typical examples, H + H2, OH + HO2, and H2O/TiO2(110), find that the present CI-GAN approach generates distributions of geometry and energy. Calculations on the above examples show that the present CI-GAN approach is able to generate 50%-80% meaningful results among all of the generated data with chemistry constraints. Thus, it has the potential capability to predict classical dynamics simulations as well as ab initio calculations avoiding expensive calculations. These results and the power of CI-GANs in generating ab initio energies and MD trajectories are deeply discussed.

AlF-AlF Reaction Dynamics between 200 K and 1000 K: Reaction Mechanisms and Intermediate Complex Characterization

AlF is a relevant molecule in astrochemistry as a tracer of F-bearing molecules. Additionally, AlF presents diagonal Franck-Condon factors and can be created very efficiently in the lab, which makes it a prototypical molecular for laser cooling. However, very little is known about the reaction dynamics of AlF. In this work, we report on the reaction dynamics of AlF-AlF between 200 and 1000 K using ab initio molecular dynamics and a highly efficient active learning approach for the potential energy surface, including all degrees of freedom. As a result, we identify the main reaction mechanisms and the lifetime of the intermediate complex AlF-AlF relevant to astrochemistry environments and regions in buffer gas cells.

A Gaussian Process Based Δ-Machine Learning Approach to Reactive Potential Energy Surfaces

The Gaussian process (GP) is an efficient nonparametric machine learning (ML) method. A distinct advantage of the GP is its ability to provide an estimate of statistical uncertainties. This is particularly useful in constructing high-dimensional potential energy surfaces (PESs) from ab initio data as it offers an optimal way to add new geometries to reduce the overall error. In this work, GP is employed in the context of Δ-machine learning (Δ-ML), in which a correction PES to an inaccurate low-level PES is constructed using a small number of high-level ab initio calculations. This new method is tested in three prototypical reactive systems, namely, the H + H2 → H + H2, OH + H2 → H2O + H, and H + CH4 → H2 + CH3 reactions. The results show that the GP-based Δ-ML approach is more efficient than its direct application in constructing high-level PESs. We also compare the new method to a previously proposed neural-network-based Δ-ML approach [Liu and Li J. Phys. Chem. Lett. 2022, 13, 4729-4738]. The results indicate that the two Δ-ML methods have comparable efficiencies in constructing accurate PESs.

Molecular dynamics-driven global potential energy surfaces: Application to the AlF dimer

In this work, we present a full-dimensional potential energy surface for AlF-AlF. We apply a general machine learning approach for full-dimensional potential energy surfaces, employing an active learning scheme trained on ab initio points, whose size grows based on the accuracy required. The training points are selected based on molecular dynamics simulations, choosing the most suitable configurations for different collision energy and mapping the most relevant part of the potential energy landscape of the system. The present approach does not require long-range information and is entirely general. As a result, it is possible to provide the full-dimensional AlF-AlF potential energy surface, requiring ≲0.01% of the configurations to be calculated ab initio. Furthermore, we analyze the general properties of the AlF-AlF system, finding critical differences with other reported results on CaF or bi-alkali dimers.

Globally Accurate Gaussian Process Potential Energy Surface and Quantum Dynamics Studies on the Li(2S) + Na2 → LiNa + Na Reaction at Low Collision Energies

The LiNa2 reactive system has recently received great attention in the experimental study of ultracold chemical reactions, but the corresponding theoretical calculations have not been carried out. Here, we report the first globally accurate ground-state LiNa2 potential energy surface (PES) using a Gaussian process model based on only 1776 actively selected high-level ab initio training points. The constructed PES had high precision and strong generalization capability. On the new PES, the quantum dynamics calculations on the Li(2S) + Na2(v = 0, j = 0) → LiNa + Na reaction were carried out in the 0.001–0.01 eV collision energy range using an improved time-dependent wave packet method. The calculated results indicate that this reaction is dominated by a complex-forming mechanism at low collision energies. The presented dynamics data provide guidance for experimental research, and the newly constructed PES could be further used for ultracold reaction dynamics calculations on this reactive system.

The loss of the property of locality of the kernel in high-dimensional Gaussian process regression on the example of the fitting of molecular potential energy surfaces

Kernel-based methods, including Gaussian process regression (GPR) and generally kernel ridge regression, have been finding increasing use in computational chemistry, including the fitting of potential energy surfaces and density functionals in high-dimensional feature spaces. Kernels of the Matern family, such as Gaussian-like kernels (basis functions), are often used which allow imparting to them the meaning of covariance functions and formulating GPR as an estimator of the mean of a Gaussian distribution. The notion of locality of the kernel is critical for this interpretation. It is also critical to the formulation of multi-zeta type basis functions widely used in computational chemistry. We show, on the example of fitting of molecular potential energy surfaces of increasing dimensionality, the practical disappearance of the property of locality of a Gaussian-like kernel in high dimensionality. We also formulate a multi-zeta approach to the kernel and show that it significantly improves the quality of regression in low dimensionality but loses any advantage in high dimensionality, which is attributed to the loss of the property of locality.

Quantitative molecular simulations

All-atom simulations can provide molecular-level insights into the dynamics of gas-phase, condensed-phase and surface processes. One important requirement is a sufficiently realistic and detailed description of the underlying intermolecular interactions. The present perspective provides an overview of the present status of quantitative atomistic simulations from colleagues' and our own efforts for gas- and solution-phase processes and for the dynamics on surfaces. Particular attention is paid to direct comparison with experiment. An outlook discusses present challenges and future extensions to bring such dynamics simulations even closer to reality.

Quantum Gaussian process model of potential energy surface for a polyatomic molecule

With gates of a quantum computer designed to encode multi-dimensional vectors, projections of quantum computer states onto specific qubit states can produce kernels of reproducing kernel Hilbert spaces. We show that quantum kernels obtained with a fixed ansatz implementable on current quantum computers can be used for accurate regression models of global potential energy surfaces (PESs) for polyatomic molecules. To obtain accurate regression models, we apply Bayesian optimization to maximize marginal likelihood by varying the parameters of the quantum gates. This yields Gaussian process models with quantum kernels. We illustrate the effect of qubit entanglement in the quantum kernels and explore the generalization performance of quantum Gaussian processes by extrapolating global six-dimensional PESs in the energy domain.

Atomistic Simulations for Reactions and Vibrational Spectroscopy in the Era of Machine Learning─Quo Vadis?

Atomistic simulations using accurate energy functions can provide molecular-level insight into functional motions of molecules in the gas and in the condensed phase. This Perspective delineates the present status of the field from the efforts of others and some of our own work and discusses open questions and future prospects. The combination of physics-based long-range representations using multipolar charge distributions and kernel representations for the bonded interactions is shown to provide realistic models for the exploration of the infrared spectroscopy of molecules in solution. For reactions, empirical models connecting dedicated energy functions for the reactant and product states allow statistically meaningful sampling of conformational space whereas machine-learned energy functions are superior in accuracy. The future combination of physics-based models with machine-learning techniques and integration into all-purpose molecular simulation software provides a unique opportunity to bring such dynamics simulations closer to reality.

Representing Globally Accurate Reactive Potential Energy Surfaces with Complex Topography by Combining Gaussian Process Regression and Neural Network

There has been increasing attention in using machine learning technologies, such as neural network (NN) and Gaussian process regression (GPR), to model multidimensional potential energy surfaces (PESs). NN PES features...

Gradient domain machine learning with composite kernels: improving the accuracy of PES and force fields for large molecules

The generalization accuracy of machine learning models of potential energy surfaces (PES) and force fields (FF) for large polyatomic molecules can be improved either by increasing the number of training points or by improving the models. In order to build accurate models based on expensive ab initio calculations, much of recent work has focused on the latter. In particular, it has been shown that gradient domain machine learning (GDML) models produce accurate results for high-dimensional molecular systems with a small number of ab initio calculations. The present work extends GDML to models with composite kernels built to maximize inference from a small number of molecular geometries. We illustrate that GDML models can be improved by increasing the complexity of underlying kernels through a greedy search algorithm using Bayesian information criterion as the model selection metric. We show that this requires including anisotropy into kernel functions and produces models with significantly smaller generalization errors. The results are presented for ethanol, uracil, malonaldehyde and aspirin. For aspirin, the model with composite kernels trained by forces at 1000 randomly sampled molecular geometries produces a global 57-dimensional PES with the mean absolute accuracy 0.177 kcal mol−1 (61.9 cm−1) and FFs with the mean absolute error 0.457 kcal mol−1 Å−1.

Active learning of potential-energy surfaces of weakly bound complexes with regression-tree ensembles

Several pool-based active learning (AL) algorithms were employed to model potential-energy surfaces (PESs) with a minimum number of electronic structure calculations. Theoretical and empirical results suggest that superior strategies can be obtained by sampling molecular structures corresponding to large uncertainties in their predictions while at the same time not deviating much from the true distribution of the data. To model PESs in an AL framework, we propose to use a regression version of stochastic query by forest, a hybrid method that samples points corresponding to large uncertainties while avoiding collecting too many points from sparse regions of space. The algorithm is implemented with decision trees that come with relatively small computational costs. We empirically show that this algorithm requires around half the data to converge to the same accuracy in comparison to the uncertainty-based query-by-committee algorithm. Moreover, the algorithm is fully automatic and does not require any prior knowledge of the PES. Simulations on a 6D PES of pyrrole(H₂O) show that <15 000 configurations are enough to build a PES with a generalization error of 16 cm^-1, whereas the final model with around 50 000 configurations has a generalization error of 11 cm^-1.

A full-dimensional ab initio intermolecular potential energy surface and rovibrational spectra for OC-HF and OC-DF

We present a full-dimensional ab initio intermolecular potential energy surface (IPES) for the OC-HF van der Waals complex. 3167 ab initio points were computed at the frozen-core (FC) explicitly correlated coupled cluster [FC-CCSD(T)-F12b] level, with the augmented correlation-consistent polarized valence quadruple-zeta basis set plus bond functions. Basis set superposition error correction was also considered by the full counterpoise procedure. Gaussian process regression (GPR) was used to map out the potential energy surface, while a multipole expansion method was employed to smooth the ab initio noise of intermolecular potential in the long range. The global minimum of -1248.364 cm^-1 was located at the linear configuration with the C atom pointing toward the H atom of the HF molecule. In addition, a local minimum of -602.026 cm^-1 was found at another linear configuration with the O atom pointing toward the H atom of the HF molecule. The eigenstates were calculated on the vibrational averaged four-dimensional IPESs with the mixed radial discrete variable representation/angular finite basis representation method and Lanczos propagation algorithm. The dissociation energy D₀ was calculated to be 701.827 cm^-1, well reproducing the experimental value of 732 ± 2 cm^-1. The dipole moment surfaces were also fitted by GPR from 3132 ab initio points calculated using the coupled cluster method [CCSD(T)] with AVTZ basis set plus bond functions. The frequencies and relative line intensities of rovibrational transitions in the HF (DF) and CO stretching bands were further calculated and compared well with the experimental results. These results indicate the high fidelity of the new IPES.

Machine Learning for Electronically Excited States of Molecules

Electronically excited states of molecules are at the heart of photochemistry, photophysics, as well as photobiology and also play a role in material science. Their theoretical description requires highly accurate quantum chemical calculations, which are computationally expensive. In this review, we focus on not only how machine learning is employed to speed up such excited-state simulations but also how this branch of artificial intelligence can be used to advance this exciting research field in all its aspects. Discussed applications of machine learning for excited states include excited-state dynamics simulations, static calculations of absorption spectra, as well as many others. In order to put these studies into context, we discuss the promises and pitfalls of the involved machine learning techniques. Since the latter are mostly based on quantum chemistry calculations, we also provide a short introduction into excited-state electronic structure methods and approaches for nonadiabatic dynamics simulations and describe tricks and problems when using them in machine learning for excited states of molecules.

Machine Learning for Electronically Excited States of Molecules

Electronically excited states of molecules are at the heart of photochemistry, photophysics, as well as photobiology and also play a role in material science. Their theoretical description requires highly accurate quantum chemical calculations, which are computationally expensive. In this review, we focus on not only how machine learning is employed to speed up such excited-state simulations but also how this branch of artificial intelligence can be used to advance this exciting research field in all its aspects. Discussed applications of machine learning for excited states include excited-state dynamics simulations, static calculations of absorption spectra, as well as many others. In order to put these studies into context, we discuss the promises and pitfalls of the involved machine learning techniques. Since the latter are mostly based on quantum chemistry calculations, we also provide a short introduction into excited-state electronic structure methods and approaches for nonadiabatic dynamics simulations and describe tricks and problems when using them in machine learning for excited states of molecules.

Exploration of transferable and uniformly accurate neural network interatomic potentials using optimal experimental design

Machine learning has been proven to have the potential to bridge the gap between the accuracy of ab initio methods and the efficiency of empirical force fields. Neural networks are one of the most frequently used approaches to construct high-dimensional potential energy surfaces. Unfortunately, they lack an inherent uncertainty estimation which is necessary for efficient and automated sampling through the chemical and conformational space to find extrapolative configurations. The identification of the latter is needed for the construction of transferable and uniformly accurate potential energy surfaces. In this paper, we propose an active learning approach that uses the estimated model’s output variance derived in the framework of the optimal experimental design. This method has several advantages compared to the established active learning approaches, e.g. Query-by-Committee, Monte Carlo dropout, feature and latent distances, in terms of the predictive power and computational efficiency. We have shown that the application of the proposed active learning scheme leads to transferable and uniformly accurate potential energy surfaces constructed using only a small fraction of data points. Additionally, it is possible to define a natural threshold value for the proposed uncertainty metric which offers the possibility to generate highly informative training data on-the-fly.

Searching Configurations in Uncertainty Space: Active Learning of High-Dimensional Neural Network Reactive Potentials

Neural network (NN) potential energy surfaces (PESs) have been widely used in atomistic simulations with ab initio accuracy. While constructing NN PESs, their training data points are often sampled by molecular dynamics trajectories. This strategy can be however inefficient for reactive systems involving rare events. Here, we develop an uncertainty-driven active learning strategy to automatically and efficiently generate high-dimensional NN-based reactive potentials, taking a gas-surface reaction as an example. The difference between two independent NN models is used as a simple and differentiable uncertainty metric, allowing us to quickly search in the uncertainty space and place new samples at which the PES is less reliable. By interfacing this algorithm with the first-principles simulation package, we demonstrate that a globally accurate NN potential of the H₂ + Ag(111) system can be constructed with merely ∼150 data points. This PES can be further refined to describe H₂ dissociation on Ag(100) by adding ∼130 more configurations on this facet. The entire process is completely automatic and self-terminated once the relative error criterion is fulfilled. Impressively, data points sampled by this uncertainty-driven strategy are substantially fewer than by the traditional trajectory-based sampling. The final NN PES not only converges well the quantum dissociation probability of the molecule but also well-reproduces the phonon properties of the substrate and is capable of describing surface temperature effects. These results show the potential of this active learning approach in developing high-dimensional NN reactive potentials in gas and condensed phases.

Time-dependent quantum mechanical wave packet dynamics

Starting from a model study of the collinear (H, H₂) exchange reaction in 1959, the time-dependent quantum mechanical wave packet (TDQMWP) method has come a long way in dealing with systems as large as Cl + CH₄. The fast Fourier transform method for evaluating the second order spatial derivative of the wave function and split-operator method or Chebyshev polynomial expansion for determining the time evolution of the wave function for the system have made the approach highly accurate from a practical point of view. The TDQMWP methodology has been able to predict state-to-state differential and integral reaction cross sections accurately, in agreement with available experimental results for three dimensional (H, H₂) collisions, and identify reactive scattering resonances too. It has become a practical computational tool in predicting the observables for many A + BC exchange reactions in three dimensions and a number of larger systems. It is equally amenable to determining the bound and quasi-bound states for a variety of molecular systems. Just as it is able to deal with dissociative processes (without involving basis set expansion), it is able to deal with multi-mode nonadiabatic dynamics in multiple electronic states with equal ease. We present an overview of the method and its strength and limitations, citing examples largely from our own research groups.

High-Fidelity Potential Energy Surfaces for Gas-Phase and Gas-Surface Scattering Processes from Machine Learning

In this Perspective, we review recent advances in constructing high-fidelity potential energy surfaces (PESs) from discrete ab initio points, using machine learning tools. Such PESs, albeit with substantial initial investments, provide significantly higher efficiency than direct dynamics methods and/or high accuracy at a level that is not affordable by on-the-fly approaches. These PESs not only are a necessity for quantum dynamical studies because of delocalization of wave packets but also enable the study of low-probability and long-time events in (quasi-)classical treatments. Our focus here is on inelastic and reactive scattering processes, which are more challenging than bound systems because of the involvement of continua. Relevant applications and developments for dynamical processes in both the gas phase and at gas-surface interfaces are discussed.

Direct quantum dynamics using variational Gaussian wavepackets and Gaussian process regression

The method of direct variational quantum nuclear dynamics in a basis of Gaussian wavepackets, combined with the potential energy surfaces fitted on-the-fly using Gaussian process regression, is described together with its implementation. Enabling exact and efficient analytic evaluation of Hamiltonian matrix elements, this approach allows for black-box quantum dynamics of multidimensional anharmonic molecular systems. Example calculations of intra-molecular proton transfer on the electronic ground state of salicylaldimine are provided, and future algorithmic improvements as well as the potential for multiple-state non-adiabatic dynamics are discussed.

Modelling potential energy surfaces for small clusters using Shepard interpolation with Gaussian-form nodal functions

A new interpolation method based on Gaussian functions to reliably generate potential energy surfaces.

Bayesian machine learning for quantum molecular dynamics

This article discusses applications of Bayesian machine learning for quantum molecular dynamics.

Neural network potential energy surface and dynamical isotope effects for the N+(3P) + H2 → NH+ + H reaction

Dynamical isotope effects are calculated for the N⁺(³P) + H₂ → NH⁺ + H reaction on a new neural network potential energy surface.