Interpolation and Extrapolation of Global Potential Energy Surfaces for Polyatomic Systems by Gaussian Processes with Composite Kernels

Quantum and statistical state-to-state studies of cold Ar + H2+ collisions

In this work we present new state-to-state integral scattering cross sections and initial-state selected rate coefficients for the 36Ar (1S) + H2+ (X2Σg+,v = 0,j) reactive system for collision energies up to 0.1 eV (with respect to the 36Ar (1S) + H2+ (X2Σg+,v = 0,j = 0) channel). To the best of our knowledge, these cross sections are the first fully state resolved ones that were obtained by performing time-independent quantum mechanical and quantum statistical calculations. For this purpose a new full-dimensional ground state 2A' adiabatic electronic potential energy surface was calculated at the MRCI+Q/aug-cc-pVQZ level of theory, which was fitted by means of machine learning methods. We find that a statistical quantum method and a statistical adiabatic channel model reproduce quantum mechanical initial-state selected cross sections fairly well, thus suggesting that complex-forming mechanisms seem to be playing an important role in the reaction dynamics of the reaction that was studied.

A Neural Network Potential Energy Surface and Quantum Dynamics Study of Ca(1S) + H2(v 0 = 0, j 0 = 0) → CaH + H Reaction

The reactive collision between Ca and H2 molecules has attracted great interest experimentally due to the key role of the product CaH molecule in the field of astrophysics and cold molecules. However, quantum dynamics calculations for this system have not been reported due to the lack of a global potential energy surface (PES). Herein, a globally accurate PES of the ground-state CaH2 is developed by combining 11365 high-level ab initio points and permutation invariant polynomial neural network method. Based on the newly constructed PES, the state-to-state quantum dynamics calculations for the Ca(1S) + H2 (v 0 = 0, j 0 = 0) → CaH + H reaction are carried out using the time-dependent wave packet method. The dynamic results reveal that the reaction follows the complex-forming mechanism near the reactive threshold, whereas both the indirect insertion mechanism and direct abstraction mechanism have effects at higher collision energies. The newly constructed PES can be used to further study the influence of isotope substitution, rovibrational excitation, and spatial orientation of reactant molecules on reaction dynamics.

Accelerated Bayesian Inference for Molecular Simulations using Local Gaussian Process Surrogate Models

While Bayesian inference is the gold standard for uncertainty quantification and propagation, its use within physical chemistry encounters formidable computational barriers. These bottlenecks are magnified for modeling data with many independent variables, such as X-ray/neutron scattering patterns and electromagnetic spectra. To address this challenge, we employ local Gaussian process (LGP) surrogate models to accelerate Bayesian optimization over these complex thermophysical properties. The time-complexity of the LGPs scales linearly in the number of independent variables, in stark contrast to the computationally expensive cubic scaling of conventional Gaussian processes. To illustrate the method, we trained a LGP surrogate model on the radial distribution function of liquid neon and observed a 1,760,000-fold speed-up compared to molecular dynamics simulation, beating a conventional GP by three orders-of-magnitude. We conclude that LGPs are robust and efficient surrogate models poised to expand the application of Bayesian inference in molecular simulations to a broad spectrum of experimental data.

Machine Learning Representations of the Three Lowest Adiabatic Electronic Potential Energy Surfaces for the ArH2+ Reactive System

In this work, we present Gaussian process regression machine learning representations of the three lowest coupled 2A' adiabatic electronic potential energy surfaces of the ArH2+ reactive system in full dimensionality. Additionally, the nonadiabatic coupling matrix elements were calculated. These adiabatic potentials and their nonadiabatic couplings are necessary ingredients in the theoretical investigation of the nonadiabatic reaction dynamics of the Ar + H2+ → ArH+ + H and Ar+ + H2 → ArH+ + H reactions, as well as the competing charge transfer process, Ar + H2+↔ Ar+ + H2. Accurate ab initio electronic structure calculations (ic-MRCI+Q/aug-cc-pVQZ), whereby the effect of spin-orbit coupling in Ar+ has been accounted for through the state interaction method, serve as input for the machine learning training process. The potential energy surfaces are fitted with high accuracies, with root-mean-square errors on the order of 10-7 eV for the three surfaces, which meet the requirements for chemical dynamics at low temperature. It was found that quite a large number of training points (of the order of 5000 ab initio points) are needed in order to achieve these accuracies due to the complex topography of these electronic surfaces.

Parallel Implementation of Nonadditive Gaussian Process Potentials for Monte Carlo Simulations

A strategy is presented to implement Gaussian process potentials in molecular simulations through parallel programming. Attention is focused on the three-body nonadditive energy, though all algorithms extend straightforwardly to the additive energy. The method to distribute pairs and triplets between processes is general to all potentials. Results are presented for a simulation box of argon, including full box and atom displacement calculations, which are relevant to Monte Carlo simulation. Data on speed-up are presented for up to 120 processes across four nodes. A 4-fold speed-up is observed over five processes, extending to 20-fold over 40 processes and 30-fold over 120 processes.

Globally Accurate Gaussian Process Potential Energy Surface and Quantum Dynamics Studies on the Li(2S) + Na2 → LiNa + Na Reaction at Low Collision Energies

The LiNa2 reactive system has recently received great attention in the experimental study of ultracold chemical reactions, but the corresponding theoretical calculations have not been carried out. Here, we report the first globally accurate ground-state LiNa2 potential energy surface (PES) using a Gaussian process model based on only 1776 actively selected high-level ab initio training points. The constructed PES had high precision and strong generalization capability. On the new PES, the quantum dynamics calculations on the Li(2S) + Na2(v = 0, j = 0) → LiNa + Na reaction were carried out in the 0.001-0.01 eV collision energy range using an improved time-dependent wave packet method. The calculated results indicate that this reaction is dominated by a complex-forming mechanism at low collision energies. The presented dynamics data provide guidance for experimental research, and the newly constructed PES could be further used for ultracold reaction dynamics calculations on this reactive system.

Barrier Height Prediction by Machine Learning Correction of Semiempirical Calculations

Different machine learning (ML) models are proposed in the present work to predict density functional theory-quality barrier heights (BHs) from semiempirical quantum mechanical (SQM) calculations. The ML models include a multitask deep neural network, gradient-boosted trees by means of the XGBoost interface, and Gaussian process regression. The obtained mean absolute errors are similar to those of previous models considering the same number of data points. The ML corrections proposed in this paper could be useful for rapid screening of the large reaction networks that appear in combustion chemistry or in astrochemistry. Finally, our results show that 70% of the features with the highest impact on model output are bespoke predictors. This custom-made set of predictors could be employed by future Δ-ML models to improve the quantitative prediction of other reaction properties.

Machine learning, artificial intelligence, and chemistry: how smart algorithms are reshaping simulation and the laboratory

Machine learning and artificial intelligence are increasingly gaining in prominence through image analysis, language processing, and automation, to name a few applications. Machine learning is also making profound changes in chemistry. From revisiting decades-old analytical techniques for the purpose of creating better calibration curves, to assisting and accelerating traditional in silico simulations, to automating entire scientific workflows, to being used as an approach to deduce underlying physics of unexplained chemical phenomena, machine learning and artificial intelligence are reshaping chemistry, accelerating scientific discovery, and yielding new insights. This review provides an overview of machine learning and artificial intelligence from a chemist’s perspective and focuses on a number of examples of the use of these approaches in computational chemistry and in the laboratory.

Machine learning for non-additive intermolecular potentials: quantum chemistry to first-principles predictions

Prediction of thermophysical properties from molecular principles requires accurate potential energy surfaces (PES). We present a widely-applicable method to produce first-principles PES from quantum chemistry calculations. Our approach accurately interpolates three-body non-additive interaction data, using the machine learning technique, Gaussian Processes (GP). The GP approach needs no bespoke modification when the number or type of molecules is changed. Our method produces highly accurate interpolation from significantly fewer training points than typical approaches, meaning ab initio calculations can be performed at higher accuracy. As an exemplar we compute the PES for all three-body cross interactions for CO₂-Ar mixtures. From these we calculate the CO₂-Ar virial coefficients up to 5th order. The resulting virial equation of state (EoS) is convergent for densities up to the critical density. Where convergent, the EoS makes accurate first-principles predictions for a range of thermophysical properties for CO₂-Ar mixtures, including the compressibility factor, speed of sound and Joule-Thomson coefficient. Our method has great potential to make wide-ranging first-principles predictions for mixtures of comparably sized molecules. Such predictions can replace the need for expensive, laborious and repetitive experiments and inform the continuum models required for applications.

Quantum Gaussian process model of potential energy surface for a polyatomic molecule

With gates of a quantum computer designed to encode multi-dimensional vectors, projections of quantum computer states onto specific qubit states can produce kernels of reproducing kernel Hilbert spaces. We show that quantum kernels obtained with a fixed ansatz implementable on current quantum computers can be used for accurate regression models of global potential energy surfaces (PESs) for polyatomic molecules. To obtain accurate regression models, we apply Bayesian optimization to maximize marginal likelihood by varying the parameters of the quantum gates. This yields Gaussian process models with quantum kernels. We illustrate the effect of qubit entanglement in the quantum kernels and explore the generalization performance of quantum Gaussian processes by extrapolating global six-dimensional PESs in the energy domain.

Inclusion of More Physics Leads to Less Data: Learning the Interaction Energy as a Function of Electron Deformation Density with Limited Training Data

Machine learning (ML) approaches to predicting quantum mechanical (QM) properties have made great strides toward achieving the computational chemist's holy grail of structure-based property prediction. In contrast to direct ML methods, which encode a molecule with only structural information, in this work, we show that QM descriptors improve ML predictions of dimer interaction energy, both in terms of accuracy and data efficiency, by incorporating electronic information into the descriptor. We present the electron deformation density interaction energy machine learning (EDDIE-ML) model, which predicts the interaction energy as a function of Hartree-Fock electron deformation density. We compare its performance with leading direct ML schemes and modern DFT methods for the prediction of interaction energies for dimers of varying charge type, size, and intermolecular separation. Under a low-data regime, EDDIE-ML outperforms other direct ML schemes and is the only model readily transferrable to larger, more complex systems including base pair trimers and porous cages. The underlying physical connection between the density and interaction energy enables EDDIE-ML to reach an accuracy comparable to modern DFT functionals in fewer training data points compared to other ML methods.

Representing Globally Accurate Reactive Potential Energy Surfaces with Complex Topography by Combining Gaussian Process Regression and Neural Network

There has been increasing attention in using machine learning technologies, such as neural network (NN) and Gaussian process regression (GPR), to model multidimensional potential energy surfaces (PESs). NN PES features...

A new permutation-symmetry-adapted machine learning diabatization procedure and its application in MgH2 system

This work introduces a new permutation-symmetry-adapted machine learning diabatization procedure, termed the diabatization by equivariant neural network (DENN). In this approach, the permutation symmetric and anti-symmetric elements in diabatic potential energy metrics (DPEMs) were simultaneously simulated by the equivariant neural network. The diabatization by deep neural network scheme was adopted for machine learning diabatization, and non-zero diabatic coupling was included to increase accuracy in the near degenerate region. Based on DENN, the global DPEMs for 1¹A' and 2¹A' states of MgH₂ have been constructed. To the best of our knowledge, these are the first global DPEMs for the MgH₂ system. The root-mean-square-errors (RMSEs) for diagonal elements (H₁₁ and H₂₂) and the off-diagonal element (H₁₂) around the conical intersection region were 5.824, 5.307, and 5.796 meV, respectively. The RMSEs of global adiabatic energies for two adiabatic states were 4.613 and 12.755 meV, respectively. The spectroscopic calculations of the 1¹A' state in the linear HMgH region are in good agreement with the experiment and previous theoretical results. The differences between calculated frequencies and corresponding experiment values are 1.38 and 1.08 cm^-1 for anti-symmetric stretching fundamental vibrational frequency and first overtone. The global DPEMs obtained in this work should be useful for further quantum mechanics dynamic simulations on the MgH₂ system.

Gradient domain machine learning with composite kernels: improving the accuracy of PES and force fields for large molecules

The generalization accuracy of machine learning models of potential energy surfaces (PES) and force fields (FF) for large polyatomic molecules can be improved either by increasing the number of training points or by improving the models. In order to build accurate models based on expensive ab initio calculations, much of recent work has focused on the latter. In particular, it has been shown that gradient domain machine learning (GDML) models produce accurate results for high-dimensional molecular systems with a small number of ab initio calculations. The present work extends GDML to models with composite kernels built to maximize inference from a small number of molecular geometries. We illustrate that GDML models can be improved by increasing the complexity of underlying kernels through a greedy search algorithm using Bayesian information criterion as the model selection metric. We show that this requires including anisotropy into kernel functions and produces models with significantly smaller generalization errors. The results are presented for ethanol, uracil, malonaldehyde and aspirin. For aspirin, the model with composite kernels trained by forces at 1000 randomly sampled molecular geometries produces a global 57-dimensional PES with the mean absolute accuracy 0.177 kcal mol−1 (61.9 cm−1) and FFs with the mean absolute error 0.457 kcal mol−1 Å−1.

Quantum transfer through small networks coupled to phonons: Effects of topology versus phonons

Particle or energy transfer through quantum networks is determined by network topology and couplings to environments. This study examines the combined effect of topology and external couplings on the efficiency of directional quantum transfer through quantum networks. We consider a microscopic model of qubit networks coupled to external vibrations by Holstein and Peierls couplings. By treating the positions of the network sites and the site-dependent phonon frequencies as independent variables, we determine the Hamiltonian parameters corresponding to minimum transfer time by Bayesian optimization. The results show that Holstein couplings may accelerate transfer through suboptimal network configurations but cannot accelerate quantum dynamics beyond the limit of the transfer time in an optimal phonon-free configuration. By contrast, Peierls couplings distort the optimal networks to accelerate quantum transfer through configurations with less than six sites. However, the speed-up offered by Peierls couplings decreases with the network size and disappears for networks with more than seven sites. For networks with seven sites or more, Peierls couplings distort the optimal network configurations and change the mechanism of quantum transfer but do not affect the lower limit of the transfer time. The machine-learning approach demonstrated here can be applied to determine quantum speed limits in other applications.

Gaussian process models of potential energy surfaces with boundary optimization

A strategy is outlined to reduce the number of training points required to model intermolecular potentials using Gaussian processes, without reducing accuracy. An asymptotic function is used at a long range, and the crossover distance between this model and the Gaussian process is learnt from the training data. The results are presented for different implementations of this procedure, known as boundary optimization, across the following dimer systems: CO-Ne, HF-Ne, HF-Na⁺, CO₂-Ne, and (CO₂)₂. The technique reduces the number of training points, at fixed accuracy, by up to ∼49%, compared to our previous work based on a sequential learning technique. The approach is readily transferable to other statistical methods of prediction or modeling problems.

Active learning of potential-energy surfaces of weakly bound complexes with regression-tree ensembles

Several pool-based active learning (AL) algorithms were employed to model potential-energy surfaces (PESs) with a minimum number of electronic structure calculations. Theoretical and empirical results suggest that superior strategies can be obtained by sampling molecular structures corresponding to large uncertainties in their predictions while at the same time not deviating much from the true distribution of the data. To model PESs in an AL framework, we propose to use a regression version of stochastic query by forest, a hybrid method that samples points corresponding to large uncertainties while avoiding collecting too many points from sparse regions of space. The algorithm is implemented with decision trees that come with relatively small computational costs. We empirically show that this algorithm requires around half the data to converge to the same accuracy in comparison to the uncertainty-based query-by-committee algorithm. Moreover, the algorithm is fully automatic and does not require any prior knowledge of the PES. Simulations on a 6D PES of pyrrole(H₂O) show that <15 000 configurations are enough to build a PES with a generalization error of 16 cm^-1, whereas the final model with around 50 000 configurations has a generalization error of 11 cm^-1.

Machine Learning for Chemical Reactions

Machine learning (ML) techniques applied to chemical reactions have a long history. The present contribution discusses applications ranging from small molecule reaction dynamics to computational platforms for reaction planning. ML-based techniques can be particularly relevant for problems involving both computation and experiments. For one, Bayesian inference is a powerful approach to develop models consistent with knowledge from experiments. Second, ML-based methods can also be used to handle problems that are formally intractable using conventional approaches, such as exhaustive characterization of state-to-state information in reactive collisions. Finally, the explicit simulation of reactive networks as they occur in combustion has become possible using machine-learned neural network potentials. This review provides an overview of the questions that can and have been addressed using machine learning techniques, and an outlook discusses challenges in this diverse and stimulating field. It is concluded that ML applied to chemistry problems as practiced and conceived today has the potential to transform the way with which the field approaches problems involving chemical reactions, in both research and academic teaching.

Full-dimensional potential energy surface for acetylacetone and tunneling splittings

New, full-dimensional potential energy surface for acetylacetone allows for description of H-tunneling dynamics and characterization of stationary points.

High-Fidelity Potential Energy Surfaces for Gas-Phase and Gas-Surface Scattering Processes from Machine Learning

In this Perspective, we review recent advances in constructing high-fidelity potential energy surfaces (PESs) from discrete ab initio points, using machine learning tools. Such PESs, albeit with substantial initial investments, provide significantly higher efficiency than direct dynamics methods and/or high accuracy at a level that is not affordable by on-the-fly approaches. These PESs not only are a necessity for quantum dynamical studies because of delocalization of wave packets but also enable the study of low-probability and long-time events in (quasi-)classical treatments. Our focus here is on inelastic and reactive scattering processes, which are more challenging than bound systems because of the involvement of continua. Relevant applications and developments for dynamical processes in both the gas phase and at gas-surface interfaces are discussed.