Direct Quantum Dynamics Using Grid-Based Wave Function Propagation and Machine-Learned Potential Energy Surfaces

Machine Learning of Reactive Potentials

In the past two decades, machine learning potentials (MLPs) have driven significant developments in chemical, biological, and material sciences. The construction and training of MLPs enable fast and accurate simulations and analysis of thermodynamic and kinetic properties. This review focuses on the application of MLPs to reaction systems with consideration of bond breaking and formation. We review the development of MLP models, primarily with neural network and kernel-based algorithms, and recent applications of reactive MLPs (RMLPs) to systems at different scales. We show how RMLPs are constructed, how they speed up the calculation of reactive dynamics, and how they facilitate the study of reaction trajectories, reaction rates, free energy calculations, and many other calculations. Different data sampling strategies applied in building RMLPs are also discussed with a focus on how to collect structures for rare events and how to further improve their performance with active learning.

Program Synthesis of Sparse Algorithms for Wave Function and Energy Prediction in Grid-Based Quantum Simulations

We have recently shown how program synthesis (PS), or the concept of "self-writing code", can generate novel algorithms that solve the vibrational Schrödinger equation, providing approximations to the allowed wave functions for bound, one-dimensional (1-D) potential energy surfaces (PESs). The resulting algorithms use a grid-based representation of the underlying wave function ψ(x) and PES V(x), providing codes which represent approximations to standard discrete variable representation (DVR) methods. In this Article, we show how this inductive PS strategy can be improved and modified to enable prediction of both vibrational wave functions and energy eigenvalues of representative model PESs (both 1-D and multidimensional). We show that PS can generate algorithms that offer some improvements in energy eigenvalue accuracy over standard DVR schemes; however, we also demonstrate that PS can identify accurate numerical methods that exhibit desirable computational features, such as employing very sparse (tridiagonal) matrices. The resulting PS-generated algorithms are initially developed and tested for 1-D vibrational eigenproblems, before solution of multidimensional problems is demonstrated; we find that our new PS-generated algorithms can reduce calculation times for grid-based eigenvector computation by an order of magnitude or more. More generally, with further development and optimization, we anticipate that PS-generated algorithms based on effective Hamiltonian approximations, such as those proposed here, could be useful in direct simulations of quantum dynamics via wave function propagation and evaluation of molecular electronic structure.

Predicting Molecular Photochemistry Using Machine-Learning-Enhanced Quantum Dynamics Simulations

The processes which occur after molecules absorb light underpin an enormous range of fundamental technologies and applications, including photocatalysis to enable new chemical transformations, sunscreens to protect against the harmful effects of UV overexposure, efficient photovoltaics for energy generation from sunlight, and fluorescent probes to image the intricate details of complex biomolecular structures. Reflecting this broad range of applications, an enormously versatile set of experiments are now regularly used to interrogate light-driven chemical dynamics, ranging from the typical ultrafast transient absorption spectroscopy used in many university laboratories to the inspiring central facilities around the world, such as the next-generation of X-ray free-electron lasers.Computer simulations of light-driven molecular and material dynamics are an essential route to analyzing the enormous amount of transient electronic and structural data produced by these experimental sources. However, to date, the direct simulation of molecular photochemistry remains a frontier challenge in computational chemical science, simultaneously demanding the accurate treatment of molecular electronic structure, nuclear dynamics, and the impact of nonadiabatic couplings.To address these important challenges and to enable new computational methods which can be integrated with state-of-the-art experimental capabilities, the past few years have seen a burst of activity in the development of "direct" quantum dynamics methods, merging the machine learning of potential energy surfaces (PESs) and nonadiabatic couplings with accurate quantum propagation schemes such as the multiconfiguration time-dependent Hartree (MCTDH) method. The result of this approach is a new generation of direct quantum dynamics tools in which PESs are generated in tandem with wave function propagation, enabling accurate "on-the-fly" simulations of molecular photochemistry. These simulations offer an alternative route toward gaining quantum dynamics insights, circumventing the challenge of generating ab initio electronic structure data for PES fitting by instead only demanding expensive energy evaluations as and when they are needed.In this Account, we describe the chronological evolution of our own contributions to this field, focusing on describing the algorithmic developments that enable direct MCTDH simulations for complex molecular systems moving on multiple coupled electronic states. Specifically, we highlight active learning strategies for generating PESs during grid-based quantum chemical dynamics simulations, and we discuss the development and impact of novel diabatization schemes to enable direct grid-based simulations of photochemical dynamics; these developments are highlighted in a series of benchmark molecular simulations of systems containing multiple nuclear degrees of freedom moving on multiple coupled electronic states. We hope that the ongoing developments reported here represent a major step forward in tools for modeling excited-state chemistry such as photodissociation, proton and electron transfer, and ultrafast energy dissipation in complex molecular systems.

Analyzing Grid-Based Direct Quantum Molecular Dynamics Using Non-Linear Dimensionality Reduction

Grid-based schemes for simulating quantum dynamics, such as the multi-configuration time-dependent Hartree (MCTDH) method, provide highly accurate predictions of the coupled nuclear and electronic dynamics in molecular systems. Such approaches provide a multi-dimensional, time-dependent view of the system wavefunction represented on a coordinate grid; in the case of non-adiabatic simulations, additional information about the state populations adds a further layer of complexity. As such, wavepacket motion on potential energy surfaces which couple many nuclear and electronic degrees-of-freedom can be extremely challenging to analyse in order to extract physical insight beyond the usual expectation-value picture. Here, we show that non-linear dimensionality reduction (NLDR) methods, notably diffusion maps, can be adapted to extract information from grid-based wavefunction dynamics simulations, providing insight into key nuclear motions which explain the observed dynamics. This approach is demonstrated for 2-D and 9-D models of proton transfer in salicylaldimine, as well as 8-D and full 12-D simulations of cis-trans isomerization in ethene; these simulations demonstrate how NLDR can provide alternative views of wavefunction dynamics, and also highlight future developments.

Solving the Schrödinger equation using program synthesis

We demonstrate that a program synthesis approach based on a linear code representation can be used to generate algorithms that approximate the ground-state solutions of one-dimensional time-independent Schrödinger equations constructed with bound polynomial potential energy surfaces (PESs). Here, an algorithm is constructed as a linear series of instructions operating on a set of input vectors, matrices, and constants that define the problem characteristics, such as the PES. Discrete optimization is performed using simulated annealing in order to identify sequences of code-lines, operating on the program inputs that can reproduce the expected ground-state wavefunctions ψ(x) for a set of target PESs. The outcome of this optimization is not simply a mathematical function approximating ψ(x) but is, instead, a complete algorithm that converts the input vectors describing the system into a ground-state solution of the Schrödinger equation. These initial results point the way toward an alternative route for developing novel algorithms for quantum chemistry applications.

On application of deep learning to simplified quantum-classical dynamics in electronically excited states

Deep learning (DL) is applied to simulate non-adiabatic molecular dynamics of phenanthrene, using the time-dependent density functional based tight binding (TD-DFTB) approach for excited states combined with mixed quantum–classical propagation. Reference calculations rely on Tully’s fewest-switches surface hopping (FSSH) algorithm coupled to TD-DFTB, which provides electronic relaxation dynamics in fair agreement with various available experimental results. Aiming at describing the coupled electron-nuclei dynamics in large molecular systems, we then examine the combination of DL for excited-state potential energy surfaces (PESs) with a simplified trajectory surface hopping propagation based on the Belyaev–Lebedev (BL) scheme. We start to assess the accuracy of the TD-DFTB approach upon comparison of the optical spectrum with experimental and higher-level theoretical results. Using the recently developed SchNetPack (Schütt et al 2019 J. Chem. Theory Comput. 15 448–55) for DL applications, we train several models and evaluate their performance in predicting excited-state energies and forces. Then, the main focus is given to the analysis of the electronic population of low-lying excited states computed with the aforementioned methods. We determine the relaxation timescales and compare them with experimental data. Our results show that DL demonstrates its ability to describe the excited-state PESs. When coupled to the simplified BL scheme considered in this study, it provides reliable description of the electronic relaxation in phenanthrene as compared with either the experimental data or the higher-level FSSH/TD-DFTB theoretical results. Furthermore, the DL performance allows high-throughput analysis at a negligible cost.

Machine Learning for Electronically Excited States of Molecules

Electronically excited states of molecules are at the heart of photochemistry, photophysics, as well as photobiology and also play a role in material science. Their theoretical description requires highly accurate quantum chemical calculations, which are computationally expensive. In this review, we focus on not only how machine learning is employed to speed up such excited-state simulations but also how this branch of artificial intelligence can be used to advance this exciting research field in all its aspects. Discussed applications of machine learning for excited states include excited-state dynamics simulations, static calculations of absorption spectra, as well as many others. In order to put these studies into context, we discuss the promises and pitfalls of the involved machine learning techniques. Since the latter are mostly based on quantum chemistry calculations, we also provide a short introduction into excited-state electronic structure methods and approaches for nonadiabatic dynamics simulations and describe tricks and problems when using them in machine learning for excited states of molecules.

Machine Learning for Electronically Excited States of Molecules

Electronically excited states of molecules are at the heart of photochemistry, photophysics, as well as photobiology and also play a role in material science. Their theoretical description requires highly accurate quantum chemical calculations, which are computationally expensive. In this review, we focus on not only how machine learning is employed to speed up such excited-state simulations but also how this branch of artificial intelligence can be used to advance this exciting research field in all its aspects. Discussed applications of machine learning for excited states include excited-state dynamics simulations, static calculations of absorption spectra, as well as many others. In order to put these studies into context, we discuss the promises and pitfalls of the involved machine learning techniques. Since the latter are mostly based on quantum chemistry calculations, we also provide a short introduction into excited-state electronic structure methods and approaches for nonadiabatic dynamics simulations and describe tricks and problems when using them in machine learning for excited states of molecules.

The Quest to Simulate Excited-State Dynamics of Transition Metal Complexes

This Perspective describes current computational efforts in the field of simulating photodynamics of transition metal complexes. We present the typical workflows and feature the strengths and limitations of the different contemporary approaches. From electronic structure methods suitable to describe transition metal complexes to approaches able to simulate their nuclear dynamics under the effect of light, we give particular attention to build a bridge between theory and experiment by critically discussing the different models commonly adopted in the interpretation of spectroscopic experiments and the simulation of particular observables. Thereby, we review all the studies of excited-state dynamics on transition metal complexes, both in gas phase and in solution from reduced to full dimensionality.

Local Measure of Quantum Effects in Quantum Dynamics

The Madelung-de Broglie-Bohm formulation of the Schrödinger equation casts the time-evolution of a wave function as dynamics of an ensemble of quantum, or Bohmian, trajectories, interacting via the nonlocal quantum potential. This trajectory perspective gives insight into the quantumness (or classicality) of a given system due to clear partitioning of the energy into classical and quantum components. Here, we propose a system-independent measure of the quantumness of dynamics, based on the energy time-change, referred to as "quantum power". This measure is local in the coordinate space. Based on applications to model chemical systems, we argue that during the transition from the quantum to classical regime, defined as compression of quantization, the quantum features in dynamics do not "disappear" but are pushed forward in time. This feature may be used to gauge the validity of the semiclassical and other approximate dynamics approaches in applications to anharmonic systems.

Machine-learned potentials for next-generation matter simulations

The choice of simulation methods in computational materials science is driven by a fundamental trade-off: bridging large time- and length-scales with highly accurate simulations at an affordable computational cost. Venturing the investigation of complex phenomena on large scales requires fast yet accurate computational methods. We review the emerging field of machine-learned potentials, which promises to reach the accuracy of quantum mechanical computations at a substantially reduced computational cost. This Review will summarize the basic principles of the underlying machine learning methods, the data acquisition process and active learning procedures. We highlight multiple recent applications of machine-learned potentials in various fields, ranging from organic chemistry and biomolecules to inorganic crystal structure predictions and surface science. We furthermore discuss the developments required to promote a broader use of ML potentials, and the possibility of using them to help solve open questions in materials science and facilitate fully computational materials design.

Molecular excited states through a machine learning lens

Theoretical simulations of electronic excitations and associated processes in molecules are indispensable for fundamental research and technological innovations. However, such simulations are notoriously challenging to perform with quantum mechanical methods. Advances in machine learning open many new avenues for assisting molecular excited-state simulations. In this Review, we track such progress, assess the current state of the art and highlight the critical issues to solve in the future. We overview a broad range of machine learning applications in excited-state research, which include the prediction of molecular properties, improvements of quantum mechanical methods for the calculations of excited-state properties and the search for new materials. Machine learning approaches can help us understand hidden factors that influence photo-processes, leading to a better control of such processes and new rules for the design of materials for optoelectronic applications.

Transferable Multilevel Attention Neural Network for Accurate Prediction of Quantum Chemistry Properties via Multitask Learning

The development of efficient models for predicting specific properties through machine learning is of great importance for the innovation of chemistry and material science. However, predicting global electronic structure properties like Frontier molecular orbital highest occupied molecular orbital (HOMO) and lowest unoccupied molecular orbital (LUMO) energy levels and their HOMO-LUMO gaps from the small-sized molecule data to larger molecules remains a challenge. Here, we develop a multilevel attention neural network, named DeepMoleNet, to enable chemical interpretable insights being fused into multitask learning through (1) weighting contributions from various atoms and (2) taking the atom-centered symmetry functions (ACSFs) as the teacher descriptor. The efficient prediction of 12 properties including dipole moment, HOMO, and Gibbs free energy within chemical accuracy is achieved by using multiple benchmarks, both at the equilibrium and nonequilibrium geometries, including up to 110,000 records of data in QM9, 400,000 records in MD17, and 280,000 records in ANI-1ccx for random split evaluation. The good transferability for predicting larger molecules outside the training set is demonstrated in both equilibrium QM9 and Alchemy data sets at the density functional theory (DFT) level. Additional tests on nonequilibrium molecular conformations from DFT-based MD17 data set and ANI-1ccx data set with coupled cluster accuracy as well as the public test sets of singlet fission molecules, biomolecules, long oligomers, and protein with up to 140 atoms show reasonable predictions for thermodynamics and electronic structure properties. The proposed multilevel attention neural network is applicable to high-throughput screening of numerous chemical species in both equilibrium and nonequilibrium molecular spaces to accelerate rational designs of drug-like molecules, material candidates, and chemical reactions.

Ultrafast Spectroscopy of Photoactive Molecular Systems from First Principles: Where We Stand Today and Where We Are Going

Computational spectroscopy is becoming a mandatory tool for the interpretation of the complex, and often congested, spectral maps delivered by modern non-linear multi-pulse techniques. The fields of Electronic Structure Methods, Non-Adiabatic Molecular Dynamics, and Theoretical Spectroscopy represent the three pillars of the virtual ultrafast optical spectrometer, able to deliver transient spectra in silico from first principles. A successful simulation strategy requires a synergistic approach that balances between the three fields, each one having its very own challenges and bottlenecks. The aim of this Perspective is to demonstrate that, despite these challenges, an impressive agreement between theory and experiment is achievable now regarding the modeling of ultrafast photoinduced processes in complex molecular architectures. Beyond that, some key recent developments in the three fields are presented that we believe will have major impacts on spectroscopic simulations in the very near future. Potential directions of development, pending challenges, and rising opportunities are illustrated.

Machine Learning for Absorption Cross Sections

We present a machine learning (ML) method to accelerate the nuclear ensemble approach (NEA) for computing absorption cross sections. ML-NEA is used to calculate cross sections on vast ensembles of nuclear geometries to reduce the error due to insufficient statistical sampling. The electronic properties-excitation energies and oscillator strengths-are calculated with a reference electronic structure method only for a relatively few points in the ensemble. The KREG model (kernel-ridge-regression-based ML combined with the RE descriptor) as implemented in MLatom is used to predict these properties for the remaining tens of thousands of points in the ensemble without incurring much of additional computational cost. We demonstrate for two examples, benzene and a 9-dicyanomethylene derivative of acridine, that ML-NEA can produce statistically converged cross sections even for very challenging cases and even with as few as several hundreds of training points.

Quantum Chemistry in the Age of Machine Learning

As the quantum chemistry (QC) community embraces machine learning (ML), the number of new methods and applications based on the combination of QC and ML is surging. In this Perspective, a view of the current state of affairs in this new and exciting research field is offered, challenges of using machine learning in quantum chemistry applications are described, and potential future developments are outlined. Specifically, examples of how machine learning is used to improve the accuracy and accelerate quantum chemical research are shown. Generalization and classification of existing techniques are provided to ease the navigation in the sea of literature and to guide researchers entering the field. The emphasis of this Perspective is on supervised machine learning.

Quantum Trajectory Mean-Field Method for Nonadiabatic Dynamics in Photochemistry

The mixed quantum-classical dynamical approaches have been widely used to study nonadiabatic phenomena in photochemistry and photobiology, in which the time evolutions of the electronic and nuclear subsystems are treated based on quantum and classical mechanics, respectively. The key issue is how to deal with coherence and decoherence during the propagation of the two subsystems, which has been the subject of numerous investigations for a few decades. A brief description on Ehrenfest mean-field and surface-hopping (SH) methods is first provided, and then different algorithms for treatment of quantum decoherence are reviewed in the present paper. More attentions were paid to quantum trajectory mean-field (QTMF) method under the picture of quantum measurements, which is able to overcome the overcoherence problem. Furthermore, the combined QTMF and SH algorithm is proposed in the present work, which takes advantages of the QTMF and SH methods. The potential to extend the applicability of the QTMF method was briefly discussed, such as the generalization to other type of nonadiabatic transitions, the combination with multiscale computational models, and possible improvements on its accuracy and efficiency by using machine-learning techniques.

Direct quantum dynamics using variational Gaussian wavepackets and Gaussian process regression

The method of direct variational quantum nuclear dynamics in a basis of Gaussian wavepackets, combined with the potential energy surfaces fitted on-the-fly using Gaussian process regression, is described together with its implementation. Enabling exact and efficient analytic evaluation of Hamiltonian matrix elements, this approach allows for black-box quantum dynamics of multidimensional anharmonic molecular systems. Example calculations of intra-molecular proton transfer on the electronic ground state of salicylaldimine are provided, and future algorithmic improvements as well as the potential for multiple-state non-adiabatic dynamics are discussed.

Can we use on-the-fly quantum simulations to connect molecular structure and sunscreen action?

Direct MCTDH quantum dynamics simulations, with automatic active coordinate generation, applied to potential molecular sunscreens.

Deep Learning for Nonadiabatic Excited-State Dynamics

In this work we show that deep learning (DL) can be used for exploring complex and highly nonlinear multistate potential energy surfaces of polyatomic molecules and related nonadiabatic dynamics. Our DL is based on deep neural networks (DNNs), which are used as accurate representations of the CASSCF ground- and excited-state potential energy surfaces (PESs) of CH₂NH. After geometries near conical intersection are included in the training set, the DNN models accurately reproduce excited-state topological structures; photoisomerization paths; and, importantly, conical intersections. We have also demonstrated that the results from nonadiabatic dynamics run with the DNN models are very close to those from the dynamics run with the pure ab initio method. The present work should encourage further studies of using machine learning methods to explore excited-state potential energy surfaces and nonadiabatic dynamics of polyatomic molecules.

Nonadiabatic Excited-State Dynamics with Machine Learning

We show that machine learning (ML) can be used to accurately reproduce nonadiabatic excited-state dynamics with decoherence-corrected fewest switches surface hopping in a 1-D model system. We propose to use ML to significantly reduce the simulation time of realistic, high-dimensional systems with good reproduction of observables obtained from reference simulations. Our approach is based on creating approximate ML potentials for each adiabatic state using a small number of training points. We investigate the feasibility of this approach by using adiabatic spin-boson Hamiltonian models of various dimensions as reference methods.

Inclusion of Machine Learning Kernel Ridge Regression Potential Energy Surfaces in On-the-Fly Nonadiabatic Molecular Dynamics Simulation

We discuss a theoretical approach that employs machine learning potential energy surfaces (ML-PESs) in the nonadiabatic dynamics simulation of polyatomic systems by taking 6-aminopyrimidine as a typical example. The Zhu-Nakamura theory is employed in the surface hopping dynamics, which does not require the calculation of the nonadiabatic coupling vectors. The kernel ridge regression is used in the construction of the adiabatic PESs. In the nonadiabatic dynamics simulation, we use ML-PESs for most geometries and switch back to the electronic structure calculations for a few geometries either near the S₁/S₀ conical intersections or in the out-of-confidence regions. The dynamics results based on ML-PESs are consistent with those based on CASSCF PESs. The ML-PESs are further used to achieve the highly efficient massive dynamics simulations with a large number of trajectories. This work displays the powerful role of ML methods in the nonadiabatic dynamics simulation of polyatomic systems.

Curve crossing in a manifold of coupled electronic states: direct quantum dynamics simulations of formamide

Quantum dynamics simulations are an important tool to evaluate molecular behaviour including the, often key, quantum nature of the system. In this paper we present an algorithm that is able to simulate the time evolution of a molecule after photo-excitation into a manifold of states. The direct dynamics variational multi-configurational Gaussian (DD-vMCG) method circumvents the computational bottleneck problems of traditional grid-based methods by computing the potential energy functions on-the-fly, i.e. only where required. Unlike other commonly used direct dynamics methods, DD-vMCG is fully quantum mechanical. Here, the method is combined with a novel on-the-fly diabatisation scheme to simulate the short-time dynamics of the key molecule formamide and its acid analogue formimidic acid. This is a challenging test system due to the nature and large number of excited states, and eight coupled states are included in the calculations. It is shown that the method is able to provide unbiased information on the product channels open after excitation at different energies and demonstrates the potential to be a practical scheme, limited mainly by the quality of the quantum chemistry used to describe the excited states.