Convolutional Neural Networks for Long Time Dissipative Quantum Dynamics

Unsupervised Machine Learning in the Analysis of Nonadiabatic Molecular Dynamics Simulation

The all-atomic full-dimensional-level simulations of nonadiabatic molecular dynamics (NAMD) in large realistic systems has received high research interest in recent years. However, such NAMD simulations normally generate an enormous amount of time-dependent high-dimensional data, leading to a significant challenge in result analyses. Based on unsupervised machine learning (ML) methods, considerable efforts were devoted to developing novel and easy-to-use analysis tools for the identification of photoinduced reaction channels and the comprehensive understanding of complicated molecular motions in NAMD simulations. Here, we tried to survey recent advances in this field, particularly to focus on how to use unsupervised ML methods to analyze the trajectory-based NAMD simulation results. Our purpose is to offer a comprehensive discussion on several essential components of this analysis protocol, including the selection of ML methods, the construction of molecular descriptors, the establishment of analytical frameworks, their advantages and limitations, and persistent challenges.

Machine-Learned Kohn-Sham Hamiltonian Mapping for Nonadiabatic Molecular Dynamics

In this work, we report a simple, efficient, and scalable machine-learning (ML) approach for mapping non-self-consistent Kohn-Sham Hamiltonians constructed with one kind of density functional to the nearly self-consistent Hamiltonians constructed with another kind of density functional. This approach is designed as a fast surrogate Hamiltonian calculator for use in long nonadiabatic dynamics simulations of large atomistic systems. In this approach, the input and output features are Hamiltonian matrices computed from different levels of theory. We demonstrate that the developed ML-based Hamiltonian mapping method (1) speeds up the calculations by several orders of magnitude, (2) is conceptually simpler than alternative ML approaches, (3) is applicable to different systems and sizes and can be used for mapping Hamiltonians constructed with arbitrary density functionals, (4) requires a modest training data, learns fast, and generates molecular orbitals and their energies with the accuracy nearly matching that of conventional calculations, and (5) when applied to nonadiabatic dynamics simulation of excitation energy relaxation in large systems yields the corresponding time scales within the margin of error of the conventional calculations. Using this approach, we explore the excitation energy relaxation in C60 fullerene and Si75H64 quantum dot structures and derive qualitative and quantitative insights into dynamics in these systems.

Ultrafast Photocontrolled Rotation in a Molecular Motor Investigated by Machine Learning-Based Nonadiabatic Dynamics Simulations

The thermal helix inversion (THI) of the overcrowded alkene-based molecular motors determines the speed of the unidirectional rotation due to the high reaction barrier in the ground state, in comparison with the ultrafast photoreaction process. Recently, a phosphine-based motor has achieved all-photochemical rotation experimentally, promising to be controlled without a thermal step. However, the mechanism of this photochemical reaction has not yet been fully revealed. The comprehensive computational studies on photoisomerization still resort to nonadiabatic molecular dynamics (NAMD) simulations based on electronic structure calculations, which remains a high computational cost for large systems such as molecular motors. Machine learning (ML) has become an accelerating tool in NAMD simulations recently, where excited-state potential energy surfaces (PESs) are constructed analytically with high accuracy, providing an efficient approach for simulations in photochemistry. Herein the reaction pathway is explored by a spin-flip time-dependent density functional theory (SF-TDDFT) approach in combination with ML-based NAMD simulations. According to our computational simulations, we notice that one of the key factors of fulfilling all-photochemical rotation in the phosphine-based motor is that the excitation energies of four isomers are similar. Additionally, a shortcut photoinduced transformation between unstable isomers replaces the THI step, which shares the conical intersection (CI) with photoisomerization. In this study, we provide a practical approach to speed up the NAMD simulations in photochemical reactions for a large system that could be extended to other complex systems.

Quantum computing for near-term applications in generative chemistry and drug discovery

In recent years, drug discovery and life sciences have been revolutionized with machine learning and artificial intelligence (AI) methods. Quantum computing is touted to be the next most significant leap in technology; one of the main early practical applications for quantum computing solutions is predicted to be in quantum chemistry simulations. Here, we review the near-term applications of quantum computing and their advantages for generative chemistry and highlight the challenges that can be addressed with noisy intermediate-scale quantum (NISQ) devices. We also discuss the possible integration of generative systems running on quantum computers into established generative AI platforms.

Trajectory Propagation of Symmetrical Quasi-classical Dynamics with Meyer-Miller Mapping Hamiltonian Using Machine Learning

The long short-term memory recurrent neural network (LSTM-RNN) approach is applied to realize the trajectory-based nonadiabatic dynamics within the framework of the symmetrical quasi-classical dynamics method based on the Meyer-Miller mapping Hamiltonian (MM-SQC). After construction, the LSTM-RNN model allows us to propagate the entire trajectory evolutions of all involved degrees of freedoms (DOFs) from initial conditions. The proposed idea is proven to be reliable and accurate in the simulations of the dynamics of several site-exciton electron-phonon coupling models and three Tully's scattering models. It indicates that the LSTM-RNN model perfectly captures the dynamical information on the trajectory evolution in the MM-SQC dynamics. Our work proposes a novel machine learning approach in the simulation of trajectory-based nonadiabatic dynamic of complex systems with a large number of DOFs.

Fewest-Switches Surface Hopping with Long Short-Term Memory Networks

The mixed quantum-classical dynamical simulation is essential for studying nonadiabatic phenomena in photophysics and photochemistry. In recent years, many machine learning models have been developed to accelerate the time evolution of the nuclear subsystem. Herein, we implement long short-term memory (LSTM) networks as a propagator to accelerate the time evolution of the electronic subsystem during the fewest-switches surface hopping (FSSH) simulations. A small number of reference trajectories are generated using the original FSSH method, and then the LSTM networks can be built, accompanied by careful examination of typical LSTM-FSSH trajectories that employ the same initial condition and random numbers as the corresponding reference. The constructed network is applied to FSSH to further produce a trajectory ensemble to reveal the mechanism of nonadiabatic processes. Taking Tully's three models as test systems, we qualitatively reproduced the collective results. This work demonstrates that LSTM can be applied to the most popular surface hopping simulations.

Quantum machine learning for chemistry and physics

Machine learning (ML) has emerged as a formidable force for identifying hidden but pertinent patterns within a given data set with the objective of subsequent generation of automated predictive behavior. In recent years, it is safe to conclude that ML and its close cousin, deep learning (DL), have ushered in unprecedented developments in all areas of physical sciences, especially chemistry. Not only classical variants of ML, even those trainable on near-term quantum hardwares have been developed with promising outcomes. Such algorithms have revolutionized materials design and performance of photovoltaics, electronic structure calculations of ground and excited states of correlated matter, computation of force-fields and potential energy surfaces informing chemical reaction dynamics, reactivity inspired rational strategies of drug designing and even classification of phases of matter with accurate identification of emergent criticality. In this review we shall explicate a subset of such topics and delineate the contributions made by both classical and quantum computing enhanced machine learning algorithms over the past few years. We shall not only present a brief overview of the well-known techniques but also highlight their learning strategies using statistical physical insight. The objective of the review is not only to foster exposition of the aforesaid techniques but also to empower and promote cross-pollination among future research in all areas of chemistry which can benefit from ML and in turn can potentially accelerate the growth of such algorithms.

One-Shot Trajectory Learning of Open Quantum Systems Dynamics

Nonadiabatic quantum dynamics is important for understanding light-harvesting processes, but its propagation with traditional methods can be rather expensive. Here we present a one-shot trajectory learning approach that allows us to directly make an ultrafast prediction of the entire trajectory of the reduced density matrix for a new set of such simulation parameters as temperature and reorganization energy. The whole 10-ps-long propagation takes 70 ms as we demonstrate on the comparatively large quantum system, the Fenna-Matthews-Olsen (FMO) complex. Our approach also significantly reduces time and memory requirements for training.

Predicting the future of excitation energy transfer in light-harvesting complex with artificial intelligence-based quantum dynamics

Exploring excitation energy transfer (EET) in light-harvesting complexes (LHCs) is essential for understanding the natural processes and design of highly-efficient photovoltaic devices. LHCs are open systems, where quantum effects may play a crucial role for almost perfect utilization of solar energy. Simulation of energy transfer with inclusion of quantum effects can be done within the framework of dissipative quantum dynamics (QD), which are computationally expensive. Thus, artificial intelligence (AI) offers itself as a tool for reducing the computational cost. Here we suggest AI-QD approach using AI to directly predict QD as a function of time and other parameters such as temperature, reorganization energy, etc., completely circumventing the need of recursive step-wise dynamics propagation in contrast to the traditional QD and alternative, recursive AI-based QD approaches. Our trajectory-learning AI-QD approach is able to predict the correct asymptotic behavior of QD at infinite time. We demonstrate AI-QD on seven-sites Fenna-Matthews-Olson (FMO) complex.

Forecasting nonadiabatic dynamics using hybrid convolutional neural network/long short-term memory network

Modeling nonadiabatic dynamics in complex molecular or condensed-phase systems has been challenging, especially for the long-time dynamics. In this work, we propose a time series machine learning scheme based on the hybrid convolutional neural network/long short-term memory (CNN-LSTM) framework for predicting the long-time quantum behavior, given only the short-time dynamics. This scheme takes advantage of both the powerful local feature extraction ability of CNN and the long-term global sequential pattern recognition ability of LSTM. With feature fusion of individually trained CNN-LSTM models for the quantum population and coherence dynamics, the proposed scheme is shown to have high accuracy and robustness in predicting the linearized semiclassical and symmetrical quasiclassical mapping dynamics as well as the mixed quantum-classical Liouville dynamics of various spin-boson models with learning time up to 0.3 ps. Furthermore, if the hybrid network has learned the dynamics of a system, this knowledge is transferable that could significantly enhance the accuracy in predicting the dynamics of a similar system. The hybrid CNN-LSTM network is thus believed to have high predictive power in forecasting the nonadiabatic dynamics in realistic charge and energy transfer processes in photoinduced energy conversion.

Artificial Neural Networks as Propagators in Quantum Dynamics

The utilization of artificial neural networks (ANNs) provides strategies for accelerating molecular simulations. Herein, ANNs are implemented as propagators of the time-dependent Schrödinger equation to simulate the quantum dynamics of systems with time-dependent potentials. These ANN propagators are trained to map nonstationary wavepackets from a given time to a future time within the discrete variable representation. Each propagator is trained for a specified time step, and iterative application of the propagator enables the propagation of wavepackets over long time scales. Such ANN propagators are developed and applied to one- and two-dimensional proton transfer systems, which exhibit nuclear quantum effects such as hydrogen tunneling. These ANN propagators are trained for either a specific time-independent potential or general potentials that can be time-dependent. Hierarchical, multiple time step algorithms enable parallelization, and the extension to higher dimensions is straightforward. This strategy is applicable to quantum dynamical simulations of diverse chemical and biological processes.

Simulation of Open Quantum Dynamics with Bootstrap-Based Long Short-Term Memory Recurrent Neural Network

The recurrent neural network with the long short-term memory cell (LSTM-NN) is employed to simulate the long-time dynamics of open quantum systems. The bootstrap method is applied in the LSTM-NN construction and prediction, which provides a Monte Carlo estimation of a forecasting confidence interval. Within this approach, a large number of LSTM-NNs are constructed by resampling time-series sequences that were obtained from the early stage quantum evolution given by numerically exact multilayer multiconfigurational time-dependent Hartree method. The built LSTM-NN ensemble is used for the reliable propagation of the long-time quantum dynamics, and the simulated result is highly consistent with the exact evolution. The forecasting uncertainty that partially reflects the reliability of the LSTM-NN prediction is also given. This demonstrates the bootstrap-based LSTM-NN approach is a practical and powerful tool to propagate the long-time quantum dynamics of open systems with high accuracy and low computational cost.

Molecular excited states through a machine learning lens

Theoretical simulations of electronic excitations and associated processes in molecules are indispensable for fundamental research and technological innovations. However, such simulations are notoriously challenging to perform with quantum mechanical methods. Advances in machine learning open many new avenues for assisting molecular excited-state simulations. In this Review, we track such progress, assess the current state of the art and highlight the critical issues to solve in the future. We overview a broad range of machine learning applications in excited-state research, which include the prediction of molecular properties, improvements of quantum mechanical methods for the calculations of excited-state properties and the search for new materials. Machine learning approaches can help us understand hidden factors that influence photo-processes, leading to a better control of such processes and new rules for the design of materials for optoelectronic applications.