Accelerated Simulations of Molecular Systems through Learning of Effective Dynamics

Analyzing Multimodal Probability Measures with Autoencoders

Finding collective variables to describe some important coarse-grained information on physical systems, in particular metastable states, remains a key issue in molecular dynamics. Recently, machine learning techniques have been intensively used to complement and possibly bypass expert knowledge in order to construct collective variables. Our focus here is on neural network approaches based on autoencoders. We study some relevant mathematical properties of the loss function considered for training autoencoders and provide physical interpretations based on conditional variances and minimum energy paths. We also consider various extensions in order to better describe physical systems, by incorporating more information on transition states at saddle points, and/or allowing for multiple decoders in order to describe several transition paths. Our results are illustrated on toy two-dimensional systems and on alanine dipeptide.

Developing an Implicit Solvation Machine Learning Model for Molecular Simulations of Ionic Media

Molecular dynamics (MD) simulations of biophysical systems require accurate modeling of their native environment, i.e., aqueous ionic solution, as it critically impacts the structure and function of biomolecules. On the other hand, the models should be computationally efficient to enable simulations of large spatiotemporal scales. Here, we present the deep implicit solvation model for sodium chloride solutions that satisfies both requirements. Owing to the use of the neural network potential, the model can capture the many-body potential of mean force, while the implicit water treatment renders the model inexpensive. We demonstrate our approach first for pure ionic solutions with concentrations ranging from physiological to 2 M. We then extend the model to capture the effective ion interactions in the vicinity and far away from a DNA molecule. In both cases, the structural properties are in good agreement with all-atom MD, showcasing a general methodology for the efficient and accurate modeling of ionic media.

Coarse-Graining and Forecasting Atomic Material Simulations with Descriptors

Atomic simulations of materials require significant resources to generate, store, and analyze. Here, descriptor functions are proposed as a general, metric latent space for atomic structures, ideal for use in large-scale simulations. Descriptors can regress a broad range of properties, including character-dependent dislocation densities, stress states, or radial distribution functions. A vector autoregressive model can generate trajectories over yield points, resample from new initial conditions and forecast trajectory futures. A forecast confidence, essential for practical application, is derived by propagating forecasts through the Mahalanobis outlier distance, providing a powerful tool to assess coarse-grained models. Application to nanoparticles and yielding of nanoscale dislocation networks confirms low uncertainty forecasts are accurate and resampling allows for the propagation of smooth property distributions. Yielding is associated with a collapse in the intrinsic dimension of the descriptor manifold, which is discussed in relation to the yield surface.

Sub-THz acoustic excitation of protein motion

The application of terahertz radiation has been shown to affect both protein structure and cellular function. As the key to such structural changes lies in the dynamic response of a protein, we focus on the susceptibility of the protein's internal dynamics to mechanical stress induced by acoustic pressure waves. We use the open-boundary molecular dynamics method, which allows us to simulate the protein exposed to acoustic waves. By analyzing the dynamic fluctuations of the protein subunits, we demonstrate that the protein is highly susceptible to acoustic waves with frequencies corresponding to those of the internal protein vibrations. This is confirmed by changes in the compactness of the protein structure. As the amplitude of the pressure wave increases, even larger deviations from average positions and larger changes in protein compactness are observed. Furthermore, performing the mode-projection analysis, we show that the breathing-like character of collective modes is enhanced at frequencies corresponding to those used to excite the protein.

Discovering Reaction Pathways, Slow Variables, and Committor Probabilities with Machine Learning

A significant challenge faced by atomistic simulations is the difficulty, and often impossibility, to sample the transitions between metastable states of the free-energy landscape associated with slow molecular processes. Importance-sampling schemes represent an appealing option to accelerate the underlying dynamics by smoothing out the relevant free-energy barriers, but require the definition of suitable reaction-coordinate (RC) models expressed in terms of compact low-dimensional sets of collective variables (CVs). While most computational studies of slow molecular processes have traditionally relied on educated guesses based on human intuition to reduce the dimensionality of the problem at hand, a variety of machine-learning (ML) algorithms have recently emerged as powerful alternatives to discover meaningful CVs capable of capturing the dynamics of the slowest degrees of freedom. Considering a simple paradigmatic situation in which the long-time dynamics is dominated by the transition between two known metastable states, we compare two variational data-driven ML methods based on Siamese neural networks aimed at discovering a meaningful RC model─the slowest decorrelating CV of the molecular process, and the committor probability to first reach one of the two metastable states. One method is the state-free reversible variational approach for Markov processes networks (VAMPnets), or SRVs─the other, inspired by the transition path theory framework, is the variational committor-based neural networks, or VCNs. The relationship and the ability of these methodologies to discover the relevant descriptors of the slow molecular process of interest are illustrated with a series of simple model systems. We also show that both strategies are amenable to importance-sampling schemes through an appropriate reweighting algorithm that approximates the kinetic properties of the transition.

Girsanov Reweighting Enhanced Sampling Technique (GREST): On-the-Fly Data-Driven Discovery of and Enhanced Sampling in Slow Collective Variables

Molecular dynamics simulations of microscopic phenomena are limited by the short integration time steps which are required for numerical stability but which limit the practically achievable simulation time scales. Collective variable (CV) enhanced sampling techniques apply biases to predefined collective coordinates to promote barrier crossing, phase space exploration, and sampling of rare events. The efficacy of these techniques is contingent on the selection of good CVs correlated with the molecular motions governing the long-time dynamical evolution of the system. In this work, we introduce Girsanov Reweighting Enhanced Sampling Technique (GREST) as an adaptive sampling scheme that interleaves rounds of data-driven slow CV discovery and enhanced sampling along these coordinates. Since slow CVs are inherently dynamical quantities, a key ingredient in our approach is the use of both thermodynamic and dynamical Girsanov reweighting corrections for rigorous estimation of slow CVs from biased simulation data. We demonstrate our approach on a toy 1D 4-well potential, a simple biomolecular system alanine dipeptide, and the Trp-Leu-Ala-Leu-Leu (WLALL) pentapeptide. In each case GREST learns appropriate slow CVs and drives sampling of all thermally accessible metastable states starting from zero prior knowledge of the system. We make GREST accessible to the community via a publicly available open source Python package.

Trajectory Propagation of Symmetrical Quasi-classical Dynamics with Meyer-Miller Mapping Hamiltonian Using Machine Learning

The long short-term memory recurrent neural network (LSTM-RNN) approach is applied to realize the trajectory-based nonadiabatic dynamics within the framework of the symmetrical quasi-classical dynamics method based on the Meyer-Miller mapping Hamiltonian (MM-SQC). After construction, the LSTM-RNN model allows us to propagate the entire trajectory evolutions of all involved degrees of freedoms (DOFs) from initial conditions. The proposed idea is proven to be reliable and accurate in the simulations of the dynamics of several site-exciton electron-phonon coupling models and three Tully's scattering models. It indicates that the LSTM-RNN model perfectly captures the dynamical information on the trajectory evolution in the MM-SQC dynamics. Our work proposes a novel machine learning approach in the simulation of trajectory-based nonadiabatic dynamic of complex systems with a large number of DOFs.

Fewest-Switches Surface Hopping with Long Short-Term Memory Networks

The mixed quantum-classical dynamical simulation is essential for studying nonadiabatic phenomena in photophysics and photochemistry. In recent years, many machine learning models have been developed to accelerate the time evolution of the nuclear subsystem. Herein, we implement long short-term memory (LSTM) networks as a propagator to accelerate the time evolution of the electronic subsystem during the fewest-switches surface hopping (FSSH) simulations. A small number of reference trajectories are generated using the original FSSH method, and then the LSTM networks can be built, accompanied by careful examination of typical LSTM-FSSH trajectories that employ the same initial condition and random numbers as the corresponding reference. The constructed network is applied to FSSH to further produce a trajectory ensemble to reveal the mechanism of nonadiabatic processes. Taking Tully's three models as test systems, we qualitatively reproduced the collective results. This work demonstrates that LSTM can be applied to the most popular surface hopping simulations.