Optimal reaction coordinates

Buckets Instead of Umbrellas for Enhanced Sampling and Free Energy Calculations

Umbrella sampling has been a workhorse for free energy calculations in molecular simulations for several decades. In conventional umbrella sampling, restraining bias potentials are strategically applied along one or several collective variables. Major drawbacks associated with this method are the requirement of a large number of bias windows and the poor sampling of the transverse coordinates. In this work, we propose an alternate formalism that departs from the traditional umbrella sampling to mitigate these issues, where we replace umbrella-type restraining bias potentials with bucket-type wall potentials. This modification permits one to formulate an efficient computational strategy leveraging wall potentials and metadynamics sampling. This new method, called "bucket sampling", can significantly reduce the computational cost of obtaining converged high-dimensional free energy surfaces. Extensions of the proposed method with temperature acceleration and replica exchange solute tempering are also demonstrated.

Enhanced Sampling for Conformational Changes and Molecular Mechanisms of Human NTHL1

The functionalities of proteins rely on protein conformational changes during many processes. Identification of the protein conformations and capturing transitions among different conformations are important but extremely challenging in both experiments and simulations. In this work, we develop a machine learning based approach to identify a reaction coordinate that accelerates the exploration of protein conformational changes in molecular simulations. We implement our approach to study the conformational changes of human NTHL1 during DNA repair. Our results identified three distinct conformations: open (stable), closed (unstable), and bundle (stable). The existence of the bundle conformation can rationalize recent experimental observations. Comparison with an NTHL1 mutant demonstrates that a closely packed cluster of positively charged residues in the linker could be a factor to search when screening for genetic abnormalities. Results will lead to a better modulation of the DNA repair pathway to protect against carcinogenesis.

On committor functions in milestoning

As an optimal one-dimensional reaction coordinate, the committor function not only describes the probability of a trajectory initiated at a phase space point first reaching the product state before reaching the reactant state but also preserves the kinetics when utilized to run a reduced dynamics model. However, calculating the committor function in high-dimensional systems poses significant challenges. In this paper, within the framework of milestoning, exact expressions for committor functions at two levels of coarse graining are given, including committor functions of phase space point to point (CFPP) and milestone to milestone (CFMM). When combined with transition kernels obtained from trajectory analysis, these expressions can be utilized to accurately and efficiently compute the committor functions. Furthermore, based on the calculated committor functions, an adaptive algorithm is developed to gradually refine the transition state region. Finally, two model examples are employed to assess the accuracy of these different formulations of committor functions.

Optimal Reaction Coordinates and Kinetic Rates from the Projected Dynamics of Transition Paths

Finding optimal reaction coordinates and predicting accurate kinetic rates for activated processes are two of the foremost challenges of molecular simulations. We introduce an algorithm that tackles the two problems at once: starting from a limited number of reactive molecular dynamics trajectories (transition paths), we automatically generate with a Monte Carlo approach a sequence of different reaction coordinates that progressively reduce the kinetic rate of their projected effective dynamics. Based on a variational principle, the minimal rate accurately approximates the exact one, and it corresponds to the optimal reaction coordinate. After benchmarking the method on an analytic double-well system, we apply it to complex atomistic systems: the interaction of carbon nanoparticles of different sizes in water.

Additive eigenvectors as optimal reaction coordinates, conditioned trajectories, and time-reversible description of stochastic processes

A fundamental way to analyze complex multidimensional stochastic dynamics is to describe it as diffusion on a free energy landscape—free energy as a function of reaction coordinates (RCs). For such a description to be quantitatively accurate, the RC should be chosen in an optimal way. The committor function is a primary example of an optimal RC for the description of equilibrium reaction dynamics between two states. Here, additive eigenvectors (addevs) are considered as optimal RCs to address the limitations of the committor. An addev master equation for a Markov chain is derived. A stationary solution of the equation describes a sub-ensemble of trajectories conditioned on having the same optimal RC for the forward and time-reversed dynamics in the sub-ensemble. A collection of such sub-ensembles of trajectories, called stochastic eigenmodes, can be used to describe/approximate the stochastic dynamics. A non-stationary solution describes the evolution of the probability distribution. However, in contrast to the standard master equation, it provides a time-reversible description of stochastic dynamics. It can be integrated forward and backward in time. The developed framework is illustrated on two model systems—unidirectional random walk and diffusion.

Information Thermodynamics of the Transition-Path Ensemble

The reaction coordinate describing a transition between reactant and product is a fundamental concept in the theory of chemical reactions. Within transition-path theory, a quantitative definition of the reaction coordinate is found in the committor, which is the probability that a trajectory initiated from a given microstate first reaches the product before the reactant. Here we develop an information-theoretic origin for the committor and show how selecting transition paths from a long ergodic equilibrium trajectory induces entropy production which exactly equals the information that system dynamics provide about the reactivity of trajectories. This equality of entropy production and dynamical information generation also holds at the level of arbitrary individual coordinates, providing parallel measures of the coordinate's relevance to the reaction, each of which is maximized by the committor.

Transition rate theory, spectral analysis, and reactive paths

The kinetics of a dynamical system dominated by two metastable states is examined from the perspective of the activated-dynamics reactive flux formalism, Markov state eigenvalue spectral decomposition, and committor-based transition path theory. Analysis shows that the different theoretical formulations are consistent, clarifying the significance of the inherent microscopic lag-times that are implicated, and that the most meaningful one-dimensional reaction coordinate in the region of the transition state is along the gradient of the committor in the multidimensional subspace of collective variables. It is shown that the familiar reactive flux activated dynamics formalism provides an effective route to calculate the transition rate in the case of a narrow sharp barrier but much less so in the case of a broad flat barrier. In this case, the standard reactive flux correlation function decays very slowly to the plateau value that corresponds to the transmission coefficient. Treating the committor function as a reaction coordinate does not alleviate all issues caused by the slow relaxation of the reactive flux correlation function. A more efficient activated dynamics simulation algorithm may be achieved from a modified reactive flux weighted by the committor. Simulation results on simple systems are used to illustrate the various conceptual points.

Explaining reaction coordinates of alanine dipeptide isomerization obtained from deep neural networks using Explainable Artificial Intelligence (XAI)

A method for obtaining appropriate reaction coordinates is required to identify transition states distinguishing product and reactant in complex molecular systems. Recently, abundant research has been devoted to obtaining reaction coordinates using artificial neural networks from deep learning literature, where many collective variables are typically utilized in the input layer. However, it is difficult to explain the details of which collective variables contribute to the predicted reaction coordinates owing to the complexity of the nonlinear functions in deep neural networks. To overcome this limitation, we used Explainable Artificial Intelligence (XAI) methods of the Local Interpretable Model-agnostic Explanation (LIME) and the game theory-based framework known as Shapley Additive exPlanations (SHAP). We demonstrated that XAI enables us to obtain the degree of contribution of each collective variable to reaction coordinates that is determined by nonlinear regressions with deep learning for the committor of the alanine dipeptide isomerization in vacuum. In particular, both LIME and SHAP provide important features to the predicted reaction coordinates, which are characterized by appropriate dihedral angles consistent with those previously reported from the committor test analysis. The present study offers an AI-aided framework to explain the appropriate reaction coordinates, which acquires considerable significance when the number of degrees of freedom increases.

Nonlinear Reaction Coordinate of an Enzyme Catalyzed Proton Transfer Reaction

We present an in-depth study on the theoretical calculation of an optimum reaction coordinate as a linear or nonlinear combination of important collective variables (CVs) sampled from an ensemble of reactive transition paths for an intramolecular proton transfer reaction catalyzed by the enzyme human carbonic anhydrase (HCA) II. The linear models are optimized by likelihood maximization for a given number of CVs. The nonlinear models are based on an artificial neural network with the same number of CVs and optimized by minimizing the root-mean-square error in comparison to a training set of committor estimators generated for the given transition. The nonlinear reaction coordinate thus obtained yields the free energy of activation and rate constant as 9.46 kcal mol^-1 and 1.25 × 10⁶ s^-1, respectively. These estimates are found to be in quantitative agreement with the known experimental results. We have also used an extended autoencoder model to show that a similar analysis can be carried out using a single CV only. The resultant free energies and kinetics of the reaction slightly overestimate the experimental data. The implications of these results are discussed using a detailed microkinetic scheme of the proton transfer reaction catalyzed by HCA II.

Nonparametric Analysis of Nonequilibrium Simulations

We extend the nonparametric framework of reaction coordinate optimization to nonequilibrium ensembles of (short) trajectories. For example, we show how, starting from such an ensemble, one can obtain an equilibrium free-energy profile along the committor, which can be used to determine important properties of the dynamics exactly. A new adaptive sampling approach, the transition-state ensemble enrichment, is suggested, which samples the configuration space by "growing" committor segments toward each other starting from the boundary states. This framework is suggested as a general tool, alternative to the Markov state models, for a rigorous and accurate analysis of simulations of large biomolecular systems, as it has the following attractive properties. It is immune to the curse of dimensionality, does not require system-specific information, can approximate arbitrary reaction coordinates with high accuracy, and has sensitive and rigorous criteria to test optimality and convergence. The approaches are illustrated on a 50-dimensional model system and a realistic protein folding trajectory.

Implementation of the Freely Jointed Chain Model to Assess Kinetics and Thermodynamics of Thermosensitive Coil-Globule Transition by Markov States

We revived and implemented a method developed by Kuhn in 1934, originally only published in German, that is, the so-called “freely jointed chain” model. This approach turned out to be surprisingly useful for analyzing state-of-the-art computer simulations of the thermosensitive coil–globule transition of N-Isopropylacrylamide 20-mer. Our atomistic computer simulations are orders of magnitude longer than those of previous studies and lead to a reliable description of thermodynamics and kinetics at many different temperatures. The freely jointed chain model provides a coordinate system, which allows us to construct a Markov state model of the conformational transitions. Furthermore, this guarantees a reliable reconstruction of the kinetics in back-and-forth directions. In addition, we obtain a description of the high diversity and variability of both conformational states. Thus, we gain a detailed understanding of the coil–globule transition. Surprisingly, conformational entropy turns out to play only a minor role in the thermodynamic balance of the process. Moreover, we show that the radius of gyration is an unexpectedly unsuitable coordinate to comprehend the transition kinetics because it does not capture the high conformational diversity within the different states. Consequently, the approach presented here allows for an exhaustive description and resolution of the conformational ensembles of arbitrary linear polymer chains.

Blind Analysis of Molecular Dynamics

We describe a nonparametric approach for accurate determination of the slowest relaxation eigenvectors of molecular dynamics. The approach is blind as it uses no system specific information. In particular, it does not require a functional form with many parameters to closely approximate eigenvectors, e.g., linear combinations of molecular descriptors or a deep neural network, and thus no extensive expertise with the system. We suggest a rigorous and sensitive validation/optimality criterion for an eigenvector. The criterion uses only eigenvector time series and can be used to validate eigenvectors computed by other approaches. The power of the approach is illustrated on long atomistic protein folding trajectories. The determined eigenvectors pass the validation test at a time scale of 0.2 ns, much shorter than alternative approaches.

Sequential Water and Headgroup Merger: Membrane Poration Paths and Energetics from MD Simulations

Membrane topology changes such as poration, stalk formation, and hemifusion rupture are essential to cellular function, but their molecular details, energetics, and kinetics are still not fully understood. Here, we present a unified energetic and mechanistic picture of metastable pore defects in tensionless lipid membranes. We used an exhaustive committor analysis to test and select optimal reaction coordinates and also to determine the nucleation mechanism. These reaction coordinates were used to calculate free-energy landscapes that capture the full process and end states. The identified barriers agree with the committor analysis. To enable sufficient sampling of the complete transition path for our molecular dynamics simulations, we developed a “gizmo” potential biasing scheme. The simulations suggest that the essential step in the nucleation is the initial merger of lipid headgroups at the nascent pore center. To facilitate this event, an indentation pathway is energetically preferred to a hydrophobic defect. Continuous water columns that span the indentation were determined to be on-path transients that precede the nucleation barrier. This study gives a quantitative description of the nucleation mechanism and energetics of small metastable pores and illustrates a systematic approach to uncover the mechanisms of diverse cellular membrane remodeling processes.

Machine Learning Force Fields and Coarse-Grained Variables in Molecular Dynamics: Application to Materials and Biological Systems

Machine learning encompasses tools and algorithms that are now becoming popular in almost all scientific and technological fields. This is true for molecular dynamics as well, where machine learning offers promises of extracting valuable information from the enormous amounts of data generated by simulation of complex systems. We provide here a review of our current understanding of goals, benefits, and limitations of machine learning techniques for computational studies on atomistic systems, focusing on the construction of empirical force fields from ab initio databases and the determination of reaction coordinates for free energy computation and enhanced sampling.

Microcanonical coarse-graining of the kinetic Ising model

We propose a scheme for coarse-graining the dynamics of the 2-D kinetic Ising model onto the microcanonical ensemble. At subcritical temperatures, 2-D and higher-dimensional Ising lattices possess two basins of attraction separated by a free energy barrier. Projecting onto the microcanonical ensemble has the advantage that the dependence of the crossing rate constant on environmental conditions can be obtained from a single Monte Carlo trajectory. Using various numerical methods, we computed the forward rate constants of coarse-grained representations of the Ising model and compared them with the true value obtained from brute force simulation. While coarse-graining preserves detailed balance, the computed rate constants for barrier heights between 5 kT and 9 kT were consistently 50% larger than the true value. Markovianity testing revealed loss of dynamical memory, which we propose accounts for coarse-graining error. Committor analysis did not support the alternative hypothesis that microcanonical projection is incompatible with an optimal reaction coordinate. The correct crossing rate constant was obtained by spectrally decomposing the diffusion coefficient near the free energy barrier and selecting the slowest (reactive) component. The spectral method also yielded the correct rate constant in the 3-D Ising lattice, where coarse-graining error was 6% and memory effects were diminished. We conclude that microcanonical coarse-graining supplemented by spectral analysis of short-term barrier fluctuations provides a comprehensive kinetic description of barrier crossing in a non-inertial continuous-time jump process.

Assembly of heteropolymers via a network of reaction coordinates

In biochemistry, heteropolymers encoding biological information are assembled out of equilibrium by sequentially incorporating available monomers found in the environment. Current models of polymerization treat monomer incorporation as a sequence of discrete chemical reactions between intermediate metastable states. In this paper, we use ideas from reaction rate theory and describe nonequilibrium assembly of a heteropolymer via a continuous reaction coordinate. Our approach allows for estimating the copy error and incorporation speed from the Gibbs free energy landscape of the process. We apply our theory to several examples from a simple reaction characterized by a free energy barrier to more complex cases incorporating error correction mechanisms, such as kinetic proofreading.

On the removal of initial state bias from simulation data

Classical atomistic simulations of biomolecules play an increasingly important role in molecular life science. The structure of current computing architectures favors methods that run multiple trajectories at once without requiring extensive communication between them. Many advanced sampling strategies in the field fit this mold. These approaches often rely on an adaptive logic and create ensembles of comparatively short trajectories whose starting points are not distributed according to the correct Boltzmann weights. This type of bias is notoriously difficult to remove, and Markov state models (MSMs) are one of the few strategies available for recovering the correct kinetics and thermodynamics from these ensembles of trajectories. In this contribution, we analyze the performance of MSMs in the thermodynamic reweighting task for a hierarchical set of systems. We show that MSMs can be rigorous tools to recover the correct equilibrium distribution for systems of sufficiently low dimensionality. This is conditional upon not tampering with local flux imbalances found in the data. For a real-world application, we find that a pure likelihood-based inference of the transition matrix produces the best results. The removal of the bias is incomplete, however, and for this system, all tested MSMs are outperformed by an alternative albeit less general approach rooted in the ideas of statistical resampling. We conclude by formulating some recommendations for how to address the reweighting issue in practice.

Modeling of Multicolor Single-Molecule Förster Resonance Energy-Transfer Experiments on Protein Folding

Using a coarse-grained, C_α-model of BBL protein, a multicolor single-molecule Förster resonance energy transfer (FRET) experiment is modeled. Three fluorophores are introduced, which, for simplicity, are associated with C_α beads. Two fluorophores are placed at the ends of protein chain and the third one at the middle of the chain. The free-energy surfaces (FESs) depending on the interfluorophore distances and on the FRET efficiencies corresponding to these distances have been constructed and compared with the FESs depending on the conventional collective variables, such as the fraction of native contacts and radius of gyration. It has been found that multicolor experiments can successfully resolve all essential BBL states that are revealed by the conventional FESs. The resolution of these states with the FRET-efficiency histogram is found to be successful if the energy transfer is measured between the fluorophores at the BBL ends. We also show that, although the present model construct of BBL is very simple, it captures some characteristic features of the single-molecule FRET experiments, such as the pattern of the FRET-efficiency histograms and their evolution with the denaturant concentration.

Riemann metric approach to optimal sampling of multidimensional free-energy landscapes

Exploring the free-energy landscape along reaction coordinates or system parameters λ is central to many studies of high-dimensional model systems in physics, e.g., large molecules or spin glasses. In simulations this usually requires sampling conformational transitions or phase transitions, but efficient sampling is often difficult to attain due to the roughness of the energy landscape. For Boltzmann distributions, crossing rates decrease exponentially with free-energy barrier heights. Thus, exponential acceleration can be achieved in simulations by applying an artificial bias along λ tuned such that a flat target distribution is obtained. A flat distribution is, however, an ambiguous concept unless a proper metric is used and is generally suboptimal. Here we propose a multidimensional Riemann metric, which takes the local diffusion into account, and redefine uniform sampling such that it is invariant under nonlinear coordinate transformations. We use the metric in combination with the accelerated weight histogram method, a free-energy calculation and sampling method, to adaptively optimize sampling toward the target distribution prescribed by the metric. We demonstrate that for complex problems, such as molecular dynamics simulations of DNA base-pair opening, sampling uniformly according to the metric, which can be calculated without significant computational overhead, improves sampling efficiency by 50%-70%.

Protein Folding Free Energy Landscape along the Committor - the Optimal Folding Coordinate

Recent advances in simulation and experiment have led to dramatic increases in the quantity and complexity of produced data, which makes the development of automated analysis tools very important. A powerful approach to analyze dynamics contained in such data sets is to describe/approximate it by diffusion on a free energy landscape - free energy as a function of reaction coordinates (RC). For the description to be quantitatively accurate, RCs should be chosen in an optimal way. Recent theoretical results show that such an optimal RC exists; however, determining it for practical systems is a very difficult unsolved problem. Here we describe a solution to this problem. We describe an adaptive nonparametric approach to accurately determine the optimal RC (the committor) for an equilibrium trajectory of a realistic system. In contrast to alternative approaches, which require a functional form with many parameters to approximate an RC and thus extensive expertise with the system, the suggested approach is nonparametric and can approximate any RC with high accuracy without system specific information. To avoid overfitting for a realistically sampled system, the approach performs RC optimization in an adaptive manner by focusing optimization on less optimized spatiotemporal regions of the RC. The power of the approach is illustrated on a long equilibrium atomistic folding simulation of HP35 protein. We have determined the optimal folding RC - the committor, which was confirmed by passing a stringent committor validation test. It allowed us to determine a first quantitatively accurate protein folding free energy landscape. We have confirmed the recent theoretical results that diffusion on such a free energy profile can be used to compute exactly the equilibrium flux, the mean first passage times, and the mean transition path times between any two points on the profile. We have shown that the mean squared displacement along the optimal RC grows linear with time as for simple diffusion. The free energy profile allowed us to obtain a direct rigorous estimate of the pre-exponential factor for the folding dynamics.

Exploratory search during directed navigation in C. elegans and Drosophila larva

Many organisms—from bacteria to nematodes to insect larvae—navigate their environments by biasing random movements. In these organisms, navigation in isotropic environments can be characterized as an essentially diffusive and undirected process. In stimulus gradients, movement decisions are biased to drive directed navigation toward favorable environments. How does directed navigation in a gradient modulate random exploration either parallel or orthogonal to the gradient? Here, we introduce methods originally used for analyzing protein folding trajectories to study the trajectories of the nematode Caenorhabditis elegans and the Drosophila larva in isotropic environments, as well as in thermal and chemical gradients. We find that the statistics of random exploration in any direction are little affected by directed movement along a stimulus gradient. A key constraint on the behavioral strategies of these organisms appears to be the preservation of their capacity to continuously explore their environments in all directions even while moving toward favorable conditions.

Collective variables for the study of long-time kinetics from molecular trajectories: theory and methods

Collective variables are an important concept to study high-dimensional dynamical systems, such as molecular dynamics of macromolecules, liquids, or polymers, in particular to define relevant metastable states and state-transition or phase-transition. Over the past decade, a rigorous mathematical theory has been formulated to define optimal collective variables to characterize slow dynamical processes. Here we review recent developments, including a variational principle to find optimal approximations to slow collective variables from simulation data, and algorithms such as the time-lagged independent component analysis. Using these concepts, a distance metric can be defined that quantifies how slowly molecular conformations interconvert. Extensions and open questions are discussed.

Properties of low-dimensional collective variables in the molecular dynamics of biopolymers

The description of the dynamics of a complex, high-dimensional system in terms of a low-dimensional set of collective variables Y can be fruitful if the low-dimensional representation satisfies a Langevin equation with drift and diffusion coefficients that depend only on Y. We present a computational scheme to evaluate whether a given collective variable provides a faithful low-dimensional representation of the dynamics of a high-dimensional system. The scheme is based on the framework of a finite-difference Langevin equation, similar to that used for molecular-dynamics simulations. This allows one to calculate the drift and diffusion coefficients in any point of the full-dimensional system. The width of the distribution of drift and diffusion coefficients in an ensemble of microscopic points at the same value of Y indicates to what extent the dynamics of Y is described by a simple Langevin equation. Using a simple protein model, we show that collective variables often used to describe biopolymers display a non-negligible width both in the drift and in the diffusion coefficients. We also show that the associated effective force is compatible with the equilibrium free energy calculated from a microscopic sampling, but it results in markedly different dynamical properties.