Iterative Reconstruction of Memory Kernels

A Gauss-Newton method for iterative optimization of memory kernels for generalized Langevin thermostats in coarse-grained molecular dynamics simulations

In molecular dynamics simulations, dynamically consistent coarse-grained (CG) models commonly use stochastic thermostats to model friction and fluctuations that are lost in a CG description. While Markovian, i.e., time-local, formulations of such thermostats allow for an accurate representation of diffusivities/long-time dynamics, a correct description of the dynamics on all time scales generally requires non-Markovian, i.e., non-time-local, thermostats. These thermostats typically take the form of a Generalized Langevin Equation (GLE) determined by a memory kernel. In this work, we use a Markovian embedded formulation of a position-independent GLE thermostat acting independently on each CG degree of freedom. Extracting the memory kernel of this CG model from atomistic reference data requires several approximations. Therefore, this task is best understood as an inverse problem. While our recently proposed approximate Newton scheme allows for the iterative optimization of memory kernels (IOMK), Markovian embedding remained potentially error-prone and computationally expensive. In this work, we present an IOMK-Gauss-Newton scheme (IOMK-GN) based on IOMK that allows for the direct parameterization of a Markovian embedded model.

Accurate Memory Kernel Extraction from Discretized Time-Series Data

Memory effects emerge as a fundamental consequence of dimensionality reduction when low-dimensional observables are used to describe the dynamics of complex many-body systems. In the context of molecular dynamics (MD) data analysis, accounting for memory effects using the framework of the generalized Langevin equation (GLE) has proven efficient, accurate, and insightful, particularly when working with high-resolution time series data. However, in experimental systems, high-resolution data are often unavailable, raising questions about the impact of the data resolution on the estimated GLE parameters. This study demonstrates that direct memory extraction from time series data remains accurate when the discretization time is below the memory time. To obtain memory functions reliably, even when the discretization time exceeds the memory time, we introduce a Gaussian Process Optimization (GPO) scheme. This scheme minimizes the deviation of discretized two-point correlation functions between time series data and GLE simulations and is able to estimate accurate memory kernels as long as the discretization time stays below the longest time scale in the data, typically the barrier crossing time.

Chemically Specific Systematic Coarse-Grained Polymer Model with Both Consistently Structural and Dynamical Properties

The coarse-grained (CG) model serves as a powerful tool for the simulation of polymer systems; its reliability depends on the accurate representation of both structural and dynamical properties. However, strong correlations between structural and dynamical properties on different scales and also a strong memory effect, enforced by chain connectivity between monomers in polymer systems, render developing a chemically specific systematic CG model a formidable task. In this study, we report a systematic CG approach that combines the iterative Boltzmann inversion (IBI) method and the generalized Langevin equation (GLE) dynamics. Structural properties are ensured by using conservative CG potentials derived from the IBI method. To retrieve the correct dynamical properties in the system, we demonstrate that using a combination of a Rouse-type delta function and a time-dependent short-time kernel in the GLE simulation is practically efficient. The former can be used to adjust the long-time diffusion dynamics, and the latter can be reconstructed from an iterative procedure according to the velocity autocorrelation function (ACF) from all-atomistic (AA) simulations. Taking the polystyrene as an example, we show that not only structural properties of radial distribution function, intramolecular bond, and angle distributions can be reproduced but also dynamical properties of mean-square displacement, velocity ACF, and force ACF resulted from our CG model have quantitative agreement with the reference AA model. In addition, reasonable agreements are observed in other collective properties between our GLE-CG model and the AA simulations as well.

Force renormalization for probes immersed in an active bath

Langevin equations or generalized Langevin equations (GLEs) are popular models for describing the motion of a particle in a fluid medium in an effective manner. Here we examine particles immersed in an inherently nonequilibrium fluid, i.e., an active bath, which are subject to an external force. Specifically, we consider two types of forces that are highly relevant for microrheological studies: A harmonic, trapping force and a constant, "drag" force. We study such systems by molecular simulations and use the simulation data to extract an effective GLE description. We find that within this description, in an active bath, the external force in the GLE is not equal to the physical external force, but rather a renormalized external force, which can be significantly smaller. The effect cannot be attributed to the mere temperature renormalization, which is also observed.

Inferring free-energy barriers and kinetic rates from molecular dynamics via underdamped Langevin models

Rare events include many of the most interesting transformation processes in condensed matter, from phase transitions to biomolecular conformational changes to chemical reactions. Access to the corresponding mechanisms, free-energy landscapes and kinetic rates can in principle be obtained by different techniques after projecting the high-dimensional atomic dynamics on one (or a few) collective variable. Even though it is well-known that the projected dynamics approximately follows - in a statistical sense - the generalized, underdamped or overdamped Langevin equations (depending on the time resolution), to date it is nontrivial to parameterize such equations starting from a limited, practically accessible amount of non-ergodic trajectories. In this work we focus on Markovian, underdamped Langevin equations, that arise naturally when considering, e.g., numerous water-solution processes at sub-picosecond resolution. After contrasting the advantages and pitfalls of different numerical approaches, we present an efficient parametrization strategy based on a limited set of molecular dynamics data, including equilibrium trajectories confined to minima and few hundreds transition path sampling-like trajectories. Employing velocity autocorrelation or memory kernel information for learning the friction and likelihood maximization for learning the free-energy landscape, we demonstrate the possibility to reconstruct accurate barriers and rates both for a benchmark system and for the interaction of carbon nanoparticles in water.

Understanding dynamics in coarse-grained models. III. Roles of rotational motion and translation-rotation coupling in coarse-grained dynamics

This paper series aims to establish a complete correspondence between fine-grained (FG) and coarse-grained (CG) dynamics by way of excess entropy scaling (introduced in Paper I). While Paper II successfully captured translational motions in CG systems using a hard sphere mapping, the absence of rotational motions in single-site CG models introduces differences between FG and CG dynamics. In this third paper, our objective is to faithfully recover atomistic diffusion coefficients from CG dynamics by incorporating rotational dynamics. By extracting FG rotational diffusion, we unravel, for the first time reported to our knowledge, a universality in excess entropy scaling between the rotational and translational diffusion. Once the missing rotational dynamics are integrated into the CG translational dynamics, an effective translation-rotation coupling becomes essential. We propose two different approaches for estimating this coupling parameter: the rough hard sphere theory with acentric factor (temperature-independent) or the rough Lennard-Jones model with CG attractions (temperature-dependent). Altogether, we demonstrate that FG diffusion coefficients can be recovered from CG diffusion coefficients by (1) incorporating "entropy-free" rotational diffusion with translation-rotation coupling and (2) recapturing the missing entropy. Our findings shed light on the fundamental relationship between FG and CG dynamics in molecular fluids.

Construction of Coarse-Grained Molecular Dynamics with Many-Body Non-Markovian Memory

We introduce a machine-learning-based coarse-grained molecular dynamics model that faithfully retains the many-body nature of the intermolecular dissipative interactions. Unlike the common empirical coarse-grained models, the present model is constructed based on the Mori-Zwanzig formalism and naturally inherits the heterogeneous state-dependent memory term rather than matching the mean-field metrics such as the velocity autocorrelation function. Numerical results show that preserving the many-body nature of the memory term is crucial for predicting the collective transport and diffusion processes, where empirical forms generally show limitations.

General theory of the viscosity of liquids and solids from nonaffine particle motions

A microscopic formula for the viscosity of liquids and solids is derived rigorously from a first-principles (microscopically reversible) Hamiltonian for particle-bath atomistic motion. The derivation is done within the framework of nonaffine linear response theory. This formula may lead to a valid alternative to the Green-Kubo approach to describe the viscosity of condensed matter systems from molecular simulations without having to fit long-time tails. Furthermore, it provides a direct link between the viscosity, the vibrational density of states of the system, and the zero-frequency limit of the memory kernel. Finally, it provides a microscopic solution to Maxwell's interpolation problem of viscoelasticity by naturally recovering Newton's law of viscous flow and Hooke's law of elastic solids in two opposite limits.

Modeling Surface Vibrations and Their Role in Molecular Adsorption: A Generalized Langevin Approach

The atomic vibrations of a solid surface can play a significant role in the reactions of surface-bound molecules, as well as their adsorption and desorption. Relevant phonon modes can involve the collective motion of atoms over a wide array of length scales. In this paper, we demonstrate how the generalized Langevin equation can be utilized to describe these collective motions weighted by their coupling to individual sites. Our approach builds upon the generalized Langevin oscillator (GLO) model originally developed by Tully. We extend the GLO by deriving parameters from atomistic simulation data. We apply this approach to study the memory kernel of a model platinum surface and demonstrate that the memory kernel has a bimodal form due to coupling to both low-energy acoustic modes and high-energy modes near the Debye frequency. The same bimodal form was observed across a wide variety of solids of different elemental compositions, surface structures, and solvation states. By studying how these dominant modes depend on the simulation size, we argue that the acoustic modes are frozen in the limit of macroscopic lattices. By simulating periodically replicated slabs of various sizes, we quantify the influence of phonon confinement effects in the memory kernel and their concomitant effect on simulated sticking coefficients.

A deep learning approach to the measurement of long-lived memory kernels from generalized Langevin dynamics

Memory effects are ubiquitous in a wide variety of complex physical phenomena, ranging from glassy dynamics and metamaterials to climate models. The Generalized Langevin Equation (GLE) provides a rigorous way to describe memory effects via the so-called memory kernel in an integro-differential equation. However, the memory kernel is often unknown, and accurately predicting or measuring it via, e.g., a numerical inverse Laplace transform remains a herculean task. Here, we describe a novel method using deep neural networks (DNNs) to measure memory kernels from dynamical data. As a proof-of-principle, we focus on the notoriously long-lived memory effects of glass-forming systems, which have proved a major challenge to existing methods. In particular, we learn the operator mapping dynamics to memory kernels from a training set generated with the Mode-Coupling Theory (MCT) of hard spheres. Our DNNs are remarkably robust against noise, in contrast to conventional techniques. Furthermore, we demonstrate that a network trained on data generated from analytic theory (hard-sphere MCT) generalizes well to data from simulations of a different system (Brownian Weeks-Chandler-Andersen particles). Finally, we train a network on a set of phenomenological kernels and demonstrate its effectiveness in generalizing to both unseen phenomenological examples and supercooled hard-sphere MCT data. We provide a general pipeline, KernelLearner, for training networks to extract memory kernels from any non-Markovian system described by a GLE. The success of our DNN method applied to noisy glassy systems suggests that deep learning can play an important role in the study of dynamical systems with memory.

Memory Unlocks the Future of Biomolecular Dynamics: Transformative Tools to Uncover Physical Insights Accurately and Efficiently

Conformational changes underpin function and encode complex biomolecular mechanisms. Gaining atomic-level detail of how such changes occur has the potential to reveal these mechanisms and is of critical importance in identifying drug targets, facilitating rational drug design, and enabling bioengineering applications. While the past two decades have brought Markov state model techniques to the point where practitioners can regularly use them to glimpse the long-time dynamics of slow conformations in complex systems, many systems are still beyond their reach. In this Perspective, we discuss how including memory (i.e., non-Markovian effects) can reduce the computational cost to predict the long-time dynamics in these complex systems by orders of magnitude and with greater accuracy and resolution than state-of-the-art Markov state models. We illustrate how memory lies at the heart of successful and promising techniques, ranging from the Fokker-Planck and generalized Langevin equations to deep-learning recurrent neural networks and generalized master equations. We delineate how these techniques work, identify insights that they can offer in biomolecular systems, and discuss their advantages and disadvantages in practical settings. We show how generalized master equations can enable the investigation of, for example, the gate-opening process in RNA polymerase II and demonstrate how our recent advances tame the deleterious influence of statistical underconvergence of the molecular dynamics simulations used to parameterize these techniques. This represents a significant leap forward that will enable our memory-based techniques to interrogate systems that are currently beyond the reach of even the best Markov state models. We conclude by discussing some current challenges and future prospects for how exploiting memory will open the door to many exciting opportunities.

Perspective: How to overcome dynamical density functional theory

We argue in favour of developing a comprehensive dynamical theory for rationalizing, predicting, designing, and machine learning nonequilibrium phenomena that occur in soft matter. To give guidance for navigating the theoretical and practical challenges that lie ahead, we discuss and exemplify the limitations of dynamical density functional theory (DDFT). Instead of the implied adiabatic sequence of equilibrium states that this approach provides as a makeshift for the true time evolution, we posit that the pending theoretical tasks lie in developing a systematic understanding of the dynamical functional relationships that govern the genuine nonequilibrium physics. While static density functional theory gives a comprehensive account of the equilibrium properties of many-body systems, we argue that power functional theory is the only present contender to shed similar insights into nonequilibrium dynamics, including the recognition and implementation of exact sum rules that result from the Noether theorem. As a demonstration of the power functional point of view, we consider an idealized steady sedimentation flow of the three-dimensional Lennard-Jones fluid and machine-learn the kinematic map from the mean motion to the internal force field. The trained model is capable of both predicting and designing the steady state dynamics universally for various target density modulations. This demonstrates the significant potential of using such techniques in nonequilibrium many-body physics and overcomes both the conceptual constraints of DDFT as well as the limited availability of its analytical functional approximations.

Simple and efficient algorithms based on Volterra equations to compute memory kernels and projected cross-correlation functions from molecular dynamics

Starting from the orthogonal dynamics of any given set of variables with respect to the projection variable used to derive the Mori-Zwanzig equation, a set of coupled Volterra equations is obtained that relate the projected time correlation functions between all the variables of interest. This set of equations can be solved using standard numerical inversion methods for Volterra equations, leading to a very convenient yet efficient strategy to obtain any projected time correlation function or contribution to the memory kernel entering a generalized Langevin equation. Using this strategy, the memory kernel related to the diffusion of tagged particles in a bulk Lennard-Jones fluid is investigated up to the long-term regime to show that the repulsive-attractive cross-contribution to memory effects represents a small but non-zero contribution to the self-diffusion coefficient.

Bottom-Up Informed and Iteratively Optimized Coarse-Grained Non-Markovian Water Models with Accurate Dynamics

Molecular dynamics (MD) simulations based on coarse-grained (CG) particle models of molecular liquids generally predict accelerated dynamics and misrepresent the time scales for molecular vibrations and diffusive motions. The parametrization of Generalized Langevin Equation (GLE) thermostats based on the microscopic dynamics of the fine-grained model provides a promising route to address this issue, in conjunction with the conservative interactions of the CG model obtained with standard coarse graining methods, such as iterative Boltzmann inversion, force matching, or relative entropy minimization. We report the application of a recently introduced bottom-up dynamic coarse graining method, based on the Mori-Zwanzig formalism, which provides accurate estimates of isotropic GLE memory kernels for several CG models of liquid water. We demonstrate that, with an additional iterative optimization of the memory kernels (IOMK) for the CG water models based on a practical iterative optimization technique, the velocity autocorrelation function of liquid water can be represented very accurately within a few iterations. By considering the distinct Van Hove function, we demonstrate that, with the presented methods, an accurate representation of structural relaxation can be achieved. We consider several distinct CG potentials to study how the choice of the CG potential affects the performance of bottom-up informed and iteratively optimized models.

Understanding dynamics in coarse-grained models. II. Coarse-grained diffusion modeled using hard sphere theory

The first paper of this series [J. Chem. Phys. 158, 034103 (2023)] demonstrated that excess entropy scaling holds for both fine-grained and corresponding coarse-grained (CG) systems. Despite its universality, a more exact determination of the scaling relationship was not possible due to the semi-empirical nature. In this second paper, an analytical excess entropy scaling relation is derived for bottom-up CG systems. At the single-site CG resolution, effective hard sphere systems are constructed that yield near-identical dynamical properties as the target CG systems by taking advantage of how hard sphere dynamics and excess entropy can be analytically expressed in terms of the liquid packing fraction. Inspired by classical equilibrium perturbation theories and recent advances in constructing hard sphere models for predicting activated dynamics of supercooled liquids, we propose a new approach for understanding the diffusion of molecular liquids in the normal regime using hard sphere reference fluids. The proposed "fluctuation matching" is designed to have the same amplitude of long wavelength density fluctuations (dimensionless compressibility) as the CG system. Utilizing the Enskog theory to derive an expression for hard sphere diffusion coefficients, a bridge between the CG dynamics and excess entropy is then established. The CG diffusion coefficient can be roughly estimated using various equations of the state, and an accurate prediction of accelerated CG dynamics at different temperatures is also possible in advance of running any CG simulation. By introducing another layer of coarsening, these findings provide a more rigorous method to assess excess entropy scaling and understand the accelerated CG dynamics of molecular fluids.

Understanding dynamics in coarse-grained models. I. Universal excess entropy scaling relationship

Coarse-grained (CG) models facilitate an efficient exploration of complex systems by reducing the unnecessary degrees of freedom of the fine-grained (FG) system while recapitulating major structural correlations. Unlike structural properties, assessing dynamic properties in CG modeling is often unfeasible due to the accelerated dynamics of the CG models, which allows for more efficient structural sampling. Therefore, the ultimate goal of the present series of articles is to establish a better correspondence between the FG and CG dynamics. To assess and compare dynamical properties in the FG and the corresponding CG models, we utilize the excess entropy scaling relationship. For Paper I of this series, we provide evidence that the FG and the corresponding CG counterpart follow the same universal scaling relationship. By carefully reviewing and examining the literature, we develop a new theory to calculate excess entropies for the FG and CG systems while accounting for entropy representability. We demonstrate that the excess entropy scaling idea can be readily applied to liquid water and methanol systems at both the FG and CG resolutions. For both liquids, we reveal that the scaling exponents remain unchanged from the coarse-graining process, indicating that the scaling behavior is universal for the same underlying molecular systems. Combining this finding with the concept of mapping entropy in CG models, we show that the missing entropy plays an important role in accelerating the CG dynamics.

Data-driven construction of stochastic reduced dynamics encoded with non-Markovian features

One important problem in constructing the reduced dynamics of molecular systems is the accurate modeling of the non-Markovian behavior arising from the dynamics of unresolved variables. The main complication emerges from the lack of scale separations, where the reduced dynamics generally exhibits pronounced memory and non-white noise terms. We propose a data-driven approach to learn the reduced model of multi-dimensional resolved variables that faithfully retains the non-Markovian dynamics. Different from the common approaches based on the direct construction of the memory function, the present approach seeks a set of non-Markovian features that encode the history of the resolved variables and establishes a joint learning of the extended Markovian dynamics in terms of both the resolved variables and these features. The training is based on matching the evolution of the correlation functions of the extended variables that can be directly obtained from the ones of the resolved variables. The constructed model essentially approximates the multi-dimensional generalized Langevin equation and ensures numerical stability without empirical treatment. We demonstrate the effectiveness of the method by constructing the reduced models of molecular systems in terms of both one-dimensional and four-dimensional resolved variables.

Pair-Reaction Dynamics in Water: Competition of Memory, Potential Shape, and Inertial Effects

When described by a one-dimensional reaction coordinate, pair-reaction rates in a solvent depend, in addition to the potential barrier height and the friction coefficient, on the potential shape, the effective mass, and the friction relaxation spectrum, but a rate theory that accurately accounts for all of these effects does not exist. After a review of classical reaction-rate theories, we show how to extract all parameters of the generalized Langevin equation (GLE) and, in particular, the friction memory function from molecular dynamics (MD) simulations of two prototypical pair reactions in water, the dissociation of NaCl and of two methane molecules. The memory exhibits multiple time scales and, for NaCl, pronounced oscillatory components. Simulations of the GLE by Markovian embedding techniques accurately reproduce the pair-reaction kinetics from MD simulations without any fitting parameters, which confirms the accuracy of the approximative form of the GLE and of the parameter extraction techniques. By modification of the GLE parameters, we investigate the relative importance of memory, mass, and potential shape effects. Neglect of memory slows down NaCl and methane dissociation by roughly a factor of 2; neglect of mass accelerates reactions by a similar factor, and the harmonic approximation of the potential shape gives rise to slight acceleration. This partial error cancellation explains why Kramers' theory, which neglects memory effects and treats the potential shape in harmonic approximation, describes reaction rates better than more sophisticated theories. In essence, all three effects, friction memory, inertia, and the potential shape nonharmonicity, are important to quantitatively describe pair-reaction kinetics in water.

Assessing transition rates as functions of environmental variables

We present a method to estimate the transition rates of molecular systems under different environmental conditions that cause the formation or the breaking of bonds and require the sampling of the Grand Canonical Ensemble. For this purpose, we model the molecular system in terms of probable "scenarios," governed by different potential energy functions, which are separately sampled by classical MD simulations. Reweighting the canonical distribution of each scenario according to specific environmental variables, we estimate the grand canonical distribution, then use the Square Root Approximation method to discretize the Fokker-Planck operator into a rate matrix and the robust Perron Cluster Cluster Analysis method to coarse-grain the kinetic model. This permits efficiently estimating the transition rates of conformational states as functions of environmental variables, for example, the local pH at a cell membrane. In this work, we formalize the theoretical framework of the procedure, and we present a numerical experiment comparing the results with those provided by a constant-pH method based on non-equilibrium Molecular Dynamics Monte Carlo simulations. The method is relevant for the development of new drug design strategies that take into account how the cellular environment influences biochemical processes.

Sampling the Bulk Viscosity of Water with Molecular Dynamics Simulation in the Canonical Ensemble

The bulk viscosity, a transport coefficient in the Navier-Stokes equation, is often neglected in the continuum mechanics of Newtonian fluids. Recently, however, the role of the bulk viscosity is highlighted in the area of surface and interface-related phenomena, in systematic model up-scaling and as an important quantity for the interpretation of acoustic sensor data. The prediction of the bulk viscosity usually employs molecular dynamics and the Green-Kubo linear response theory, which is used to sample transport properties in general from molecular trajectories. Since simulations are usually carried out at specified state points in concert with the evaluation of other thermodynamic properties, the role of thermostats in molecular dynamics needs to be explored systematically. In this work, we carefully investigate the role of thermostatting schemes and numerical implementations of the Green-Kubo formalism, in particular in the canonical ensemble, using two popular water force field models. It turns out that the sampling of the bulk and shear viscosities is a delicate challenge since details of thermostatting and numerical subtleties may have an influence on the results beyond statistical uncertainties. Based on the present findings, we conclude with hints on how to construct robust sampling in the canonical ensemble for the bulk viscosity.

Bottom-up Coarse-Graining: Principles and Perspectives

Large-scale computational molecular models provide scientists a means to investigate the effect of microscopic details on emergent mesoscopic behavior. Elucidating the relationship between variations on the molecular scale and macroscopic observable properties facilitates an understanding of the molecular interactions driving the properties of real world materials and complex systems (e.g., those found in biology, chemistry, and materials science). As a result, discovering an explicit, systematic connection between microscopic nature and emergent mesoscopic behavior is a fundamental goal for this type of investigation. The molecular forces critical to driving the behavior of complex heterogeneous systems are often unclear. More problematically, simulations of representative model systems are often prohibitively expensive from both spatial and temporal perspectives, impeding straightforward investigations over possible hypotheses characterizing molecular behavior. While the reduction in resolution of a study, such as moving from an atomistic simulation to that of the resolution of large coarse-grained (CG) groups of atoms, can partially ameliorate the cost of individual simulations, the relationship between the proposed microscopic details and this intermediate resolution is nontrivial and presents new obstacles to study. Small portions of these complex systems can be realistically simulated. Alone, these smaller simulations likely do not provide insight into collectively emergent behavior. However, by proposing that the driving forces in both smaller and larger systems (containing many related copies of the smaller system) have an explicit connection, systematic bottom-up CG techniques can be used to transfer CG hypotheses discovered using a smaller scale system to a larger system of primary interest. The proposed connection between different CG systems is prescribed by (i) the CG representation (mapping) and (ii) the functional form and parameters used to represent the CG energetics, which approximate potentials of mean force (PMFs). As a result, the design of CG methods that facilitate a variety of physically relevant representations, approximations, and force fields is critical to moving the frontier of systematic CG forward. Crucially, the proposed connection between the system used for parametrization and the system of interest is orthogonal to the optimization used to approximate the potential of mean force present in all systematic CG methods. The empirical efficacy of machine learning techniques on a variety of tasks provides strong motivation to consider these approaches for approximating the PMF and analyzing these approximations.

Passive probe particle in an active bath: can we tell it is out of equilibrium?

We study a passive probe immersed in a fluid of active particles. Despite the system's non-equilibrium nature, the trajectory of the probe does not exhibit non-equilibrium signatures: its velocity distribution remains Gaussian, the second fluctuation dissipation theorem is not fundamentally violated, and the motion does not indicate breaking of time reversal symmetry. To tell that the probe is out of equilibrium requires examination of its behavior in tandem with that of the active fluid: the kinetic temperature of the probe does not equilibrate to that of the surrounding active particles. As a strategy to diagnose non-equilibrium from probe trajectories alone, we propose to examine their response to a small perturbation which reveals a non-equilibrium signature through a violation of the first fluctuation dissipation theorem.

Cross-Correlation Corrected Friction in Generalized Langevin Models: Application to the continuous Asakura-Oosawa Model

In a previous study we proposed a method to parameterize isotropic, configuration independent, non-Markovian generalized Langevin thermostats to achieve dynamic consistency in coarse-grained models. In the current study, by applying the same strategy, we develop coarse-grained implicit solvent models for the continuous Asakura-Oosawa model, which under certain conditions allows to develop very accurate coarse-grained potentials. By developing coarse-grained models for different reference systems with varying parameters, we test the broader applicability of the proposed procedure and demonstrate the relevance of accurate coarse-grained potentials in bottom-up derived dissipative models. We study how different system parameters affect the dynamic representability of the coarse-grained models. In particular we find that the quality of the coarse-grained potential is crucial to correctly model the backscattering effect due to collisions on the coarse-grained scale. In the dynamics of colloid suspensions the hydrodynamic interactions affect the long-time scale dynamics by solvent mediated momentum transfer. These interactions are not explicitly modeled in the presented coarse-grained models, which poses some limitations to the proposed coarse-graining scheme. The Asakura-Oosawa model allows a tuning of system parameters, to gain an improved understanding of these limitations. We also propose three new iterative optimization schemes to fine tune the generalized Langevin thermostat to exactly match the reference velocity-autocorrelation function.

Position-dependent memory kernel in generalized Langevin equations: Theory and numerical estimation

Generalized Langevin equations with non-linear forces and position-dependent linear friction memory kernels, such as commonly used to describe the effective dynamics of coarse-grained variables in molecular dynamics, are rigorously derived within the Mori–Zwanzig formalism. A fluctuation–dissipation theorem relating the properties of the noise to the memory kernel is shown. The derivation also yields Volterra-type equations for the kernel, which can be used for a numerical parametrization of the model from all-atom simulations.

Molecular Origin of Driving-Dependent Friction in Fluids

The friction coefficient of fluids may become a function of the velocity at increased external driving. This non-Newtonian behavior is of general theoretical interest and of great practical importance, for example, for the design of lubricants. Although the effect has been observed in large-scale atomistic simulations of bulk liquids, its theoretical formulation and microscopic origin are not well understood. Here, we use dissipation-corrected targeted molecular dynamics, which pulls apart two tagged liquid molecules in the presence of surrounding molecules, and analyze this nonequilibrium process via a generalized Langevin equation. The approach is based on a second-order cumulant expansion of Jarzynski's identity, which is shown to be valid for fluids and therefore allows for an exact computation of the friction profile as well of the underlying memory kernel. We show that velocity-dependent friction in fluids results from an intricate interplay of near-order structural effects and the non-Markovian behavior of the friction memory kernel. For complex fluids such as the model lubricant C₄₀H₈₂, the memory kernel exhibits a stretched-exponential long-time decay, which reflects the multitude of timescales of the system.

Generalized Langevin equation with a nonlinear potential of mean force and nonlinear memory friction from a hybrid projection scheme

We introduce a hybrid projection scheme that combines linear Mori projection and conditional Zwanzig projection techniques and use it to derive a generalized Langevin equation (GLE) for a general interacting many-body system. The resulting GLE includes (i) explicitly the potential of mean force (PMF) that describes the equilibrium distribution of the system in the chosen space of reaction coordinates, (ii) a random force term that explicitly depends on the initial state of the system, and (iii) a memory friction contribution that splits into two parts: a part that is linear in the past reaction-coordinate velocity and a part that is in general nonlinear in the past reaction coordinates but does not depend on velocities. Our hybrid scheme thus combines all desirable properties of the Zwanzig and Mori projection schemes. The nonlinear memory friction contribution is shown to be related to correlations between the reaction-coordinate velocity and the random force. We present a numerical method to compute all parameters of our GLE, in particular the nonlinear memory friction function and the random force distribution, from a trajectory in reaction coordinate space. We apply our method on the dihedral-angle dynamics of a butane molecule in water obtained from atomistic molecular dynamics simulations. For this example, we demonstrate that nonlinear memory friction is present and that the random force exhibits significant non-Gaussian corrections. We also present the derivation of the GLE for multidimensional reaction coordinates that are general functions of all positions in the phase-space of the underlying many-body system; this corresponds to a systematic coarse-graining procedure that preserves not only the correct equilibrium behavior but also the correct dynamics of the coarse-grained system.

Likelihood-based non-Markovian models from molecular dynamics

The analysis of complex systems with many degrees of freedom generally involves the definition of low-dimensional collective variables more amenable to physical understanding. Their dynamics can be modeled by generalized Langevin equations, whose coefficients have to be estimated from simulations of the initial high-dimensional system. These equations feature a memory kernel describing the mutual influence of the low-dimensional variables and their environment. We introduce and implement an approach where the generalized Langevin equation is designed to maximize the statistical likelihood of the observed data. This provides an efficient way to generate reduced models to study dynamical properties of complex processes such as chemical reactions in solution, conformational changes in biomolecules, or phase transitions in condensed matter systems.

We introduce a method to accurately and efficiently estimate the effective dynamics of collective variables in molecular simulations. Such reduced dynamics play an essential role in the study of a broad class of processes, ranging from chemical reactions in solution to conformational changes in biomolecules or phase transitions in condensed matter systems. The standard Markovian approximation often breaks down due to the lack of a proper separation of time scales, and memory effects must be taken into account. Using a parametrization based on hidden auxiliary variables, we obtain a generalized Langevin equation by maximizing the statistical likelihood of the observed trajectories. Both the memory kernel and random noise are correctly recovered by this procedure. This data-driven approach provides a reduced dynamical model for multidimensional collective variables, enabling the accurate sampling of their long-time dynamical properties at a computational cost drastically reduced with respect to all-atom numerical simulations. The present strategy, based on the reproduction of the dynamics of trajectories rather than the memory kernel or the velocity-autocorrelation function, conveniently provides other observables beyond these two, including, e.g., stationary currents in nonequilibrium situations or the distribution of first passage times between metastable states.

Non-Markovian systems out of equilibrium: exact results for two routes of coarse graining

Generalized Langevin equations (GLEs) can be systematically derived via dimensional reduction from high-dimensional microscopic systems. For linear models the derivation can either be based on projection operator techniques such as the Mori-Zwanzig (MZ) formalism or by 'integrating out' the bath degrees of freedom. Based on exact analytical results we show that both routes can lead to fundamentally different GLEs and that the origin of these differences is based inherently on the non-equilibrium nature of the microscopic stochastic model. The most important conceptional difference between the two routes is that the MZ result intrinsically fulfills the generalized second fluctuation-dissipation theorem while the integration result can lead to its violation. We supplement our theoretical findings with numerical and simulation results for two popular non-equilibrium systems: time-delayed feedback control and the active Ornstein-Uhlenbeck process.

Shear and Bulk Acceleration Viscosities in Simple Fluids

Inhomogeneities in the velocity field of a moving fluid are dampened by the inherent viscous behavior of the system. Both bulk and shear effects, related to the divergence and the curl of the velocity field, are relevant. On molecular time scales, beyond the Navier-Stokes description, memory plays an important role. Using molecular and overdamped Brownian dynamics many-body simulations, we demonstrate that analogous viscous effects act on the acceleration field. This acceleration viscous behavior is associated with the divergence and the curl of the acceleration field, and it can be quantitatively described using simple exponentially decaying memory kernels. The simultaneous use of velocity and acceleration fields enables the description of fast dynamics on molecular scales.

Non-Markovian modeling of protein folding

Protein-folding kinetics is often described as Markovian (i.e., memoryless) diffusion in a one-dimensional free energy landscape, governed by an instantaneous friction coefficient that is fitted to reproduce experimental or simulated folding times. For the α-helix forming polypeptide alanine9 and a specific reaction coordinate that consists of the summed native hydrogen-bond lengths, we demonstrate that the friction extracted from molecular dynamics simulations exhibits significant memory with a decay time that is in the nanosecond range and thus, of the same order as the folding and unfolding times. Our non-Markovian modeling not only reproduces the molecular dynamics simulations accurately but also demonstrates that memory friction effects lead to anomalous and drastically accelerated protein kinetics.

We extract the folding free energy landscape and the time-dependent friction function, the two ingredients of the generalized Langevin equation (GLE), from explicit-water molecular dynamics (MD) simulations of the α-helix forming polypeptide alanine9 for a one-dimensional reaction coordinate based on the sum of the native H-bond distances. Folding and unfolding times from numerical integration of the GLE agree accurately with MD results, which demonstrate the robustness of our GLE-based non-Markovian model. In contrast, Markovian models do not accurately describe the peptide kinetics and in particular, cannot reproduce the folding and unfolding kinetics simultaneously, even if a spatially dependent friction profile is used. Analysis of the GLE demonstrates that memory effects in the friction significantly speed up peptide folding and unfolding kinetics, as predicted by the Grote–Hynes theory, and are the cause of anomalous diffusion in configuration space. Our methods are applicable to any reaction coordinate and in principle, also to experimental trajectories from single-molecule experiments. Our results demonstrate that a consistent description of protein-folding dynamics must account for memory friction effects.

Fluctuation-dissipation relations far from equilibrium: a case study

Fluctuation-dissipation relations or "theorems" (FDTs) are fundamental for statistical physics and can be rigorously derived for equilibrium systems. Their applicability to non-equilibrium systems is, however, debated. Here, we simulate an active microrheology experiment, in which a spherical colloid is pulled with a constant external force through a fluid, creating near-equilibrium and far-from-equilibrium systems. We characterize the structural and dynamical properties of these systems, and reconstruct an effective generalized Langevin equation (GLE) for the colloid dynamics. Specifically, we test the validity of two FDTs: The first FDT relates the non-equilibrium response of a system to equilibrium correlation functions, and the second FDT relates the memory friction kernel in the GLE to the stochastic force. We find that the validity of the first FDT depends strongly on the strength of the external driving: it is fulfilled close to equilibrium and breaks down far from it. In contrast, we observe that the second FDT is always fulfilled. We provide a mathematical argument why this generally holds for memory kernels reconstructed from a deterministic Volterra equation for correlation functions, even for non-stationary non-equilibrium systems. Motivated by the Mori-Zwanzig formalism, we therefore suggest to impose an orthogonality constraint on the stochastic force, which is in fact equivalent to the validity of this Volterra equation. Such GLEs automatically satisfy the second FDT and are unique, which is desirable when using GLEs for coarse-grained modeling.

Transfer learning of memory kernels for transferable coarse-graining of polymer dynamics

The present work concerns the transferability of coarse-grained (CG) modeling in reproducing the dynamic properties of the reference atomistic systems across a range of parameters. In particular, we focus on implicit-solvent CG modeling of polymer solutions. The CG model is based on the generalized Langevin equation, where the memory kernel plays the critical role in determining the dynamics in all time scales. Thus, we propose methods for transfer learning of memory kernels. The key ingredient of our methods is Gaussian process regression. By integration with the model order reduction via proper orthogonal decomposition and the active learning technique, the transfer learning can be practically efficient and requires minimum training data. Through two example polymer solution systems, we demonstrate the accuracy and efficiency of the proposed transfer learning methods in the construction of transferable memory kernels. The transferability allows for out-of-sample predictions, even in the extrapolated domain of parameters. Built on the transferable memory kernels, the CG models can reproduce the dynamic properties of polymers in all time scales at different thermodynamic conditions (such as temperature and solvent viscosity) and for different systems with varying concentrations and lengths of polymers.

Cross-correlation corrected friction in (generalized) Langevin models

We propose a route for parameterizing isotropic (generalized) Langevin [(G)LE] thermostats with the aim to correct the dynamics of coarse-grained (CG) models with pairwise conservative interactions. The approach is based on the Mori-Zwanzig formalism and derives the memory kernels from Q-projected time correlation functions. Bottom-up informed (GLE and LE) thermostats for a CG star-polymer melt are investigated, and it is demonstrated that the inclusion of memory in the CG simulation leads to predictions of polymer diffusion in quantitative agreement with fine-grained simulations. Interestingly, memory effects are observed in the diffusive regime. We demonstrate that previously neglected cross-correlations between the "irrelevant" and the CG degree of freedom are important and lie at the origin of shortcomings in previous CG simulations.

Petrov-Galerkin methods for the construction of non-Markovian dynamics preserving nonlocal statistics

A common observation in coarse-graining a molecular system is the non-Markovian behavior, primarily due to the lack of scale separations. This is reflected in the strong memory effect and the non-white noise spectrum, which must be incorporated into a coarse-grained description to correctly predict dynamic properties. To construct a stochastic model that gives rise to the correct non-Markovian dynamics, we propose a Galerkin projection approach, which transforms the exhausting effort of finding an appropriate model to choosing appropriate subspaces in terms of the derivatives of the coarse-grained variables and, at the same time, provides an accurate approximation to the generalized Langevin equation. We introduce the notion of fractional statistics that embodies nonlocal properties. More importantly, we show how to pick subspaces in the Galerkin projection so that those statistics are automatically matched.

Introducing Memory in Coarse-Grained Molecular Simulations

Preserving the correct dynamics at the coarse-grained (CG) level is a pressing problem in the development of systematic CG models in soft matter simulation. Starting from the seminal idea of simple time-scale mapping, there have been many efforts over the years toward establishing a meticulous connection between the CG and fine-grained (FG) dynamics based on fundamental statistical mechanics approaches. One of the most successful attempts in this context has been the development of CG models based on the Mori-Zwanzig (MZ) theory, where the resulting equation of motion has the form of a generalized Langevin equation (GLE) and closely preserves the underlying FG dynamics. In this Review, we describe some of the recent studies in this regard. We focus on the construction and simulation of dynamically consistent systematic CG models based on the GLE, both in the simple Markovian limit and the non-Markovian case. Some recent studies of physical effects of memory are also discussed. The Review is aimed at summarizing recent developments in the field while highlighting the major challenges and possible future directions.

Model reduction techniques for the computation of extended Markov parameterizations for generalized Langevin equations

The generalized Langevin equation is a model for the motion of coarse-grained particles where dissipative forces are represented by a memory term. The numerical realization of such a model requires the implementation of a stochastic delay-differential equation and the estimation of a corresponding memory kernel. Here we develop a new approach for computing a data-driven Markov model for the motion of the particles, given equidistant samples of their velocity autocorrelation function. Our method bypasses the determination of the underlying memory kernel by representing it via up to about twenty auxiliary variables. The algorithm is based on a sophisticated variant of the Prony method for exponential interpolation and employs the positive real lemma from model reduction theory to extract the associated Markov model. We demonstrate the potential of this approach for the test case of anomalous diffusion, where data are given analytically, and then apply our method to velocity autocorrelation data of molecular dynamics simulations of a colloid in a Lennard-Jones fluid. In both cases, the velocity autocorrelation function and the memory kernel can be reproduced very accurately. Moreover, we show that the algorithm can also handle input data with large statistical noise. We anticipate that it will be a very useful tool in future studies that involve dynamic coarse-graining of complex soft matter systems.

Dynamic coarse-graining of polymer systems using mobility functions

We propose a dynamic coarse-graining (CG) scheme for mapping heterogeneous polymer fluids onto extremely CG models in a dynamically consistent manner. The idea is to use as target function for the mapping a wave-vector dependent mobility function derived from the single-chain dynamic structure factor, which is calculated in the microscopic reference system. In previous work, we have shown that dynamic density functional calculations based on this mobility function can accurately reproduce the order/disorder kinetics in polymer melts, thus it is a suitable starting point for dynamic mapping. To enable the mapping over a range of relevant wave vectors, we propose to modify the CG dynamics by introducing internal friction parameters that slow down the CG monomer dynamics on local scales, without affecting the static equilibrium structure of the system. We illustrate and discuss the method using the example of infinitely long linear Rouse polymers mapped onto ultrashort CG chains. We show that our method can be used to construct dynamically consistent CG models for homopolymers with CG chain lengthN= 4, whereas for copolymers, longer CG chain lengths are necessary.

Constructing many-body dissipative particle dynamics models of fluids from bottom-up coarse-graining

Since their emergence in the 1990s, mesoscopic models of fluids have been widely used to study complex organization and transport phenomena beyond the molecular scale. Even though these models are designed based on results from physics at the meso- and macroscale, such as fluid mechanics and statistical field theory, the underlying microscopic foundation of these models is not as well defined. This paper aims to build such a systematic connection using bottom-up coarse-graining methods. From the recently developed dynamic coarse-graining scheme, we introduce a statistical inference framework of explicit many-body conservative interaction that quantitatively recapitulates the mesoscopic structure of the underlying fluid. To further consider the dissipative and fluctuation forces, we design a novel algorithm that parameterizes these forces. By utilizing this algorithm, we derive pairwise decomposable friction kernels under both non-Markovian and Markovian limits where both short- and long-time features of the coarse-grained dynamics are reproduced. Finally, through these new developments, the many-body dissipative particle dynamics type of equations of motion are successfully derived. The methodologies developed in this work thus open a new avenue for the construction of direct bottom-up mesoscopic models that naturally bridge the meso- and macroscopic physics.

Universality in Driven and Equilibrium Hard Sphere Liquid Dynamics

We demonstrate that the time evolution of the van Hove dynamical pair correlation function is governed by adiabatic forces that arise from the free energy and by superadiabatic forces that are induced by the flow of the van Hove function. The superadiabatic forces consist of drag, viscous, and structural contributions, as occur in active Brownian particles, in liquids under shear and in lane forming mixtures. For hard sphere liquids, we present a power functional theory that predicts these universal force fields in quantitative agreement with our Brownian dynamics simulation results.

Negative friction memory induces persistent motion

We investigate the mean-square displacement (MSD) for random motion governed by the generalized Langevin equation for memory functions that contain two different time scales: In the first model, the memory kernel consists of a delta peak and a single-exponential and in the second model of the sum of two exponentials. In particular, we investigate the scenario where the long-time exponential kernel contribution is negative. The competition between positive and negative friction memory contributions produces an enhanced transient persistent regime in the MSD, which is relevant for biological motility and active matter systems.

Data-driven molecular modeling with the generalized Langevin equation

The complexity of molecular dynamics simulations necessitates dimension reduction and coarse-graining techniques to enable tractable computation. The generalized Langevin equation (GLE) describes coarse-grained dynamics in reduced dimensions. In spite of playing a crucial role in non-equilibrium dynamics, the memory kernel of the GLE is often ignored because it is difficult to characterize and expensive to solve. To address these issues, we construct a data-driven rational approximation to the GLE. Building upon previous work leveraging the GLE to simulate simple systems, we extend these results to more complex molecules, whose many degrees of freedom and complicated dynamics require approximation methods. We demonstrate the effectiveness of our approximation by testing it against exact methods and comparing observables such as autocorrelation and transition rates.

Data-driven coarse-grained modeling of polymers in solution with structural and dynamic properties conserved

We present data-driven coarse-grained (CG) modeling for polymers in solution, which conserves the dynamic as well as structural properties of the underlying atomistic system. The CG modeling is built upon the framework of the generalized Langevin equation (GLE). The key is to determine each term in the GLE by directly linking it to atomistic data. In particular, we propose a two-stage Gaussian process-based Bayesian optimization method to infer the non-Markovian memory kernel from the data of the velocity autocorrelation function (VACF). Considering that the long-time behaviors of the VACF and memory kernel for polymer solutions can exhibit hydrodynamic scaling (algebraic decay with time), we further develop an active learning method to determine the emergence of hydrodynamic scaling, which can accelerate the inference process of the memory kernel. The proposed methods do not rely on how the mean force or CG potential in the GLE is constructed. Thus, we also compare two methods for constructing the CG potential: a deep learning method and the iterative Boltzmann inversion method. With the memory kernel and CG potential determined, the GLE is mapped onto an extended Markovian process to circumvent the expensive cost of directly solving the GLE. The accuracy and computational efficiency of the proposed CG modeling are assessed in a model star-polymer solution system at three representative concentrations. By comparing with the reference atomistic simulation results, we demonstrate that the proposed CG modeling can robustly and accurately reproduce the dynamic and structural properties of polymers in solution.

Memory-induced motion reversal in Brownian liquids

We study the Brownian dynamics of hard spheres under spatially inhomogeneous shear, using event-driven Brownian dynamics simulations and power functional theory. We examine density and current profiles both for steady states and for the transient dynamics after switching on and switching off an external square wave shear force field. We find that a dense hard sphere fluid (volume fraction ≈0.35) undergoes global motion reversal after switching off the shear force field. We use power functional theory with a spatially nonlocal memory kernel to describe the superadiabatic force contributions and obtain good quantitative agreement of the theoretical results with simulation data. The theory provides an explanation for the motion reversal: internal superadiabatic nonequilibrium forces that oppose the externally driven current arise due to memory after switching off. The effect is genuinely viscoelastic: in steady state, viscous forces oppose the current, but they elastically generate an opposing current after switch-off.