Improving the Wang-Landau algorithm for polymers and proteins

Low-dimensional projection approach for efficient sampling of molecular recognition and polymer aggregation

The one-dimensional projection (ODP) approach is extended to two-dimensional umbrella sampling (TDUS) and is applied to three different complex systems in combination with a reactive force field (ReaxFF). TDUS is capable of showing detailed features of the free-energy surface (FES) of the double-proton transfer of the acetic acid dimer. It also revealed the direct relationship between the types of hydrogen bonding and binding strengths in the case of adrenaline molecular recognition by SIVSF (Serine, Isoleucine, Valine, Cysteine, and Phenylalanine). The study of polymer aggregation using TDUS shows that aggregation is preferred with a less-polar solvent, which is also consistent with the experimental observation of a tape-casting process. Therefore, TDUS can be generally useful in FES explorations from simple chemical reactions to complex processes of molecular recognition and polymer aggregation.

The tension of framed membranes from computer simulations

We have analyzed the behavior of a randomly triangulated, self-avoiding surface model of a flexible, fluid membrane subject to a circular boundary by Wang-Landau Monte Carlo computer simulation techniques. The dependence of the canonical free energy and frame tension on the frame area is obtained for flexible membranes. It is shown that for low bending rigidities the framed membrane is only stable above a threshold tension, suggesting a discontinuous transition from the collapsed (branched polymer) state to a finite tension extended state. In a tension range above this threshold tension the membranes display power-law characteristics for the equation of state, while higher tension levels includes both an extended linear (elastic) as well as a highly non-linear stretching regime. For semi-flexible membranes a transition from extended to buckled conformations takes place at negative frame tensions. Our analysis indicates that at zero frame tension the crumpling transition of fluid membranes show characteristics of both critical behavior and a discontinuous transition at low bending rigidities.

Control of accuracy in the Wang-Landau algorithm

The Wang-Landau (WL) algorithm has been widely used for simulations in many areas of physics. Our analysis of the WL algorithm explains its properties and shows that the difference of the largest eigenvalue of the transition matrix in the energy space from unity can be used to control the accuracy of estimating the density of states. Analytic expressions for the matrix elements are given in the case of the one-dimensional Ising model. The proposed method is further confirmed by numerical results for the one-dimensional and two-dimensional Ising models and also the two-dimensional Potts model.

Wang-Landau Reaction Ensemble Method: Simulation of Weak Polyelectrolytes and General Acid-Base Reactions

We present a novel method for the study of weak polyelectrolytes and general acid-base reactions in molecular dynamics and Monte Carlo simulations. The approach combines the advantages of the reaction ensemble and the Wang-Landau sampling method. Deprotonation and protonation reactions are simulated explicitly with the help of the reaction ensemble method, while the accurate sampling of the corresponding phase space is achieved by the Wang-Landau approach. The combination of both techniques provides a sufficient statistical accuracy such that meaningful estimates for the density of states and the partition sum can be obtained. With regard to these estimates, several thermodynamic observables like the heat capacity or reaction free energies can be calculated. We demonstrate that the computation times for the calculation of titration curves with a high statistical accuracy can be significantly decreased when compared to the original reaction ensemble method. The applicability of our approach is validated by the study of weak polyelectrolytes and their thermodynamic properties.

From polymers to proteins: the effect of side chains and broken symmetry on the formation of secondary structures within a Wang-Landau approach

We use a micro-canonical Wang-Landau technique to study the equilibrium properties of a single flexible homopolymer where consecutive monomers are represented by impenetrable hard spherical beads tangential to each other, and non-consecutive monomers interact via a square-well potential. To mimic the characteristics of a protein-like system, the model is then refined in two different directions. Firstly, by allowing partial overlap between consecutive beads, we break the spherical symmetry and thus provide a severe constraint on the possible conformations of the chain. Alternatively, we introduce additional spherical beads at specific positions in the direction normal to the backbone, to represent the steric hindrance of the side chains in real proteins. Finally, we consider also a combination of these two ingredients. In all three systems, we obtain the full phase diagram in the temperature-interaction range plane and find the presence of helicoidal structures at low temperatures in the intermediate range of interactions. The effect of the range of the square-well attraction is highlighted, and shown to play a role similar to that found in simple liquids and polymers. Perspectives in terms of protein folding are finally discussed.

Nonconvergence of the Wang-Landau algorithms with multiple random walkers

This paper discusses some convergence properties in the entropic sampling Monte Carlo methods with multiple random walkers, particularly in the Wang-Landau (WL) and 1/t algorithms. The classical algorithms are modified by the use of m-independent random walkers in the energy landscape to calculate the density of states (DOS). The Ising model is used to show the convergence properties in the calculation of the DOS, as well as the critical temperature, while the calculation of the number π by multiple dimensional integration is used in the continuum approximation. In each case, the error is obtained separately for each walker at a fixed time, t; then, the average over m walkers is performed. It is observed that the error goes as 1/sqrt[m]. However, if the number of walkers increases above a certain critical value m>m_{x}, the error reaches a constant value (i.e., it saturates). This occurs for both algorithms; however, it is shown that for a given system, the 1/t algorithm is more efficient and accurate than the similar version of the WL algorithm. It follows that it makes no sense to increase the number of walkers above a critical value m_{x}, since it does not reduce the error in the calculation. Therefore, the number of walkers does not guarantee convergence.

Thermodynamics and structure of macromolecules from flat-histogram Monte Carlo simulations

Over the last decade flat-histogram Monte Carlo simulations, especially multi-canonical and Wang-Landau simulations, have emerged as a strong tool to study the statistical mechanics of polymer chains. These investigations have focused on coarse-grained models of polymers on the lattice and in the continuum. Phase diagrams of chains in bulk as well as chains attached to surfaces were studied, for homopolymers as well as for protein-like models. Also, aggregation behavior in solution of these models has been investigated. We will present here the theoretical background for these simulations, explain the algorithms used and discuss their performance and give an overview over the systems studied with these methods in the literature, where we will limit ourselves to studies of coarse-grained model systems. Implementations of these algorithms on parallel computers will be also briefly described. In parallel to the development of these simulation methods, the power of a micro-canonical analysis of such simulations has been recognized, and we present the current state of the art in applying the micro-canonical analysis to phase transitions in nanoscopic polymer systems.

Accelerated weight histogram method for exploring free energy landscapes

Calculating free energies is an important and notoriously difficult task for molecular simulations. The rapid increase in computational power has made it possible to probe increasingly complex systems, yet extracting accurate free energies from these simulations remains a major challenge. Fully exploring the free energy landscape of, say, a biological macromolecule typically requires sampling large conformational changes and slow transitions. Often, the only feasible way to study such a system is to simulate it using an enhanced sampling method. The accelerated weight histogram (AWH) method is a new, efficient extended ensemble sampling technique which adaptively biases the simulation to promote exploration of the free energy landscape. The AWH method uses a probability weight histogram which allows for efficient free energy updates and results in an easy discretization procedure. A major advantage of the method is its general formulation, making it a powerful platform for developing further extensions and analyzing its relation to already existing methods. Here, we demonstrate its efficiency and general applicability by calculating the potential of mean force along a reaction coordinate for both a single dimension and multiple dimensions. We make use of a non-uniform, free energy dependent target distribution in reaction coordinate space so that computational efforts are not wasted on physically irrelevant regions. We present numerical results for molecular dynamics simulations of lithium acetate in solution and chignolin, a 10-residue long peptide that folds into a β-hairpin. We further present practical guidelines for setting up and running an AWH simulation.

Dynamical traps in Wang-Landau sampling of continuous systems: Mechanism and solution

We study the mechanism behind dynamical trappings experienced during Wang-Landau sampling of continuous systems reported by several authors. Trapping is caused by the random walker coming close to a local energy extremum, although the mechanism is different from that of the critical slowing-down encountered in conventional molecular dynamics or Monte Carlo simulations. When trapped, the random walker misses the entire or even several stages of Wang-Landau modification factor reduction, leading to inadequate sampling of the configuration space and a rough density of states, even though the modification factor has been reduced to very small values. Trapping is dependent on specific systems, the choice of energy bins, and the Monte Carlo step size, making it highly unpredictable. A general, simple, and effective solution is proposed where the configurations of multiple parallel Wang-Landau trajectories are interswapped to prevent trapping. We also explain why swapping frees the random walker from such traps. The efficacy of the proposed algorithm is demonstrated.

Wang-Landau sampling: a criterion for halting the simulations

In this work we propose a criterion to finish the simulations of the Wang-Landau sampling. Instead of determining a final modification factor for all simulations and every sample size, we investigate the behavior of the temperature of the peak of the specific heat during the simulations and finish them when this value varies below a given limit. As a result, different runs stop at different final modification factors. We show that in place of the temperature of the peak of the specific heat one can adopt alternatively the integrated heat transfer as a reference quantity. We apply this technique to the two-dimensional Ising model and a homopolymer. We verify that for the Ising model the mean order of the final modification factors is roughly the same for all lattice sizes, but for the homopolymer the order of the final modification factors increases with increasing polymer sizes. The results show that the simulations can be halted much earlier than is conventional in Wang-Landau sampling, but manifold finite-size simulations are required in order to obtain accurate results. A brief application to the three-dimensional Ising model is also available.

Dynamically optimized Wang-Landau sampling with adaptive trial moves and modification factors

The density of states of continuous models is known to span many orders of magnitudes at different energies due to the small volume of phase space near the ground state. Consequently, the traditional Wang-Landau sampling which uses the same trial move for all energies faces difficulties sampling the low-entropic states. We developed an adaptive variant of the Wang-Landau algorithm that very effectively samples the density of states of continuous models across the entire energy range. By extending the acceptance ratio method of Bouzida, Kumar, and Swendsen such that the step size of the trial move and acceptance rate are adapted in an energy-dependent fashion, the random walker efficiently adapts its sampling according to the local phase space structure. The Wang-Landau modification factor is also made energy dependent in accordance with the step size, enhancing the accumulation of the density of states. Numerical simulations show that our proposed method performs much better than the traditional Wang-Landau sampling.

Examining the phase transition behavior of amphiphilic lipids in solution using statistical temperature molecular dynamics and replica-exchange Wang-Landau methods

Two different techniques - replica-exchange Wang-Landau (REWL) and statistical temperature molecular dynamics (STMD) - were applied to systematically study the phase transition behavior of self-assembling lipids as a function of temperature using an off-lattice lipid model. Both methods allow the direct calculation of the density of states with improved efficiency compared to the original Wang-Landau method. A 3-segment model of amphiphilic lipids solvated in water has been studied with varied particle interaction energies (ε) and lipid concentrations. The phase behavior of the lipid molecules with respect to bilayer formation has been characterized through the calculation of the heat capacity as a function of temperature, in addition to various order parameters and general visual inspection. The simulations conducted by both methods can go to very low temperatures with the whole system exhibiting well-ordered structures. With optimized parameters, several bilayer phases are observed within the temperature range studied, including gel phase bilayers with frozen water, mixed water (i.e., frozen and liquid water), and liquid water, and a more fluid bilayer with liquid water. The results obtained from both methods, STMD and REWL, are consistently in excellent agreement with each other, thereby validating both the methods and the results.

A Wang-Landau study of a lattice model for lipid bilayer self-assembly

The Wang-Landau (WL) Monte Carlo method has been applied to simulate the self-assembly of a lipid bilayer on a 3D lattice. The WL method differs from conventional Monte Carlo methods in that a complete density of states is obtained directly for the system, from which properties, such as the free energy, can be derived. Furthermore, from a single WL simulation, continuous curves of the average energy and heat capacity can be determined, which provide a complete picture of the phase behavior. The lipid model studied consists of 3 or 5 coarse-grained segments on lattices of varying sizes, with the empty lattice sites representing water. A bilayer structure is found to form at low temperatures, with phase transitions to clusters as temperature increases. For 3-segment chains, varying lattice sizes were studied, with the observation that the ratio of chain number to lattice area (i.e., area per lipid) affects the phase transition temperature. At small ratios, only one phase transition occurs between the bilayer and cluster phases, while at high lipid ratios the phase transition occurs in a two-step process with a stable intermediate phase. This second phase transition was not observed in conventional Metropolis Monte Carlo simulations on the same model, demonstrating the advantage of being able to perform a complete scan of the whole temperature range with the WL method. For longer 5-segment chains similar phase transitions are also observed with changes in temperature. In the WL method, due to the extensive nature of the energy, the number of energy bins required to represent the density of states increases as the system size increases and so limits its practical application to larger systems. To improve this, an extension of the WL algorithm, the statistical-temperature Monte Carlo method that allows simulations with larger energy bin sizes, has recently been proposed and is implemented in this work for the 3-segment lattice model. The results obtained are in good agreement with the original WL method and appear to be independent of the energy bin size used.

Generic folding and transition hierarchies for surface adsorption of hydrophobic-polar lattice model proteins

The thermodynamic behavior and structural properties of hydrophobic-polar (HP) lattice proteins interacting with attractive surfaces are studied by means of Wang-Landau sampling. Three benchmark HP sequences (48mer, 67mer, and 103mer) are considered with different types of surfaces, each of which attract either all monomers, only hydrophobic (H) monomers, or only polar (P) monomers, respectively. The diversity of folding behavior in dependence of surface strength is discussed. Analyzing the combined patterns of various structural observables, such as, e.g., the derivatives of the numbers of surface contacts, together with the specific heat, we are able to identify generic categories of folding and transition hierarchies. We also infer a connection between these transition categories and the relative surface strengths, i.e., the ratio of the surface attractive strength to the interchain attraction among H monomers. The validity of our proposed classification scheme is reinforced by the analysis of additional benchmark sequences. We thus believe that the folding hierarchies and identification scheme are generic for HP proteins interacting with attractive surfaces, regardless of chain length, sequence, or surface attraction.

"Pull moves" for rectangular lattice polymer models are not fully reversible

"Pull moves" is a popular move set for lattice polymer model simulations. We show that the proof given for its reversibility earlier is flawed, and some moves are irreversible, which leads to biases in the parameters estimated from the simulations. We show how to make the move set fully reversible.

Finding multiple minimum-energy conformations of the hydrophobic-polar protein model via multidomain sampling

We demonstrate the efficiency of the multidomain sampler (MDS) in finding multiple distinct global minima and low-energy local minima in the hydrophobic-polar (HP) lattice protein model. Extending the idea of partitioning energy space in the Wang-Landau algorithm, our approach introduces an additional partitioning scheme to divide the protein conformation space into local basins of attraction. This double-partitioning design is very powerful in guiding the sampler to visit the basins of unexplored local minima. An H-residue subchain distance is used to merge the basins of similar local minima into one domain, which increases the diversity among identified minimum-energy conformations. Moreover, a visit-enhancement factor is introduced for long protein chains to facilitate jumps between basins. Results on three benchmark protein sequences reveal that our approach is capable of finding multiple global minima and hundreds of low-energy local minima of great diversity.

Selective adsorption of lattice peptides on patterned surfaces

To study the adsorption of individual peptides in implicit solvent, we propose a version of the Wang-Landau Monte Carlo algorithm that uses a single surface, with no need for a confining wall or grafting. Our "wall-free" method is both more efficient than the traditional ones and free of additional assumptions or approximations. We illustrate it by simulating an HP-model lattice peptide on planar surfaces with a variety of patterns of adsorption sites, discovering a temperature-induced switch of surface selection which is due to a balance of energetic and entropic effects.

Density of states-based molecular simulations

One of the central problems in statistical mechanics is that of finding the density of states of a system. Knowledge of the density of states of a system is equivalent to knowledge of its fundamental equation, from which all thermodynamic quantities can be obtained. Over the past several years molecular simulations have made considerable strides in their ability to determine the density of states of complex fluids and materials. In this review we discuss some of the more promising approaches proposed in the recent literature along with their advantages and limitations.

Wang-Landau sampling: improving accuracy

In this work, we investigate the behavior of the microcanonical and canonical averages of the two-dimensional Ising model during the Wang-Landau simulation. The simulations were carried out using conventional Wang-Landau sampling and the 1/t scheme. Our findings reveal that the microcanonical average should not be accumulated during the initial modification factors f, and they outline a criterion to find this limit, which we define as f(micro). We show that updating the density of states only after every L(2) spin-flip trials leads to a much better precision. We present a mechanism to determine for the given model up to what final modification factor f(final) the simulations should be carried out. Altogether these small adjustments lead to an improved procedure for simulations with much more reliable results. We compare our results with 1/t simulations. We also present an application of the procedure to a self-avoiding homopolymer.

Phase diagrams of knotted and unknotted ring polymers

The phase diagram for a lattice ring polymer under applied force, with variable solvent quality, for different topological knot states, is determined for the first time. In addition to eliminating pseudophases where the polymer is flattened into a single layer, it is found that nontrivial knots result in additional pseudophases under tensile force conditions.