Ab Initio Finite Temperature Auxiliary Field Quantum Monte Carlo

Toward Large-Scale AFQMC Calculations: Large Time Step Auxiliary-Field Quantum Monte Carlo

We report modifications of the ph-AFQMC algorithm that allow the use of large time steps and reliable time step extrapolation. Our modified algorithm eliminates size-consistency errors present in the standard algorithm when large time steps are employed. We investigate various methods to approximate the exponential of the one-body operator within the AFQMC framework, distinctly demonstrating the superiority of Krylov methods over the conventional Taylor expansion. We assess various propagators within AFQMC and demonstrate that the Split-2 propagator is the optimal method, exhibiting the smallest time-step errors. For the HEAT set molecules, the time-step extrapolated energies deviate on average by only 0.19 kcal/mol from the accurate small time-step energies. For small water clusters, we obtain accurate complete basis-set binding energies using time-step extrapolation with a mean absolute error of 0.07 kcal/mol compared to CCSD(T). Using large time-step ph-AFQMC for the N2 dimer, we show that accurate bond lengths can be obtained while reducing CPU time by an order of magnitude.

Fermionic Reduced Density Low-Rank Matrix Completion, Noise Filtering, and Measurement Reduction in Quantum Simulations

Fermionic reduced density matrices summarize the key observables in Fermionic systems. In electronic systems, the two-particle reduced density matrix (2-RDM) is sufficient to determine the energy and most physical observables of interest. Here, we consider the possibility of using matrix completion to reconstruct the two-particle reduced density matrix to chemical accuracy from partial information. We consider the case of noiseless matrix completion, where the partial information corresponds to a subset of the 2-RDM elements, as well as noisy completion, where the partial information corresponds to both a subset of elements and statistical noise in their values. Through experiments on a set of 24 molecular systems, we find that 2-RDM can be efficiently reconstructed from a reduced amount of information. In the case of noisy completion, this results in a multiple orders of magnitude reduction in the number of measurements needed to determine the 2-RDM with chemical accuracy. These techniques can be readily applied to both classical and quantum algorithms for quantum simulations.

Electronic Free Energy Surface of the Nitrogen Dimer Using First-Principles Finite Temperature Electronic Structure Methods

We use full configuration interaction and density matrix quantum Monte Carlo methods to calculate the electronic free energy surface of the nitrogen dimer within the free-energy Born-Oppenheimer approximation. As the temperature is raised from T = 0, we find a temperature regime in which the internal energy causes bond strengthening. At these temperatures, adding in the entropy contributions is required to cause the bond to gradually weaken with increasing temperature. We predict a thermally driven dissociation for the nitrogen dimer between 22,000 to 63,200 K depending on symmetries and basis set. Inclusion of more spatial and spin symmetries reduces the temperature required. The origin of these observations is explored using the structure of the density matrix at various temperatures and bond lengths.

Stable recursive auxiliary field quantum Monte Carlo algorithm in the canonical ensemble: Applications to thermometry and the Hubbard model

Many experimentally accessible, finite-sized interacting quantum systems are most appropriately described by the canonical ensemble of statistical mechanics. Conventional numerical simulation methods either approximate them as being coupled to a particle bath or use projective algorithms which may suffer from nonoptimal scaling with system size or large algorithmic prefactors. In this paper, we introduce a highly stable, recursive auxiliary field quantum Monte Carlo approach that can directly simulate systems in the canonical ensemble. We apply the method to the fermion Hubbard model in one and two spatial dimensions in a regime known to exhibit a significant "sign" problem and find improved performance over existing approaches including rapid convergence to ground-state expectation values. The effects of excitations above the ground state are quantified using an estimator-agnostic approach including studying the temperature dependence of the purity and overlap fidelity of the canonical and grand canonical density matrices. As an important application, we show that thermometry approaches often exploited in ultracold atoms that employ an analysis of the velocity distribution in the grand canonical ensemble may be subject to errors leading to an underestimation of extracted temperatures with respect to the Fermi temperature.

On the potentially transformative role of auxiliary-field quantum Monte Carlo in quantum chemistry: A highly accurate method for transition metals and beyond

Approximate solutions to the ab initio electronic structure problem have been a focus of theoretical and computational chemistry research for much of the past century, with the goal of predicting relevant energy differences to within "chemical accuracy" (1 kcal/mol). For small organic molecules, or in general, for weakly correlated main group chemistry, a hierarchy of single-reference wave function methods has been rigorously established, spanning perturbation theory and the coupled cluster (CC) formalism. For these systems, CC with singles, doubles, and perturbative triples is known to achieve chemical accuracy, albeit at O(N⁷) computational cost. In addition, a hierarchy of density functional approximations of increasing formal sophistication, known as Jacob's ladder, has been shown to systematically reduce average errors over large datasets representing weakly correlated chemistry. However, the accuracy of such computational models is less clear in the increasingly important frontiers of chemical space including transition metals and f-block compounds, in which strong correlation can play an important role in reactivity. A stochastic method, phaseless auxiliary-field quantum Monte Carlo (ph-AFQMC), has been shown to be capable of producing chemically accurate predictions even for challenging molecular systems beyond the main group, with relatively low O(N³ - N⁴) cost and near-perfect parallel efficiency. Herein, we present our perspectives on the past, present, and future of the ph-AFQMC method. We focus on its potential in transition metal quantum chemistry to be a highly accurate, systematically improvable method that can reliably probe strongly correlated systems in biology and chemical catalysis and provide reference thermochemical values (for future development of density functionals or interatomic potentials) when experiments are either noisy or absent. Finally, we discuss the present limitations of the method and where we expect near-term development to be most fruitful.

Bootstrap Embedding on a Quantum Computer

We extend molecular bootstrap embedding to make it appropriate for implementation on a quantum computer. This enables solution of the electronic structure problem of a large molecule as an optimization problem for a composite Lagrangian governing fragments of the total system, in such a way that fragment solutions can harness the capabilities of quantum computers. By employing state-of-art quantum subroutines including the quantum SWAP test and quantum amplitude amplification, we show how a quadratic speedup can be obtained over the classical algorithm, in principle. Utilization of quantum computation also allows the algorithm to match─at little additional computational cost─full density matrices at fragment boundaries, instead of being limited to 1-RDMs. Current quantum computers are small, but quantum bootstrap embedding provides a potentially generalizable strategy for harnessing such small machines through quantum fragment matching.

Effective electronic forces and potentials from ab initio path integral Monte Carlo simulations

The rigorous description of correlated quantum many-body systems constitutes one of the most challenging tasks in contemporary physics and related disciplines. In this context, a particularly useful tool is the concept of effective pair potentials that take into account the effects of the complex many-body medium consistently. In this work, we present extensive, highly accurate ab initio path integral Monte Carlo (PIMC) results for the effective interaction and the effective force between two electrons in the presence of the uniform electron gas. This gives us a direct insight into finite-size effects, thereby, opening up the possibility for novel domain decompositions and methodological advances. In addition, we present unassailable numerical proof for an effective attraction between two electrons under moderate coupling conditions, without the mediation of an underlying ionic structure. Finally, we compare our exact PIMC results to effective potentials from linear-response theory, and we demonstrate their usefulness for the description of the dynamic structure factor. All PIMC results are made freely available online and can be used as a thorough benchmark for new developments and approximations.

Piecewise Interaction Picture Density Matrix Quantum Monte Carlo

The density matrix quantum Monte Carlo (DMQMC) set of methods stochastically samples the exact $N$-body density matrix for interacting electrons at finite temperature. We introduce a simple modification to the interaction picture DMQMC method (IP-DMQMC) which overcomes the limitation of only sampling one inverse temperature point at a time, instead allowing for the sampling of a temperature range within a single calculation thereby reducing the computational cost. At the target inverse temperature, instead of ending the simulation, we incorporate a change of picture away from the interaction picture. The resulting equations of motion have piecewise functions and use the interaction picture in the first phase of a simulation, followed by the application of the Bloch equation once the target inverse temperature is reached. We find that the performance of this method is similar to or better than the DMQMC and IP-DMQMC algorithms in a variety of molecular test systems.

Momentum distribution of the uniform electron gas at finite temperature: Effects of spin polarization

We carry out extensive direct path integral Monte Carlo (PIMC) simulations of the uniform electron gas (UEG) at finite temperature for different values of the spin-polarization ξ. This allows us to unambiguously quantify the impact of spin effects on the momentum distribution function n(k) and related properties. We find that interesting physical effects like the interaction-induced increase in the occupation of the zero-momentum state n(0) substantially depend on ξ. Our results further advance the current understanding of the UEG as a fundamental model system, and are of practical relevance for the description of transport properties of warm dense matter in an external magnetic field. All PIMC results are freely available online and can be used as a benchmark for the development of methods and applications.

The Sign Problem in Density Matrix Quantum Monte Carlo

Density matrix quantum Monte Carlo (DMQMC) is a recently developed method for stochastically sampling the N-particle thermal density matrix to obtain exact-on-average energies for model and ab initio systems. We report a systematic numerical study of the sign problem in DMQMC based on simulations of atomic and molecular systems. In DMQMC, the density matrix is written in an outer product basis of Slater determinants. In principle, this means that DMQMC needs to sample a space that scales in the system size, N, as O[(exp(N))²]. In practice, removing the sign problem requires a total walker population that exceeds a system-dependent critical walker population (N_c), imposing limitations on both storage and compute time. We establish that N_c for DMQMC is the square of N_c for FCIQMC. By contrast, the minimum N_c in the interaction picture modification of DMQMC (IP-DMQMC) is only linearly related to the N_c for FCIQMC. We find that this difference originates from the difference in propagation of IP-DMQMC versus canonical DMQMC: the former is asymmetric, whereas the latter is symmetric. When an asymmetric mode of propagation is used in DMQMC, there is a much greater stochastic error and is thus prohibitively expensive for DMQMC without the interaction picture adaptation. Finally, we find that the equivalence between IP-DMQMC and FCIQMC seems to extend to the initiator approximation, which is often required to study larger systems with large basis sets. This suggests that IP-DMQMC offers a way to ameliorate the cost of moving between a Slater determinant space and an outer product basis.

Real-time dynamics of strongly correlated fermions using auxiliary field quantum Monte Carlo

Spurred by recent technological advances, there is a growing demand for computational methods that can accurately predict the dynamics of correlated electrons. Such methods can provide much-needed theoretical insights into the electron dynamics probed via time-resolved spectroscopy experiments and observed in non-equilibrium ultracold atom experiments. In this article, we develop and benchmark a numerically exact Auxiliary Field Quantum Monte Carlo (AFQMC) method for modeling the dynamics of correlated electrons in real time. AFQMC has become a powerful method for predicting the ground state and finite temperature properties of strongly correlated systems mostly by employing constraints to control the sign problem. Our initial goal in this work is to determine how well AFQMC generalizes to real-time electron dynamics problems without constraints. By modeling the repulsive Hubbard model on different lattices and with differing initial electronic configurations, we show that real-time AFQMC is capable of accurately capturing long-lived electronic coherences beyond the reach of mean field techniques. While the times to which we can meaningfully model decrease with increasing correlation strength and system size as a result of the exponential growth of the dynamical phase problem, we show that our technique can model the short-time behavior of strongly correlated systems to very high accuracy. Crucially, we find that importance sampling, combined with a novel adaptive active space sampling technique, can substantially lengthen the times to which we can simulate. These results establish real-time AFQMC as a viable technique for modeling the dynamics of correlated electron systems and serve as a basis for future sampling advances that will further mitigate the dynamical phase problem.

The Shape of Full Configuration Interaction to Come

We present a Perspective on what the future holds for full configuration interaction (FCI) theory, with an emphasis on conceptual rather than technical details. Upon revisiting the early history of FCI, a number of its key contemporary approximations are compared on as equal a footing as possible, using a recent blind challenge on the benzene molecule as a testbed [Eriksen et al., J. Phys. Chem. Lett., 2020 11, 8922]. In the process, we review the scope of applications for which FCI continues to prove indispensable, and the required traits in terms of robustness, efficacy, and reliability its modern approximations must satisfy are discussed. We close by conveying a number of general observations on the merits offered by the state-of-the-art alongside some of the challenges still faced to this day. While the field has altogether seen immense progress over the years-the past decade, in particular-it remains clear that our community as a whole has a substantial way to go in enhancing the overall applicability of near-exact electronic structure theory for systems of general composition and increasing size.

Finite-size effects in the reconstruction of dynamic properties from ab initio path integral Monte Carlo simulations

We systematically investigate finite-size effects in the dynamic structure factor S(q,ω) of the uniform electron gas obtained via the analytic continuation of ab initio path integral Monte Carlo data for the imaginary-time density-density correlation function F(q,τ). Using the recent scheme by Dornheim et al. [Phys. Rev. Lett. 121, 255001 (2018)PRLTAO0031-900710.1103/PhysRevLett.121.255001], we find that the reconstructed spectra are not afflicted with any finite-size effects for as few as N=14 electrons both at warm dense matter (WDM) conditions and at the margins of the strongly correlated electron liquid regime. Our results further corroborate the high quality of our current description of the dynamic density response of correlated electrons, which is of high importance for many applications in WDM theory and beyond.

Fermion sign problem in path integral Monte Carlo simulations: Quantum dots, ultracold atoms, and warm dense matter

The ab initio thermodynamic simulation of correlated Fermi systems is of central importance for many applications, such as warm dense matter, electrons in quantum dots, and ultracold atoms. Unfortunately, path integral Monte Carlo (PIMC) simulations of fermions are severely restricted by the notorious fermion sign problem (FSP). In this paper, we present a hands-on discussion of the FSP and investigate in detail its manifestation with respect to temperature, system size, interaction-strength and -type, and the dimensionality of the system. Moreover, we analyze the probability distribution of fermionic expectation values, which can be non-Gaussian and fat-tailed when the FSP is severe. As a practical application, we consider electrons and dipolar atoms in a harmonic confinement, and the uniform electron gas in the warm dense matter regime. In addition, we provide extensive PIMC data, which can be used as a reference for the development of new methods and as a benchmark for approximations.

Reaching the Continuum Limit in Finite-Temperature Ab Initio Field-Theory Computations in Many-Fermion Systems

Finite-temperature grand-canonical computations based on field theory are widely applied in areas including condensed matter physics, ultracold atomic gas systems, and the lattice gauge theory. However, these calculations have computational costs scaling as N_{s}^{3} with the size of the lattice or basis set, N_{s}. We report a new approach based on systematically controllable low-rank factorization that reduces the scaling of such computations to N_{s}N_{e}^{2}, where N_{e} is the average number of fermions in the system. In any realistic calculations aiming to describe the continuum limit, N_{s}/N_{e} is large and needs to be extrapolated effectively to infinity for convergence. The method thus fundamentally changes the prospect for finite-temperature many-body computations in correlated fermion systems. Its application, in combination with frameworks to control the sign or phase problem as needed, will provide a powerful tool in ab initio quantum chemistry and correlated electron materials. We demonstrate the method by computing exact properties of the two-dimensional Fermi gas with zero-range attractive interaction as a function of temperature in both the normal and superfluid states.