Stochastic determination of effective Hamiltonian for the full configuration interaction solution of quasi-degenerate electronic states

Toward a Stochastic Complete Active Space Second-Order Perturbation Theory

In this work, an internally contracted stochastic complete active space second-order perturbation theory, stochastic-CASPT2, is reported. The method relies on stochastically sampled reduced density matrices (RDMs) up to rank four and contractions thereof with the generalized Fock matrix. A new protocol for calculating higher-order RDMs in full configuration interaction quantum Monte Carlo (FCIQMC) has been designed based on (1) restricting sampling of the corresponding excitations to a deterministic subspace, (2) averaging the RDMs from independent dynamics and (3) projecting them onto the closest positive semi-definite matrix. Our protocol avoids previously encountered numerical conditioning problems in the orthogonalization of the perturber overlap matrix stemming from numerical noise. The chromium dimer CASSCF(12,12)/CASPT2 binding curve is computed as a proof of concept.

Nonunitary projective transcorrelation theory inspired by the F12 ansatz

An alternative nonunitary transcorrelation, inspired by the F12 ansatz, is investigated. In contrast to the Jastrow transcorrelation of Boys-Handy, the effective Hamiltonian of this projective transcorrelation features: 1. a series terminating formally at four-body interactions. 2. no spin-contamination within the non-relativistic framework. 3. simultaneous satisfaction of the singlet and triplet first-order cusp conditions. 4. arbitrary choices of pairs for correlation including frozen-core approximations. We discuss the connection between the projective transcorrelation and F12 theory with applications to small molecules, to show that the cusp conditions play an important role to reduce the uncertainty arising from the nonunitary transformation.

The Multistate Quantum Monte Carlo Algebraic Diagrammatic Construction Method

A multistate formulation of the recently developed quantum Monte Carlo (QMC) algebraic diagrammatic construction (ADC) method, QMCADC, is presented. QMCADC solves the Hermitian eigenvalue problem of the second-order ADC scheme for the polarization propagator stochastically by combining ADC schemes with projector quantum Monte Carlo (PQMC). It allows for massively parallel distributed computing and exploits the sparsity of the effective ADC matrix, thereby relaxing memory and processing requirements of ADC methods significantly. Here, the theory and implementation of the multistate variant of QMCADC are described, and our first proof-of-principle calculations for various molecular systems are shown. Indeed, multistate QMCADC enables sampling of an arbitrary number of low-lying excited states and can reproduce their vertical excitation energies with a marginal controllable error. The performance of multistate QMCADC is examined in terms of state-wise and overall accuracy as well as with respect to the balance in the treatments of excited states relatively to each other. The results are very promising as they show bias and imbalances among excited states to diminish as the number of sampling points increases. Furthermore, the impact of the quality of trial wave functions on the vertical excitation energies is investigated. A black-box approach for the generation of high quality trial wave functions internally is given.

Block Effective Hamiltonian Theory and Its Application

Block effective Hamiltonian theory (BEHT) is presented in this work. Configuration interaction functions are divided into P, Q, and R spaces. Effective Hamiltonian is constructed with the partitioning technique within the P space. The eigenvalue problem of the effective Hamiltonian is then solved iteratively. It is demonstrated that the ground-state energies of N₂, HF, and F₂ calculated with BEHT converge to the multireference configuration interaction energies from below and the iteration number becomes smaller as BEHT energy becomes closer to the exact energy. The accuracy of BEHT is better than that of the second-order multireference perturbation theory, although the matrix elements in both methods are the same. The ionization potentials of the singlet state of HF, the doublet state of F, and the triplet state of NH and the potential energy curves of CH₄, C₂, and N₂ are calculated with BEHT and compared with experiments and results of CASSCF, CCSD, and CCSD(T) and the results of the full configuration interaction if available. The iteration numbers are all less than 10 in this study. These calculations show the good performances of BEHT in comparison with other theoretical approximation methods.

Downfolded Configuration Interaction for Chemically Accurate Electron Correlation

A model subspace configuration interaction method is developed to obtain chemically accurate electron correlations by diagonalizing a very compact effective Hamiltonian of a realistic molecule. The construction of the effective Hamiltonian is deterministic and implemented by iteratively building a sufficiently small model subspace comprising local clusters of a small number of Slater determinants. Through the low-rank reciprocal of interaction Hamiltonian, important determinants can be incrementally identified to couple with selected local pairwise clusters and then downfolded into the model subspace. This method avoids direct ordering and selection of the configurations in the entire space. We demonstrate the efficiency and accuracy of this theory for obtaining the near-FCI ground- and excited-state potential energies by benchmarking the C₂ molecule and illustrate its application potential in computing accurate excitation energies of organometallic [Cu(NHC)₂(pyridine)₂]^x+ complexes and other organic molecules of various excitation character.

Stochastic evaluation of four-component relativistic second-order many-body perturbation energies: A potentially quadratic-scaling correlation method

A second-order many-body perturbation correction to the relativistic Dirac-Hartree-Fock energy is evaluated stochastically by integrating 13-dimensional products of four-component spinors and Coulomb potentials. The integration in the real space of electron coordinates is carried out by the Monte Carlo (MC) method with the Metropolis sampling, whereas the MC integration in the imaginary-time domain is performed by the inverse-CDF (cumulative distribution function) method. The computational cost to reach a given relative statistical error for spatially compact but heavy molecules is observed to be no worse than cubic and possibly quadratic with the number of electrons or basis functions. This is a vast improvement over the quintic scaling of the conventional, deterministic second-order many-body perturbation method. The algorithm is also easily and efficiently parallelized with demonstrated 92% strong scalability going from 64 to 4096 processors for a fixed job size.

The Static-Dynamic-Static Family of Methods for Strongly Correlated Electrons: Methodology and Benchmarking

A series of methods (SDSCI, SDSPT2, iCI, iCIPT2, iCISCF(2), iVI, and iCAS) is introduced to accurately describe strongly correlated systems of electrons. Born from the (restricted) static-dynamic-static (SDS) framework for designing many-electron wave functions, SDSCI is a minimal multireference (MR) configuration interaction (CI) approach that constructs and diagonalizes a [Formula: see text] matrix for [Formula: see text] states, regardless of the numbers of orbitals and electrons to be correlated. If the full molecular Hamiltonian H in the QHQ block (which describes couplings between functions of the first-order interaction space Q) of the SDSCI CI matrix is replaced with a zeroth-order Hamiltonian [Formula: see text] before the diagonalization is taken, we obtain SDSPT2, a CI-like second-order perturbation theory (PT2). Unlike most variants of MRPT2, SDSPT2 treats single and multiple states in the same way and is particularly advantageous in the presence of near degeneracy. On the other hand, if the SDSCI procedure is repeated until convergence, we will have iterative CI (iCI), which can converge quickly from the above to the exact solutions (full CI) even when starting with a poor guess. When further combined with the selection of important configurations followed by a PT2 treatment of dynamic correlation, iCI becomes iCIPT2, which is a near-exact theory for medium-sized systems. The microiterations of iCI for relaxing the coefficients of contracted many-electron functions can be generalized to an iterative vector interaction (iVI) approach for finding exterior or interior roots of a given matrix, in which the dimension of the search subspace is fixed by either the number of target roots or the user-specified energy window. Naturally, iCIPT2 can be employed as the active space solver of the complete active space (CAS) self-consistent field, leading to iCISCF(2), which can further be combined with iCAS for automated selection of active orbitals and assurance of the same CAS for all states and all geometries. The methods are calibrated by taking the Thiel set of benchmark systems as examples. Results for the corresponding cations, a new set of benchmark systems, are also reported.

Fixed- and Partial-Node Approximations in Slater Determinant Space for Molecules

We present a study of fixed- and partial-node approximations in Slater determinant basis sets, using full configuration interaction quantum Monte Carlo (FCIQMC) to perform sampling. Walker annihilation in the FCIQMC method allows partial-node simulations to be performed, relaxing the nodal constraint to converge to the FCI solution. This is applied to ab initio molecular systems, using symmetry-projected Jastrow mean-field wave functions for complete active space (CAS) problems. Convergence and the sign problem within the partial-node approximation are studied, which is shown to eventually be limited in its use due to the large walker populations required. However, the fixed-node approximation results in an accurate and practical method. We apply these approaches to various molecular systems and active spaces, including ferrocene and acenes. This also provides a test of symmetry-projected Jastrow mean-field wave functions in variational Monte Carlo for a new set of problems. For trans-polyacetylene molecules and acenes, we find that the time to perform a constant number of fixed-node FCIQMC iterations scales as O(N1.44) and O(N1.75), respectively, resulting in an efficient method for CAS-based problems that can be applied accurately to large active spaces.

Monte Carlo MP2-F12 for Noncovalent Interactions: The C60 Dimer

A scalable stochastic algorithm is presented that can evaluate explicitly correlated (F12) second-order many-body perturbation (MP2) energies of weak, noncovalent, intermolecular interactions. It first transforms the formulas of the MP2 and F12 energy differences into a short sum of high-dimensional integrals of Green's functions in real space and imaginary time. These integrals are then evaluated by the Monte Carlo method augmented by parallel execution, redundant-walker convergence acceleration, direct-sampling autocorrelation elimination, and control-variate error reduction. By sharing electron-pair walkers across the supermolecule and its subsystems spanned by the joint basis set, the statistical uncertainty is reduced by one to 2 orders of magnitude in the MP2 binding energy corrected for the basis-set incompleteness and superposition errors. The method predicts the MP2-F12/aug-cc-pVDZ binding energy of 19.1 ± 4.0 kcal mol^-1 for the C₆₀ dimer at the center distance of 9.748 Å.

Stochastic evaluation of fourth-order many-body perturbation energies

A scalable, stochastic algorithm evaluating the fourth-order many-body perturbation (MP4) correction to energy is proposed. Three hundred Goldstone diagrams representing the MP4 correction are computer generated and then converted into algebraic formulas expressed in terms of Green's functions in real space and imaginary time. They are evaluated by the direct (i.e., non-Markov, non-Metropolis) Monte Carlo (MC) integration accelerated by the redundant-walker and control-variate algorithms. The resulting MC-MP4 method is efficiently parallelized and is shown to display O(n^5.3) size-dependence of cost, which is nearly two ranks lower than the O(n⁷) dependence of the deterministic MP4 algorithm. It evaluates the MP4/aug-cc-pVDZ energy for benzene, naphthalene, phenanthrene, and corannulene with the statistical uncertainty of 10 mE_h (1.1% of the total basis-set correlation energy), 38 mE_h (2.6%), 110 mE_h (5.5%), and 280 mE_h (9.0%), respectively, after about 10⁹ MC steps.

CAS without SCF-Why to use CASCI and where to get the orbitals

The complete active space self-consistent field (CASSCF) method has seen broad adoption due to its ability to describe the electronic structure of both the ground and excited states of molecules over a broader swath of the potential energy surface than is possible with the simpler Hartree-Fock approximation. However, it also has a reputation for being unwieldy, computationally costly, and un-black-box. Here, we discuss a class of alternatives, complete active space configuration interaction (CASCI) methods, paying particular attention to their application to electronic excited states. The goal of this Perspective is fourfold. First, we argue that CASCI is not merely an approximation to CASSCF, in that it can be designed to have important qualitative advantages over CASSCF. Second, we present several insights drawn from our experience experimenting with different schemes for computing orbitals to be employed in CASCI. Third, we argue that CASCI is well suited for application to nanomaterials. Finally, we reason that, with the rise in new low-scaling approaches for describing multireference systems, there is a greater need than ever to develop new methods for defining orbitals that provide an efficient and accurate description of both static correlation and electronic excitations in a limited active space.

Further Development of iCIPT2 for Strongly Correlated Electrons

The efficiency of the recently proposed iCIPT2 [iterative configuration interaction (iCI) with selection and second-order perturbation theory (PT2); J. Chem. Theory Comput. 2020, 16, 2296] for strongly correlated electrons is further enhanced (by up to 20×) by using (1) a new ranking criterion for configuration selection, (2) a new particle-hole algorithm for Hamiltonian construction over randomly selected configuration state functions (CSF), and (3) a new data structure for the quick sorting of the variational and first-order interaction spaces. Meanwhile, the memory requirement is also significantly reduced. As a result, this improved implementation of iCIPT2 can handle 1 order of magnitude more CSFs than the previous version, as revealed by taking the chromium dimer and an iron-sulfur cluster, [Fe₂S₂(SCH₃)]₄^2-, as examples.

The Shape of Full Configuration Interaction to Come

We present a Perspective on what the future holds for full configuration interaction (FCI) theory, with an emphasis on conceptual rather than technical details. Upon revisiting the early history of FCI, a number of its key contemporary approximations are compared on as equal a footing as possible, using a recent blind challenge on the benzene molecule as a testbed [Eriksen et al., J. Phys. Chem. Lett., 2020 11, 8922]. In the process, we review the scope of applications for which FCI continues to prove indispensable, and the required traits in terms of robustness, efficacy, and reliability its modern approximations must satisfy are discussed. We close by conveying a number of general observations on the merits offered by the state-of-the-art alongside some of the challenges still faced to this day. While the field has altogether seen immense progress over the years-the past decade, in particular-it remains clear that our community as a whole has a substantial way to go in enhancing the overall applicability of near-exact electronic structure theory for systems of general composition and increasing size.

Towards Near-Exact Solutions of Molecular Electronic Structure: Full Coupled-Cluster Reduction with a Second-Order Perturbative Correction

We introduce a new augmented adaptation of the recently developed full coupled-cluster reduction (FCCR) with a second-order perturbative correction, abbreviated as FCCR(2). FCCR is a selected coupled-cluster expansion aimed at optimally reducing the excitation manifold and commutator expansions for high-rank excitations for obtaining accurate solutions of the electronic Schödinger equation in a size-extensive manner. The present FCCR(2) enables estimating the residual correlation of FCCR by the second-order perturbative correction E⁽²⁾ from the complementary space of the FCCR projection manifold. The linear relationship between E⁽²⁾ and the energy of FCCR(2) allows accurate estimates of near-exact energies for a wide variety of molecules with strong electron correlation. The potential of the method is demonstrated using challenging cases, the ground-state electronic energy of the benzene molecule in equilibrium and stretched geometries, and the isomerization energy of the transition metal complex [Cu(NH₃)]₂O₂²⁺.

Artificial Neural Networks Applied as Molecular Wave Function Solvers

We use artificial neural networks (ANNs) based on the Boltzmann machine (BM) architectures as an encoder of ab initio molecular many-electron wave functions represented with the complete active space configuration interaction (CAS-CI) model. As first introduced by the work of Carleo and Troyer for physical systems, the coefficients of the electronic configurations in the CI expansion are parametrized with the BMs as a function of their occupancies that act as descriptors. This ANN-based wave function ansatz is referred to as the neural-network quantum state (NQS). The machine learning is used for training the BMs in terms of finding a variationally optimal form of the ground-state wave function on the basis of the energy minimization. It is relevant to reinforcement learning and does not use any reference data nor prior knowledge of the wave function, while the Hamiltonian is given based on a user-specified chemical structure in the first-principles manner. Carleo and Troyer used the restricted Boltzmann machine (RBM), which has hidden units, for the neural network architecture of NQS, while, in this study, we further introduce its replacement with the BM that has only visible units but with different orders of connectivity. For this hidden-node free BM, the second- and third-order BMs based on quadratic and cubic energy functions, respectively, were implemented. We denote these second- and third-order BMs as BM2 and BM3, respectively. The pilot implementation of the NQS solver into an exact diagonalization module of the quantum chemistry program was made to assess the capability of variants of the BM-based NQS. The test calculations were performed by determining the CAS-CI wave functions of illustrative molecular systems, indocyanine green, and dinitrogen dissociation. The simulated energies have been shown to converge to CAS-CI energy in most cases by improving RBM with an increasing number of hidden nodes. BM3 systematically yields lower energies than BM2, reproducing the CAS-CI energies of dinitrogen across potential energy curves within an error of 50 μE_h.

Stochastic perturbation theory in a limited configuration space

A general-order stochastic perturbation algorithm is obtained from the order-by-order expansion of the imaginary-time evolution of a configuration interaction wave function. A truncation of configuration space that is required for the practical treatment of the perturbative corrections, however, does not preserve size-consistency as is the case for a truncated configuration interaction. To circumvent this problem, we formulate a linked variant of stochastic perturbation theory based on the coupled-cluster ansatz. The implementation based on the linearized coupled-cluster is compared with several full configuration interaction results. We also compare the results with those obtained from deterministic coupled-cluster and many-body perturbation theories.

Full Coupled-Cluster Reduction for Accurate Description of Strong Electron Correlation

A full coupled-cluster expansion suitable for sparse algebraic operations is developed by expanding the commutators of the Baker-Campbell-Hausdorff series explicitly for cluster operators in binary representations. A full coupled-cluster reduction that is capable of providing very accurate solutions of the many-body Schrödinger equation is then initiated employing screenings to the projection manifold and commutator operations. The projection manifold is iteratively updated through the single commutators ⟨κ|[H[over ^],T[over ^]]|0⟩ comprised of the primary clusters T[over ^]_{λ} with a substantial contribution to the connectivity. The operation of the commutators is further reduced by introducing a correction, taking into account the so-called exclusion-principle-violating terms that provides a fast and near-variational convergence in many cases.

A Deterministic Projector Configuration Interaction Approach for the Ground State of Quantum Many-Body Systems

In this work we propose a novel approach to solve the Schrödinger equation which combines projection onto the ground state with a path-filtering truncation scheme. The resulting projector configuration interaction (PCI) approach realizes a deterministic version of the full configuration interaction quantum Monte Carlo (FCIQMC) method [Booth, G. H.; Thom, A. J. W.; Alavi, A. J. Chem. Phys. 2009, 131, 054106]. To improve upon the linearized imaginary-time propagator, we develop an optimal projector scheme based on an exponential Chebyshev expansion in the limit of an infinite imaginary time step. After writing the exact projector as a path integral in determinant space, we introduce a path filtering procedure that truncates the size of the determinantal basis and approximates the Hamiltonian. The path filtering procedure is controlled by one real threshold that determines the accuracy of the PCI energy and is not biased toward any determinant. Therefore, the PCI approach can equally well describe static and dynamic electron correlation effects. This point is illustrated in benchmark computations on N2 at both equilibrium and stretched geometries. In both cases, the PCI achieves chemical accuracy with wave functions that contain less than 0.5% determinants of full CI space. We also report computations on the ground state of C2 with up to quaduple-ζ basis sets and wave functions as large as 200 million determinants, which allow a direct comparison of the PCI, FCIQMC, and density matrix renormalization group (DMRG) methods. The size of the PCI wave function grows modestly with the number of unoccupied orbitals, and its accuracy may be tuned to match that of FCIQMC and DMRG.