iCI: Iterative CI toward full CI

Is Externally Corrected Coupled Cluster Always Better Than the Underlying Truncated Configuration Interaction?

The short answer to the question in the title is "no". We identify classes of truncated configuration interaction (CI) wave functions for which the externally corrected coupled-cluster (ec-CC) approach using the three-body (T₃) and four-body (T₄) components of the cluster operator extracted from CI does not improve the results of the underlying CI calculations. Implications of our analysis, illustrated by numerical examples, for the ec-CC computations using truncated and selected CI methods are discussed. We also introduce a novel ec-CC approach using the T₃ and T₄ amplitudes obtained with the selected CI scheme abbreviated as CIPSI, correcting the resulting energies for the missing T₃ correlations not captured by CIPSI with the help of moment expansions similar to those employed in the completely renormalized CC methods.

How accurate are EOM-CC4 vertical excitation energies?

We report the first investigation of the performance of EOM-CC4-an approximate equation-of-motion coupled-cluster model, which includes iterative quadruple excitations-for vertical excitation energies in molecular systems. By considering a set of 28 excited states in 10 small molecules for which we have computed CC with singles, doubles, triples, quadruples, and pentuples and full configuration interaction reference energies, we show that, in the case of excited states with a dominant contribution from the single excitations, CC4 yields excitation energies with sub-kJ mol^-1 accuracy (i.e., error below 0.01 eV), in very close agreement with its more expensive CC with singles, doubles, triples, and quadruples parent. Therefore, if one aims at high accuracy, CC4 stands as a highly competitive approximate method to model molecular excited states, with a significant improvement over both CC3 and CC with singles, doubles, and triples. Our results also evidence that, although the same qualitative conclusions hold, one cannot reach the same level of accuracy for transitions with a dominant contribution from the double excitations.

Externally Corrected CCSD with Renormalized Perturbative Triples (R-ecCCSD(T)) and the Density Matrix Renormalization Group and Selected Configuration Interaction External Sources

We investigate the renormalized perturbative triples correction together with the externally corrected coupled-cluster singles and doubles (ecCCSD) method. We use the density matrix renormalization group (DMRG) and heat-bath CI (HCI) as external sources for the ecCCSD equations. The accuracy is assessed for the potential energy surfaces of H₂O, N₂, and F₂. We find that the triples correction significantly improves upon ecCCSD, and we do not see any instability of the renormalized triples with respect to dissociation. We explore how to balance the cost of computing the external source amplitudes against the accuracy of the subsequent CC calculation. In this context, we find that very approximate wave functions (and their large amplitudes) serve as an efficient and accurate external source. Finally, we characterize the domain of correlation treatable using the ecCCSD and renormalized triples combination studied in this work via a well-known wave function diagnostic.

Approximations of density matrices in N-electron valence state second-order perturbation theory (NEVPT2). I. Revisiting the NEVPT2 construction

Over the last decade, the second-order N-electron valence state perturbation theory (NEVPT2) has developed into a widely used multireference perturbation method. To apply NEVPT2 to systems with large active spaces, the computational bottleneck is the construction of the fourth-order reduced density matrix. Both its generation and storage become quickly problematic beyond the usual maximum active space of about 15 active orbitals. To reduce the computational cost of handling fourth-order density matrices, the cumulant approximation (CU) has been proposed in several studies. A more conventional strategy to address the higher-order density matrices is the pre-screening approximation (PS), which is the default one in the ORCA program package since 2010. In the present work, the performance of the CU, PS, and extended PS (EPS) approximations for the fourth-order density matrices is compared. Following a pedagogical introduction to NEVPT2, contraction schemes, as well as the approximations to density matrices, and the intruder state problem are discussed. The CU approximation, while potentially leading to large computational savings, virtually always leads to intruder states. With the PS approximation, the computational savings are more modest. However, in conjunction with conservative cutoffs, it produces stable results. The EPS approximation to the fourth-order density matrices can reproduce very accurate NEVPT2 results without any intruder states. However, its computational cost is not much lower than that of the canonical algorithm. Moreover, we found that a good indicator of intrude states problems in any approximation to high order density matrices is the eigenspectra of the Koopmans matrices.

Near-Exact CASSCF-Level Geometry Optimization with a Large Active Space using Adaptive Sampling Configuration Interaction Self-Consistent Field Corrected with Second-Order Perturbation Theory (ASCI-SCF-PT2)

An accurate description of electron correlation is one of the most challenging problems in quantum chemistry. The exact electron correlation can be obtained by means of full configuration interaction (FCI). A simple strategy for approximating FCI at a reduced computational cost is selected CI (SCI), which diagonalizes the Hamiltonian within only the chosen configuration space. Recovery of the contributions of the remaining configurations is possible with second-order perturbation theory. Here, we apply adaptive sampling configuration interaction (ASCI) combined with molecular orbital optimizations (ASCI-SCF) corrected with second-order perturbation theory (ASCI-SCF-PT2) for geometry optimization by implementing the analytical nuclear gradient algorithm for ASCI-PT2 with the Z-vector (Lagrangian) formalism. We demonstrate that for phenalenyl radicals and anthracene, optimized geometries and the number of unpaired electrons can be obtained at nearly the CASSCF accuracy by incorporating PT2 corrections and extrapolating them. We demonstrate the current algorithm's utility for optimizing the equilibrium geometries and electronic structures of six-ring-fused polycyclic aromatic hydrocarbons and 4-periacene.

Comparison of Many-Particle Representations for Selected Configuration Interaction: II. Numerical Benchmark Calculations

The present work is the second part in our three-part series on the comparison of many-particle representations for the selected configuration interaction (CI) method. In this work, we present benchmark calculations based on our selected CI program called the iterative configuration expansion (ICE) that is inspired by the CIPSI method of Malrieu and co-workers (MalrieuJ. Chem. Phys.1973, 58, ( (12), ), 5745−5759). We describe the main parameters that enter in this algorithm and perform benchmark calculations on a set of 21 small molecules and compare ground state energies with full configuration interaction (FCI) results (FCI21 test set). The focus is the comparison of the performance of three different types of many-particle basis functions (MPBFs): (1) individual Slater determinants (DETS), (2) individual spin-adapted configuration state functions (CSFs), and (3) all CSFs of a given total spin that can be generated from spatial configurations (CFGs). An analysis of the cost of the calculation in terms of the number of wavefunction parameters and the energy error is evaluated for the DET-, CFG-, and CSF-based ICE. The main differences for the three many-particle basis representations show up in the number of wavefunction parameters and the rate of convergence toward the FCI limit with the thresholds of the ICE. Next, we analyze the best way to extrapolate the ICE energies toward the FCI results as a function of the thresholds. The efficiency of the extrapolation is investigated relative to the FCI21 test set as well as near FCI calculations on three moderately sized hydrocarbon molecules CH₄, C₂H₄, and C₄H₆. Finally, we comment on the size-inconsistency error for the three many-particle representations and compare it with the error in the total energy. The implication for selected CI implementations with any of the three many-particle representations is discussed.

Spin-Flip Pair-Density Functional Theory: A Practical Approach To Treat Static and Dynamical Correlations in Large Molecules

We present a practical approach to treat static and dynamical correlation accurately in large multiconfigurational systems. The static correlation is taken into account by using the spin-flip approach, which is well-known for capturing static correlation accurately at low-computational expense. Unlike previous approaches to add dynamical correlation to spin-flip models which use perturbation theory or coupled-cluster theory, we explore the ability to use the on-top pair-density functional theory approaches recently developed by Gagliardi and co-workers (J. Comput. Theor. Chem., 2014, 10, 3669). External relaxations are performed in the spin-flip calculations through a restricted active space framework for which a truncation scheme for the orbitals used in the external excitation is presented. The performance of the approach is demonstrated by computing energy gaps between ground and excited states for diradicals, triradicals, and linear polyacene chains ranging from naphthalene to dodecacene. Accurate results are obtained using the new approach for these challenging open-shell molecular systems.

High-level coupled-cluster energetics by Monte Carlo sampling and moment expansions: Further details and comparisons

We recently proposed a novel approach to converging electronic energies equivalent to high-level coupled-cluster (CC) computations by combining the deterministic CC(P;Q) formalism with the stochastic configuration interaction (CI) and CC Quantum Monte Carlo (QMC) propagations. This article extends our initial study [J. E. Deustua, J. Shen, and P. Piecuch, Phys. Rev. Lett. 119, 223003 (2017)], which focused on recovering the energies obtained with the CC method with singles, doubles, and triples (CCSDT) using the information extracted from full CI QMC and CCSDT-MC, to the CIQMC approaches truncated at triples and quadruples. It also reports our first semi-stochastic CC(P;Q) calculations aimed at converging the energies that correspond to the CC method with singles, doubles, triples, and quadruples (CCSDTQ). The ability of the semi-stochastic CC(P;Q) formalism to recover the CCSDT and CCSDTQ energies, even when electronic quasi-degeneracies and triply and quadruply excited clusters become substantial, is illustrated by a few numerical examples, including the F-F bond breaking in F₂, the automerization of cyclobutadiene, and the double dissociation of the water molecule.

Comparison of many-particle representations for selected-CI I: A tree based approach

The full configuration interaction (FCI) method is only applicable to small molecules with few electrons in moderate size basis sets. One of the main alternatives to obtain approximate FCI energies for bigger molecules and larger basis sets is selected CI. However, due to: (a) the lack of a well-defined structure in a selected CI Hamiltonian, (b) the potentially large number of electrons together with c) potentially large orbital spaces, a computationally and memory efficient algorithm is difficult to construct. In the present series of papers, we describe our attempts to address these issues by exploring tree-based approaches. At the same time, we devote special attention to the issue of obtaining eigenfunctions of the total spin squared operator since this is of particular importance in tackling magnetic properties of complex open shell systems. Dedicated algorithms are designed to tackle the CI problem in terms of determinant, configuration (CFG) and configuration state function many-particle bases by effective use of the tree representation. In this paper we describe the underlying logic of our algorithm design and discuss the advantages and disadvantages of the different many particle bases. We demonstrate by the use of small examples how the use of the tree simplifies many key algorithms required for the design of an efficient selected CI program. Our selected CI algorithm, called the iterative configuration expansion, is presented in the penultimate part. Finally, we discuss the limitations and scaling characteristics of the present approach.

Further Development of iCIPT2 for Strongly Correlated Electrons

The efficiency of the recently proposed iCIPT2 [iterative configuration interaction (iCI) with selection and second-order perturbation theory (PT2); J. Chem. Theory Comput. 2020, 16, 2296] for strongly correlated electrons is further enhanced (by up to 20×) by using (1) a new ranking criterion for configuration selection, (2) a new particle-hole algorithm for Hamiltonian construction over randomly selected configuration state functions (CSF), and (3) a new data structure for the quick sorting of the variational and first-order interaction spaces. Meanwhile, the memory requirement is also significantly reduced. As a result, this improved implementation of iCIPT2 can handle 1 order of magnitude more CSFs than the previous version, as revealed by taking the chromium dimer and an iron-sulfur cluster, [Fe₂S₂(SCH₃)]₄^2-, as examples.

The Shape of Full Configuration Interaction to Come

We present a Perspective on what the future holds for full configuration interaction (FCI) theory, with an emphasis on conceptual rather than technical details. Upon revisiting the early history of FCI, a number of its key contemporary approximations are compared on as equal a footing as possible, using a recent blind challenge on the benzene molecule as a testbed [Eriksen et al., J. Phys. Chem. Lett., 2020 11, 8922]. In the process, we review the scope of applications for which FCI continues to prove indispensable, and the required traits in terms of robustness, efficacy, and reliability its modern approximations must satisfy are discussed. We close by conveying a number of general observations on the merits offered by the state-of-the-art alongside some of the challenges still faced to this day. While the field has altogether seen immense progress over the years-the past decade, in particular-it remains clear that our community as a whole has a substantial way to go in enhancing the overall applicability of near-exact electronic structure theory for systems of general composition and increasing size.

Portably parallel construction of a configuration-interaction wave function from a matrix-product state using the Charm++ framework

The construction of configuration-interaction (CI) expansions from a matrix product state (MPS) involves numerous matrix operations and the skillful sampling of important configurations in a large Hilbert space. In this work, we present an efficient procedure for constructing CI expansions from MPS employing the parallel object-oriented Charm++ programming framework, upon which automatic load-balancing and object migrating facilities can be employed. This procedure was employed in the MPS-to-CI utility (Moritz et al., J. Chem. Phys. 2007, 126, 224109), the sampling-reconstructed complete active-space algorithm (SR-CAS, Boguslawski et al., J. Chem. Phys. 2011, 134, 224101), and the entanglement-driven genetic algorithm (EDGA, Luo et al., J. Chem. Theory Comput. 2017, 13, 4699). It enhances productivity and allows the sampling programs to evolve to their population-expansion versions, for example, EDGA with population expansion (PE-EDGA). Further, examples of 1,2-dioxetanone and firefly dioxetanone anion (FDO^- ) molecules demonstrated the following: (a) parallel efficiencies can be persistently improved by simply by increasing the proportions of the asynchronous executions and (b) a sampled CAS-type CI wave function of a bi-radical-state FDO^- molecule utilizing the full valence (30e,26o) active space can be constructed within a few hours with using thousands of cores.

Quantum simulations employing connected moments expansions

Further advancement of quantum computing (QC) is contingent on enabling many-body models that avoid deep circuits and excessive use of CNOT gates. To this end, we develop a QC approach employing finite-order connected moment expansions (CMX) and affordable procedures for initial state preparation. We demonstrate the performance of our approach employing several quantum variants of CMX through the classical emulations on the H₂ molecule potential energy surface and the Anderson model with a broad range of correlation strength. The results show that our approach is robust and flexible. Good agreement with exact solutions can be maintained even at the dissociation and strong correlation limits.

Efficient local energy evaluation for multi-Slater wave functions in orbital space quantum Monte Carlo

We present an algorithm for calculating the local energy of a multi-Slater wave function in orbital space quantum Monte Carlo (QMC). Recent developments in selected configuration interaction methods have led to increased interest in using multi-Slater trial wave functions in various QMC methods. For an ab initio Hamiltonian, our algorithm has a cost scaling of O(n⁵ + n_c), as opposed to the O(n⁴n_c) scaling of existing orbital space algorithms, where n is the system size and n_c is the number of configurations in the wave function. We present our method using variational Monte Carlo calculations with the Jastrow multi-Slater wave function, although the formalism should be applicable for auxiliary field QMC. We apply it to polyacetylene and demonstrate the possibility of using a much larger number of configurations than possible using existing methods.

Towards Near-Exact Solutions of Molecular Electronic Structure: Full Coupled-Cluster Reduction with a Second-Order Perturbative Correction

We introduce a new augmented adaptation of the recently developed full coupled-cluster reduction (FCCR) with a second-order perturbative correction, abbreviated as FCCR(2). FCCR is a selected coupled-cluster expansion aimed at optimally reducing the excitation manifold and commutator expansions for high-rank excitations for obtaining accurate solutions of the electronic Schödinger equation in a size-extensive manner. The present FCCR(2) enables estimating the residual correlation of FCCR by the second-order perturbative correction E⁽²⁾ from the complementary space of the FCCR projection manifold. The linear relationship between E⁽²⁾ and the energy of FCCR(2) allows accurate estimates of near-exact energies for a wide variety of molecules with strong electron correlation. The potential of the method is demonstrated using challenging cases, the ground-state electronic energy of the benzene molecule in equilibrium and stretched geometries, and the isomerization energy of the transition metal complex [Cu(NH₃)]₂O₂²⁺.

The Ground State Electronic Energy of Benzene

We report on the findings of a blind challenge devoted to determining the frozen-core, full configuration interaction (FCI) ground-state energy of the benzene molecule in a standard correlation-consistent basis set of double-ζ quality. As a broad international endeavor, our suite of wave function-based correlation methods collectively represents a diverse view of the high-accuracy repertoire offered by modern electronic structure theory. In our assessment, the evaluated high-level methods are all found to qualitatively agree on a final correlation energy, with most methods yielding an estimate of the FCI value around -863 mE_H. However, we find the root-mean-square deviation of the energies from the studied methods to be considerable (1.3 mE_H), which in light of the acclaimed performance of each of the methods for smaller molecular systems clearly displays the challenges faced in extending reliable, near-exact correlation methods to larger systems. While the discrepancies exposed by our study thus emphasize the fact that the current state-of-the-art approaches leave room for improvement, we still expect the present assessment to provide a valuable community resource for benchmark and calibration purposes going forward.

Reactivities of singlet oxygen: open-shell or closed-shell?

This work explores the reactivity of singlet oxygen with respect to two typical reactions: cycloaddition to anthracene and excitation energy transfer (EET) to a carotenoid using diabatic states with multistate density functional theory (MSDFT). Noticeably, the degenerate state 1Δg has distinct open-shell (OS) and closed-shell (CS) components, and the closed-shell component showed more reactivity than the open-shell one due to the strong diabatic couplings to the product diabatic states. The diabatic perspective presented in this work could also apply to general singlet fission processes.

Generalized Many-Body Expanded Full Configuration Interaction Theory

Facilitated by a rigorous partitioning of a molecular system's orbital basis into two fundamental subspaces-a reference and an expansion space, both with orbitals of unspecified occupancy-we generalize our recently introduced many-body expanded full configuration interaction (MBE-FCI) method to allow for electron-rich model and molecular systems dominated by both weak and strong correlation to be addressed. By employing minimal or even empty reference spaces, we show through calculations on the one-dimensional Hubbard model with up to 46 lattice sites, the chromium dimer, and the benzene molecule how near-exact results may be obtained in an entirely unbiased manner for chemical and physical problems of not only academic but also applied chemical interest. Given the massive parallelism and overall accuracy of the resulting method, we argue that generalized MBE-FCI theory possesses an immense potential to yield near-exact correlation energies for molecular systems of unprecedented size, composition, and complexity in the years to come.

Stochastic perturbation theory in a limited configuration space

A general-order stochastic perturbation algorithm is obtained from the order-by-order expansion of the imaginary-time evolution of a configuration interaction wave function. A truncation of configuration space that is required for the practical treatment of the perturbative corrections, however, does not preserve size-consistency as is the case for a truncated configuration interaction. To circumvent this problem, we formulate a linked variant of stochastic perturbation theory based on the coupled-cluster ansatz. The implementation based on the linearized coupled-cluster is compared with several full configuration interaction results. We also compare the results with those obtained from deterministic coupled-cluster and many-body perturbation theories.

Variational Excitations in Real Solids: Optical Gaps and Insights into Many-Body Perturbation Theory

We present an approach to studying optical band gaps in real solids in which quantum Monte Carlo methods allow for the application of a rigorous variational principle to both ground and excited state wave functions. In tests that include small, medium, and large band gap materials, optical gaps are predicted with a mean absolute deviation of 3.5% against experiment, less than half the equivalent errors for typical many-body perturbation theories. The approach is designed to be insensitive to the choice of density functional, a property we exploit in order to provide insight into how far different functionals are from satisfying the assumptions of many-body perturbation theory. We explore this question most deeply in the challenging case of ZnO, where we show that, although many commonly used functionals have shortcomings, there does exist a one-particle basis in which perturbation theory's zeroth-order picture is sound. Insights of this nature should be useful in guiding the future application and improvement of these widely used techniques.

Symmetric dissociation of the water molecule with truncation energy error. A benchmark study

We use selected configuration interaction with truncation energy error (SCI-TEE) and CI by parts (CIBP) to study the symmetric dissociation of the water molecule with Roos' triple-ζ double polarization basis set and with the Dunning cc-pVTZ basis. The calculations comprise CISDTQ (CI-4x) through CI-8x for H2O at its equilibrium geometry (Req) and up to fifteen times Req. With the Dunning basis our SCI-TEE-8x energies differ from full CI by less than 0.01 mHartree (0.006 kcal mol-1) at all O-H distances, representing the best upper bounds for this system outside Req. We compare our results with those of other relevant ab initio methods finding good agreement with recent DMRG calculations. The non-parallelity error (NPE) for SCI-TEE-6x remains stable below 0.1 mHartree when moving from the Roos to the Dunning orbitals. For the present system, CBS energy errors at the experimental equilibrium geometry and at dissociation can accurately be evaluated as the difference between non-relativistic total electronic energies taken from the literature, and our SCI-TEE-8x energies obtained with Dunning's or Roos' orbitals. In both cases, the difference between CBS energy errors at the equilibrium geometry and dissociation is not smaller than 10 mH, showing that chemically accurate NPE values do not guarantee a chemically accurate potential energy surface.