Efficient calculation of beyond RPA correlation energies in the dielectric matrix formalism

Basis Set Requirements of σ-Functionals for Gaussian- and Slater-Type Basis Functions and Comparison with Range-Separated Hybrid and Double Hybrid Functionals

σ-Functionals belong to the class of Kohn-Sham (KS) correlation functionals based on the adiabatic-connection fluctuation-dissipation theorem and are technically closely related to the random phase approximation (RPA). They have the same computational demand as the latter, with the computational effort of an energy evaluation for both methods being lower than that of a preceding hybrid DFT calculation for typical systems but yield much higher accuracy, reaching chemical accuracy of 1 kcal/mol for quantities such as reactions and transition energies in main group chemistry. In previous work on σ-functionals, rather large Gaussian basis sets have been used. Here, we investigate the actual basis set requirements of σ-functionals and present three setups that employ smaller Gaussian basis sets ranging from quadruple-ζ (QZ) to triple-ζ (TZ) quality and represent a good compromise between accuracy and computational efficiency. Furthermore, we introduce an implementation of σ-functionals based on Slater-type basis sets and present two setups of QZ and TZ quality for this implementation. We test the accuracy of these setups on a large database of various physical properties and types of reactions, as well as equilibrium geometries and vibrational frequencies. As expected, the accuracy of σ-functional calculations becomes somewhat lower with a decreasing basis set size. However, for all setups considered here, calculations with σ-functionals are clearly more accurate than those within the RPA and even more so than those of the conventional KS methods. For the smallest setup using Gaussian-type basis functions and Slater-type basis functions, we introduce a reparametrization that reduces the loss in accuracy due to the basis set error to some extent. A comparison with the range-separated hybrid ωB97X-V and the double hybrid DSD-BLYP-D3 shows that σ functionals outperform in accuracy both of these accurate and, for their class, representative functionals.

Highly accurate σ- and τ-functionals for beyond-RPA methods with approximate exchange kernels

σ-Functionals are promising new developments for the Kohn-Sham correlation energy based upon the direct Random Phase Approximation (dRPA) within the adiabatic connection formalism, providing impressive improvements over dRPA for a broad range of benchmarks. However, σ-functionals exhibit a high amount of self-interaction inherited from the approximations made within dRPA. Inclusion of an exchange kernel in deriving the coupling-strength-dependent density-density response function leads to so-called τ-functionals, which - apart from a fourth-order Taylor series expansion - have only been realized in an approximate fashion so far to the best of our knowledge, most notably in the form of scaled σ-functionals. In this work, we derive, optimize, and benchmark three types of σ- and τ-functionals including approximate exchange effects in the form of an antisymmetrized Hartree kernel. These functionals, based on a second-order screened exchange type contribution in the adiabatic connection formalism, the electron-hole time-dependent Hartree-Fock kernel (eh-TDHF) otherwise known as RPA with exchange (RPAx), and an approximation thereof known as approximate exchange kernel (AXK), are optimized on the ASCDB database using two new parametrizations named A1 and A2. In addition, we report a first full evaluation of σ- and τ-functionals on the GMTKN55 database, revealing our exchange-including functionals to considerably outperform existing σ-functionals while being highly competitive with some of the best double-hybrid functionals of the original GMTKN55 publication. In particular, the σ-functionals based on AXK and τ-functionals based on RPAx with PBE0 reference stand out as highly accurate approaches for a wide variety of chemically relevant problems.

Corrected density functional theory and the random phase approximation: Improved accuracy at little extra cost

We recently introduced an efficient methodology to perform density-corrected Hartree-Fock density functional theory [DC(HF)-DFT] calculations and an extension to it we called "corrected" HF DFT [C(HF)-DFT] [Graf and Thom, J. Chem. Theory Comput. 19 5427-5438 (2023)]. In this work, we take a further step and combine C(HF)-DFT, augmented with a straightforward orbital energy correction, with the random phase approximation (RPA). We refer to the resulting methodology as corrected HF RPA [C(HF)-RPA]. We evaluate the proposed methodology across various RPA methods: direct RPA (dRPA), RPA with an approximate exchange kernel, and RPA with second-order screened exchange. C(HF)-dRPA demonstrates very promising performance; for RPA with exchange methods, on the other hand, we often find over-corrections.

Toward Pair Atomic Density Fitting for Correlation Energies with Benchmark Accuracy

Pair atomic density fitting (PADF) has been identified as a promising strategy to reduce the scaling with system size of quantum chemical methods for the calculation of the correlation energy like the direct random-phase approximation (RPA) or second-order Møller-Plesset perturbation theory (MP2). PADF can however introduce large errors in correlation energies as the two-electron interaction energy is not guaranteed to be bounded from below. This issue can be partially alleviated by using very large fit sets, but this comes at the price of reduced efficiency and having to deal with near-linear dependencies in the fit set. One posibility is to use global density fitting (DF), but in this work, we introduce an alternative methodology to overcome this problem that preserves the intrinsically favorable scaling of PADF. We first regularize the Fock matrix by projecting out parts of the basis set which gives rise to orbital products that are hard to describe by PADF. After having thus obtained a reliable self-consistent field solution, we then also apply this projector to the orbital coefficient matrix to improve the precision of PADF-MP2 and PADF-RPA. We systematically assess the accuracy of this new approach in a numerical atomic orbital framework using Slater type orbitals (STO) and correlation consistent Gaussian type basis sets up to quintuple-ζ quality for systems with more than 200 atoms. For the small and medium systems in the S66 database we show the maximum deviation of PADF-MP2 and PADF-RPA relative correlation energies to DF-MP2 and DF-RPA reference results to be 0.07 and 0.14 kcal/mol, respectively. When the new projector method is used, the errors only slightly increase for large molecules and also when moderately sized fit sets are used the resulting errors are well under control. Finally, we demonstrate the computational efficiency of our algorithm by calculating the interaction energies of large, non-covalently bound complexes with more than 1000 atoms and 20000 atomic orbitals at the RPA@PBE/CC-pVTZ level of theory.

Efficient Method for the Computation of Frozen-Core Nuclear Gradients within the Random Phase Approximation

A method for the evaluation of analytical frozen-core gradients within the random phase approximation is presented. We outline an efficient way to evaluate the response of the density of active electrons arising only when introducing the frozen-core approximation and constituting the main difficulty, together with the response of the standard Kohn-Sham density. The general framework allows to extend the outlined procedure to related electron correlation methods in the atomic orbital basis that require the evaluation of density responses, such as second-order Møller-Plesset perturbation theory or coupled cluster variants. By using Cholesky decomposed densities─which reintroduce the occupied index in the time-determining steps─we are able to achieve speedups of 20-30% (depending on the size of the basis set) by using the frozen-core approximation, which is of similar magnitude as for molecular orbital formulations. We further show that the errors introduced by the frozen-core approximation are practically insignificant for molecular geometries.

Assessment of the Second-Order Statically Screened Exchange Correction to the Random Phase Approximation for Correlation Energies

With increasing interelectronic distance, the screening of the electron–electron interaction by the presence of other electrons becomes the dominant source of electron correlation. This effect is described by the random phase approximation (RPA) which is therefore a promising method for the calculation of weak interactions. The success of the RPA relies on the cancellation of errors, which can be traced back to the violation of the crossing symmetry of the 4-point vertex, leading to strongly overestimated total correlation energies. By the addition of second-order screened exchange (SOSEX) to the correlation energy, this issue is substantially reduced. In the adiabatic connection (AC) SOSEX formalism, one of the two electron–electron interaction lines in the second-order exchange term is dynamically screened (SOSEX(W, v_c)). A related SOSEX expression in which both electron–electron interaction lines are statically screened (SOSEX(W(0), W(0))) is obtained from the G3W2 contribution to the electronic self-energy. In contrast to SOSEX(W, v_c), the evaluation of this correlation energy expression does not require an expensive numerical frequency integration and is therefore advantageous from a computational perspective. We compare the accuracy of the statically screened variant to RPA and RPA+SOSEX(W, v_c) for a wide range of chemical reactions. While both methods fail for barrier heights, SOSEX(W(0), W(0)) agrees very well with SOSEX(W, v_c) for charged excitations and noncovalent interactions where they lead to major improvements over RPA.

An effective sub-quadratic scaling atomic-orbital reformulation of the scaled opposite-spin RI-CC2 ground-state model using Cholesky-decomposed densities and an attenuated Coulomb metric

An atomic-orbital reformulation of the Laplace-transformed scaled opposite-spin (SOS) coupled cluster singles and doubles (CC2) model within the resolution of the identity (RI) approximation (SOS-RI-CC2) is presented that extends its applicability to molecules with several hundreds of atoms and triple-zeta basis sets. We exploit sparse linear algebra and an attenuated Coulomb metric to decrease the disk space demands and the computational efforts. In this way, an effective sub-quadratic computational scaling is achieved with our ω-SOS-CDD-RI-CC2 model. Moreover, Cholesky decomposition of the ground-state one-electron density matrix reduces the prefactor, allowing for an early crossover with the molecular orbital formulation. The accuracy and performance of the presented method are investigated for various molecular systems.

Benchmarking the Accuracy of the Direct Random Phase Approximation and σ-Functionals for NMR Shieldings

A method for computing NMR shieldings with the direct random phase approximation (RPA) and the closely related σ-functionals [Trushin, E.; Thierbach, A.; Görling, A. Toward chemical accuracy at low computational cost: density functional theory with σ-functionals for the correlation energy. J. Chem. Phys. 2021, 154, 014104] is presented, which is based on a finite-difference approach. The accuracy is evaluated in benchmark calculations using high-quality coupled cluster values as a reference. Our results show that the accuracy of the computed NMR shieldings using direct RPA is strongly dependent on the density functional theory reference orbitals and improves with increasing amounts of exact Hartree-Fock exchange in the functional. NMR shieldings computed with direct RPA using a Hartree-Fock reference are significantly more accurate than MP2 shieldings and comparable to CCSD shieldings. Also, the basis set convergence is analyzed and it is shown that at least triple-zeta basis sets are required for reliable results.

Chemical accuracy with σ-functionals for the Kohn-Sham correlation energy optimized for different input orbitals and eigenvalues

Recently, a new type of orbital-dependent functional for the Kohn-Sham (KS) correlation energy, σ-functionals, was introduced. Technically, σ-functionals are closely related to the well-known direct random phase approximation (dRPA). Within the dRPA, a function of the eigenvalues σ of the frequency-dependent KS response function is integrated over purely imaginary frequencies. In σ-functionals, this function is replaced by one that is optimized with respect to reference sets of atomization, reaction, transition state, and non-covalent interaction energies. The previously introduced σ-functional uses input orbitals and eigenvalues from KS calculations with the generalized gradient approximation (GGA) exchange-correlation functional of Perdew, Burke, and Ernzerhof (PBE). Here, σ-functionals using input orbitals and eigenvalues from the meta-GGA TPSS and the hybrid-functionals PBE0 and B3LYP are presented and tested. The number of reference sets taken into account in the optimization of the σ-functionals is larger than in the first PBE based σ-functional and includes sets with 3d-transition metal compounds. Therefore, also a reparameterized PBE based σ-functional is introduced. The σ-functionals based on PBE0 and B3LYP orbitals and eigenvalues reach chemical accuracy for main group chemistry. For the 10 966 reactions from the highly accurate W4-11RE reference set, the B3LYP based σ-functional exhibits a mean average deviation of 1.03 kcal/mol compared to 1.08 kcal/mol for the coupled cluster singles doubles perturbative triples method if the same valence quadruple zeta basis set is used. For 3d-transition metal chemistry, accuracies of about 2 kcal/mol are reached. The computational effort for the post-self-consistent evaluation of the σ-functional is lower than that of a preceding PBE0 or B3LYP calculation for typical systems.

Lagrangian-Based Minimal-Overhead Batching Scheme for the Efficient Integral-Direct Evaluation of the RPA Correlation Energy

A highly memory-efficient integral-direct random phase approximation (RPA) method based on our ω-CDGD-RI-RPA method [Graf, D. J. Chem. Theory Comput. 2018, 14, 2505] is presented that completely alleviates the memory bottleneck of storing the multidimensional three-center integral tensor, which severely limited the tractable system sizes. Based on a Lagrangian formulation, we introduce an optimized batching scheme over the auxiliary and basis-function indices, which allows to compute the optimal number of batches for a given amount of system memory, while minimizing the batching overhead. Thus, our optimized batching constitutes the best tradeoff between program runtime and memory demand. Within this batching scheme, the half-transformed three-center integral tensor B_iμ^M is recomputed for each batch of auxiliary and basis functions. This allows the computation of systems that were out of reach before. The largest system within this work consists of a DNA fragment comprising 1052 atoms and 11 230 basis functions calculated on a single node, which emphasizes the new possibilities of our integral-direct RPA method.

Energies, structures, and harmonic frequencies of small water clusters from the direct random phase approximation

The binding energies, structures, and vibrational frequencies of water clusters up to 20 molecules are computed at the direct random phase approximation (RPA) level of theory and compared to theoretical benchmarks. Binding energies of the WATER27 set, which includes neutral and positively and negatively charged clusters, are predicted to be too low in the complete basis set limit by an average of 7 kcal/mol (9%) and are worse than the results from the best density functional theory methods or from the Møller-Plesset theory. The RPA shows significant basis set size dependence for binding energies. The order of the relative energies of the water hexamer and dodecamer isomers is predicted correctly by the RPA. The mean absolute deviation for angles and distances for neutral clusters up to the water hexamer are 0.2° and 0.6 pm, respectively, using quintuple-ζ basis sets. The relative energetic order of the hexamer isomers is preserved upon optimization. Vibrational frequencies for these systems are underestimated by several tens of wavenumbers for large basis sets, and deviations increase with the basis set size. Overall, the direct RPA method yields accurate structural parameters but systematically underestimates binding energies and shows strong basis set size dependence.

Toward chemical accuracy at low computational cost: Density-functional theory with σ-functionals for the correlation energy

We introduce new functionals for the Kohn-Sham correlation energy that are based on the adiabatic-connection fluctuation-dissipation (ACFD) theorem and are named σ-functionals. Like in the well-established direct random phase approximation (dRPA), σ-functionals require as input exclusively eigenvalues σ of the frequency-dependent KS response function. In the new functionals, functions of σ replace the σ-dependent dRPA expression in the coupling-constant and frequency integrations contained in the ACFD theorem. We optimize σ-functionals with the help of reference sets for atomization, reaction, transition state, and non-covalent interaction energies. The optimized functionals are to be used in a post-self-consistent way using orbitals and eigenvalues from conventional Kohn-Sham calculations employing the exchange-correlation functional of Perdew, Burke, and Ernzerhof. The accuracy of the presented approach is much higher than that of dRPA methods and is comparable to that of high-level wave function methods. Reaction and transition state energies from σ-functionals exhibit accuracies close to 1 kcal/mol and thus approach chemical accuracy. For the 10 966 reactions of the W4-11RE reference set, the mean absolute deviation is 1.25 kcal/mol compared to 3.21 kcal/mol in the dRPA case. Non-covalent binding energies are accurate to a few tenths of a kcal/mol. The presented approach is highly efficient, and the post-self-consistent calculation of the total energy requires less computational time than a density-functional calculation with a hybrid functional and thus can be easily carried out routinely. σ-Functionals can be implemented in any existing dRPA code with negligible programming effort.

A range-separated generalized Kohn-Sham method including a long-range nonlocal random phase approximation correlation potential

Based on our recently published range-separated random phase approximation (RPA) functional [Kreppel et al., "Range-separated density-functional theory in combination with the random phase approximation: An accuracy benchmark," J. Chem. Theory Comput. 16, 2985-2994 (2020)], we introduce self-consistent minimization with respect to the one-particle density matrix. In contrast to the range-separated RPA methods presented so far, the new method includes a long-range nonlocal RPA correlation potential in the orbital optimization process, making it a full-featured variational generalized Kohn-Sham (GKS) method. The new method not only improves upon all other tested RPA schemes including the standard post-GKS range-separated RPA for the investigated test cases covering general main group thermochemistry, kinetics, and noncovalent interactions but also significantly outperforms the popular G₀W₀ method in estimating the ionization potentials and fundamental gaps considered in this work using the eigenvalue spectra obtained from the GKS Hamiltonian.

Lieb-Oxford bound and pair correlation functions for density-functional methods based on the adiabatic-connection fluctuation-dissipation theorem

Compliance with the Lieb-Oxford bound for the indirect Coulomb energy and for the exchange-correlation energy is investigated for a number of density-functional methods based on the adiabatic-connection fluctuation-dissipation (ACFD) theorem to treat correlation. Furthermore, the correlation contribution to the pair density resulting from these methods is compared with highly accurate reference values for the helium atom and for the hydrogen molecule at several bond distances. For molecules, the Lieb-Oxford bound is obeyed by all considered methods. For the homogeneous electron gas, it is violated by all methods for low electron densities. The simplest considered ACFD method, the direct random phase approximation (dRPA), violates the Lieb-Oxford bound much earlier than more advanced ACFD methods that, in addition to the simple Hartree kernel, take into account the exchange kernel and an approximate correlation kernel in the calculation of the correlation energy. While the dRPA yields quite poor correlation contributions to the pair density, those from more advanced ACFD methods are physically reasonable but still leave room for improvements, particularly in the case of the stretched hydrogen molecule.

Efficient Reduced-Scaling Second-Order Møller-Plesset Perturbation Theory with Cholesky-Decomposed Densities and an Attenuated Coulomb Metric

We present a novel, highly efficient method for the computation of second-order Møller-Plesset perturbation theory (MP2) correlation energies, which uses the resolution of the identity (RI) approximation and local molecular orbitals obtained from a Cholesky decomposition of pseudodensity matrices (CDD), as in the RI-CDD-MP2 method developed previously in our group [Maurer, S. A.; Clin, L.; Ochsenfeld, C. J. Chem. Phys. 2014, 140, 224112]. In addition, we introduce an attenuated Coulomb metric and subsequently redesign the RI-CDD-MP2 method in order to exploit the resulting sparsity in the three-center integrals. Coulomb and exchange energy contributions are computed separately using specialized algorithms. A simple, yet effective integral screening protocol based on Schwarz estimates is used for the MP2 exchange energy. The Coulomb energy computation and the preceding transformations of the three-center integrals are accelerated using a modified version of the natural blocking approach [Jung, Y.; Head-Gordon, M. Phys. Chem. Chem. Phys. 2006, 8, 2831-2840]. Effective subquadratic scaling for a wide range of molecule sizes is demonstrated in test calculations in conjunction with a low prefactor. The method is shown to enable cost-efficient MP2 calculations on large molecular systems with several thousand basis functions.

Range-Separated Density-Functional Theory in Combination with the Random Phase Approximation: An Accuracy Benchmark

A formulation of range-separated random phase approximation (RPA) based on our efficient ω-CDGD-RI-RPA [J. Chem. Theory Comput. 2018, 14, 2505] method and a large scale benchmark study are presented. By application to the GMTKN55 data set, we obtain a comprehensive picture of the performance of range-separated RPA in general main group thermochemistry, kinetics, and noncovalent interactions. The results show that range-separated RPA performs stably over the broad range of molecular chemistry included in the GMTKN55 set. It improves significantly over semilocal DFT but it is still less accurate than modern dispersion corrected double-hybrid functionals. Furthermore, range-separated RPA shows a faster basis set convergence compared to standard full-range RPA making it a promising applicable approach with only one empirical parameter.

Performance and Scope of Perturbative Corrections to Random-Phase Approximation Energies

It has been suspected since the early days of the random-phase approximation (RPA) that corrections to RPA correlation energies result mostly from short-range correlation effects and are thus amenable to perturbation theory. Here we test this hypothesis by analyzing formal and numerical results for the most common beyond-RPA perturbative corrections, including the bare second-order exchange (SOX), second-order screened exchange (SOSEX), and approximate exchange kernel (AXK) methods. Our analysis is facilitated by efficient and robust algorithms based on the resolution-of-the-identity (RI) approximation and numerical frequency integration, which enable benchmark beyond-RPA calculations on medium- and large-size molecules with size-independent accuracy. The AXK method systematically improves upon RPA, SOX, and SOSEX for reaction barrier heights, reaction energies, and noncovalent interaction energies of main-group compounds. The improved accuracy of AXK compared with SOX and SOSEX is attributed to stronger screening of bare SOX in AXK. For reactions involving transition-metal compounds, particularly 3d transition-metal dimers, the AXK correction is too small and can even have the wrong sign. These observations are rationalized by a measure α̅ of the effective coupling strength for beyond-RPA correlation. When the effective coupling strength increases beyond a critical α̅ value of approximately 0.5, the RPA errors increase rapidly and perturbative corrections become unreliable. Thus, perturbation theory can systematically correct RPA but only for systems and properties qualitatively well captured by RPA, as indicated by small α̅ values.