Extended N-centered ensemble density functional theory of double electronic excitations

A recent work (arXiv:2401.04685) has merged N-centered ensembles of neutral and charged electronic ground states with ensembles of neutral ground and excited states, thus providing a general and in-principle exact (so-called extended N-centered) ensemble density functional theory of neutral and charged electronic excitations. This formalism made it possible to revisit the concept of density-functional derivative discontinuity, in the particular case of single excitations from the highest occupied Kohn-Sham (KS) molecular orbital, without invoking the usual "asymptotic behavior of the density" argument. In this work, we address a broader class of excitations, with a particular focus on double excitations. An exact implementation of the theory is presented for the two-electron Hubbard dimer model. A thorough comparison of the true physical ground- and excited-state electronic structures with that of the fictitious ensemble density-functional KS system is also presented. Depending on the choice of the density-functional ensemble as well as the asymmetry of the dimer and the correlation strength, an inversion of states can be observed. In some other cases, the strong mixture of KS states within the true physical system makes the assignment "single excitation" or "double excitation" irrelevant.

Particle-Breaking Unrestricted Hartree-Fock Theory for Open Molecular Systems

We recently introduced the particle-breaking restricted Hartree-Fock (PBRHF) model, a mean-field approach to address the fractional charging of molecules when they interact with an electronic environment. In this paper, we present an extension of the model referred to as particle-breaking unrestricted Hartree-Fock (PBUHF). The unrestricted formulation contains odd-electron states necessary for a realistic description of fractional charging. Within the PBUHF parametrization, we use two-body operators as they yield convenient operator transformations. However, two-body operators can change only the particle number by two. Therefore, we include noninteracting zero-energy bath orbitals to generate a linear combination of even and odd electron states. Depending on whether the occupied or virtual orbitals of a molecule interact with the environment, the average number of electrons is either decreased or increased. Without interaction, PBUHF reduces to the unrestricted Hartree-Fock wave function.

Exact Excited-State Functionals of the Asymmetric Hubbard Dimer

The exact functionals associated with the (singlet) ground state and the two singlet excited states of the asymmetric Hubbard dimer at half-filling are calculated using both Levy's constrained search and Lieb's convex formulation. While the ground-state functional is, as is commonly known, a convex function with respect to the density, the functional associated with the doubly excited state is found to be concave. Also, because the density-potential mapping associated with the first excited state is noninvertible, its "functional" is a partial, multivalued function composed of one concave and one convex branch that correspond to two separate domains of the external potential. Remarkably, it is found that, although the one-to-one mapping between density and external potential may not apply (as in the case of the first excited state), each state-specific energy and corresponding universal functional are "functions" whose derivatives are each other's inverse, just as in the ground state formalism.

State-Specific Configuration Interaction for Excited States

We introduce and benchmark a systematically improvable route for excited-state calculations, labeled state-specific configuration interaction (ΔCI), which is a particular realization of multiconfigurational self-consistent field and multireference configuration interaction. Starting with a reference built from optimized configuration state functions, separate CI calculations are performed for each targeted state (hence, state-specific orbitals and determinants). Accounting for single and double excitations produces the ΔCISD model, which can be improved with second-order Epstein-Nesbet perturbation theory (ΔCISD+EN2) or a posteriori Davidson corrections (ΔCISD+Q). These models were gauged against a vast and diverse set of 294 reference excitation energies. We have found that ΔCI is significantly more accurate than standard ground-state-based CI, whereas close performances were found between ΔCISD and EOM-CC2 and between ΔCISD+EN2 and EOM-CCSD. For larger systems, ΔCISD+Q delivers more accurate results than EOM-CC2 and EOM-CCSD. The ΔCI route can handle challenging multireference problems, singly and doubly excited states, from closed- and open-shell species, with overall comparable accuracy and thus represents a promising alternative to more established methodologies. In its current form, however, it is reliable only for relatively low-lying excited states.

Electronic Excited States in Extreme Limits via Ensemble Density Functionals

Density functional theory (DFT) has greatly expanded our ability to affordably compute and understand electronic ground states, by replacing intractable ab initio calculations by models based on paradigmatic physics from high- and low-density limits. But, a comparable treatment of excited states lags behind. Here, we solve this outstanding problem by employing a generalization of density functional theory to ensemble states (EDFT). We thus address important paradigmatic cases of all electronic systems in strongly (low-density) and weakly (high-density) correlated regimes. We show that the high-density limit connects to recent, exactly solvable EDFT results. The low-density limit reveals an unnoticed and most unexpected result-density functionals for strictly correlated ground states can be reused directly for excited states. Nontrivial dependence on excitation structure only shows up at third leading order. Overall, our results provide foundations for effective models of excited states that interpolate between exact low- and high-density limits, which we illustrate on the cases of singlet-singlet excitations in H_{2} and a ring of quantum wells.

DFT exchange: sharing perspectives on the workhorse of quantum chemistry and materials science

In this paper, the history, present status, and future of density-functional theory (DFT) is informally reviewed and discussed by 70 workers in the field, including molecular scientists, materials scientists, method developers and practitioners. The format of the paper is that of a roundtable discussion, in which the participants express and exchange views on DFT in the form of 302 individual contributions, formulated as responses to a preset list of 26 questions. Supported by a bibliography of 777 entries, the paper represents a broad snapshot of DFT, anno 2022.

Single Excitation Energies Obtained from the Ensemble "HOMO-LUMO Gap": Exact Results and Approximations

In calculations based on density functional theory, the "HOMO-LUMO gap" (difference between the highest occupied and lowest unoccupied molecular orbital energies) is often used as a low-cost, ad hoc approximation for the lowest excitation energy. Here we show that a simple correction based on rigorous ensemble density functional theory makes the HOMO-LUMO gap exact in principle and significantly more accurate in practice. The introduced perturbative ensemble density functional theory approach predicts different and useful values for singlet-singlet and singlet-triplet excitations, using semilocal and hybrid approximations. Excitation energies are similar in quality to time-dependent density functional theory, especially at high fractions of exact exchange. The approach therefore offers an easy-to-implement and low-cost route to robust prediction of molecular excitation energies.

Double and Charge-Transfer Excitations in Time-Dependent Density Functional Theory

Time-dependent density functional theory has emerged as a method of choice for calculations of spectra and response properties in physics, chemistry, and biology, with its system-size scaling enabling computations on systems much larger than otherwise possible. While increasingly complex and interesting systems have been successfully tackled with relatively simple functional approximations, there has also been increasing awareness that these functionals tend to fail for certain classes of approximations. Here I review the fundamental challenges the approximate functionals have in describing double excitations and charge-transfer excitations, which are two of the most common impediments for the theory to be applied in a black-box way. At the same time, I describe the progress made in recent decades in developing functional approximations that give useful predictions for these excitations. Expected final online publication date for the Annual Review of Physical Chemistry, Volume 73 is April 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Ensemble Density Functional Theory of Neutral and Charged Excitations : Exact Formulations, Standard Approximations, and Open Questions

Recent progress in the field of (time-independent) ensemble density-functional theory (DFT) for excited states are reviewed. Both Gross-Oliveira-Kohn (GOK) and N-centered ensemble formalisms, which are mathematically very similar and allow for an in-principle-exact description of neutral and charged electronic excitations, respectively, are discussed. Key exact results, for example, the equivalence between the infamous derivative discontinuity problem and the description of weight dependencies in the ensemble exchange-correlation density functional, are highlighted. The variational evaluation of orbital-dependent ensemble Hartree-exchange (Hx) energies is discussed in detail. We show in passing that state-averaging individual exact Hx energies can lead to severe (although solvable) v-representability issues. Finally, we explore the possibility of using the concept of density-driven correlation, which has been introduced recently and does not exist in regular ground-state DFT, for improving state-of-the-art correlation density-functional approximations for ensembles. The present review reflects the efforts of a growing community to turn ensemble DFT into a rigorous and reliable low-cost computational method for excited states. We hope that, in the near future, this contribution will stimulate new formal and practical developments in the field.

Variations of the Hartree-Fock fractional-spin error for one electron

Fractional-spin errors are inherent in all current approximate density functionals, including Hartree-Fock theory, and their origin has been related to strong static correlation effects. The conventional way to encode fractional-spin calculations is to construct an ensemble density that scales between the high-spin and low-spin densities. In this article, we explore the variation of the Hartree-Fock fractional-spin (or ghost-interaction) error in one-electron systems using restricted and unrestricted ensemble densities and the exact generalized Hartree-Fock representation. By considering the hydrogen atom and H⁺ ₂ cation, we analyze how the unrestricted and generalized Hartree-Fock schemes minimize this error by localizing the electrons or rotating the spin coordinates. We also reveal a clear similarity between the Coulomb hole of He-like ions and the density depletion near the nucleus induced by the fractional-spin error in the unpolarized hydrogen atom. Finally, we analyze the effect of the fractional-spin error on the Møller-Plesset adiabatic connection, excited states, and functional- and density-driven errors.

Ensemble Reduced Density Matrix Functional Theory for Excited States and Hierarchical Generalization of Pauli's Exclusion Principle

We propose and work out a reduced density matrix functional theory (RDMFT) for calculating energies of eigenstates of interacting many-electron systems beyond the ground state. Various obstacles which historically have doomed such an approach to be unfeasible are overcome. First, we resort to a generalization of the Ritz variational principle to ensemble states with fixed weights. This in combination with the constrained search formalism allows us to establish a universal functional of the one-particle reduced density matrix. Second, we employ tools from convex analysis to circumvent the too involved N-representability constraints. Remarkably, this identifies Valone's pioneering work on RDMFT as a special case of convex relaxation and reveals that crucial information about the excitation structure is contained in the functional's domain. Third, to determine the crucial latter object, a methodology is developed which eventually leads to a generalized exclusion principle. The corresponding linear constraints are calculated for systems of arbitrary size.

Ensemble generalized Kohn-Sham theory: The good, the bad, and the ugly

Two important extensions of Kohn-Sham (KS) theory are generalized: KS theory and ensemble KS theory. The former allows for non-multiplicative potential operators and greatly facilitates practical calculations with advanced, orbital-dependent functionals. The latter allows for quantum ensembles and enables the treatment of open systems and excited states. Here, we combine the two extensions, both formally and practically, first via an exact yet complicated formalism and then via a computationally tractable variant that involves a controlled approximation of ensemble "ghost interactions" by means of an iterative algorithm. The resulting formalism is illustrated using selected examples. This opens the door to the application of generalized KS theory in more challenging quantum scenarios and to the improvement of ensemble theories for the purpose of practical and accurate calculations.

Ensemble Density Functional Theory: Insight from the Fluctuation-Dissipation Theorem

Density functional theory can be generalized to mixtures of ground and excited states, for the purpose of determining energies of excitations using low-cost density functional approximations. Adapting approximations originally developed for ground states to work in the new setting would fast-forward progress enormously. But, previous attempts have stumbled on daunting fundamental issues. Here we show that these issues can be prevented from the outset, by using a fluctuation dissipation theorem (FDT) to dictate key functionals. We thereby show that existing exchange energy approximations are readily adapted to excited states, when combined with a rigorous exact Hartree term that is different in form from its ground state counterpart, and counterparts based on ensemble Ansatzë. Applying the FDT to correlation energies also provides insights into ground statelike and ensemble-only correlations. We thus provide a comprehensive and versatile framework for ensemble density functional approximations.

Approximately Self-Consistent Ensemble Density Functional Theory: Toward Inclusion of All Correlations

Recent theory developments in ensemble density functional theory (EDFT) promise to bring decades of work for ground states to the practical resolution of excited states, provided newly discovered "density-driven correlations" can be dealt with and adequate effective potentials can be found. This Letter introduces simple theories for both and shows that EDFT using these theories outperforms ΔSCF DFT and time-dependent DFT for low-lying gaps in most of the small atoms and molecules tested, even when all use the same density functional approximations. It thus establishes EDFT as a promising tool for low-cost studies of low-lying excited states and provides a clear route to practical EDFT implementation of arbitrary functional approximations.

Dynamical kernels for optical excitations

We discuss the physical properties and accuracy of three distinct dynamical (i.e., frequency-dependent) kernels for the computation of optical excitations within linear response theory: (i) an a priori built kernel inspired by the dressed time-dependent density-functional theory kernel proposed by Maitra et al. [J. Chem. Phys. 120, 5932 (2004)], (ii) the dynamical kernel stemming from the Bethe-Salpeter equation (BSE) formalism derived originally by Strinati [Riv. Nuovo Cimento 11, 1-86 (1988)], and (iii) the second-order BSE kernel derived by Zhang et al. [J. Chem. Phys. 139, 154109 (2013)]. The principal take-home message of the present paper is that dynamical kernels can provide, thanks to their frequency-dependent nature, additional excitations that can be associated with higher-order excitations (such as the infamous double excitations), an unappreciated feature of dynamical quantities. We also analyze, for each kernel, the appearance of spurious excitations originating from the approximate nature of the kernels, as first evidenced by Romaniello et al. [J. Chem. Phys. 130, 044108 (2009)]. Using a simple two-level model, prototypical examples of valence, charge-transfer, and Rydberg excited states are considered.