A weight-dependent local correlation density-functional approximation for ensembles

Extended N-centered ensemble density functional theory of double electronic excitations

A recent work (arXiv:2401.04685) has merged N-centered ensembles of neutral and charged electronic ground states with ensembles of neutral ground and excited states, thus providing a general and in-principle exact (so-called extended N-centered) ensemble density functional theory of neutral and charged electronic excitations. This formalism made it possible to revisit the concept of density-functional derivative discontinuity, in the particular case of single excitations from the highest occupied Kohn-Sham (KS) molecular orbital, without invoking the usual "asymptotic behavior of the density" argument. In this work, we address a broader class of excitations, with a particular focus on double excitations. An exact implementation of the theory is presented for the two-electron Hubbard dimer model. A thorough comparison of the true physical ground- and excited-state electronic structures with that of the fictitious ensemble density-functional KS system is also presented. Depending on the choice of the density-functional ensemble as well as the asymmetry of the dimer and the correlation strength, an inversion of states can be observed. In some other cases, the strong mixture of KS states within the true physical system makes the assignment "single excitation" or "double excitation" irrelevant.

Electronic Vector Potential from the Exact Factorization of a Complex Wavefunction

We generalize the definitions of local scalar potentials namedυ kin ${\upsilon _{{\rm{kin}}} }$ andυ N - 1 ${\upsilon _{N - 1} }$ , which are relevant to properly describe phenomena such as molecular dissociation with density-functional theory, to the case in which the electronic wavefunction corresponds to a complex current-carrying state. In such a case, an extra term in the form of a vector potential appears which cannot be gauged away. Both scalar and vector potentials are introduced via the exact factorization formalism which allows us to express the given Schrödinger equation as two coupled equations, one for the marginal and one for the conditional amplitude. The electronic vector potential is directly related to the paramagnetic current density carried by the total wavefunction and to the diamagnetic current density in the equation for the marginal amplitude. An explicit example of this vector potential in a triplet state of two non-interacting electrons is showcased together with its associated circulation, giving rise to a non-vanishing geometric phase. Some connections with the exact factorization for the full molecular wavefunction beyond the Born-Oppenheimer approximation are also discussed.

Exact Excited-State Functionals of the Asymmetric Hubbard Dimer

The exact functionals associated with the (singlet) ground state and the two singlet excited states of the asymmetric Hubbard dimer at half-filling are calculated using both Levy's constrained search and Lieb's convex formulation. While the ground-state functional is, as is commonly known, a convex function with respect to the density, the functional associated with the doubly excited state is found to be concave. Also, because the density-potential mapping associated with the first excited state is noninvertible, its "functional" is a partial, multivalued function composed of one concave and one convex branch that correspond to two separate domains of the external potential. Remarkably, it is found that, although the one-to-one mapping between density and external potential may not apply (as in the case of the first excited state), each state-specific energy and corresponding universal functional are "functions" whose derivatives are each other's inverse, just as in the ground state formalism.

State-Specific Configuration Interaction for Excited States

We introduce and benchmark a systematically improvable route for excited-state calculations, labeled state-specific configuration interaction (ΔCI), which is a particular realization of multiconfigurational self-consistent field and multireference configuration interaction. Starting with a reference built from optimized configuration state functions, separate CI calculations are performed for each targeted state (hence, state-specific orbitals and determinants). Accounting for single and double excitations produces the ΔCISD model, which can be improved with second-order Epstein-Nesbet perturbation theory (ΔCISD+EN2) or a posteriori Davidson corrections (ΔCISD+Q). These models were gauged against a vast and diverse set of 294 reference excitation energies. We have found that ΔCI is significantly more accurate than standard ground-state-based CI, whereas close performances were found between ΔCISD and EOM-CC2 and between ΔCISD+EN2 and EOM-CCSD. For larger systems, ΔCISD+Q delivers more accurate results than EOM-CC2 and EOM-CCSD. The ΔCI route can handle challenging multireference problems, singly and doubly excited states, from closed- and open-shell species, with overall comparable accuracy and thus represents a promising alternative to more established methodologies. In its current form, however, it is reliable only for relatively low-lying excited states.

Electronic Excited States in Extreme Limits via Ensemble Density Functionals

Density functional theory (DFT) has greatly expanded our ability to affordably compute and understand electronic ground states, by replacing intractable ab initio calculations by models based on paradigmatic physics from high- and low-density limits. But, a comparable treatment of excited states lags behind. Here, we solve this outstanding problem by employing a generalization of density functional theory to ensemble states (EDFT). We thus address important paradigmatic cases of all electronic systems in strongly (low-density) and weakly (high-density) correlated regimes. We show that the high-density limit connects to recent, exactly solvable EDFT results. The low-density limit reveals an unnoticed and most unexpected result-density functionals for strictly correlated ground states can be reused directly for excited states. Nontrivial dependence on excitation structure only shows up at third leading order. Overall, our results provide foundations for effective models of excited states that interpolate between exact low- and high-density limits, which we illustrate on the cases of singlet-singlet excitations in H_{2} and a ring of quantum wells.

DFT exchange: sharing perspectives on the workhorse of quantum chemistry and materials science

In this paper, the history, present status, and future of density-functional theory (DFT) is informally reviewed and discussed by 70 workers in the field, including molecular scientists, materials scientists, method developers and practitioners. The format of the paper is that of a roundtable discussion, in which the participants express and exchange views on DFT in the form of 302 individual contributions, formulated as responses to a preset list of 26 questions. Supported by a bibliography of 777 entries, the paper represents a broad snapshot of DFT, anno 2022.

Single Excitation Energies Obtained from the Ensemble "HOMO-LUMO Gap": Exact Results and Approximations

In calculations based on density functional theory, the "HOMO-LUMO gap" (difference between the highest occupied and lowest unoccupied molecular orbital energies) is often used as a low-cost, ad hoc approximation for the lowest excitation energy. Here we show that a simple correction based on rigorous ensemble density functional theory makes the HOMO-LUMO gap exact in principle and significantly more accurate in practice. The introduced perturbative ensemble density functional theory approach predicts different and useful values for singlet-singlet and singlet-triplet excitations, using semilocal and hybrid approximations. Excitation energies are similar in quality to time-dependent density functional theory, especially at high fractions of exact exchange. The approach therefore offers an easy-to-implement and low-cost route to robust prediction of molecular excitation energies.

Machine learning the derivative discontinuity of density-functional theory

Machine learning is a powerful tool to design accurate, highly non-local, exchange-correlation functionals for density functional theory. So far, most of those machine learned functionals are trained for systems with an integer number of particles. As such, they are unable to reproduce some crucial and fundamental aspects, such as the explicit dependency of the functionals on the particle number or the infamous derivative discontinuity at integer particle numbers. Here we propose a solution to these problems by training a neural network as the universal functional of density-functional theory that (a) depends explicitly on the number of particles with a piece-wise linearity between the integer numbers and (b) reproduces the derivative discontinuity of the exchange-correlation energy. This is achieved by using an ensemble formalism, a training set containing fractional densities, and an explicitly discontinuous formulation.

Foundation of One-Particle Reduced Density Matrix Functional Theory for Excited States

In Phys. Rev. Lett. 2021, 127, 023001 a reduced density matrix functional theory (RDMFT) was proposed for calculating energies of selected eigenstates of interacting many-Fermion systems. Here, we develop a solid foundation for this so-called w-RDMFT and present the details of various derivations. First, we explain how a generalization of the Ritz variational principle to ensemble states with fixed weights w in combination with the constrained search would lead to a universal functional of the one-particle reduced density matrix. To turn this into a viable functional theory, however, we also need to implement an exact convex relaxation. This general procedure includes Valone's pioneering work on ground state RDMFT as the special case w = (1,0, ···). Then, we work out in a comprehensive manner a methodology for deriving a compact description of the functional's domain. This leads to a hierarchy of generalized exclusion principle constraints which we illustrate in great detail. By anticipating their future pivotal role in functional theories and to keep our work self-contained, several required concepts from convex analysis are introduced and discussed.

Double and Charge-Transfer Excitations in Time-Dependent Density Functional Theory

Time-dependent density functional theory has emerged as a method of choice for calculations of spectra and response properties in physics, chemistry, and biology, with its system-size scaling enabling computations on systems much larger than otherwise possible. While increasingly complex and interesting systems have been successfully tackled with relatively simple functional approximations, there has also been increasing awareness that these functionals tend to fail for certain classes of approximations. Here I review the fundamental challenges the approximate functionals have in describing double excitations and charge-transfer excitations, which are two of the most common impediments for the theory to be applied in a black-box way. At the same time, I describe the progress made in recent decades in developing functional approximations that give useful predictions for these excitations. Expected final online publication date for the Annual Review of Physical Chemistry, Volume 73 is April 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Ensemble Density Functional Theory of Neutral and Charged Excitations : Exact Formulations, Standard Approximations, and Open Questions

Recent progress in the field of (time-independent) ensemble density-functional theory (DFT) for excited states are reviewed. Both Gross-Oliveira-Kohn (GOK) and N-centered ensemble formalisms, which are mathematically very similar and allow for an in-principle-exact description of neutral and charged electronic excitations, respectively, are discussed. Key exact results, for example, the equivalence between the infamous derivative discontinuity problem and the description of weight dependencies in the ensemble exchange-correlation density functional, are highlighted. The variational evaluation of orbital-dependent ensemble Hartree-exchange (Hx) energies is discussed in detail. We show in passing that state-averaging individual exact Hx energies can lead to severe (although solvable) v-representability issues. Finally, we explore the possibility of using the concept of density-driven correlation, which has been introduced recently and does not exist in regular ground-state DFT, for improving state-of-the-art correlation density-functional approximations for ensembles. The present review reflects the efforts of a growing community to turn ensemble DFT into a rigorous and reliable low-cost computational method for excited states. We hope that, in the near future, this contribution will stimulate new formal and practical developments in the field.

Variations of the Hartree-Fock fractional-spin error for one electron

Fractional-spin errors are inherent in all current approximate density functionals, including Hartree-Fock theory, and their origin has been related to strong static correlation effects. The conventional way to encode fractional-spin calculations is to construct an ensemble density that scales between the high-spin and low-spin densities. In this article, we explore the variation of the Hartree-Fock fractional-spin (or ghost-interaction) error in one-electron systems using restricted and unrestricted ensemble densities and the exact generalized Hartree-Fock representation. By considering the hydrogen atom and H⁺ ₂ cation, we analyze how the unrestricted and generalized Hartree-Fock schemes minimize this error by localizing the electrons or rotating the spin coordinates. We also reveal a clear similarity between the Coulomb hole of He-like ions and the density depletion near the nucleus induced by the fractional-spin error in the unpolarized hydrogen atom. Finally, we analyze the effect of the fractional-spin error on the Møller-Plesset adiabatic connection, excited states, and functional- and density-driven errors.

Ensemble Reduced Density Matrix Functional Theory for Excited States and Hierarchical Generalization of Pauli's Exclusion Principle

We propose and work out a reduced density matrix functional theory (RDMFT) for calculating energies of eigenstates of interacting many-electron systems beyond the ground state. Various obstacles which historically have doomed such an approach to be unfeasible are overcome. First, we resort to a generalization of the Ritz variational principle to ensemble states with fixed weights. This in combination with the constrained search formalism allows us to establish a universal functional of the one-particle reduced density matrix. Second, we employ tools from convex analysis to circumvent the too involved N-representability constraints. Remarkably, this identifies Valone's pioneering work on RDMFT as a special case of convex relaxation and reveals that crucial information about the excitation structure is contained in the functional's domain. Third, to determine the crucial latter object, a methodology is developed which eventually leads to a generalized exclusion principle. The corresponding linear constraints are calculated for systems of arbitrary size.

Ensemble generalized Kohn-Sham theory: The good, the bad, and the ugly

Two important extensions of Kohn-Sham (KS) theory are generalized: KS theory and ensemble KS theory. The former allows for non-multiplicative potential operators and greatly facilitates practical calculations with advanced, orbital-dependent functionals. The latter allows for quantum ensembles and enables the treatment of open systems and excited states. Here, we combine the two extensions, both formally and practically, first via an exact yet complicated formalism and then via a computationally tractable variant that involves a controlled approximation of ensemble "ghost interactions" by means of an iterative algorithm. The resulting formalism is illustrated using selected examples. This opens the door to the application of generalized KS theory in more challenging quantum scenarios and to the improvement of ensemble theories for the purpose of practical and accurate calculations.

From Kohn-Sham to Many-Electron Energies via Step Structures in the Exchange-Correlation Potential

Accurately describing excited states within Kohn–Sham (KS) density functional theory (DFT), particularly those which induce ionization and charge transfer, remains a great challenge. Common exchange-correlation (xc) approximations are unreliable for excited states owing, in part, to the absence of a derivative discontinuity in the xc energy (Δ), which relates a many-electron energy difference to the corresponding KS energy difference. We demonstrate, analytically and numerically, how the relationship between KS and many-electron energies leads to the step structures observed in the exact xc potential in four scenarios: electron addition, molecular dissociation, excitation of a finite system, and charge transfer. We further show that steps in the potential can be obtained also with common xc approximations, as simple as the LDA, when addressed from the ensemble perspective. The article therefore highlights how capturing the relationship between KS and many-electron energies with advanced xc approximations is crucial for accurately calculating excitations, as well as the ground-state density and energy of systems which consist of distinct subsystems.

Ensemble Density Functional Theory: Insight from the Fluctuation-Dissipation Theorem

Density functional theory can be generalized to mixtures of ground and excited states, for the purpose of determining energies of excitations using low-cost density functional approximations. Adapting approximations originally developed for ground states to work in the new setting would fast-forward progress enormously. But, previous attempts have stumbled on daunting fundamental issues. Here we show that these issues can be prevented from the outset, by using a fluctuation dissipation theorem (FDT) to dictate key functionals. We thereby show that existing exchange energy approximations are readily adapted to excited states, when combined with a rigorous exact Hartree term that is different in form from its ground state counterpart, and counterparts based on ensemble Ansatzë. Applying the FDT to correlation energies also provides insights into ground statelike and ensemble-only correlations. We thus provide a comprehensive and versatile framework for ensemble density functional approximations.

Approximately Self-Consistent Ensemble Density Functional Theory: Toward Inclusion of All Correlations

Recent theory developments in ensemble density functional theory (EDFT) promise to bring decades of work for ground states to the practical resolution of excited states, provided newly discovered "density-driven correlations" can be dealt with and adequate effective potentials can be found. This Letter introduces simple theories for both and shows that EDFT using these theories outperforms ΔSCF DFT and time-dependent DFT for low-lying gaps in most of the small atoms and molecules tested, even when all use the same density functional approximations. It thus establishes EDFT as a promising tool for low-cost studies of low-lying excited states and provides a clear route to practical EDFT implementation of arbitrary functional approximations.

Dynamical kernels for optical excitations

We discuss the physical properties and accuracy of three distinct dynamical (i.e., frequency-dependent) kernels for the computation of optical excitations within linear response theory: (i) an a priori built kernel inspired by the dressed time-dependent density-functional theory kernel proposed by Maitra et al. [J. Chem. Phys. 120, 5932 (2004)], (ii) the dynamical kernel stemming from the Bethe-Salpeter equation (BSE) formalism derived originally by Strinati [Riv. Nuovo Cimento 11, 1-86 (1988)], and (iii) the second-order BSE kernel derived by Zhang et al. [J. Chem. Phys. 139, 154109 (2013)]. The principal take-home message of the present paper is that dynamical kernels can provide, thanks to their frequency-dependent nature, additional excitations that can be associated with higher-order excitations (such as the infamous double excitations), an unappreciated feature of dynamical quantities. We also analyze, for each kernel, the appearance of spurious excitations originating from the approximate nature of the kernels, as first evidenced by Romaniello et al. [J. Chem. Phys. 130, 044108 (2009)]. Using a simple two-level model, prototypical examples of valence, charge-transfer, and Rydberg excited states are considered.

Individual Correlations in Ensemble Density Functional Theory: State- and Density-Driven Decompositions without Additional Kohn-Sham Systems

Gould and Pittalis [Phys. Rev. Lett. 123, 016401 (2019)PRLTAO0031-900710.1103/PhysRevLett.123.016401 recently revealed a density-driven (DD) correlation energy that is specific to many-electron ensembles and must be accounted for by approximations. We derive in this Letter a general and simpler expression in terms of the ensemble weights, the ensemble Kohn-Sham (KS) orbitals, and their linear response to variations in the ensemble weights. As no additional state-driven KS systems are needed, its evaluation is greatly simplified. We confirm the importance of DD effects and introduce a direct and promising route to approximations.

Weight dependence of local exchange–correlation functionals in ensemble density-functional theory: double excitations in two-electron systems

We discuss the construction of first-rung weight-dependent exchange–correlation density-functional approximations for He and H₂ specifically designed for the computation of double excitations within Gross–Oliveira–Kohn-DFT.