Ensemble generalized Kohn-Sham theory: The good, the bad, and the ugly

Extended N-centered ensemble density functional theory of double electronic excitations

A recent work (arXiv:2401.04685) has merged N-centered ensembles of neutral and charged electronic ground states with ensembles of neutral ground and excited states, thus providing a general and in-principle exact (so-called extended N-centered) ensemble density functional theory of neutral and charged electronic excitations. This formalism made it possible to revisit the concept of density-functional derivative discontinuity, in the particular case of single excitations from the highest occupied Kohn-Sham (KS) molecular orbital, without invoking the usual "asymptotic behavior of the density" argument. In this work, we address a broader class of excitations, with a particular focus on double excitations. An exact implementation of the theory is presented for the two-electron Hubbard dimer model. A thorough comparison of the true physical ground- and excited-state electronic structures with that of the fictitious ensemble density-functional KS system is also presented. Depending on the choice of the density-functional ensemble as well as the asymmetry of the dimer and the correlation strength, an inversion of states can be observed. In some other cases, the strong mixture of KS states within the true physical system makes the assignment "single excitation" or "double excitation" irrelevant.

The Potential of Neural Network Potentials

In the next half-century, physical chemistry will likely undergo a profound transformation, driven predominantly by the combination of recent advances in quantum chemistry and machine learning (ML). Specifically, equivariant neural network potentials (NNPs) are a breakthrough new tool that are already enabling us to simulate systems at the molecular scale with unprecedented accuracy and speed, relying on nothing but fundamental physical laws. The continued development of this approach will realize Paul Dirac's 80-year-old vision of using quantum mechanics to unify physics with chemistry and providing invaluable tools for understanding materials science, biology, earth sciences, and beyond. The era of highly accurate and efficient first-principles molecular simulations will provide a wealth of training data that can be used to build automated computational methodologies, using tools such as diffusion models, for the design and optimization of systems at the molecular scale. Large language models (LLMs) will also evolve into increasingly indispensable tools for literature review, coding, idea generation, and scientific writing.

Electronic Excited States in Extreme Limits via Ensemble Density Functionals

Density functional theory (DFT) has greatly expanded our ability to affordably compute and understand electronic ground states, by replacing intractable ab initio calculations by models based on paradigmatic physics from high- and low-density limits. But, a comparable treatment of excited states lags behind. Here, we solve this outstanding problem by employing a generalization of density functional theory to ensemble states (EDFT). We thus address important paradigmatic cases of all electronic systems in strongly (low-density) and weakly (high-density) correlated regimes. We show that the high-density limit connects to recent, exactly solvable EDFT results. The low-density limit reveals an unnoticed and most unexpected result-density functionals for strictly correlated ground states can be reused directly for excited states. Nontrivial dependence on excitation structure only shows up at third leading order. Overall, our results provide foundations for effective models of excited states that interpolate between exact low- and high-density limits, which we illustrate on the cases of singlet-singlet excitations in H_{2} and a ring of quantum wells.

Toward routine Kohn-Sham inversion using the "Lieb-response" approach

Kohn-Sham (KS) inversion, in which the effective KS mean-field potential is found for a given density, provides insights into the nature of exact density functional theory (DFT) that can be exploited for the development of density functional approximations. Unfortunately, despite significant and sustained progress in both theory and software libraries, KS inversion remains rather difficult in practice, especially in finite basis sets. The present work presents a KS inversion method, dubbed the "Lieb-response" approach, that naturally works with existing Fock-matrix DFT infrastructure in finite basis sets, is numerically efficient, and directly provides meaningful matrix and energy quantities for pure-state and ensemble systems. Some additional work yields potential. It thus enables the routine inversion of even difficult KS systems, as illustrated in a variety of problems within this work, and provides outputs that can be used for embedding schemes or machine learning of density functional approximations. The effect of finite basis sets on KS inversion is also analyzed and investigated.

Fundamental Variable and Density Representation in Multistate DFT for Excited States

Complementary to the theorems of Hohenberg and Kohn for the ground state, Theophilou's subspace theory establishes a one-to-one relationship between the total eigenstate energy and density ρ_V(r) of the subspace spanned by the lowest N eigenstates. However, the individual eigenstate energies are not directly available from such a subspace density functional theory. Lu and Gao (J. Phys. Chem. Lett. 2022, 13, 7762) recently proved that the Hamiltonian projected on to this subspace is a matrix functional H[D] of the multistate matrix density D(r) and that variational optimization of the trace of the Hamiltonian matrix functional yields exactly the individual eigenstates and densities. This study shows that the matrix density D(r) is the necessary fundamental variable in order to determine the exact energies and densities of the individual eigenstates. Furthermore, two ways of representing the matrix density are introduced, making use of nonorthogonal and orthogonal orbitals. In both representations, a multistate active space of auxiliary states can be constructed to exactly represent D(r) with which an explicit formulation of the Hamiltonian matrix functional H[D] is presented. Importantly, the use of a common set of orthonormal orbitals makes it possible to carry out multistate self-consistent-field optimization of the auxiliary states with singly and doubly excited configurations (MS-SDSCF).

DFT exchange: sharing perspectives on the workhorse of quantum chemistry and materials science

In this paper, the history, present status, and future of density-functional theory (DFT) is informally reviewed and discussed by 70 workers in the field, including molecular scientists, materials scientists, method developers and practitioners. The format of the paper is that of a roundtable discussion, in which the participants express and exchange views on DFT in the form of 302 individual contributions, formulated as responses to a preset list of 26 questions. Supported by a bibliography of 777 entries, the paper represents a broad snapshot of DFT, anno 2022.

Single Excitation Energies Obtained from the Ensemble "HOMO-LUMO Gap": Exact Results and Approximations

In calculations based on density functional theory, the "HOMO-LUMO gap" (difference between the highest occupied and lowest unoccupied molecular orbital energies) is often used as a low-cost, ad hoc approximation for the lowest excitation energy. Here we show that a simple correction based on rigorous ensemble density functional theory makes the HOMO-LUMO gap exact in principle and significantly more accurate in practice. The introduced perturbative ensemble density functional theory approach predicts different and useful values for singlet-singlet and singlet-triplet excitations, using semilocal and hybrid approximations. Excitation energies are similar in quality to time-dependent density functional theory, especially at high fractions of exact exchange. The approach therefore offers an easy-to-implement and low-cost route to robust prediction of molecular excitation energies.

Density functionals with spin-density accuracy for open shells

Electrons in zero external magnetic field can be studied with density functional theory (DFT) or with spin-DFT (SDFT). The latter is normally used for open shell systems because its approximations appear to model better the exchange and correlation (xc) functional, but also because so far the application of DFT implied a closed-shell-like approximation. Correcting this error for open shells allows the approximate DFT xc functionals to become as accurate as those in SDFT. In the limit of zero magnetic field, the Kohn-Sham equations of SDFT emerge as the generalised KS equations of DFT.

Ensemble Density Functional Theory of Neutral and Charged Excitations : Exact Formulations, Standard Approximations, and Open Questions

Recent progress in the field of (time-independent) ensemble density-functional theory (DFT) for excited states are reviewed. Both Gross-Oliveira-Kohn (GOK) and N-centered ensemble formalisms, which are mathematically very similar and allow for an in-principle-exact description of neutral and charged electronic excitations, respectively, are discussed. Key exact results, for example, the equivalence between the infamous derivative discontinuity problem and the description of weight dependencies in the ensemble exchange-correlation density functional, are highlighted. The variational evaluation of orbital-dependent ensemble Hartree-exchange (Hx) energies is discussed in detail. We show in passing that state-averaging individual exact Hx energies can lead to severe (although solvable) v-representability issues. Finally, we explore the possibility of using the concept of density-driven correlation, which has been introduced recently and does not exist in regular ground-state DFT, for improving state-of-the-art correlation density-functional approximations for ensembles. The present review reflects the efforts of a growing community to turn ensemble DFT into a rigorous and reliable low-cost computational method for excited states. We hope that, in the near future, this contribution will stimulate new formal and practical developments in the field.

Description of Sudden Polarization in the Excited Electronic States with an Ensemble Density Functional Theory Method

Sudden polarization (SP) is one of the manifestations of electron transfer in the electronically excited states of molecules. Proposed initially to explain the unusual reactivity of photoexcited olefins, SP often occurs in the excited states of molecules possessing strongly correlated diradical ground state. Theoretical description of SP involves mixing between the singly excited and the doubly excited zwitterionic states, which makes it inaccessible with the use of the popular linear-response time-dependent density functional theory methods. In this work, an extended variant of the state-interaction state-averaged spin-restricted ensemble-referenced Kohn-Sham (SI-SA-REKS, or SSR) method is applied to study SP in a number of organic diradical systems. To this end, the analytical derivative formalism is derived and implemented for the SSR(3,2) method (see the main text for explanation of the acronym), which enables the automatic geometry optimization and obtains the relaxed density matrices as well as the electron binding energies and respective Dyson's orbitals. Application of the new method to SP in the lowest singlet excited state of ethylene agrees with the results obtained previously with the use of multireference methods of wavefunction theory. A number of interesting manifestations of SP are observed, such as the charge transfer in photoexcited tetramethyleneethene (TME) diradical mediated by the vibrational motion and conductivity switching in the excited state of a donor-acceptor dyad placed in an external electric field.