Theory and practice of modeling van der Waals interactions in electronic-structure calculations

The accurate description of long-range electron correlation, most prominently including van der Waals (vdW) dispersion interactions, represents a particularly challenging task in the modeling of molecules and materials. vdW forces arise from the interaction of quantum-mechanical fluctuations in the electronic charge density. Within (semi-)local density functional approximations or Hartree-Fock theory such interactions are neglected altogether. Non-covalent vdW interactions, however, are ubiquitous in nature and play a key role for the understanding and accurate description of the stability, dynamics, structure, and response properties in a plethora of systems. During the last decade, many promising methods have been developed for modeling vdW interactions in electronic-structure calculations. These methods include vdW-inclusive Density Functional Theory and correlated post-Hartree-Fock approaches. Here, we focus on the methods within the framework of Density Functional Theory, including non-local van der Waals density functionals, interatomic dispersion models within many-body and pairwise formulation, and random phase approximation-based approaches. This review aims to guide the reader through the theoretical foundations of these methods in a tutorial-style manner and, in particular, highlight practical aspects such as the applicability and the advantages and shortcomings of current vdW-inclusive approaches. In addition, we give an overview of complementary experimental approaches, and discuss tools for the qualitative understanding of non-covalent interactions as well as energy decomposition techniques. Besides representing a reference for the current state-of-the-art, this work is thus also designed as a concise and detailed introduction to vdW-inclusive electronic structure calculations for a general and broad audience.

Structures of the neutral and positively charged forms of the 4,4',4″-tris(N,N-phenyl-3-methylphenylamino)triphenylamine (m-MTDATA) molecule and its dimer, and charge localization in the corresponding cationic species

The structures of the 4,4',4″-tris(N,N-phenyl-3-methylphenylamino)triphenylamine (m-MTDATA) molecule and its dimer in their neutral and positively charged forms were studied by performing quantum-chemical calculations at the Hartree-Fock (HF) and density functional theory (DFT) levels of theory using several exchange-correlation functionals (PBE, PBE0, BHANDHLYP, and M06-HF) with different percentages of HF exchange. It was found that there are at least four possible isomeric structures of m-MTDATA with different (planar or perpendicular) arrangements of the peripheral diphenylamino groups. The charge localization in the monomeric and dimeric cationic species was also determined. The results indicated that the charge on the dimeric cation is localized on the central region or on the side fragment of the cationic part of the dimer, depending on the dimer structure. DFT calculations showed a tendency to overestimate the charge delocalization over the molecule, irrespective of the percentage of HF exchange applied. Graphical abstract Structure of an m-MTDATA dimer cation.

On the geometric dependence of the molecular dipole polarizability in water: A benchmark study of higher-order electron correlation, basis set incompleteness error, core electron effects, and zero-point vibrational contributions

In this work, we investigate how geometric changes influence the static dipole polarizability (α) of a water molecule by explicitly computing the corresponding dipole polarizability surface (DPS) across 3125 total (1625 symmetry-unique) geometries using linear response coupled cluster theory including single, double, and triple excitations (LR-CCSDT) and the doubly augmented triple-ζ basis set (d-aug-cc-pVTZ). Analytical formulae based on power series expansions of this ab initio surface are generated using linear least-squares analysis and provide highly accurate estimates of this quantity as a function of molecular geometry (i.e., bond and angle variations) in a computationally tractable manner. An additional database, which consists of 25 representative molecular geometries and incorporates a more thorough treatment of both basis sets and core electron effects, is provided as a current benchmark for this quantity and the corresponding leading-order C ₆ dispersion coefficient. This database has been utilized to assess the importance of these effects as well as the relative accuracy that can be obtained using several quantum chemical methods and a library of density functional approximations. In addition to high-level electron correlation methods (like CCSD) and our analytical least-squares formulae, we find that the SCAN0, PBE0, MN15, and B97-2 hybrid functionals yield the most accurate descriptions of the molecular polarizability tensor in H₂O. Using first-order perturbation theory, we compute the zero-point vibrational correction to α at the CCSDT/d-aug-cc-pVTZ level and find that this correction contributes approximately 3% to the isotropic (α _iso) and nearly 50% to the anisotropic (α _aniso) polarizability values. In doing so, we find that α _iso = 9.8307 bohr³, which is in excellent agreement with the experimental value of 9.83 ± 0.02 bohr³ provided by Russell and Spackman. The DPS reported herein provides a benchmark-quality quantum mechanical estimate of this fundamental quantity of interest and should find extensive use in the development (and assessment) of next-generation force fields and machine-learning based approaches for modeling water in complex condensed-phase environments.

Delocalization Errors in Density Functional Theory Are Essentially Quadratic in Fractional Occupation Number

Approximate functionals used in practical density functional theory (DFT) deviate from the piecewise linear behavior of the exact functional for fractional charges. This deviation causes excess charge delocalization, which leads to incorrect densities, molecular properties, barrier heights, band gaps, and excitation energies. We present a simple delocalization function for characterizing this error and find it to be almost perfectly linear vs the fractional electron number for systems spanning in size from the H atom to the C₁₂H₁₄ polyene. This causes the delocalization energy error to be a quadratic polynomial in the fractional electron number, which permits us to assess the comparative performance of 47 popular and recent functionals through the curvature. The quadratic form further suggests that information about a single fractional charge is sufficient to eliminate the principal source of delocalization error. Generalizing traditional two-point information like ionization potentials or electron affinities to account for a third, fractional charge-based data point could therefore permit fitting/tuning of functionals with lower delocalization error.

Semi-empirical or non-empirical double-hybrid density functionals: which are more robust?

The development of non-empirical double-hybrid density functionals (DHDFs) is a very active research area with the number of approaches in this field having increased rapidly. At the same time, there is a lack of published work that provides a fair assessment and comparison between non-empirical and semi-empirical DHDFs on an equal footing. Herein, we close this gap and present a thorough analysis of both classes of DHDFs on the large GMTKN55 benchmark database for general main-group thermochemistry, kinetics, and noncovalent interactions [Goerigk et al., Phys. Chem. Chem. Phys., 2017, 19, 32184-32215]. In total, 115 variations of dispersion-corrected and -uncorrected DHDFs are tested, which will be condensed to an in-depth assessment of 31 methods: 19 non-empirical and 12 semi-empirical DHDFs. As such, our study represents the largest DHDF study ever conducted and can serve as an important benchmark informing method developers and users alike. Our results show that semi-empirical DHDFs are the most robust density functional approximations and more reliable and accurate than non-empirical ones. In fact, some non-empirical approaches are even outperformed by hybrid approaches or even dispersion-corrected and -uncorrected MP2 and SCS-MP2. SOS0-PBE0-2-D3(BJ) is the only exception and the only non-empirical DHDF that we can safely recommend for general applicability. However, it is still outperformed by six semi-empirical DHDFs, of which we would like to particularly recommend the following five: ωB97X-2-D3(BJ), DSD-BLYP-D3(BJ), DSD-PBEP86-D3(BJ), B2NC-PLYP-D3(BJ), and B2GPPLYP-D3(BJ). Our findings seriously question current trends in the field and they highlight that novel strategies have to be found in order to outperform the currently best density functional theory methods on the market. We hope that our study can function as an important cornerstone inspiring such a change of direction in the field.

Wavefunction-like Correlation Model for Use in Hybrid Density Functionals

We present Unsöld-W12 (UW12), an approximation to the correlation energy of molecules that is an explicit functional of the single-particle reduced-density matrix. The approximation resembles one part of modern explicitly correlated second-order Møller-Plesset (MP2) theory and is intended as an alternative to MP2 in double-hybrid exchange-correlation functionals. Orbital optimization with UW12 is straightforward, and the UW12 energy is evaluated without a double summation over unoccupied orbitals, leading to a faster basis-set convergence than is seen in double-hybrid functionals. We suggest a one-parameter hybrid exchange-correlation functional XCH-BLYP-UW12. XCH-BLYP-UW12 is similar to double-hybrid functionals, but contains UW12 correlation instead of MP2 correlation. We find that XCH-BLYP-UW12 is more accurate than the existing double-hybrid functional B2-PLYP for small-molecule main-group reaction barrier heights and has roughly the same accuracy as the existing hybrid functional B3LYP for atomization energies.

Bimolecular Reaction Dynamics in the Phenyl-Silane System: Exploring the Prototype of a Radical Substitution Mechanism

We present a combined experimental and theoretical investigation of the bimolecular gas-phase reaction of the phenyl radical (C₆H₅) with silane (SiH₄) under single collision conditions to investigate the chemical dynamics of forming phenylsilane (C₆H₅SiH₃) via a bimolecular radical substitution mechanism at a tetracoordinated silicon atom. Verified by electronic structure and quasiclassical trajectory calculations, the replacement of a single carbon atom in methane by silicon lowers the barrier to substitution, thus defying conventional wisdom that tetracoordinated hydrides undergo preferentially hydrogen abstraction. This reaction mechanism provides fundamental insights into the hitherto unexplored gas-phase chemical dynamics of radical substitution reactions of mononuclear main group hydrides under single collision conditions and highlights the distinct reactivity of silicon compared to its isovalent carbon. This mechanism might be also involved in the synthesis of cyanosilane (SiH₃CN) and methylsilane (CH₃SiH₃) probed in the circumstellar envelope of the carbon star IRC+10216.

Analysis of transition state stabilization by non-covalent interactions in organocatalysis: application of atomic and functional-group partitioned symmetry-adapted perturbation theory to the addition of organoboron reagents to fluoroketones

This work seeks to apply symmetry-adapted perturbation theory (SAPT) to the recent study of Hoveyda and co-workers [K. A. Lee et al., Nat. Chem. 2016, 8, 768] where an allyl addition to a ketone became enantioselective when the ketone was fluorinated. Through the application of atomic SAPT (A-SAPT) and functional-group SAPT (F-SAPT), the non-covalent interactions between specific atoms and functional groups in the transition states associated with the fluoroketone reactions can be quantified. Our A-SAPT analysis confirms that a HF contact thought to enhance stereoselectivity shows a strong preference for one of the transition states leading to the experimentally observed product enantiomer. Other key atom-atom contacts invoked to rationalize relative transition state energies are also found to behave as expected based on chemical intuition and contact distances. On the other hand, hypothesized steric clashes between substrate phenyl or ortho-methyl phenyl groups and the catalyst are not supported by F-SAPT computations, and indeed, these are actually favorable π-π interactions.

Survival of the most transferable at the top of Jacob's ladder: Defining and testing the ωB97M(2) double hybrid density functional

A meta-generalized gradient approximation, range-separated double hybrid (DH) density functional with VV10 non-local correlation is presented. The final 14-parameter functional form is determined by screening trillions of candidate fits through a combination of best subset selection, forward stepwise selection, and random sample consensus (RANSAC) outlier detection. The MGCDB84 database of 4986 data points is employed in this work, containing a training set of 870 data points, a validation set of 2964 data points, and a test set of 1152 data points. Following an xDH approach, orbitals from the ωB97M-V density functional are used to compute the second-order perturbation theory correction. The resulting functional, ωB97M(2), is benchmarked against a variety of leading double hybrid density functionals, including B2PLYP-D3(BJ), B2GPPLYP-D3(BJ), ωB97X-2(TQZ), XYG3, PTPSS-D3(0), XYGJ-OS, DSD-PBEP86-D3(BJ), and DSD-PBEPBE-D3(BJ). Encouragingly, the overall performance of ωB97M(2) on nearly 5000 data points clearly surpasses that of all of the tested density functionals. As a Rung 5 density functional, ωB97M(2) completes our family of combinatorially optimized functionals, complementing B97M-V on Rung 3, and ωB97X-V and ωB97M-V on Rung 4. The results suggest that ωB97M(2) has the potential to serve as a powerful predictive tool for accurate and efficient electronic structure calculations of main-group chemistry.

Assessing many-body contributions to intermolecular interactions of the AMOEBA force field using energy decomposition analysis of electronic structure calculations

In this work, we evaluate the accuracy of the classical AMOEBA model for representing many-body interactions, such as polarization, charge transfer, and Pauli repulsion and dispersion, through comparison against an energy decomposition method based on absolutely localized molecular orbitals (ALMO-EDA) for the water trimer and a variety of ion-water systems. When the 2- and 3-body contributions according to the many-body expansion are analyzed for the ion-water trimer systems examined here, the 3-body contributions to Pauli repulsion and dispersion are found to be negligible under ALMO-EDA, thereby supporting the validity of the pairwise-additive approximation in AMOEBA's 14-7 van der Waals term. However AMOEBA shows imperfect cancellation of errors for the missing effects of charge transfer and incorrectness in the distance dependence for polarization when compared with the corresponding ALMO-EDA terms. We trace the larger 2-body followed by 3-body polarization errors to the Thole damping scheme used in AMOEBA, and although the width parameter in Thole damping can be changed to improve agreement with the ALMO-EDA polarization for points about equilibrium, the correct profile of polarization as a function of intermolecular distance cannot be reproduced. The results suggest that there is a need for re-examining the damping and polarization model used in the AMOEBA force field and provide further insights into the formulations of polarizable force fields in general.

Simplified DFT methods for consistent structures and energies of large systems

Kohn-Sham density functional theory (DFT) is routinely used for the fast electronic structure computation of large systems and will most likely continue to be the method of choice for the generation of reliable geometries in the foreseeable future. Here, we present a hierarchy of simplified DFT methods designed for consistent structures and non-covalent interactions of large systems with particular focus on molecular crystals. The covered methods are a minimal basis set Hartree-Fock (HF-3c), a small basis set screened exchange hybrid functional (HSE-3c), and a generalized gradient approximated functional evaluated in a medium-sized basis set (B97-3c), all augmented with semi-classical correction potentials. We give an overview on the methods design, a comprehensive evaluation on established benchmark sets for geometries and lattice energies of molecular crystals, and highlight some realistic applications on large organic crystals with several hundreds of atoms in the primitive unit cell.

Density Functional Theory for Microwave Spectroscopy of Noncovalent Complexes: A Benchmark Study

In this work, we compare the results obtained with 89 computational methods for predicting noncovalent bond lengths in weakly bound complexes. Evaluations for the performance in noncovalent interaction energies and covalent bond lengths obtained from five other data sets are included. The overall best performing density functional is the ωB97M-V method, achieving balanced results across all three categories. For noncovalent geometries, the best methods include B97M-V, B3LYP-D3(BJ) and DSD-PBEPBE-D3(BJ). The effects of systematic improvement of the density functional approximation and of dispersion corrections are also discussed.

On the Computational Characterization of Charge-Transfer Effects in Noncovalently Bound Molecular Complexes

Charge-transfer (CT) is an important binding force in the formation of intermolecular complexes, and there have been a variety of theoretical models proposed to quantify this effect. These approaches, which typically rely on a definition of a "CT-free" state based on a partition of the system, sometimes yield significantly different results for a given intermolecular complex. Two widely used definitions of the "CT-free" state, the absolutely localized molecular orbitals (ALMO) method (where only on-fragment orbital mixings are permitted) and the constrained density functional theory (CDFT) approach (where fragment electron populations are fixed), are carefully examined in this work. Natural bond orbital (NBO) and the regularized symmetry-adapted perturbation theory (SAPT) are also briefly considered. Results for the ALMO and CDFT definitions of CT are compared on a broad range of model systems, including hydrogen-bonding systems, borane complexes, metal-carbonyl complexes, and complexes formed by water and metal cations. For most of these systems, CDFT yields a much smaller equilibrium CT energy compared to that given by the ALMO-based definition. This is mainly because the CDFT population constraint does not fully inhibit CT, which means that the CDFT "CT-free" state is in fact CT-contaminated. Examples of this contamination include (i) matching forward and backward donation (e.g., formic acid dimer) and (ii) unidirectional CT without changing fragment populations. The magnitude of the latter effect is quantified in systems such as the water dimer by employing a 3-space density constraint in addition to the orbital constraint. Furthermore, by means of the adiabatic EDA, it is shown that several observable effects of CT, such as the "pyramidalization" of the planar BH₃ molecule upon the complexation with Lewis bases, already appear on the "CT-free" CDFT surface. These results reveal the essential distinctions between the ALMO and CDFT definitions of CT and suggest that the former is more consistent with accepted understanding of the role of CT in intermolecular binding.

Fast and accurate quantum Monte Carlo for molecular crystals

Computational approaches based on the fundamental laws of quantum mechanics are now integral to almost all materials design initiatives in academia and industry. If computational materials science is genuinely going to deliver on its promises, then an electronic structure method with consistently high accuracy is urgently needed. We show that, thanks to recent algorithmic advances and the strategy developed in our manuscript, quantum Monte Carlo yields extremely accurate predictions for the lattice energies of materials at a surprisingly modest computational cost. It is thus no longer a technique that requires a world-leading computational facility to obtain meaningful results. While we focus on molecular crystals, the significance of our findings extends to all classes of materials.

Computer simulation plays a central role in modern-day materials science. The utility of a given computational approach depends largely on the balance it provides between accuracy and computational cost. Molecular crystals are a class of materials of great technological importance which are challenging for even the most sophisticated ab initio electronic structure theories to accurately describe. This is partly because they are held together by a balance of weak intermolecular forces but also because the primitive cells of molecular crystals are often substantially larger than those of atomic solids. Here, we demonstrate that diffusion quantum Monte Carlo (DMC) delivers subchemical accuracy for a diverse set of molecular crystals at a surprisingly moderate computational cost. As such, we anticipate that DMC can play an important role in understanding and predicting the properties of a large number of molecular crystals, including those built from relatively large molecules which are far beyond reach of other high-accuracy methods.

Energy decomposition analysis in an adiabatic picture

Energy decomposition analysis (EDA) of electronic structure calculations has facilitated quantitative understanding of diverse intermolecular interactions. Nevertheless, such analyses are usually performed at a single geometry and thus decompose a "single-point" interaction energy. As a result, the influence of the physically meaningful EDA components on the molecular structure and other properties are not directly obtained. To address this gap, the absolutely localized molecular orbital (ALMO)-EDA is reformulated in an adiabatic picture, where the frozen, polarization, and charge transfer energy contributions are defined as energy differences between the stationary points on different potential energy surfaces (PESs), which are accessed by geometry optimizations at the frozen, polarized and fully relaxed levels of density functional theory (DFT). Other molecular properties such as vibrational frequencies can thus be obtained at the stationary points on each PES. We apply the adiabatic ALMO-EDA to different configurations of the water dimer, the water-Cl^- and water-Mg²⁺/Ca²⁺ complexes, metallocenes (Fe²⁺, Ni²⁺, Cu²⁺, Zn²⁺), and the ammonia-borane complex. This method appears to be very useful for unraveling how physical effects such as polarization and charge transfer modulate changes in molecular properties induced by intermolecular interactions. As an example of the insight obtained, we find that a linear hydrogen bond geometry for the water dimer is preferred even without the presence of polarization and charge transfer, while the red shift in the OH stretch frequency is primarily a charge transfer effect; by contrast, a near-linear geometry for the water-chloride hydrogen bond is achieved only when charge transfer is allowed.

Probing non-covalent interactions with a second generation energy decomposition analysis using absolutely localized molecular orbitals

An energy decomposition analysis (EDA) separates a calculated interaction energy into as many interpretable contributions as possible; for instance, permanent and induced electrostatics, Pauli repulsions, dispersion and charge transfer. The challenge is to construct satisfactory definitions of all terms in the chemically relevant regime where fragment densities overlap, rendering unique definitions impossible. Towards this goal, we present an improved EDA for Kohn-Sham density functional theory (DFT) with properties that have previously not been simultaneously attained. Building on the absolutely localized molecular orbital (ALMO)-EDA, this second generation ALMO-EDA is variational and employs valid antisymmetric electronic wavefunctions to produce all five contributions listed above. These contributions moreover all have non-trivial complete basis set limits. We apply the EDA to the water dimer, the T-shaped and parallel-displaced benzene dimer, the p-biphthalate dimer "anti-electrostatic" hydrogen bonding complex, the biologically relevant binding of adenine and thymine in stacked and hydrogen-bonded configurations, the triply hydrogen-bonded guanine-cytosine complex, the interaction of Cl(-) with s-triazine and with the 1,3-dimethyl imidazolium cation, which is relevant to the study of ionic liquids, and the water-formaldehyde-vinyl alcohol ter-molecular radical cationic complex formed in the dissociative photoionization of glycerol.

Accuracy of Td-DFT in the Ultraviolet and Circular Dichroism Spectra of Deoxyguanosine and Uridine

Accuracy of the time-dependent density functional theory (Td-DFT) was examined for the ultraviolet (UV) and circular dichroism (CD) spectra of deoxyguanosine (dG) and uridine, using 11 different DFT functionals and two different basis sets. The Td-DFT results of the UV and CD spectra were strongly dependent on the functionals used. The basis-set dependence was observed only for the CD spectral calculations. For the UV spectra, the B3LYP and PBE0 functionals gave relatively good results. For the CD spectra, the B3LYP and PBE0 with 6-311G(d,p) basis gave relatively permissible result only for dG. The results of other functionals were difficult to be used for the studies of the UV and CD spectra, though the symmetry adapted cluster-configuration interaction (SAC-CI) method reproduced well the experimental spectra of these molecules. To obtain valuable information from the theoretical calculations of the UV and CD spectra, the theoretical tool must be able to reproduce correctly both of the intensities and peak positions of the UV and CD spectra. Then, we can analyze the reasons of the changes of the intensity and/or the peak position to clarify the chemistry involved. It is difficult to recommend Td-DFT as such tools of science, at least from the examinations using dG and uridine.

How accurate are static polarizability predictions from density functional theory? An assessment over 132 species at equilibrium geometry

Static polarizabilities are the first response of the electron density to electric fields, and offer a formally exact measure of the accuracy of excited states. We have developed a benchmark database of polarizabilities and have assessed the performance of 60 popular and recent functionals in predicting them.

A QM/MM approach on the structural and stereoelectronic factors governing glycosylation by GTF-SI fromStreptococcus mutans

This manuscript contains novel insights into the reaction mechanism catalyzed by GTF-SI. Structural and electronic features of the system are revealed, such as the strong hydrogen bond depicted above.

Computational Chemistry: The Fate of Current Methods and Future Challenges

"Where do we go from here?" is the underlying question regarding the future (perhaps foreseeable) developments in computational chemistry. Although this young discipline has already permeated practically all of chemistry, it is likely to become even more powerful with the rapid development of computational hard- and software.

The BioFragment Database (BFDb): An open-data platform for computational chemistry analysis of noncovalent interactions

Accurate potential energy models are necessary for reliable atomistic simulations of chemical phenomena. In the realm of biomolecular modeling, large systems like proteins comprise very many noncovalent interactions (NCIs) that can contribute to the protein's stability and structure. This work presents two high-quality chemical databases of common fragment interactions in biomolecular systems as extracted from high-resolution Protein DataBank crystal structures: 3380 sidechain-sidechain interactions and 100 backbone-backbone interactions that inaugurate the BioFragment Database (BFDb). Absolute interaction energies are generated with a computationally tractable explicitly correlated coupled cluster with perturbative triples [CCSD(T)-F12] "silver standard" (0.05 kcal/mol average error) for NCI that demands only a fraction of the cost of the conventional "gold standard," CCSD(T) at the complete basis set limit. By sampling extensively from biological environments, BFDb spans the natural diversity of protein NCI motifs and orientations. In addition to supplying a thorough assessment for lower scaling force-field (2), semi-empirical (3), density functional (244), and wavefunction (45) methods (comprising >1M interaction energies), BFDb provides interactive tools for running and manipulating the resulting large datasets and offers a valuable resource for potential energy model development and validation.