Analytical gradients for tensor hyper-contracted MP2 and SOS-MP2 on graphical processing units

Analytic Gradients for Density Fitting MP2 Using Natural Auxiliary Functions

The natural auxiliary function (NAF) approach is an approximation to decrease the size of the auxiliary basis set required for quantum chemical calculations utilizing the density fitting technique. It has been proven efficient to speed up various correlation models, such as second-order Møller-Plesset (MP2) theory and coupled-cluster methods. Here, for the first time, we discuss the theory of analytic derivatives for correlation methods employing the NAF approximation on the example of MP2. A detailed algorithm for the gradient calculation with the NAF approximation is proposed in the framework of the method of Lagrange multipliers. To assess the effect of the NAF approximation on gradients and optimized geometric parameters, a series of benchmark calculations on small and medium-sized systems was performed. Our results demonstrate that, for MP2, sufficiently accurate gradients and geometries can be achieved with a moderate time reduction of 15-20% for both small and medium-sized molecules.

New physical insights into the supporting subspace factorization of XMS-CASPT2 and generalization to multiple spin states via spin-free formulation

This paper introduces a spin-free formulation of the supporting subspace factorization [C. Song and T. J. Martínez, J. Chem. Phys. 149, 044108 (2018)], enabling a reduction in the computational scaling of the extended multi-state complete active space second-order perturbation (XMS-CASPT2) method for arbitrary spins. Compared to the original formulation that is defined in the spin orbitals and is limited to singlet states, the spin-free formulation in this work treats different spin states equivalently, thus naturally generalizing the idea beyond singlet states. In addition, we will present a new way of deriving the supporting subspace factorization with the purpose of understanding its physical interpretation. In this new derivation, we separate the sources that make CASPT2 difficult into the "same-site interactions" and "inter-site interactions." We will first show how the Kronecker sum can be used to remove the same-site interactions in the absence of inter-site interactions, leading to MP2 energy in dressed orbitals. We will then show how the inter-site interactions can be exactly recovered using Löwdin partition, where the supporting subspace concept will naturally arise. The new spin-free formulation maintains the main advantage of the supporting subspace factorization, i.e., allowing XMS-CASPT2 energies to be computed using highly optimized MP2 energy codes and Fock build codes, thus reducing the scaling of XMS-CASPT2 to the same scaling as MP2. We will present and discuss results that benchmark the accuracy and performance of the new method. To demonstrate how the new method can be useful in studying real photochemical systems, the supporting subspace XMS-CASPT2 is applied to a photoreaction sensitive to magnetic field effects. The new spin-free formulation makes it possible to calculate the doublet and quartet states required in this particular photoreaction mechanism.

High-Performance Multi-GPU Analytic RI-MP2 Energy Gradients

This article presents a novel algorithm for the calculation of analytic energy gradients from second-order Møller-Plesset perturbation theory within the Resolution-of-the-Identity approximation (RI-MP2), which is designed to achieve high performance on clusters with multiple graphical processing units (GPUs). The algorithm uses GPUs for all major steps of the calculation, including integral generation, formation of all required intermediate tensors, solution of the Z-vector equation and gradient accumulation. The implementation in the EXtreme Scale Electronic Structure System (EXESS) software package includes a tailored, highly efficient, multistream scheduling system to hide CPU-GPU data transfer latencies and allows nodes with 8 A100 GPUs to operate at over 80% of theoretical peak floating-point performance. Comparative performance analysis shows a significant reduction in computational time relative to traditional multicore CPU-based methods, with our approach achieving up to a 95-fold speedup over the single-node performance of established software such as Q-Chem and ORCA. Additionally, we demonstrate that pairing our implementation with the molecular fragmentation framework in EXESS can drastically lower the computational scaling of RI-MP2 gradient calculations from quintic to subquadratic, enabling further substantial savings in runtime while retaining high numerical accuracy in the resulting gradients.

Low-Scaling Algorithm for the Random Phase Approximation Using Tensor Hypercontraction with k-point Sampling

We present a low-scaling algorithm for the random phase approximation (RPA) with k-point sampling in the framework of tensor hypercontraction (THC) for electron repulsion integrals (ERIs). The THC factorization is obtained via a revised interpolative separable density fitting (ISDF) procedure with a momentum-dependent auxiliary basis for generic single-particle Bloch orbitals. Our formulation does not require preoptimized interpolating points or auxiliary bases, and the accuracy is systematically controlled by the number of interpolating points. The resulting RPA algorithm scales linearly with the number of k-points and cubically with the system size without any assumption on sparsity or locality of orbitals. The errors of ERIs and RPA energy show rapid convergence with respect to the size of the THC auxiliary basis, suggesting a promising and robust direction to construct efficient algorithms of higher order many-body perturbation theories for large-scale systems.

Cluster Amplitudes and Their Interplay with Self-Consistency in Density Functional Methods

Density functional theory (DFT) provides convenient electronic structure methods for the study of molecular systems and materials. Regular Kohn-Sham DFT calculations rely on unitary transformations to determine the ground-state electronic density, ground state energy, and related properties. However, for dissociation of molecular systems into open-shell fragments, due to the self-interaction error present in a large number of density functional approximations, the self-consistent procedure based on the this type of transformation gives rise to the well-known charge delocalization problem. To avoid this issue, we showed previously that the cluster operator of coupled-cluster theory can be utilized within the context of DFT to solve in an alternative and approximate fashion the ground-state self-consistent problem. This work further examines the application of the singles cluster operator to molecular ground state calculations. Two approximations are derived and explored: i) A linearized scheme of the quadratic equation used to determine the cluster amplitudes. ii) The effect of carrying the calculations in a non-self-consistent field fashion. These approaches are found to be capable of improving the energy and density of the system and are quite stable in either case. The theoretical framework discussed in this work could be used to describe, with an added flexibility, quantum systems that display challenging features and require expanded theoretical methods.

Tensor-Hypercontracted MP2 First Derivatives: Runtime and Memory Efficient Computation of Hyperfine Coupling Constants

We employ our recently introduced tensor-hypercontracted (THC) second-order Møller-Plesset perturbation theory (MP2) method [Bangerter, F. H., Glasbrenner, M., Ochsenfeld, C. J. Chem. Theory Comput. 2021, 17, 211-221] for the computation of hyperfine coupling constants (HFCCs). The implementation leverages the tensor structure of the THC factorized electron repulsion integrals for an efficient formation of the integral-based intermediates. The computational complexity of the most expensive and formally quintic scaling exchange-like contribution is reduced to effectively subquadratic, by making use of the intrinsic, exponentially decaying coupling between tensor indices through screening based on natural blocking. Overall, this yields an effective subquadratic scaling with a low prefactor for the presented THC-based AO-MP2 method for the computation of isotropic HFCCs on DNA fragments with up to 500 atoms and 5000 basis functions. Furthermore, the implementation achieves considerable speedups with up to a factor of roughly 600-1000 compared to previous implementations [Vogler, S., Ludwig, M., Maurer, M., Ochsenfeld, C. J. Chem. Phys. 2017, 147, 024101] for medium-sized organic radicals, while also significantly reducing storage requirements.

A diagrammatic approach for automatically deriving analytical gradients of tensor hyper-contracted electronic structure methods

We introduce a diagrammatic approach to facilitate the automatic derivation of analytical nuclear gradients for tensor hyper-contraction (THC) based electronic structure methods. The automatically derived gradients are guaranteed to have the same scaling in terms of both operation count and memory footprint as the underlying energy calculations, and the computation of a gradient is roughly three times as costly as the underlying energy. The new diagrammatic approach enables the first cubic scaling implementation of nuclear derivatives for THC tensors fitted in molecular orbital basis (MO-THC). Furthermore, application of this new approach to THC-MP2 analytical gradients leads to an implementation, which is at least four times faster than the previously reported, manually derived implementation. Finally, we apply the new approach to the 14 tensor contraction patterns appearing in the supporting subspace formulation of multireference perturbation theory, laying the foundation for developments of analytical nuclear gradients and nonadiabatic coupling vectors for multi-state CASPT2.

Reduced scaling formulation of CASPT2 analytical gradients using the supporting subspace method

We present a reduced scaling and exact reformulation of state specific complete active space second-order perturbation (CASPT2) analytical gradients in terms of the MP2 and Fock derivatives using the supporting subspace method. This work follows naturally from the supporting subspace formulation of the CASPT2 energy in terms of the MP2 energy using dressed orbitals and Fock builds. For a given active space configuration, the terms corresponding to the MP2-gradient can be evaluated with O(N⁵) operations, while the rest of the calculations can be computed with O(N³) operations using Fock builds, Fock gradients, and linear algebra. When tensor-hyper-contraction is applied simultaneously, the computational cost can be further reduced to O(N⁴) for a fixed active space size. The new formulation enables efficient implementation of CASPT2 analytical gradients by leveraging the existing graphical processing unit (GPU)-based MP2 and Fock routines. We present benchmark results that demonstrate the accuracy and performance of the new method. Example applications of the new method in ab initio molecular dynamics simulation and constrained geometry optimization are given.

Low-Scaling Tensor Hypercontraction in the Cholesky Molecular Orbital Basis Applied to Second-Order Møller-Plesset Perturbation Theory

We employ various reduced scaling techniques to accelerate the recently developed least-squares tensor hypercontraction (LS-THC) approximation [Parrish, R. M., Hohenstein, E. G., Martínez, T. J., Sherrill, C. D. J. Chem. Phys. 137, 224106 (2012)] for electron repulsion integrals (ERIs) and apply it to second-order Møller-Plesset perturbation theory (MP2). The grid-projected ERI tensors are efficiently constructed using a localized Cholesky molecular orbital basis from density-fitted integrals with an attenuated Coulomb metric. Additionally, rigorous integral screening and the natural blocking matrix format are applied to reduce the complexity of this step. By recasting the equations to form the quantized representation of the 1/r operator Z into the form of a system of linear equations, the bottleneck of inverting the grid metric via pseudoinversion is removed. This leads to a reduced scaling THC algorithm and application to MP2 yields the (sub-)quadratically scaling THC-ω-RI-CDD-SOS-MP2 method. The efficiency of this method is assessed for various systems including DNA fragments with over 8000 basis functions and the subquadratic scaling is illustrated.

Reduced scaling extended multi-state CASPT2 (XMS-CASPT2) using supporting subspaces and tensor hyper-contraction

We present a reduced scaling formulation of the extended multi-state CASPT2 (XMS-CASPT2) method, which is based on our recently developed state-specific CASPT2 (SS-CASPT2) formulation using supporting subspaces and tensor hyper-contraction. By using these two techniques, the off-diagonal elements of the effective Hamiltonian can be computed with only O(N³) operations and O(N²) memory, where N is the number of basis functions. This limits the overall computational scaling to O(N⁴) operations and O(N²) memory. Thus, excited states can now be obtained at the same reduced (relative to previous algorithms) scaling we achieved for SS-CASPT2. In addition, we also investigate how the energy denominators can be factorized with the Laplace quadrature when some of the denominators are negative, which is critical for excited state calculations. An efficient implementation of the method has been developed using graphical processing units while also exploiting spatial sparsity in tensor operations. We benchmark the accuracy of the new method by comparison to non-THC formulated XMS-CASPT2 for the excited states of various molecules. In our tests, the THC approximation introduces negligible errors (≈0.01 eV) compared to the non-THC reference method. Scaling behavior and computational timings are presented to demonstrate performance. The new method is also interfaced with quantum mechanics/molecular mechanics (QM/MM). In an example study of green fluorescent protein, we show how the XMS-CASPT2 potential energy surfaces and excitation energies are affected by increasing the size of the QM region up to 278 QM atoms with more than 2300 basis functions.

TeraChem: Accelerating electronic structure and ab initio molecular dynamics with graphical processing units

Developed over the past decade, TeraChem is an electronic structure and ab initio molecular dynamics software package designed from the ground up to leverage graphics processing units (GPUs) to perform large-scale ground and excited state quantum chemistry calculations in the gas and the condensed phase. TeraChem's speed stems from the reformulation of conventional electronic structure theories in terms of a set of individually optimized high-performance electronic structure operations (e.g., Coulomb and exchange matrix builds, one- and two-particle density matrix builds) and rank-reduction techniques (e.g., tensor hypercontraction). Recent efforts have encapsulated these core operations and provided language-agnostic interfaces. This greatly increases the accessibility and flexibility of TeraChem as a platform to develop new electronic structure methods on GPUs and provides clear optimization targets for emerging parallel computing architectures.

Numerical assessment for accuracy and GPU acceleration of TD-DMRG time evolution schemes

The time dependent density matrix renormalization group (TD-DMRG) has become one of the cutting edge methods of quantum dynamics for complex systems. In this paper, we comparatively study the accuracy of three time evolution schemes in the TD-DMRG, the global propagation and compression method with the Runge-Kutta algorithm (P&C-RK), the time dependent variational principle based methods with the matrix unfolding algorithm (TDVP-MU), and with the projector-splitting algorithm (TDVP-PS), by performing benchmarks on the exciton dynamics of the Fenna-Matthews-Olson complex. We show that TDVP-MU and TDVP-PS yield the same result when the time step size is converged and they are more accurate than P&C-RK4, while TDVP-PS tolerates a larger time step size than TDVP-MU. We further adopt the graphical processing units to accelerate the heavy tensor contractions in the TD-DMRG, and it is able to speed up the TDVP-MU and TDVP-PS schemes by up to 73 times.

Analytic gradients for the single-reference driven similarity renormalization group second-order perturbation theory

We derive and implement analytic energy gradients for the single-reference driven similarity renormalization group second-order perturbation theory (DSRG-PT2). The resulting equations possess an asymptotic scaling that is identical to that of the second-order Møller-Plesset perturbation theory (MP2), indicating that the exponential regularizer in the DSRG equations does not introduce formal difficulties in the gradient theory. We apply the DSRG-PT2 method to optimizing the geometries of 15 small molecules. The equilibrium bond lengths computed with DSRG-PT2 are found similar to those of MP2, yielding a mean absolute error of 0.0033 Å and a standard deviation of 0.0045 Å when compared with coupled cluster with singles, doubles, and perturbative triples.

Preface: Special Topic: From Quantum Mechanics to Force Fields

This Special Topic issue entitled "From Quantum Mechanics to Force Fields" is dedicated to the ongoing efforts of the theoretical chemistry community to develop a new generation of accurate force fields based on data from high-level electronic structure calculations and to develop faster electronic structure methods for testing and designing force fields as well as for carrying out simulations. This issue includes a collection of 35 original research articles that illustrate recent theoretical advances in the field. It provides a timely snapshot of recent developments in the generation of approaches to enable more accurate molecular simulations of processes important in chemistry, physics, biophysics, and materials science.