Alchemical Predictions for Computational Catalysis: Potential and Limitations

The Importance of Reaction Energy in Predicting Chemical Reaction Barriers with Machine Learning Models

Improving our fundamental understanding of complex heterocatalytic processes increasingly relies on electronic structure simulations and microkinetic models based on calculated energy differences. In particular, calculation of activation barriers, usually achieved through compute-intensive saddle point search routines, remains a serious bottleneck in understanding trends in catalytic activity for highly branched reaction networks. Although the well-known Brønsted-Evans-Polyani (BEP) scaling - a one-feature linear regression model - has been widely applied in such microkinetic models, they still rely on calculated reaction energies and may not generalize beyond a single facet on a single class of materials, e. g., a terrace sites on transition metals. For highly branched and energetically shallow reaction networks, such as electrochemical CO2 reduction or wastewater remediation, calculating even reaction energies on many surfaces can become computationally intractable due to the combinatorial explosion of states that must be considered. Here, we investigate the feasibility of activation barrier prediction without knowledge of the reaction energy using linear and nonlinear machine learning (ML) models trained on a new database of over 500 dehydrogenation activation barriers. We also find that inclusion of the reaction energy significantly improves both classes of ML models, but complex nonlinear models can achieve performance similar to the simplest BEP scaling when predicting activation barriers on new systems. Additionally, inclusion of the reaction energy significantly improves generalizability to new systems beyond the training set. Our results suggest that the reaction energy is a critical feature to consider when building models to predict activation barriers, indicating that efforts to reliably predict reaction energies through, e. g., the Open Catalyst Project and others, will be an important route to effective model development for more complex systems.

Biomolecular dynamics with machine-learned quantum-mechanical force fields trained on diverse chemical fragments

The GEMS method enables molecular dynamics simulations of large heterogeneous systems at ab initio quality.

Extending the definition of atomic basis sets to atoms with fractional nuclear charge

Alchemical transformations showed that perturbation theory can be applied also to changes in the atomic nuclear charges of a molecule. The alchemical path that connects two different chemical species involves the conceptualization of a non-physical system in which an atom possess a non-integer nuclear charge. A correct quantum mechanical treatment of these systems is limited by the fact that finite size atomic basis sets do not define exponents and contraction coefficients for fractional charge atoms. This paper proposes a solution to this problem and shows that a smooth interpolation of the atomic orbital coefficients and exponents across the periodic table is a convenient way to produce accurate alchemical predictions, even using small size basis sets.

Optimization of General Molecular Properties in the Equilibrium Geometry Using Quantum Alchemy: An Inverse Molecular Design Approach

Inverse molecular design allows the optimization of molecules in chemical space and is promising for accelerating the development of functional molecules and materials. To design realistic molecules, it is necessary to consider geometric stability during optimization. In this work, we introduce an inverse design method that optimizes molecular properties by changing the chemical composition in the equilibrium geometry. The optimization algorithm of our recently developed molecular design method has been modified to allow molecular design for general properties at a low computational cost. The proposed method is based on quantum alchemy and does not require empirical data. We demonstrate the applicability and limitations of the present method in the optimization of the electric dipole moment and atomization energy in small chemical spaces for (BF, CO), (N₂, CO), BN-doped benzene derivatives, and BN-doped butane derivatives. It was found that the optimality criteria scheme adopted for updating the molecular species yields faster convergence of the optimization and requires a less computational cost. Moreover, we also investigate and discuss the applicability of quantum alchemy to the electric dipole moment.

Quantum Alchemy Based Bonding Trends and Their Link to Hammett's Equation and Pauling's Electronegativity Model

We present an intuitive and general analytical approximation estimating the energy of covalent single and double bonds between participating atoms in terms of their respective nuclear charges with just three parameters, [E_AB ≈ a - bZ_AZ_B + c(Z_A^7/3 + Z_B^7/3) ]. The functional form of our expression models an alchemical atomic energy decomposition between participating atoms A and B. After calibration, reasonably accurate bond dissociation energy estimates are obtained for hydrogen-saturated diatomics composed of p-block elements coming from the same row 2 ≤ n ≤ 4 in the periodic table. Corresponding changes in bond dissociation energies due to substitution of atom B by C can be obtained via simple formulas. While being of different functional form and origin, our model is as simple and accurate as Pauling's well-known electronegativity model. Analysis indicates that the model's response in covalent bonding to variation in nuclear charge is near-linear, which is consistent with Hammett's equation.

Relative energies without electronic perturbations via alchemical integral transform

We show that the energy of a perturbed system can be fully recovered from the unperturbed system’s electron density. We derive an alchemical integral transform by parametrizing space in terms of transmutations, the chain rule, and integration by parts. Within the radius of convergence, the zeroth order yields the energy expansion at all orders, restricting the textbook statement by Wigner that the p-th order wave function derivative is necessary to describe the (2 p + 1)-th energy derivative. Without the need for derivatives of the electron density, this allows us to cover entire chemical neighborhoods from just one quantum calculation instead of single systems one by one. Numerical evidence presented indicates that predictive accuracy is achieved in the range of mHa for the harmonic oscillator or the Morse potential and in the range of machine accuracy for hydrogen-like atoms. Considering isoelectronic nuclear charge variations by one proton in all multi-electron atoms from He to Ne, alchemical integral transform based estimates of the relative energy deviate by only few mHa from corresponding Hartree–Fock reference numbers.

Alchemical geometry relaxation

We propose to relax geometries throughout chemical compound space (CCS) using alchemical perturbation density functional theory (APDFT). APDFT refers to perturbation theory involving changes in nuclear charges within approximate solutions to Schr\"odinger's equation. We give an analytical formula to calculate the mixed second order energy derivatives with respect to both, nuclear charges and nuclear positions (named "alchemical force"), within the restricted Hartree-Fock case.We have implemented and studied the formula for its use in geometry relaxation of various reference and target molecules.We have also analysed the convergence of the alchemical force perturbation series, as well as basis set effects.Interpolating alchemically predicted energies, forces, and Hessian to a Morse potential yields more accurate geometries and equilibrium energies than when performing a standard Newton Raphson step. Our numerical predictions for small molecules including BF, CO, N2, CH$_4$, NH$_3$, H$_2$O, and HF yield mean absolute errors of of equilibrium energies and bond lengths smaller than 10 mHa and 0.01 Bohr for 4$^\text{th}$ order APDFT predictions, respectively.Our alchemical geometry relaxation still preserves the combinatorial efficiency of APDFT: Based on a single coupled perturbed Hartree Fock derivative for benzene we provide numerical predictions of equilibrium energies and relaxed structures of all the 17 iso-electronic charge-netural BN-doped mutants with averaged absolute deviations of $\sim$27 mHa and $\sim$0.12 Bohr, respectively.

Arbitrarily accurate quantum alchemy

Doping compounds can be considered a perturbation to the nuclear charges in a molecular Hamiltonian. Expansions of this perturbation in a Taylor series, i.e., quantum alchemy, have been used in the literature to assess millions of derivative compounds at once rather than enumerating them in costly quantum chemistry calculations. So far, it was unclear whether this series even converges for small molecules, whether it can be used for geometry relaxation, and how strong this perturbation may be to still obtain convergent numbers. This work provides numerical evidence that this expansion converges and recovers the self-consistent energy of Hartree-Fock calculations. The convergence radius of this expansion is quantified for dimer examples and systematically evaluated for different basis sets, allowing for estimates of the chemical space that can be covered by perturbing one reference calculation alone. Besides electronic energy, convergence is shown for density matrix elements, molecular orbital energies, and density profiles, even for large changes in electronic structure, e.g., transforming He₃ into H₆. Subsequently, mixed alchemical and spatial derivatives are used to relax H₂ from the electronic structure of He alone, highlighting a path to spatially relaxed quantum alchemy. Finally, the underlying code that allows for arbitrarily accurate evaluation of restricted Hartree-Fock energies and arbitrary order derivatives is made available to support future method development.

Periodic Trends in Adsorption Energies around Single-Atom Alloy Active Sites

Single-atom alloys (SAAs) make up a special class of alloy surface catalysts that offer well-defined, isolated active sites in a more inert metal host. The dopant sites are generally assumed to have little or no influence on the properties of the host metal, and transport of chemical reactants and products to and from the dopant sites is generally assumed to be facile. Here, by performing density functional theory calculations and surface science experiments, we identify a new physical effect on SAA surfaces, whereby adsorption is destabilized by ≤300 meV on host sites within the perimeter of the reactive dopant site. We identify periodic trends for this behavior and demonstrate a zone of exclusion around the reactive sites for a range of adsorbates and combinations of host and dopant metals. Experiments confirm an increased barrier for diffusion of CO toward the dopant on a RhCu SAA. This effect offers new possibilities for understanding and designing active sites with tunable energetic landscapes surrounding them.

Ab Initio Machine Learning in Chemical Compound Space

Chemical compound space (CCS), the set of all theoretically conceivable combinations of chemical elements and (meta-)stable geometries that make up matter, is colossal. The first-principles based virtual sampling of this space, for example, in search of novel molecules or materials which exhibit desirable properties, is therefore prohibitive for all but the smallest subsets and simplest properties. We review studies aimed at tackling this challenge using modern machine learning techniques based on (i) synthetic data, typically generated using quantum mechanics based methods, and (ii) model architectures inspired by quantum mechanics. Such Quantum mechanics based Machine Learning (QML) approaches combine the numerical efficiency of statistical surrogate models with an ab initio view on matter. They rigorously reflect the underlying physics in order to reach universality and transferability across CCS. While state-of-the-art approximations to quantum problems impose severe computational bottlenecks, recent QML based developments indicate the possibility of substantial acceleration without sacrificing the predictive power of quantum mechanics.

Globally Optimized Molecular Embeddings for Dynamic Reaction Solvate Shell Optimization and Active Site Design

We demonstrate how a full QM/MM derivatization of the recently developed GOCAT model can be utilized in the global optimization of molecular embeddings. To this end, we provide two distinct examples: An $$\text {S}_\text {N}2$$ S N 2 reaction, and one enzymatic example of recent interest, the ketosteroid isomerase. These serve us to highlight the advantages of such an approach and sketch the roadmap for further improvements.

Simplifying inverse materials design problems for fixed lattices with alchemical chirality

Brute-force compute campaigns relying on demanding ab initio calculations routinely search for previously unknown materials in chemical compound space (CCS), the vast set of all conceivable stable combinations of elements and structural configurations. Here, we demonstrate that four-dimensional chirality arising from antisymmetry of alchemical perturbations dissects CCS and defines approximate ranks, which reduce its formal dimensionality and break down its combinatorial scaling. The resulting "alchemical" enantiomers have the same electronic energy up to the third order, independent of respective covalent bond topology, imposing relevant constraints on chemical bonding. Alchemical chirality deepens our understanding of CCS and enables the establishment of trends without empiricism for any materials with fixed lattices. We demonstrate the efficacy for three cases: (i) new rules for electronic energy contributions to chemical bonding; (ii) analysis of the electron density of BN-doped benzene; and (iii) ranking over 2000 and 4 million BN-doped naphthalene and picene derivatives, respectively.

Effects of perturbation order and basis set on alchemical predictions

Alchemical perturbation density functional theory has been shown to be an efficient and computationally inexpensive way to explore chemical compound space. We investigate approximations made, in terms of atomic basis sets and the perturbation order, introduce an electron-density based estimate of errors of the alchemical prediction, and propose a correction for effects due to basis set incompleteness. Our numerical analysis of potential energy estimates, and resulting binding curves, is based on coupled-cluster single double (CCSD) reference results and is limited to all neutral diatomics with 14 electrons (AlH⋯NN). The method predicts binding energy, equilibrium distance, and vibrational frequencies of neighboring out-of-sample diatomics with near CCSD quality using perturbations up to the fifth order. We also discuss simultaneous alchemical mutations at multiple sites in benzene.

Using nature's blueprint to expand catalysis with Earth-abundant metals

Numerous redox transformations that are essential to life are catalyzed by metalloenzymes that feature Earth-abundant metals. In contrast, platinum-group metals have been the cornerstone of many industrial catalytic reactions for decades, providing high activity, thermal stability, and tolerance to chemical poisons. We assert that nature's blueprint provides the fundamental principles for vastly expanding the use of abundant metals in catalysis. We highlight the key physical properties of abundant metals that distinguish them from precious metals, and we look to nature to understand how the inherent attributes of abundant metals can be embraced to produce highly efficient catalysts for reactions crucial to the sustainable production and transformation of fuels and chemicals.

A deep neural network for molecular wave functions in quasi-atomic minimal basis representation

The emergence of machine learning methods in quantum chemistry provides new methods to revisit an old problem: Can the predictive accuracy of electronic structure calculations be decoupled from their numerical bottlenecks? Previous attempts to answer this question have, among other methods, given rise to semi-empirical quantum chemistry in minimal basis representation. We present an adaptation of the recently proposed SchNet for Orbitals (SchNOrb) deep convolutional neural network model [K. T. Schütt et al., Nat. Commun. 10, 5024 (2019)] for electronic wave functions in an optimized quasi-atomic minimal basis representation. For five organic molecules ranging from 5 to 13 heavy atoms, the model accurately predicts molecular orbital energies and wave functions and provides access to derived properties for chemical bonding analysis. Particularly for larger molecules, the model outperforms the original atomic-orbital-based SchNOrb method in terms of accuracy and scaling. We conclude by discussing the future potential of this approach in quantum chemical workflows.

Globally optimal catalytic fields for a Diels-Alder reaction

In a previous paper [M. Dittner and B. Hartke, J. Chem. Theory Comput. 14, 3547 (2018)], we introduced a preliminary version of our GOCAT (globally optimal catalyst) concept in which electrostatic catalysts are designed for arbitrary reactions by global optimization of distributed point charges that surround the reaction. In this first version, a pre-defined reaction path was kept fixed. This unrealistic assumption allowed for only small catalytic effects. In the present work, we extend our GOCAT framework by a sophisticated and robust on-the-fly reaction path optimization, plus further concomitant algorithm adaptions. This allows smaller and larger excursions from a pre-defined reaction path under the influence of the GOCAT point-charge surrounding, all the way to drastic mechanistic changes. In contrast to the restricted first GOCAT version, this new version is able to address real-life catalysis. We demonstrate this by applying it to the electrostatic catalysis of a prototypical Diels-Alder reaction. Without using any prior information, this procedure re-discovers theoretically and experimentally established features of electrostatic catalysis of this very reaction, including a field-dependent transition from the synchronous, concerted textbook mechanism to a zwitterionic two-step mechanism, and diastereomeric discrimination by suitable electric field components.

Predicting metal-metal interactions. II. Accelerating generalized schemes through physical insights

Operando-computational frameworks that integrate descriptors for catalyst stability within catalyst screening paradigms enable predictions of rates and selectivity on chemically faithful representations of nanoparticles under reaction conditions. These catalyst stability descriptors can be efficiently predicted by density functional theory (DFT)-based models. The alloy stability model, for example, predicts the stability of metal atoms in nanoparticles with site-by-site resolution. Herein, we use physical insights to present accelerated approaches of parameterizing this recently introduced alloy-stability model. These accelerated approaches meld quadratic functions for the energy of metal atoms in terms of the coordination number with linear correlations between model parameters and the cohesive energies of bulk metals. By interpolating across both the coordination number and chemical space, these accelerated approaches shrink the training set size for 12 fcc p- and d-block metals from 204 to as few as 24 DFT calculated total energies without sacrificing the accuracy of our model. We validate the accelerated approaches by predicting adsorption energies of metal atoms on extended surfaces and 147 atom cuboctahedral nanoparticles with mean absolute errors of 0.10 eV and 0.24 eV, respectively. This efficiency boost will enable a rapid and exhaustive exploration of the vast material space of transition metal alloys for catalytic applications.

Predicting metal-metal interactions. I. The influence of strain on nanoparticle and metal adlayer stabilities

Strain-engineering of bimetallic nanomaterials is an important design strategy for developing new catalysts. Herein, we introduce an approach for including strain effects into a recently introduced, density functional theory (DFT)-based alloy stability model. The model predicts adsorption site stabilities in nanoparticles and connects these site stabilities with catalytic reactivity and selectivity. Strain-based dependencies will increase the model's accuracy for nanoparticles affected by finite-size effects. In addition to the stability of small nanoparticles, strain also influences the heat of adsorption of epitaxially grown metal-on-metal adlayers. In this respect, we successfully benchmark the strain-including alloy stability model with previous experimentally determined trends in the heats of adsorption of Au and Cu adlayers on Pt (111). For these systems, our model predicts stronger bimetallic interactions in the first monolayer than monometallic interactions in the second monolayer. We explicitly quantify the interplay between destabilizing strain effects and the energy gained by forming new metal-metal bonds. While tensile strain in the first Cu monolayer significantly destabilizes the adsorption strength, compressive strain in the first Au monolayer has a minimal impact on the heat of adsorption. Hence, this study introduces and, by comparison with previous experiments, validates an efficient DFT-based approach for strain-engineering the stability, and, in turn, the catalytic performance, of active sites in bimetallic alloys with atomic level resolution.

Rapid and accurate molecular deprotonation energies from quantum alchemy

We assess the applicability of alchemical perturbation density functional theory (APDFT) for quickly and accurately estimating deprotonation energies. We have considered all possible single and double deprotonations in one hundred small organic molecules drawn at random from QM9 [Ramakrishnan et al., JCTC, 2015]. Numerical evidence is presented for 5160 deprotonated species at both HF/def2-TZVP and CCSD/6-31G* levels of theory. We show that the perturbation expansion formalism of APDFT quickly converges to reliable results: using CCSD electron densities and derivatives, regular Hartree-Fock calculations are outperformed at the second or third order for ranking all possible doubly or singly deprotonated molecules, respectively. CCSD single deprotonation energies are reproduced within 1.4 kcal mol^-1 on average within third order APDFT. We introduce a hybrid approach where the computational cost of APDFT is reduced even further by mixing first order terms at a higher level of theory (CCSD) with higher order terms at a lower level of theory only (HF). We find that this approach reaches 2 kcal mol^-1 accuracy in absolute deprotonation energies compared to CCSD at 2% of the computational cost of third order APDFT.

Atoms in Molecules from Alchemical Perturbation Density Functional Theory

Based on thermodynamic integration, we introduce atoms in molecules (AIM) using the orbital-free framework of alchemical perturbation density functional theory (APDFT). Within APDFT, atomic energies and electron densities in molecules are arbitrary because any reference system and integration path can be selected as long as it meets the boundary conditions. We choose the uniform electron gas (jellium) as a reference and linearly scale up all nuclear charges, situated at any query molecule's atomic coordinates. Within the approximations made when calculating one-particle electron densities, this universal choice affords unambiguous and exact definitions of energies and electron densities of AIMs. Numerical results are presented for neutral small molecules (CO, N₂, BF, CO₂), various small molecules with different electronic hybridization states of carbon (CH₄, C₂H₆, C₂H₄, C₂H₂, HCN), and all of the possible BN-doped mutants connecting benzene to borazine (C_2nB_3-nN_3-nH₆, 0 ≤ n ≤ 3). Our results, as well as comparison to atomic energy estimates resulting from either DFT trained neural network models or atomic basis set overlap within CCSD, suggest that APDFT based AIMs enable meaningful, interesting, and counterintuitive interpretations of chemical bonding and molecular electron densities.

Search for Catalysts by Inverse Design: Artificial Intelligence, Mountain Climbers, and Alchemists

In silico catalyst design is a grand challenge of chemistry. Traditional computational approaches have been limited by the need to compute properties for an intractably large number of possible catalysts. Recently, inverse design methods have emerged, starting from a desired property and optimizing a corresponding chemical structure. Techniques used for exploring chemical space include gradient-based optimization, alchemical transformations, and machine learning. Though the application of these methods to catalysis is in its early stages, further development will allow for robust computational catalyst design. This review provides an overview of the evolution of inverse design approaches and their relevance to catalysis. The strengths and limitations of existing techniques are highlighted, and suggestions for future research are provided.

Predicting Adsorption Properties of Catalytic Descriptors on Bimetallic Nanoalloys with Site-Specific Precision

Bimetallic nanoparticles present a vastly tunable structural and compositional design space rendering them promising materials for catalytic and energy applications. Yet it remains an enduring challenge to efficiently screen candidate alloys with atomic level specificity while explicitly accounting for their inherent stabilities under reaction conditions. Herein, by leveraging correlations between binding energies of metal adsorption sites and metal-adsorbate complexes, we predict adsorption energies of typical catalytic descriptors (OH*, CH₃*, CH*, and CO*) on bimetallic alloys with site-specific resolution. We demonstrate that our approach predicts adsorption energies on top and bridge sites of bimetallic nanoparticles having generic morphologies and chemical environments with errors between 0.09 and 0.18 eV. By forging a link between the inherent stability of an alloy and the adsorption properties of catalytic descriptors, we can now identify active site motifs in nanoalloys that possess targeted catalytic descriptor values while being thermodynamically stable under working conditions.

Alchemical Normal Modes Unify Chemical Space

In silico design of new molecules and materials with desirable quantum properties by high-throughput screening is a major challenge due to the high dimensionality of chemical space. To facilitate its navigation, we present a unification of coordinate and composition space in terms of alchemical normal modes (ANMs) which result from second order perturbation theory. ANMs assume a predominantly smooth nature of chemical space and form a basis in which new compounds can be expanded and identified. We showcase the use of ANMs for the energetics of the isoelectronic series of diatomics with 14 electrons, BN doped benzene derivatives (C_{6-2 x}(BN) _xH₆ with x = 0,1,2,3), predictions for over 1.8 million BN doped coronene derivatives, and genetic energy optimizations in the entire BN-doped coronene space. Using Ge lattice scans as reference, the applicability of ANMs across the periodic table is demonstrated for III-V and IV-IV semiconductors Si, Sn, SiGe, SnGe, SiSn, as well as AlP, AlAs, AlSb, GaP, GaAs, GaSb, InP, InAs, and InSb. Analysis of our results indicates simple qualitative structure property rules for estimating energetic rankings among isomers. Useful quantitative estimates can also be obtained when few atoms are changed to neighboring or lower lying elements in the periodic table. The quality of the predictions often increases with the symmetry of system chosen as reference due to cancellation of odd order terms. Rooted in perturbation theory, the ANM approach promises to generally enable unbiased compound exploration campaigns at reduced computational cost.

Exploring chemical space with alchemical derivatives: alchemical transformations of H through Ar and their ions as a proof of concept

Alchemical derivatives have been used previously to obtain information about transformations in which the number of electrons is unchanged. Here an approach for combining changes in both the number of electrons and the nuclear charge is presented.