Interactive-quantum-chemical-descriptors enabling accurate prediction of an activation energy through machine learning

Graph to Activation Energy Models Easily Reach Irreducible Errors but Show Limited Transferability

Activation energy characterization of competing reactions is a costly but crucial step for understanding the kinetic relevance of distinct reaction pathways, product yields, and myriad other properties of reacting systems. The standard methodology for activation energy characterization has historically been a transition state search using the highest level of theory that can be afforded. However, recently, several groups have popularized the idea of predicting activation energies directly based on nothing more than the reactant and product graphs, a sufficiently complex neural network, and a broad enough data set. Here, we have revisited this task using the recently developed Reaction Graph Depth 1 (RGD1) transition state data set and several newly developed graph attention architectures. All of these new architectures achieve similar state-of-the-art results of ∼4 kcal/mol mean absolute error on withheld testing sets of reactions but poor performance on external testing sets composed of reactions with differing mechanisms, reaction molecularity, or reactant size distribution. Limited transferability is also shown to be shared by other contemporary graph to activation energy architectures through a series of case studies. We conclude that an array of standard graph architectures can already achieve results comparable to the irreducible error of available reaction data sets but that out-of-distribution performance remains poor.

Machine Learning Models for Predicting Zirconocene Properties and Barriers

Zr metallocenes have significant potential to be highly tunable polyethylene catalysts through modification of the aromatic ligand framework. Here we report the development of multiple machine learning models using a large library (>700 systems) of DFT-calculated zirconocene properties and barriers for ethylene polymerization. We show that very accurate machine learning models are possible for HOMO-LUMO gaps of precatalysts but the performance significantly depends on the machine learning algorithm and type of featurization, such as fingerprints, Coulomb matrices, smooth overlap of atomic positions, or persistence images. Surprisingly, the description of the bonding hapticity, the number of direct connections between Zr and the ligand aromatic carbons, only has a moderate influence on the performance of most models. Despite robust models for HOMO-LUMO gaps, these types of machine learning models based on structure connectivity type features perform poorly in predicting ethylene migratory insertion barrier heights. Therefore, we developed several relatively robust and accurate machine learning models for barrier heights that are based on quantum-chemical descriptors (QCDs). The quantitative accuracy of these models depends on which potential energy surface structure QCDs were harvested from. This revealed a Hammett-type principle to naturally emerge showing that QCDs from the π-coordination complexes provide much better descriptions of the transition states than other potential-energy structures. Feature importance analysis of the QCDs provides several fundamental principles that influence zirconocene catalyst reactivity.

%VBur index and steric maps: from predictive catalysis to machine learning

Steric indices are parameters used in chemistry to describe the spatial arrangement of atoms or groups of atoms in molecules. They are important in determining the reactivity, stability, and physical properties of chemical compounds. One commonly used steric index is the steric hindrance, which refers to the obstruction or hindrance of movement in a molecule caused by bulky substituents or functional groups. Steric hindrance can affect the reactivity of a molecule by altering the accessibility of its reactive sites and influencing the geometry of its transition states. Notably, the Tolman cone angle and %VBur are prominent among these indices. Actually, steric effects can also be described using the concept of steric bulk, which refers to the space occupied by a molecule or functional group. Steric bulk can affect the solubility, melting point, boiling point, and viscosity of a substance. Even though electronic indices are more widely used, they have certain drawbacks that might shift preferences towards others. They present a higher computational cost, and often, the weight of electronics in correlation with chemical properties, e.g. binding energies, falls short in comparison to %VBur. However, it is worth noting that this may be because the steric index inherently captures part of the electronic content. Overall, steric indices play an important role in understanding the behaviour of chemical compounds and can be used to predict their reactivity, stability, and physical properties. Predictive chemistry is an approach to chemical research that uses computational methods to anticipate the properties and behaviour of these compounds and reactions, facilitating the design of new compounds and reactivities. Within this domain, predictive catalysis specifically targets the prediction of the performance and behaviour of catalysts. Ultimately, the goal is to identify new catalysts with optimal properties, leading to chemical processes that are both more efficient and sustainable. In this framework, %VBur can be a key metric for deepening our understanding of catalysis, emphasizing predictive catalysis and sustainability. Those latter concepts are needed to direct our efforts toward identifying the optimal catalyst for any reaction, minimizing waste, and reducing experimental efforts while maximizing the efficacy of the computational methods.

Improving Accuracy and Transferability of Machine Learning Chemical Activation Energies by Adding Electronic Structure Information

Predicting chemical activation energies is one of the longstanding and important challenges in computational chemistry. Recent advances have shown that machine learning can be used to create tools to predict them. Such tools can significantly decrease the computational cost for these predictions compared to traditional methods, which require an optimal path search along a high-dimensional potential energy surface. To enable this new route, we need both large and accurate datasets and a compact yet complete description of the reactions. Although data for chemical reactions is becoming increasingly available, the key step of encoding the reaction as an efficient descriptor remains a big challenge. In this paper, we demonstrate that including electronic energy levels in the description of the reaction significantly improves the prediction accuracy and transferability. Feature importance analysis further demonstrates that electronic energy levels have a higher importance than some structural information and typically require less space in the reaction encoding vector. In general, we observe that the results of the feature importance analysis relate well to the domain knowledge of fundamental chemical principles. This work can help to build better chemical reaction encodings for machine learning and thus improve the predictions of machine learning models for reaction activation energies. These models could ultimately be used to recognize reaction limiting steps in large reaction systems, allowing to account for bottlenecks at the design stage.

Graph-Driven Reaction Discovery: Progress, Challenges, and Future Opportunities

Graph-based descriptors, such as bond-order matrices and adjacency matrices, offer a simple and compact way of categorizing molecular structures; furthermore, such descriptors can be readily used to catalog chemical reactions (i.e., bond-making and -breaking). As such, a number of graph-based methodologies have been developed with the goal of automating the process of generating chemical reaction network models describing the possible mechanistic chemistry in a given set of reactant species. Here, we outline the evolution of these graph-based reaction discovery schemes, with particular emphasis on more recent methods incorporating graph-based methods with semiempirical and ab initio electronic structure calculations, minimum-energy path refinements, and transition state searches. Using representative examples from homogeneous catalysis and interstellar chemistry, we highlight how these schemes increasingly act as "virtual reaction vessels" for interrogating mechanistic questions. Finally, we highlight where challenges remain, including issues of chemical accuracy and calculation speeds, as well as the inherent challenge of dealing with the vast size of accessible chemical reaction space.

Machine Learning for the Discovery, Design, and Engineering of Materials

Machine learning (ML) has become a part of the fabric of high-throughput screening and computational discovery of materials. Despite its increasingly central role, challenges remain in fully realizing the promise of ML. This is especially true for the practical acceleration of the engineering of robust materials and the development of design strategies that surpass trial and error or high-throughput screening alone. Depending on the quantity being predicted and the experimental data available, ML can either outperform physics-based modes, be used to accelerate such models, or be integrated with them to improve their performance. We cover recent advances in algorithms and in their application that are starting to make inroads toward (a) the discovery of new materials through large-scale enumerative screening, (b) the design of materials through identification of rules and principles that govern materials properties, and (c) the engineering of practical materials by satisfying multiple objectives. We conclude with opportunities for further advancement to realize ML as a widespread tool for practical computational materials design. Expected final online publication date for the Annual Review of Chemical and Biomolecular Engineering, Volume 13 is October 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Machine learning and semi-empirical calculations: a synergistic approach to rapid, accurate, and mechanism-based reaction barrier prediction

A synergistic approach that combines machine learning with semi-empirical methods enables the fast and accurate prediction of DFT-quality reaction barriers, with mechanistic insights available from semi-empirical transition state geometries.

Deciphering Cryptic Behavior in Bimetallic Transition-Metal Complexes with Machine Learning

We demonstrate an alternative, data-driven approach to uncovering structure-property relationships for the rational design of heterobimetallic transition-metal complexes that exhibit metal-metal bonding. We tailor graph-based representations of the metal-local environment for these complexes for use in multiple linear regression and kernel ridge regression (KRR) models. We curate a set of 28 experimentally characterized complexes to develop a multiple linear regression model for oxidation potentials. We achieve good accuracy (mean absolute error of 0.25 V) and preserve transferability to unseen experimental data with a new ligand structure. We also train a KRR model on a subset of 330 structurally characterized heterobimetallics to predict the degree of metal-metal bonding. This KRR model predicts relative metal-metal bond lengths in the test set to within 5%, and analysis of key features reveals the fundamental atomic contributions (e.g., the valence electron configuration) that most strongly influence the behavior of these complexes. Our work provides guidance for rational bimetallic design, suggesting that properties, including the formal shortness ratio, should be transferable from one period to another.

Computational Discovery of Transition-metal Complexes: From High-throughput Screening to Machine Learning

Transition-metal complexes are attractive targets for the design of catalysts and functional materials. The behavior of the metal-organic bond, while very tunable for achieving target properties, is challenging to predict and necessitates searching a wide and complex space to identify needles in haystacks for target applications. This review will focus on the techniques that make high-throughput search of transition-metal chemical space feasible for the discovery of complexes with desirable properties. The review will cover the development, promise, and limitations of "traditional" computational chemistry (i.e., force field, semiempirical, and density functional theory methods) as it pertains to data generation for inorganic molecular discovery. The review will also discuss the opportunities and limitations in leveraging experimental data sources. We will focus on how advances in statistical modeling, artificial intelligence, multiobjective optimization, and automation accelerate discovery of lead compounds and design rules. The overall objective of this review is to showcase how bringing together advances from diverse areas of computational chemistry and computer science have enabled the rapid uncovering of structure-property relationships in transition-metal chemistry. We aim to highlight how unique considerations in motifs of metal-organic bonding (e.g., variable spin and oxidation state, and bonding strength/nature) set them and their discovery apart from more commonly considered organic molecules. We will also highlight how uncertainty and relative data scarcity in transition-metal chemistry motivate specific developments in machine learning representations, model training, and in computational chemistry. Finally, we will conclude with an outlook of areas of opportunity for the accelerated discovery of transition-metal complexes.

Hydrogen Evolution Prediction for Alternating Conjugated Copolymers Enabled by Machine Learning with Multidimension Fragmentation Descriptors

Hydrogen evolution by alternating conjugated copolymers has attracted much attention in recent years. To study alternating copolymers with data-driven strategies, two types of multidimension fragmentation descriptors (MDFD), structure-based MDFD (SMDFD), and electronic property-based MDFD (EPMDFD), have been developed with machine learning (ML) algorithms for the first time. The superiority of SMDFD-based models has been demonstrated by the highly accurate and universal predictions of electronic properties. Moreover, EPMDFD-based, experimental-parameter-free ML models were developed for the prediction of the hydrogen evolution reaction, displaying excellent accuracy (real-test accuracy = 0.91). The combination of explainable ML approaches and first-principles calculations was employed to explore photocatalytic dynamics, revealing the importance of electron delocalization in the excited state. Virtual designing of high-performance candidates can also be achieved. Our work illustrates the huge potential of ML-based material design in the field of polymeric photocatalysts toward high-performance photocatalysis.