Construction of High Accuracy Machine Learning Interatomic Potential for Surface/Interface of Nanomaterials-A Review

The inherent discontinuity and unique dimensional attributes of nanomaterial surfaces and interfaces bestow them with various exceptional properties. These properties, however, also introduce difficulties for both experimental and computational studies. The advent of machine learning interatomic potential (MLIP) addresses some of the limitations associated with empirical force fields, presenting a valuable avenue for accurate simulations of these surfaces/interfaces of nanomaterials. Central to this approach is the idea of capturing the relationship between system configuration and potential energy, leveraging the proficiency of machine learning (ML) to precisely approximate high-dimensional functions. This review offers an in-depth examination of MLIP principles and their execution and elaborates on their applications in the realm of nanomaterial surface and interface systems. The prevailing challenges faced by this potent methodology are also discussed.

Thermal transport across TiO2-H2O interface involving water dissociation: Ab initio-assisted deep potential molecular dynamics

Water dissociation on TiO2 surfaces has been known for decades and holds great potential in various applications, many of which require a proper understanding of thermal transport across the TiO2-H2O interface. Molecular dynamics (MD) simulations play an important role in characterizing complex systems' interfacial thermal transport properties. Nevertheless, due to the imprecision of empirical force field potentials, the interfacial thermal transport mechanism involving water dissociation remains to be determined. To cope with this, a deep potential (DP) model is formulated through the utilization of ab initio datasets. This model successfully simulates interfacial thermal transport accompanied by water dissociation on the TiO2 surfaces. The trained DP achieves a total energy accuracy of ∼238.8 meV and a force accuracy of ∼197.05 meV/Å. The DPMD simulations show that water dissociation induces the formation of hydrogen bonding networks and molecular bridges. Structural modifications further affect interfacial thermal transport. The interfacial thermal conductance estimated by DP is ∼8.54 × 109 W/m2 K, smaller than ∼13.17 × 109 W/m2 K by empirical potentials. The vibrational density of states (VDOS) quantifies the differences between the DP model and empirical potentials. Notably, the VDOS disparity between the adsorbed hydrogen atoms and normal hydrogen atoms demonstrates the influence of water dissociation on heat transfer processes. This work aims to understand the effect of water dissociation on thermal transport at the TiO2-H2O interface. The findings will provide valuable guidance for the thermal management of photocatalytic devices.

Reducing the Cost of Neural Network Potential Generation for Reactive Molecular Systems

Although machine learning potentials have recently had a substantial impact on molecular simulations, the construction of a robust training set can still become a limiting factor, especially due to the requirement of a reference ab initio simulation that covers all the relevant geometries of the system. Recognizing that this can be prohibitive for certain systems, we develop the method of transition tube sampling that mitigates the computational cost of training set and model generation. In this approach, we generate classical or quantum thermal geometries around a transition path describing a conformational change or a chemical reaction using only a sparse set of local normal mode expansions along this path and select from these geometries by an active learning protocol. This yields a training set with geometries that characterize the whole transition without the need for a costly reference trajectory. The performance of the method is evaluated on different molecular systems with the complexity of the potential energy landscape increasing from a single minimum to a double proton-transfer reaction with high barriers. Our results show that the method leads to training sets that give rise to models applicable in classical and path integral simulations alike that are on par with those based directly on ab initio calculations while providing the computational speedup we have come to expect from machine learning potentials.

Neural Network with Optimal Neuron Activation Functions Based on Additive Gaussian Process Regression

Feed-forward neural networks (NNs) are a staple machine learning method widely used in many areas of science and technology, including physical chemistry, computational chemistry, and materials informatics. While even a single-hidden-layer NN is a universal approximator, its expressive power is limited by the use of simple neuron activation functions (such as sigmoid functions) that are typically the same for all neurons. More flexible neuron activation functions would allow the use of fewer neurons and layers and thereby save computational cost and improve expressive power. We show that additive Gaussian process regression (GPR) can be used to construct optimal neuron activation functions that are individual to each neuron. An approach is also introduced that avoids nonlinear fitting of neural network parameters by defining them with rules. The resulting method combines the advantage of robustness of a linear regression with the higher expressive power of an NN. We demonstrate the approach by fitting the potential energy surfaces of the water molecule and formaldehyde. Without requiring any nonlinear optimization, the additive-GPR-based approach outperforms a conventional NN in the high-accuracy regime, where a conventional NN suffers more from overfitting.

Thermodynamic and kinetic modeling of electrocatalytic reactions using a first-principles approach

The computational modeling of electrochemical interfaces and their applications in electrocatalysis has attracted great attention in recent years. While tremendous progress has been made in this area, however, the accurate atomistic descriptions at the electrode/electrolyte interfaces remain a great challenge. The Computational Hydrogen Electrode (CHE) method and continuum modeling of the solvent and electrolyte interactions form the basis for most of these methodological developments. Several posterior corrections have been added to the CHE method to improve its accuracy and widen its applications. The most recently developed grand canonical potential approaches with the embedded diffuse layer models have shown considerable improvement in defining interfacial interactions at electrode/electrolyte interfaces over the state-of-the-art computational models for electrocatalysis. In this Review, we present an overview of these different computational models developed over the years to quantitatively probe the thermodynamics and kinetics of electrochemical reactions in the presence of an electrified catalyst surface under various electrochemical environments. We begin our discussion by giving a brief picture of the different continuum solvation approaches, implemented within the ab initio method to effectively model the solvent and electrolyte interactions. Next, we present the thermodynamic and kinetic modeling approaches to determine the activity and stability of the electrocatalysts. A few applications to these approaches are also discussed. We conclude by giving an outlook on the different machine learning models that have been integrated with the thermodynamic approaches to improve their efficiency and widen their applicability.

Accelerating explicit solvent models of heterogeneous catalysts with machine learning interatomic potentials

Realistically modelling how solvents affect catalytic reactions is a longstanding challenge due to its prohibitive computational cost. Typically, an explicit atomistic treatment of the solvent molecules is needed together with molecular dynamics (MD) simulations and enhanced sampling methods. Here, we demonstrate the utility of machine learning interatomic potentials (MLIPs), coupled with active learning, to enable fast and accurate explicit solvent modelling of adsorption and reactions on heterogeneous catalysts. MLIPs trained on-the-fly were able to accelerate ab initio MD simulations by up to 4 orders of magnitude while reproducing with high fidelity the geometrical features of water in the bulk and at metal-water interfaces. Using these ML-accelerated simulations, we accurately predicted key catalytic quantities such as the adsorption energies of CO*, OH*, COH*, HCO*, and OCCHO* on Cu surfaces and the free energy barriers of C-H scission of ethylene glycol over Cu and Pd surfaces, as validated with ab initio calculations. We envision that such simulations will pave the way towards detailed and realistic studies of solvated catalysts at large time- and length-scales.

Comparing Ab Initio Molecular Dynamics and a Semiclassical Grand Canonical Scheme for the Electric Double Layer of the Pt(111)/Water Interface

The theoretical modeling of metal/water interfaces centers on an appropriate configuration of the electric double layer (EDL) under grand canonical conditions. In principle, ab initio molecular dynamics (AIMD) simulations would be the appropriate choice for treating the competing water-water and water-metal interactions and explicitly considering the atomic and electronic degrees of freedom. However, this approach only allows simulations of relatively small canonical ensembles over a limited period (shorter than 100 ps). On the other hand, computationally efficient semiclassical approaches can treat the EDL model based on a grand canonical scheme by averaging the microscopic details. Thus, an improved description of the EDL can be obtained by combining AIMD simulations and semiclassical methods based on a grand canonical scheme. By taking the Pt(111)/water interface as an example, we compare these approaches in terms of the electric field, water configuration, and double-layer capacitance. Furthermore, we discuss how the combined merits of the approaches can contribute to advances in EDL theory.

Machine Learning Assisted Simulations of Electrochemical Interfaces: Recent Progress and Challenges

The electrochemical interface, where the adsorption of reactants and electrocatalytic reactions take place, has long been a focus of attention. Some of the important processes on it tend to possess relatively slow kinetic characteristics, which are usually beyond the scope of ab initio molecular dynamics. The newly emerging technique, machine learning methods, provides an alternative approach to achieve thousands of atoms and nanosecond time scale while ensuring precision and efficiency. In this Perspective, we summarize in detail the recent progress and achievements made by the introduction of machine learning to simulate electrochemical interfaces, and focus on the limitations of current machine learning models, such as accurate descriptions of long-range electrostatic interactions and the kinetics of the electrochemical reactions occurring at the interface. Finally, we further point out the future directions for machine learning to expand in the field of electrochemical interfaces.

Thermal transport across copper-water interfaces according to deep potential molecular dynamics

Nanoscale thermal transport at solid-liquid interfaces plays an essential role in many engineering fields. This work performs deep potential molecular dynamics (DPMD) simulations to investigate thermal transport across copper-water interfaces. Unlike traditional classical molecular dynamics (CMD) simulations, we independently train a deep learning potential (DLP) based on density functional theory (DFT) calculations and demonstrated its high computational efficiency and accuracy. The trained DLP predicts radial distribution functions (RDFs), vibrational densities of states (VDOS), density curves, and thermal conductivity of water confined in the nanochannel at a DFT accuracy. The thermal conductivity decreases slightly with an increase in the channel height, while the influence of the cross-sectional area is negligible. Moreover, the predicted interfacial thermal conductance (ITC) across the copper-water interface by DPMD is 2.505 × 10⁸ W m^-2 K^-1, the same order of magnitude as the CMD and experimental results but with a high computational accuracy. This work seeks to simulate the thermal transport properties of solid-liquid interfaces with DFT accuracy at large-system and long-time scales.

Data-Driven Machine Learning for Understanding Surface Structures of Heterogeneous Catalysts

The design of heterogeneous catalysts is necessarily surface-focused, generally achieved via optimization of adsorption energy and microkinetic modelling. A prerequisite is to ensure the adsorption energy is physically meaningful is the stable existence of the conceived active-site structure on the surface. The development of improved understanding of the catalyst surface, however, is challenging practically because of the complex nature of dynamic surface formation and evolution under in-situ reactions. We propose therefore data-driven machine-learning (ML) approaches as a solution. In this Minireview we summarize recent progress in using machine-learning to search and predict (meta)stable structures, assist operando simulation under reaction conditions and micro-environments, and critically analyze experimental characterization data. We conclude that ML will become the new norm to lower costs associated with discovery and design of optimal heterogeneous catalysts.

Insight into the solvent effects on ethanol oxidation on Ir(100)

Solvent effects have always been a non-negligible factor for aqueous catalytic reactions, though few studies have been devoted towards the molecular understanding and impact of solvent effects on catalysis. In this work, we investigated ethanol dehydrogenation and C-C bond cleavage over Ir(100) in an aqueous solution using density functional theory calculations with both the implicit and explicit solvent models and transition state theory-based kinetics simulations. The results show that solvent polarization assists the α- and β-dehydrogenation of ethanol on Ir(100) in the aqueous solution and hydrogen bonding also assists the ethanol β-dehydrogenation and C-C bond cleavage in CH₂CO. The hydrogen bond between the ethanol and water molecule hinders ethanol hydroxyl dehydrogenation while the CHCO⋯H2O hydrogen bond radically alters the adsorption configuration of CHCO, which leads to an increase in the C-C cleavage barrier by 2.5 fold. Furthermore, the solvent changes the reaction pathways significantly. In an aqueous solution, ethanol β-dehydrogenation on Ir(100) is the dominant ethanol dehydrogenation pathway and C-C bond cleavage occurs predominantly via CH₂CO species.

Liquid-Phase Effects on Adsorption Processes in Heterogeneous Catalysis

Aqueous solvation free energies of adsorption have recently been measured for phenol adsorption on Pt(111). Endergonic solvent effects of ∼1 eV suggest solvents dramatically influence a metal catalyst's activity with significant implications for the catalyst design. However, measurements are indirect and involve adsorption isotherm models, which potentially reduces the reliability of the extracted energy values. Computational, implicit solvation models predict exergonic solvation effects for phenol adsorption, failing to agree with measurements even qualitatively. In this study, an explicit, hybrid quantum mechanical/molecular mechanical approach for computing solvation free energies of adsorption is developed, solvation free energies of phenol adsorption are computed, and experimental data for solvation free energies of phenol adsorption are reanalyzed using multiple adsorption isotherm models. Explicit solvation calculations predict an endergonic solvation free energy for phenol adsorption that agrees well with measurements to within the experimental and force field uncertainties. Computed adsorption free energies of solvation of carbon monoxide, ethylene glycol, benzene, and phenol over the (111) facet of Pt and Cu suggest that liquid water destabilizes all adsorbed species, with the largest impact on the largest adsorbates.

Nanosecond solvation dynamics of the hematite/liquid water interface at hybrid DFT accuracy using committee neural network potentials

Metal oxide/water interfaces play an important role in biology, catalysis, energy storage and photocatalytic water splitting. The atomistic structure at these interfaces is often difficult to characterize by experimental techniques, whilst results from ab initio molecular dynamics simulations tend to be uncertain due to the limited length and time scales accessible. In this work, we train a committee neural network potential to simulate the hematite/water interface at the hybrid DFT level of theory to reach the nanosecond timescale and systems containing more than 3000 atoms. The NNP enables us to converge dynamical properties, not possible with brute-force ab initio molecular dynamics. Our simulations uncover a rich solvation dynamics at the hematite/water interface spanning three different time scales: picosecond H-bond dynamics between surface hydroxyls and the first water layer, in-plane/out-of-plane tilt motion of surface hydroxyls on the 10 ps time scale, and diffusion of water molecules from the oxide surface characterized by a mean residence lifetime of about 60 ps. Calculation of vibrational spectra confirm that H-bonds between surface hydroxyls and first layer water molecules are stronger than H-bonds in bulk water. Our study showcases how state of the art machine learning approaches can routinely be utilized to explore the structural dynamics at transition metal oxide interfaces with complex electronic structure. It foreshadows that c-NNPs are a promising tool to tackle the sampling problem in ab initio electrochemistry with explicit solvent molecules.

Structure and energetics of liquid water-hydroxyl layers on Pt(111)

The interactions between liquid water and hydroxyl species on Pt(111) surfaces have been intensely investigated due to their importance to fuel cell electrocatalysis. Here we present a molecular dynamics study of their structure and energetics using an ensemble of neural network potentials, which allow us to obtain unprecedented statistical sampling. We first study the energetics of hydroxyl formation, where we find a near-linear adsorption energy profile, which exhibits a soft and gradual increase in the differential adsorption energy at high hydroxyl coverages. This is strikingly different from the predictions of the conventional bilayer model, which displays a kink at 1/3ML OH coverage indicating a sizeable jump in differential adsorption energy, but within the statistical uncertainty of previously reported ab initio molecular dynamics studies. We then analyze the structure of the interface, where we provide evidence for the water-OH/Pt(111) interface being hydrophobic at high hydroxyl coverages. We furthermore explain the observed adsorption energetics by analyzing the hydrogen bonding in the water-hydroxyl adlayers, where we argue that the increase in differential adsorption energy at high OH coverage can be explained by a reduction in the number of hydrogen bonds from the adsorbed water molecules to the hydroxyls.

Assessing the persistence of chalcogen bonds in solution with neural network potentials

Non-covalent bonding patterns are commonly harvested as a design principle in the field of catalysis, supramolecular chemistry and functional materials to name a few. Yet, their computational description generally neglects finite temperature and environment effects, which promote competing interactions and alter their static gas-phase properties. Recently, neural network potentials (NNPs) trained on Density Functional Theory (DFT) data have become increasingly popular to simulate molecular phenomena in condensed phase with an accuracy comparable to ab initio methods. To date, most applications have centered on solid-state materials or fairly simple molecules made of a limited number of elements. Herein, we focus on the persistence and strength of chalcogen bonds involving a benzotelluradiazole in condensed phase. While the tellurium-containing heteroaromatic molecules are known to exhibit pronounced interactions with anions and lone pairs of different atoms, the relevance of competing intermolecular interactions, notably with the solvent, is complicated to monitor experimentally but also challenging to model at an accurate electronic structure level. Here, we train direct and baselined NNPs to reproduce hybrid DFT energies and forces in order to identify what are the most prevalent non-covalent interactions occurring in a solute-Cl$^-$-THF mixture. The simulations in explicit solvent highlight competition with chalcogen bonds formed with the solvent and the short-range directionality of the interaction with direct consequences for the molecular properties in the solution. The comparison with other potentials (e.g., AMOEBA, direct NNP and continuum solvent model) also demonstrates that baselined NNPs offer a reliable picture of the non-covalent interaction interplay occurring in solution.

Theoretical Modeling of Electrochemical Proton-Coupled Electron Transfer

Proton-coupled electron transfer (PCET) plays an essential role in a wide range of electrocatalytic processes. A vast array of theoretical and computational methods have been developed to study electrochemical PCET. These methods can be used to calculate redox potentials and pK_a values for molecular electrocatalysts, proton-coupled redox potentials and bond dissociation free energies for PCET at metal and semiconductor interfaces, and reorganization energies associated with electrochemical PCET. Periodic density functional theory can also be used to compute PCET activation energies and perform molecular dynamics simulations of electrochemical interfaces. Various approaches for maintaining a constant electrode potential in electronic structure calculations and modeling complex interactions in the electric double layer (EDL) have been developed. Theoretical formulations for both homogeneous and heterogeneous electrochemical PCET spanning the adiabatic, nonadiabatic, and solvent-controlled regimes have been developed and provide analytical expressions for the rate constants and current densities as functions of applied potential. The quantum mechanical treatment of the proton and inclusion of excited vibronic states have been shown to be critical for describing experimental data, such as Tafel slopes and potential-dependent kinetic isotope effects. The calculated rate constants can be used as input to microkinetic models and voltammogram simulations to elucidate complex electrocatalytic processes.

Machine Learning-Assisted Discovery of Hidden States in Expanded Free Energy Space

Collective variables (CVs) are crucial parameters in enhanced sampling calculations and strongly impact the quality of the obtained free energy surface. However, many existing CVs are unique to and dependent on the system they are constructed with, making the developed CV non-transferable to other systems. Herein, we develop a non-instructor-led deep autoencoder neural network (DAENN) for discovering general-purpose CVs. The DAENN is used to train a model by learning molecular representations upon unbiased trajectories that contain only the reactant conformers. The prior knowledge of nonconstraint reactants coupled with the here-introduced topology variable and loss-like penalty function are only required to make the biasing method able to expand its configurational (phase) space to unexplored energy basins. Our developed autoencoder is efficient and relatively inexpensive to use in terms of a priori knowledge, enabling one to automatically search for hidden CVs of the reaction of interest.

Theories for Electrolyte Effects in CO2 Electroreduction

Electrochemical CO₂ reduction (eCO₂R) enables the conversion of waste CO₂ to high-value fuels and commodity chemicals powered by renewable electricity, thereby offering a viable strategy for reaching the goal of net-zero carbon emissions. Research in the past few decades has focused both on the optimization of the catalyst (electrode) and the electrolyte environment. Surface-area normalized current densities show that the latter can affect the CO₂ reduction activity by up to a few orders of magnitude.In this Account, we review theories of the mechanisms behind the effects of the electrolyte (cations, anions, and the electrolyte pH) on eCO₂R. As summarized in the conspectus graphic, the electrolyte influences eCO₂R activity via a field (ε) effect on dipolar (μ) reaction intermediates, changing the proton donor for the multi-step proton-electron transfer reaction, specifically adsorbed anions on the catalyst surface to block active sites, and tuning the local environment by homogeneous reactions. To be specific, alkali metal cations (M⁺) can stabilize reaction intermediates via electrostatic interactions with dipolar intermediates or buffer the interfacial pH via hydrolysis reactions, thereby promoting the eCO₂R activity with the following trend in hydrated size (corresponding to the local field strength ε)/hydrolysis ability: Cs⁺ > K⁺ > Na⁺ > Li⁺. The effect of the electrolyte pH can give a change in eCO₂R activity of up to several orders of magnitude, arising from linearly shifting the absolute interfacial field via the relationship U_SHE = U_RHE - (2.3k_BT)pH, homogeneous reactions between OH^- and desorbed intermediates, or changing the proton donor from hydronium to water along with increasing pH. Anions have been suggested to affect the eCO₂R reaction process by solution-phase reactions (e.g., buffer reactions to tune local pH), acting as proton donors or as a surface poison.So far, the existing models of electrolyte effects have been used to rationalize various experimentally observed trends, having yet to demonstrate general predictive capabilities. The major challenges in our understanding of the electrolyte effect in eCO₂R are (i) the long time scale associated with a dynamic ab initio picture of the catalyst|electrolyte interface and (ii) the overall activity determined by the length-scale interplay of intrinsic microkinetics, homogeneous reactions, and mass transport limitations. New developments in ab initio dynamic models and coupling the effects of mass transport can provide a more accurate view of the structure and intrinsic functions of the electrode-electrolyte interface and the corresponding reaction energetics toward comprehensive and predictive models for electrolyte design.

Ab Initio Simulations of Water/Metal Interfaces

Structures and processes at water/metal interfaces play an important technological role in electrochemical energy conversion and storage, photoconversion, sensors, and corrosion, just to name a few. However, they are also of fundamental significance as a model system for the study of solid-liquid interfaces, which requires combining concepts from the chemistry and physics of crystalline materials and liquids. Particularly interesting is the fact that the water-water and water-metal interactions are of similar strength so that the structures at water/metal interfaces result from a competition between these comparable interactions. Because water is a polar molecule and water and metal surfaces are both polarizable, explicit consideration of the electronic degrees of freedom at water/metal interfaces is mandatory. In principle, ab initio molecular dynamics simulations are thus the method of choice to model water/metal interfaces, but they are computationally still rather demanding. Here, ab initio simulations of water/metal interfaces will be reviewed, starting from static systems such as the adsorption of single water molecules, water clusters, and icelike layers, followed by the properties of liquid water layers at metal surfaces. Technical issues such as the appropriate first-principles description of the water-water and water-metal interactions will be discussed, and electrochemical aspects will be addressed. Finally, more approximate but numerically less demanding approaches to treat water at metal surfaces from first-principles will be briefly discussed.

Insights into lithium manganese oxide-water interfaces using machine learning potentials

Unraveling the atomistic and the electronic structure of solid-liquid interfaces is the key to the design of new materials for many important applications, from heterogeneous catalysis to battery technology. Density functional theory (DFT) calculations can, in principle, provide a reliable description of such interfaces, but the high computational costs severely restrict the accessible time and length scales. Here, we report machine learning-driven simulations of various interfaces between water and lithium manganese oxide (Li_xMn₂O₄), an important electrode material in lithium ion batteries and a catalyst for the oxygen evolution reaction. We employ a high-dimensional neural network potential to compute the energies and forces several orders of magnitude faster than DFT without loss in accuracy. In addition, a high-dimensional neural network for spin prediction is utilized to analyze the electronic structure of the manganese ions. Combining these methods, a series of interfaces is investigated by large-scale molecular dynamics. The simulations allow us to gain insights into a variety of properties, such as the dissociation of water molecules, proton transfer processes, and hydrogen bonds, as well as the geometric and electronic structure of the solid surfaces, including the manganese oxidation state distribution, Jahn-Teller distortions, and electron hopping.

Dynamics of Heterogeneous Catalytic Processes at Operando Conditions

The rational design of high-performance catalysts is hindered by the lack of knowledge of the structures of active sites and the reaction pathways under reaction conditions, which can be ideally addressed by an in situ/operando characterization. Besides the experimental insights, a theoretical investigation that simulates reaction conditions-so-called operando modeling-is necessary for a plausible understanding of a working catalyst system at the atomic scale. However, there is still a huge gap between the current widely used computational model and the concept of operando modeling, which should be achieved through multiscale computational modeling. This Perspective describes various modeling approaches and machine learning techniques that step toward operando modeling, followed by selected experimental examples that present an operando understanding in the thermo- and electrocatalytic processes. At last, the remaining challenges in this area are outlined.

Accurate prediction of grain boundary structures and energetics in CdTe: a machine-learning potential approach

To accurately predict grain boundary (GB) atomic structures and their energetics in CdTe, the present study constructs an artificial-neural-network (ANN) interatomic potential. To cover a wide range of atomic environments, large amounts of density functional theory (DFT) data are used as a training dataset including point defects, surfaces and GBs. Structural relaxation combined with the trained ANN potential is applied to symmetric tilt and twist GBs, many of which are not included in the training dataset. The relative stability of the relaxed structures and their GB energies are then evaluated with the DFT level. The ANN potential is found to accurately predict low-energy structures and their energetics with reasonable accuracy with respect to DFT results, while conventional empirical potentials critically fail to find low-energy structures. The present study also provides a way to further improve the transferability of the ANN potential to more complicated GBs, using only low-Σ GBs as training datasets. Such improvement will offer a way to accurately predict atomic structures of general GBs within practical computational cost.

Implicit Solvation Methods for Catalysis at Electrified Interfaces

Implicit solvation is an effective, highly coarse-grained approach in atomic-scale simulations to account for a surrounding liquid electrolyte on the level of a continuous polarizable medium. Originating in molecular chemistry with finite solutes, implicit solvation techniques are now increasingly used in the context of first-principles modeling of electrochemistry and electrocatalysis at extended (often metallic) electrodes. The prevalent ansatz to model the latter electrodes and the reactive surface chemistry at them through slabs in periodic boundary condition supercells brings its specific challenges. Foremost this concerns the difficulty of describing the entire double layer forming at the electrified solid–liquid interface (SLI) within supercell sizes tractable by commonly employed density functional theory (DFT). We review liquid solvation methodology from this specific application angle, highlighting in particular its use in the widespread ab initio thermodynamics approach to surface catalysis. Notably, implicit solvation can be employed to mimic a polarization of the electrode’s electronic density under the applied potential and the concomitant capacitive charging of the entire double layer beyond the limitations of the employed DFT supercell. Most critical for continuing advances of this effective methodology for the SLI context is the lack of pertinent (experimental or high-level theoretical) reference data needed for parametrization.

Is the water/Pt(111) interface ordered at room temperature?

The structure of the water/Pt(111) interface has been a subject of debate over the past decades. Here, we report the results of a room temperature molecular dynamics study based on neural network potentials, which allow us to access long time scale simulations while retaining ab initio accuracy. We find that the water/Pt(111) interface is characterized by a double layer composed of a primary, strongly bound adsorption layer with a coverage of ∼0.15 ML, which is coupled to a secondary, weakly bound adsorption layer with a coverage of ∼0.58 ML. By studying the order of the primary adsorption layer, we find that there is an effective repulsion between the adsorbed water molecules, which gives rise to a dynamically changing, semi-ordered interfacial structure, where the water molecules in the primary adsorption layer are distributed homogeneously across the interface, forming frequent hydrogen bonds to water molecules in the secondary adsorption layer. We further show that these conclusions are beyond the time scales accessible to ab initio molecular dynamics.

Static and dynamic water structures at interfaces: A case study with focus on Pt(111)

An accurate atomistic treatment of aqueous solid-liquid interfaces necessitates the explicit description of interfacial water ideally via ab initio molecular dynamics simulations. Many applications, however, still rely on static interfacial water models, e.g., for the computation of (electro)chemical reaction barriers and focus on a single, prototypical structure. In this work, we systematically study the relation between density functional theory-derived static and dynamic interfacial water models with specific focus on the water-Pt(111) interface. We first introduce a general construction protocol for static 2D water layers on any substrate, which we apply to the low index surfaces of Pt. Subsequently, we compare these with structures from a broad selection of reference works based on the Smooth Overlap of Atomic Positions descriptor. The analysis reveals some structural overlap between static and dynamic water ensembles; however, static structures tend to overemphasize the in-plane hydrogen bonding network. This feature is especially pronounced for the widely used low-temperature hexagonal ice-like structure. In addition, a complex relation between structure, work function, and adsorption energy is observed, which suggests that the concentration on single, static water models might introduce systematic biases that are likely reduced by averaging over consistently created structural ensembles, as introduced here.

Learning intermolecular forces at liquid-vapor interfaces

By adopting a perspective informed by contemporary liquid-state theory, we consider how to train an artificial neural network potential to describe inhomogeneous, disordered systems. We find that neural network potentials based on local representations of atomic environments are capable of describing some properties of liquid-vapor interfaces but typically fail for properties that depend on unbalanced long-ranged interactions that build up in the presence of broken translation symmetry. These same interactions cancel in the translationally invariant bulk, allowing local neural network potentials to describe bulk properties correctly. By incorporating explicit models of the slowly varying long-ranged interactions and training neural networks only on the short-ranged components, we can arrive at potentials that robustly recover interfacial properties. We find that local neural network models can sometimes approximate a local molecular field potential to correct for the truncated interactions, but this behavior is variable and hard to learn. Generally, we find that models with explicit electrostatics are easier to train and have higher accuracy. We demonstrate this perspective in a simple model of an asymmetric dipolar fluid, where the exact long-ranged interaction is known, and in an ab initio water model, where it is approximated.

Transferable Gaussian Attractive Potentials for Organic/Oxide Interfaces

Organic/oxide interfaces play an important role in many areas of chemistry and in particular for lubrication and corrosion. Molecular dynamics simulations are the method of choice for providing complementary insight to experiments. However, the force fields used to simulate the interaction between molecules and oxide surfaces tend to capture only weak physisorption interactions, discarding the stabilizing Lewis acid/base interactions. We here propose a simple complement to the straightforward molecular mechanics description based on "out-of-the-box" Lennard-Jones potentials and electrostatic interactions: the addition of an attractive Gaussian potential between reactive sites of the surface and heteroatoms of adsorbed organic molecules, leading to the Gaussian Lennard-Jones (GLJ) potential. The interactions of four oxygenated and four amine molecules with the typical and widespread hematite and γ-alumina surfaces are investigated. The root mean square deviation (RMSD) for all probed molecules is only 5.7 kcal/mol, which corresponds to an error of 23% over hematite. On γ-alumina, the RMSD is 11.2 kcal/mol using a single parameter for all five chemically inequivalent surface aluminum atoms. Applying GLJ to the simulation of organic films on oxide surfaces demonstrates that the mobility of the surfactants is overestimated by the simplistic LJ potential, while GLJ and other qualitatively correct potentials show a strong structuration and slow dynamics of the surface films, as could be expected from the first-principles adsorption energies for model head groups.

Recent Progress toward Ab Initio Modeling of Electrocatalysis

Electrode potential is the key factor for controlling electrocatalytic reactions at electrochemical interfaces, and moreover, it is also known that the pH and solutes (e.g., cations) of the solution have prominent effects on electrocatalysis. Understanding these effects requires microscopic information on the electrochemical interfaces, in which theoretical simulations can play an important role. This Perspective summarizes the recent progress in method development for modeling electrochemical interfaces, including different methods for describing the electrolytes at the interfaces and different schemes for charging up the electrode surfaces. In the final section, we provide an outlook for future development in modeling methods and their applications to electrocatalysis.

Machine learning potentials for complex aqueous systems made simple

Understanding complex materials, in particular those with solid–liquid interfaces, such as water on surfaces or under confinement, is a key challenge for technological and scientific progress. Although established simulation approaches have been able to provide important atomistic insight, ab initio techniques struggle with the required time and length scales, while force field methods can often be limited in terms of their accuracy. Here we show how these limitations can be overcome in a simple and automated machine learning procedure to provide accurate models of interactions at the ab initio level, as illustrated for a variety of complex aqueous systems. These developments open up the prospect of the straightforward exploration of many technologically relevant systems by molecular simulations.

Simulation techniques based on accurate and efficient representations of potential energy surfaces are urgently needed for the understanding of complex systems such as solid–liquid interfaces. Here we present a machine learning framework that enables the efficient development and validation of models for complex aqueous systems. Instead of trying to deliver a globally optimal machine learning potential, we propose to develop models applicable to specific thermodynamic state points in a simple and user-friendly process. After an initial ab initio simulation, a machine learning potential is constructed with minimum human effort through a data-driven active learning protocol. Such models can afterward be applied in exhaustive simulations to provide reliable answers for the scientific question at hand or to systematically explore the thermal performance of ab initio methods. We showcase this methodology on a diverse set of aqueous systems comprising bulk water with different ions in solution, water on a titanium dioxide surface, and water confined in nanotubes and between molybdenum disulfide sheets. Highlighting the accuracy of our approach with respect to the underlying ab initio reference, the resulting models are evaluated in detail with an automated validation protocol that includes structural and dynamical properties and the precision of the force prediction of the models. Finally, we demonstrate the capabilities of our approach for the description of water on the rutile titanium dioxide (110) surface to analyze the structure and mobility of water on this surface. Such machine learning models provide a straightforward and uncomplicated but accurate extension of simulation time and length scales for complex systems.

Differentiable sampling of molecular geometries with uncertainty-based adversarial attacks

Neural network (NN) interatomic potentials provide fast prediction of potential energy surfaces, closely matching the accuracy of the electronic structure methods used to produce the training data. However, NN predictions are only reliable within well-learned training domains, and show volatile behavior when extrapolating. Uncertainty quantification methods can flag atomic configurations for which prediction confidence is low, but arriving at such uncertain regions requires expensive sampling of the NN phase space, often using atomistic simulations. Here, we exploit automatic differentiation to drive atomistic systems towards high-likelihood, high-uncertainty configurations without the need for molecular dynamics simulations. By performing adversarial attacks on an uncertainty metric, informative geometries that expand the training domain of NNs are sampled. When combined with an active learning loop, this approach bootstraps and improves NN potentials while decreasing the number of calls to the ground truth method. This efficiency is demonstrated on sampling of kinetic barriers, collective variables in molecules, and supramolecular chemistry in zeolite-molecule interactions, and can be extended to any NN potential architecture and materials system.

Photoinduced Desorption Dynamics of CO from Pd(111): A Neural Network Approach

Modeling the ultrafast photoinduced dynamics and reactivity of adsorbates on metals requires including the effect of the laser-excited electrons and, in many cases, also the effect of the highly excited surface lattice. Although the recent ab initio molecular dynamics with electronic friction and thermostats, (T_e,T_l)-AIMDEF [AlducinM.;Phys. Rev. Lett.2019, 123, 246802]31922860, enables such complex modeling, its computational cost may limit its applicability. Here, we use the new embedded atom neural network (EANN) method [ZhangY.;J. Phys. Chem. Lett.2019, 10, 496231397157] to develop an accurate and extremely complex potential energy surface (PES) that allows us a detailed and reliable description of the photoinduced desorption of CO from the Pd(111) surface with a coverage of 0.75 monolayer. Molecular dynamics simulations performed on this EANN-PES reproduce the (T_e,T_l)-AIMDEF results with a remarkable level of accuracy. This demonstrates the outstanding performance of the obtained EANN-PES that is able to reproduce available density functional theory (DFT) data for an extensive range of surface temperatures (90–1000 K); a large number of degrees of freedom, those corresponding to six CO adsorbates and 24 moving surface atoms; and the varying CO coverage caused by the abundant desorption events.

Strategies for the construction of machine-learning potentials for accurate and efficient atomic-scale simulations

Recent advances in machine-learning interatomic potentials have enabled the efficient modeling of complex atomistic systems with an accuracy that is comparable to that of conventional quantum-mechanics based methods. At the same time, the construction of new machine-learning potentials can seem a daunting task, as it involves data-science techniques that are not yet common in chemistry and materials science. Here, we provide a tutorial-style overview of strategies and best practices for the construction of artificial neural network (ANN) potentials. We illustrate the most important aspects of (a) data collection, (b) model selection, (c) training and validation, and (d) testing and refinement of ANN potentials on the basis of practical examples. Current research in the areas of active learning and delta learning are also discussed in the context of ANN potentials. This tutorial review aims at equipping computational chemists and materials scientists with the required background knowledge for ANN potential construction and application, with the intention to accelerate the adoption of the method, so that it can facilitate exciting research that would otherwise be challenging with conventional strategies.

Phase Diagram of a Deep Potential Water Model

Using the Deep Potential methodology, we construct a model that reproduces accurately the potential energy surface of the SCAN approximation of density functional theory for water, from low temperature and pressure to about 2400 K and 50 GPa, excluding the vapor stability region. The computational efficiency of the model makes it possible to predict its phase diagram using molecular dynamics. Satisfactory overall agreement with experimental results is obtained. The fluid phases, molecular and ionic, and all the stable ice polymorphs, ordered and disordered, are predicted correctly, with the exception of ice III and XV that are stable in experiments, but metastable in the model. The evolution of the atomic dynamics upon heating, as ice VII transforms first into ice VII^{''} and then into an ionic fluid, reveals that molecular dissociation and breaking of the ice rules coexist with strong covalent fluctuations, explaining why only partial ionization was inferred in experiments.

Controlling potential difference between electrodes based on self-consistent-charge density functional tight binding

A proper understanding and description of the electronic response of the electrode surfaces in electrochemical systems are quite important because the interactions between the electrode surface and electrolyte give rise to unique and useful interfacial properties. Atomistic modeling of the electrodes requires not only an accurate description of the electronic response under a constant-potential condition but also computational efficiency in order to deal with systems large enough to investigate the interfacial electrolyte structures. We thus develop a self-consistent-charge density functional tight binding based method to model a pair of electrodes in electrochemical cells under the constant-potential condition. The method is more efficient than the (ab initio) density functional theory calculations so that it can treat systems as large as those studied in classical atomistic simulations. It can also describe the electronic response of electrodes quantum mechanically and more accurately than the classical counterparts. The constant-potential condition is introduced through a Legendre transformation of the electronic energy with respect to the difference in the number of electrons in the two electrodes and their electrochemical potential difference, through which the Kohn-Sham equations for each electrode are variationally derived. The method is applied to platinum electrodes faced parallel to each other under an applied voltage. The electronic response to the voltage and a charged particle is compared with the result of a classical constant-potential method based on the chemical potential equalization principle.

Computational approaches to dissociative chemisorption on metals: towards chemical accuracy

We review the state-of-the-art in the theory of dissociative chemisorption (DC) of small gas phase molecules on metal surfaces, which is important to modeling heterogeneous catalysis for practical reasons, and for achieving an understanding of the wealth of experimental information that exists for this topic, for fundamental reasons. We first give a quick overview of the experimental state of the field. Turning to the theory, we address the challenge that barrier heights (E_b, which are not observables) for DC on metals cannot yet be calculated with chemical accuracy, although embedded correlated wave function theory and diffusion Monte-Carlo are moving in this direction. For benchmarking, at present chemically accurate E_b can only be derived from dynamics calculations based on a semi-empirically derived density functional (DF), by computing a sticking curve and demonstrating that it is shifted from the curve measured in a supersonic beam experiment by no more than 1 kcal mol^-1. The approach capable of delivering this accuracy is called the specific reaction parameter (SRP) approach to density functional theory (DFT). SRP-DFT relies on DFT and on dynamics calculations, which are most efficiently performed if a potential energy surface (PES) is available. We therefore present a brief review of the DFs that now exist, also considering their performance on databases for E_b for gas phase reactions and DC on metals, and for adsorption to metals. We also consider expressions for SRP-DFs and briefly discuss other electronic structure methods that have addressed the interaction of molecules with metal surfaces. An overview is presented of dynamical models, which make a distinction as to whether or not, and which dissipative channels are modeled, the dissipative channels being surface phonons and electronically non-adiabatic channels such as electron-hole pair excitation. We also discuss the dynamical methods that have been used, such as the quasi-classical trajectory method and quantum dynamical methods like the time-dependent wave packet method and the reaction path Hamiltonian method. Limits on the accuracy of these methods are discussed for DC of diatomic and polyatomic molecules on metal surfaces, paying particular attention to reduced dimensionality approximations that still have to be invoked in wave packet calculations on polyatomic molecules like CH₄. We also address the accuracy of fitting methods, such as recent machine learning methods (like neural network methods) and the corrugation reducing procedure. In discussing the calculation of observables we emphasize the importance of modeling the properties of the supersonic beams in simulating the sticking probability curves measured in the associated experiments. We show that chemically accurate barrier heights have now been extracted for DC in 11 molecule-metal surface systems, some of which form the most accurate core of the only existing database of E_b for DC reactions on metal surfaces (SBH10). The SRP-DFs (or candidate SRP-DFs) that have been derived show transferability in many cases, i.e., they have been shown also to yield chemically accurate E_b for chemically related systems. This can in principle be exploited in simulating rates of catalyzed reactions on nano-particles containing facets and edges, as SRP-DFs may be transferable among systems in which a molecule dissociates on low index and stepped surfaces of the same metal. In many instances SRP-DFs have allowed important conclusions regarding the mechanisms underlying observed experimental trends. An important recent observation is that SRP-DFT based on semi-local exchange DFs has so far only been successful for systems for which the difference of the metal work function and the molecule's electron affinity exceeds 7 eV. A main challenge to SRP-DFT is to extend its applicability to the other systems, which involve a range of important DC reactions of e.g. O₂, H₂O, NH₃, CO₂, and CH₃OH. Recent calculations employing a PES based on a screened hybrid exchange functional suggest that the road to success may be based on using exchange functionals of this category.

Transferable Multilevel Attention Neural Network for Accurate Prediction of Quantum Chemistry Properties via Multitask Learning

The development of efficient models for predicting specific properties through machine learning is of great importance for the innovation of chemistry and material science. However, predicting global electronic structure properties like Frontier molecular orbital highest occupied molecular orbital (HOMO) and lowest unoccupied molecular orbital (LUMO) energy levels and their HOMO-LUMO gaps from the small-sized molecule data to larger molecules remains a challenge. Here, we develop a multilevel attention neural network, named DeepMoleNet, to enable chemical interpretable insights being fused into multitask learning through (1) weighting contributions from various atoms and (2) taking the atom-centered symmetry functions (ACSFs) as the teacher descriptor. The efficient prediction of 12 properties including dipole moment, HOMO, and Gibbs free energy within chemical accuracy is achieved by using multiple benchmarks, both at the equilibrium and nonequilibrium geometries, including up to 110,000 records of data in QM9, 400,000 records in MD17, and 280,000 records in ANI-1ccx for random split evaluation. The good transferability for predicting larger molecules outside the training set is demonstrated in both equilibrium QM9 and Alchemy data sets at the density functional theory (DFT) level. Additional tests on nonequilibrium molecular conformations from DFT-based MD17 data set and ANI-1ccx data set with coupled cluster accuracy as well as the public test sets of singlet fission molecules, biomolecules, long oligomers, and protein with up to 140 atoms show reasonable predictions for thermodynamics and electronic structure properties. The proposed multilevel attention neural network is applicable to high-throughput screening of numerous chemical species in both equilibrium and nonequilibrium molecular spaces to accelerate rational designs of drug-like molecules, material candidates, and chemical reactions.

Measuring transferability issues in machine-learning force fields: the example of gold–iron interactions with linearized potentials

Machine-learning force fields have been increasingly employed in order to extend the possibility of current first-principles calculations. However, the transferability of the obtained potential cannot always be guaranteed in situations that are outside the original database. To study such limitation, we examined the very difficult case of the interactions in gold–iron nanoparticles. For the machine-learning potential, we employed a linearized formulation that is parameterized using a penalizing regression scheme which allows us to control the complexity of the obtained potential. We showed that while having a more complex potential allows for a better agreement with the training database, it can also lead to overfitting issues and a lower accuracy in untrained systems.

Computational Methods in Heterogeneous Catalysis

The unprecedented ability of computations to probe atomic-level details of catalytic systems holds immense promise for the fundamentals-based bottom-up design of novel heterogeneous catalysts, which are at the heart of the chemical and energy sectors of industry. Here, we critically analyze recent advances in computational heterogeneous catalysis. First, we will survey the progress in electronic structure methods and atomistic catalyst models employed, which have enabled the catalysis community to build increasingly intricate, realistic, and accurate models of the active sites of supported transition-metal catalysts. We then review developments in microkinetic modeling, specifically mean-field microkinetic models and kinetic Monte Carlo simulations, which bridge the gap between nanoscale computational insights and macroscale experimental kinetics data with increasing fidelity. We finally review the advancements in theoretical methods for accelerating catalyst design and discovery. Throughout the review, we provide ample examples of applications, discuss remaining challenges, and provide our outlook for the near future.

Dependency of solvation effects on metal identity in surface reactions

Solvent interactions with adsorbed moieties involved in surface reactions are often believed to be similar for different metal surfaces. However, solvents alter the electronic structures of surface atoms, which in turn affects their interaction with adsorbed moieties. To reveal the importance of metal identity on aqueous solvent effects in heterogeneous catalysis, we studied solvent effects on the activation free energies of the O-H and C-H bond cleavages of ethylene glycol over the (111) facet of six transition metals (Ni, Pd, Pt, Cu, Ag, Au) using an explicit solvation approach based on a hybrid quantum mechanical/molecular mechanical (QM/MM) description of the potential energy surface. A significant metal dependence on aqueous solvation effects was observed that suggests solvation effects must be studied in detail for every reaction system. The main reason for this dependence could be traced back to a different amount of charge-transfer between the adsorbed moieties and metals in the reactant and transition states for the different metal surfaces.

Machine learning for condensed matter physics

Condensed matter physics (CMP) seeks to understand the microscopic interactions of matter at the quantum and atomistic levels, and describes how these interactions result in both mesoscopic and macroscopic properties. CMP overlaps with many other important branches of science, such as chemistry, materials science, statistical physics, and high-performance computing. With the advancements in modern machine learning (ML) technology, a keen interest in applying these algorithms to further CMP research has created a compelling new area of research at the intersection of both fields. In this review, we aim to explore the main areas within CMP, which have successfully applied ML techniques to further research, such as the description and use of ML schemes for potential energy surfaces, the characterization of topological phases of matter in lattice systems, the prediction of phase transitions in off-lattice and atomistic simulations, the interpretation of ML theories with physics-inspired frameworks and the enhancement of simulation methods with ML algorithms. We also discuss in detail the main challenges and drawbacks of using ML methods on CMP problems, as well as some perspectives for future developments.