How machine learning can assist the interpretation of ab initio molecular dynamics simulations and conceptual understanding of chemistry

An explainable machine learning-based probabilistic framework for the design of scaffolds in bone tissue engineering

Recently, 3D-printed biodegradable scaffolds have shown great potential for bone repair in critical-size fractures. The differentiation of the cells on a scaffold is impacted among other factors by the surface deformation of the scaffold due to mechanical loading and the wall shear stresses imposed by the interstitial fluid flow. These factors are in turn significantly affected by the material properties, the geometry of the scaffold, as well as the loading and flow conditions. In this work, a numerical framework is proposed to study the influence of these factors on the expected osteochondral cell differentiation. The considered scaffold is rectangular with a 0/90 lay-down pattern and a four-layered strut made of polylactic acid with a 5% steel particle content. The distribution of the different types of cells on the scaffold surface is estimated through a scalar stimulus, calculated by using a mechanobioregulatory model. To reduce the simulation time for the computation of the stimulus, a probabilistic machine learning (ML)-based reduced-order model (ROM) is proposed. Then, a sensitivity analysis is performed using the Shapley additive explanations to examine the contribution of the various parameters to the framework stimulus predictions. In a final step, a multiobjective optimization procedure is implemented using genetic algorithms and the ROM, aiming to identify the material parameters and loading conditions that maximize the percentage of surface area populated by bone cells while minimizing the area corresponding to the other types of cells and the resorption condition. The results of the performed analysis highlight the potential of using ROMs for the scaffold design, by dramatically reducing the simulation time while enabling the efficient implementation of sensitivity analysis and optimization procedures.

Machine-Learned Kohn-Sham Hamiltonian Mapping for Nonadiabatic Molecular Dynamics

In this work, we report a simple, efficient, and scalable machine-learning (ML) approach for mapping non-self-consistent Kohn-Sham Hamiltonians constructed with one kind of density functional to the nearly self-consistent Hamiltonians constructed with another kind of density functional. This approach is designed as a fast surrogate Hamiltonian calculator for use in long nonadiabatic dynamics simulations of large atomistic systems. In this approach, the input and output features are Hamiltonian matrices computed from different levels of theory. We demonstrate that the developed ML-based Hamiltonian mapping method (1) speeds up the calculations by several orders of magnitude, (2) is conceptually simpler than alternative ML approaches, (3) is applicable to different systems and sizes and can be used for mapping Hamiltonians constructed with arbitrary density functionals, (4) requires a modest training data, learns fast, and generates molecular orbitals and their energies with the accuracy nearly matching that of conventional calculations, and (5) when applied to nonadiabatic dynamics simulation of excitation energy relaxation in large systems yields the corresponding time scales within the margin of error of the conventional calculations. Using this approach, we explore the excitation energy relaxation in C60 fullerene and Si75H64 quantum dot structures and derive qualitative and quantitative insights into dynamics in these systems.

From Organic Fragments to Photoswitchable Catalysts: The OFF-ON Structural Repository for Transferable Kernel-Based Potentials

Structurally and conformationally diverse databases are needed to train accurate neural networks or kernel-based potentials capable of exploring the complex free energy landscape of flexible functional organic molecules. Curating such databases for species beyond "simple" drug-like compounds or molecules composed of well-defined building blocks (e.g., peptides) is challenging as it requires thorough chemical space mapping and evaluation of both chemical and conformational diversities. Here, we introduce the OFF-ON (organic fragments from organocatalysts that are non-modular) database, a repository of 7869 equilibrium and 67,457 nonequilibrium geometries of organic compounds and dimers aimed at describing conformationally flexible functional organic molecules, with an emphasis on photoswitchable organocatalysts. The relevance of this database is then demonstrated by training a local kernel regression model on a low-cost semiempirical baseline and comparing it with a PBE0-D3 reference for several known catalysts, notably the free energy surfaces of exemplary photoswitchable organocatalysts. Our results demonstrate that the OFF-ON data set offers reliable predictions for simulating the conformational behavior of virtually any (photoswitchable) organocatalyst or organic compound composed of H, C, N, O, F, and S atoms, thereby opening a computationally feasible route to explore complex free energy surfaces in order to rationalize and predict catalytic behavior.

Cost-Efficient High-Resolution Linear Absorption Spectra through Extrapolating the Dipole Moment from Real-Time Time-Dependent Electronic-Structure Theory

We present a novel function fitting method for approximating the propagation of the time-dependent electric dipole moment from real-time electronic structure calculations. Real-time calculations of the electronic absorption spectrum require discrete Fourier transforms of the electric dipole moment. The spectral resolution is determined by the total propagation time, i.e., the trajectory length of the dipole moment, causing a high computational cost. Our developed method uses function fitting on shorter trajectories of the dipole moment, achieving arbitrary spectral resolution through extrapolation. Numerical testing shows that the fitting method can reproduce high-resolution spectra by using short dipole trajectories. The method converges with as little as 100 a.u. dipole trajectories for some systems, though the difficulty converging increases with the spectral density. We also introduce an error estimate of the fit, reliably assessing its convergence and hence the quality of the approximated spectrum.

Four-Dimensional-Spacetime Atomistic Artificial Intelligence Models

We demonstrate that AI can learn atomistic systems in the four-dimensional (4D) spacetime. For this, we introduce the 4D-spacetime GICnet model, which for the given initial conditions (nuclear positions and velocities at time zero) can predict nuclear positions and velocities as a continuous function of time up to the distant future. Such models of molecules can be unrolled in the time dimension to yield long-time high-resolution molecular dynamics trajectories with high efficiency and accuracy. 4D-spacetime models can make predictions for different times in any order and do not need a stepwise evaluation of forces and integration of the equations of motions at discretized time steps, which is a major advance over traditional, cost-inefficient molecular dynamics. These models can be used to speed up dynamics, simulate vibrational spectra, and obtain deeper insight into nuclear motions, as we demonstrate for a series of organic molecules.

Machine Learning for Bridging the Gap between Density Functional Theory and Coupled Cluster Energies

Accurate electronic energies and properties are crucial for successful reaction design and mechanistic investigations. Computing energies and properties of molecular structures has proven extremely useful, and, with increasing computational power, the limits of high-level approaches (such as coupled cluster theory) are expanding to ever larger systems. However, because scaling is highly unfavorable, these methods are still not universally applicable to larger systems. To address the need for fast and accurate electronic energies of larger systems, we created a database of around 8000 small organic monomers (2000 dimers) optimized at the B3LYP-D3(BJ)/cc-pVTZ level of theory. This database also includes single-point energies computed at various levels of theory, including PBE1PBE, ωΒ97Χ, M06-2X, revTPSS, B3LYP, and BP86, for density functional theory as well as DLPNO-CCSD(T) and CCSD(T) for coupled cluster theory, all in conjunction with a cc-pVTZ basis. We used this database to train machine learning models based on graph neural networks using two different graph representations. Our models are able to make energy predictions from B3LYP-D3(BJ)/cc-pVTZ inputs to CCSD(T)/cc-pVTZ outputs with a mean absolute error of 0.78 and to DLPNO-CCSD(T)/cc-pVTZ with an mean absolute error of 0.50 and 0.18 kcal mol^-1 for monomers and dimers, respectively. The model for dimers was further validated on the S22 database, and the monomer model was tested on challenging systems, including those with highly conjugated or functionally complex molecules.

Probing Accuracy-Speedup Tradeoff in Machine Learning Surrogates for Molecular Dynamics Simulations

The performance promise of machine learning surrogates of molecular dynamics simulations of soft materials is significant but generally comes at the cost of acquiring large training datasets to learn the complex relationships between input soft material attributes and output properties. Under the constraint of limited high-performance computing resources, optimizing the size of the training datasets becomes paramount. Using an artificial neural network based surrogate for molecular dynamics simulations of confined electrolytes, we explore the tradeoff between surrogate accuracy and computational gains. Accuracy is assessed by computing the root-mean-square errors between the surrogate predictions and the ground truth results obtained via molecular dynamics simulations. The computational performance is judged by evaluating the speedup which incorporates the training dataset creation time. Improvement in accuracy occurs with a loss of speedup, which scales as the inverse of the training dataset size. The link between surrogate generalizability and the accuracy-speedup tradeoff is assessed by examining the errors incurred in surrogate predictions on unseen, interpolated input variables and developing a net speedup metric to capture the associated gains.

An Expedited Route to Optical and Electronic Properties at Finite Temperature via Unsupervised Learning

Electronic properties and absorption spectra are the grounds to investigate molecular electronic states and their interactions with the environment. Modeling and computations are required for the molecular understanding and design strategies of photo-active materials and sensors. However, the interpretation of such properties demands expensive computations and dealing with the interplay of electronic excited states with the conformational freedom of the chromophores in complex matrices (i.e., solvents, biomolecules, crystals) at finite temperature. Computational protocols combining time dependent density functional theory and ab initio molecular dynamics (MD) have become very powerful in this field, although they require still a large number of computations for a detailed reproduction of electronic properties, such as band shapes. Besides the ongoing research in more traditional computational chemistry fields, data analysis and machine learning methods have been increasingly employed as complementary approaches for efficient data exploration, prediction and model development, starting from the data resulting from MD simulations and electronic structure calculations. In this work, dataset reduction capabilities by unsupervised clustering techniques applied to MD trajectories are proposed and tested for the ab initio modeling of electronic absorption spectra of two challenging case studies: a non-covalent charge-transfer dimer and a ruthenium complex in solution at room temperature. The K-medoids clustering technique is applied and is proven to be able to reduce by ∼100 times the total cost of excited state calculations on an MD sampling with no loss in the accuracy and it also provides an easier understanding of the representative structures (medoids) to be analyzed on the molecular scale.

Integrating Machine Learning in the Coarse-Grained Molecular Simulation of Polymers

Machine learning (ML) is having an increasing impact on the physical sciences, engineering, and technology and its integration into molecular simulation frameworks holds great potential to expand their scope of applicability to complex materials and facilitate fundamental knowledge and reliable property predictions, contributing to the development of efficient materials design routes. The application of ML in materials informatics in general, and polymer informatics in particular, has led to interesting results, however great untapped potential lies in the integration of ML techniques into the multiscale molecular simulation methods for the study of macromolecular systems, specifically in the context of Coarse Grained (CG) simulations. In this Perspective, we aim at presenting the pioneering recent research efforts in this direction and discussing how these new ML-based techniques can contribute to critical aspects of the development of multiscale molecular simulation methods for bulk complex chemical systems, especially polymers. Prerequisites for the implementation of such ML-integrated methods and open challenges that need to be met toward the development of general systematic ML-based coarse graining schemes for polymers are discussed.

ESIPT in the pyrrol pyridine molecule: mechanism, timescale and yield revealed using dynamics simulations

Excited State Intramolecular Proton Transfer in pyrrol pyridine is theoretically investigated using non-adiabatic dynamics simulations. The photochemical process is completely characterised: the reaction time, the total yield and the accessibility of the conical intersection are evaluated. Finally, new mechanistic interpretation are extracted: the proton transfer reaction in this molecule is shown to be driven by two complementary mechanisms.

Reweighted Manifold Learning of Collective Variables from Enhanced Sampling Simulations

Enhanced sampling methods are indispensable in computational chemistry and physics, where atomistic simulations cannot exhaustively sample the high-dimensional configuration space of dynamical systems due to the sampling problem. A class of such enhanced sampling methods works by identifying a few slow degrees of freedom, termed collective variables (CVs), and enhancing the sampling along these CVs. Selecting CVs to analyze and drive the sampling is not trivial and often relies on chemical intuition. Despite routinely circumventing this issue using manifold learning to estimate CVs directly from standard simulations, such methods cannot provide mappings to a low-dimensional manifold from enhanced sampling simulations, as the geometry and density of the learned manifold are biased. Here, we address this crucial issue and provide a general reweighting framework based on anisotropic diffusion maps for manifold learning that takes into account that the learning data set is sampled from a biased probability distribution. We consider manifold learning methods based on constructing a Markov chain describing transition probabilities between high-dimensional samples. We show that our framework reverts the biasing effect, yielding CVs that correctly describe the equilibrium density. This advancement enables the construction of low-dimensional CVs using manifold learning directly from the data generated by enhanced sampling simulations. We call our framework reweighted manifold learning. We show that it can be used in many manifold learning techniques on data from both standard and enhanced sampling simulations.

Conical Intersection in Chemiluminescence of Cyclic Peroxides

Chemiluminescence (CL) utilizing chemiexcitation for energy transformation is one of the most highly sensitive and useful analytical techniques. The chemiexcitation is a chemical process of a ground-state reactant producing an excited-state product, in which a nonadiabatic event is facilitated by conical intersections (CIs), the specific molecular geometries where electronic states are degenerated. Cyclic peroxides, especially 1,2-dioxetane/dioxetanone derivatives, are the iconic chemiluminescent substances. In this Perspective, we concentrated on the CIs in the CL of cyclic peroxides. We first present a computational overview on the role of CIs between the ground (S₀) state and the lowest singlet excited (S₁) state in the thermolysis of cyclic peroxides. Subsequently, we discuss the role of the S₀/S₁ CI in the CL efficiency and point out misunderstandings in some theoretical studies on the singlet chemiexcitations of cyclic peroxides. Finally, we address the challenges and future prospects in theoretically calculating S₀/S₁ CIs and simulating the dynamics and chemiexcitation efficiency in the CL of cyclic peroxides.

Reversible assembly of nanoparticles: theory, strategies and computational simulations

The significant advances in synthesis and functionalization have enabled the preparation of high-quality nanoparticles that have found a plethora of successful applications. The unique physicochemical properties of nanoparticles can be manipulated through the control of size, shape, composition, and surface chemistry, but their technological application possibilities can be further expanded by exploiting the properties that emerge from their assembly. The ability to control the assembly of nanoparticles not only is required for many real technological applications, but allows the combination of the intrinsic properties of nanoparticles and opens the way to the exploitation of their complex interplay, giving access to collective properties. Significant advances and knowledge gained over the past few decades on nanoparticle assembly have made it possible to implement a growing number of strategies for reversible assembly of nanoparticles. In addition to being of interest for basic studies, such advances further broaden the range of applications and the possibility of developing innovative devices using nanoparticles. This review focuses on the reversible assembly of nanoparticles and includes the theoretical aspects related to the concept of reversibility, an up-to-date assessment of the experimental approaches applied to this field and the advanced computational schemes that offer key insights into the assembly mechanisms. We aim to provide readers with a comprehensive guide to address the challenges in assembling reversible nanoparticles and promote their applications.

The principal component analysis of the ring deformation in the nonadiabatic surface hopping dynamics

The analysis of the leading active molecular motions in the on-the-fly trajectory surface hopping simulation provides the essential information to understand the geometric evolution in nonadiabatic dynamics. When the ring deformation is involved, the identification of the key active coordinates becomes challenging. A "hierarchical" protocol based on the dimensionality reduction and clustering approaches is proposed for the automatic analysis of the ring deformation in the nonadiabatic molecular dynamics. The representative system keto isocytosine is taken as the prototype to illustrate this protocol. The results indicate that the current hierarchical analysis protocol is a powerful way to clearly clarify both the major and minor active molecular motions of the ring distortion in nonadiabatic dynamics.

Machine learning, artificial intelligence, and chemistry: how smart algorithms are reshaping simulation and the laboratory

Machine learning and artificial intelligence are increasingly gaining in prominence through image analysis, language processing, and automation, to name a few applications. Machine learning is also making profound changes in chemistry. From revisiting decades-old analytical techniques for the purpose of creating better calibration curves, to assisting and accelerating traditional in silico simulations, to automating entire scientific workflows, to being used as an approach to deduce underlying physics of unexplained chemical phenomena, machine learning and artificial intelligence are reshaping chemistry, accelerating scientific discovery, and yielding new insights. This review provides an overview of machine learning and artificial intelligence from a chemist’s perspective and focuses on a number of examples of the use of these approaches in computational chemistry and in the laboratory.

Differences in ligand-induced protein dynamics extracted from an unsupervised deep learning approach correlate with protein-ligand binding affinities

Prediction of protein–ligand binding affinity is a major goal in drug discovery. Generally, free energy gap is calculated between two states (e.g., ligand binding and unbinding). The energy gap implicitly includes the effects of changes in protein dynamics induced by ligand binding. However, the relationship between protein dynamics and binding affinity remains unclear. Here, we propose a method that represents ligand-binding-induced protein behavioral change with a simple feature that can be used to predict protein–ligand affinity. From unbiased molecular simulation data, an unsupervised deep learning method measures the differences in protein dynamics at a ligand-binding site depending on the bound ligands. A dimension reduction method extracts a dynamic feature that strongly correlates to the binding affinities. Moreover, the residues that play important roles in protein–ligand interactions are specified based on their contribution to the differences. These results indicate the potential for binding dynamics-based drug discovery.

Differences in ligand-induced protein dynamics extracted as a single feature from a deep learning-based analysis of MD simulations correlate with ligand binding affinity.

Multiscale molecular modelling: from electronic structure to dynamics of nanosystems and beyond

Important contemporary biological and materials problems often depend on interactions that span orders of magnitude differences in spatial and temporal dimensions. This Tutorial Review attempts to provide an introduction to such fascinating problems through a series of case studies, aimed at beginning researchers, graduate students, postdocs and more senior colleagues who are changing direction to focus on multiscale aspects of their research. The choice of specific examples is highly personal, with examples either chosen from our own work or outstanding multiscale efforts from the literature. I start with various embedding schemes, as exemplified by polarizable continuum models, 3-D RISM, molecular DFT and frozen-density embedding. Next, QM/MM (quantum mechanical/molecular mechanical) techniques are the workhorse of pm-to-nm/ps-to-ns simulations; examples are drawn from enzymes and from nanocatalysis for oil-sands upgrading. Using polarizable force-fields in the QM/MM framework represents a burgeoning subfield; with examples from ion channels and electron dynamics in molecules subject to strong external fields, probing the atto-second dynamics of the electrons with RT-TDDFT (real-time - time-dependent density functional theory) eventually coupled with nuclear motion through the Ehrenfest approximation. This is followed by a section on coarse graining, bridging dimensions from atoms to cells. The penultimate chapter gives a quick overview of multiscale approaches that extend into the meso- and macro-scales, building on atomistic and coarse-grained techniques to enter the world of materials engineering, on the one hand, and cell biology, on the other. A final chapter gives just a glimpse of the burgeoning impact of machine learning on the structure-dynamics front. I aim to capture the excitement of contemporary leading-edge breakthroughs in the description of physico-chemical systems and processes in complex environments, with only enough historical content to provide context and aid the next generation of methodological development. While I aim also for a clear description of the essence of methodological breakthroughs, equations are kept to a minimum and detailed formalism and implementation details are left to the references. My approach is very selective (case studies) rather than exhaustive. I think that these case studies should provide fodder to build as complete a reference tree on multiscale modelling as the reader may wish, through forward and backward citation analysis. I hope that my choices of cases will excite interest in newcomers and help to fuel the growth of multiscale modelling in general.

Solving Newton’s equations of motion with large timesteps using recurrent neural networks based operators

Classical molecular dynamics simulations are based on solving Newton’s equations of motion. Using a small timestep, numerical integrators such as Verlet generate trajectories of particles as solutions to Newton’s equations. We introduce operators derived using recurrent neural networks that accurately solve Newton’s equations utilizing sequences of past trajectory data, and produce energy-conserving dynamics of particles using timesteps up to 4000 times larger compared to the Verlet timestep. We demonstrate significant speedup in many example problems including 3D systems of up to 16 particles.

Computer Simulations of Deep Eutectic Solvents: Challenges, Solutions, and Perspectives

Deep eutectic solvents (DESs) are one of the most rapidly evolving types of solvents, appearing in a broad range of applications, such as nanotechnology, electrochemistry, biomass transformation, pharmaceuticals, membrane technology, biocomposite development, modern 3D-printing, and many others. The range of their applicability continues to expand, which demands the development of new DESs with improved properties. To do so requires an understanding of the fundamental relationship between the structure and properties of DESs. Computer simulation and machine learning techniques provide a fruitful approach as they can predict and reveal physical mechanisms and readily be linked to experiments. This review is devoted to the computational research of DESs and describes technical features of DES simulations and the corresponding perspectives on various DES applications. The aim is to demonstrate the current frontiers of computational research of DESs and discuss future perspectives.

Predicting Membrane-Active Peptide Dynamics in Fluidic Lipid Membranes

Understanding the interactions between peptides and lipid membranes could not only accelerate the development of antimicrobial peptides as treatments for infections but also be applied to finding targeted therapies for cancer and other diseases. However, designing biophysical experiments to study molecular interactions between flexible peptides and fluidic lipid membranes has been an ongoing challenge. Recently, with hardware advances, algorithm improvements, and more accurate parameterizations (i.e., force fields), all-atom molecular dynamics (MD) simulations have been used as a "computational microscope" to investigate the molecular interactions and mechanisms of membrane-active peptides in cell membranes (Chen et al., Curr Opin Struct Biol 61:160-166, 2020; Ulmschneider and Ulmschneider, Acc Chem Res 51(5):1106-1116, 2018; Dror et al., Annu Rev Biophys 41:429-452, 2012). In this chapter, we describe how to utilize MD simulations to predict and study peptide dynamics and how to validate the simulations by circular dichroism, intrinsic fluorescent probe, membrane leakage assay, electrical impedance, and isothermal titration calorimetry. Experimentally validated MD simulations open a new route towards peptide design starting from sequence and structure and leading to desirable functions.

Ab initio molecular dynamics with enhanced sampling in heterogeneous catalysis

Enhanced sampling ab initio simulations enable to study chemical phenomena in catalytic systems including thermal effects & anharmonicity, & collective dynamics describing enthalpic & entropic contributions, which can significantly impact on reaction free energy landscapes.

Reinforcement Learning Configuration Interaction

Selected configuration interaction (sCI) methods exploit the sparsity of the full configuration interaction (FCI) wave function, yielding significant computational savings and wave function compression without sacrificing the accuracy. Despite recent advances in sCI methods, the selection of important determinants remains an open problem. We explore the possibility of utilizing reinforcement learning approaches to solve the sCI problem. By mapping the configuration interaction problem onto a sequential decision-making process, the agent learns on-the-fly which determinants to include and which to ignore, yielding a compressed wave function at near-FCI accuracy. This method, which we call reinforcement-learned configuration interaction, adds another weapon to the sCI arsenal and highlights how reinforcement learning approaches can potentially help solve challenging problems in electronic structure theory.

Machine Learning for Electronically Excited States of Molecules

Electronically excited states of molecules are at the heart of photochemistry, photophysics, as well as photobiology and also play a role in material science. Their theoretical description requires highly accurate quantum chemical calculations, which are computationally expensive. In this review, we focus on not only how machine learning is employed to speed up such excited-state simulations but also how this branch of artificial intelligence can be used to advance this exciting research field in all its aspects. Discussed applications of machine learning for excited states include excited-state dynamics simulations, static calculations of absorption spectra, as well as many others. In order to put these studies into context, we discuss the promises and pitfalls of the involved machine learning techniques. Since the latter are mostly based on quantum chemistry calculations, we also provide a short introduction into excited-state electronic structure methods and approaches for nonadiabatic dynamics simulations and describe tricks and problems when using them in machine learning for excited states of molecules.

Machine Learning for Electronically Excited States of Molecules

Electronically excited states of molecules are at the heart of photochemistry, photophysics, as well as photobiology and also play a role in material science. Their theoretical description requires highly accurate quantum chemical calculations, which are computationally expensive. In this review, we focus on not only how machine learning is employed to speed up such excited-state simulations but also how this branch of artificial intelligence can be used to advance this exciting research field in all its aspects. Discussed applications of machine learning for excited states include excited-state dynamics simulations, static calculations of absorption spectra, as well as many others. In order to put these studies into context, we discuss the promises and pitfalls of the involved machine learning techniques. Since the latter are mostly based on quantum chemistry calculations, we also provide a short introduction into excited-state electronic structure methods and approaches for nonadiabatic dynamics simulations and describe tricks and problems when using them in machine learning for excited states of molecules.

Machine learning directed drug formulation development

Machine learning (ML) has enabled ground-breaking advances in the healthcare and pharmaceutical sectors, from improvements in cancer diagnosis, to the identification of novel drugs and drug targets as well as protein structure prediction. Drug formulation is an essential stage in the discovery and development of new medicines. Through the design of drug formulations, pharmaceutical scientists can engineer important properties of new medicines, such as improved bioavailability and targeted delivery. The traditional approach to drug formulation development relies on iterative trial-and-error, requiring a large number of resource-intensive and time-consuming in vitro and in vivo experiments. This review introduces the basic concepts of ML-directed workflows and discusses how these tools can be used to aid in the development of various types of drug formulations. ML-directed drug formulation development offers unparalleled opportunities to fast-track development efforts, uncover new materials, innovative formulations, and generate new knowledge in drug formulation science. The review also highlights the latest artificial intelligence (AI) technologies, such as generative models, Bayesian deep learning, reinforcement learning, and self-driving laboratories, which have been gaining momentum in drug discovery and chemistry and have potential in drug formulation development.

Perspective on integrating machine learning into computational chemistry and materials science

Machine learning (ML) methods are being used in almost every conceivable area of electronic structure theory and molecular simulation. In particular, ML has become firmly established in the construction of high-dimensional interatomic potentials. Not a day goes by without another proof of principle being published on how ML methods can represent and predict quantum mechanical properties-be they observable, such as molecular polarizabilities, or not, such as atomic charges. As ML is becoming pervasive in electronic structure theory and molecular simulation, we provide an overview of how atomistic computational modeling is being transformed by the incorporation of ML approaches. From the perspective of the practitioner in the field, we assess how common workflows to predict structure, dynamics, and spectroscopy are affected by ML. Finally, we discuss how a tighter and lasting integration of ML methods with computational chemistry and materials science can be achieved and what it will mean for research practice, software development, and postgraduate training.

Elucidating an Atmospheric Brown Carbon Species-Toward Supplanting Chemical Intuition with Exhaustive Enumeration and Machine Learning

Brown carbon (BrC) is involved in atmospheric light absorption and climate forcing and can cause adverse health effects. Understanding the formation mechanisms and molecular structure of BrC is of key importance in developing strategies to control its environment and health impact. Structure determination of BrC is challenging, due to the lack of experiments providing molecular fingerprints and the sheer number of molecular candidates with identical mass. Suggestions based on chemical intuition are prone to errors due to the inherent bias. We present an unbiased algorithm, using graph-based molecule generation and machine learning, which can identify all molecular structures of compounds involved in biomass burning and the composition of BrC. We apply this algorithm to C₁₂H₁₂O₇, a light-absorbing "test case" molecule identified in chamber experiments on the aqueous photo-oxidation of syringol, a prevalent marker in wood smoke. Of the 260 million molecular graphs, the algorithm leaves only 36,518 (0.01%) as viable candidates matching the spectrum. Although no unique molecular structure is obtained from only a chemical formula and a UV/vis absorption spectrum, we discuss further reduction strategies and their efficacy. With additional data, the method can potentially more rapidly identify isomers extracted from lab and field aerosol particles without introducing human bias.

Machine learning classification of disrotatory IRC and conrotatory non-IRC trajectory motion for cyclopropyl radical ring opening

Quasiclassical trajectory analysis is now a standard tool to analyze non-minimum energy pathway motion of organic reactions. However, due to the large amount of information associated with trajectories, quantitative analysis of the dynamic origin of reaction selectivity is complex. For the electrocyclic ring opening of cyclopropyl radical, more than 4000 trajectories were run showing that allyl radicals are formed through a mixture of disrotatory intrinsic reaction coordinate (IRC) motion as well as conrotatory non-IRC motion. Geometric, vibrational mode, and atomic velocity transition-state features from these trajectories were used for supervised machine learning analysis with classification algorithms. Accuracy >80% with a random forest model enabled quantitative and qualitative assessment of transition-state trajectory features controlling disrotatory IRC versus conrotatory non-IRC motion. This analysis revealed that there are two key vibrational modes where their directional combination provides prediction of IRC versus non-IRC motion.

Hybrid localized graph kernel for machine learning energy-related properties of molecules and solids

Nowadays, the coupling of electronic structure and machine learning techniques serves as a powerful tool to predict chemical and physical properties of a broad range of systems. With the aim of improving the accuracy of predictions, a large number of representations for molecules and solids for machine learning applications has been developed. In this work we propose a novel descriptor based on the notion of molecular graph. While graphs are largely employed in classification problems in cheminformatics or bioinformatics, they are not often used in regression problem, especially of energy-related properties. Our method is based on a local decomposition of atomic environments and on the hybridization of two kernel functions: a graph kernel contribution that describes the chemical pattern and a Coulomb label contribution that encodes finer details of the local geometry. The accuracy of this new kernel method in energy predictions of molecular and condensed phase systems is demonstrated by considering the popular QM7 and BA10 datasets. These examples show that the hybrid localized graph kernel outperforms traditional approaches such as, for example, the smooth overlap of atomic positions and the Coulomb matrices.

Remodelling structure-based drug design using machine learning

To keep up with the pace of rapid discoveries in biomedicine, a plethora of research endeavors had been directed toward Rational Drug Development that slowly gave way to Structure-Based Drug Design (SBDD). In the past few decades, SBDD played a stupendous role in identification of novel drug-like molecules that are capable of altering the structures and/or functions of the target macromolecules involved in different disease pathways and networks. Unfortunately, post-delivery drug failures due to adverse drug interactions have constrained the use of SBDD in biomedical applications. However, recent technological advancements, along with parallel surge in clinical research have led to the concomitant establishment of other powerful computational techniques such as Artificial Intelligence (AI) and Machine Learning (ML). These leading-edge tools with the ability to successfully predict side-effects of a wide range of drugs have eventually taken over the field of drug design. ML, a subset of AI, is a robust computational tool that is capable of data analysis and analytical model building with minimal human intervention. It is based on powerful algorithms that use huge sets of 'training data' as inputs to predict new output values, which improve iteratively through experience. In this review, along with a brief discussion on the evolution of the drug discovery process, we have focused on the methodologies pertaining to the technological advancements of machine learning. This review, with specific examples, also emphasises the tremendous contributions of ML in the field of biomedicine, while exploring possibilities for future developments.

A review on machine learning algorithms for the ionic liquid chemical space

There are thousands of papers published every year investigating the properties and possible applications of ionic liquids. Industrial use of these exceptional fluids requires adequate understanding of their physical properties, in order to create the ionic liquid that will optimally suit the application. Computational property prediction arose from the urgent need to minimise the time and cost that would be required to experimentally test different combinations of ions. This review discusses the use of machine learning algorithms as property prediction tools for ionic liquids (either as standalone methods or in conjunction with molecular dynamics simulations), presents common problems of training datasets and proposes ways that could lead to more accurate and efficient models.

Analysis of bath motion in MM-SQC dynamics via dimensionality reduction approach: Principal component analysis

The system-plus-bath model is an important tool to understand the nonadiabatic dynamics of large molecular systems. Understanding the collective motion of a large number of bath modes is essential for revealing their key roles in the overall dynamics. Here, we applied principal component analysis (PCA) to investigate the bath motion in the basis of a large dataset generated from the symmetrical quasi-classical dynamics method based on the Meyer-Miller mapping Hamiltonian nonadiabatic dynamics for the excited-state energy transfer in the Frenkel-exciton model. The PCA method clearly elucidated that two types of bath modes, which either display strong vibronic coupling or have frequencies close to that of the electronic transition, are important to the nonadiabatic dynamics. These observations were fully consistent with the physical insights. The conclusions were based on the PCA of the trajectory data and did not involve significant pre-defined physical knowledge. The results show that the PCA approach, which is one of the simplest unsupervised machine learning dimensionality reduction methods, is a powerful one for analyzing complicated nonadiabatic dynamics in the condensed phase with many degrees of freedom.

Drug design targeting active posttranslational modification protein isoforms

Modern drug design aims to discover novel lead compounds with attractable chemical profiles to enable further exploration of the intersection of chemical space and biological space. Identification of small molecules with good ligand efficiency, high activity, and selectivity is crucial toward developing effective and safe drugs. However, the intersection is one of the most challenging tasks in the pharmaceutical industry, as chemical space is almost infinity and continuous, whereas the biological space is very limited and discrete. This bottleneck potentially limits the discovery of molecules with desirable properties for lead optimization. Herein, we present a new direction leveraging posttranslational modification (PTM) protein isoforms target space to inspire drug design termed as "Post-translational Modification Inspired Drug Design (PTMI-DD)." PTMI-DD aims to extend the intersections of chemical space and biological space. We further rationalized and highlighted the importance of PTM protein isoforms and their roles in various diseases and biological functions. We then laid out a few directions to elaborate the PTMI-DD in drug design including discovering covalent binding inhibitors mimicking PTMs, targeting PTM protein isoforms with distinctive binding sites from that of wild-type counterpart, targeting protein-protein interactions involving PTMs, and hijacking protein degeneration by ubiquitination for PTM protein isoforms. These directions will lead to a significant expansion of the biological space and/or increase the tractability of compounds, primarily due to precisely targeting PTM protein isoforms or complexes which are highly relevant to biological functions. Importantly, this new avenue will further enrich the personalized treatment opportunity through precision medicine targeting PTM isoforms.

Exploiting deep learning for predictable carbon dot design

In this study, we developed a deep convolution neural network (DCNN) model for predicting the optical properties of carbon dots (CDs), including spectral properties and fluorescence color under ultraviolet irradiation. These results demonstrate the powerful potential of DCNN for guiding the synthesis of CDs.

BonDNet: a graph neural network for the prediction of bond dissociation energies for charged molecules

A broad collection of technologies, including e.g. drug metabolism, biofuel combustion, photochemical decontamination of water, and interfacial passivation in energy production/storage systems rely on chemical processes that involve bond-breaking molecular reactions. In this context, a fundamental thermodynamic property of interest is the bond dissociation energy (BDE) which measures the strength of a chemical bond. Fast and accurate prediction of BDEs for arbitrary molecules would lay the groundwork for data-driven projections of complex reaction cascades and hence a deeper understanding of these critical chemical processes and, ultimately, how to reverse design them. In this paper, we propose a chemically inspired graph neural network machine learning model, BonDNet, for the rapid and accurate prediction of BDEs. BonDNet maps the difference between the molecular representations of the reactants and products to the reaction BDE. Because of the use of this difference representation and the introduction of global features, including molecular charge, it is the first machine learning model capable of predicting both homolytic and heterolytic BDEs for molecules of any charge. To test the model, we have constructed a dataset of both homolytic and heterolytic BDEs for neutral and charged (−1 and +1) molecules. BonDNet achieves a mean absolute error (MAE) of 0.022 eV for unseen test data, significantly below chemical accuracy (0.043 eV). Besides the ability to handle complex bond dissociation reactions that no previous model could consider, BonDNet distinguishes itself even in only predicting homolytic BDEs for neutral molecules; it achieves an MAE of 0.020 eV on the PubChem BDE dataset, a 20% improvement over the previous best performing model. We gain additional insight into the model's predictions by analyzing the patterns in the features representing the molecules and the bond dissociation reactions, which are qualitatively consistent with chemical rules and intuition. BonDNet is just one application of our general approach to representing and learning chemical reactivity, and it could be easily extended to the prediction of other reaction properties in the future.

Prediction of bond dissociation energies for charged molecules with a graph neural network enabled by global molecular features and reaction difference features between products and reactants.

Nonequilibrium Dynamics of Proton-Coupled Electron Transfer in Proton Wires: Concerted but Asynchronous Mechanisms

The coupling between electrons and protons and the long-range transport of protons play important roles throughout biology. Biomimetic systems derived from benzimidazole-phenol (BIP) constructs have been designed to undergo proton-coupled electron transfer (PCET) upon electrochemical or photochemical oxidation. Moreover, these systems can transport protons along hydrogen-bonded networks or proton wires through multiproton PCET. Herein, the nonequilibrium dynamics of both single and double proton transfer in BIP molecules initiated by oxidation are investigated with first-principles molecular dynamics simulations. Although these processes are concerted in that no thermodynamically stable intermediate is observed, the simulations predict that they are predominantly asynchronous on the ultrafast time scale. For both systems, the first proton transfer typically occurs ∼100 fs after electron transfer. For the double proton transfer system, typically the second proton transfer occurs hundreds of femtoseconds after the initial proton transfer. A machine learning algorithm was used to identify the key molecular vibrational modes essential for proton transfer: a slow, in-plane bending mode that dominates the overall inner-sphere reorganization, the proton donor-acceptor motion that leads to vibrational coherence, and the faster donor-hydrogen stretching mode. The asynchronous double proton transfer mechanism can be understood in terms of a significant mode corresponding to the two anticorrelated proton donor-acceptor motions, typically decreasing only one donor-acceptor distance at a time. Although these PCET processes appear concerted on the time scale of typical electrochemical experiments, attaching these BIP constructs to photosensitizers may enable the detection of the asynchronicity of the electron and multiple proton transfers with ultrafast two-dimensional spectroscopy. Understanding the fundamental PCET mechanisms at this level will guide the design of PCET systems for catalysis and energy conversion processes.

Designing and understanding light-harvesting devices with machine learning

Understanding the fundamental processes of light-harvesting is crucial to the development of clean energy materials and devices. Biological organisms have evolved complex metabolic mechanisms to efficiently convert sunlight into chemical energy. Unraveling the secrets of this conversion has inspired the design of clean energy technologies, including solar cells and photocatalytic water splitting. Describing the emergence of macroscopic properties from microscopic processes poses the challenge to bridge length and time scales of several orders of magnitude. Machine learning experiences increased popularity as a tool to bridge the gap between multi-level theoretical models and Edisonian trial-and-error approaches. Machine learning offers opportunities to gain detailed scientific insights into the underlying principles governing light-harvesting phenomena and can accelerate the fabrication of light-harvesting devices.

Machine Learning Force Fields and Coarse-Grained Variables in Molecular Dynamics: Application to Materials and Biological Systems

Machine learning encompasses tools and algorithms that are now becoming popular in almost all scientific and technological fields. This is true for molecular dynamics as well, where machine learning offers promises of extracting valuable information from the enormous amounts of data generated by simulation of complex systems. We provide here a review of our current understanding of goals, benefits, and limitations of machine learning techniques for computational studies on atomistic systems, focusing on the construction of empirical force fields from ab initio databases and the determination of reaction coordinates for free energy computation and enhanced sampling.

Simulating Solvation and Acidity in Complex Mixtures with First-Principles Accuracy: The Case of CH3SO3H and H2O2 in Phenol

We present a generally applicable computational framework for the efficient and accurate characterization of molecular structural patterns and acid properties in an explicit solvent using H₂O₂ and CH₃SO₃H in phenol as an example. To address the challenges posed by the complexity of the problem, we resort to a set of data-driven methods and enhanced sampling algorithms. The synergistic application of these techniques makes the first-principle estimation of the chemical properties feasible without renouncing to the use of explicit solvation, involving extensive statistical sampling. Ensembles of neural network (NN) potentials are trained on a set of configurations carefully selected out of preliminary simulations performed at a low-cost density functional tight-binding (DFTB) level. The energy and forces of these configurations are then recomputed at the hybrid density functional theory (DFT) level and used to train the neural networks. The stability of the NN model is enhanced by using DFTB energetics as a baseline, but the efficiency of the direct NN (i.e., baseline-free) is exploited via a multiple-time-step integrator. The neural network potentials are combined with enhanced sampling techniques, such as replica exchange and metadynamics, and used to characterize the relevant protonated species and dominant noncovalent interactions in the mixture, also considering nuclear quantum effects.

From Absorption Spectra to Charge Transfer in Nanoaggregates of Oligomers with Machine Learning

Fast and inexpensive characterization of materials properties is a key element to discover novel functional materials. In this work, we suggest an approach employing three classes of Bayesian machine learning (ML) models to correlate electronic absorption spectra of nanoaggregates with the strength of intermolecular electronic couplings in organic conducting and semiconducting materials. As a specific model system, we consider poly(3,4-ethylenedioxythiophene) (PEDOT) polystyrene sulfonate, a cornerstone material for organic electronic applications, and so analyze the couplings between charged dimers of closely packed PEDOT oligomers that are at the heart of the material's unrivaled conductivity. We demonstrate that ML algorithms can identify correlations between the coupling strengths and the electronic absorption spectra. We also show that ML models can be trained to be transferable across a broad range of spectral resolutions and that the electronic couplings can be predicted from the simulated spectra with an 88% accuracy when ML models are used as classifiers. Although the ML models employed in this study were trained on data generated by a multiscale computational workflow, they were able to leverage experimental data.

Machine Learning Analysis of Direct Dynamics Trajectory Outcomes for Thermal Deazetization of 2,3-Diazabicyclo[2.2.1]hept-2-ene

Experimentally, the thermal gas-phase deazetization of 2,3-diazabicyclo[2.2.1]hept-2-ene (1) results in the loss of N₂ and the formation of bicyclo products 3 (exo) and 4 (endo) in a nonstatistical ratio, with preference for the exo product. Here, we report unrestricted M06-2X quasiclassical trajectories initialized from the concerted N₂ ejection transition state that were able to replicate the experimental preference to form 3. We found that the 3:4 ratio results from the relative amounts of very fast (ballistic) exotype trajectories versus trajectories that lead to the 1,3-diradical intermediate 2. These quasiclassical trajectories provided a set of transition-state vibrational, velocity, momenta, and geometric features for the machine learning analysis. A selection of popular supervised classification algorithms (e.g., random forest) provided poor prediction of trajectory outcomes based on only transition-state vibrational quanta and energy features. However, these machine learning models provided more accurate predictions using atomic velocities and atomic positions, attaining ∼70% accuracy using initial conditions and between 85 and 95% accuracy at later reaction time steps. This increased accuracy allowed the feature importance analysis to reveal that, at the later-time analysis, the methylene bridge out-of-plane bending is correlated with trajectory outcomes for the formation of either the exo product or toward the diradical intermediate. Possible reasons for the struggle of machine learning algorithms to classify trajectories based on transition-state features is the heavily overlapping feature values, the finite but very large possible vibrational mode combinations, and the possibility of chaos as trajectories propagate. We examined this chaos by comparing a set of nearly identical trajectories that differed by only a very small scaling of the kinetic energies resulting from the transition-state reaction coordinate.

Modern quantum chemistry with [Open]Molcas

MOLCAS/OpenMolcas is an ab initio electronic structure program providing a large set of computational methods from Hartree-Fock and density functional theory to various implementations of multiconfigurational theory. This article provides a comprehensive overview of the main features of the code, specifically reviewing the use of the code in previously reported chemical applications as well as more recent applications including the calculation of magnetic properties from optimized density matrix renormalization group wave functions.