Machine learning builds full-QM precision protein force fields in seconds

Software Infrastructure for Next-Generation QM/MM-ΔMLP Force Fields

We present software infrastructure for the design and testing of new quantum mechanical/molecular mechanical and machine-learning potential (QM/MM-ΔMLP) force fields for a wide range of applications. The software integrates Amber's molecular dynamics simulation capabilities with fast, approximate quantum models in the xtb package and machine-learning potential corrections in DeePMD-kit. The xtb package implements the recently developed density-functional tight-binding QM models with multipolar electrostatics and density-dependent dispersion (GFN2-xTB), and the interface with Amber enables their use in periodic boundary QM/MM simulations with linear-scaling QM/MM particle-mesh Ewald electrostatics. The accuracy of the semiempirical models is enhanced by including machine-learning correction potentials (ΔMLPs) enabled through an interface with the DeePMD-kit software. The goal of this paper is to present and validate the implementation of this software infrastructure in molecular dynamics and free energy simulations. The utility of the new infrastructure is demonstrated in proof-of-concept example applications. The software elements presented here are open source and freely available. Their interface provides a powerful enabling technology for the design of new QM/MM-ΔMLP models for studying a wide range of problems, including biomolecular reactivity and protein-ligand binding.

Amber free energy tools: Interoperable software for free energy simulations using generalized quantum mechanical/molecular mechanical and machine learning potentials

We report the development and testing of new integrated cyberinfrastructure for performing free energy simulations with generalized hybrid quantum mechanical/molecular mechanical (QM/MM) and machine learning potentials (MLPs) in Amber. The Sander molecular dynamics program has been extended to leverage fast, density-functional tight-binding models implemented in the DFTB+ and xTB packages, and an interface to the DeePMD-kit software enables the use of MLPs. The software is integrated through application program interfaces that circumvent the need to perform "system calls" and enable the incorporation of long-range Ewald electrostatics into the external software's self-consistent field procedure. The infrastructure provides access to QM/MM models that may serve as the foundation for QM/MM-ΔMLP potentials, which supplement the semiempirical QM/MM model with a MLP correction trained to reproduce ab initio QM/MM energies and forces. Efficient optimization of minimum free energy pathways is enabled through a new surface-accelerated finite-temperature string method implemented in the FE-ToolKit package. Furthermore, we interfaced Sander with the i-PI software by implementing the socket communication protocol used in the i-PI client-server model. The new interface with i-PI allows for the treatment of nuclear quantum effects with semiempirical QM/MM-ΔMLP models. The modular interoperable software is demonstrated on proton transfer reactions in guanine-thymine mispairs in a B-form deoxyribonucleic acid helix. The current work represents a considerable advance in the development of modular software for performing free energy simulations of chemical reactions that are important in a wide range of applications.

Electronic and Nuclear Quantum Effects on Proton Transfer Reactions of Guanine-Thymine (G-T) Mispairs Using Combined Quantum Mechanical/Molecular Mechanical and Machine Learning Potentials

Rare tautomeric forms of nucleobases can lead to Watson-Crick-like (WC-like) mispairs in DNA, but the process of proton transfer is fast and difficult to detect experimentally. NMR studies show evidence for the existence of short-time WC-like guanine-thymine (G-T) mispairs; however, the mechanism of proton transfer and the degree to which nuclear quantum effects play a role are unclear. We use a B-DNA helix exhibiting a wGT mispair as a model system to study tautomerization reactions. We perform ab initio (PBE0/6-31G*) quantum mechanical/molecular mechanical (QM/MM) simulations to examine the free energy surface for tautomerization. We demonstrate that while the ab initio QM/MM simulations are accurate, considerable sampling is required to achieve high precision in the free energy barriers. To address this problem, we develop a QM/MM machine learning potential correction (QM/MM-ΔMLP) that is able to improve the computational efficiency, greatly extend the accessible time scales of the simulations, and enable practical application of path integral molecular dynamics to examine nuclear quantum effects. We find that the inclusion of nuclear quantum effects has only a modest effect on the mechanistic pathway but leads to a considerable lowering of the free energy barrier for the GT*⇌G*T equilibrium. Our results enable a rationalization of observed experimental data and the prediction of populations of rare tautomeric forms of nucleobases and rates of their interconversion in B-DNA.

Review and Comparative Analysis of Methods and Advancements in Predicting Protein Complex Structure

Protein complexes perform diverse biological functions, and obtaining their three-dimensional structure is critical to understanding and grasping their functions. In many cases, it's not just two proteins interacting to form a dimer; instead, multiple proteins interact to form a multimer. Experimentally resolving protein complex structures can be quite challenging. Recently, there have been efforts and methods that build upon prior predictions of dimer structures to attempt to predict multimer structures. However, in comparison to monomeric protein structure prediction, the accuracy of protein complex structure prediction remains relatively low. This paper provides an overview of recent advancements in efficient computational models for predicting protein complex structures. We introduce protein-protein docking methods in detail and summarize their main ideas, applicable modes, and related information. To enhance prediction accuracy, other critical protein-related information is also integrated, such as predicting interchain residue contact, utilizing experimental data like cryo-EM experiments, and considering protein interactions and non-interactions. In addition, we comprehensively review computational approaches for end-to-end prediction of protein complex structures based on artificial intelligence (AI) technology and describe commonly used datasets and representative evaluation metrics in protein complexes. Finally, we analyze the formidable challenges faced in current protein complex structure prediction tasks, including the structure prediction of heteromeric complex, disordered regions in complex, antibody-antigen complex, and RNA-related complex, as well as the evaluation metrics for complex assessment. We hope that this work will provide comprehensive knowledge of complex structure predictions to contribute to future advanced predictions.

Determining the mechanical and decomposition properties of high energetic materials (α-RDX, β-HMX, and ε-CL-20) using a neural network potential

Molecular simulations of high energetic materials (HEMs) are limited by efficiency and accuracy. Recently, neural network potential (NNP) models have achieved molecular simulations of millions of atoms while maintaining the accuracy of density functional theory (DFT) levels. Herein, an NNP model covering typical HEMs containing C, H, N, and O elements is developed. The mechanical and decomposition properties of 1,3,5-trinitroperhydro-1,3,5-triazine (RDX), hexahydro-1,3,5-trinitro-1,3,5-triazine (HMX), and 2,4,6,8,10,12-hexanitrohexaazaisowurtzitane (CL-20) are determined by employing the molecular dynamics (MD) simulations based on the NNP model. The calculated results show that the mechanical properties of α-RDX, β-HMX, and ε-CL-20 agree with previous experiments and theoretical results, including cell parameters, equations of state, and elastic constants. In the thermal decomposition simulations, it is also found that the initial decomposition reactions of the three crystals are N-NO2 homolysis, corresponding radical intermediates formation, and NO2-induced reactions. This decomposition trajectory is mainly divided into two stages separating from the peak of NO2: pyrolysis and oxidation. Overall, the NNP model for C/H/N/O elements in this work is an alternative reactive force field for RDX, HMX, and CL-20 HEMs, and it opens up new potential for future kinetic study of nitramine explosives.

MatGPT: A Vane of Materials Informatics from Past, Present, to Future

Combining materials science, artificial intelligence (AI), physical chemistry, and other disciplines, materials informatics is continuously accelerating the vigorous development of new materials. The emergence of "GPT (Generative Pre-trained Transformer) AI" shows that the scientific research field has entered the era of intelligent civilization with "data" as the basic factor and "algorithm + computing power" as the core productivity. The continuous innovation of AI will impact the cognitive laws and scientific methods, and reconstruct the knowledge and wisdom system. This leads to think more about materials informatics. Here, a comprehensive discussion of AI models and materials infrastructures is provided, and the advances in the discovery and design of new materials are reviewed. With the rise of new research paradigms triggered by "AI for Science", the vane of materials informatics: "MatGPT", is proposed and the technical path planning from the aspects of data, descriptors, generative models, pretraining models, directed design models, collaborative training, experimental robots, as well as the efforts and preparations needed to develop a new generation of materials informatics, is carried out. Finally, the challenges and constraints faced by materials informatics are discussed, in order to achieve a more digital, intelligent, and automated construction of materials informatics with the joint efforts of more interdisciplinary scientists.

RotNet: A Rotationally Invariant Graph Neural Network for Quantum Mechanical Calculations

Deep learning has proven promising in biological and chemical applications, aiding in accurate predictions of properties such as atomic forces, energies, and material band gaps. Traditional methods with rotational invariance, one of the most crucial physical laws for predictions made by machine learning, have relied on Fourier transforms or specialized convolution filters, leading to complex model design and reduced accuracy and efficiency. However, models without rotational invariance exhibit poor generalization ability across datasets. Addressing this contradiction, this work proposes a rotationally invariant graph neural network, named RotNet, for accurate and accelerated quantum mechanical calculations that can overcome the generalization deficiency caused by rotations of molecules. RotNet ensures rotational invariance through an effective transformation and learns distance and angular information from atomic coordinates. Benchmark experiments on three datasets (protein fragments, electronic materials, and QM9) demonstrate that the proposed RotNet framework outperforms popular baselines and generalizes well to spatial data with varying rotations. The high accuracy, efficiency, and fast convergence of RotNet suggest that it has tremendous potential to significantly facilitate studies of protein dynamics simulation and materials engineering while maintaining physical plausibility.

DeePMD-kit v2: A software package for deep potential models

DeePMD-kit is a powerful open-source software package that facilitates molecular dynamics simulations using machine learning potentials known as Deep Potential (DP) models. This package, which was released in 2017, has been widely used in the fields of physics, chemistry, biology, and material science for studying atomistic systems. The current version of DeePMD-kit offers numerous advanced features, such as DeepPot-SE, attention-based and hybrid descriptors, the ability to fit tensile properties, type embedding, model deviation, DP-range correction, DP long range, graphics processing unit support for customized operators, model compression, non-von Neumann molecular dynamics, and improved usability, including documentation, compiled binary packages, graphical user interfaces, and application programming interfaces. This article presents an overview of the current major version of the DeePMD-kit package, highlighting its features and technical details. Additionally, this article presents a comprehensive procedure for conducting molecular dynamics as a representative application, benchmarks the accuracy and efficiency of different models, and discusses ongoing developments.

Trends in in-silico guided engineering of efficient polyethylene terephthalate (PET) hydrolyzing enzymes to enable bio-recycling and upcycling of PET

Polyethylene terephthalate (PET) is the largest produced polyester globally, and less than 30% of all the PET produced globally (∼6 billion pounds annually) is currently recycled into lower-quality products. The major drawbacks in current recycling methods (mechanical and chemical), have inspired the exploration of potentially efficient and sustainable PET depolymerization using biological approaches. Researchers have discovered efficient PET hydrolyzing enzymes in the plastisphere and have demonstrated the selective degradation of PET to original monomers thus enabling biological recycling or upcycling. However, several significant hurdles such as the less efficiency of the hydrolytic reaction, low thermostability of the enzymes, and the inability of the enzyme to depolymerize crystalline PET must be addressed in order to establish techno-economically feasible commercial-scale biological PET recycling or upcycling processes. Researchers leverage a synthetic biology-based design; build, test, and learn (DBTL) methodology to develop commercially applicable efficient PET hydrolyzing enzymes through 1) high-throughput metagenomic and proteomic approaches to discover new PET hydrolyzing enzymes with superior properties: and, 2) enzyme engineering approaches to modify and optimize PET hydrolyzing properties. Recently, in-silico platforms including molecular mechanics and machine learning concepts are emerging as innovative tools for the development of more efficient and effective PET recycling through the exploration of novel mutations in PET hydrolyzing enzymes. In-silico-guided PET hydrolyzing enzyme engineering with DBTL cycles enables the rapid development of efficient variants of enzymes over tedious conventional enzyme engineering methods such as random or directed evolution. This review highlights the potential of in-silico-guided PET degrading enzyme engineering to create more efficient variants, including Ideonella sakaiensis PETase (IsPETase) and leaf-branch compost cutinases (LCC). Furthermore, future research prospects are discussed to enable a sustainable circular economy through the bioconversion of PET to original or high-value platform chemicals.

Clustered tree regression to learn protein energy change with mutated amino acid

Accurate and effective prediction of mutation-induced protein energy change remains a great challenge and of great interest in computational biology. However, high resource consumption and insufficient structural information of proteins severely limit the experimental techniques and structure-based prediction methods. Here, we design a structure-independent protocol to accurately and effectively predict the mutation-induced protein folding free energy change with only sequence, physicochemical and evolutionary features. The proposed clustered tree regression protocol is capable of effectively exploiting the inherent data patterns by integrating unsupervised feature clustering by K-means and supervised tree regression using XGBoost, and thus enabling fast and accurate protein predictions with different mutations, with an average Pearson correlation coefficient of 0.83 and an average root-mean-square error of 0.94kcal/mol. The proposed sequence-based method not only eliminates the dependence on protein structures, but also has potential applications in protein predictions with rare structural information.

End-to-end differentiable construction of molecular mechanics force fields

Molecular mechanics (MM) potentials have long been a workhorse of computational chemistry. Leveraging accuracy and speed, these functional forms find use in a wide variety of applications in biomolecular modeling and drug discovery, from rapid virtual screening to detailed free energy calculations. Traditionally, MM potentials have relied on human-curated, inflexible, and poorly extensible discrete chemical perception rules (atom types) for applying parameters to small molecules or biopolymers, making it difficult to optimize both types and parameters to fit quantum chemical or physical property data. Here, we propose an alternative approach that uses graph neural networks to perceive chemical environments, producing continuous atom embeddings from which valence and nonbonded parameters can be predicted using invariance-preserving layers. Since all stages are built from smooth neural functions, the entire process-spanning chemical perception to parameter assignment-is modular and end-to-end differentiable with respect to model parameters, allowing new force fields to be easily constructed, extended, and applied to arbitrary molecules. We show that this approach is not only sufficiently expressive to reproduce legacy atom types, but that it can learn to accurately reproduce and extend existing molecular mechanics force fields. Trained with arbitrary loss functions, it can construct entirely new force fields self-consistently applicable to both biopolymers and small molecules directly from quantum chemical calculations, with superior fidelity than traditional atom or parameter typing schemes. When adapted to simultaneously fit partial charge models, espaloma delivers high-quality partial atomic charges orders of magnitude faster than current best-practices with low inaccuracy. When trained on the same quantum chemical small molecule dataset used to parameterize the Open Force Field ("Parsley") openff-1.2.0 small molecule force field augmented with a peptide dataset, the resulting espaloma model shows superior accuracy vis-á-vis experiments in computing relative alchemical free energy calculations for a popular benchmark. This approach is implemented in the free and open source package espaloma, available at https://github.com/choderalab/espaloma.

An inductive transfer learning force field (ITLFF) protocol builds protein force fields in seconds

Accurate simulation of protein folding is a unique challenge in understanding the physical process of protein folding, with important implications for protein design and drug discovery. Molecular dynamics simulation strongly requires advanced force fields with high accuracy to achieve correct folding. However, the current force fields are inaccurate, inapplicable and inefficient. We propose a machine learning protocol, the inductive transfer learning force field (ITLFF), to construct protein force fields in seconds with any level of accuracy from a small dataset. This process is achieved by incorporating an inductive transfer learning algorithm into deep neural networks, which learn knowledge of any high-level calculations from a large dataset of low-level method. Here, we use a double-hybrid density functional theory (DFT) as a case functional, but ITLFF is suitable for any high-precision functional. The performance of the selected 18 proteins indicates that compared with the fragment-based double-hybrid DFT algorithm, the force field constructed by ITLFF achieves considerable accuracy with a mean absolute error of 0.0039 kcal/mol/atom for energy and a root mean square error of 2.57 $\mathrm{kcal}/\mathrm{mol}/{\AA}$ for force, and it is more than 30 000 times faster and obtains more significant efficiency benefits as the system increases. The outstanding performance of ITLFF provides promising prospects for accurate and efficient protein dynamic simulations and makes an important step toward protein folding simulation. Due to the ability of ITLFF to utilize the knowledge acquired in one task to solve related problems, it is also applicable for various problems in biology, chemistry and material science.

Quantum Mechanical-Based Stability Evaluation of Crystal Structures for HIV-Targeted Drug Cabotegravir

The long-acting parenteral formulation of the HIV integrase inhibitor cabotegravir (GSK744) is currently being developed to prevent HIV infections, benefiting from infrequent dosing and high efficacy. The crystal structure can affect the bioavailability and efficacy of cabotegravir. However, the stability determination of crystal structures of GSK744 have remained a challenge. Here, we introduced an ab initio protocol to determine the stability of the crystal structures of pharmaceutical molecules, which were obtained from crystal structure prediction process starting from the molecular diagram. Using GSK744 as a case study, the ab initio predicted that Gibbs free energy provides reliable further refinement of the predicted crystal structures and presents its capability for becoming a crystal stability determination approach in the future. The proposed work can assist in the comprehensive screening of pharmaceutical design and can provide structural predictions and stability evaluation for pharmaceutical crystals.