1
|
Rollins ZA, Widatalla T, Waight A, Cheng AC, Metwally E. AbLEF: antibody language ensemble fusion for thermodynamically empowered property predictions. Bioinformatics 2024; 40:btae268. [PMID: 38627249 PMCID: PMC11256947 DOI: 10.1093/bioinformatics/btae268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Revised: 03/27/2024] [Accepted: 04/23/2024] [Indexed: 05/08/2024] Open
Abstract
MOTIVATION Pre-trained protein language and/or structural models are often fine-tuned on drug development properties (i.e. developability properties) to accelerate drug discovery initiatives. However, these models generally rely on a single structural conformation and/or a single sequence as a molecular representation. We present a physics-based model, whereby 3D conformational ensemble representations are fused by a transformer-based architecture and concatenated to a language representation to predict antibody protein properties. Antibody language ensemble fusion enables the direct infusion of thermodynamic information into latent space and this enhances property prediction by explicitly infusing dynamic molecular behavior that occurs during experimental measurement. RESULTS We showcase the antibody language ensemble fusion model on two developability properties: hydrophobic interaction chromatography retention time and temperature of aggregation (Tagg). We find that (i) 3D conformational ensembles that are generated from molecular simulation can further improve antibody property prediction for small datasets, (ii) the performance benefit from 3D conformational ensembles matches shallow machine learning methods in the small data regime, and (iii) fine-tuned large protein language models can match smaller antibody-specific language models at predicting antibody properties. AVAILABILITY AND IMPLEMENTATION AbLEF codebase is available at https://github.com/merck/AbLEF.
Collapse
Affiliation(s)
- Zachary A Rollins
- Modeling and Informatics, Merck & Co., Inc, South San Francisco, CA, 94080, United States
| | - Talal Widatalla
- Modeling and Informatics, Merck & Co., Inc, South San Francisco, CA, 94080, United States
| | - Andrew Waight
- Discovery Biologics, Merck & Co., Inc, South San Francisco, CA, 94080, United States
| | - Alan C Cheng
- Modeling and Informatics, Merck & Co., Inc, South San Francisco, CA, 94080, United States
| | - Essam Metwally
- Modeling and Informatics, Merck & Co., Inc, South San Francisco, CA, 94080, United States
| |
Collapse
|
2
|
Yao S, Song J, Jia L, Cheng L, Zhong Z, Song M, Feng Z. Fast and effective molecular property prediction with transferability map. Commun Chem 2024; 7:85. [PMID: 38632308 PMCID: PMC11024153 DOI: 10.1038/s42004-024-01169-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Accepted: 04/05/2024] [Indexed: 04/19/2024] Open
Abstract
Effective transfer learning for molecular property prediction has shown considerable strength in addressing insufficient labeled molecules. Many existing methods either disregard the quantitative relationship between source and target properties, risking negative transfer, or require intensive training on target tasks. To quantify transferability concerning task-relatedness, we propose Principal Gradient-based Measurement (PGM) for transferring molecular property prediction ability. First, we design an optimization-free scheme to calculate a principal gradient for approximating the direction of model optimization on a molecular property prediction dataset. We have analyzed the close connection between the principal gradient and model optimization through mathematical proof. PGM measures the transferability as the distance between the principal gradient obtained from the source dataset and that derived from the target dataset. Then, we perform PGM on various molecular property prediction datasets to build a quantitative transferability map for source dataset selection. Finally, we evaluate PGM on multiple combinations of transfer learning tasks across 12 benchmark molecular property prediction datasets and demonstrate that it can serve as fast and effective guidance to improve the performance of a target task. This work contributes to more efficient discovery of drugs, materials, and catalysts by offering a task-relatedness quantification prior to transfer learning and understanding the relationship between chemical properties.
Collapse
Affiliation(s)
- Shaolun Yao
- Collaborative Innovation Center of Artificial Intelligence by MOE and Zhejiang Provincial Government, Zhejiang University, 310027, Hangzhou, China
- College of Computer Science and Technology, Zhejiang University, 310027, Hangzhou, China
- Shanghai Institute for Advanced Study of Zhejiang University, 201203, Shanghai, China
| | - Jie Song
- Shanghai Institute for Advanced Study of Zhejiang University, 201203, Shanghai, China
- School of Software Technology, Zhejiang University, 315048, Ningbo, China
| | - Lingxiang Jia
- College of Computer Science and Technology, Zhejiang University, 310027, Hangzhou, China
| | - Lechao Cheng
- School of Computer Science and Information Engineering, Hefei University of Technology, 230009, Hefei, China
| | - Zipeng Zhong
- College of Computer Science and Technology, Zhejiang University, 310027, Hangzhou, China
| | - Mingli Song
- College of Computer Science and Technology, Zhejiang University, 310027, Hangzhou, China
- Shanghai Institute for Advanced Study of Zhejiang University, 201203, Shanghai, China
| | - Zunlei Feng
- Shanghai Institute for Advanced Study of Zhejiang University, 201203, Shanghai, China.
- School of Software Technology, Zhejiang University, 315048, Ningbo, China.
| |
Collapse
|
3
|
Roth JP, Bajorath J. Relationship between prediction accuracy and uncertainty in compound potency prediction using deep neural networks and control models. Sci Rep 2024; 14:6536. [PMID: 38503823 PMCID: PMC10950896 DOI: 10.1038/s41598-024-57135-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2023] [Accepted: 03/14/2024] [Indexed: 03/21/2024] Open
Abstract
The assessment of prediction variance or uncertainty contributes to the evaluation of machine learning models. In molecular machine learning, uncertainty quantification is an evolving area of research where currently no standard approaches or general guidelines are available. We have carried out a detailed analysis of deep neural network variants and simple control models for compound potency prediction to study relationships between prediction accuracy and uncertainty. For comparably accurate predictions obtained with models of different complexity, highly variable prediction uncertainties were detected using different metrics. Furthermore, a strong dependence of prediction characteristics and uncertainties on potency levels of test compounds was observed, often leading to over- or under-confident model decisions with respect to the expected variance of predictions. Moreover, neural network models responded very differently to training set modifications. Taken together, our findings indicate that there is only little, if any correlation between compound potency prediction accuracy and uncertainty, especially for deep neural network models, when predictions are assessed on the basis of currently used metrics for uncertainty quantification.
Collapse
Affiliation(s)
- Jannik P Roth
- Department of Life Science Informatics and Data Science, B-IT, LIMES Program Unit Chemical Biology and Medicinal Chemistry, Rheinische Friedrich-Wilhelms-Universität, Friedrich-Hirzebruch-Allee 5/6, 53115, Bonn, Germany
| | - Jürgen Bajorath
- Department of Life Science Informatics and Data Science, B-IT, LIMES Program Unit Chemical Biology and Medicinal Chemistry, Rheinische Friedrich-Wilhelms-Universität, Friedrich-Hirzebruch-Allee 5/6, 53115, Bonn, Germany.
| |
Collapse
|
4
|
Isakova AM, Kovalenko AA, Skorb EV, Shityakov S. NeuroClick: software for mimicking click reaction to generate drug-like molecules permeating the blood-brain barrier. Future Med Chem 2024; 16:389-398. [PMID: 38372134 DOI: 10.4155/fmc-2023-0017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 01/17/2024] [Indexed: 02/20/2024] Open
Abstract
Background: Traditional methods for chemical library generation in virtual screening often impose limitations on the accessible chemical space or produce synthetically irrelevant structures. Incorporating common chemical reactions into generative algorithms could offer significant benefits. Materials & methods: In this study, we developed NeuroClick, a graphical user interface software designed to perform in silico azide-alkyne cycloaddition, a widely utilized synthetic approach in modern medicinal chemistry. Results & conclusion: NeuroClick facilitates the generation and filtering of large combinatorial libraries at a remarkable rate of 10,000 molecules per minute. Moreover, the generated products can be filtered to identify subsets of pharmaceutically relevant compounds based on Lipinski's rule of five and blood-brain barrier permeability prediction. We demonstrate the utility of NeuroClick by generating and filtering several thousand molecules for dopamine D3 receptor ligand screening.
Collapse
Affiliation(s)
- Anastasiia M Isakova
- Laboratory of Chemoinformatics, Infochemistry Scientific Center, ITMO University, Saint Petersburg, Russian Federation
| | - Alexander A Kovalenko
- Laboratory of Chemoinformatics, Infochemistry Scientific Center, ITMO University, Saint Petersburg, Russian Federation
| | - Ekaterina V Skorb
- Laboratory of Chemoinformatics, Infochemistry Scientific Center, ITMO University, Saint Petersburg, Russian Federation
| | - Sergey Shityakov
- Laboratory of Chemoinformatics, Infochemistry Scientific Center, ITMO University, Saint Petersburg, Russian Federation
| |
Collapse
|
5
|
Nigam A, Pollice R, Friederich P, Aspuru-Guzik A. Artificial design of organic emitters via a genetic algorithm enhanced by a deep neural network. Chem Sci 2024; 15:2618-2639. [PMID: 38362419 PMCID: PMC10866360 DOI: 10.1039/d3sc05306g] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2023] [Accepted: 01/10/2024] [Indexed: 02/17/2024] Open
Abstract
The design of molecules requires multi-objective optimizations in high-dimensional chemical space with often conflicting target properties. To navigate this space, classical workflows rely on the domain knowledge and creativity of human experts, which can be the bottleneck in high-throughput approaches. Herein, we present an artificial molecular design workflow relying on a genetic algorithm and a deep neural network to find a new family of organic emitters with inverted singlet-triplet gaps and appreciable fluorescence rates. We combine high-throughput virtual screening and inverse design infused with domain knowledge and artificial intelligence to accelerate molecular generation significantly. This enabled us to explore more than 800 000 potential emitter molecules and find more than 10 000 candidates estimated to have inverted singlet-triplet gaps (INVEST) and appreciable fluorescence rates, many of which likely emit blue light. This class of molecules has the potential to realize a new generation of organic light-emitting diodes.
Collapse
Affiliation(s)
- AkshatKumar Nigam
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto 80 St. George St Toronto Ontario M5S 3H6 Canada
- Department of Computer Science, University of Toronto 40 St. George St Toronto Ontario M5S 2E4 Canada
| | - Robert Pollice
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto 80 St. George St Toronto Ontario M5S 3H6 Canada
- Department of Computer Science, University of Toronto 40 St. George St Toronto Ontario M5S 2E4 Canada
| | - Pascal Friederich
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto 80 St. George St Toronto Ontario M5S 3H6 Canada
- Department of Computer Science, University of Toronto 40 St. George St Toronto Ontario M5S 2E4 Canada
- Institute of Nanotechnology, Karlsruhe Institute of Technology Hermann-von-Helmholtz-Platz 1 76344 Eggenstein-Leopoldshafen Germany
- Institute of Theoretical Informatics, Karlsruhe Institute of Technology Am Fasanengarten 5 76131 Karlsruhe Germany
| | - Alán Aspuru-Guzik
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto 80 St. George St Toronto Ontario M5S 3H6 Canada
- Department of Computer Science, University of Toronto 40 St. George St Toronto Ontario M5S 2E4 Canada
- Vector Institute for Artificial Intelligence 661 University Ave Suite 710 Toronto Ontario M5G 1M1 Canada
- Department of Chemical Engineering & Applied Chemistry, University of Toronto 200 College St. Ontario M5S 3E5 Canada
- Department of Materials Science & Engineering, University of Toronto, 184 College St. Ontario M5S 3E4 Canada
- Lebovic Fellow, Canadian Institute for Advanced Research (CIFAR) 661 University Ave Toronto Ontario M5G Canada
- Acceleration Consortium Toronto Ontario M5G 3H6 Canada
| |
Collapse
|
6
|
Busk J, Schmidt MN, Winther O, Vegge T, Jørgensen PB. Graph neural network interatomic potential ensembles with calibrated aleatoric and epistemic uncertainty on energy and forces. Phys Chem Chem Phys 2023; 25:25828-25837. [PMID: 37724552 DOI: 10.1039/d3cp02143b] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/21/2023]
Abstract
Inexpensive machine learning (ML) potentials are increasingly being used to speed up structural optimization and molecular dynamics simulations of materials by iteratively predicting and applying interatomic forces. In these settings, it is crucial to detect when predictions are unreliable to avoid wrong or misleading results. Here, we present a complete framework for training and recalibrating graph neural network ensemble models to produce accurate predictions of energy and forces with calibrated uncertainty estimates. The proposed method considers both epistemic and aleatoric uncertainty and the total uncertainties are recalibrated post hoc using a nonlinear scaling function to achieve good calibration on previously unseen data, without loss of predictive accuracy. The method is demonstrated and evaluated on two challenging, publicly available datasets, ANI-1x (Smith et al. J. Chem. Phys., 2018, 148, 241733.) and Transition1x (Schreiner et al. Sci. Data, 2022, 9, 779.), both containing diverse conformations far from equilibrium. A detailed analysis of the predictive performance and uncertainty calibration is provided. In all experiments, the proposed method achieved low prediction error and good uncertainty calibration, with predicted uncertainty correlating with expected error, on energy and forces. To the best of our knowledge, the method presented in this paper is the first to consider a complete framework for obtaining calibrated epistemic and aleatoric uncertainty predictions on both energy and forces in ML potentials.
Collapse
Affiliation(s)
- Jonas Busk
- Department of Energy Conversion and Storage, Technical University of Denmark, Kongens Lyngby, Denmark.
| | - Mikkel N Schmidt
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kongens Lyngby, Denmark.
| | - Ole Winther
- Department of Applied Mathematics and Computer Science, Technical University of Denmark, Kongens Lyngby, Denmark.
- Center for Genomic Medicine, Rigshospitalet, Copenhagen University Hospital, Denmark
- Bioinformatics Centre, Department of Biology, University of Copenhagen, Denmark
| | - Tejs Vegge
- Department of Energy Conversion and Storage, Technical University of Denmark, Kongens Lyngby, Denmark.
| | - Peter Bjørn Jørgensen
- Department of Energy Conversion and Storage, Technical University of Denmark, Kongens Lyngby, Denmark.
| |
Collapse
|
7
|
Oliveira FL, Cleeton C, Neumann Barros Ferreira R, Luan B, Farmahini AH, Sarkisov L, Steiner M. CRAFTED: An exploratory database of simulated adsorption isotherms of metal-organic frameworks. Sci Data 2023; 10:230. [PMID: 37081024 PMCID: PMC10119274 DOI: 10.1038/s41597-023-02116-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Accepted: 03/28/2023] [Indexed: 04/22/2023] Open
Abstract
Grand Canonical Monte Carlo is an important method for performing molecular-level simulations and assisting the study and development of nanoporous materials for gas capture applications. These simulations are based on the use of force fields and partial charges to model the interaction between the adsorbent molecules and the solid framework. The choice of the force field parameters and partial charges can significantly impact the results obtained, however, there are very few databases available to support a comprehensive impact evaluation. Here, we present a database of simulations of CO2 and N2 adsorption isotherms on 690 metal-organic frameworks taken from the CoRE MOF 2014 database. We performed simulations with two force fields (UFF and DREIDING), six partial charge schemes (no charges, Qeq, EQeq, MPNN, PACMOF, and DDEC), and three temperatures (273, 298, 323 K). The resulting isotherms compose the Charge-dependent, Reproducible, Accessible, Forcefield-dependent, and Temperature-dependent Exploratory Database (CRAFTED) of adsorption isotherms.
Collapse
Affiliation(s)
- Felipe Lopes Oliveira
- IBM Research, Av. República do Chile, 330, CEP 20031-170, Rio de Janeiro, RJ, Brazil
- Department of Organic Chemistry, Instituto de Química, Universidade Federal do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
| | - Conor Cleeton
- Department of Chemical Engineering, Engineering A, the University of Manchester, Manchester, M13 9PL, United Kingdom
| | | | - Binquan Luan
- IBM Research, 1101 Kitchawan Road, Yorktown Heights, 10598, NY, United States of America
| | - Amir H Farmahini
- Department of Chemical Engineering, Engineering A, the University of Manchester, Manchester, M13 9PL, United Kingdom
| | - Lev Sarkisov
- Department of Chemical Engineering, Engineering A, the University of Manchester, Manchester, M13 9PL, United Kingdom
| | - Mathias Steiner
- IBM Research, Av. República do Chile, 330, CEP 20031-170, Rio de Janeiro, RJ, Brazil
| |
Collapse
|
8
|
Luukkonen S, van den Maagdenberg HW, Emmerich MTM, van Westen GJP. Artificial intelligence in multi-objective drug design. Curr Opin Struct Biol 2023; 79:102537. [PMID: 36774727 DOI: 10.1016/j.sbi.2023.102537] [Citation(s) in RCA: 19] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2022] [Revised: 12/21/2022] [Accepted: 01/03/2023] [Indexed: 02/12/2023]
Abstract
The factors determining a drug's success are manifold, making de novo drug design an inherently multi-objective optimisation (MOO) problem. With the advent of machine learning and optimisation methods, the field of multi-objective compound design has seen a rapid increase in developments and applications. Population-based metaheuris-tics and deep reinforcement learning are the most commonly used artificial intelligence methods in the field, but recently conditional learning methods are gaining popularity. The former approaches are coupled with a MOO strat-egy which is most commonly an aggregation function, but Pareto-based strategies are widespread too. Besides these and conditional learning, various innovative approaches to tackle MOO in drug design have been proposed. Here we provide a brief overview of the field and the latest innovations.
Collapse
Affiliation(s)
- Sohvi Luukkonen
- Leiden Academic Centre for Drug Research, Leiden University, Einsteinweg 55, Leiden, 2333 CC, the Netherlands. https://twitter.com/sohvi_luukkonen
| | - Helle W van den Maagdenberg
- Leiden Academic Centre for Drug Research, Leiden University, Einsteinweg 55, Leiden, 2333 CC, the Netherlands
| | - Michael T M Emmerich
- Leiden Institute of Advanced Computer Science, Leiden University, Niels Bohrweg 1, Leiden, 2333 CC, the Netherlands
| | - Gerard J P van Westen
- Leiden Academic Centre for Drug Research, Leiden University, Einsteinweg 55, Leiden, 2333 CC, the Netherlands.
| |
Collapse
|
9
|
Chen Y, Ou Y, Zheng P, Huang Y, Ge F, Dral PO. Benchmark of general-purpose machine learning-based quantum mechanical method AIQM1 on reaction barrier heights. J Chem Phys 2023; 158:074103. [PMID: 36813722 DOI: 10.1063/5.0137101] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023] Open
Abstract
Artificial intelligence-enhanced quantum mechanical method 1 (AIQM1) is a general-purpose method that was shown to achieve high accuracy for many applications with a speed close to its baseline semiempirical quantum mechanical (SQM) method ODM2*. Here, we evaluate the hitherto unknown performance of out-of-the-box AIQM1 without any refitting for reaction barrier heights on eight datasets, including a total of ∼24 thousand reactions. This evaluation shows that AIQM1's accuracy strongly depends on the type of transition state and ranges from excellent for rotation barriers to poor for, e.g., pericyclic reactions. AIQM1 clearly outperforms its baseline ODM2* method and, even more so, a popular universal potential, ANI-1ccx. Overall, however, AIQM1 accuracy largely remains similar to SQM methods (and B3LYP/6-31G* for most reaction types) suggesting that it is desirable to focus on improving AIQM1 performance for barrier heights in the future. We also show that the built-in uncertainty quantification helps in identifying confident predictions. The accuracy of confident AIQM1 predictions is approaching the level of popular density functional theory methods for most reaction types. Encouragingly, AIQM1 is rather robust for transition state optimizations, even for the type of reactions it struggles with the most. Single-point calculations with high-level methods on AIQM1-optimized geometries can be used to significantly improve barrier heights, which cannot be said for its baseline ODM2* method.
Collapse
Affiliation(s)
- Yuxinxin Chen
- State Key Laboratory of Physical Chemistry of Solid Surfaces, Fujian Provincial Key Laboratory of Theoretical and Computational Chemistry, Department of Chemistry, and College of Chemistry and Chemical Engineering, Xiamen University, Xiamen 361005, China
| | - Yanchi Ou
- State Key Laboratory of Physical Chemistry of Solid Surfaces, Fujian Provincial Key Laboratory of Theoretical and Computational Chemistry, Department of Chemistry, and College of Chemistry and Chemical Engineering, Xiamen University, Xiamen 361005, China
| | - Peikun Zheng
- State Key Laboratory of Physical Chemistry of Solid Surfaces, Fujian Provincial Key Laboratory of Theoretical and Computational Chemistry, Department of Chemistry, and College of Chemistry and Chemical Engineering, Xiamen University, Xiamen 361005, China
| | - Yaohuang Huang
- State Key Laboratory of Physical Chemistry of Solid Surfaces, Fujian Provincial Key Laboratory of Theoretical and Computational Chemistry, Department of Chemistry, and College of Chemistry and Chemical Engineering, Xiamen University, Xiamen 361005, China
| | - Fuchun Ge
- State Key Laboratory of Physical Chemistry of Solid Surfaces, Fujian Provincial Key Laboratory of Theoretical and Computational Chemistry, Department of Chemistry, and College of Chemistry and Chemical Engineering, Xiamen University, Xiamen 361005, China
| | - Pavlo O Dral
- State Key Laboratory of Physical Chemistry of Solid Surfaces, Fujian Provincial Key Laboratory of Theoretical and Computational Chemistry, Department of Chemistry, and College of Chemistry and Chemical Engineering, Xiamen University, Xiamen 361005, China
| |
Collapse
|
10
|
Yang CI, Li YP. Explainable uncertainty quantifications for deep learning-based molecular property prediction. J Cheminform 2023; 15:13. [PMID: 36737786 PMCID: PMC9898940 DOI: 10.1186/s13321-023-00682-3] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2022] [Accepted: 01/15/2023] [Indexed: 02/05/2023] Open
Abstract
Quantifying uncertainty in machine learning is important in new research areas with scarce high-quality data. In this work, we develop an explainable uncertainty quantification method for deep learning-based molecular property prediction. This method can capture aleatoric and epistemic uncertainties separately and attribute the uncertainties to atoms present in the molecule. The atom-based uncertainty method provides an extra layer of chemical insight to the estimated uncertainties, i.e., one can analyze individual atomic uncertainty values to diagnose the chemical component that introduces uncertainty to the prediction. Our experiments suggest that atomic uncertainty can detect unseen chemical structures and identify chemical species whose data are potentially associated with significant noise. Furthermore, we propose a post-hoc calibration method to refine the uncertainty quantified by ensemble models for better confidence interval estimates. This work improves uncertainty calibration and provides a framework for assessing whether and why a prediction should be considered unreliable.
Collapse
Affiliation(s)
- Chu-I Yang
- grid.19188.390000 0004 0546 0241Department of Chemical Engineering, National Taiwan University, No. 1, Sec. 4, Roosevelt Road, Taipei, 10617 Taiwan
| | - Yi-Pei Li
- grid.19188.390000 0004 0546 0241Department of Chemical Engineering, National Taiwan University, No. 1, Sec. 4, Roosevelt Road, Taipei, 10617 Taiwan ,grid.28665.3f0000 0001 2287 1366Taiwan International Graduate Program (TIGP), Academia Sinica, No. 128, Sec. 2, Academia Road, Taipei, 11529 Taiwan
| |
Collapse
|
11
|
Xia S, Zhang D, Zhang Y. Multitask Deep Ensemble Prediction of Molecular Energetics in Solution: From Quantum Mechanics to Experimental Properties. J Chem Theory Comput 2023; 19:10.1021/acs.jctc.2c01024. [PMID: 36607141 PMCID: PMC10323048 DOI: 10.1021/acs.jctc.2c01024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
The past few years have witnessed significant advances in developing machine learning methods for molecular energetics predictions, including calculated electronic energies with high-level quantum mechanical methods and experimental properties, such as solvation free energy and logP. Typically, task-specific machine learning models are developed for distinct prediction tasks. In this work, we present a multitask deep ensemble model, sPhysNet-MT-ens5, which can simultaneously and accurately predict electronic energies of molecules in gas, water, and octanol phases, as well as transfer free energies at both calculated and experimental levels. On the calculated data set Frag20-solv-678k, which is developed in this work and contains 678,916 molecular conformations, up to 20 heavy atoms, and their properties calculated at B3LYP/6-31G* level of theory with continuum solvent models, sPhysNet-MT-ens5 predicts density functional theory (DFT)-level electronic energies directly from force field-optimized geometry within chemical accuracy. On the experimental data sets, sPhysNet-MT-ens5 achieves state-of-the-art performances, which predict both experimental hydration free energy with a RMSE of 0.620 kcal/mol on the FreeSolv data set and experimental logP with a RMSE of 0.393 on the PHYSPROP data set. Furthermore, sPhysNet-MT-ens5 also provides a reasonable estimation of model uncertainty which shows correlations with prediction error. Finally, by analyzing the atomic contributions of its predictions, we find that the developed deep learning model is aware of the chemical environment of each atom by assigning reasonable atomic contributions consistent with our chemical knowledge.
Collapse
Affiliation(s)
- Song Xia
- Department of Chemistry, New York University, New York, New York 10003, United States
| | - Dongdong Zhang
- Department of Chemistry, New York University, New York, New York 10003, United States
| | - Yingkai Zhang
- Department of Chemistry, New York University, New York, New York 10003, United States
- Simons Center for Computational Physical Chemistry at New York University, New York, New York 10003, United States
- NYU-ECNU Center for Computational Chemistry at NYU Shanghai, Shanghai 200062, China
| |
Collapse
|
12
|
Developing a Naïve Bayesian Classification Model with PI3Kγ structural features for virtual screening against PI3Kγ: Combining molecular docking and pharmacophore based on multiple PI3Kγ conformations. Eur J Med Chem 2022; 244:114824. [DOI: 10.1016/j.ejmech.2022.114824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2022] [Revised: 09/28/2022] [Accepted: 10/01/2022] [Indexed: 11/21/2022]
|
13
|
Deep generative molecular design reshapes drug discovery. Cell Rep Med 2022; 3:100794. [PMID: 36306797 PMCID: PMC9797947 DOI: 10.1016/j.xcrm.2022.100794] [Citation(s) in RCA: 34] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Revised: 08/05/2022] [Accepted: 09/30/2022] [Indexed: 11/05/2022]
Abstract
Recent advances and accomplishments of artificial intelligence (AI) and deep generative models have established their usefulness in medicinal applications, especially in drug discovery and development. To correctly apply AI, the developer and user face questions such as which protocols to consider, which factors to scrutinize, and how the deep generative models can integrate the relevant disciplines. This review summarizes classical and newly developed AI approaches, providing an updated and accessible guide to the broad computational drug discovery and development community. We introduce deep generative models from different standpoints and describe the theoretical frameworks for representing chemical and biological structures and their applications. We discuss the data and technical challenges and highlight future directions of multimodal deep generative models for accelerating drug discovery.
Collapse
|
14
|
Krenn M, Pollice R, Guo SY, Aldeghi M, Cervera-Lierta A, Friederich P, dos Passos Gomes G, Häse F, Jinich A, Nigam A, Yao Z, Aspuru-Guzik A. On scientific understanding with artificial intelligence. NATURE REVIEWS. PHYSICS 2022; 4:761-769. [PMID: 36247217 PMCID: PMC9552145 DOI: 10.1038/s42254-022-00518-3] [Citation(s) in RCA: 33] [Impact Index Per Article: 16.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 08/30/2022] [Indexed: 05/27/2023]
Abstract
An oracle that correctly predicts the outcome of every particle physics experiment, the products of every possible chemical reaction or the function of every protein would revolutionize science and technology. However, scientists would not be entirely satisfied because they would want to comprehend how the oracle made these predictions. This is scientific understanding, one of the main aims of science. With the increase in the available computational power and advances in artificial intelligence, a natural question arises: how can advanced computational systems, and specifically artificial intelligence, contribute to new scientific understanding or gain it autonomously? Trying to answer this question, we adopted a definition of 'scientific understanding' from the philosophy of science that enabled us to overview the scattered literature on the topic and, combined with dozens of anecdotes from scientists, map out three dimensions of computer-assisted scientific understanding. For each dimension, we review the existing state of the art and discuss future developments. We hope that this Perspective will inspire and focus research directions in this multidisciplinary emerging field.
Collapse
Affiliation(s)
- Mario Krenn
- Max Planck Institute for the Science of Light (MPL), Erlangen, Germany
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
- Department of Computer Science, University of Toronto, Toronto, Ontario Canada
- Vector Institute for Artificial Intelligence, Toronto, Ontario Canada
| | - Robert Pollice
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
- Department of Computer Science, University of Toronto, Toronto, Ontario Canada
| | - Si Yue Guo
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
| | - Matteo Aldeghi
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
- Department of Computer Science, University of Toronto, Toronto, Ontario Canada
- Vector Institute for Artificial Intelligence, Toronto, Ontario Canada
| | - Alba Cervera-Lierta
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
- Department of Computer Science, University of Toronto, Toronto, Ontario Canada
| | - Pascal Friederich
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
- Department of Computer Science, University of Toronto, Toronto, Ontario Canada
- Institute of Nanotechnology, Karlsruhe Institute of Technology, Eggenstein-Leopoldshafen, Germany
| | - Gabriel dos Passos Gomes
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
- Department of Computer Science, University of Toronto, Toronto, Ontario Canada
| | - Florian Häse
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
- Department of Computer Science, University of Toronto, Toronto, Ontario Canada
- Vector Institute for Artificial Intelligence, Toronto, Ontario Canada
- Department of Chemistry and Chemical Biology, Harvard University, Cambridge, MA USA
| | - Adrian Jinich
- Division of Infectious Diseases, Weill Department of Medicine, Weill Cornell Medical College, New York, USA
| | - AkshatKumar Nigam
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
- Department of Computer Science, University of Toronto, Toronto, Ontario Canada
| | - Zhenpeng Yao
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
- Center of Hydrogen Science, Shanghai Jiao Tong University, Shanghai, China
- State Key Laboratory of Metal Matrix Composites, School of Materials Science and Engineering, Shanghai Jiao Tong University, Shanghai, China
- Innovation Center for Future Materials, Zhangjiang Institute for Advanced Study, Shanghai Jiao Tong University, Shanghai, China
| | - Alán Aspuru-Guzik
- Chemical Physics Theory Group, Department of Chemistry, University of Toronto, Toronto, Ontario Canada
- Department of Computer Science, University of Toronto, Toronto, Ontario Canada
- Vector Institute for Artificial Intelligence, Toronto, Ontario Canada
- Canadian Institute for Advanced Research (CIFAR) Lebovic Fellow, Toronto, Ontario Canada
| |
Collapse
|
15
|
Thiede LA, Krenn M, Nigam A, Aspuru-Guzik A. Curiosity in exploring chemical spaces: Intrinsicrewards for molecular reinforcement learning. MACHINE LEARNING: SCIENCE AND TECHNOLOGY 2022. [DOI: 10.1088/2632-2153/ac7ddc] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022] Open
Abstract
Abstract
Computer aided design of molecules has the potential to disrupt the field of drug and material discovery. Machine learning and deep learning in particular, made big strides in recent years and promises to greatly benefit computer aided methods. Reinforcement learning is a particularly promising approach since it enables de novo molecule design, that is molecular design, without providing any prior knowledge. However, the search space is vast, and therefore any reinforcement learning agent needs to perform efficient exploration. In this study, we examine three versions of intrinsic motivation to aid efficient exploration. The algorithms are adapted from intrinsic motivation in the literature that were developed in other settings, predominantly video games. We show that the \textit{curious} agents finds better performing molecules on two of three benchmarks. This indicates an exciting new research direction for reinforcement learning agents that can explore the chemical space out of their own motivation. This has the potential to eventually lead to unexpected new molecular designs no human has thought about so far.
Collapse
|
16
|
Aouichaoui ARN, Mansouri SS, Abildskov J, Sin G. Uncertainty estimation in deep learning‐based property models: Graph neural networks applied to the critical properties. AIChE J 2022. [DOI: 10.1002/aic.17696] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Adem R. N. Aouichaoui
- Department of Chemical and Biochemical Engineering Technical University of Denmark Lyngby Denmark
| | - Seyed Soheil Mansouri
- Department of Chemical and Biochemical Engineering Technical University of Denmark Lyngby Denmark
| | - Jens Abildskov
- Department of Chemical and Biochemical Engineering Technical University of Denmark Lyngby Denmark
| | - Gürkan Sin
- Department of Chemical and Biochemical Engineering Technical University of Denmark Lyngby Denmark
| |
Collapse
|
17
|
A Novel Molecular Representation Learning for Molecular Property Prediction with a Multiple SMILES-Based Augmentation. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:8464452. [PMID: 35178082 PMCID: PMC8843876 DOI: 10.1155/2022/8464452] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Revised: 12/15/2021] [Accepted: 12/27/2021] [Indexed: 11/17/2022]
Abstract
Deep learning has brought a rapid development in the aspect of molecular representation for various tasks, such as molecular property prediction. The prediction of molecular properties is a crucial task in the field of drug discovery for finding specific drugs with good pharmacological activity and pharmacokinetic properties. SMILES string is always used as a kind of character approach in deep neural network models, inspired by natural language processing techniques. However, the deep learning models are hindered by the nonunique nature of the SMILES string. To efficiently learn molecular features along all message paths, in this paper we encode multiple SMILES for every molecule as an automated data augmentation for the prediction of molecular properties, which alleviates the overfitting problem caused by the small amount of data in the datasets of molecular property prediction. As a result, by using the multiple SMILES-based augmentation, we obtained better molecular representation and showed superior performance in the tasks of predicting molecular properties.
Collapse
|
18
|
Liu R, Li J, Xiao S, Zhang D, He T, Cheng J, Zhu X. Authentic Intelligent Machine for Scaling Driven Discovery: A Case for Chiral Quantum Dots. ACS NANO 2022; 16:1600-1611. [PMID: 34978184 DOI: 10.1021/acsnano.1c10299] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The scaling laws have long been used as evidence of science where many fundamental physics laws emerge. As emerging nanomaterials, quantum dots are also sensitive to scaling because of their strong size effect. In this work, we developed the chiral dielectric theory based on the exciton absorption mechanism to explain the increment of the dielectric constant from chirality via its dimensionality. To help researchers discover and develop scaling relevant theories, the Authentic Intelligent Machine (AIM) protocol was developed to generate and interpret experimental data in an analytical and scaling-oriented manner. We show how the AIM protocol interprets spectra such as transient absorption data of chiral quantum dots with theories, where discrepancies concerning the dielectric constant were discovered. Examples for applying the AIM protocol on other spectra, such as absorption spectra and photoluminescence spectra, are also given.
Collapse
Affiliation(s)
- Rulin Liu
- School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, Shenzhen, Guangdong 518172, China
| | - Jiagen Li
- Shenzhen Institute of Artificial Intelligence and Robotics for Society (AIRS), Shenzhen, Guangdong 518172, China
| | - Shuyu Xiao
- College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen, Guangdong 518060, China
| | - Dongxiang Zhang
- Shenzhen Institute of Artificial Intelligence and Robotics for Society (AIRS), Shenzhen, Guangdong 518172, China
- School of Materials Science and Engineering, Hubei University, Wuhan, Hubei 430062, China
| | - Tingchao He
- College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen, Guangdong 518060, China
| | - Jiaji Cheng
- School of Materials Science and Engineering, Hubei University, Wuhan, Hubei 430062, China
| | - Xi Zhu
- School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, Shenzhen, Guangdong 518172, China
- Shenzhen Institute of Artificial Intelligence and Robotics for Society (AIRS), Shenzhen, Guangdong 518172, China
| |
Collapse
|
19
|
Nigam A, Pollice R, Aspuru-Guzik A. Parallel tempered genetic algorithm guided by deep neural networks for inverse molecular design. DIGITAL DISCOVERY 2022; 1:390-404. [PMID: 36091415 PMCID: PMC9358752 DOI: 10.1039/d2dd00003b] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Accepted: 05/03/2022] [Indexed: 12/30/2022]
Abstract
We present JANUS, an evolutionary algorithm for inverse molecular design. It propagates an explorative and an exploitative population exchanging members via parallel tempering and uses active learning via deep neural networks to enhance sampling.
Collapse
Affiliation(s)
- AkshatKumar Nigam
- Department of Computer Science, Stanford University, USA
- Department of Computer Science, University of Toronto, Canada
- Department of Chemistry, University of Toronto, Canada
| | - Robert Pollice
- Department of Computer Science, University of Toronto, Canada
- Department of Chemistry, University of Toronto, Canada
| | - Alán Aspuru-Guzik
- Department of Computer Science, University of Toronto, Canada
- Department of Chemistry, University of Toronto, Canada
- Vector Institute for Artificial Intelligence, Toronto, Canada
- Lebovic Fellow, Canadian Institute for Advanced Research (CIFAR), 661 University Ave, Toronto, Ontario M5G, Canada
| |
Collapse
|
20
|
Busk J, Bjørn Jørgensen P, Bhowmik A, Schmidt MN, Winther O, Vegge T. Calibrated uncertainty for molecular property prediction using ensembles of message passing neural networks. MACHINE LEARNING: SCIENCE AND TECHNOLOGY 2021. [DOI: 10.1088/2632-2153/ac3eb3] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
Abstract
Data-driven methods based on machine learning have the potential to accelerate computational analysis of atomic structures. In this context, reliable uncertainty estimates are important for assessing confidence in predictions and enabling decision making. However, machine learning models can produce badly calibrated uncertainty estimates and it is therefore crucial to detect and handle uncertainty carefully. In this work we extend a message passing neural network designed specifically for predicting properties of molecules and materials with a calibrated probabilistic predictive distribution. The method presented in this paper differs from previous work by considering both aleatoric and epistemic uncertainty in a unified framework, and by recalibrating the predictive distribution on unseen data. Through computer experiments, we show that our approach results in accurate models for predicting molecular formation energies with well calibrated uncertainty in and out of the training data distribution on two public molecular benchmark datasets, QM9 and PC9. The proposed method provides a general framework for training and evaluating neural network ensemble models that are able to produce accurate predictions of properties of molecules with well calibrated uncertainty estimates.
Collapse
|
21
|
Lin S, Peng D, Yang W, Gu FL, Lan Z. Theoretical studies on triplet-state driven dissociation of formaldehyde by quasi-classical molecular dynamics simulation on machine-learning potential energy surface. J Chem Phys 2021; 155:214105. [PMID: 34879677 PMCID: PMC8654486 DOI: 10.1063/5.0067176] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2021] [Accepted: 11/09/2021] [Indexed: 11/15/2022] Open
Abstract
The H-atom dissociation of formaldehyde on the lowest triplet state (T1) is studied by quasi-classical molecular dynamic simulations on the high-dimensional machine-learning potential energy surface (PES) model. An atomic-energy based deep-learning neural network (NN) is used to represent the PES function, and the weighted atom-centered symmetry functions are employed as inputs of the NN model to satisfy the translational, rotational, and permutational symmetries, and to capture the geometry features of each atom and its individual chemical environment. Several standard technical tricks are used in the construction of NN-PES, which includes the application of clustering algorithm in the formation of the training dataset, the examination of the reliability of the NN-PES model by different fitted NN models, and the detection of the out-of-confidence region by the confidence interval of the training dataset. The accuracy of the full-dimensional NN-PES model is examined by two benchmark calculations with respect to ab initio data. Both the NN and electronic-structure calculations give a similar H-atom dissociation reaction pathway on the T1 state in the intrinsic reaction coordinate analysis. The small-scaled trial dynamics simulations based on NN-PES and ab initio PES give highly consistent results. After confirming the accuracy of the NN-PES, a large number of trajectories are calculated in the quasi-classical dynamics, which allows us to get a better understanding of the T1-driven H-atom dissociation dynamics efficiently. Particularly, the dynamics simulations from different initial conditions can be easily simulated with a rather low computational cost. The influence of the mode-specific vibrational excitations on the H-atom dissociation dynamics driven by the T1 state is explored. The results show that the vibrational excitations on symmetric C-H stretching, asymmetric C-H stretching, and C=O stretching motions always enhance the H-atom dissociation probability obviously.
Collapse
Affiliation(s)
| | | | - Weitao Yang
- Department of Chemistry, Duke University, Durham, North Carolina 27708, USA
| | - Feng Long Gu
- Authors to whom correspondence should be addressed: and
| | - Zhenggang Lan
- Authors to whom correspondence should be addressed: and
| |
Collapse
|
22
|
Wang D, Yu J, Chen L, Li X, Jiang H, Chen K, Zheng M, Luo X. A hybrid framework for improving uncertainty quantification in deep learning-based QSAR regression modeling. J Cheminform 2021; 13:69. [PMID: 34544485 PMCID: PMC8454160 DOI: 10.1186/s13321-021-00551-x] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2021] [Accepted: 09/05/2021] [Indexed: 11/24/2022] Open
Abstract
Reliable uncertainty quantification for statistical models is crucial in various downstream applications, especially for drug design and discovery where mistakes may incur a large amount of cost. This topic has therefore absorbed much attention and a plethora of methods have been proposed over the past years. The approaches that have been reported so far can be mainly categorized into two classes: distance-based approaches and Bayesian approaches. Although these methods have been widely used in many scenarios and shown promising performance with their distinct superiorities, being overconfident on out-of-distribution examples still poses challenges for the deployment of these techniques in real-world applications. In this study we investigated a number of consensus strategies in order to combine both distance-based and Bayesian approaches together with post-hoc calibration for improved uncertainty quantification in QSAR (Quantitative Structure-Activity Relationship) regression modeling. We employed a set of criteria to quantitatively assess the ranking and calibration ability of these models. Experiments based on 24 bioactivity datasets were designed to make critical comparison between the model we proposed and other well-studied baseline models. Our findings indicate that the hybrid framework proposed by us can robustly enhance the model ability of ranking absolute errors. Together with post-hoc calibration on the validation set, we show that well-calibrated uncertainty quantification results can be obtained in domain shift settings. The complementarity between different methods is also conceptually analyzed.
Collapse
Affiliation(s)
- Dingyan Wang
- Shanghai Key Laboratory of Forensic Medicine, Academy of Forensic Science, Shanghai, 200063, China
- University of Chinese Academy of Sciences, No.19A Yuquan Road, Beijing, 100049, China
- Drug Discovery and Design Center, State Key Laboratory of Drug Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, 555 Zuchongzhi Road, Shanghai, 201203, China
| | - Jie Yu
- University of Chinese Academy of Sciences, No.19A Yuquan Road, Beijing, 100049, China
- Drug Discovery and Design Center, State Key Laboratory of Drug Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, 555 Zuchongzhi Road, Shanghai, 201203, China
| | - Lifan Chen
- University of Chinese Academy of Sciences, No.19A Yuquan Road, Beijing, 100049, China
- Drug Discovery and Design Center, State Key Laboratory of Drug Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, 555 Zuchongzhi Road, Shanghai, 201203, China
| | - Xutong Li
- University of Chinese Academy of Sciences, No.19A Yuquan Road, Beijing, 100049, China
- Drug Discovery and Design Center, State Key Laboratory of Drug Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, 555 Zuchongzhi Road, Shanghai, 201203, China
| | - Hualiang Jiang
- University of Chinese Academy of Sciences, No.19A Yuquan Road, Beijing, 100049, China
- Drug Discovery and Design Center, State Key Laboratory of Drug Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, 555 Zuchongzhi Road, Shanghai, 201203, China
| | - Kaixian Chen
- University of Chinese Academy of Sciences, No.19A Yuquan Road, Beijing, 100049, China
- Drug Discovery and Design Center, State Key Laboratory of Drug Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, 555 Zuchongzhi Road, Shanghai, 201203, China
| | - Mingyue Zheng
- University of Chinese Academy of Sciences, No.19A Yuquan Road, Beijing, 100049, China.
- Drug Discovery and Design Center, State Key Laboratory of Drug Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, 555 Zuchongzhi Road, Shanghai, 201203, China.
| | - Xiaomin Luo
- Shanghai Key Laboratory of Forensic Medicine, Academy of Forensic Science, Shanghai, 200063, China.
- University of Chinese Academy of Sciences, No.19A Yuquan Road, Beijing, 100049, China.
- Drug Discovery and Design Center, State Key Laboratory of Drug Research, Shanghai Institute of Materia Medica, Chinese Academy of Sciences, 555 Zuchongzhi Road, Shanghai, 201203, China.
| |
Collapse
|
23
|
Raddi RM, Voelz VA. Stacking Gaussian processes to improve [Formula: see text] predictions in the SAMPL7 challenge. J Comput Aided Mol Des 2021; 35:953-961. [PMID: 34363562 PMCID: PMC9478567 DOI: 10.1007/s10822-021-00411-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 07/05/2021] [Indexed: 10/20/2022]
Abstract
Accurate predictions of acid dissociation constants are essential to rational molecular design in the pharmaceutical industry and elsewhere. There has been much interest in developing new machine learning methods that can produce fast and accurate pKa predictions for arbitrary species, as well as estimates of prediction uncertainty. Previously, as part of the SAMPL6 community-wide blind challenge, Bannan et al. approached the problem of predicting [Formula: see text]s by using a Gaussian process regression to predict microscopic [Formula: see text]s, from which macroscopic [Formula: see text] values can be analytically computed (Bannan et al. in J Comput-Aided Mol Des 32:1165-1177). While this method can make reasonably quick and accurate predictions using a small training set, accuracy was limited by the lack of a sufficiently broad range of chemical space in the training set (e.g., the inclusion of polyprotic acids). Here, to address this issue, we construct a deep Gaussian Process (GP) model that can include more features without invoking the curse of dimensionality. We trained both a standard GP and a deep GP model using a database of approximately 3500 small molecules curated from public sources, filtered by similarity to targets. We tested the model on both the SAMPL6 and more recent SAMPL7 challenge, which introduced a similar lack of ionizable sites and/or environments found between the test set and the previous training set. The results show that while the deep GP model made only minor improvements over the standard GP model for SAMPL6 predictions, it made significant improvements over the standard GP model in SAMPL7 macroscopic predictions, achieving a MAE of 1.5 [Formula: see text].
Collapse
Affiliation(s)
- Robert M Raddi
- Department of Chemistry, Temple University, Philadelphia, PA 19122, USA
| | - Vincent A Voelz
- Department of Chemistry, Temple University, Philadelphia, PA 19122, USA
| |
Collapse
|
24
|
Cesar de Azevedo L, Pinheiro GA, Quiles MG, Da Silva JLF, Prati RC. Systematic Investigation of Error Distribution in Machine Learning Algorithms Applied to the Quantum-Chemistry QM9 Data Set Using the Bias and Variance Decomposition. J Chem Inf Model 2021; 61:4210-4223. [PMID: 34387994 DOI: 10.1021/acs.jcim.1c00503] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
Most machine learning applications in quantum-chemistry (QC) data sets rely on a single statistical error parameter such as the mean square error (MSE) to evaluate their performance. However, this approach has limitations or can even yield incorrect interpretations. Here, we report a systematic investigation of the two components of the MSE, i.e., the bias and variance, using the QM9 data set. To this end, we experiment with three descriptors, namely (i) symmetry functions (SF, with two-body and three-body functions), (ii) many-body tensor representation (MBTR, with two- and three-body terms), and (iii) smooth overlap of atomic positions (SOAP), to evaluate the prediction process's performance using different numbers of molecules in training samples and the effect of bias and variance on the final MSE. Overall, low sample sizes are related to higher MSE. Moreover, the bias component strongly influences the larger MSEs. Furthermore, there is little agreement among molecules with higher errors (outliers) across different descriptors. However, there is a high prevalence among the outliers intersection set and the convex hull volume of geometric coordinates (VCH). According to the obtained results with the distribution of MSE (and its components bias and variance) and the appearance of outliers, it is suggested to use ensembles of models with a low bias to minimize the MSE, more specifically when using a small number of molecules in the training set.
Collapse
Affiliation(s)
- Luis Cesar de Azevedo
- Center of Mathematics, Computation and Cognition, Federal University of ABC, Av. dos Estados, 5001, 09210-580 Santo André, SP, Brazil
| | - Gabriel A Pinheiro
- Institute of Science and Technology, Federal University of São Paulo (Unifesp), 12247-014 São José dos Campos, SP, Brazil
| | - Marcos G Quiles
- Institute of Science and Technology, Federal University of São Paulo (Unifesp), 12247-014 São José dos Campos, SP, Brazil
| | - Juarez L F Da Silva
- São Carlos Institute of Chemistry, University of São Paulo, PO Box 780, 13560-970 São Carlos, SP, Brazil
| | - Ronaldo C Prati
- Center of Mathematics, Computation and Cognition, Federal University of ABC, Av. dos Estados, 5001, 09210-580 Santo André, SP, Brazil
| |
Collapse
|
25
|
Bell DR, Chen SH. Toward Guided Mutagenesis: Gaussian Process Regression Predicts MHC Class II Antigen Mutant Binding. J Chem Inf Model 2021; 61:4857-4867. [PMID: 34375111 DOI: 10.1021/acs.jcim.1c00458] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Antigen-specific immunotherapies (ASI) require successful loading and presentation of antigen peptides into the major histocompatibility complex (MHC) binding cleft. One route of ASI design is to mutate native antigens for either stronger or weaker binding interaction to MHC. Exploring all possible mutations is costly both experimentally and computationally. To reduce experimental and computational expense, here we investigate the minimal amount of prior data required to accurately predict the relative binding affinity of point mutations for peptide-MHC class II (pMHCII) binding. Using data from different residue subsets, we interpolate pMHCII mutant binding affinities by Gaussian process (GP) regression of residue volume and hydrophobicity. We apply GP regression to an experimental data set from the Immune Epitope Database, and theoretical data sets from NetMHCIIpan and Free Energy Perturbation calculations. We find that GP regression can predict binding affinities of nine neutral residues from a six-residue subset with an average R2 coefficient of determination value of 0.62 ± 0.04 (±95% CI), average error of 0.09 ± 0.01 kcal/mol (±95% CI), and with an receiver operating characteristic (ROC) AUC value of 0.92 for binary classification of enhanced or diminished binding affinity. Similarly, metrics increase to an R2 value of 0.69 ± 0.04, average error of 0.07 ± 0.01 kcal/mol, and an ROC AUC value of 0.94 for predicting seven neutral residues from an eight-residue subset. Our work finds that prediction is most accurate for neutral residues at anchor residue sites without register shift. This work holds relevance to predicting pMHCII binding and accelerating ASI design.
Collapse
Affiliation(s)
- David R Bell
- Advanced Biomedical Computational Science, Frederick National Laboratory for Cancer Research, Frederick, Maryland 21701, United States
| | - Serena H Chen
- Computational Sciences and Engineering Division, Oak Ridge National Laboratory, Oak Ridge, Tennessee 37830, United States
| |
Collapse
|