1
|
Freschlin CR, Fahlberg SA, Heinzelman P, Romero PA. Neural network extrapolation to distant regions of the protein fitness landscape. Nat Commun 2024; 15:6405. [PMID: 39080282 PMCID: PMC11289474 DOI: 10.1038/s41467-024-50712-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 07/13/2024] [Indexed: 08/02/2024] Open
Abstract
Machine learning (ML) has transformed protein engineering by constructing models of the underlying sequence-function landscape to accelerate the discovery of new biomolecules. ML-guided protein design requires models, trained on local sequence-function information, to accurately predict distant fitness peaks. In this work, we evaluate neural networks' capacity to extrapolate beyond their training data. We perform model-guided design using a panel of neural network architectures trained on protein G (GB1)-Immunoglobulin G (IgG) binding data and experimentally test thousands of GB1 designs to systematically evaluate the models' extrapolation. We find each model architecture infers markedly different landscapes from the same data, which give rise to unique design preferences. We find simpler models excel in local extrapolation to design high fitness proteins, while more sophisticated convolutional models can venture deep into sequence space to design proteins that fold but are no longer functional. We also find that implementing a simple ensemble of convolutional neural networks enables robust design of high-performing variants in the local landscape. Our findings highlight how each architecture's inductive biases prime them to learn different aspects of the protein fitness landscape and how a simple ensembling approach makes protein engineering more robust.
Collapse
Affiliation(s)
- Chase R Freschlin
- Department of Biochemistry, University of Wisconsin-Madison, Madison, WI, USA
| | - Sarah A Fahlberg
- Department of Biochemistry, University of Wisconsin-Madison, Madison, WI, USA
| | - Pete Heinzelman
- Department of Biochemistry, University of Wisconsin-Madison, Madison, WI, USA
| | - Philip A Romero
- Department of Biochemistry, University of Wisconsin-Madison, Madison, WI, USA.
- Department of Chemical & Biological Engineering, University of Wisconsin-Madison, Madison, WI, USA.
| |
Collapse
|
2
|
Isenberg NM, Mertins SD, Yoon BJ, Reyes KG, Urban NM. Identifying Bayesian optimal experiments for uncertain biochemical pathway models. Sci Rep 2024; 14:15237. [PMID: 38956095 PMCID: PMC11219779 DOI: 10.1038/s41598-024-65196-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Accepted: 06/18/2024] [Indexed: 07/04/2024] Open
Abstract
Pharmacodynamic (PD) models are mathematical models of cellular reaction networks that include drug mechanisms of action. These models are useful for studying predictive therapeutic outcomes of novel drug therapies in silico. However, PD models are known to possess significant uncertainty with respect to constituent parameter data, leading to uncertainty in the model predictions. Furthermore, experimental data to calibrate these models is often limited or unavailable for novel pathways. In this study, we present a Bayesian optimal experimental design approach for improving PD model prediction accuracy. We then apply our method using simulated experimental data to account for uncertainty in hypothetical laboratory measurements. This leads to a probabilistic prediction of drug performance and a quantitative measure of which prospective laboratory experiment will optimally reduce prediction uncertainty in the PD model. The methods proposed here provide a way forward for uncertainty quantification and guided experimental design for models of novel biological pathways.
Collapse
Affiliation(s)
| | - Susan D Mertins
- Fredrick National Laboratory for Cancer Research, Fredrick, MD, 21702, USA
| | - Byung-Jun Yoon
- Texas A &M University, College Station, TX, 77843, USA
- Brookhaven National Laboratory, Upton, NY, 11973, USA
| | - Kristofer G Reyes
- University at Buffalo, Buffalo, NY, 14260, USA
- Brookhaven National Laboratory, Upton, NY, 11973, USA
| | | |
Collapse
|
3
|
Machaca V, Goyzueta V, Cruz MG, Sejje E, Pilco LM, López J, Túpac Y. Transformers meets neoantigen detection: a systematic literature review. J Integr Bioinform 2024; 21:jib-2023-0043. [PMID: 38960869 DOI: 10.1515/jib-2023-0043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Accepted: 03/20/2024] [Indexed: 07/05/2024] Open
Abstract
Cancer immunology offers a new alternative to traditional cancer treatments, such as radiotherapy and chemotherapy. One notable alternative is the development of personalized vaccines based on cancer neoantigens. Moreover, Transformers are considered a revolutionary development in artificial intelligence with a significant impact on natural language processing (NLP) tasks and have been utilized in proteomics studies in recent years. In this context, we conducted a systematic literature review to investigate how Transformers are applied in each stage of the neoantigen detection process. Additionally, we mapped current pipelines and examined the results of clinical trials involving cancer vaccines.
Collapse
Affiliation(s)
| | | | | | - Erika Sejje
- Universidad Nacional de San Agustín, Arequipa, Perú
| | | | | | - Yván Túpac
- 187038 Universidad Católica San Pablo , Arequipa, Perú
| |
Collapse
|
4
|
Bulashevska A, Nacsa Z, Lang F, Braun M, Machyna M, Diken M, Childs L, König R. Artificial intelligence and neoantigens: paving the path for precision cancer immunotherapy. Front Immunol 2024; 15:1394003. [PMID: 38868767 PMCID: PMC11167095 DOI: 10.3389/fimmu.2024.1394003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/29/2024] [Accepted: 05/13/2024] [Indexed: 06/14/2024] Open
Abstract
Cancer immunotherapy has witnessed rapid advancement in recent years, with a particular focus on neoantigens as promising targets for personalized treatments. The convergence of immunogenomics, bioinformatics, and artificial intelligence (AI) has propelled the development of innovative neoantigen discovery tools and pipelines. These tools have revolutionized our ability to identify tumor-specific antigens, providing the foundation for precision cancer immunotherapy. AI-driven algorithms can process extensive amounts of data, identify patterns, and make predictions that were once challenging to achieve. However, the integration of AI comes with its own set of challenges, leaving space for further research. With particular focus on the computational approaches, in this article we have explored the current landscape of neoantigen prediction, the fundamental concepts behind, the challenges and their potential solutions providing a comprehensive overview of this rapidly evolving field.
Collapse
Affiliation(s)
- Alla Bulashevska
- Host-Pathogen-Interactions, Paul-Ehrlich-Institut, Langen, Germany
| | - Zsófia Nacsa
- Host-Pathogen-Interactions, Paul-Ehrlich-Institut, Langen, Germany
| | - Franziska Lang
- TRON - Translational Oncology at the University Medical Center of the Johannes Gutenberg University gGmbH, Mainz, Germany
| | - Markus Braun
- Host-Pathogen-Interactions, Paul-Ehrlich-Institut, Langen, Germany
| | - Martin Machyna
- Host-Pathogen-Interactions, Paul-Ehrlich-Institut, Langen, Germany
| | - Mustafa Diken
- TRON - Translational Oncology at the University Medical Center of the Johannes Gutenberg University gGmbH, Mainz, Germany
| | - Liam Childs
- Host-Pathogen-Interactions, Paul-Ehrlich-Institut, Langen, Germany
| | - Renate König
- Host-Pathogen-Interactions, Paul-Ehrlich-Institut, Langen, Germany
| |
Collapse
|
5
|
Thrift WJ, Perera J, Cohen S, Lounsbury NW, Gurung HR, Rose CM, Chen J, Jhunjhunwala S, Liu K. Graph-pMHC: graph neural network approach to MHC class II peptide presentation and antibody immunogenicity. Brief Bioinform 2024; 25:bbae123. [PMID: 38555476 PMCID: PMC10981672 DOI: 10.1093/bib/bbae123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 02/20/2024] [Accepted: 02/27/2024] [Indexed: 04/02/2024] Open
Abstract
Antigen presentation on MHC class II (pMHCII presentation) plays an essential role in the adaptive immune response to extracellular pathogens and cancerous cells. But it can also reduce the efficacy of large-molecule drugs by triggering an anti-drug response. Significant progress has been made in pMHCII presentation modeling due to the collection of large-scale pMHC mass spectrometry datasets (ligandomes) and advances in machine learning. Here, we develop graph-pMHC, a graph neural network approach to predict pMHCII presentation. We derive adjacency matrices for pMHCII using Alphafold2-multimer and address the peptide-MHC binding groove alignment problem with a simple graph enumeration strategy. We demonstrate that graph-pMHC dramatically outperforms methods with suboptimal inductive biases, such as the multilayer-perceptron-based NetMHCIIpan-4.0 (+20.17% absolute average precision). Finally, we create an antibody drug immunogenicity dataset from clinical trial data and develop a method for measuring anti-antibody immunogenicity risk using pMHCII presentation models. Our model increases receiver operating characteristic curve (ROC)-area under the ROC curve (AUC) by 2.57% compared to just filtering peptides by hits in OASis alone for predicting antibody drug immunogenicity.
Collapse
Affiliation(s)
| | - Jason Perera
- Genentech, 1 DNA Way, South San Francisco, California 94080, USA
| | - Sivan Cohen
- Genentech, 1 DNA Way, South San Francisco, California 94080, USA
| | | | - Hem R Gurung
- Genentech, 1 DNA Way, South San Francisco, California 94080, USA
| | | | - Jieming Chen
- Genentech, 1 DNA Way, South San Francisco, California 94080, USA
| | | | - Kai Liu
- Genentech, 1 DNA Way, South San Francisco, California 94080, USA
| |
Collapse
|
6
|
Laubenbacher R, Adler F, An G, Castiglione F, Eubank S, Fonseca LL, Glazier J, Helikar T, Jett-Tilton M, Kirschner D, Macklin P, Mehrad B, Moore B, Pasour V, Shmulevich I, Smith A, Voigt I, Yankeelov TE, Ziemssen T. Forum on immune digital twins: a meeting report. NPJ Syst Biol Appl 2024; 10:19. [PMID: 38365857 PMCID: PMC10873299 DOI: 10.1038/s41540-024-00345-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2023] [Accepted: 01/25/2024] [Indexed: 02/18/2024] Open
Abstract
Medical digital twins are computational models of human biology relevant to a given medical condition, which are tailored to an individual patient, thereby predicting the course of disease and individualized treatments, an important goal of personalized medicine. The immune system, which has a central role in many diseases, is highly heterogeneous between individuals, and thus poses a major challenge for this technology. In February 2023, an international group of experts convened for two days to discuss these challenges related to immune digital twins. The group consisted of clinicians, immunologists, biologists, and mathematical modelers, representative of the interdisciplinary nature of medical digital twin development. A video recording of the entire event is available. This paper presents a synopsis of the discussions, brief descriptions of ongoing digital twin projects at different stages of progress. It also proposes a 5-year action plan for further developing this technology. The main recommendations are to identify and pursue a small number of promising use cases, to develop stimulation-specific assays of immune function in a clinical setting, and to develop a database of existing computational immune models, as well as advanced modeling technology and infrastructure.
Collapse
Affiliation(s)
| | - Fred Adler
- Department of Mathematics and School of Biological Sciences, University of Utah, Salt Lake City, UT, USA
| | - Gary An
- Department of Surgery, University of Vermont, Burlington, VT, USA
| | - Filippo Castiglione
- Biotechnology Research Center, Technology Innovation Institute, Abu Dhabi, UAE
| | - Stephen Eubank
- Biocomplexity Institute and Initiative, University of Virginia, Charlottesville, VA, USA
| | - Luis L Fonseca
- Department of Medicine, University of Florida, Gainesville, FL, USA
| | - James Glazier
- Department of Intelligent Systems Engineering, Indiana University, Bloomington, IN, USA
| | - Tomas Helikar
- Department of Biochemistry, University of Nebraska, Lincoln, NE, USA
| | | | - Denise Kirschner
- Department of Microbiology and Immunology, University of Michigan, Ann Arbor, MI, USA
| | - Paul Macklin
- Department of Intelligent Systems Engineering, Indiana University, Bloomington, IN, USA
| | - Borna Mehrad
- Department of Medicine, University of Florida, Gainesville, FL, USA
| | - Beth Moore
- Department of Microbiology and Immunology, University of Michigan, Ann Arbor, MI, USA
| | - Virginia Pasour
- U.S. Army Research Office, Research Triangle Park, Raleigh, NC, USA
| | | | - Amber Smith
- Department of Pediatrics, University of Tennessee Health Science Center, Memphis, TN, USA
| | - Isabel Voigt
- Center of Clinical Neuroscience, Department of Neurology, Medical Faculty and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Fetscherstraße 74, 01307, Dresden, Germany
| | - Thomas E Yankeelov
- Department of Biomedical Engineering, Oden Institute for Computational Engineering and Sciences, Departments of Biomedical Engineering, Diagnostic Medicine, Oncology, The University of Texas, Austin, TX, USA
- Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, USA
| | - Tjalf Ziemssen
- Center of Clinical Neuroscience, Department of Neurology, Medical Faculty and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Fetscherstraße 74, 01307, Dresden, Germany
| |
Collapse
|
7
|
Yu Y, Zu L, Jiang J, Wu Y, Wang Y, Xu M, Liu Q. Structure-aware deep model for MHC-II peptide binding affinity prediction. BMC Genomics 2024; 25:127. [PMID: 38291350 PMCID: PMC10826266 DOI: 10.1186/s12864-023-09900-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 12/12/2023] [Indexed: 02/01/2024] Open
Abstract
The prediction of major histocompatibility complex (MHC)-peptide binding affinity is an important branch in immune bioinformatics, especially helpful in accelerating the design of disease vaccines and immunity therapy. Although deep learning-based solutions have yielded promising results on MHC-II molecules in recent years, these methods ignored structure knowledge from each peptide when employing the deep neural network models. Each peptide sequence has its specific combination order, so it is worth considering adding the structural information of the peptide sequence to the deep model training. In this work, we use positional encoding to represent the structural information of peptide sequences and validly combine the positional encoding with existing models by different strategies. Experiments on three datasets show that the introduction of position-coding information can further improve the performance built upon the existing model. The idea of introducing positional encoding to this field can provide important reference significance for the optimization of the deep network structure in the future.
Collapse
Affiliation(s)
- Ying Yu
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Lipeng Zu
- Department of Computer Science, Florida State University, Tallahassee, 32306, USA
| | - Jiaye Jiang
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Yafang Wu
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Yinglin Wang
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Midie Xu
- Department of Pathology, Fudan University, Shanghai Cancer Center, Shanghai, 200032, China.
- Department of Medical Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, China.
- Institute of Pathology, Fudan University, Shanghai, 200032, China.
| | - Qing Liu
- School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China.
| |
Collapse
|
8
|
Wang X, Wu T, Jiang Y, Chen T, Pan D, Jin Z, Xie J, Quan L, Lyu Q. RPEMHC: improved prediction of MHC-peptide binding affinity by a deep learning approach based on residue-residue pair encoding. Bioinformatics 2024; 40:btad785. [PMID: 38175759 PMCID: PMC10796178 DOI: 10.1093/bioinformatics/btad785] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2023] [Revised: 12/20/2023] [Accepted: 12/28/2023] [Indexed: 01/06/2024] Open
Abstract
MOTIVATION Binding of peptides to major histocompatibility complex (MHC) molecules plays a crucial role in triggering T cell recognition mechanisms essential for immune response. Accurate prediction of MHC-peptide binding is vital for the development of cancer therapeutic vaccines. While recent deep learning-based methods have achieved significant performance in predicting MHC-peptide binding affinity, most of them separately encode MHC molecules and peptides as inputs, potentially overlooking critical interaction information between the two. RESULTS In this work, we propose RPEMHC, a new deep learning approach based on residue-residue pair encoding to predict the binding affinity between peptides and MHC, which encode an MHC molecule and a peptide as a residue-residue pair map. We evaluate the performance of RPEMHC on various MHC-II-related datasets for MHC-peptide binding prediction, demonstrating that RPEMHC achieves better or comparable performance against other state-of-the-art baselines. Moreover, we further construct experiments on MHC-I-related datasets, and experimental results demonstrate that our method can work on both two MHC classes. These extensive validations have manifested that RPEMHC is an effective tool for studying MHC-peptide interactions and can potentially facilitate the vaccine development. AVAILABILITY The source code of the method along with trained models is freely available at https://github.com/lennylv/RPEMHC.
Collapse
Affiliation(s)
- Xuejiao Wang
- School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215006, China
| | - Tingfang Wu
- School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215006, China
- Province Key Lab for Information Processing Technologies, Soochow University, Suzhou, Jiangsu 215006, China
- Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing, Jiangsu 210000, China
| | - Yelu Jiang
- School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215006, China
| | - Taoning Chen
- School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215006, China
| | - Deng Pan
- School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215006, China
| | - Zhi Jin
- School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215006, China
| | - Jingxin Xie
- School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215006, China
| | - Lijun Quan
- School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215006, China
- Province Key Lab for Information Processing Technologies, Soochow University, Suzhou, Jiangsu 215006, China
- Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing, Jiangsu 210000, China
| | - Qiang Lyu
- School of Computer Science and Technology, Soochow University, Suzhou, Jiangsu 215006, China
- Province Key Lab for Information Processing Technologies, Soochow University, Suzhou, Jiangsu 215006, China
- Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing, Jiangsu 210000, China
| |
Collapse
|
9
|
Luo Y, Liu Y, Peng J. Calibrated geometric deep learning improves kinase-drug binding predictions. NAT MACH INTELL 2023; 5:1390-1401. [PMID: 38962391 PMCID: PMC11221792 DOI: 10.1038/s42256-023-00751-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Accepted: 09/29/2023] [Indexed: 07/05/2024]
Abstract
Protein kinases regulate various cellular functions and hold significant pharmacological promise in cancer and other diseases. Although kinase inhibitors are one of the largest groups of approved drugs, much of the human kinome remains unexplored but potentially druggable. Computational approaches, such as machine learning, offer efficient solutions for exploring kinase-compound interactions and uncovering novel binding activities. Despite the increasing availability of three-dimensional (3D) protein and compound structures, existing methods predominantly focus on exploiting local features from one-dimensional protein sequences and two-dimensional molecular graphs to predict binding affinities, overlooking the 3D nature of the binding process. Here we present KDBNet, a deep learning algorithm that incorporates 3D protein and molecule structure data to predict binding affinities. KDBNet uses graph neural networks to learn structure representations of protein binding pockets and drug molecules, capturing the geometric and spatial characteristics of binding activity. In addition, we introduce an algorithm to quantify and calibrate the uncertainties of KDBNet's predictions, enhancing its utility in model-guided discovery in chemical or protein space. Experiments demonstrated that KDBNet outperforms existing deep learning models in predicting kinase-drug binding affinities. The uncertainties estimated by KDBNet are informative and well-calibrated with respect to prediction errors. When integrated with a Bayesian optimization framework, KDBNet enables data-efficient active learning and accelerates the exploration and exploitation of diverse high-binding kinase-drug pairs.
Collapse
Affiliation(s)
- Yunan Luo
- School of Computational Science and Engineering, Georgia Institute of Technology, Atlanta, GA, USA
- These authors contributed equally: Yunan Luo, Yang Liu
| | - Yang Liu
- Department of Computer Science, University of Illinois Urbana-Champaign, Urbana, IL, USA
- These authors contributed equally: Yunan Luo, Yang Liu
| | - Jian Peng
- Department of Computer Science, University of Illinois Urbana-Champaign, Urbana, IL, USA
| |
Collapse
|
10
|
Fahlberg SA, Freschlin CR, Heinzelman P, Romero PA. Neural network extrapolation to distant regions of the protein fitness landscape. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.11.08.566287. [PMID: 37987009 PMCID: PMC10659313 DOI: 10.1101/2023.11.08.566287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2023]
Abstract
Machine learning (ML) has transformed protein engineering by constructing models of the underlying sequence-function landscape to accelerate the discovery of new biomolecules. ML-guided protein design requires models, trained on local sequence-function information, to accurately predict distant fitness peaks. In this work, we evaluate neural networks' capacity to extrapolate beyond their training data. We perform model-guided design using a panel of neural network architectures trained on protein G (GB1)-Immunoglobulin G (IgG) binding data and experimentally test thousands of GB1 designs to systematically evaluate the models' extrapolation. We find each model architecture infers markedly different landscapes from the same data, which give rise to unique design preferences. We find simpler models excel in local extrapolation to design high fitness proteins, while more sophisticated convolutional models can venture deep into sequence space to design proteins that fold but are no longer functional. Our findings highlight how each architecture's inductive biases prime them to learn different aspects of the protein fitness landscape.
Collapse
Affiliation(s)
- Sarah A Fahlberg
- Department of Biochemistry, University of Wisconsin-Madison, Madison, WI, USA
| | - Chase R Freschlin
- Department of Biochemistry, University of Wisconsin-Madison, Madison, WI, USA
| | - Pete Heinzelman
- Department of Biochemistry, University of Wisconsin-Madison, Madison, WI, USA
| | - Philip A Romero
- Department of Biochemistry, University of Wisconsin-Madison, Madison, WI, USA
- Department of Chemical & Biological Engineering, University of Wisconsin-Madison, Madison, WI, USA
| |
Collapse
|
11
|
Ahmad B, Achek A, Farooq M, Choi S. Accelerated NLRP3 inflammasome-inhibitory peptide design using a recurrent neural network model and molecular dynamics simulations. Comput Struct Biotechnol J 2023; 21:4825-4835. [PMID: 37854633 PMCID: PMC10579963 DOI: 10.1016/j.csbj.2023.09.038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 09/27/2023] [Accepted: 09/27/2023] [Indexed: 10/20/2023] Open
Abstract
Anomalous NLRP3 inflammasome responses have been linked to multiple health issues, including but not limited to atherosclerosis, diabetes, metabolic syndrome, cardiovascular disease, and neurodegenerative disease. Thus, targeting NLRP3 and modulating its associated immune response might be a promising strategy for developing new anti-inflammatory drugs. Herein, we report a computational method for de novo peptide design for targeting NLRP3 inflammasomes. The described method leverages a long-short-term memory (LSTM) network based on a recurrent neural network (RNN) to model a valuable latent space of molecules. The resulting classifiers are utilized to guide the selection of molecules generated by the model based on circular dichroism spectra and physicochemical features derived from high-throughput molecular dynamics simulations. Of the experimentally tested sequences, 60% of the peptides showed NLRP3-mediated inhibition of IL-1β and IL-18. One peptide displayed high potency against NLRP3-mediated IL-1β inhibition. However, NLRC4 and AIM2 inflammasome-mediated IL-1β secretion was uninterrupted by this peptide, demonstrating its selectivity toward the NLRP3 inflammasome. Overall, these results indicate that deep learning and molecular dynamics can accelerate the discovery of NLRP3 inhibitors with potent and selective activity.
Collapse
Affiliation(s)
- Bilal Ahmad
- Department of Molecular Science and Technology, Ajou University, Suwon 16499, South Korea
- S&K Therapeutics, Ajou University, Campus Plaza 418, Worldcup-ro 199, Yeongtong-gu, Suwon 16502, South Korea
| | - Asma Achek
- Department of Molecular Science and Technology, Ajou University, Suwon 16499, South Korea
- Technology Development Platform, Institut Pasteur Korea, Seongnam 13488, Soouth Korea
| | - Mariya Farooq
- Department of Molecular Science and Technology, Ajou University, Suwon 16499, South Korea
- S&K Therapeutics, Ajou University, Campus Plaza 418, Worldcup-ro 199, Yeongtong-gu, Suwon 16502, South Korea
| | - Sangdun Choi
- Department of Molecular Science and Technology, Ajou University, Suwon 16499, South Korea
- S&K Therapeutics, Ajou University, Campus Plaza 418, Worldcup-ro 199, Yeongtong-gu, Suwon 16502, South Korea
| |
Collapse
|
12
|
Yu X, Negron C, Huang L, Veldman G. TransMHCII: a novel MHC-II binding prediction model built using a protein language model and an image classifier. Antib Ther 2023; 6:137-146. [PMID: 37342671 PMCID: PMC10278228 DOI: 10.1093/abt/tbad011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2023] [Revised: 04/18/2023] [Accepted: 05/09/2023] [Indexed: 06/23/2023] Open
Abstract
The emergence of deep learning models such as AlphaFold2 has revolutionized the structure prediction of proteins. Nevertheless, much remains unexplored, especially on how we utilize structure models to predict biological properties. Herein, we present a method using features extracted from protein language models (PLMs) to predict the major histocompatibility complex class II (MHC-II) binding affinity of peptides. Specifically, we evaluated a novel transfer learning approach where the backbone of our model was interchanged with architectures designed for image classification tasks. Features extracted from several PLMs (ESM1b, ProtXLNet or ProtT5-XL-UniRef) were passed into image models (EfficientNet v2b0, EfficientNet v2m or ViT-16). The optimal pairing of the PLM and image classifier resulted in the final model TransMHCII, outperforming NetMHCIIpan 3.2 and NetMHCIIpan 4.0-BA on the receiver operating characteristic area under the curve, balanced accuracy and Jaccard scores. The architecture innovation may facilitate the development of other deep learning models for biological problems.
Collapse
Affiliation(s)
- Xin Yu
- Biotherapeutics Discovery, AbbVie Bioresearch Center, 100 Research Drive, Worcester, MA 01605, USA
| | - Christopher Negron
- Biotherapeutics Discovery, AbbVie Bioresearch Center, 100 Research Drive, Worcester, MA 01605, USA
| | - Lili Huang
- Biotherapeutics Discovery, AbbVie Bioresearch Center, 100 Research Drive, Worcester, MA 01605, USA
| | - Geertruida Veldman
- Biotherapeutics Discovery, AbbVie Bioresearch Center, 100 Research Drive, Worcester, MA 01605, USA
| |
Collapse
|
13
|
Ibtehaz N, Sourav SMSH, Bayzid MS, Rahman MS. Align-gram: Rethinking the Skip-gram Model for Protein Sequence Analysis. Protein J 2023; 42:135-146. [PMID: 36977849 DOI: 10.1007/s10930-023-10096-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/13/2023] [Indexed: 03/29/2023]
Abstract
The inception of next generations sequencing technologies have exponentially increased the volume of biological sequence data. Protein sequences, being quoted as the 'language of life', has been analyzed for a multitude of applications and inferences. Owing to the rapid development of deep learning, in recent years there have been a number of breakthroughs in the domain of Natural Language Processing. Since these methods are capable of performing different tasks when trained with a sufficient amount of data, off-the-shelf models are used to perform various biological applications. In this study, we investigated the applicability of the popular Skip-gram model for protein sequence analysis and made an attempt to incorporate some biological insights into it. We propose a novel k-mer embedding scheme, Align-gram, which is capable of mapping the similar k-mers close to each other in a vector space. Furthermore, we experiment with other sequence-based protein representations and observe that the embeddings derived from Align-gram aids modeling and training deep learning models better. Our experiments with a simple baseline LSTM model and a much complex CNN model of DeepGoPlus shows the potential of Align-gram in performing different types of deep learning applications for protein sequence analysis.
Collapse
|
14
|
Dixit R, Khambhati K, Supraja KV, Singh V, Lederer F, Show PL, Awasthi MK, Sharma A, Jain R. Application of machine learning on understanding biomolecule interactions in cellular machinery. BIORESOURCE TECHNOLOGY 2023; 370:128522. [PMID: 36565819 DOI: 10.1016/j.biortech.2022.128522] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/29/2022] [Revised: 12/17/2022] [Accepted: 12/20/2022] [Indexed: 06/17/2023]
Abstract
Machine learning (ML) applications have become ubiquitous in all fields of research including protein science and engineering. Apart from protein structure and mutation prediction, scientists are focusing on knowledge gaps with respect to the molecular mechanisms involved in protein binding and interactions with other components in the experimental setups or the human body. Researchers are working on several wet-lab techniques and generating data for a better understanding of concepts and mechanics involved. The information like biomolecular structure, binding affinities, structure fluctuations and movements are enormous which can be handled and analyzed by ML. Therefore, this review highlights the significance of ML in understanding the biomolecular interactions while assisting in various fields of research such as drug discovery, nanomedicine, nanotoxicity and material science. Hence, the way ahead would be to force hand-in hand of laboratory work and computational techniques.
Collapse
Affiliation(s)
- Rewati Dixit
- Waste Treatment Laboratory, Department of Biochemical Engineering and Biotechnology, Indian Institute of Technology Delhi, Haus-khas, New Delhi 110016, India
| | - Khushal Khambhati
- Department of Biosciences, School of Science, Indrashil University, Rajpur, Mehsana 382715, Gujarat, India
| | - Kolli Venkata Supraja
- Waste Treatment Laboratory, Department of Biochemical Engineering and Biotechnology, Indian Institute of Technology Delhi, Haus-khas, New Delhi 110016, India
| | - Vijai Singh
- Department of Biosciences, School of Science, Indrashil University, Rajpur, Mehsana 382715, Gujarat, India
| | - Franziska Lederer
- Helmholtz-Zentrum Dresden-Rossendorf, Helmholtz Institute Freiberg for Resource Technology, Bautzner landstrasse 400, 01328 Dresden, Germany
| | - Pau-Loke Show
- Zhejiang Provincial Key Laboratory for Subtropical Water Environment and Marine Biological Resources Protection, Wenzhou University, Wenzhou 325035, China; Department of Sustainable Engineering, Saveetha School of Engineering, SIMATS, Chennai 602105, India; Department of Chemical and Environmental Engineering, University of Nottingham, Malaysia, 43500 Semenyih, Selangor Darul Ehsan, Malaysia
| | - Mukesh Kumar Awasthi
- College of Natural Resources and Environment, Northwest A&F University, Yangling 712100, China
| | - Abhinav Sharma
- Institute Theory of Polymers, Leibniz Institute for Polymer Research, Hohe Strasse 6, 01069 Dresden, Germany
| | - Rohan Jain
- Helmholtz-Zentrum Dresden-Rossendorf, Helmholtz Institute Freiberg for Resource Technology, Bautzner landstrasse 400, 01328 Dresden, Germany.
| |
Collapse
|
15
|
Grazioli F, Machart P, Mösch A, Li K, Castorina LV, Pfeifer N, Min MR. Attentive Variational Information Bottleneck for TCR-peptide interaction prediction. Bioinformatics 2022; 39:6960920. [PMID: 36571499 PMCID: PMC9825246 DOI: 10.1093/bioinformatics/btac820] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Revised: 11/18/2022] [Accepted: 12/23/2022] [Indexed: 12/27/2022] Open
Abstract
MOTIVATION We present a multi-sequence generalization of Variational Information Bottleneck and call the resulting model Attentive Variational Information Bottleneck (AVIB). Our AVIB model leverages multi-head self-attention to implicitly approximate a posterior distribution over latent encodings conditioned on multiple input sequences. We apply AVIB to a fundamental immuno-oncology problem: predicting the interactions between T-cell receptors (TCRs) and peptides. RESULTS Experimental results on various datasets show that AVIB significantly outperforms state-of-the-art methods for TCR-peptide interaction prediction. Additionally, we show that the latent posterior distribution learned by AVIB is particularly effective for the unsupervised detection of out-of-distribution amino acid sequences. AVAILABILITY AND IMPLEMENTATION The code and the data used for this study are publicly available at: https://github.com/nec-research/vibtcr. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
| | - Pierre Machart
- Biomedical AI Group, NEC Laboratories Europe, Heidelberg 69115, Germany
| | - Anja Mösch
- Biomedical AI Group, NEC Laboratories Europe, Heidelberg 69115, Germany
| | - Kai Li
- Machine Learning Department, NEC Laboratories America, Princeton, NJ 08540, USA
| | | | - Nico Pfeifer
- Methods in Medical Informatics, Department of Computer Science, University of Tübingen, Tübingen 72076, Germany
| | | |
Collapse
|
16
|
Fannjiang C, Bates S, Angelopoulos AN, Listgarten J, Jordan MI. Conformal prediction under feedback covariate shift for biomolecular design. Proc Natl Acad Sci U S A 2022; 119:e2204569119. [PMID: 36256807 PMCID: PMC9618043 DOI: 10.1073/pnas.2204569119] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Accepted: 06/20/2022] [Indexed: 11/18/2022] Open
Abstract
Many applications of machine-learning methods involve an iterative protocol in which data are collected, a model is trained, and then outputs of that model are used to choose what data to consider next. For example, a data-driven approach for designing proteins is to train a regression model to predict the fitness of protein sequences and then use it to propose new sequences believed to exhibit greater fitness than observed in the training data. Since validating designed sequences in the wet laboratory is typically costly, it is important to quantify the uncertainty in the model's predictions. This is challenging because of a characteristic type of distribution shift between the training and test data that arises in the design setting-one in which the training and test data are statistically dependent, as the latter is chosen based on the former. Consequently, the model's error on the test data-that is, the designed sequences-has an unknown and possibly complex relationship with its error on the training data. We introduce a method to construct confidence sets for predictions in such settings, which account for the dependence between the training and test data. The confidence sets we construct have finite-sample guarantees that hold for any regression model, even when it is used to choose the test-time input distribution. As a motivating use case, we use real datasets to demonstrate how our method quantifies uncertainty for the predicted fitness of designed proteins and can therefore be used to select design algorithms that achieve acceptable tradeoffs between high predicted fitness and low predictive uncertainty.
Collapse
Affiliation(s)
- Clara Fannjiang
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720
| | - Stephen Bates
- Department of Statistics, University of California, Berkeley, CA 94720
| | - Anastasios N. Angelopoulos
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720
| | - Jennifer Listgarten
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720
- Center for Computational Biology, University of California, Berkeley, CA 94720
| | - Michael I. Jordan
- Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, CA 94720
- Department of Statistics, University of California, Berkeley, CA 94720
| |
Collapse
|
17
|
Grazioli F, Mösch A, Machart P, Li K, Alqassem I, O’Donnell TJ, Min MR. On TCR binding predictors failing to generalize to unseen peptides. Front Immunol 2022; 13:1014256. [PMID: 36341448 PMCID: PMC9634250 DOI: 10.3389/fimmu.2022.1014256] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2022] [Accepted: 10/05/2022] [Indexed: 11/18/2022] Open
Abstract
Several recent studies investigate TCR-peptide/-pMHC binding prediction using machine learning or deep learning approaches. Many of these methods achieve impressive results on test sets, which include peptide sequences that are also included in the training set. In this work, we investigate how state-of-the-art deep learning models for TCR-peptide/-pMHC binding prediction generalize to unseen peptides. We create a dataset including positive samples from IEDB, VDJdb, McPAS-TCR, and the MIRA set, as well as negative samples from both randomization and 10X Genomics assays. We name this collection of samples TChard. We propose the hard split, a simple heuristic for training/test split, which ensures that test samples exclusively present peptides that do not belong to the training set. We investigate the effect of different training/test splitting techniques on the models’ test performance, as well as the effect of training and testing the models using mismatched negative samples generated randomly, in addition to the negative samples derived from assays. Our results show that modern deep learning methods fail to generalize to unseen peptides. We provide an explanation why this happens and verify our hypothesis on the TChard dataset. We then conclude that robust prediction of TCR recognition is still far for being solved.
Collapse
Affiliation(s)
- Filippo Grazioli
- Biomedical AI Group, NEC Laboratories Europe, Heidelberg, Germany
- *Correspondence: Filippo Grazioli, ; Martin Renqiang Min,
| | - Anja Mösch
- Biomedical AI Group, NEC Laboratories Europe, Heidelberg, Germany
| | - Pierre Machart
- Biomedical AI Group, NEC Laboratories Europe, Heidelberg, Germany
| | - Kai Li
- Machine Learning Department, NEC Laboratories America, Princeton, NJ, United States
| | - Israa Alqassem
- Biomedical AI Group, NEC Laboratories Europe, Heidelberg, Germany
| | - Timothy J. O’Donnell
- Division of Hematology and Medical Oncology, Icahn School of Medicine at Mount Sinai, New York, NY, United States
| | - Martin Renqiang Min
- Machine Learning Department, NEC Laboratories America, Princeton, NJ, United States
- *Correspondence: Filippo Grazioli, ; Martin Renqiang Min,
| |
Collapse
|
18
|
Huisman BD, Dai Z, Gifford DK, Birnbaum ME. A high-throughput yeast display approach to profile pathogen proteomes for MHC-II binding. eLife 2022; 11:e78589. [PMID: 35781135 PMCID: PMC9292997 DOI: 10.7554/elife.78589] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Accepted: 07/04/2022] [Indexed: 11/13/2022] Open
Abstract
T cells play a critical role in the adaptive immune response, recognizing peptide antigens presented on the cell surface by major histocompatibility complex (MHC) proteins. While assessing peptides for MHC binding is an important component of probing these interactions, traditional assays for testing peptides of interest for MHC binding are limited in throughput. Here, we present a yeast display-based platform for assessing the binding of tens of thousands of user-defined peptides in a high-throughput manner. We apply this approach to assess a tiled library covering the SARS-CoV-2 proteome and four dengue virus serotypes for binding to human class II MHCs, including HLA-DR401, -DR402, and -DR404. While the peptide datasets show broad agreement with previously described MHC-binding motifs, they additionally reveal experimentally validated computational false positives and false negatives. We therefore present this approach as able to complement current experimental datasets and computational predictions. Further, our yeast display approach underlines design considerations for epitope identification experiments and serves as a framework for examining relationships between viral conservation and MHC binding, which can be used to identify potentially high-interest peptide binders from viral proteins. These results demonstrate the utility of our approach to determine peptide-MHC binding interactions in a manner that can supplement and potentially enhance current algorithm-based approaches.
Collapse
Affiliation(s)
- Brooke D Huisman
- Koch Institute for Integrative Cancer ResearchCambridgeUnited States
- Department of Biological Engineering, Massachusetts Institute of TechnologyCambridgeUnited States
| | - Zheng Dai
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of TechnologyCambridgeUnited States
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of TechnologyCambridgeUnited States
| | - David K Gifford
- Department of Biological Engineering, Massachusetts Institute of TechnologyCambridgeUnited States
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of TechnologyCambridgeUnited States
- Department of Electrical Engineering and Computer Science, Massachusetts Institute of TechnologyCambridgeUnited States
| | - Michael E Birnbaum
- Koch Institute for Integrative Cancer ResearchCambridgeUnited States
- Department of Biological Engineering, Massachusetts Institute of TechnologyCambridgeUnited States
- Ragon Institute of MGH, MIT and HarvardCambridgeUnited States
| |
Collapse
|
19
|
Shang S, Zhao Y, Qian K, Qin Y, Zhang X, Li T, Shan L, Wei M, Xi J, Tang B. The role of neoantigens in tumor immunotherapy. Biomed Pharmacother 2022; 151:113118. [PMID: 35623169 DOI: 10.1016/j.biopha.2022.113118] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2022] [Revised: 05/04/2022] [Accepted: 05/10/2022] [Indexed: 11/29/2022] Open
Abstract
Tumor neoantigens are aberrant polypeptides produced by tumor cells as a result of genomic mutations. They are also tumor-specific antigens (TSA). Neoantigens are more immunogenic than tumor-related antigens and do not induce autoimmunity. Based on the rapid development of bioinformatics and the continuous update of sequencing technology, cancer immunotherapy with tumor neoantigens has made promising breakthroughs and progress. In this review, the generation, prediction, and identification of novel antigens, as well as the individualized treatments of neoantigens, were first introduced. Secondly, the mechanism of Chimeric Antigen Receptor T-Cell Immunotherapy (CAR-T) therapy and immune checkpoint blockade therapy in the treatment of tumors were outlined, and the three treatment methods were compared. Thirdly, the application of neoantigens in CAR-T therapy and PD-1/PD-L1 blockade therapy was briefly described. The benefits of the neoantigen vaccines over common vaccines were summarized as well. Finally, the prospect of neoantigen therapy was presented.
Collapse
Affiliation(s)
- Shengwen Shang
- School of Life Science, Anhui Province Key Laboratory of Translational Cancer Research, Anhui Province Key Laboratory of Immunology in Chronic Diseases, Bengbu Medical College, Bengbu, Anhui Province 233030, China
| | - Yongjie Zhao
- School of Life Science, Anhui Province Key Laboratory of Translational Cancer Research, Anhui Province Key Laboratory of Immunology in Chronic Diseases, Bengbu Medical College, Bengbu, Anhui Province 233030, China
| | - Kaiqiang Qian
- School of Life Science, Anhui Province Key Laboratory of Translational Cancer Research, Anhui Province Key Laboratory of Immunology in Chronic Diseases, Bengbu Medical College, Bengbu, Anhui Province 233030, China
| | - Yuexuan Qin
- School of Life Science, Anhui Province Key Laboratory of Translational Cancer Research, Anhui Province Key Laboratory of Immunology in Chronic Diseases, Bengbu Medical College, Bengbu, Anhui Province 233030, China
| | - Xinyi Zhang
- School of Life Science, Anhui Province Key Laboratory of Translational Cancer Research, Anhui Province Key Laboratory of Immunology in Chronic Diseases, Bengbu Medical College, Bengbu, Anhui Province 233030, China
| | - Tianyue Li
- School of Life Science, Anhui Province Key Laboratory of Translational Cancer Research, Anhui Province Key Laboratory of Immunology in Chronic Diseases, Bengbu Medical College, Bengbu, Anhui Province 233030, China
| | - Lidong Shan
- School of Life Science, Anhui Province Key Laboratory of Translational Cancer Research, Anhui Province Key Laboratory of Immunology in Chronic Diseases, Bengbu Medical College, Bengbu, Anhui Province 233030, China
| | - Meili Wei
- School of Life Science, Anhui Province Key Laboratory of Translational Cancer Research, Anhui Province Key Laboratory of Immunology in Chronic Diseases, Bengbu Medical College, Bengbu, Anhui Province 233030, China
| | - Jun Xi
- School of Life Science, Anhui Province Key Laboratory of Translational Cancer Research, Anhui Province Key Laboratory of Immunology in Chronic Diseases, Bengbu Medical College, Bengbu, Anhui Province 233030, China
| | - Bikui Tang
- School of Life Science, Anhui Province Key Laboratory of Translational Cancer Research, Anhui Province Key Laboratory of Immunology in Chronic Diseases, Bengbu Medical College, Bengbu, Anhui Province 233030, China.
| |
Collapse
|
20
|
Abstract
Motivation Computationally predicting major histocompatibility complex (MHC)-peptide binding affinity is an important problem in immunological bioinformatics. Recent cutting-edge deep learning-based methods for this problem are unable to achieve satisfactory performance for MHC class II molecules. This is because such methods generate the input by simply concatenating the two given sequences: (the estimated binding core of) a peptide and (the pseudo sequence of) an MHC class II molecule, ignoring biological knowledge behind the interactions of the two molecules. We thus propose a binding core-aware deep learning-based model, DeepMHCII, with a binding interaction convolution layer, which allows to integrate all potential binding cores (in a given peptide) with the MHC pseudo (binding) sequence, through modeling the interaction with multiple convolutional kernels. Results Extensive empirical experiments with four large-scale datasets demonstrate that DeepMHCII significantly outperformed four state-of-the-art methods under numerous settings, such as 5-fold cross-validation, leave one molecule out, validation with independent testing sets and binding core prediction. All these results and visualization of the predicted binding cores indicate the effectiveness of our model, DeepMHCII, and the importance of properly modeling biological facts in deep learning for high predictive performance and efficient knowledge discovery. Availability and implementation DeepMHCII is publicly available at https://github.com/yourh/DeepMHCII. Supplementary information Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Ronghui You
- Institute of Science and Technology for Brain-Inspired Intelligence and MOE Frontiers Center for Brain Sciences, Fudan University, Shanghai 200433, China
| | - Wei Qu
- Institute of Science and Technology for Brain-Inspired Intelligence and MOE Frontiers Center for Brain Sciences, Fudan University, Shanghai 200433, China
- Shanghai Qi Zhi Institute, Shanghai 200030, China
| | - Hiroshi Mamitsuka
- Bioinformatics Center, Institute for Chemical Research, Kyoto University, Uji, Kyoto Prefecture, Japan
- Department of Computer Science, Aalto University, Espoo, Finland
| | - Shanfeng Zhu
- To whom correspondence should be addressed. E-mail:
| |
Collapse
|
21
|
Adaptive machine learning for protein engineering. Curr Opin Struct Biol 2021; 72:145-152. [PMID: 34896756 DOI: 10.1016/j.sbi.2021.11.002] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2021] [Revised: 09/14/2021] [Accepted: 11/08/2021] [Indexed: 11/22/2022]
Abstract
Machine-learning models that learn from data to predict how protein sequence encodes function are emerging as a useful protein engineering tool. However, when using these models to suggest new protein designs, one must deal with the vast combinatorial complexity of protein sequences. Here, we review how to use a sequence-to-function machine-learning surrogate model to select sequences for experimental measurement. First, we discuss how to select sequences through a single round of machine-learning optimization. Then, we discuss sequential optimization, where the goal is to discover optimized sequences and improve the model across multiple rounds of training, optimization, and experimental measurement.
Collapse
|
22
|
Xu Y, Su GH, Ma D, Xiao Y, Shao ZM, Jiang YZ. Technological advances in cancer immunity: from immunogenomics to single-cell analysis and artificial intelligence. Signal Transduct Target Ther 2021; 6:312. [PMID: 34417437 PMCID: PMC8377461 DOI: 10.1038/s41392-021-00729-7] [Citation(s) in RCA: 46] [Impact Index Per Article: 15.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 07/06/2021] [Accepted: 07/18/2021] [Indexed: 02/07/2023] Open
Abstract
Immunotherapies play critical roles in cancer treatment. However, given that only a few patients respond to immune checkpoint blockades and other immunotherapeutic strategies, more novel technologies are needed to decipher the complicated interplay between tumor cells and the components of the tumor immune microenvironment (TIME). Tumor immunomics refers to the integrated study of the TIME using immunogenomics, immunoproteomics, immune-bioinformatics, and other multi-omics data reflecting the immune states of tumors, which has relied on the rapid development of next-generation sequencing. High-throughput genomic and transcriptomic data may be utilized for calculating the abundance of immune cells and predicting tumor antigens, referring to immunogenomics. However, as bulk sequencing represents the average characteristics of a heterogeneous cell population, it fails to distinguish distinct cell subtypes. Single-cell-based technologies enable better dissection of the TIME through precise immune cell subpopulation and spatial architecture investigations. In addition, radiomics and digital pathology-based deep learning models largely contribute to research on cancer immunity. These artificial intelligence technologies have performed well in predicting response to immunotherapy, with profound significance in cancer therapy. In this review, we briefly summarize conventional and state-of-the-art technologies in the field of immunogenomics, single-cell and artificial intelligence, and present prospects for future research.
Collapse
Affiliation(s)
- Ying Xu
- Key Laboratory of Breast Cancer in Shanghai, Department of Breast Surgery, Fudan University Shanghai Cancer Center, Shanghai, China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Guan-Hua Su
- Key Laboratory of Breast Cancer in Shanghai, Department of Breast Surgery, Fudan University Shanghai Cancer Center, Shanghai, China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Ding Ma
- Key Laboratory of Breast Cancer in Shanghai, Department of Breast Surgery, Fudan University Shanghai Cancer Center, Shanghai, China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China
| | - Yi Xiao
- Key Laboratory of Breast Cancer in Shanghai, Department of Breast Surgery, Fudan University Shanghai Cancer Center, Shanghai, China.
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China.
| | - Zhi-Ming Shao
- Key Laboratory of Breast Cancer in Shanghai, Department of Breast Surgery, Fudan University Shanghai Cancer Center, Shanghai, China.
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China.
- Institutes of Biomedical Sciences, Fudan University, Shanghai, China.
| | - Yi-Zhou Jiang
- Key Laboratory of Breast Cancer in Shanghai, Department of Breast Surgery, Fudan University Shanghai Cancer Center, Shanghai, China.
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, China.
| |
Collapse
|
23
|
Pearngam P, Sriswasdi S, Pisitkun T, Jones AR. MHCVision: estimation of global and local false discovery rate for MHC class I peptide binding prediction. Bioinformatics 2021; 37:3830-3838. [PMID: 34196671 PMCID: PMC8570816 DOI: 10.1093/bioinformatics/btab479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2020] [Revised: 06/11/2021] [Accepted: 06/30/2021] [Indexed: 11/29/2022] Open
Abstract
Motivation MHC-peptide binding prediction has been widely used for understanding the immune response of individuals or populations, each carrying different MHC molecules as well as for the development of immunotherapeutics. The results from MHC-peptide binding prediction tools are mostly reported as a predicted binding affinity (IC50) and the percentile rank score, and global thresholds e.g. IC50 value < 500 nM or percentile rank < 2% are generally recommended for distinguishing binding peptides from non-binding peptides. However, it is difficult to evaluate statistically the probability of an individual peptide binding prediction to be true or false solely considering predicted scores. Therefore, statistics describing the overall global false discovery rate (FDR) and local FDR, also called posterior error probability (PEP) are required to give statistical context to the natively produced scores. Result We have developed an algorithm and code implementation, called MHCVision, for estimation of FDR and PEP values for the predicted results of MHC-peptide binding prediction from the NetMHCpan tool. MHCVision performs parameter estimation using a modified expectation maximization framework for a two-component beta mixture model, representing the distribution of true and false scores of the predicted dataset. We can then estimate the PEP of an individual peptide’s predicted score, and conversely the probability that it is true. We demonstrate that the use of global FDR and PEP estimation can provide a better trade-off between sensitivity and precision over using currently recommended thresholds from tools. Availability and implementation https://github.com/PGB-LIV/MHCVision. Supplementary information Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Phorutai Pearngam
- Program in Bioinformatics and Computational Biology, Graduate School, Chulalongkorn University, Bangkok, Thailand.,Institute of Systems, Molecular and Integrative Biology, University of Liverpool, Liverpool, United Kingdom
| | - Sira Sriswasdi
- Research Affairs, Faculty of Medicine, Chulalongkorn, University, Bangkok, Thailand.,Computational Molecular Biology Group, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Trairak Pisitkun
- Center of Excellence in Systems Biology, Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand
| | - Andrew R Jones
- Institute of Systems, Molecular and Integrative Biology, University of Liverpool, Liverpool, United Kingdom
| |
Collapse
|
24
|
Bepler T, Berger B. Learning the protein language: Evolution, structure, and function. Cell Syst 2021; 12:654-669.e3. [PMID: 34139171 PMCID: PMC8238390 DOI: 10.1016/j.cels.2021.05.017] [Citation(s) in RCA: 144] [Impact Index Per Article: 48.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2021] [Revised: 05/20/2021] [Accepted: 05/20/2021] [Indexed: 02/06/2023]
Abstract
Language models have recently emerged as a powerful machine-learning approach for distilling information from massive protein sequence databases. From readily available sequence data alone, these models discover evolutionary, structural, and functional organization across protein space. Using language models, we can encode amino-acid sequences into distributed vector representations that capture their structural and functional properties, as well as evaluate the evolutionary fitness of sequence variants. We discuss recent advances in protein language modeling and their applications to downstream protein property prediction problems. We then consider how these models can be enriched with prior biological knowledge and introduce an approach for encoding protein structural knowledge into the learned representations. The knowledge distilled by these models allows us to improve downstream function prediction through transfer learning. Deep protein language models are revolutionizing protein biology. They suggest new ways to approach protein and therapeutic design. However, further developments are needed to encode strong biological priors into protein language models and to increase their accessibility to the broader community.
Collapse
Affiliation(s)
- Tristan Bepler
- Simons Machine Learning Center, New York Structural Biology Center, New York, NY, USA; Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA; Computational and Systems Biology Program, Massachusetts Institute of Technology, Cambridge, MA, USA.
| | - Bonnie Berger
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA; Department of Mathematics, Massachusetts Institute of Technology, Cambridge, MA, USA.
| |
Collapse
|
25
|
Cheng J, Bendjama K, Rittner K, Malone B. BERTMHC: Improved MHC-peptide class II interaction prediction with transformer and multiple instance learning. Bioinformatics 2021; 37:4172-4179. [PMID: 34096999 PMCID: PMC9502151 DOI: 10.1093/bioinformatics/btab422] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2020] [Revised: 05/17/2021] [Accepted: 06/04/2021] [Indexed: 11/12/2022] Open
Abstract
Motivation Increasingly comprehensive characterization of cancer-associated genetic alterations has paved the way for the development of highly specific therapeutic vaccines. Predicting precisely the binding and presentation of peptides to major histocompatibility complex (MHC) alleles is an important step toward such therapies. Recent data suggest that presentation of both class I and II epitopes are critical for the induction of a sustained effective immune response. However, the prediction performance for MHC class II has been limited compared to class I. Results We present a transformer neural network model which leverages self-supervised pretraining from a large corpus of protein sequences. We also propose a multiple instance learning (MIL) framework to deconvolve mass spectrometry data where multiple potential MHC alleles may have presented each peptide. We show that pretraining boosted the performance for these tasks. Combining pretraining and the novel MIL approach, our model outperforms state-of-the-art models based on peptide and MHC sequence only for both binding and cell surface presentation predictions. Availability and implementation Our source code is available at https://github.com/s6juncheng/BERTMHC under a noncommercial license. A webserver is available at https://bertmhc.privacy.nlehd.de/ Supplementary information Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Jun Cheng
- NEC Laboratories Europe GmbH Kurfuersten-Anlage 36, 69115 Heidelberg, Germany
| | - Kaïdre Bendjama
- Transgene, Boulevard Gonthier d'Andernach, 67400 Illkirch-Graffenstaden, France
| | - Karola Rittner
- Transgene, Boulevard Gonthier d'Andernach, 67400 Illkirch-Graffenstaden, France
| | - Brandon Malone
- NEC Laboratories Europe GmbH Kurfuersten-Anlage 36, 69115 Heidelberg, Germany
| |
Collapse
|
26
|
Dai Z, Huisman BD, Zeng H, Carter B, Jain S, Birnbaum ME, Gifford DK. Machine learning optimization of peptides for presentation by class II MHCs. Bioinformatics 2021; 37:3160-3167. [PMID: 33705522 PMCID: PMC8504626 DOI: 10.1093/bioinformatics/btab131] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Revised: 12/17/2020] [Accepted: 03/08/2021] [Indexed: 11/12/2022] Open
Abstract
T cells play a critical role in cellular immune responses to pathogens and cancer and can be activated and expanded by MHC-presented antigens contained in peptide vaccines. We present a machine learning method to optimize the presentation of peptides by class II MHCs by modifying their anchor residues. Our method first learns a model of peptide affinity for a class II MHC using an ensemble of deep residual networks, and then uses the model to propose anchor residue changes to improve peptide affinity. We use a high throughput yeast display assay to show that anchor residue optimization improves peptide binding. Supplementary information: Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Zheng Dai
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA.,Department of Computer Science and Electrical Engineering, MIT, Cambridge, MA, USA
| | | | - Haoyang Zeng
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA.,Department of Computer Science and Electrical Engineering, MIT, Cambridge, MA, USA
| | - Brandon Carter
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA.,Department of Computer Science and Electrical Engineering, MIT, Cambridge, MA, USA
| | - Siddhartha Jain
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA.,Department of Computer Science and Electrical Engineering, MIT, Cambridge, MA, USA
| | | | - David K Gifford
- Computer Science and Artificial Intelligence Laboratory, MIT, Cambridge, MA, USA.,Department of Computer Science and Electrical Engineering, MIT, Cambridge, MA, USA.,Department of Biological Engineering, MIT, Cambridge, MA, USA
| |
Collapse
|
27
|
Venkatesh G, Grover A, Srinivasaraghavan G, Rao S. MHCAttnNet: predicting MHC-peptide bindings for MHC alleles classes I and II using an attention-based deep neural model. Bioinformatics 2021; 36:i399-i406. [PMID: 32657386 PMCID: PMC7355292 DOI: 10.1093/bioinformatics/btaa479] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Abstract
Motivation Accurate prediction of binding between a major histocompatibility complex (MHC) allele and a peptide plays a major role in the synthesis of personalized cancer vaccines. The immune system struggles to distinguish between a cancerous and a healthy cell. In a patient suffering from cancer who has a particular MHC allele, only those peptides that bind with the MHC allele with high affinity, help the immune system recognize the cancerous cells. Results MHCAttnNet is a deep neural model that uses an attention mechanism to capture the relevant subsequences of the amino acid sequences of peptides and MHC alleles. It then uses this to accurately predict the MHC-peptide binding. MHCAttnNet achieves an AUC-PRC score of 94.18% with 161 class I MHC alleles, which outperforms the state-of-the-art models for this task. MHCAttnNet also achieves a better F1-score in comparison to the state-of-the-art models while covering a larger number of class II MHC alleles. The attention mechanism used by MHCAttnNet provides a heatmap over the amino acids thus indicating the important subsequences present in the amino acid sequence. This approach also allows us to focus on a much smaller number of relevant trigrams corresponding to the amino acid sequence of an MHC allele, from 9251 possible trigrams to about 258. This significantly reduces the number of amino acid subsequences that need to be clinically tested. Availability and implementation The data and source code are available at https://github.com/gopuvenkat/MHCAttnNet.
Collapse
Affiliation(s)
| | - Aayush Grover
- International Institute of Information Technology Bangalore, Bangalore 560100, India
| | - G Srinivasaraghavan
- International Institute of Information Technology Bangalore, Bangalore 560100, India
| | - Shrisha Rao
- International Institute of Information Technology Bangalore, Bangalore 560100, India
| |
Collapse
|
28
|
Abstract
Spurred into action by the COVID-19 pandemic, the global scientific community has, in a short of period of time, made astonishing progress in understanding and combating COVID-19. Given the known human protein machinery for (a) SARS-CoV-2 entry, (b) the host innate immune response, and (c) virus-host interactions (protein-protein and RNA-protein), the potential effects of human genetic variation in this machinery, which may contribute to clinical differences in SARS-CoV-2 pathogenesis and help determine individual risk for COVID-19 infection, are explored. The Genome Aggregation Database (gnomAD) was used to show that several rare germline exome variants of proteins in these pathways occur in the human population, suggesting that carriers of these rare variants (especially for proteins of innate immunity pathways) are at risk for severe symptoms (like the severe symptoms in patients who are known to be rare variant carriers), whereas carriers of other variants could have a protective advantage against infection. The occurrence of genetic variation is thus expected to motivate the experimental probing of natural variants to understand the mechanistic differences in SARS-CoV-2 pathogenesis from one individual to another.
Collapse
Affiliation(s)
- Suvobrata Chakravarty
- Chemistry & Biochemistry, South
Dakota State University, Brookings, South Dakota 57007, United
States
- BioSNTR, Brookings, South
Dakota 57007, United States
| |
Collapse
|
29
|
Liu G, Carter B, Gifford DK. Predicted Cellular Immunity Population Coverage Gaps for SARS-CoV-2 Subunit Vaccines and Their Augmentation by Compact Peptide Sets. Cell Syst 2020; 12:102-107.e4. [PMID: 33321075 PMCID: PMC7691134 DOI: 10.1016/j.cels.2020.11.010] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2020] [Revised: 10/18/2020] [Accepted: 11/19/2020] [Indexed: 11/25/2022]
Abstract
Subunit vaccines induce immunity to a pathogen by presenting a component of the pathogen and thus inherently limit the representation of pathogen peptides for cellular immunity-based memory. We find that severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) subunit peptides may not be robustly displayed by the major histocompatibility complex (MHC) molecules in certain individuals. We introduce an augmentation strategy for subunit vaccines that adds a small number of SARS-CoV-2 peptides to a vaccine to improve the population coverage of pathogen peptide display. Our population coverage estimates integrate clinical data on peptide immunogenicity in convalescent COVID-19 patients and machine learning predictions. We evaluate the population coverage of 9 different subunits of SARS-CoV-2, including 5 functional domains and 4 full proteins, and augment each of them to fill a predicted coverage gap. Clinical data and machine learning predict SARS-CoV-2 peptide-HLA immunogenicity Human population coverage gaps of COVID-19 subunit vaccines are predicted Subunit augmentation improves vaccine population coverage for cellular immunity Subunit-free peptide vaccines are predicted to have high population coverage
Collapse
Affiliation(s)
- Ge Liu
- MIT Computer Science and Artificial Intelligence Laboratory, Cambridge, MA, USA; MIT Electrical Engineering and Computer Science, Cambridge, MA, USA
| | - Brandon Carter
- MIT Computer Science and Artificial Intelligence Laboratory, Cambridge, MA, USA; MIT Electrical Engineering and Computer Science, Cambridge, MA, USA
| | - David K Gifford
- MIT Computer Science and Artificial Intelligence Laboratory, Cambridge, MA, USA; MIT Electrical Engineering and Computer Science, Cambridge, MA, USA; MIT Biological Engineering, Cambridge, MA, USA.
| |
Collapse
|
30
|
Wen B, Zeng W, Liao Y, Shi Z, Savage SR, Jiang W, Zhang B. Deep Learning in Proteomics. Proteomics 2020; 20:e1900335. [PMID: 32939979 PMCID: PMC7757195 DOI: 10.1002/pmic.201900335] [Citation(s) in RCA: 70] [Impact Index Per Article: 17.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2020] [Revised: 09/14/2020] [Indexed: 12/17/2022]
Abstract
Proteomics, the study of all the proteins in biological systems, is becoming a data-rich science. Protein sequences and structures are comprehensively catalogued in online databases. With recent advancements in tandem mass spectrometry (MS) technology, protein expression and post-translational modifications (PTMs) can be studied in a variety of biological systems at the global scale. Sophisticated computational algorithms are needed to translate the vast amount of data into novel biological insights. Deep learning automatically extracts data representations at high levels of abstraction from data, and it thrives in data-rich scientific research domains. Here, a comprehensive overview of deep learning applications in proteomics, including retention time prediction, MS/MS spectrum prediction, de novo peptide sequencing, PTM prediction, major histocompatibility complex-peptide binding prediction, and protein structure prediction, is provided. Limitations and the future directions of deep learning in proteomics are also discussed. This review will provide readers an overview of deep learning and how it can be used to analyze proteomics data.
Collapse
Affiliation(s)
- Bo Wen
- Lester and Sue Smith Breast CenterBaylor College of MedicineHoustonTX77030USA
- Department of Molecular and Human GeneticsBaylor College of MedicineHoustonTX77030USA
| | - Wen‐Feng Zeng
- Key Lab of Intelligent Information Processing of Chinese Academy of Sciences (CAS)Chinese Academy of SciencesInstitute of Computing TechnologyBeijing100190China
| | - Yuxing Liao
- Lester and Sue Smith Breast CenterBaylor College of MedicineHoustonTX77030USA
- Department of Molecular and Human GeneticsBaylor College of MedicineHoustonTX77030USA
| | - Zhiao Shi
- Lester and Sue Smith Breast CenterBaylor College of MedicineHoustonTX77030USA
- Department of Molecular and Human GeneticsBaylor College of MedicineHoustonTX77030USA
| | - Sara R. Savage
- Lester and Sue Smith Breast CenterBaylor College of MedicineHoustonTX77030USA
- Department of Molecular and Human GeneticsBaylor College of MedicineHoustonTX77030USA
| | - Wen Jiang
- Lester and Sue Smith Breast CenterBaylor College of MedicineHoustonTX77030USA
- Department of Molecular and Human GeneticsBaylor College of MedicineHoustonTX77030USA
| | - Bing Zhang
- Lester and Sue Smith Breast CenterBaylor College of MedicineHoustonTX77030USA
- Department of Molecular and Human GeneticsBaylor College of MedicineHoustonTX77030USA
| |
Collapse
|
31
|
Hie B, Bryson BD, Berger B. Leveraging Uncertainty in Machine Learning Accelerates Biological Discovery and Design. Cell Syst 2020; 11:461-477.e9. [PMID: 33065027 DOI: 10.1016/j.cels.2020.09.007] [Citation(s) in RCA: 65] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2020] [Revised: 06/01/2020] [Accepted: 09/23/2020] [Indexed: 12/13/2022]
Abstract
Machine learning that generates biological hypotheses has transformative potential, but most learning algorithms are susceptible to pathological failure when exploring regimes beyond the training data distribution. A solution to address this issue is to quantify prediction uncertainty so that algorithms can gracefully handle novel phenomena that confound standard methods. Here, we demonstrate the broad utility of robust uncertainty prediction in biological discovery. By leveraging Gaussian process-based uncertainty prediction on modern pre-trained features, we train a model on just 72 compounds to make predictions over a 10,833-compound library, identifying and experimentally validating compounds with nanomolar affinity for diverse kinases and whole-cell growth inhibition of Mycobacterium tuberculosis. Uncertainty facilitates a tight iterative loop between computation and experimentation and generalizes across biological domains as diverse as protein engineering and single-cell transcriptomics. More broadly, our work demonstrates that uncertainty should play a key role in the increasing adoption of machine learning algorithms into the experimental lifecycle.
Collapse
Affiliation(s)
- Brian Hie
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Bryan D Bryson
- Department of Biological Engineering, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; Ragon Institute of Massachusetts General Hospital, MIT, and Harvard, Cambridge, MA 02139, USA.
| | - Bonnie Berger
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139, USA; Department of Mathematics, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.
| |
Collapse
|
32
|
Liu G, Carter B, Bricken T, Jain S, Viard M, Carrington M, Gifford DK. Computationally Optimized SARS-CoV-2 MHC Class I and II Vaccine Formulations Predicted to Target Human Haplotype Distributions. Cell Syst 2020; 11:131-144.e6. [PMID: 32721383 PMCID: PMC7384425 DOI: 10.1016/j.cels.2020.06.009] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Revised: 05/31/2020] [Accepted: 06/18/2020] [Indexed: 12/20/2022]
Abstract
We present a combinatorial machine learning method to evaluate and optimize peptide vaccine formulations for SARS-CoV-2. Our approach optimizes the presentation likelihood of a diverse set of vaccine peptides conditioned on a target human-population HLA haplotype distribution and expected epitope drift. Our proposed SARS-CoV-2 MHC class I vaccine formulations provide 93.21% predicted population coverage with at least five vaccine peptide-HLA average hits per person (≥ 1 peptide: 99.91%) with all vaccine peptides perfectly conserved across 4,690 geographically sampled SARS-CoV-2 genomes. Our proposed MHC class II vaccine formulations provide 97.21% predicted coverage with at least five vaccine peptide-HLA average hits per person with all peptides having an observed mutation probability of ≤ 0.001. We provide an open-source implementation of our design methods (OptiVax), vaccine evaluation tool (EvalVax), as well as the data used in our design efforts here: https://github.com/gifford-lab/optivax.
Collapse
Affiliation(s)
- Ge Liu
- MIT Computer Science and Artificial Intelligence Laboratory, Cambridge, MA, USA; MIT Electrical Engineering and Computer Science, Cambridge, MA, USA
| | - Brandon Carter
- MIT Computer Science and Artificial Intelligence Laboratory, Cambridge, MA, USA; MIT Electrical Engineering and Computer Science, Cambridge, MA, USA
| | | | - Siddhartha Jain
- MIT Computer Science and Artificial Intelligence Laboratory, Cambridge, MA, USA
| | - Mathias Viard
- Basic Science Program, Frederick National Laboratory for Cancer Research, Frederick, MD, USA; Ragon Institute of Massachusetts General Hospital, MIT and Harvard University, Cambridge, MA, USA
| | - Mary Carrington
- Basic Science Program, Frederick National Laboratory for Cancer Research, Frederick, MD, USA; Ragon Institute of Massachusetts General Hospital, MIT and Harvard University, Cambridge, MA, USA
| | - David K Gifford
- MIT Computer Science and Artificial Intelligence Laboratory, Cambridge, MA, USA; MIT Electrical Engineering and Computer Science, Cambridge, MA, USA; MIT Biological Engineering, Cambridge, MA, USA.
| |
Collapse
|
33
|
Uncovering the Tumor Antigen Landscape: What to Know about the Discovery Process. Cancers (Basel) 2020; 12:cancers12061660. [PMID: 32585818 PMCID: PMC7352969 DOI: 10.3390/cancers12061660] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2020] [Revised: 06/11/2020] [Accepted: 06/20/2020] [Indexed: 12/14/2022] Open
Abstract
According to the latest available data, cancer is the second leading cause of death, highlighting the need for novel cancer therapeutic approaches. In this context, immunotherapy is emerging as a reliable first-line treatment for many cancers, particularly metastatic melanoma. Indeed, cancer immunotherapy has attracted great interest following the recent clinical approval of antibodies targeting immune checkpoint molecules, such as PD-1, PD-L1, and CTLA-4, that release the brakes of the immune system, thus reviving a field otherwise poorly explored. Cancer immunotherapy mainly relies on the generation and stimulation of cytotoxic CD8 T lymphocytes (CTLs) within the tumor microenvironment (TME), priming T cells and establishing efficient and durable anti-tumor immunity. Therefore, there is a clear need to define and identify immunogenic T cell epitopes to use in therapeutic cancer vaccines. Naturally presented antigens in the human leucocyte antigen-1 (HLA-I) complex on the tumor surface are the main protagonists in evocating a specific anti-tumor CD8+ T cell response. However, the methodologies for their identification have been a major bottleneck for their reliable characterization. Consequently, the field of antigen discovery has yet to improve. The current review is intended to define what are today known as tumor antigens, with a main focus on CTL antigenic peptides. We also review the techniques developed and employed to date for antigen discovery, exploring both the direct elution of HLA-I peptides and the in silico prediction of epitopes. Finally, the last part of the review analyses the future challenges and direction of the antigen discovery field.
Collapse
|
34
|
Liu G, Carter B, Bricken T, Jain S, Viard M, Carrington M, Gifford DK. Robust computational design and evaluation of peptide vaccines for cellular immunity with application to SARS-CoV-2. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2020. [PMID: 32511351 DOI: 10.1101/2020.05.16.088989] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
We present a combinatorial machine learning method to evaluate and optimize peptide vaccine formulations, and we find for SARS-CoV-2 that it provides superior predicted display of viral epitopes by MHC class I and MHC class II molecules over populations when compared to other candidate vaccines. Our method is robust to idiosyncratic errors in the prediction of MHC peptide display and considers target population HLA haplotype frequencies during optimization. To minimize clinical development time our methods validate vaccines with multiple peptide presentation algorithms to increase the probability that a vaccine will be effective. We optimize an objective function that is based on the presentation likelihood of a diverse set of vaccine peptides conditioned on a target population HLA haplotype distribution and expected epitope drift. We produce separate peptide formulations for MHC class I loci (HLA-A, HLA-B, and HLA-C) and class II loci (HLA-DP, HLA-DQ, and HLA-DR) to permit signal sequence based cell compartment targeting using nucleic acid based vaccine platforms. Our SARS-CoV-2 MHC class I vaccine formulations provide 93.21% predicted population coverage with at least five vaccine peptide-HLA hits on average in an individual (≥ 1 peptide 99.91%) with all vaccine peptides perfectly conserved across 4,690 geographically sampled SARS-CoV-2 genomes. Our MHC class II vaccine formulations provide 90.17% predicted coverage with at least five vaccine peptide-HLA hits on average in an individual with all peptides having observed mutation probability ≤ 0.001. We evaluate 29 previously published peptide vaccine designs with our evaluation tool with the requirement of having at least five vaccine peptide-HLA hits per individual, and they have a predicted maximum of 58.51% MHC class I coverage and 71.65% MHC class II coverage given haplotype based analysis. We provide an open source implementation of our design methods (OptiVax), vaccine evaluation tool (EvalVax), as well as the data used in our design efforts.
Collapse
|
35
|
Zhao T, Cheng L, Zang T, Hu Y. Peptide-Major Histocompatibility Complex Class I Binding Prediction Based on Deep Learning With Novel Feature. Front Genet 2019; 10:1191. [PMID: 31850062 PMCID: PMC6892951 DOI: 10.3389/fgene.2019.01191] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2019] [Accepted: 10/28/2019] [Indexed: 12/27/2022] Open
Abstract
Peptide-based vaccine development needs accurate prediction of the binding affinity between major histocompatibility complex I (MHC I) proteins and their peptide ligands. Nowadays more and more machine learning methods have been developed to predict binding affinity and some of them have become the popular tools. However most of them are designed by the shallow neural networks. Bengio said that deep neural networks can learn better fits with less data than shallow neural networks. In our case, some of the alleles only have dozens of peptide data. In addition, we transform each peptide into a characteristic matrix and input it into the model. As we know when dealing with the problem that the input is a matrix, convolutional neural network (CNN) can find the most critical features by itself. Obviously, compared with the traditional neural network model, CNN is more suitable for predicting binding affinity. Different from the previous studies which are based on blocks substitution matrix (BLOSUM), we used novel feature to do the prediction. Since we consider that the order of the sequence, hydropathy index, polarity and the length of the peptide could affect the binding affinity and the properties of these amino acids are key factors for their binding to MHC, we extracted these information from each peptide. In order to make full use of the data we have obtained, we have integrated different lengths of peptides into 15mer based on the binding mode of peptide to MHC I. In order to demonstrate that our method is reliable to predict peptide-MHC binding, we compared our method with several popular methods. The experiments show the superiority of our method.
Collapse
Affiliation(s)
- Tianyi Zhao
- Department of Computer Science and Technology, School of Life Science and Technology, Harbin Institute of Technology, Harbin, China
| | - Liang Cheng
- College of Bioinformatics Science and Technology, Harbin Medical University, Harbin, China
| | - Tianyi Zang
- Department of Computer Science and Technology, School of Life Science and Technology, Harbin Institute of Technology, Harbin, China
| | - Yang Hu
- Department of Computer Science and Technology, School of Life Science and Technology, Harbin Institute of Technology, Harbin, China
| |
Collapse
|