Prediction of Specific TCR-Peptide Binding From Large Dictionaries of TCR-Peptide Pairs

TCR-ESM: Employing protein language embeddings to predict TCR-peptide-MHC binding

Cognate target identification for T-cell receptors (TCRs) is a significant barrier in T-cell therapy development, which may be overcome by accurately predicting TCR interaction with peptide-bound major histocompatibility complex (pMHC). In this study, we have employed peptide embeddings learned from a large protein language model- Evolutionary Scale Modeling (ESM), to predict TCR-pMHC binding. The TCR-ESM model presented outperforms existing predictors. The complementarity-determining region 3 (CDR3) of the hypervariable TCR is located at the center of the paratope and plays a crucial role in peptide recognition. TCR-ESM trained on paired TCR data with both CDR3α and CDR3β chain information performs significantly better than those trained on data with only CDR3β, suggesting that both TCR chains contribute to specificity, the relative importance however depends on the specific peptide-MHC targeted. The study illuminates the importance of MHC information in TCR-peptide binding which remained inconclusive so far and was thought dependent on the dataset characteristics. TCR-ESM outperforms existing approaches on external datasets, suggesting generalizability. Overall, the potential of deep learning for predicting TCR-pMHC interactions and improving the understanding of factors driving TCR specificity are highlighted. The prediction model is available at http://tcresm.dhanjal-lab.iiitd.edu.in/ as an online tool.

TSpred: a robust prediction framework for TCR-epitope interactions using paired chain TCR sequence data

MOTIVATION

Prediction of T-cell receptor (TCR)-epitope interactions is important for many applications in biomedical research, such as cancer immunotherapy and vaccine design. The prediction of TCR-epitope interactions remains challenging especially for novel epitopes, due to the scarcity of available data.

RESULTS

We propose TSpred, a new deep learning approach for the pan-specific prediction of TCR binding specificity based on paired chain TCR data. We develop a robust model that generalizes well to unseen epitopes by combining the predictive power of CNN and the attention mechanism. In particular, we design a reciprocal attention mechanism which focuses on extracting the patterns underlying TCR-epitope interactions. Upon a comprehensive evaluation of our model, we find that TSpred achieves state-of-the-art performances in both seen and unseen epitope specificity prediction tasks. Also, compared to other predictors, TSpred is more robust to bias related to peptide imbalance in the dataset. In addition, the reciprocal attention component of our model allows for model interpretability by capturing structurally important binding regions. Results indicate that TSpred is a robust and reliable method for the task of TCR-epitope binding prediction.

AVAILABILITY AND IMPLEMENTATION

Source code is available at https://github.com/ha01994/TSpred.

Computational Methods for Predicting Key Interactions in T Cell-Mediated Adaptive Immunity

The adaptive immune system recognizes pathogen- and cancer-specific features and is endowed with memory, enabling it to respond quickly and efficiently to repeated encounters with the same antigens. T cells play a central role in the adaptive immune system by directly targeting intracellular pathogens and helping to activate B cells to secrete antibodies. Several fundamental protein interactions-including those between major histocompatibility complex (MHC) proteins and antigen-derived peptides as well as between T cell receptors and peptide-MHC complexes-underlie the ability of T cells to recognize antigens with great precision. Computational approaches to predict these interactions are increasingly being used for medically relevant applications, including vaccine design and prediction of patient response to cancer immunotherapies. We provide computational researchers with an accessible introduction to the adaptive immune system, review computational approaches to predict the key protein interactions underlying T cell-mediated adaptive immunity, and highlight remaining challenges.

Development and Clinical Applications of Therapeutic Cancer Vaccines with Individualized and Shared Neoantigens

Neoantigens, presented as peptides on the surfaces of cancer cells, have recently been proposed as optimal targets for immunotherapy in clinical practice. The promising outcomes of neoantigen-based cancer vaccines have inspired enthusiasm for their broader clinical applications. However, the individualized tumor-specific antigens (TSA) entail considerable costs and time due to the variable immunogenicity and response rates of these neoantigens-based vaccines, influenced by factors such as neoantigen response, vaccine types, and combination therapy. Given the crucial role of neoantigen efficacy, a number of bioinformatics algorithms and pipelines have been developed to improve the accuracy rate of prediction through considering a series of factors involving in HLA-peptide-TCR complex formation, including peptide presentation, HLA-peptide affinity, and TCR recognition. On the other hand, shared neoantigens, originating from driver mutations at hot mutation spots (e.g., KRASG12D), offer a promising and ideal target for the development of therapeutic cancer vaccines. A series of clinical practices have established the efficacy of these vaccines in patients with distinct HLA haplotypes. Moreover, increasing evidence demonstrated that a combination of tumor associated antigens (TAAs) and neoantigens can also improve the prognosis, thus expand the repertoire of shared neoantigens for cancer vaccines. In this review, we provide an overview of the complex process involved in identifying personalized neoantigens, their clinical applications, advances in vaccine technology, and explore the therapeutic potential of shared neoantigen strategies.

TDC-2: Multimodal Foundation for Therapeutic Science

Therapeutics Data Commons (tdcommons.ai) is an open science initiative with unified datasets, AI models, and benchmarks to support research across therapeutic modalities and drug discovery and development stages. The Commons 2.0 (TDC-2) is a comprehensive overhaul of Therapeutic Data Commons to catalyze research in multimodal models for drug discovery by unifying single-cell biology of diseases, biochemistry of molecules, and effects of drugs through multimodal datasets, AI-powered API endpoints, new multimodal tasks and model frameworks, and comprehensive benchmarks. TDC-2 introduces over 1,000 multimodal datasets spanning approximately 85 million cells, pre-calculated embeddings from 5 state-of-the-art single-cell models, and a biomedical knowledge graph. TDC-2 drastically expands the coverage of ML tasks across therapeutic pipelines and 10+ new modalities, spanning but not limited to single-cell gene expression data, clinical trial data, peptide sequence data, peptidomimetics protein-peptide interaction data regarding newly discovered ligands derived from AS-MS spectroscopy, novel 3D structural data for proteins, and cell-type-specific protein-protein interaction networks at single-cell resolution. TDC-2 introduces multimodal data access under an API-first design using the model-view-controller paradigm. TDC-2 introduces 7 novel ML tasks with fine-grained biological contexts: contextualized drug-target identification, single-cell chemical/genetic perturbation response prediction, protein-peptide binding affinity prediction task, and clinical trial outcome prediction task, which introduce antigen-processing-pathway-specific, cell-type-specific, peptide-specific, and patient-specific biological contexts. TDC-2 also releases benchmarks evaluating 15+ state-of-the-art models across 5+ new learning tasks evaluating models on diverse biological contexts and sampling approaches. Among these, TDC-2 provides the first benchmark for context-specific learning. TDC-2, to our knowledge, is also the first to introduce a protein-peptide binding interaction benchmark.

Artificial intelligence and neoantigens: paving the path for precision cancer immunotherapy

Cancer immunotherapy has witnessed rapid advancement in recent years, with a particular focus on neoantigens as promising targets for personalized treatments. The convergence of immunogenomics, bioinformatics, and artificial intelligence (AI) has propelled the development of innovative neoantigen discovery tools and pipelines. These tools have revolutionized our ability to identify tumor-specific antigens, providing the foundation for precision cancer immunotherapy. AI-driven algorithms can process extensive amounts of data, identify patterns, and make predictions that were once challenging to achieve. However, the integration of AI comes with its own set of challenges, leaving space for further research. With particular focus on the computational approaches, in this article we have explored the current landscape of neoantigen prediction, the fundamental concepts behind, the challenges and their potential solutions providing a comprehensive overview of this rapidly evolving field.

GTE: a graph learning framework for prediction of T-cell receptors and epitopes binding specificity

The interaction between T-cell receptors (TCRs) and peptides (epitopes) presented by major histocompatibility complex molecules (MHC) is fundamental to the immune response. Accurate prediction of TCR-epitope interactions is crucial for advancing the understanding of various diseases and their prevention and treatment. Existing methods primarily rely on sequence-based approaches, overlooking the inherent topology structure of TCR-epitope interaction networks. In this study, we present $GTE$, a novel heterogeneous Graph neural network model based on inductive learning to capture the topological structure between TCRs and Epitopes. Furthermore, we address the challenge of constructing negative samples within the graph by proposing a dynamic edge update strategy, enhancing model learning with the nonbinding TCR-epitope pairs. Additionally, to overcome data imbalance, we adapt the Deep AUC Maximization strategy to the graph domain. Extensive experiments are conducted on four public datasets to demonstrate the superiority of exploring underlying topological structures in predicting TCR-epitope interactions, illustrating the benefits of delving into complex molecular networks. The implementation code and data are available at https://github.com/uta-smile/GTE.

Designing meaningful continuous representations of T cell receptor sequences with deep generative models

T Cell Receptor (TCR) antigen binding underlies a key mechanism of the adaptive immune response yet the vast diversity of TCRs and the complexity of protein interactions limits our ability to build useful low dimensional representations of TCRs. To address the current limitations in TCR analysis we develop a capacity-controlled disentangling variational autoencoder trained using a dataset of approximately 100 million TCR sequences, that we name TCR-VALID. We design TCR-VALID such that the model representations are low-dimensional, continuous, disentangled, and sufficiently informative to provide high-quality TCR sequence de novo generation. We thoroughly quantify these properties of the representations, providing a framework for future protein representation learning in low dimensions. The continuity of TCR-VALID representations allows fast and accurate TCR clustering and is benchmarked against other state-of-the-art TCR clustering tools and pre-trained language models.

VitTCR: A deep learning method for peptide recognition prediction

This study introduces VitTCR, a predictive model based on the vision transformer (ViT) architecture, aimed at identifying interactions between T cell receptors (TCRs) and peptides, crucial for developing cancer immunotherapies and vaccines. VitTCR converts TCR-peptide interactions into numerical AtchleyMaps using Atchley factors for prediction, achieving AUROC (0.6485) and AUPR (0.6295) values. Benchmark analysis indicates VitTCR's performance is comparable to other models, with further comparative studies suggested to understand its effectiveness in varied contexts. Additionally, integrating a positional bias weight matrix (PBWM), derived from amino acid contact probabilities in structurally resolved pMHC-TCR complexes, slightly improves VitTCR's accuracy. The model's predictions show weak yet statistically significant correlations with immunological factors like T cell clonal expansion and activation percentages, underscoring the biological relevance of VitTCR's predictive capabilities. VitTCR emerges as a valuable computational tool for predicting TCR-peptide interactions, offering insights for immunotherapy and vaccine development.

Unified cross-modality integration and analysis of T cell receptors and T cell transcriptomes by low-resource-aware representation learning

Single-cell RNA sequencing (scRNA-seq) and T cell receptor sequencing (TCR-seq) are pivotal for investigating T cell heterogeneity. Integrating these modalities, which is expected to uncover profound insights in immunology that might otherwise go unnoticed with a single modality, faces computational challenges due to the low-resource characteristics of the multimodal data. Herein, we present UniTCR, a novel low-resource-aware multimodal representation learning framework designed for the unified cross-modality integration, enabling comprehensive T cell analysis. By designing a dual-modality contrastive learning module and a single-modality preservation module to effectively embed each modality into a common latent space, UniTCR demonstrates versatility in connecting TCR sequences with T cell transcriptomes across various tasks, including single-modality analysis, modality gap analysis, epitope-TCR binding prediction, and TCR profile cross-modality generation, in a low-resource-aware way. Extensive evaluations conducted on multiple scRNA-seq/TCR-seq paired datasets showed the superior performance of UniTCR, exhibiting the ability of exploring the complexity of immune system.

DIRMC: a database of immunotherapy-related molecular characteristics

Cancer immunotherapy has brought about a revolutionary breakthrough in the field of cancer treatment. Immunotherapy has changed the treatment landscape for a variety of solid and hematologic malignancies. To assist researchers in efficiently uncovering valuable information related to cancer immunotherapy, we have presented a manually curated comprehensive database called DIRMC, which focuses on molecular features involved in cancer immunotherapy. All the content was collected manually from published literature, authoritative clinical trial data submitted by clinicians, some databases for drug target prediction such as DrugBank, and some experimentally confirmed high-throughput data sets for the characterization of immune-related molecular interactions in cancer, such as a curated database of T-cell receptor sequences with known antigen specificity (VDJdb), a pathology-associated TCR database (McPAS-TCR) et al. By constructing a fully connected functional network, ranging from cancer-related gene mutations to target genes to translated target proteins to protein regions or sites that may specifically affect protein function, we aim to comprehensively characterize molecular features related to cancer immunotherapy. We have developed the scoring criteria to assess the reliability of each MHC-peptide-T-cell receptor (TCR) interaction item to provide a reference for users. The database provides a user-friendly interface to browse and retrieve data by genes, target proteins, diseases and more. DIRMC also provides a download and submission page for researchers to access data of interest for further investigation or submit new interactions related to cancer immunotherapy targets. Furthermore, DIRMC provides a graphical interface to help users predict the binding affinity between their own peptide of interest and MHC or TCR. This database will provide researchers with a one-stop resource to understand cancer immunotherapy-related targets as well as data on MHC-peptide-TCR interactions. It aims to offer reliable molecular characteristics support for both the analysis of the current status of cancer immunotherapy and the development of new immunotherapy. DIRMC is available at http://www.dirmc.tech/. Database URL: http://www.dirmc.tech/.

The physiological interactome of TCR-like antibody therapeutics in human tissues

Selective binding of TCR-like antibodies that target a single tumour-specific peptide antigen presented by human leukocyte antigens (HLA) is the absolute prerequisite for their therapeutic suitability and patient safety. To date, selectivity assessment has been limited to peptide library screening and predictive modeling. We developed an experimental platform to de novo identify interactomes of TCR-like antibodies directly in human tissues using mass spectrometry. As proof of concept, we confirm the target epitope of a MAGE-A4-specific TCR-like antibody. We further determine cross-reactive peptide sequences for ESK1, a TCR-like antibody with known off-target activity, in human liver tissue. We confirm off-target-induced T cell activation and ESK1-mediated liver spheroid killing. Off-target sequences feature an amino acid motif that allows a structural groove-coordination mimicking that of the target peptide, therefore allowing the interaction with the engager molecule. We conclude that our strategy offers an accurate, scalable route for evaluating the non-clinical safety profile of TCR-like antibody therapeutics prior to first-in-human clinical application.

Deep learning predictions of TCR-epitope interactions reveal epitope-specific chains in dual alpha T cells

T cells have the ability to eliminate infected and cancer cells and play an essential role in cancer immunotherapy. T cell activation is elicited by the binding of the T cell receptor (TCR) to epitopes displayed on MHC molecules, and the TCR specificity is determined by the sequence of its α and β chains. Here, we collect and curate a dataset of 17,715 αβTCRs interacting with dozens of class I and class II epitopes. We use this curated data to develop MixTCRpred, an epitope-specific TCR-epitope interaction predictor. MixTCRpred accurately predicts TCRs recognizing several viral and cancer epitopes. MixTCRpred further provides a useful quality control tool for multiplexed single-cell TCR sequencing assays of epitope-specific T cells and pinpoints a substantial fraction of putative contaminants in public databases. Analysis of epitope-specific dual α T cells demonstrates that MixTCRpred can identify α chains mediating epitope recognition. Applying MixTCRpred to TCR repertoires from COVID-19 patients reveals enrichment of clonotypes predicted to bind an immunodominant SARS-CoV-2 epitope. Overall, MixTCRpred provides a robust tool to predict TCRs interacting with specific epitopes and interpret TCR-sequencing data from both bulk and epitope-specific T cells.

Novel insights into TCR-T cell therapy in solid neoplasms: optimizing adoptive immunotherapy

Adoptive immunotherapy in the T cell landscape exhibits efficacy in cancer treatment. Over the past few decades, genetically modified T cells, particularly chimeric antigen receptor T cells, have enabled remarkable strides in the treatment of hematological malignancies. Besides, extensive exploration of multiple antigens for the treatment of solid tumors has led to clinical interest in the potential of T cells expressing the engineered T cell receptor (TCR). TCR-T cells possess the capacity to recognize intracellular antigen families and maintain the intrinsic properties of TCRs in terms of affinity to target epitopes and signal transduction. Recent research has provided critical insight into their capability and therapeutic targets for multiple refractory solid tumors, but also exposes some challenges for durable efficacy. In this review, we describe the screening and identification of available tumor antigens, and the acquisition and optimization of TCRs for TCR-T cell therapy. Furthermore, we summarize the complete flow from  laboratory to clinical applications of TCR-T cells. Last, we emerge future prospects for improving therapeutic efficacy in cancer world with combination therapies or TCR-T derived products. In conclusion, this review depicts our current understanding of TCR-T cell therapy in solid neoplasms, and provides new perspectives for expanding its clinical applications and improving therapeutic efficacy.

Predicting TCR sequences for unseen antigen epitopes using structural and sequence features

T-cell receptor (TCR) recognition of antigens is fundamental to the adaptive immune response. With the expansion of experimental techniques, a substantial database of matched TCR-antigen pairs has emerged, presenting opportunities for computational prediction models. However, accurately forecasting the binding affinities of unseen antigen-TCR pairs remains a major challenge. Here, we present convolutional-self-attention TCR (CATCR), a novel framework tailored to enhance the prediction of epitope and TCR interactions. Our approach utilizes convolutional neural networks to extract peptide features from residue contact matrices, as generated by OpenFold, and a transformer to encode segment-based coded sequences. We introduce CATCR-D, a discriminator that can assess binding by analyzing the structural and sequence features of epitopes and CDR3-β regions. Additionally, the framework comprises CATCR-G, a generative module designed for CDR3-β sequences, which applies the pretrained encoder to deduce epitope characteristics and a transformer decoder for predicting matching CDR3-β sequences. CATCR-D achieved an AUROC of 0.89 on previously unseen epitope-TCR pairs and outperformed four benchmark models by a margin of 17.4%. CATCR-G has demonstrated high precision, recall and F1 scores, surpassing 95% in bidirectional encoder representations from transformers score assessments. Our results indicate that CATCR is an effective tool for predicting unseen epitope-TCR interactions. Incorporating structural insights enhances our understanding of the general rules governing TCR-epitope recognition significantly. The ability to predict TCRs for novel epitopes using structural and sequence information is promising, and broadening the repository of experimental TCR-epitope data could further improve the precision of epitope-TCR binding predictions.

APTAnet: an atom-level peptide-TCR interaction affinity prediction model

The prediction of affinity between TCRs and peptides is crucial for the further development of TIL (Tumor-Infiltrating Lymphocytes) immunotherapy. Inspired by the broader research of drug-protein interaction (DPI), we propose an atom-level peptide-TCR interaction (PTI) affinity prediction model APTAnet using natural language processing methods. APTAnet model achieved an average ROC-AUC and PR-AUC of 0.893 and 0.877, respectively, in ten-fold cross-validation on 25,675 pairs of PTI data. Furthermore, experimental results on an independent test set from the McPAS database showed that APTAnet outperformed the current mainstream models. Finally, through the validation on 11 cases of real tumor patient data, we found that the APTAnet model can effectively identify tumor peptides and screen tumor-specific TCRs.

The spike-specific TCRβ repertoire shows distinct features in unvaccinated or vaccinated patients with SARS-CoV-2 infection

BACKGROUND

The evolving variants of SARS-CoV-2 may escape immunity from prior infections or vaccinations. It's vital to understand how immunity adapts to these changes. Both infection and mRNA vaccination induce T cells that target the Spike protein. These T cells can recognize multiple variants, such as Delta and Omicron, even if neutralizing antibodies are weakened. However, the degree of recognition can vary among people, affecting vaccine efficacy. Previous studies demonstrated the capability of T-cell receptor (TCR) repertoire analysis to identify conserved and immunodominant peptides with cross-reactive potential among variant of concerns. However, there is a need to extend the analysis of the TCR repertoire to different clinical scenarios. The aim of this study was to examine the Spike-specific TCR repertoire profiles in natural infections and those with combined natural and vaccine immunity.

METHODS

A T-cell enrichment approach and bioinformatic tools were used to investigate the Spike-specific TCRβ repertoire in peripheral blood mononuclear cells of previously vaccinated (n = 8) or unvaccinated (n = 6) COVID-19 patients.

RESULTS

Diversity and clonality of the TCRβ repertoire showed no significant differences between vaccinated and unvaccinated groups. When comparing the TCRβ data to public databases, 692 unique TCRβ sequences linked to S epitopes were found in the vaccinated group and 670 in the unvaccinated group. TCRβ clonotypes related to spike regions S135-177, S264-276, S319-350, and S448-472 appear notably more prevalent in the vaccinated group. In contrast, the S673-699 epitope, believed to have super antigenic properties, is observed more frequently in the unvaccinated group. In-silico analyses suggest that mutations in epitopes, relative to the main SARS-CoV-2 variants of concern, don't hinder their cross-reactive recognition by associated TCRβ clonotypes.

CONCLUSIONS

Our findings reveal distinct TCRβ signatures in vaccinated and unvaccinated individuals with COVID-19. These differences might be associated with disease severity and could influence clinical outcomes.

TRIAL REGISTRATION

FESR/FSE 2014-2020 DDRC n. 585, Action 10.5.12, noCOVID19@UMG.

T-cell receptor determinants of response to chemoradiation in locally-advanced HPV16-driven malignancies

Background

The effect of chemoradiation on the anti-cancer immune response is being increasingly acknowledged; however, its clinical implications in treatment responses are yet to be fully understood. Human papillomavirus (HPV)-driven malignancies express viral oncogenic proteins which may serve as tumor-specific antigens and represent ideal candidates for monitoring the peripheral T-cell receptor (TCR) changes secondary to chemoradiotherapy (CRT).

Methods

We performed intra-tumoral and pre- and post-treatment peripheral TCR sequencing in a cohort of patients with locally-advanced HPV16-positive cancers treated with CRT. An in silico computational pipeline was used to cluster TCR repertoire based on epitope-specificity and to predict affinity between these clusters and HPV16-derived epitopes.

Results

Intra-tumoral repertoire diversity, intra-tumoral and post-treatment peripheral CDR3β similarity clustering were predictive of response. In responders, CRT triggered an increase peripheral TCR clonality and clonal relatedness. Post-treatment expansion of baseline peripheral dominant TCRs was associated with response. Responders showed more baseline clustered structures of TCRs maintained post-treatment and displayed significantly more maintained clustered structures. When applying clustering by TCR-specificity methods, responders displayed a higher proportion of intra-tumoral TCRs predicted to recognise HPV16 peptides.

Conclusions

Baseline TCR characteristics and changes in the peripheral T-cell clones triggered by CRT are associated with treatment outcome. Maintenance and boosting of pre-existing clonotypes are key elements of an effective anti-cancer immune response driven by CRT, supporting a paradigm in which the immune system plays a central role in the success of CRT in current standard-of-care protocols.

TEPCAM: Prediction of T-cell receptor-epitope binding specificity via interpretable deep learning

The recognition of T-cell receptor (TCR) on the surface of T cell to specific epitope presented by the major histocompatibility complex is the key to trigger the immune response. Identifying the binding rules of TCR-epitope pair is crucial for developing immunotherapies, including neoantigen vaccine and drugs. Accurate prediction of TCR-epitope binding specificity via deep learning remains challenging, especially in test cases which are unseen in the training set. Here, we propose TEPCAM (TCR-EPitope identification based on Cross-Attention and Multi-channel convolution), a deep learning model that incorporates self-attention, cross-attention mechanism, and multi-channel convolution to improve the generalizability and enhance the model interpretability. Experimental results demonstrate that our model outperformed several state-of-the-art models on two challenging tasks including a strictly split dataset and an external dataset. Furthermore, the model can learn some interaction patterns between TCR and epitope by extracting the interpretable matrix from cross-attention layer and mapping them to the three-dimensional structures. The source code and data are freely available at https://github.com/Chenjw99/TEPCAM.

Attention network for predicting T-cell receptor-peptide binding can associate attention with interpretable protein structural properties

Understanding how a T-cell receptor (TCR) recognizes its specific ligand peptide is crucial for gaining an insight into biological functions and disease mechanisms. Despite its importance, experimentally determining TCR-peptide-major histocompatibility complex (TCR-pMHC) interactions is expensive and time-consuming. To address this challenge, computational methods have been proposed, but they are typically evaluated by internal retrospective validation only, and few researchers have incorporated and tested an attention layer from language models into structural information. Therefore, in this study, we developed a machine learning model based on a modified version of Transformer, a source-target attention neural network, to predict the TCR-pMHC interaction solely from the amino acid sequences of the TCR complementarity-determining region (CDR) 3 and the peptide. This model achieved competitive performance on a benchmark dataset of the TCR-pMHC interaction, as well as on a truly new external dataset. Additionally, by analyzing the results of binding predictions, we associated the neural network weights with protein structural properties. By classifying the residues into large- and small-attention groups, we identified statistically significant properties associated with the largely attended residues such as hydrogen bonds within CDR3. The dataset that we created and the ability of our model to provide an interpretable prediction of TCR-peptide binding should increase our knowledge about molecular recognition and pave the way for designing new therapeutics.

pan-MHC and cross-Species Prediction of T Cell Receptor-Antigen Binding

Profiling the binding of T cell receptors (TCRs) of T cells to antigenic peptides presented by MHC proteins is one of the most important unsolved problems in modern immunology. Experimental methods to probe TCR-antigen interactions are slow, labor-intensive, costly, and yield moderate throughput. To address this problem, we developed pMTnet-omni, an Artificial Intelligence (AI) system based on hybrid protein sequence and structure information, to predict the pairing of TCRs of αβ T cells with peptide-MHC complexes (pMHCs). pMTnet-omni is capable of handling peptides presented by both class I and II pMHCs, and capable of handling both human and mouse TCR-pMHC pairs, through information sharing enabled this hybrid design. pMTnet-omni achieves a high overall Area Under the Curve of Receiver Operator Characteristics (AUROC) of 0.888, which surpasses competing tools by a large margin. We showed that pMTnet-omni can distinguish binding affinity of TCRs with similar sequences. Across a range of datasets from various biological contexts, pMTnet-omni characterized the longitudinal evolution and spatial heterogeneity of TCR-pMHC interactions and their functional impact. We successfully developed a biomarker based on pMTnet-omni for predicting immune-related adverse events of immune checkpoint inhibitor (ICI) treatment in a cohort of 57 ICI-treated patients. pMTnet-omni represents a major advance towards developing a clinically usable AI system for TCR-pMHC pairing prediction that can aid the design and implementation of TCR-based immunotherapeutics.

GGNpTCR: A Generative Graph Structure Neural Network for Predicting Immunogenic Peptides for T-cell Immune Response

Identifying the interactions between T-cell receptor (TCRs) and human antigens is a crucial step in developing new vaccines, diagnostics, and immunotherapy. Current methods primarily focus on learning binding patterns from known TCR binding repertoires by using sequence information alone without considering the binding specificity of new antigens or exogenous peptides that have not appeared in the training set. Furthermore, the spatial structure of antigens plays a critical role in immune studies and immunotherapy, which should be addressed properly in the identification of interacting TCR-antigen pairs. In this study, we introduced a novel deep learning framework based on generative graph structures, GGNpTCR, for predicting interactions between TCR and peptides from sequence information. Results of real data analysis indicate that our model achieved excellent prediction for new antigens unseen in the training data set, making significant improvements compared to existing methods. We also applied the model to a large COVID-19 data set with no antigens in the training data set, and the improvement was also significant. Furthermore, through incorporation of additional supervised mechanisms, GGNpTCR demonstrated the ability to precisely forecast the locations of peptide-TCR interactions within 3D configurations. This enhancement substantially improved the model's interpretability. In summary, based on the performance on multiple data sets, GGNpTCR has made significant progress in terms of performance, universality, and interpretability.

Neoantigen-targeted TCR-engineered T cell immunotherapy: current advances and challenges

Adoptive cell therapy using T cell receptor-engineered T cells (TCR-T) is a promising approach for cancer therapy with an expectation of no significant side effects. In the human body, mature T cells are armed with an incredible diversity of T cell receptors (TCRs) that theoretically react to the variety of random mutations generated by tumor cells. The outcomes, however, of current clinical trials using TCR-T cell therapies are not very successful especially involving solid tumors. The therapy still faces numerous challenges in the efficient screening of tumor-specific antigens and their cognate TCRs. In this review, we first introduce TCR structure-based antigen recognition and signaling, then describe recent advances in neoantigens and their specific TCR screening technologies, and finally summarize ongoing clinical trials of TCR-T therapies against neoantigens. More importantly, we also present the current challenges of TCR-T cell-based immunotherapies, e.g., the safety of viral vectors, the mismatch of T cell receptor, the impediment of suppressive tumor microenvironment. Finally, we highlight new insights and directions for personalized TCR-T therapy.

EPIC-TRACE: predicting TCR binding to unseen epitopes using attention and contextualized embeddings

MOTIVATION

T cells play an essential role in adaptive immune system to fight pathogens and cancer but may also give rise to autoimmune diseases. The recognition of a peptide-MHC (pMHC) complex by a T cell receptor (TCR) is required to elicit an immune response. Many machine learning models have been developed to predict the binding, but generalizing predictions to pMHCs outside the training data remains challenging.

RESULTS

We have developed a new machine learning model that utilizes information about the TCR from both α and β chains, epitope sequence, and MHC. Our method uses ProtBERT embeddings for the amino acid sequences of both chains and the epitope, as well as convolution and multi-head attention architectures. We show the importance of each input feature as well as the benefit of including epitopes with only a few TCRs to the training data. We evaluate our model on existing databases and show that it compares favorably against other state-of-the-art models.

AVAILABILITY AND IMPLEMENTATION

https://github.com/DaniTheOrange/EPIC-TRACE.

Striking efficacy of a vaccine targeting TOP2A for triple-negative breast cancer immunoprevention

Triple-negative breast cancer (TNBC) is an aggressive subtype of breast cancer that has a poor prognosis. TOP2A is a key enzyme in DNA replication and is a therapeutic target for breast and other cancers. TOP2A-specific Th1-promoting epitopes with optimal binding affinity to MHC II were identified using a combined scoring system. The multi-peptide TOP2A vaccine elicited a robust immunologic response in immunized mice, as demonstrated by the significant production of Th1 cytokines from immunized animals' splenocytes stimulated in vitro with TOP2A peptides. Anti-tumor efficacy of the TOP2A vaccine was demonstrated in a syngeneic TNBC mouse model, in which pre-graft preventive vaccination was associated with significantly decreased tumor growth as compared to adjuvant control. In a genetically engineered mouse (GEM) model of TNBC, vaccinated animals demonstrated a significant reduction in tumor incidence and average tumor volume compared to adjuvant control. Finally, we examined TCR sequences in CD4 tumor Infiltrating lymphocytes (TIL) from vaccinated mice and found that the TIL contained TCR sequences specific to the three vaccine peptides. These data indicate that our newly developed multi-peptide TOP2A vaccine is highly immunogenic, elicits TILs with vaccine specific TCRs, and is highly effective in preventing and intercepting TNBC development and progression in vivo.

A transfer-learning approach to predict antigen immunogenicity and T-cell receptor specificity

Antigen immunogenicity and the specificity of binding of T-cell receptors to antigens are key properties underlying effective immune responses. Here we propose diffRBM, an approach based on transfer learning and Restricted Boltzmann Machines, to build sequence-based predictive models of these properties. DiffRBM is designed to learn the distinctive patterns in amino-acid composition that, on the one hand, underlie the antigen's probability of triggering a response, and on the other hand the T-cell receptor's ability to bind to a given antigen. We show that the patterns learnt by diffRBM allow us to predict putative contact sites of the antigen-receptor complex. We also discriminate immunogenic and non-immunogenic antigens, antigen-specific and generic receptors, reaching performances that compare favorably to existing sequence-based predictors of antigen immunogenicity and T-cell receptor specificity.

Quantitative approaches for decoding the specificity of the human T cell repertoire

T cell receptor (TCR)-peptide-major histocompatibility complex (pMHC) interactions play a vital role in initiating immune responses against pathogens, and the specificity of TCRpMHC interactions is crucial for developing optimized therapeutic strategies. The advent of high-throughput immunological and structural evaluation of TCR and pMHC has provided an abundance of data for computational approaches that aim to predict favorable TCR-pMHC interactions. Current models are constructed using information on protein sequence, structures, or a combination of both, and utilize a variety of statistical learning-based approaches for identifying the rules governing specificity. This review examines the current theoretical, computational, and deep learning approaches for identifying TCR-pMHC recognition pairs, placing emphasis on each method's mathematical approach, predictive performance, and limitations.

Large-scale template-based structural modeling of T-cell receptors with known antigen specificity reveals complementarity features

Introduction

T-cell receptor (TCR) recognition of foreign peptides presented by the major histocompatibility complex (MHC) initiates the adaptive immune response against pathogens. While a large number of TCR sequences specific to different antigenic peptides are known to date, the structural data describing the conformation and contacting residues for TCR-peptide-MHC complexes is relatively limited. In the present study we aim to extend and analyze the set of available structures by performing highly accurate template-based modeling of these complexes using TCR sequences with known specificity.

Methods

Identification of CDR3 sequences and their further clustering, based on available spatial structures, V- and J-genes of corresponding T-cell receptors, and epitopes, was performed using the VDJdb database. Modeling of the selected CDR3 loops was conducted using a stepwise introduction of single amino acid substitutions to the template PDB structures, followed by optimization of the TCR-peptide-MHC contacting interface using the Rosetta package applications. Statistical analysis and recursive feature elimination procedures were carried out on computed energy values and properties of contacting amino acid residues between CDR3 loops and peptides, using R.

Results

Using the set of 29 complex templates (including a template with SARS-CoV-2 antigen) and 732 specificity records, we built a database of 1585 model structures carrying substitutions in either TCRα or TCRβ chains with some models representing the result of different mutation pathways for the same final structure. This database allowed us to analyze features of amino acid contacts in TCR - peptide interfaces that govern antigen recognition preferences and interpret these interactions in terms of physicochemical properties of interacting residues.

Conclusion

Our results provide a methodology for creating high-quality TCR-peptide-MHC models for antigens of interest that can be utilized to predict TCR specificity.

DeepAIR: A deep learning framework for effective integration of sequence and 3D structure to enable adaptive immune receptor analysis

Structural docking between the adaptive immune receptors (AIRs), including T cell receptors (TCRs) and B cell receptors (BCRs), and their cognate antigens are one of the most fundamental processes in adaptive immunity. However, current methods for predicting AIR-antigen binding largely rely on sequence-derived features of AIRs, omitting the structure features that are essential for binding affinity. In this study, we present a deep learning framework, termed DeepAIR, for the accurate prediction of AIR-antigen binding by integrating both sequence and structure features of AIRs. DeepAIR achieves a Pearson's correlation of 0.813 in predicting the binding affinity of TCR, and a median area under the receiver-operating characteristic curve (AUC) of 0.904 and 0.942 in predicting the binding reactivity of TCR and BCR, respectively. Meanwhile, using TCR and BCR repertoire, DeepAIR correctly identifies every patient with nasopharyngeal carcinoma and inflammatory bowel disease in test data. Thus, DeepAIR improves the AIR-antigen binding prediction that facilitates the study of adaptive immunity.

MIX-TPI: a flexible prediction framework for TCR-pMHC interactions based on multimodal representations

MOTIVATION

The interactions between T-cell receptors (TCR) and peptide-major histocompatibility complex (pMHC) are essential for the adaptive immune system. However, identifying these interactions can be challenging due to the limited availability of experimental data, sequence data heterogeneity, and high experimental validation costs.

RESULTS

To address this issue, we develop a novel computational framework, named MIX-TPI, to predict TCR-pMHC interactions using amino acid sequences and physicochemical properties. Based on convolutional neural networks, MIX-TPI incorporates sequence-based and physicochemical-based extractors to refine the representations of TCR-pMHC interactions. Each modality is projected into modality-invariant and modality-specific representations to capture the uniformity and diversities between different features. A self-attention fusion layer is then adopted to form the classification module. Experimental results demonstrate the effectiveness of MIX-TPI in comparison with other state-of-the-art methods. MIX-TPI also shows good generalization capability on mutual exclusive evaluation datasets and a paired TCR dataset.

AVAILABILITY AND IMPLEMENTATION

The source code of MIX-TPI and the test data are available at: https://github.com/Wolverinerine/MIX-TPI.

Can we predict T cell specificity with digital biology and machine learning?

Recent advances in machine learning and experimental biology have offered breakthrough solutions to problems such as protein structure prediction that were long thought to be intractable. However, despite the pivotal role of the T cell receptor (TCR) in orchestrating cellular immunity in health and disease, computational reconstruction of a reliable map from a TCR to its cognate antigens remains a holy grail of systems immunology. Current data sets are limited to a negligible fraction of the universe of possible TCR-ligand pairs, and performance of state-of-the-art predictive models wanes when applied beyond these known binders. In this Perspective article, we make the case for renewed and coordinated interdisciplinary effort to tackle the problem of predicting TCR-antigen specificity. We set out the general requirements of predictive models of antigen binding, highlight critical challenges and discuss how recent advances in digital biology such as single-cell technology and machine learning may provide possible solutions. Finally, we describe how predicting TCR specificity might contribute to our understanding of the broader puzzle of antigen immunogenicity.

BERTrand-peptide:TCR binding prediction using Bidirectional Encoder Representations from Transformers augmented with random TCR pairing

MOTIVATION

The advent of T-cell receptor (TCR) sequencing experiments allowed for a significant increase in the amount of peptide:TCR binding data available and a number of machine-learning models appeared in recent years. High-quality prediction models for a fixed epitope sequence are feasible, provided enough known binding TCR sequences are available. However, their performance drops significantly for previously unseen peptides.

RESULTS

We prepare the dataset of known peptide:TCR binders and augment it with negative decoys created using healthy donors' T-cell repertoires. We employ deep learning methods commonly applied in Natural Language Processing to train part a peptide:TCR binding model with a degree of cross-peptide generalization (0.69 AUROC). We demonstrate that BERTrand outperforms the published methods when evaluated on peptide sequences not used during model training.

AVAILABILITY AND IMPLEMENTATION

The datasets and the code for model training are available at https://github.com/SFGLab/bertrand.

iTCep: a deep learning framework for identification of T cell epitopes by harnessing fusion features

Neoantigens recognized by cytotoxic T cells are effective targets for tumor-specific immune responses for personalized cancer immunotherapy. Quite a few neoantigen identification pipelines and computational strategies have been developed to improve the accuracy of the peptide selection process. However, these methods mainly consider the neoantigen end and ignore the interaction between peptide-TCR and the preference of each residue in TCRs, resulting in the filtered peptides often fail to truly elicit an immune response. Here, we propose a novel encoding approach for peptide-TCR representation. Subsequently, a deep learning framework, namely iTCep, was developed to predict the interactions between peptides and TCRs using fusion features derived from a feature-level fusion strategy. The iTCep achieved high predictive performance with AUC up to 0.96 on the testing dataset and above 0.86 on independent datasets, presenting better prediction performance compared with other predictors. Our results provided strong evidence that model iTCep can be a reliable and robust method for predicting TCR binding specificities of given antigen peptides. One can access the iTCep through a user-friendly web server at http://biostatistics.online/iTCep/, which supports prediction modes of peptide-TCR pairs and peptide-only. A stand-alone software program for T cell epitope prediction is also available for convenient installing at https://github.com/kbvstmd/iTCep/.

TPBTE: A model based on convolutional Transformer for predicting the binding of TCR to epitope

T cell receptors (TCRs) selectively bind to antigens to fight pathogens with specific immunity. Current tools focus on the nature of amino acids within sequences and take less into account the nature of amino acids far apart and the relationship between sequences, leading to significant differences in the results from different datasets. We propose TPBTE, a model based on convolutional Transformer for Predicting the Binding of TCR to Epitope. It takes epitope sequences and the complementary decision region 3 (CDR3) sequences of TCRβ chain as inputs. And it uses a convolutional attention mechanism to learn amino acid representations between different positions of the sequences based on learning local features of the sequences. At the same time, it uses cross attention to learn the interaction information between TCR sequences and epitope sequences. A comprehensive evaluation of the TCR-epitope data shows that the average area under the curve of TPBTE outperforms the baseline model, and demonstrate an intentional performance. In addition, TPBTE can give the probability of binding TCR to epitopes, which can be used as the first step of epitope screening, narrowing the scope of epitope search and reducing the time of epitope search.

T-Cell Receptor Repertoire Sequencing in the Era of Cancer Immunotherapy

T cells are integral components of the adaptive immune system, and their responses are mediated by unique T-cell receptors (TCR) that recognize specific antigens from a variety of biological contexts. As a result, analyzing the T-cell repertoire offers a better understanding of immune responses and of diseases like cancer. Next-generation sequencing technologies have greatly enabled the high-throughput analysis of the TCR repertoire. On the basis of our extensive experience in the field from the past decade, we provide an overview of TCR sequencing, from the initial library preparation steps to sequencing and analysis methods and finally to functional validation techniques. With regards to data analysis, we detail important TCR repertoire metrics and present several computational tools for predicting antigen specificity. Finally, we highlight important applications of TCR sequencing and repertoire analysis to understanding tumor biology and developing cancer immunotherapies.

TCR sequencing: applications in immuno-oncology research

•T-cell receptor (TCR) interaction with major histocompatibility complex-antigen complexes leads to antitumour responses.•TCR sequencing analysis allows characterisation of T cells that recognise tumour neoantigens.•T-cell clonal revival and clonal replacement potentially underpin immunotherapy responses.

T cell receptor gene repertoire profiles in subgroups of patients with chronic lymphocytic leukemia bearing distinct genomic aberrations

Background

Microenvironmental interactions of the malignant clone with T cells are critical throughout the natural history of chronic lymphocytic leukemia (CLL). Indeed, clonal expansions of T cells and shared clonotypes exist between different CLL patients, strongly implying clonal selection by antigens. Moreover, immunogenic neoepitopes have been isolated from the clonotypic B cell receptor immunoglobulin sequences, offering a rationale for immunotherapeutic approaches. Here, we interrogated the T cell receptor (TR) gene repertoire of CLL patients with different genomic aberration profiles aiming to identify unique signatures that would point towards an additional source of immunogenic neoepitopes for T cells.

Experimental design

TR gene repertoire profiling using next generation sequencing in groups of patients with CLL carrying one of the following copy-number aberrations (CNAs): del(11q), del(17p), del(13q), trisomy 12, or gene mutations in TP53 or NOTCH1.

Results

Oligoclonal expansions were found in all patients with distinct recurrent genomic aberrations; these were more pronounced in cases bearing CNAs, particularly trisomy 12, rather than gene mutations. Shared clonotypes were found both within and across groups, which appeared to be CLL-biased based on extensive comparisons against TR databases from various entities. Moreover, in silico analysis identified TR clonotypes with high binding affinity to neoepitopes predicted to arise from TP53 and NOTCH1 mutations.

Conclusions

Distinct TR repertoire profiles were identified in groups of patients with CLL bearing different genomic aberrations, alluding to distinct selection processes. Abnormal protein expression and gene dosage effects associated with recurrent genomic aberrations likely represent a relevant source of CLL-specific selecting antigens.

CoV2-TCR: A web server for screening TCR CDR3 from TCR immune repertoire of COVID-19 patients and their recognized SARS-CoV-2 epitopes

Although multiple vaccines have been developed and widely administered, several severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) variants have been reported to evade immune responses and spread diffusely. Here, 108 RNA-seq files from coronavirus disease 2019 (COVID-19) patients and healthy donors (HD) were downloaded to extract their TCR immune repertoire by MiXCR. Those extracted TCR repertoire were compared and it was found that disease progression was related negatively with diversity and positively with clonality. Specifically, greater proportions of high-abundance clonotypes were observed in active and severe COVID-19 samples, probably resulting from strong stimulation of SARS-CoV-2 epitopes and a continued immune response in host. To investigate the specific recognition between TCR CDR3 and SARS-CoV-2 epitopes, we constructed an accurate classifier CoV2-TCR with an AUC of 0.967 in an independent dataset, which outperformed several similar tools. Based on this model, we observed a huge range in the number of those TCR CDR3 recognizing those different peptides, including 28 MHC-I epitopes from SARS-CoV-2 and 22 immunogenic peptides from SARS-CoV-2 variants. Interestingly, their proportions of high-abundance, low-abundance and rare clonotypes were close for each peptide. To expand the potential application of this model, we established the webserver, CoV2-TCR, in which users can obtain those recognizing CDR3 sequences from the TCR repertoire of COVID-19 patients based on the 9-mer peptides containing mutation site(s) on the four main proteins of SARS-CoV-2 variants. Overall, this study provides preliminary screening for candidate antigen epitopes and the TCR CDR3 that recognizes them, and should be helpful for vaccine design on SARS-CoV-2 variants.

Counting is almost all you need

The immune memory repertoire encodes the history of present and past infections and immunological attributes of the individual. As such, multiple methods were proposed to use T-cell receptor (TCR) repertoires to detect disease history. We here show that the counting method outperforms two leading algorithms. We then show that the counting can be further improved using a novel attention model to weigh the different TCRs. The attention model is based on the projection of TCRs using a Variational AutoEncoder (VAE). Both counting and attention algorithms predict better than current leading algorithms whether the host had CMV and its HLA alleles. As an intermediate solution between the complex attention model and the very simple counting model, we propose a new Graph Convolutional Network approach that obtains the accuracy of the attention model and the simplicity of the counting model. The code for the models used in the paper is provided at: https://github.com/louzounlab/CountingIsAlmostAllYouNeed.

Artificial intelligence applied in neoantigen identification facilitates personalized cancer immunotherapy

The field of cancer neoantigen investigation has developed swiftly in the past decade. Predicting novel and true neoantigens derived from large multi-omics data became difficult but critical challenges. The rise of Artificial Intelligence (AI) or Machine Learning (ML) in biomedicine application has brought benefits to strengthen the current computational pipeline for neoantigen prediction. ML algorithms offer powerful tools to recognize the multidimensional nature of the omics data and therefore extract the key neoantigen features enabling a successful discovery of new neoantigens. The present review aims to outline the significant technology progress of machine learning approaches, especially the newly deep learning tools and pipelines, that were recently applied in neoantigen prediction. In this review article, we summarize the current state-of-the-art tools developed to predict neoantigens. The standard workflow includes calling genetic variants in paired tumor and blood samples, and rating the binding affinity between mutated peptide, MHC (I and II) and T cell receptor (TCR), followed by characterizing the immunogenicity of tumor epitopes. More specifically, we highlight the outstanding feature extraction tools and multi-layer neural network architectures in typical ML models. It is noted that more integrated neoantigen-predicting pipelines are constructed with hybrid or combined ML algorithms instead of conventional machine learning models. In addition, the trends and challenges in further optimizing and integrating the existing pipelines are discussed.

Challenges in neoantigen-directed therapeutics

A fundamental prerequisite for the efficacy of cancer immunotherapy is the presence of functional, antigen-specific T cells within the tumor. Neoantigen-directed therapy is a promising strategy that aims at targeting the host's immune response against tumor-specific antigens, thereby eradicating cancer cells. Initial forays have been made in clinical environments utilizing vaccines and adoptive cell therapy; however, many challenges lie ahead. We provide an in-depth overview of the current state of the field with an emphasis on in silico neoantigen discovery and the clinical aspects that need to be addressed to unlock the full potential of this therapy.

Hybrid gMLP model for interaction prediction of MHC-peptide and TCR

Understanding the interaction of T-cell receptor (TCR) with major histocompatibility-peptide (MHC-peptide) complex is extremely important in human immunotherapy and vaccine development. However, due to the limited available data, the performance of existing models for predicting the interaction of T-cell receptors (TCR) with major histocompatibility-peptide complexes is still unsatisfactory. Deep learning models have been applied to prediction tasks in various fields and have achieved better results compared with other traditional models. In this study, we leverage the gMLP model combined with attention mechanism to predict the interaction of MHC-peptide and TCR. Experiments show that our model can predict TCR-peptide interactions accurately and can handle the problems caused by different TCR lengths. Moreover, we demonstrate that the models trained with paired CDR3β-chain and CDR3α-chain data are better than those trained with only CDR3β-chain or with CDR3α-chain data. We also demonstrate that the hybrid model has greater potential than the traditional convolutional neural network.

Performance comparison of TCR-pMHC prediction tools reveals a strong data dependency

The interaction of T-cell receptors with peptide-major histocompatibility complex molecules (TCR-pMHC) plays a crucial role in adaptive immune responses. Currently there are various models aiming at predicting TCR-pMHC binding, while a standard dataset and procedure to compare the performance of these approaches is still missing. In this work we provide a general method for data collection, preprocessing, splitting and generation of negative examples, as well as comprehensive datasets to compare TCR-pMHC prediction models. We collected, harmonized, and merged all the major publicly available TCR-pMHC binding data and compared the performance of five state-of-the-art deep learning models (TITAN, NetTCR-2.0, ERGO, DLpTCR and ImRex) using this data. Our performance evaluation focuses on two scenarios: 1) different splitting methods for generating training and testing data to assess model generalization and 2) different data versions that vary in size and peptide imbalance to assess model robustness. Our results indicate that the five contemporary models do not generalize to peptides that have not been in the training set. We can also show that model performance is strongly dependent on the data balance and size, which indicates a relatively low model robustness. These results suggest that TCR-pMHC binding prediction remains highly challenging and requires further high quality data and novel algorithmic approaches.

Attentive Variational Information Bottleneck for TCR-peptide interaction prediction

MOTIVATION

We present a multi-sequence generalization of Variational Information Bottleneck and call the resulting model Attentive Variational Information Bottleneck (AVIB). Our AVIB model leverages multi-head self-attention to implicitly approximate a posterior distribution over latent encodings conditioned on multiple input sequences. We apply AVIB to a fundamental immuno-oncology problem: predicting the interactions between T-cell receptors (TCRs) and peptides.

RESULTS

Experimental results on various datasets show that AVIB significantly outperforms state-of-the-art methods for TCR-peptide interaction prediction. Additionally, we show that the latent posterior distribution learned by AVIB is particularly effective for the unsupervised detection of out-of-distribution amino acid sequences.

AVAILABILITY AND IMPLEMENTATION

The code and the data used for this study are publicly available at: https://github.com/nec-research/vibtcr.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

NetTCR-2.1: Lessons and guidance on how to develop models for TCR specificity predictions

T cell receptors (TCR) define the specificity of T cells and are responsible for their interaction with peptide antigen targets presented in complex with major histocompatibility complex (MHC) molecules. Understanding the rules underlying this interaction hence forms the foundation for our understanding of basic adaptive immunology. Over the last decade, efforts have been dedicated to developing assays for high throughput identification of peptide-specific TCRs. Based on such data, several computational methods have been proposed for predicting the TCR-pMHC interaction. The general conclusion from these studies is that the prediction of TCR interactions with MHC-peptide complexes remains highly challenging. Several reasons form the basis for this including scarcity and quality of data, and ill-defined modeling objectives imposed by the high redundancy of the available data. In this work, we propose a framework for dealing with this redundancy, allowing us to address essential questions related to the modeling of TCR specificity including the use of peptide- versus pan-specific models, how to best define negative data, and the performance impact of integrating of CDR1 and 2 loops. Further, we illustrate how and why it is strongly recommended to include simple similarity-based modeling approaches when validating an improved predictive power of machine learning models, and that such validation should include a performance evaluation as a function of "distance" to the training data, to quantify the potential for generalization of the proposed model. The conclusion of the work is that, given current data, TCR specificity is best modeled using peptide-specific approaches, integrating information from all 6 CDR loops, and with negative data constructed from a combination of true and mislabeled negatives. Comparing such machine learning models to similarity-based approaches demonstrated an increased performance gain of the former as the "distance" to the training data was increased; thus demonstrating an improved generalization ability of the machine learning-based approaches. We believe these results demonstrate that the outlined modeling framework and proposed evaluation strategy form a solid basis for investigating the modeling of TCR specificities and that adhering to such a framework will allow for faster progress within the field. The final devolved model, NetTCR-2.1, is available at https://services.healthtech.dtu.dk/service.php?NetTCR-2.1.

Unconstrained generation of synthetic antibody-antigen structures to guide machine learning methodology for antibody specificity prediction

Machine learning (ML) is a key technology for accurate prediction of antibody-antigen binding. Two orthogonal problems hinder the application of ML to antibody-specificity prediction and the benchmarking thereof: the lack of a unified ML formalization of immunological antibody-specificity prediction problems and the unavailability of large-scale synthetic datasets to benchmark real-world relevant ML methods and dataset design. Here we developed the Absolut! software suite that enables parameter-based unconstrained generation of synthetic lattice-based three-dimensional antibody-antigen-binding structures with ground-truth access to conformational paratope, epitope and affinity. We formalized common immunological antibody-specificity prediction problems as ML tasks and confirmed that for both sequence- and structure-based tasks, accuracy-based rankings of ML methods trained on experimental data hold for ML methods trained on Absolut!-generated data. The Absolut! framework has the potential to enable real-world relevant development and benchmarking of ML strategies for biotherapeutics design.

Attention-aware contrastive learning for predicting T cell receptor-antigen binding specificity

MOTIVATION

It has been proven that only a small fraction of the neoantigens presented by major histocompatibility complex (MHC) class I molecules on the cell surface can elicit T cells. This restriction can be attributed to the binding specificity of T cell receptor (TCR) and peptide-MHC complex (pMHC). Computational prediction of T cells binding to neoantigens is a challenging and unresolved task.

RESULTS

In this paper, we proposed an attention-aware contrastive learning model, ATMTCR, to infer the TCR-pMHC binding specificity. For each TCR sequence, we used a transformer encoder to transform it to latent representation, and then masked a percentage of amino acids guided by attention weights to generate its contrastive view. Compared to fully-supervised baseline model, we verified that contrastive learning-based pretraining on large-scale TCR sequences significantly improved the prediction performance of downstream tasks. Interestingly, masking a percentage of amino acids with low attention weights yielded best performance compared to other masking strategies. Comparison experiments on two independent datasets demonstrated our method achieved better performance than other existing algorithms. Moreover, we identified important amino acids and their positional preference through attention weights, which indicated the potential interpretability of our proposed model.

On TCR binding predictors failing to generalize to unseen peptides

Several recent studies investigate TCR-peptide/-pMHC binding prediction using machine learning or deep learning approaches. Many of these methods achieve impressive results on test sets, which include peptide sequences that are also included in the training set. In this work, we investigate how state-of-the-art deep learning models for TCR-peptide/-pMHC binding prediction generalize to unseen peptides. We create a dataset including positive samples from IEDB, VDJdb, McPAS-TCR, and the MIRA set, as well as negative samples from both randomization and 10X Genomics assays. We name this collection of samples TChard. We propose the hard split, a simple heuristic for training/test split, which ensures that test samples exclusively present peptides that do not belong to the training set. We investigate the effect of different training/test splitting techniques on the models’ test performance, as well as the effect of training and testing the models using mismatched negative samples generated randomly, in addition to the negative samples derived from assays. Our results show that modern deep learning methods fail to generalize to unseen peptides. We provide an explanation why this happens and verify our hypothesis on the TChard dataset. We then conclude that robust prediction of TCR recognition is still far for being solved.