Predicting Heart Rejection Using Histopathological Whole-Slide Imaging and Deep Neural Network with Dropout

The transformative potential of artificial intelligence in solid organ transplantation

Solid organ transplantation confronts numerous challenges ranging from donor organ shortage to post-transplant complications. Here, we provide an overview of the latest attempts to address some of these challenges using artificial intelligence (AI). We delve into the application of machine learning in pretransplant evaluation, predicting transplant rejection, and post-operative patient outcomes. By providing a comprehensive overview of AI's current impact, this review aims to inform clinicians, researchers, and policy-makers about the transformative power of AI in enhancing solid organ transplantation and facilitating personalized medicine in transplant care.

The current and future role of artificial intelligence in optimizing donor organ utilization and recipient outcomes in heart transplantation

Heart failure (HF) is a leading cause of morbidity and mortality in the United States. While medical management and mechanical circulatory support have undergone significant advancement in recent years, orthotopic heart transplantation (OHT) remains the most definitive therapy for refractory HF. OHT has seen steady improvement in patient survival and quality of life (QoL) since its inception, with one-year mortality now under 8%. However, a significant number of HF patients are unable to receive OHT due to scarcity of donor hearts. The United Network for Organ Sharing has recently revised its organ allocation criteria in an effort to provide more equitable access to OHT. Despite these changes, there are many potential donor hearts that are inevitably rejected. Arbitrary regulations from the centers for Medicare and Medicaid services and fear of repercussions if one-year mortality falls below established values has led to a current state of excessive risk aversion for which organs are accepted for OHT. Furthermore, non-standardized utilization of extended criteria donors and donation after circulatory death, exacerbate the organ shortage. Data-driven systems can improve donor-recipient matching, better predict patient QoL post-OHT, and decrease needless organ waste through more uniform application of acceptance criteria. Thus, we propose a data-driven future for OHT and a move to patient-centric and holistic transplantation care processes.

Machine learning and artificial intelligence in cardiac transplantation: A systematic review

Background

This review aims to systematically evaluate the currently available evidence investigating the use of artificial intelligence (AI) and machine learning (ML) in the field of cardiac transplantation. Furthermore, based on the challenges identified we aim to provide a series of recommendations and a knowledge base for future research in the field of ML and heart transplantation.

Methods

A systematic database search was conducted of original articles that explored the use of ML and/or AI in heart transplantation in EMBASE, MEDLINE, Cochrane database, and Google Scholar, from inception to November 2021.

Results

Our search yielded 237 articles, of which 13 studies were included in this review, featuring 463 850 patients. Three main areas of application were identified: (1) ML for predictive modeling of heart transplantation mortality outcomes; (2) ML in graft failure outcomes; (3) ML to aid imaging in heart transplantation. The results of the included studies suggest that AI and ML are more accurate in predicting graft failure and mortality than traditional scoring systems and conventional regression analysis. Major predictors of graft failure and mortality identified in ML models were: length of hospital stay, immunosuppressive regimen, recipient's age, congenital heart disease, and organ ischemia time. Other potential benefits include analyzing initial lab investigations and imaging, assisting a patient with medication adherence, and creating positive behavioral changes to minimize further cardiovascular risk.

Conclusion

ML demonstrated promising applications for improving heart transplantation outcomes and patient‐centered care, nevertheless, there remain important limitations relating to implementing AI into everyday surgical practices.

Deep learning-enabled assessment of cardiac allograft rejection from endomyocardial biopsies

Endomyocardial biopsy (EMB) screening represents the standard of care for detecting allograft rejections after heart transplant. Manual interpretation of EMBs is affected by substantial interobserver and intraobserver variability, which often leads to inappropriate treatment with immunosuppressive drugs, unnecessary follow-up biopsies and poor transplant outcomes. Here we present a deep learning-based artificial intelligence (AI) system for automated assessment of gigapixel whole-slide images obtained from EMBs, which simultaneously addresses detection, subtyping and grading of allograft rejection. To assess model performance, we curated a large dataset from the United States, as well as independent test cohorts from Turkey and Switzerland, which includes large-scale variability across populations, sample preparations and slide scanning instrumentation. The model detects allograft rejection with an area under the receiver operating characteristic curve (AUC) of 0.962; assesses the cellular and antibody-mediated rejection type with AUCs of 0.958 and 0.874, respectively; detects Quilty B lesions, benign mimics of rejection, with an AUC of 0.939; and differentiates between low-grade and high-grade rejections with an AUC of 0.833. In a human reader study, the AI system showed non-inferior performance to conventional assessment and reduced interobserver variability and assessment time. This robust evaluation of cardiac allograft rejection paves the way for clinical trials to establish the efficacy of AI-assisted EMB assessment and its potential for improving heart transplant outcomes.

Improving Classification of Breast Cancer by Utilizing the Image Pyramids of Whole-Slide Imaging and Multi-Scale Convolutional Neural Networks

Whole-slide imaging (WSI) is the digitization of conventional glass slides. Automatic computer-aided diagnosis (CAD) based on WSI enables digital pathology and the integration of pathology with other data like genomic biomarkers. Numerous computational algorithms have been developed for WSI, with most of them taking the image patches cropped from the highest resolution as the input. However, these models exploit only the local information within each patch and lost the connections between the neighboring patches, which may contain important context information. In this paper, we propose a novel multi-scale convolutional network (ConvNet) to utilize the built-in image pyramids of WSI. For the concentric image patches cropped at the same location of different resolution levels, we hypothesize the extra input images from lower magnifications will provide context information to enhance the prediction of patch images. We build corresponding ConvNets for feature representation and then combine the extracted features by 1) late fusion: concatenation or averaging the feature vectors before performing classification, 2) early fusion: merge the ConvNet feature maps. We have applied the multi-scale networks to a benchmark breast cancer WSI dataset. Extensive experiments have demonstrated that our multiscale networks utilizing the WSI image pyramids can achieve higher accuracy for the classification of breast cancer. The late fusion method by taking the average of feature vectors reaches the highest accuracy (81.50%), which is promising for the application of multi-scale analysis of WSI.

Prediction of Heart Transplant Rejection Using Histopathological Whole-Slide Imaging

Endomyocardial biopsies are the current gold standard for monitoring heart transplant patients for signs of cardiac allograft rejection. Manually analyzing the acquired tissue samples can be costly, time-consuming, and subjective. Computer-aided diagnosis, using digitized whole-slide images, has been used to classify the presence and grading of diseases such as brain tumors and breast cancer, and we expect it can be used for prediction of cardiac allograft rejection. In this paper, we first create a pipeline to normalize and extract pixel-level and object-level features from histopathological whole-slide images of endomyocardial biopsies. Then, we develop a two-stage classification algorithm, where we first cluster individual tiles and then use the frequency of tiles in each cluster for classification of each whole-slide image. Our results show that the addition of an unsupervised clustering step leads to higher classification accuracy, as well as the importance of object-level features based on the pathophysiology of rejection. Future expansion of this study includes the development of a multiclass classification pipeline for subtypes and grades of cardiac allograft rejection.