An automated computational image analysis pipeline for histological grading of cardiac allograft rejection

Computational pathology: A survey review and the way forward

Computational Pathology (CPath) is an interdisciplinary science that augments developments of computational approaches to analyze and model medical histopathology images. The main objective for CPath is to develop infrastructure and workflows of digital diagnostics as an assistive CAD system for clinical pathology, facilitating transformational changes in the diagnosis and treatment of cancer that are mainly address by CPath tools. With evergrowing developments in deep learning and computer vision algorithms, and the ease of the data flow from digital pathology, currently CPath is witnessing a paradigm shift. Despite the sheer volume of engineering and scientific works being introduced for cancer image analysis, there is still a considerable gap of adopting and integrating these algorithms in clinical practice. This raises a significant question regarding the direction and trends that are undertaken in CPath. In this article we provide a comprehensive review of more than 800 papers to address the challenges faced in problem design all-the-way to the application and implementation viewpoints. We have catalogued each paper into a model-card by examining the key works and challenges faced to layout the current landscape in CPath. We hope this helps the community to locate relevant works and facilitate understanding of the field's future directions. In a nutshell, we oversee the CPath developments in cycle of stages which are required to be cohesively linked together to address the challenges associated with such multidisciplinary science. We overview this cycle from different perspectives of data-centric, model-centric, and application-centric problems. We finally sketch remaining challenges and provide directions for future technical developments and clinical integration of CPath. For updated information on this survey review paper and accessing to the original model cards repository, please refer to GitHub. Updated version of this draft can also be found from arXiv.

Intrinsically explainable deep learning architecture for semantic segmentation of histological structures in heart tissue

BACKGROUND

Analysis of structures contained in tissue samples and the relevant contextual information is of utmost importance to histopathologists during diagnosis. Cardiac biopsies require in-depth analysis of the relationships between biological structures. Statistical measures are insufficient for determining a model's viability and applicability in the diagnostic process. A deeper understanding of predictions is necessary in order to support histopathologists.

METHODS

We propose a method for providing supporting information in the form of segmentation of histological structures to histopathologists based on these principles. The proposed method utilizes nuclei type and density information in addition to standard image input provided at two different zoom levels for the semantic segmentation of blood vessels, inflammation, and endocardium in heart tissue.

RESULTS

The proposed method was able to reach state-of-the-art segmentation results. The overall quality and viability of the predictions was qualitatively evaluated by two pathologists and a histotechnologist.

CONCLUSIONS

The decision process of the proposed deep learning model utilizes the provided information sources correctly and simulates the decision process of histopathologists via the usage of a custom-designed attention gate that provides a combination of spatial and encoder attention mechanisms. The implementation is available at https://github.com/mathali/IEDL-segmentation-of-heart-tissue.

Revolutionizing Cardiology through Artificial Intelligence-Big Data from Proactive Prevention to Precise Diagnostics and Cutting-Edge Treatment-A Comprehensive Review of the Past 5 Years

BACKGROUND

Artificial intelligence (AI) can radically change almost every aspect of the human experience. In the medical field, there are numerous applications of AI and subsequently, in a relatively short time, significant progress has been made. Cardiology is not immune to this trend, this fact being supported by the exponential increase in the number of publications in which the algorithms play an important role in data analysis, pattern discovery, identification of anomalies, and therapeutic decision making. Furthermore, with technological development, there have appeared new models of machine learning (ML) and deep learning (DP) that are capable of exploring various applications of AI in cardiology, including areas such as prevention, cardiovascular imaging, electrophysiology, interventional cardiology, and many others. In this sense, the present article aims to provide a general vision of the current state of AI use in cardiology.

RESULTS

We identified and included a subset of 200 papers directly relevant to the current research covering a wide range of applications. Thus, this paper presents AI applications in cardiovascular imaging, arithmology, clinical or emergency cardiology, cardiovascular prevention, and interventional procedures in a summarized manner. Recent studies from the highly scientific literature demonstrate the feasibility and advantages of using AI in different branches of cardiology.

CONCLUSIONS

The integration of AI in cardiology offers promising perspectives for increasing accuracy by decreasing the error rate and increasing efficiency in cardiovascular practice. From predicting the risk of sudden death or the ability to respond to cardiac resynchronization therapy to the diagnosis of pulmonary embolism or the early detection of valvular diseases, AI algorithms have shown their potential to mitigate human error and provide feasible solutions. At the same time, limits imposed by the small samples studied are highlighted alongside the challenges presented by ethical implementation; these relate to legal implications regarding responsibility and decision making processes, ensuring patient confidentiality and data security. All these constitute future research directions that will allow the integration of AI in the progress of cardiology.

Computational Pathology Assessments of Cardiac Stromal Remodeling: Clinical Correlates and Prognostic Implications in Heart Transplantation

Both overt and indolent inflammatory insults in heart transplantation can accelerate pathologic cardiac remodeling, but there are few tools for monitoring the speed and severity of remodeling over time. To address this need, we developed an automated computational pathology system to measure pathologic remodeling in transplant biopsy samples in a large, retrospective cohort of n=2167 digitized heart transplant biopsy slides. Biopsy images were analyzed to identify the pathologic stromal changes associated with future allograft loss or advanced allograft vasculopathy. Biopsy images were then analyzed to assess which historical allo-inflammatory events drive progression of these pathologic stromal changes over time in serial biopsy samples. The top-5 features of pathologic stromal remodeling most strongly associated with adverse outcomes were also strongly associated with histories of both overt and indolent inflammatory events. Our findings identify previously unappreciated subgroups of higher- and lower-risk transplant patients, and highlight the translational potential of digital pathology analysis.

Beyond the Granuloma: New Insights into Cardiac Sarcoidosis Using Spatial Proteomics

Cardiac sarcoidosis is poorly understood, challenging to diagnose, and portends a poor prognosis. A lack of animal models necessitates the use of residual human samples to study sarcoidosis, which in turn necessitates the use of analytical tools compatible with archival, fixed tissue. We employed high-plex spatial protein analysis within a large cohort of archival human cardiac sarcoidosis and control tissue samples, studying the immunologic, fibrotic, and metabolic landscape of sarcoidosis at different stages of disease, in different cardiac tissue compartments, and in tissue regions with and without overt inflammation. Utilizing a small set of differentially expressed protein biomarkers, we also report the development of a predictive model capable of accurately discriminating between control cardiac tissue and sarcoidosis tissue, even when no histologic evidence of sarcoidosis is present. This finding has major translational implications, with the potential to markedly improve the diagnostic yield of clinical biopsies obtained from suspected sarcoidosis patients.

Adopting artificial intelligence in cardiovascular medicine: a scoping review

Recent years have witnessed significant transformations in cardiovascular medicine, driven by the rapid evolution of artificial intelligence (AI). This scoping review was conducted to capture the breadth of AI applications within cardiovascular science. Employing a structured approach, we sourced relevant articles from PubMed, with an emphasis on journals encompassing general cardiology and digital medicine. We applied filters to highlight cardiovascular articles published in journals focusing on general internal medicine, cardiology and digital medicine, thereby identifying the prevailing trends in the field. Following a comprehensive full-text screening, a total of 140 studies were identified. Over the preceding 5 years, cardiovascular medicine's interplay with AI has seen an over tenfold augmentation. This expansive growth encompasses multiple cardiovascular subspecialties, including but not limited to, general cardiology, ischemic heart disease, heart failure, and arrhythmia. Deep learning emerged as the predominant methodology. The majority of AI endeavors in this domain have been channeled toward enhancing diagnostic and prognostic capabilities, utilizing resources such as hospital datasets, electrocardiograms, and echocardiography. A significant uptrend was observed in AI's application for omics data analysis. However, a clear gap persists in AI's full-scale integration into the clinical decision-making framework. AI, particularly deep learning, has demonstrated robust applications across cardiovascular subspecialties, indicating its transformative potential in this field. As we continue on this trajectory, ensuring the alignment of technological progress with medical ethics becomes crucial. The abundant digital health data today further accentuates the need for meticulous systematic reviews, tailoring them to each cardiovascular subspecialty.

Failing to Make the Grade: Conventional Cardiac Allograft Rejection Grading Criteria Are Inadequate for Predicting Rejection Severity

BACKGROUND

Cardiac allograft rejection is the leading cause of early graft failure and is a major focus of postheart transplant patient care. While histological grading of endomyocardial biopsy samples remains the diagnostic standard for acute rejection, this standard has limited diagnostic accuracy. Discordance between biopsy rejection grade and patient clinical trajectory frequently leads to both overtreatment of indolent processes and delayed treatment of aggressive ones, spurring the need to investigate the adequacy of the current histological criteria for assessing clinically important rejection outcomes.

METHODS

N=2900 endomyocardial biopsy images were assigned a rejection grade label (high versus low grade) and a clinical trajectory label (evident versus silent rejection). Using an image analysis approach, n=370 quantitative morphology features describing the lymphocytes and stroma were extracted from each slide. Two models were constructed to compare the subset of features associated with rejection grades versus those associated with clinical trajectories. A proof-of-principle machine learning pipeline-the cardiac allograft rejection evaluator-was then developed to test the feasibility of identifying the clinical severity of a rejection event.

RESULTS

The histopathologic findings associated with conventional rejection grades differ substantially from those associated with clinically evident allograft injury. Quantitative assessment of a small set of well-defined morphological features can be leveraged to more accurately reflect the severity of rejection compared with that achieved by the International Society of Heart and Lung Transplantation grades.

CONCLUSIONS

Conventional endomyocardial samples contain morphological information that enables accurate identification of clinically evident rejection events, and this information is incompletely captured by the current, guideline-endorsed, rejection grading criteria.

Digital pathology in cardiac transplant diagnostics: from biopsies to algorithms

In the field of heart transplantation, the ability to accurately and promptly diagnose cardiac allograft rejection is crucial. This comprehensive review explores the transformative role of digital pathology and computational pathology, especially through machine learning, in this critical domain. These methodologies harness large datasets to extract subtle patterns and valuable information that extend beyond human perceptual capabilities, potentially enhancing diagnostic outcomes. Current research indicates that these computer-based systems could offer accuracy and performance matching, or even exceeding, that of expert pathologists, thereby introducing more objectivity and reducing observer variability. Despite promising results, several challenges such as limited sample sizes, diverse data sources, and the absence of standardized protocols pose significant barriers to the widespread adoption of these techniques. The future of digital pathology in heart transplantation diagnostics depends on utilizing larger, more diverse patient cohorts, standardizing data collection, processing, and evaluation protocols, and fostering collaborative research efforts. The integration of various data types, including clinical, demographic, and imaging information, could further refine diagnostic precision. As researchers address these challenges and promote collaborative efforts, digital pathology has the potential to become an integral part of clinical practice, ultimately improving patient care in heart transplantation.

The utilization of molecular microscope in management of heart transplant recipients in the era of noninvasive monitoring

INTRODUCTION

Monitoring for graft rejection is a fundamental tenet of post-transplant follow-up. In heart transplantation (HT) in particular, rejection has been traditionally assessed with endomyocardial biopsy (EMB). EMB has potential complications and noted limitations, including interobserver variability in interpretation. Additional tests, such as basic cardiac biomarkers, cardiac imaging, gene expression profiling (GEP) scores, donor-derived cell-free DNA (dd-cfDNA) and the novel molecular microscope diagnostic system (MMDx) have become critical tools in rejection surveillance beyond standard EMB.

METHODS

This paper describes an illustrative case followed by a review of MMDx within the context of other noninvasive screening modalities for rejection.

CONCLUSIONS

We suggest MMDx be used to assist with early detection of rejection in cases of discordance between EMB and other noninvasive studies.

Artificial Intelligence Advances in Transplant Pathology

Transplant pathology plays a critical role in ensuring that transplanted organs function properly and the immune systems of the recipients do not reject them. To improve outcomes for transplant recipients, accurate diagnosis and timely treatment are essential. Recent advances in artificial intelligence (AI)-empowered digital pathology could help monitor allograft rejection and weaning of immunosuppressive drugs. To explore the role of AI in transplant pathology, we conducted a systematic search of electronic databases from January 2010 to April 2023. The PRISMA checklist was used as a guide for screening article titles, abstracts, and full texts, and we selected articles that met our inclusion criteria. Through this search, we identified 68 articles from multiple databases. After careful screening, only 14 articles were included based on title and abstract. Our review focuses on the AI approaches applied to four transplant organs: heart, lungs, liver, and kidneys. Specifically, we found that several deep learning-based AI models have been developed to analyze digital pathology slides of biopsy specimens from transplant organs. The use of AI models could improve clinicians' decision-making capabilities and reduce diagnostic variability. In conclusion, our review highlights the advancements and limitations of AI in transplant pathology. We believe that these AI technologies have the potential to significantly improve transplant outcomes and pave the way for future advancements in this field.

The evolving use of biomarkers in heart transplantation: Consensus of an expert panel

In heart transplantation, the use of biomarkers to detect the risk of rejection has been evolving. In this setting, it is becoming less clear as to what is the most reliable test or combination of tests to detect rejection and assess the state of the alloimmune response. Therefore, a virtual expert panel was organized in heart and kidney transplantation to evaluate emerging diagnostics and how they may be best utilized to monitor and manage transplant patients. This manuscript covers the heart content of the conference and is a work product of the American Society of Transplantation's Thoracic and Critical Care Community of Practice. This paper reviews currently available and emerging diagnostic assays and defines the unmet needs for biomarkers in heart transplantation. Highlights of the in-depth discussions among conference participants that led to development of consensus statements are included. This conference should serve as a platform to further build consensus within the heart transplant community regarding the optimal framework to implement biomarkers into management protocols and to improve biomarker development, validation and clinical utility. Ultimately, these biomarkers and novel diagnostics should improve outcomes and optimize quality of life for our transplant patients.

Artificial intelligence, big data and heart transplantation: Actualities

BACKGROUND

As diagnostic and prognostic models developed by traditional statistics perform poorly in real-world, artificial intelligence (AI) and Big Data (BD) may improve the supply chain of heart transplantation (HTx), allocation opportunities, correct treatments, and finally optimize HTx outcome. We explored available studies, and discussed opportunities and limits of medical application of AI to the field of HTx.

METHOD

A systematic overview of studies published up to December 31st, 2022, in English on peer-revied journals, have been identified through PUBMED-MEDLINE-WEB of Science, referring to HTx, AI, BD. Studies were grouped in 4 domains based on main studies' objectives and results: etiology, diagnosis, prognosis, treatment. A systematic attempt was made to evaluate studies by the Prediction model Risk Of Bias ASsessment Tool (PROBAST) and the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD).

RESULTS

Among the 27 publications selected, none used AI applied to BD. Of the selected studies, 4 fell in the domain of etiology, 6 in the domain of diagnosis, 3 in the domain of treatment, and 17 in that of prognosis, as AI was most frequently used for algorithmic prediction and discrimination of survival, but in retrospective cohorts and registries. AI-based algorithms appeared superior to probabilistic functions to predict patterns, but external validation was rarely employed. Indeed, based on PROBAST, selected studies showed, to some extent, significant risk of bias (especially in the domain of predictors and analysis). In addition, as example of applicability in the real-world, a free-use prediction algorithm developed through AI failed to predict 1-year mortality post-HTx in cases from our center.

CONCLUSIONS

While AI-based prognostic and diagnostic functions performed better than those developed by traditional statistics, risk of bias, lack of external validation, and relatively poor applicability, may affect AI-based tools. More unbiased research with high quality BD meant for AI, transparency and external validations, are needed to have medical AI as a systematic aid to clinical decision making in HTx.

Prediction of heart transplant rejection from routine pathology slides with self-supervised deep learning

Aims

One of the most important complications of heart transplantation is organ rejection, which is diagnosed on endomyocardial biopsies by pathologists. Computer-based systems could assist in the diagnostic process and potentially improve reproducibility. Here, we evaluated the feasibility of using deep learning in predicting the degree of cellular rejection from pathology slides as defined by the International Society for Heart and Lung Transplantation (ISHLT) grading system.

Methods and results

We collected 1079 histopathology slides from 325 patients from three transplant centres in Germany. We trained an attention-based deep neural network to predict rejection in the primary cohort and evaluated its performance using cross-validation and by deploying it to three cohorts. For binary prediction (rejection yes/no), the mean area under the receiver operating curve (AUROC) was 0.849 in the cross-validated experiment and 0.734, 0.729, and 0.716 in external validation cohorts. For a prediction of the ISHLT grade (0R, 1R, 2/3R), AUROCs were 0.835, 0.633, and 0.905 in the cross-validated experiment and 0.764, 0.597, and 0.913; 0.631, 0.633, and 0.682; and 0.722, 0.601, and 0.805 in the validation cohorts, respectively. The predictions of the artificial intelligence model were interpretable by human experts and highlighted plausible morphological patterns.

Conclusion

We conclude that artificial intelligence can detect patterns of cellular transplant rejection in routine pathology, even when trained on small cohorts.

The End of Endomyocardial Biopsy?: A Practical Guide for Noninvasive Heart Transplant Rejection Surveillance

Noninvasive heart transplant rejection surveillance using gene expression profiling (GEP) to monitor immune activation is widely used among heart transplant programs. With the new development of donor-derived cell-free DNA (dd-cfDNA) assays, more programs are transitioning to a predominantly noninvasive rejection surveillance protocol with a reduced frequency of endomyocardial biopsies. As a result, many practical questions arise that potentially delay implementation of these valuable new tools. The purpose of this review is to provide practical guidance for clinicians transitioning toward a less invasive acute rejection monitoring protocol after heart transplantation, and to answer 10 common questions about the GEP and dd-cfDNA assays. Evidence supporting GEP and dd-cfDNA testing is reviewed, as well as guidance on test interpretation and future directions.

Non-invasive detection of cardiac allograft rejection among heart transplant recipients using an electrocardiogram based deep learning model

Aims

Current non-invasive screening methods for cardiac allograft rejection have shown limited discrimination and are yet to be broadly integrated into heart transplant care. Given electrocardiogram (ECG) changes have been reported with severe cardiac allograft rejection, this study aimed to develop a deep-learning model, a form of artificial intelligence, to detect allograft rejection using the 12-lead ECG (AI-ECG).

Methods and results

Heart transplant recipients were identified across three Mayo Clinic sites between 1998 and 2021. Twelve-lead digital ECG data and endomyocardial biopsy results were extracted from medical records. Allograft rejection was defined as moderate or severe acute cellular rejection (ACR) based on International Society for Heart and Lung Transplantation guidelines. The extracted data (7590 unique ECG-biopsy pairs, belonging to 1427 patients) was partitioned into training (80%), validation (10%), and test sets (10%) such that each patient was included in only one partition. Model performance metrics were based on the test set (n = 140 patients; 758 ECG-biopsy pairs). The AI-ECG detected ACR with an area under the receiver operating curve (AUC) of 0.84 [95% confidence interval (CI): 0.78-0.90] and 95% (19/20; 95% CI: 75-100%) sensitivity. A prospective proof-of-concept screening study (n = 56; 97 ECG-biopsy pairs) showed the AI-ECG detected ACR with AUC = 0.78 (95% CI: 0.61-0.96) and 100% (2/2; 95% CI: 16-100%) sensitivity.

Conclusion

An AI-ECG model is effective for detection of moderate-to-severe ACR in heart transplant recipients. Our findings could improve transplant care by providing a rapid, non-invasive, and potentially remote screening option for cardiac allograft function.

Artificial intelligence guidance of advanced heart failure therapies: A systematic scoping review

Introduction

Artificial intelligence can recognize complex patterns in large datasets. It is a promising technology to advance heart failure practice, as many decisions rely on expert opinions in the absence of high-quality data-driven evidence.

Methods

We searched Embase, Web of Science, and PubMed databases for articles containing "artificial intelligence," "machine learning," or "deep learning" and any of the phrases "heart transplantation," "ventricular assist device," or "cardiogenic shock" from inception until August 2022. We only included original research addressing post heart transplantation (HTx) or mechanical circulatory support (MCS) clinical care. Review and data extraction were performed in accordance with PRISMA-Scr guidelines.

Results

Of 584 unique publications detected, 31 met the inclusion criteria. The majority focused on outcome prediction post HTx (n = 13) and post durable MCS (n = 7), as well as post HTx and MCS management (n = 7, n = 3, respectively). One study addressed temporary mechanical circulatory support. Most studies advocated for rapid integration of AI into clinical practice, acknowledging potential improvements in management guidance and reliability of outcomes prediction. There was a notable paucity of external data validation and integration of multiple data modalities.

Conclusion

Our review showed mounting innovation in AI application in management of MCS and HTx, with the largest evidence showing improved mortality outcome prediction.

The state of the art for artificial intelligence in lung digital pathology

Lung diseases carry a significant burden of morbidity and mortality worldwide. The advent of digital pathology (DP) and an increase in computational power have led to the development of artificial intelligence (AI)-based tools that can assist pathologists and pulmonologists in improving clinical workflow and patient management. While previous works have explored the advances in computational approaches for breast, prostate, and head and neck cancers, there has been a growing interest in applying these technologies to lung diseases as well. The application of AI tools on radiology images for better characterization of indeterminate lung nodules, fibrotic lung disease, and lung cancer risk stratification has been well documented. In this article, we discuss methodologies used to build AI tools in lung DP, describing the various hand-crafted and deep learning-based unsupervised feature approaches. Next, we review AI tools across a wide spectrum of lung diseases including cancer, tuberculosis, idiopathic pulmonary fibrosis, and COVID-19. We discuss the utility of novel imaging biomarkers for different types of clinical problems including quantification of biomarkers like PD-L1, lung disease diagnosis, risk stratification, and prediction of response to treatments such as immune checkpoint inhibitors. We also look briefly at some emerging applications of AI tools in lung DP such as multimodal data analysis, 3D pathology, and transplant rejection. Lastly, we discuss the future of DP-based AI tools, describing the challenges with regulatory approval, developing reimbursement models, planning clinical deployment, and addressing AI biases. © 2022 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

Spatial interplay patterns of cancer nuclei and tumor-infiltrating lymphocytes (TILs) predict clinical benefit for immune checkpoint inhibitors

Immune checkpoint inhibitors (ICIs) show prominent clinical activity across multiple advanced tumors. However, less than half of patients respond even after molecule-based selection. Thus, improved biomarkers are required. In this study, we use an image analysis to capture morphologic attributes relating to the spatial interaction and architecture of tumor cells and tumor-infiltrating lymphocytes (TILs) from digitized H&E images. We evaluate the association of image features with progression-free (PFS) and overall survival in non-small cell lung cancer (NSCLC) (N = 187) and gynecological cancer (N = 39) patients treated with ICIs. We demonstrated that the classifier trained with NSCLC alone was associated with PFS in independent NSCLC cohorts and also in gynecological cancer. The classifier was also associated with clinical outcome independent of clinical factors. Moreover, the classifier was associated with PFS even with low PD-L1 expression. These findings suggest that image analysis can be used to predict clinical end points in patients receiving ICI.

Machine Learning to Predict Risk of Relapse Using Cytologic Image Markers in Patients With Acute Myeloid Leukemia Posthematopoietic Cell Transplantation

PURPOSE

Allogenic hematopoietic stem-cell transplant (HCT) is a curative therapy for acute myeloid leukemia (AML) and myelodysplastic syndrome (MDS). Relapse post-HCT is the most common cause of treatment failure and is associated with a poor prognosis. Pathologist-based visual assessment of aspirate images and the manual myeloblast counting have shown to be predictive of relapse post-HCT. However, this approach is time-intensive and subjective. The premise of this study was to explore whether computer-extracted morphology and texture features from myeloblasts' chromatin patterns could help predict relapse and prognosticate relapse-free survival (RFS) after HCT.

MATERIALS AND METHODS

In this study, Wright-Giemsa-stained post-HCT aspirate images were collected from 92 patients with AML/MDS who were randomly assigned into a training set (St = 52) and a validation set (Sv = 40). First, a deep learning-based model was developed to segment myeloblasts. A total of 214 texture and shape descriptors were then extracted from the segmented myeloblasts on aspirate slide images. A risk score on the basis of texture features of myeloblast chromatin patterns was generated by using the least absolute shrinkage and selection operator with a Cox regression model.

RESULTS

The risk score was associated with RFS in St (hazard ratio = 2.38; 95% CI, 1.4 to 3.95; P = .0008) and Sv (hazard ratio = 1.57; 95% CI, 1.01 to 2.45; P = .044). We also demonstrate that this resulting signature was predictive of AML relapse with an area under the receiver operating characteristic curve of 0.71 within Sv. All the relevant code is available at GitHub.

CONCLUSION

The texture features extracted from chromatin patterns of myeloblasts can predict post-HCT relapse and prognosticate RFS of patients with AML/MDS.

Computational Analysis of Routine Biopsies Improves Diagnosis and Prediction of Cardiac Allograft Vasculopathy

Background: Cardiac allograft vasculopathy (CAV) is a leading cause of morbidity and mortality for heart transplant recipients. While clinical risk factors for CAV have been established, no personalized prognostic test exists to confidently identify patients at high vs. low risk of developing aggressive CAV. The aim of this investigation was to leverage computational methods for analyzing digital pathology images from routine endomyocardial biopsies (EMB) to develop a precision medicine tool for predicting CAV years before overt clinical presentation. Methods: Clinical data from 1-year post-transplant was collected on 302 transplant recipients from the University of Pennsylvania, including 53 'early CAV' patients and 249 'no-CAV' controls. This data was used to generate a 'clinical model' (ClinCAV-Pr) for predicting future CAV development. From this cohort, n=183 archived EMBs were collected for CD31 and modified trichrome staining and then digitally scanned. These included 1-year post-transplant EMBs from 50 'early CAV' patients and 82 no-CAV patients, as well as 51 EMBs from 'disease control' patients obtained at the time of definitive coronary angiography confirming CAV. Using biologically-inspired, hand-crafted features extracted from digitized EMBs, quantitative histologic models for differentiating no-CAV from disease controls (HistoCAV-Dx), and for predicting future CAV from 1-year post-transplant EMBs were developed (HistoCAV-Pr). The performance of histologic and clinical models for predicting future CAV (i.e. HistoCAV-Pr and ClinCAV-Pr, respectively) were compared in a held-out validation set, before being combined to assess the added predictive value of an integrated predictive model (iCAV-Pr). Results: ClinCAV-Pr achieved modest performance on the independent test set, with area under the receiver operating curve (AUROC) of 0.70. The HistoCAV-Dx model for diagnosing CAV achieved excellent discrimination, with an AUROC of 0.91, while HistoCAV-Pr model for predicting CAV achieved good performance with an AUROC of 0.80. The integrated iCAV-Pr model achieved excellent predictive performance, with an AUROC of 0.93 on the held-out test set. Conclusions: Prediction of future CAV development is greatly improved by incorporation of computationally extracted histologic features. These results suggest morphologic details contained within regularly obtained biopsy tissue have the potential to enhance precision and personalization of treatment plans for post-heart transplant patients.

Deep learning-enabled assessment of cardiac allograft rejection from endomyocardial biopsies

Endomyocardial biopsy (EMB) screening represents the standard of care for detecting allograft rejections after heart transplant. Manual interpretation of EMBs is affected by substantial interobserver and intraobserver variability, which often leads to inappropriate treatment with immunosuppressive drugs, unnecessary follow-up biopsies and poor transplant outcomes. Here we present a deep learning-based artificial intelligence (AI) system for automated assessment of gigapixel whole-slide images obtained from EMBs, which simultaneously addresses detection, subtyping and grading of allograft rejection. To assess model performance, we curated a large dataset from the United States, as well as independent test cohorts from Turkey and Switzerland, which includes large-scale variability across populations, sample preparations and slide scanning instrumentation. The model detects allograft rejection with an area under the receiver operating characteristic curve (AUC) of 0.962; assesses the cellular and antibody-mediated rejection type with AUCs of 0.958 and 0.874, respectively; detects Quilty B lesions, benign mimics of rejection, with an AUC of 0.939; and differentiates between low-grade and high-grade rejections with an AUC of 0.833. In a human reader study, the AI system showed non-inferior performance to conventional assessment and reduced interobserver variability and assessment time. This robust evaluation of cardiac allograft rejection paves the way for clinical trials to establish the efficacy of AI-assisted EMB assessment and its potential for improving heart transplant outcomes.

Noninvasive methods to reduce cardiac complications postheart transplant

PURPOSE OF REVIEW

Long-term success of heart transplantation is limited by allograft rejection and cardiac allograft vasculopathy (CAV). Classic management has relied on frequent invasive testing to screen for early features of rejection and CAV to allow for early treatment. In this review, we discuss new developments in the screening and prevention of allograft rejection and CAV.

RECENT FINDINGS

Newer noninvasive screening techniques show excellent sensitivity and specificity for the detection of clinically significant rejection. New biomarkers and treatment targets continue to be identified and await further studies regarding their utility in preventing allograft vasculopathy.

SUMMARY

Noninvasive imaging and biomarker testing continue to show promise as alternatives to invasive testing for allograft rejection. Continued validation of their effectiveness may lead to new surveillance protocols with reduced frequency of invasive testing. Furthermore, these noninvasive methods will allow for more personalized strategies to reduce the complications of long-term immunosuppression whereas continuing the decline in the overall rate of allograft rejection.

Deep Neural Network-Aided Histopathological Analysis of Myocardial Injury

Deep neural networks have become the mainstream approach for analyzing and interpreting histology images. In this study, we established and validated an interpretable DNN model to assess endomyocardial biopsy (EMB) data of patients with myocardial injury. Deep learning models were used to extract features and classify EMB histopathological images of heart failure cases diagnosed with either ischemic cardiomyopathy or idiopathic dilated cardiomyopathy and non-failing cases (organ donors without a history of heart failure). We utilized the gradient-weighted class activation mapping (Grad-CAM) technique to emphasize injured regions, providing an entry point to assess the dominant morphology in the process of a comprehensive evaluation. To visualize clustered regions of interest (ROI), we utilized uniform manifold approximation and projection (UMAP) embedding for dimension reduction. We further implemented a multi-model ensemble mechanism to improve the quantitative metric (area under the receiver operating characteristic curve, AUC) to 0.985 and 0.992 on ROI-level and case-level, respectively, outperforming the achievement of 0.971 ± 0.017 and 0.981 ± 0.020 based on the sub-models. Collectively, this new methodology provides a robust and interpretive framework to explore local histopathological patterns, facilitating the automatic and high-throughput quantification of cardiac EMB analysis.

The year in cardiovascular medicine 2021: digital health and innovation

This article presents some of the most important developments in the field of digital medicine that have appeared over the last 12 months and are related to cardiovascular medicine. The article consists of three main sections, as follows: (i) artificial intelligence-enabled cardiovascular diagnostic tools, techniques, and methodologies, (ii) big data and prognostic models for cardiovascular risk protection, and (iii) wearable devices in cardiovascular risk assessment, cardiovascular disease prevention, diagnosis, and management. To conclude the article, the authors present a brief further prospective on this new domain, highlighting existing gaps that are specifically related to artificial intelligence technologies, such as explainability, cost-effectiveness, and, of course, the importance of proper regulatory oversight for each clinical implementation.

The year in cardiovascular medicine 2021: heart failure and cardiomyopathies

In the year 2021, the universal definition and classification of heart failure (HF) was published that defines HF as a clinical syndrome with symptoms and/or signs caused by a cardiac abnormality and corroborated by elevated natriuretic peptide levels or objective evidence of cardiogenic congestion. This definition and the classification of HF with reduced ejection fraction (HFrEF), mildly reduced, and HF with preserved ejection fraction (HFpEF) is consistent with the 2021 ESC Guidelines on HF. Among several other new recommendations, these guidelines give a Class I indication for the use of the sodium–glucose co-transporter 2 (SGLT2) inhibitors dapagliflozin and empagliflozin in HFrEF patients. As the first evidence-based treatment for HFpEF, in the EMPEROR-Preserved trial, empagliflozin reduced the composite endpoint of cardiovascular death and HF hospitalizations. Several reports in 2021 have provided novel and detailed analyses of device and medical therapy in HF, especially regarding sacubitril/valsartan, SGLT2 inhibitors, mineralocorticoid receptor antagonists, ferric carboxymaltose, soluble guanylate cyclase activators, and cardiac myosin activators. In patients hospitalized with COVID-19, acute HF and myocardial injury is quite frequent, whereas myocarditis and long-term damage to the heart are rather uncommon.

The Role of Machine Learning in Cardiovascular Pathology

Machine learning has seen slow but steady uptake in diagnostic pathology over the past decade to assess digital whole-slide images. Machine learning tools have incredible potential to standardise, and likely even improve, histopathologic diagnoses, but they are not yet widely used in clinical practice. We describe the principles of these tools and technologies and some successful preclinical and pretranslational efforts in cardiovascular pathology, as well as a roadmap for moving forward. In nonhuman animal models, one proof-of-principle application is in rodent progressive cardiomyopathy, which is of particular significance to drug toxicity studies. Basic science successes include screening the quality of differentiated stem cells and characterising cardiomyocyte developmental stages, with potential applications for research and toxicology/drug safety screening using derived or native human pluripotent stem cells differentiated into cardiomyocytes. Translational studies of particular note include those with success in diagnosing the various forms of heart allograft rejection. For fully realising the value of these tools in clinical cardiovascular pathology, we identify 3 essential challenges. First is image quality standardisation to ensure that algorithms can be developed and implemented on robust, consistent data. The second is consensus diagnosis; experts don't always agree, and thus "truth" may be difficult to establish, but the algorithms themselves may provide a solution. The third is the need for large-enough data sets to facilitate robust algorithm development, necessitating large cross-institutional shared image databases. The power of histopathology-based machine learning technologies is tremendous, and we outline the next steps needed to capitalise on this power.

Molecular Diagnosis of Rejection in Heart Transplantation

Despite the overall success of heart transplantation as a definitive treatment for endstage heart failure, cardiac allograft rejection remains an important cause of morbidity and mortality. Endomyocardial biopsy has been the standard of care for rejection monitoring, but is associated with several diagnostic limitations and serious procedural complications. The use of molecular diagnostics has emerged over the past decade as a tool to potentially circumvent some of these limitations. We present an update on novel molecular approaches to detecting transplant rejection, focusing on 4 categories: microarray technology, gene expression profiling, cell-free DNA and microRNA.