Prediction of Outcomes after Heart Transplantation Using Machine Learning Techniques

Prediction of Outcomes After Heart Transplantation in Pediatric Patients Using National Registry Data: Evaluation of Machine Learning Approaches

BACKGROUND

The prediction of posttransplant health outcomes for pediatric heart transplantation is critical for risk stratification and high-quality posttransplant care.

OBJECTIVE

The purpose of this study was to examine the use of machine learning (ML) models to predict rejection and mortality for pediatric heart transplant recipients.

METHODS

Various ML models were used to predict rejection and mortality at 1, 3, and 5 years after transplantation in pediatric heart transplant recipients using United Network for Organ Sharing data from 1987 to 2019. The variables used for predicting posttransplant outcomes included donor and recipient as well as medical and social factors. We evaluated 7 ML models-extreme gradient boosting (XGBoost), logistic regression, support vector machine, random forest (RF), stochastic gradient descent, multilayer perceptron, and adaptive boosting (AdaBoost)-as well as a deep learning model with 2 hidden layers with 100 neurons and a rectified linear unit (ReLU) activation function followed by batch normalization for each and a classification head with a softmax activation function. We used 10-fold cross-validation to evaluate model performance. Shapley additive explanations (SHAP) values were calculated to estimate the importance of each variable for prediction.

RESULTS

RF and AdaBoost models were the best-performing algorithms for different prediction windows across outcomes. RF outperformed other ML algorithms in predicting 5 of the 6 outcomes (area under the receiver operating characteristic curve [AUROC] 0.664 and 0.706 for 1-year and 3-year rejection, respectively, and AUROC 0.697, 0.758, and 0.763 for 1-year, 3-year, and 5-year mortality, respectively). AdaBoost achieved the best performance for prediction of 5-year rejection (AUROC 0.705).

CONCLUSIONS

This study demonstrates the comparative utility of ML approaches for modeling posttransplant health outcomes using registry data. ML approaches can identify unique risk factors and their complex relationship with outcomes, thereby identifying patients considered to be at risk and informing the transplant community about the potential of these innovative approaches to improve pediatric care after heart transplantation. Future studies are required to translate the information derived from prediction models to optimize counseling, clinical care, and decision-making within pediatric organ transplant centers.

State-of-the-art machine learning algorithms for the prediction of outcomes after contemporary heart transplantation: Results from the UNOS database

PURPOSE

We sought to develop and validate machine learning (ML) models to increase the predictive accuracy of mortality after heart transplantation (HT).

METHODS AND RESULTS

We included adult HT recipients from the United Network for Organ Sharing (UNOS) database between 2010 and 2018 using solely pre-transplant variables. The study cohort comprised 18 625 patients (53 ± 13 years, 73% males) and was randomly split into a derivation and a validation cohort with a 3:1 ratio. At 1-year after HT, there were 2334 (12.5%) deaths. Out of a total of 134 pre-transplant variables, 39 were selected as highly predictive of 1-year mortality via feature selection algorithm and were used to train five ML models. AUC for the prediction of 1-year survival was .689, .642, .649, .637, .526 for the Adaboost, Logistic Regression, Decision Tree, Support Vector Machine, and K-nearest neighbor models, respectively, whereas the Index for Mortality Prediction after Cardiac Transplantation (IMPACT) score had an AUC of .569. Local interpretable model-agnostic explanations (LIME) analysis was used in the best performing model to identify the relative impact of key predictors. ML models for 3- and 5-year survival as well as acute rejection were also developed in a secondary analysis and yielded AUCs of .629, .609, and .610 using 27, 31, and 91 selected variables respectively.

CONCLUSION

Machine learning models showed good predictive accuracy of outcomes after heart transplantation.