Development and validation of a deep learning model for survival prognosis of transcatheter arterial chemoembolization in patients with intermediate-stage hepatocellular carcinoma

Artificial Intelligence and Machine Learning Predicting Transarterial Chemoembolization Outcomes: A Systematic Review

BACKGROUND

Major society guidelines recommend transarterial chemoembolization (TACE) as the standard of care for intermediate-stage hepatocellular carcinoma (HCC) patients. However, predicting treatment response remains challenging.

AIMS

As artificial intelligence (AI) may predict therapeutic responses, this systematic review aims to assess the performance and effectiveness of radiomics and AI-based models in predicting TACE outcomes in patients with HCC.

METHODS

A systemic search was conducted on Medline and Embase databases from inception to 7th April 2024. Included studies generated a predictive model for TACE response and evaluated its performance by area under the curve (AUC), specificity, or sensitivity analysis. Systematic reviews, meta-analyses, case series and reports, pediatric, and animal studies were excluded. Secondary search of references of included articles ensured comprehensiveness.

RESULTS

64 articles, with 13,412 TACE-treated patients, were included. AI in pre-treatment CT scans provided value in predicting the efficacy of TACE in HCC treatment. A positive association was observed for AI in pre-treatment MRI scans. Models incorporating radiomics had numerically better performance than those incorporating manual measured radiological variables. 39 studies demonstrated that combined predictive models had numerically better performance than models based solely on imaging or non-imaging features.

CONCLUSION

A combined predictive model incorporating clinical features, laboratory investigations, and radiological characteristics may effectively predict response to TACE treatment for HCC.

Advancements in Artificial Intelligence-Enhanced Imaging Diagnostics for the Management of Liver Disease-Applications and Challenges in Personalized Care

Liver disease can significantly impact life expectancy, making early diagnosis and therapeutic intervention critical challenges in medical care. Imaging diagnostics play a crucial role in diagnosing and managing liver diseases. Recently, the application of artificial intelligence (AI) in medical imaging analysis has become indispensable in healthcare. AI, trained on vast datasets of medical images, has sometimes demonstrated diagnostic accuracy that surpasses that of human experts. AI-assisted imaging diagnostics are expected to contribute significantly to the standardization of diagnostic quality. Furthermore, AI has the potential to identify image features that are imperceptible to humans, thereby playing an essential role in clinical decision-making. This capability enables physicians to make more accurate diagnoses and develop effective treatment strategies, ultimately improving patient outcomes. Additionally, AI is anticipated to become a powerful tool in personalized medicine. By integrating individual patient imaging data with clinical information, AI can propose optimal plans for treatment, making it an essential component in the provision of the most appropriate care for each patient. Current reports highlight the advantages of AI in managing liver diseases. As AI technology continues to evolve, it is expected to advance personalized diagnostics and treatments and contribute to overall improvements in healthcare quality.

Advancing Hepatocellular Carcinoma Management Through Peritumoral Radiomics: Enhancing Diagnosis, Treatment, and Prognosis

Hepatocellular carcinoma (HCC) is the most common primary liver cancer and is associated with high mortality rates due to late detection and aggressive progression. Peritumoral radiomics, an emerging technique that quantitatively analyzes the tissue surrounding the tumor, has shown significant potential in enhancing the management of HCC. This paper examines the role of peritumoral radiomics in improving diagnostic accuracy, guiding personalized treatment strategies, and refining prognostic assessments. By offering unique insights into the tumor microenvironment, peritumoral radiomics enables more precise patient stratification and informs clinical decision-making. However, the integration of peritumoral radiomics into routine clinical practice faces several challenges. Addressing these challenges through continued research and innovation is crucial for the successful implementation of peritumoral radiomics in HCC management, ultimately leading to improved patient outcomes.

Identification of potential biomarkers for lung adenocarcinoma: a study based on bioinformatics analysis combined with validation experiments

Background

The prognosis for lung adenocarcinoma (LUAD) remains dismal, with a 5-year survival rate of <20%. Therefore, the purpose of this study was to identify potentially reliable biomarkers in LUAD by machine learning combination with Mendelian randomization (MR).

Methods

TCGA-LUAD, GSE40791, and GSE31210 were employed this study. Key module differential genes were identified through differentially expressed analysis and weighted gene co-expression network analysis (WGCNA). Furthermore, candidate biomarkers were derived from protein-protein interaction network (PPI) and machine learning. Ultimately, biomarkers were confirmed using MR analysis. In addition, immunohistochemistry was used to detect the expression levels of genes that have a causal relationship to LUAD in the LUAD group and the control group. Cell experiments were conducted to validate the effect of screening genes on proliferation, migration, and apoptosis of LUAD cells. The correlation between the screened genes and immune infiltration was determined by CIBERSORT algorithm. In the end, the gene-related drugs were predicted through the Drug-Gene Interaction database.

Results

In total, 401 key module differential genes were obtained by intersecting of 5,702 differentially expressed genes (DEGs) and 406 key module genes. Thereafter, GIMAP6, CAV1, PECAM1, and TGFBR2 were identified. Among them, only TGFBR2 had a significant causal relationship with LUAD (p=0.04, b=-0.06), and it is a protective factor for LUAD. Subsequently, sensitivity analyses showed that there were no heterogeneity and horizontal pleiotropy in the univariate MR results, and the results were not overly sensitive to individual SNP loci, further validating the reliability of univariate Mendelian randomization (UVMR) results. However, no causal relationship was found between them by reverse MR analysis. Meanwhile, TGFBR2 expression was decreased in LUAD group through immunohistochemistry. TGFBR2 can inhibit proliferation and migration of lung adenocarcinoma cell line A549 and promote apoptosis of A549 cells. Immune infiltration analysis suggested a potential link between TGFBR2 expression and immune infiltration. Finally, Irinotecan and Hesperetin were predicted through DGIDB database.

Conclusion

In this study, TGFBR2 was identified as a biomarker of LUAD, which provided a new idea for the treatment strategy of LUAD and may aid in the development of personalized immunotherapy strategies.

CT-based multimodal deep learning for non-invasive overall survival prediction in advanced hepatocellular carcinoma patients treated with immunotherapy

OBJECTIVES

To develop a deep learning model combining CT scans and clinical information to predict overall survival in advanced hepatocellular carcinoma (HCC).

METHODS

This retrospective study included immunotherapy-treated advanced HCC patients from 52 multi-national in-house centers between 2018 and 2022. A multi-modal prognostic model using baseline and the first follow-up CT images and 7 clinical variables was proposed. A convolutional-recurrent neural network (CRNN) was developed to extract spatial-temporal information from automatically selected representative 2D CT slices to provide a radiological score, then fused with a Cox-based clinical score to provide the survival risk. The model's effectiveness was assessed using a time-dependent area under the receiver operating curve (AUC), and risk group stratification using the log-rank test. Prognostic performances of multi-modal inputs were compared to models of missing modality, and the size-based RECIST criteria.

RESULTS

Two-hundred seven patients (mean age, 61 years ± 12 [SD], 180 men) were included. The multi-modal CRNN model reached the AUC of 0.777 and 0.704 of 1-year overall survival predictions in the validation and test sets. The model achieved significant risk stratification in validation (hazard ratio [HR] = 3.330, p = 0.008), and test sets (HR = 2.024, p = 0.047) based on the median risk score of the training set. Models with missing modalities (the single-modal imaging-based model and the model incorporating only baseline scans) can still achieve favorable risk stratification performance (all p < 0.05, except for one, p = 0.053). Moreover, results proved the superiority of the deep learning-based model to the RECIST criteria.

CONCLUSION

Deep learning analysis of CT scans and clinical data can offer significant prognostic insights for patients with advanced HCC.

CRITICAL RELEVANCE STATEMENT

The established model can help monitor patients' disease statuses and identify those with poor prognosis at the time of first follow-up, helping clinicians make informed treatment decisions, as well as early and timely interventions.

KEY POINTS

An AI-based prognostic model was developed for advanced HCC using multi-national patients. The model extracts spatial-temporal information from CT scans and integrates it with clinical variables to prognosticate. The model demonstrated superior prognostic ability compared to the conventional size-based RECIST method.

Radiomics as a tool for prognostic prediction in transarterial chemoembolization for hepatocellular carcinoma: a systematic review and meta-analysis

INTRODUCTION

Transarterial chemoembolization (TACE) is one of the predominant locoregional therapeutic modalities for addressing hepatocellular carcinoma (HCC). However, achieving precise prognostic predictions and effective patient selection remains a challenging pursuit. The primary objective of this systematic review and meta-analysis is to evaluate the efficacy of radiomics in forecasting the prognosis associated with TACE treatment.

METHODS

A comprehensive exploration of pertinent original studies was undertaken, encompassing databases of PubMed, Web of Science and Embase. The studies' quality was meticulously evaluated employing the quality assessment of diagnostic accuracy studies 2 (QUADAS-2), the radiomics quality score (RQS) and the METhodological RadiomICs Score (METRICS). Pooled statistics, along with 95% confidence intervals (95% CI), were computed for sensitivity, specificity, positive likelihood ratio (PLR), and negative likelihood ratio (NLR). Additionally, a summary receiver operating characteristic curve (sROC) was generated. To discern potential sources of heterogeneity, meta-regression and subgroup analyses were performed.

RESULTS

The systematic review incorporated 29 studies, comprising a total of 5483 patients, with 14 studies involving 2691 patients qualifying for inclusion in the meta-analysis. The assessed studies exhibited commendable quality with regard to bias risk, with mean RQS of 12.90 ± 5.13 (35.82% ± 14.25%) and mean METRICS of 62.98% ± 14.58%. The pooled sensitivity was 0.83 (95% CI: 0.78-0.87), specificity was 0.86 (95% CI: 0.79-0.92), PLR was 6.13 (95% CI: 3.79-9.90), and NLR was 0.20 (95% CI: 0.15-0.27). The area under the sROC was 0.90 (95% CI: 0.87-0.93). Significant heterogeneity within all the included studies was observed, while meta-regression and subgroup analyses revealed homogeneous and promising findings in subgroups where principal methodological variables such as modeling algorithms, imaging modalities, and imaging phases were specified.

CONCLUSION

Radiomics models have exhibited robust predictive capabilities concerning prognosis subsequent to TACE, thereby presenting promising prospects for clinical translation.

PET/CT deep learning prognosis for treatment decision support in esophageal squamous cell carcinoma

OBJECTIVES

The clinical decision-making regarding choosing surgery alone (SA) or surgery followed by postoperative adjuvant chemotherapy (SPOCT) in esophageal squamous cell carcinoma (ESCC) remains controversial. We aim to propose a pre-therapy PET/CT image-based deep learning approach to improve the survival benefit and clinical management of ESCC patients.

METHODS

This retrospective multicenter study included 837 ESCC patients from three institutions. Prognostic biomarkers integrating six networks were developed to build an ESCC prognosis (ESCCPro) model and predict the survival probability of ESCC patients treated with SA and SPOCT. Patients who did not undergo surgical resection were in a control group. Overall survival (OS) was the primary end-point event. The expected improvement in survival prognosis with the application of ESCCPro to assign treatment protocols was estimated by comparing the survival of patients in each subgroup. Seven clinicians with varying experience evaluated how ESCCPro performed in assisting clinical decision-making.

RESULTS

In this retrospective multicenter study, patients receiving SA had a median OS 9.2 months longer than controls. No significant differences in survival were found between SA patients with predicted poor outcomes and the controls (p > 0.05). It was estimated that if ESCCPro was used to determine SA and SPOCT eligibility, the median OS in the ESCCPro-recommended SA group and SPOCT group would have been 15.3 months and 24.9 months longer, respectively. In addition, ESCCPro also significantly improved prognosis accuracy, certainty, and the efficiency of clinical experts.

CONCLUSION

ESCCPro assistance improved the survival benefit of ESCC patients and the clinical decision-making among the two treatment approaches.

CRITICAL RELEVANCE STATEMENT

The ESCCPro model for treatment decision-making is promising to improve overall survival in ESCC patients undergoing surgical resection and patients undergoing surgery followed by postoperative adjuvant chemotherapy.

KEY POINTS

ESCC is associated with a poor prognosis and unclear ideal treatments. ESCCPro predicts the survival of patients with ESCC and the expected benefit from SA. ESCCPro improves clinicians' stratification of patients' prognoses.

EfficientNet-Based System for Detecting EGFR-Mutant Status and Predicting Prognosis of Tyrosine Kinase Inhibitors in Patients with NSCLC

We aimed to develop and validate a deep learning-based system using pre-therapy computed tomography (CT) images to detect epidermal growth factor receptor (EGFR)-mutant status in patients with non-small cell lung cancer (NSCLC) and predict the prognosis of advanced-stage patients with EGFR mutations treated with EGFR tyrosine kinase inhibitors (TKI). This retrospective, multicenter study included 485 patients with NSCLC from four hospitals. Of them, 339 patients from three centers were included in the training dataset to develop an EfficientNetV2-L-based model (EME) for predicting EGFR-mutant status, and the remaining patients were assigned to an independent test dataset. EME semantic features were extracted to construct an EME-prognostic model to stratify the prognosis of EGFR-mutant NSCLC patients receiving EGFR-TKI. A comparison of EME and radiomics was conducted. Additionally, we included patients from The Cancer Genome Atlas lung adenocarcinoma dataset with both CT images and RNA sequencing data to explore the biological associations between EME score and EGFR-related biological processes. EME obtained an area under the curve (AUC) of 0.907 (95% CI 0.840-0.926) on the test dataset, superior to the radiomics model (P = 0.007). The EME and radiomics fusion model showed better (AUC, 0.941) but not significantly increased performance (P = 0.895) compared with EME. In prognostic stratification, the EME-prognostic model achieved the best performance (C-index, 0.711). Moreover, the EME-prognostic score showed strong associations with biological pathways related to EGFR expression and EGFR-TKI efficacy. EME demonstrated a non-invasive and biologically interpretable approach to predict EGFR status, stratify survival prognosis, and correlate biological pathways in patients with NSCLC.

Leveraging radiomics and AI for precision diagnosis and prognostication of liver malignancies

Liver tumors, whether primary or metastatic, have emerged as a growing concern with substantial global health implications. Timely identification and characterization of liver tumors are pivotal factors in order to provide optimum treatment. Imaging is a crucial part of the detection of liver tumors; however, conventional imaging has shortcomings in the proper characterization of these tumors which leads to the need for tissue biopsy. Artificial intelligence (AI) and radiomics have recently emerged as investigational opportunities with the potential to enhance the detection and characterization of liver lesions. These advancements offer opportunities for better diagnostic accuracy, prognostication, and thereby improving patient care. In particular, these techniques have the potential to predict the histopathology, genotype, and immunophenotype of tumors based on imaging data, hence providing guidance for personalized treatment of such tumors. In this review, we outline the progression and potential of AI in the field of liver oncology imaging, specifically emphasizing manual radiomic techniques and deep learning-based representations. We discuss how these tools can aid in clinical decision-making challenges. These challenges encompass a broad range of tasks, from prognosticating patient outcomes, differentiating benign treatment-related factors and actual disease progression, recognizing uncommon response patterns, and even predicting the genetic and molecular characteristics of the tumors. Lastly, we discuss the pitfalls, technical limitations and future direction of these AI-based techniques.

A Deep Learning Model Combining Multimodal Factors to Predict the Overall Survival of Transarterial Chemoembolization

Background

To develop and validate an overall survival (OS) prediction model for transarterial chemoembolization (TACE).

Methods

In this retrospective study, 301 patients with hepatocellular carcinoma (HCC) who received TACE from 2012 to 2015 were collected. The residual network was used to extract prognostic information from CT images, which was then combined with the clinical factors adjusted by COX regression to predict survival using a modified deep learning model (DLOPCombin). The DLOPCombin model was compared with the residual network model (DLOPCTR), multiple COX regression model (DLOPCox), Radiomic model (Radiomic), and clinical model.

Results

In the validation cohort, DLOPCombin shows the highest TD AUC of all cohorts, which compared with Radiomic (TD AUC: 0.96vs 0.63) and clinical model (TD AUC: 0.96 vs 0.62) model. DLOPCombin showed significant difference in C index compared with DLOPCTR and DLOPCox models (P < 0.05). Moreover, the DLOPCombin showed good calibration and overall net benefit. Patients with DLOPCombin model score ≤ 0.902 had better OS (33 months vs 15.5 months, P < 0.0001).

Conclusion

The deep learning model can effectively predict the patients' overall survival of TACE.

Comparative analysis of radiomics and deep-learning algorithms for survival prediction in hepatocellular carcinoma

To examine the comparative robustness of computed tomography (CT)-based conventional radiomics and deep-learning convolutional neural networks (CNN) to predict overall survival (OS) in HCC patients. Retrospectively, 114 HCC patients with pretherapeutic CT of the liver were randomized into a development (n = 85) and a validation (n = 29) cohort, including patients of all tumor stages and several applied therapies. In addition to clinical parameters, image annotations of the liver parenchyma and of tumor findings on CT were available. Cox-regression based on radiomics features and CNN models were established and combined with clinical parameters to predict OS. Model performance was assessed using the concordance index (C-index). Log-rank tests were used to test model-based patient stratification into high/low-risk groups. The clinical Cox-regression model achieved the best validation performance for OS (C-index [95% confidence interval (CI)] 0.74 [0.57-0.86]) with a significant difference between the risk groups (p = 0.03). In image analysis, the CNN models (lowest C-index [CI] 0.63 [0.39-0.83]; highest C-index [CI] 0.71 [0.49-0.88]) were superior to the corresponding radiomics models (lowest C-index [CI] 0.51 [0.30-0.73]; highest C-index [CI] 0.66 [0.48-0.79]). A significant risk stratification was not possible (p > 0.05). Under clinical conditions, CNN-algorithms demonstrate superior prognostic potential to predict OS in HCC patients compared to conventional radiomics approaches and could therefore provide important information in the clinical setting, especially when clinical data is limited.

Machine Learning Combined with Radiomics Facilitating the Personal Treatment of Malignant Liver Tumors

In the realm of managing malignant liver tumors, the convergence of radiomics and machine learning has redefined the landscape of medical practice. The field of radiomics employs advanced algorithms to extract thousands of quantitative features (including intensity, texture, and structure) from medical images. Machine learning, including its subset deep learning, aids in the comprehensive analysis and integration of these features from diverse image sources. This potent synergy enables the prediction of responses of malignant liver tumors to various treatments and outcomes. In this comprehensive review, we examine the evolution of the field of radiomics and its procedural framework. Furthermore, the applications of radiomics combined with machine learning in the context of personalized treatment for malignant liver tumors are outlined in aspects of surgical therapy and non-surgical treatments such as ablation, transarterial chemoembolization, radiotherapy, and systemic therapies. Finally, we discuss the current challenges in the amalgamation of radiomics and machine learning in the study of malignant liver tumors and explore future opportunities.

Using Machine Learning to Predict Response to Image-guided Therapies for Hepatocellular Carcinoma

Interventional oncology is a rapidly growing field with advances in minimally invasive image-guided local-regional treatments for hepatocellular carcinoma (HCC), including transarterial chemoembolization, transarterial radioembolization, and thermal ablation. However, current standardized clinical staging systems for HCC are limited in their ability to optimize patient selection for treatment as they rely primarily on serum markers and radiologist-defined imaging features. Given the variation in treatment responses, an updated scoring system that includes multidimensional aspects of the disease, including quantitative imaging features, serum markers, and functional biomarkers, is needed to optimally triage patients. With the vast amounts of numerical medical record data and imaging features, researchers have turned to image-based methods, such as radiomics and artificial intelligence (AI), to automatically extract and process multidimensional data from images. The synthesis of these data can provide clinically relevant results to guide personalized treatment plans and optimize resource utilization. Machine learning (ML) is a branch of AI in which a model learns from training data and makes effective predictions by teaching itself. This review article outlines the basics of ML and provides a comprehensive overview of its potential value in the prediction of treatment response in patients with HCC after minimally invasive image-guided therapy.

Contrast-Enhanced CT Imaging Features Combined with Clinical Factors to Predict the Efficacy and Prognosis for Transarterial Chemoembolization of Hepatocellular Carcinoma

RATIONALE AND OBJECTIVES

Accurate prediction of treatment response to transarterial chemoembolization (TACE) in patients with hepatocellular carcinoma (HCC) is critical for precision treatment. This study aimed to develop a comprehensive model (DLRC) that incorporates contrast-enhanced computed tomography (CECT) images and clinical factors to predict the response to TACE in patients with HCC.

MATERIALS AND METHODS

A total of 399 patients with intermediate-stage HCC were included in this retrospective study. Deep learning and radiomic signatures were established based on arterial phase CECT images, Correlation analysis and the least absolute shrinkage and selection (LASSO) regression analysis were applied for features selection. The DLRC model incorporating deep learning radiomic signatures and clinical factors was developed using multivariate logistic regression. The area under the receiver operating characteristic curve (AUC), calibration curve and decision curve analysis (DCA) were used to evaluate the performance of the models. Kaplan-Meier survival curves based on the DLRC were plotted to assess overall survival in the follow-up cohort (n = 261).

RESULTS

The DLRC model was developed using 19 quantitative radiomic features, 10 deep learning features, and 3 clinical factors. The AUC of the DLRC model was 0.937 (95% confidence interval [CI], 0.912-0.962) and 0.909 (95% CI, 0.850-0.968) in the training and validation cohorts, respectively, outperforming models established with two signatures or a single signature (p < 0.05). Stratified analysis showed that the DLRC was not statistically different between subgroups (p > 0.05), and the DCA confirmed the greater net clinical benefit. In addition, multivariable cox regression revealed that DLRC model outputs were independent risk factors for the overall survival (hazard ratios: 1.20, 95% CI: 1.03-1.40; p = 0.019).

CONCLUSION

The DLRC model exhibited a remarkable accuracy in predicting response to TACE, and it can be utilized as a potent tool for precision treatment.

Data-Driven Assisted Decision Making for Surgical Procedure of Hepatocellular Carcinoma Resection and Prognostic Prediction: Development and Validation of Machine Learning Models

Background: Currently, surgical decisions for hepatocellular carcinoma (HCC) resection are difficult and not sufficiently personalized. We aimed to develop and validate data driven prediction models to assist surgeons in selecting the optimal surgical procedure for patients. Methods: Retrospective data from 361 HCC patients who underwent radical resection in two institutions were included. End-to-end deep learning models were built to automatically segment lesions from the arterial phase (AP) of preoperative dynamic contrast enhanced magnetic resonance imaging (DCE-MRI). Clinical baseline characteristics and radiomic features were rigorously screened. The effectiveness of radiomic features and radiomic-clinical features was also compared. Three ensemble learning models were proposed to perform the surgical procedure decision and the overall survival (OS) and recurrence-free survival (RFS) predictions after taking different solutions, respectively. Results: SegFormer performed best in terms of automatic segmentation, achieving a Mean Intersection over Union (mIoU) of 0.8860. The five-fold cross-validation results showed that inputting radiomic-clinical features outperformed using only radiomic features. The proposed models all outperformed the other mainstream ensemble models. On the external test set, the area under the receiver operating characteristic curve (AUC) of the proposed decision model was 0.7731, and the performance of the prognostic prediction models was also relatively excellent. The application web server based on automatic lesion segmentation was deployed and is available online. Conclusions: In this study, we developed and externally validated the surgical decision-making procedures and prognostic prediction models for HCC for the first time, and the results demonstrated relatively accurate predictions and strong generalizations, which are expected to help clinicians optimize surgical procedures.