Deep learning radiomics based on contrast enhanced computed tomography predicts microvascular invasion and survival outcome in early stage hepatocellular carcinoma

Radiomics model and deep learning model based on T1WI image for acute lymphoblastic leukemia identification

AIM

This study aimed to develop highly precise radiomics and deep learning models to accurately detect acute lymphoblastic leukemia (ALL) using a T1WI image.

MATERIALS AND METHODS

A total of 604 brain magnetic resonance data of ALL group and normal children (NC) group. Two radiologists independently retrieved radiomics features after manually delineating the area of interest along the clivus at the median sagittal position of T1WI. According to the 9:1 ratio, all samples were randomly divided into the training cohort and the testing cohort. support vector machine was then used to classify the radiomics model using the features that had a correlation coefficient of greater than 0.99 in the training cohort. The Efficientnet-B3 network model received the training set images to create a deep learning model. The sensitivity, specificity, and area under the ROC curve were calculated in order to evaluate the diagnostic efficacy of the different models after the validation of two aforementioned models in the testing cohort.

RESULTS

The deep learning model had a higher AUC value of 0.981 than the radiomics model's value of 0.962 in the testing cohort. Delong's test showed no statistical difference between the two models (P>0.05). The accuracy/sensitivity/specificity/negative predictive value/positive predictive value achieved 0.9180/0.9565/0.8947/0.9714/0.8462 for the radiomics model and 0.9344/0.8696/0.9737/0.9250/0.9524 for deep learning model.

CONCLUSIONS

The deep learning and radiomics models showed high AUC values in the training and test cohorts. They also exhibited good diagnostic efficacy for predicting ALL.

Preoperative prediction of microvascular invasion risk in hepatocellular carcinoma with MRI: peritumoral versus tumor region

OBJECTIVES

To explore the predictive performance of tumor and multiple peritumoral regions on dynamic contrast-enhanced magnetic resonance imaging (MRI), to identify optimal regions of interest for developing a preoperative predictive model for the grade of microvascular invasion (MVI).

METHODS

A total of 147 patients who were surgically diagnosed with hepatocellular carcinoma, and had a maximum tumor diameter ≤ 5 cm were recruited and subsequently divided into a training set (n = 117) and a testing set (n = 30) based on the date of surgery. We utilized a pre-trained AlexNet to extract deep learning features from seven different regions of the maximum transverse cross-section of tumors in various MRI sequence images. Subsequently, an extreme gradient boosting (XGBoost) classifier was employed to construct the MVI grade prediction model, with evaluation based on the area under the curve (AUC).

RESULTS

The XGBoost classifier trained with data from the 20-mm peritumoral region showed superior AUC compared to the tumor region alone. AUC values consistently increased when utilizing data from 5-mm, 10-mm, and 20-mm peritumoral regions. Combining arterial and delayed-phase data yielded the highest predictive performance, with micro- and macro-average AUCs of 0.78 and 0.74, respectively. Integration of clinical data further improved AUCs values to 0.83 and 0.80.

CONCLUSION

Compared with those of the tumor region, the deep learning features of the peritumoral region provide more important information for predicting the grade of MVI. Combining the tumor region and the 20-mm peritumoral region resulted in a relatively ideal and accurate region within which the grade of MVI can be predicted.

CLINICAL RELEVANCE STATEMENT

The 20-mm peritumoral region holds more significance than the tumor region in predicting MVI grade. Deep learning features can indirectly predict MVI by extracting information from the tumor region and directly capturing MVI information from the peritumoral region.

KEY POINTS

We investigated tumor and different peritumoral regions, as well as their fusion. MVI predominantly occurs in the peritumoral region, a superior predictor compared to the tumor region. The peritumoral 20 mm region is reasonable for accurately predicting the three-grade MVI.

Magnetic Resonance Deep Learning Radiomic Model Based on Distinct Metastatic Vascular Patterns for Evaluating Recurrence-Free Survival in Hepatocellular Carcinoma

BACKGROUND

The metastatic vascular patterns of hepatocellular carcinoma (HCC) are mainly microvascular invasion (MVI) and vessels encapsulating tumor clusters (VETC). However, most existing VETC-related radiological studies still focus on the prediction of VETC status.

PURPOSE

This study aimed to build and compare VETC-MVI related models (clinical, radiomics, and deep learning) associated with recurrence-free survival of HCC patients.

STUDY TYPE

Retrospective.

POPULATION

398 HCC patients (349 male, 49 female; median age 51.7 years, and age range: 22-80 years) who underwent resection from five hospitals in China. The patients were randomly divided into training cohort (n = 358) and test cohort (n = 40).

FIELD STRENGTH/SEQUENCE

3-T, pre-contrast T1-weighted imaging spoiled gradient recalled echo (T1WI SPGR), T2-weighted imaging fast spin echo (T2WI FSE), and contrast enhanced arterial phase (AP), delay phase (DP).

ASSESSMENT

Two radiologists performed the segmentation of HCC on T1WI, T2WI, AP, and DP images, from which radiomic features were extracted. The RFS related clinical characteristics (VETC, MVI, Barcelona stage, tumor maximum diameter, and alpha fetoprotein) and radiomic features were used to build the clinical model, clinical-radiomic (CR) nomogram, deep learning model. The follow-up process was done 1 month after resection, and every 3 months subsequently. The RFS was defined as the date of resection to the date of recurrence confirmed by radiology or the last follow-up. Patients were followed up until December 31, 2022.

STATISTICAL TESTS

Univariate COX regression, least absolute shrinkage and selection operator (LASSO), Kaplan-Meier curves, log-rank test, C-index, and area under the curve (AUC). P < 0.05 was considered statistically significant.

RESULTS

The C-index of deep learning model achieved 0.830 in test cohort compared with CR nomogram (0.731), radiomic signature (0.707), and clinical model (0.702). The average RFS of the overall patients was 26.77 months (range 1-80 months).

DATA CONCLUSION

MR deep learning model based on VETC and MVI provides a potential tool for survival assessment.

EVIDENCE LEVEL

3 TECHNICAL EFFICACY: Stage 3.

Radiomics features based on dual-area CT predict the expression levels of fatty acid binding protein 4 and outcome in hepatocellular carcinoma

RATIONALE AND OBJECTIVES

To evaluate the predictive value of tumor and peritumor radiomics in the fatty acid binding protein 4 (FABP4) expression levels and overall survival in patients with hepatocellular carcinoma.

MATERIALS AND METHODS

The genomic data of HCC patients were obtained from The Cancer Genome Atlas. The Dual-area CT images of corresponding patients were downloaded from The Cancer Imaging Archive, for radiomics feature extraction, model construction and prognosis analysis. Simultaneously, using patients from Sichuan Provincial People's Hospital, the prognostic value of the radiomics model in HCC patients was validated.

RESULTS

In the TCIA database, the area under the curve (AUC) values of the volumes of interest (VOI)whole model in the training set and internal validation set were 0.812 and 0.754, respectively, and the AUC value of VOIwhole+periphery in the training set and internal validation set were 0.866 and 0.779, respectively. In the VOIwhole and the VOIwhole+periphery model of the independent cohort, there were significant differences in OS between the high and low rad-score groups (P = 0.009, P = 0.021, respectively). Significant positive correlations can be observed between FABP4 expression and correlations with rad-score of VOIwhole model (r = 0.691) and VOIwhole+periphery model (r = 0.732) in the independent cohort.

CONCLUSION

Radiomics models of tumor and peritumor Dual-area CT images could predict stably the expression levels of FABP4 and may be helping in personalized treatment strategies.

Role of microvascular invasion in early recurrence of hepatocellular carcinoma after liver resection: A literature review

Hepatectomy is widely considered a potential treatment for hepatocellular carcinoma (HCC). Unfortunately, one-third of HCC patients have tumor recurrence within 2 years after surgery (early recurrence), accounting for more than 60% of all recurrence patients. Early recurrence is associated with a worse prognosis. Previous studies have shown that microvascular invasion (MVI) is one of the key factors for early recurrence and poor prognosis in patients with HCC after surgery. This paper reviews the latest literature and summarizes the predictors of MVI, the correlation between MVI and early recurrence, the identification of suspicious nodules or subclinical lesions, and the treatment strategies for MVI-positive HCC. The aim is to explore the management of patients with MVI-positive HCC.

A Transformer-Based microvascular invasion classifier enhances prognostic stratification in HCC following radiofrequency ablation

BACKGROUND & AIMS

We aimed to develop a Transformer-based deep learning (DL) network for prognostic stratification in hepatocellular carcinoma (HCC) patients undergoing RFA.

METHODS

A Swin Transformer DL network was trained to establish associations between magnetic resonance imaging (MRI) datasets and the ground truth of microvascular invasion (MVI) based on 696 surgical resection (SR) patients with solitary HCC ≤3 cm, and was validated in an external cohort (n = 180). The multiphase MRI-based DL risk outputs using an optimal threshold of .5 was employed as a MVI classifier for prognosis stratification in the RFA cohort (n = 180).

RESULTS

Over 90% of all enrolled patients exhibited hepatitis B virus infection. Liver cirrhosis was significantly more prevalent in the RFA cohort compared to the SR cohort (72.2% vs. 44.1%, p < .001). The MVI risk outputs exhibited good performance (area under the curve values = .938 and .883) for predicting MVI in the training and validation cohort, respectively. The RFA patients at high risk of MVI classified by the MVI classifier demonstrated significantly lower recurrence-free survival (RFS) and overall survival rates at 1, 3 and 5 years compared to those classified as low risk (p < .001). Multivariate cox regression modelling of a-fetoprotein > 20 ng/mL [hazard ratio (HR) = 1.53; 95% confidence interval (95% CI): 1.02-2.33, p = .047], high risk of MVI (HR = 3.76; 95% CI: 2.40-5.88, p < .001) and unfavourable tumour location (HR = 2.15; 95% CI: 1.40-3.29, p = .001) yielded a c-index of .731 (bootstrapped 95% CI: .667-.778) for evaluating RFS after RFA. Among the three risk factors, MVI was the most powerful predictor for intrahepatic distance recurrence.

CONCLUSIONS

The proposed MVI classifier can serve as a valuable imaging biomarker for prognostic stratification in early-stage HCC patients undergoing RFA.

Deep Features from Pretrained Networks Do Not Outperform Hand-Crafted Features in Radiomics

In radiomics, utilizing features extracted from pretrained deep networks could result in models with a higher predictive performance than those relying on hand-crafted features. This study compared the predictive performance of models trained with either deep features, hand-crafted features, or a combination of these features in terms of the area under the receiver-operating characteristic curve (AUC) and other metrics. We trained models on ten radiological datasets using five feature selection methods and three classifiers. Our results indicate that models based on deep features did not show an improved AUC compared to those utilizing hand-crafted features (deep: AUC 0.775, hand-crafted: AUC 0.789; p = 0.28). Including morphological features alongside deep features led to overall improvements in prediction performance for all models (+0.02 gain in AUC; p < 0.001); however, the best model did not benefit from this (+0.003 gain in AUC; p = 0.57). Using all hand-crafted features in addition to the deep features resulted in a further overall improvement (+0.034 in AUC; p < 0.001), but only a minor improvement could be observed for the best model (deep: AUC 0.798, hand-crafted: AUC 0.789; p = 0.92). Furthermore, our results show that models based on deep features extracted from networks pretrained on medical data have no advantage in predictive performance over models relying on features extracted from networks pretrained on ImageNet data. Our study contributes a benchmarking analysis of models trained on hand-crafted and deep features from pretrained networks across multiple datasets. It also provides a comprehensive understanding of their applicability and limitations in radiomics. Our study shows, in conclusion, that models based on features extracted from pretrained deep networks do not outperform models trained on hand-crafted ones.

Clinical Interpretability of Deep Learning for Predicting Microvascular Invasion in Hepatocellular Carcinoma by Using Attention Mechanism

Preoperative prediction of microvascular invasion (MVI) is essential for management decision in hepatocellular carcinoma (HCC). Deep learning-based prediction models of MVI are numerous but lack clinical interpretation due to their "black-box" nature. Consequently, we aimed to use an attention-guided feature fusion network, including intra- and inter-attention modules, to solve this problem. This retrospective study recruited 210 HCC patients who underwent gadoxetate-enhanced MRI examination before surgery. The MRIs on pre-contrast, arterial, portal, and hepatobiliary phases (hepatobiliary phase: HBP) were used to develop single-phase and multi-phase models. Attention weights provided by attention modules were used to obtain visual explanations of predictive decisions. The four-phase fusion model achieved the highest area under the curve (AUC) of 0.92 (95% CI: 0.84-1.00), and the other models proposed AUCs of 0.75-0.91. Attention heatmaps of collaborative-attention layers revealed that tumor margins in all phases and peritumoral areas in the arterial phase and HBP were salient regions for MVI prediction. Heatmaps of weights in fully connected layers showed that the HBP contributed the most to MVI prediction. Our study firstly implemented self-attention and collaborative-attention to reveal the relationship between deep features and MVI, improving the clinical interpretation of prediction models. The clinical interpretability offers radiologists and clinicians more confidence to apply deep learning models in clinical practice, helping HCC patients formulate personalized therapies.

CT radiomics for prediction of microvascular invasion in hepatocellular carcinoma: A systematic review and meta-analysis

The power of computed tomography (CT) radiomics for preoperative prediction of microvascular invasion (MVI) in hepatocellular carcinoma (HCC) demonstrated in current research is variable. This systematic review and meta-analysis aim to evaluate the value of CT radiomics for MVI prediction in HCC, and to investigate the methodologic quality in the workflow of radiomics research. Databases of PubMed, Embase, Web of Science, and Cochrane Library were systematically searched. The methodologic quality of included studies was assessed. Validation data from studies with Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) statement type 2a or above were extracted for meta-analysis. Eleven studies were included, among which nine were eligible for meta-analysis. Radiomics quality scores of the enrolled eleven studies varied from 6 to 17, accounting for 16.7%-47.2% of the total points, with an average score of 14. Pooled sensitivity, specificity, and Area Under the summary receiver operator Characteristic Curve (AUC) were 0.82 (95% CI 0.77-0.86), 0.79 (95% CI 0.75-0.83), and 0.87 (95% CI 0.84-0.91) for the predictive performance of CT radiomics, respectively. Meta-regression and subgroup analyses showed radiomics model based on 3D tumor segmentation, and deep learning model achieved superior performances compared to 2D segmentation and non-deep learning model, respectively (AUC: 0.93 vs. 0.83, and 0.97 vs. 0.83, respectively). This study proves that CT radiomics could predict MVI in HCC. The heterogeneity of the included studies precludes a definition of the role of CT radiomics in predicting MVI, but methodology warrants uniformization in the radiology community regarding radiomics in HCC.

Mining Whole-liver Information with Deep Learning for Preoperatively Predicting HCC Recurrence-free Survival. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023;2023:1-4. [PMID: 38082797 DOI: 10.1109/embc40787.2023.10340426] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

Hepatocellular carcinoma (HCC) is globally a leading cause of cancer death. Non-invasive pre-operative prediction of HCC recurrence-free survival (RFS) after resection is essential but remains challenging. Previous models based on medical imaging focus only on tumor area while neglecting the whole liver condition. In fact, HCC patients usually suffer from chronic liver diseases which also hamper the patient survival. This work aims to develop a novel convolutional neural network (CNN) to mine whole-liver information from contrast-enhanced computed tomography (CECT) to predict RFS after hepatic resection in HCC. Our proposed RFSNet takes liver regions from CECT as input, and outputs a risk score for each patient. Cox proportional-hazards loss was applied for model training. A total of 215 patients with primary HCC and treated with hepatic resection were included for analysis. Patients were randomly split into developing subcohort and testing subcohort by 4:1. The developing subcohort was further split into the training subcohort and validation subcohort for model training. Baseline models were built with tumor region, radiomics features and/or clinical features the same as previous tumor-based approaches. Results showed that RFSNet achieved the best performance with concordance-indinces (CIs) of 0.88 and 0.65 for the developing and testing subcohorts, respectively. Adding clinical features did not improve RFSNet. Our findings suggest that the proposed RFSNet based on whole liver is able to extract more valuable information concerning RFS prognosis compared to features from only tumor and the clinical indicators.

Deep Learning Model Based on Contrast-Enhanced Computed Tomography Imaging to Predict Postoperative Early Recurrence after the Curative Resection of a Solitary Hepatocellular Carcinoma

We aimed to develop the deep learning (DL) predictive model for postoperative early recurrence (within 2 years) of hepatocellular carcinoma (HCC) based on contrast-enhanced computed tomography (CECT) imaging. This study included 543 patients who underwent initial hepatectomy for HCC and were randomly classified into training, validation, and test datasets at a ratio of 8:1:1. Several clinical variables and arterial CECT images were used to create predictive models for early recurrence. Artificial intelligence models were implemented using convolutional neural networks and multilayer perceptron as a classifier. Furthermore, the Youden index was used to discriminate between high- and low-risk groups. The importance values of each explanatory variable for early recurrence were calculated using permutation importance. The DL predictive model for postoperative early recurrence was developed with the area under the curve values of 0.71 (test datasets) and 0.73 (validation datasets). Postoperative early recurrence incidences in the high- and low-risk groups were 73% and 30%, respectively (p = 0.0057). Permutation importance demonstrated that among the explanatory variables, the variable with the highest importance value was CECT imaging analysis. We developed a DL model to predict postoperative early HCC recurrence. DL-based analysis is effective for determining the treatment strategies in patients with HCC.

MVI-TR: A Transformer-Based Deep Learning Model with Contrast-Enhanced CT for Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma

In this study, we considered preoperative prediction of microvascular invasion (MVI) status with deep learning (DL) models for patients with early-stage hepatocellular carcinoma (HCC) (tumor size ≤ 5 cm). Two types of DL models based only on venous phase (VP) of contrast-enhanced computed tomography (CECT) were constructed and validated. From our hospital (First Affiliated Hospital of Zhejiang University, Zhejiang, P.R. China), 559 patients, who had histopathological confirmed MVI status, participated in this study. All preoperative CECT were collected, and the patients were randomly divided into training and validation cohorts at a ratio of 4:1. We proposed a novel transformer-based end-to-end DL model, named MVI-TR, which is a supervised learning method. MVI-TR can capture features automatically from radiomics and perform MVI preoperative assessments. In addition, a popular self-supervised learning method, the contrastive learning model, and the widely used residual networks (ResNets family) were constructed for fair comparisons. With an accuracy of 99.1%, a precision of 99.3%, an area under the curve (AUC) of 0.98, a recalling rate of 98.8%, and an F1-score of 99.1% in the training cohort, MVI-TR achieved superior outcomes. Additionally, the validation cohort's MVI status prediction had the best accuracy (97.2%), precision (97.3%), AUC (0.935), recalling rate (93.1%), and F1-score (95.2%). MVI-TR outperformed other models for predicting MVI status, and showed great preoperative predictive value for early-stage HCC patients.

The utility of Vision Transformer in preoperatively predicting microvascular invasion status of hepatocellular carcinoma

BACKGROUND

Microvascular invasion (MVI) is a risk factor for early recurrence and poor prognosis of hepatocellular carcinoma (HCC). Preoperative assessment of MVI status is beneficial for clinical therapy and prognosis evaluation.

METHODS

A total of 305 surgically resected patients were included retrospectively. All recruited patients underwent plain and contrast-enhanced abdominal CT. They were then randomly divided into training and validation sets in a ratio of 8:2. Self-attention-based ViT-B/16 and ResNet-50 analyzed CT images to predict MVI status preoperatively. Then, Grad-CAM was used to generate an attention map showing the high-risk MVI patches. Using five-fold cross validation, the performance of each model was evaluated.

RESULTS

Among 305 HCC patients, 99 patients were pathologically MVI-positive and 206 were MVI-negative. ViT-B/16 with fusion phase predicted the MVI status with an AUC of 0.882 and an accuracy of 86.8% in the validation set, which is similar to ResNet-50 with an AUC of 0.875 and an accuracy of 87.2%. The fusion phase improved performance a bit as compared to the single phase used for MVI prediction. The influence of peritumoral tissue on predictive ability was limited. A color visualization of the suspicious patches where microvascular has invaded was presented by attention maps.

CONCLUSION

ViT-B/16 model can predict preoperative MVI status in CT images of HCC patients. Assisted by attention maps, it can assist patients in making tailored treatment decisions.

Performance of Radiomics in Microvascular Invasion Risk Stratification and Prognostic Assessment in Hepatocellular Carcinoma: A Meta-Analysis

BACKGROUND

Primary liver cancer is the sixth most commonly diagnosed cancer and the third leading cause of cancer death. Advances in phenomenal imaging are paving the way for application in diagnosis and research. The poor prognosis of advanced HCC warrants a personalized approach. The objective was to assess the value of imaging phenomics for risk stratification and prognostication of HCC.

METHODS

We performed a meta-analysis of manuscripts published to January 2023 on MEDLINE addressing the value of imaging phenomics for HCC risk stratification and prognostication. Publication information for each were collected using a standardized data extraction form.

RESULTS

Twenty-seven articles were analyzed. Our study shows the importance of imaging phenomics in HCC MVI prediction. When the training and validation datasets were analyzed separately by the random-effects model, in the training datasets, radiomics had good MVI prediction (AUC of 0.81 (95% CI 0.76-0.86)). Similar results were found in the validation datasets (AUC of 0.79 (95% CI 0.72-0.85)). Using the fixed effects model, the mean AUC of all datasets was 0.80 (95% CI 0.76-0.84).

CONCLUSIONS

Imaging phenomics is an effective solution to predict microvascular invasion risk, prognosis, and treatment response in patients with HCC.

Radiomics: A radiological evidence-based artificial intelligence technique to facilitate personalized precision medicine in hepatocellular carcinoma

The high postoperative recurrence rates in hepatocellular carcinoma (HCC) remain a major hurdle in its management. Appropriate staging and treatment selection may alleviate the extent of fatal recurrence. However, effective methods to preoperatively evaluate pathophysiologic and molecular characteristics of HCC are lacking. Imaging plays a central role in HCC diagnosis and stratification due to the non-invasive diagnostic criteria. Vast and crucial information is hidden within image data. Other than providing a morphological sketch for lesion diagnosis, imaging could provide new insights to describe the pathophysiological and genetic landscape of HCC. Radiomics aims to facilitate diagnosis and prognosis of HCC using artificial intelligence techniques to harness the immense information contained in medical images. Radiomics produces a set of archetypal and robust imaging features that are correlated to key pathological or molecular biomarkers to preoperatively risk-stratify HCC patients. Inferred with outcome data, comprehensive combination of radiomic, clinical and/or multi-omics data could also improve direct prediction of response to treatment and prognosis. The evolution of radiomics is changing our understanding of personalized precision medicine in HCC management. Herein, we review the key techniques and clinical applications in HCC radiomics and discuss current limitations and future opportunities to improve clinical decision making.

Quantitative analysis of artificial intelligence on liver cancer: A bibliometric analysis

Objective

To provide the current research progress, hotspots, and emerging trends for AI in liver cancer, we have compiled a relative comprehensive and quantitative report on the research of liver disease using artificial intelligence by employing bibliometrics in this study.

Methods

In this study, the Web of Science Core Collection (WoSCC) database was used to perform systematic searches using keywords and a manual screening strategy, VOSviewer was used to analyze the degree of cooperation between countries/regions and institutions, as well as the co-occurrence of cooperation between authors and cited authors. Citespace was applied to generate a dual map to analyze the relationship of citing journals and citied journals and conduct a strong citation bursts ranking analysis of references. Online SRplot was used for in-depth keyword analysis and Microsoft Excel 2019 was used to collect the targeted variables from retrieved articles.

Results

1724 papers were collected in this study, including 1547 original articles and 177 reviews. The study of AI in liver cancer mostly began from 2003 and has developed rapidly from 2017. China has the largest number of publications, and the United States has the highest H-index and total citation counts. The top three most productive institutions are the League of European Research Universities, Sun Yat Sen University, and Zhejiang University. Jasjit S. Suri and Frontiers in Oncology are the most published author and journal, respectively. Keyword analysis showed that in addition to the research on liver cancer, research on liver cirrhosis, fatty liver disease, and liver fibrosis were also common. Computed tomography was the most used diagnostic tool, followed by ultrasound and magnetic resonance imaging. The diagnosis and differential diagnosis of liver cancer are currently the most widely adopted research goals, and comprehensive analyses of multi-type data and postoperative analysis of patients with advanced liver cancer are rare. The use of convolutional neural networks is the main technical method used in studies of AI on liver cancer.

Conclusion

AI has undergone rapid development and has a wide application in the diagnosis and treatment of liver diseases, especially in China. Imaging is an indispensable tool in this filed. Mmulti-type data fusion analysis and development of multimodal treatment plans for liver cancer could become the major trend of future research in AI in liver cancer.

Preoperative and Prognostic Prediction of Microvascular Invasion in Hepatocellular Carcinoma: A Review Based on Artificial Intelligence

Microvascular invasion of hepatocellular carcinoma is an important factor affecting tumor recurrence after liver resection and liver transplantation. There are many ways to classify microvascular invasion, however, an international consensus is urgently needed. Recently, artificial intelligence has emerged as an important tool for improving the clinical management of hepatocellular carcinoma. Many studies about microvascular invasion currently focus on preoperative and prognosis prediction of microvascular invasion using artificial intelligence. In this paper, we review the definition and staging of microvascular invasion, especially the diagnosis of it by using artificial intelligence. In preoperative prediction, deep learning based on multimodal data modeling of radiomics-screened features, clinical features, and medical images is currently the most effective means. In prognostic prediction, pathology is the gold standard, and the techniques used should more effectively utilize the global features of the pathology images.

MVI-Mind: A Novel Deep-Learning Strategy Using Computed Tomography (CT)-Based Radiomics for End-to-End High Efficiency Prediction of Microvascular Invasion in Hepatocellular Carcinoma

Simple Summary

Microvascular invasion is an important indicator for reflecting the prognosis of hepatocellular carcinoma, but the traditional diagnosis requires a postoperative pathological examination. This study is the first to propose an end-to-end deep learning architecture for predicting microvascular invasion in hepatocellular carcinoma by collecting retrospective data. This method can achieve noninvasive, accurate and efficient preoperative prediction only through the patient’s radiomic data, which is very beneficial to doctors for clinical decision making in HCC patients.

Abstract

Microvascular invasion (MVI) in hepatocellular carcinoma (HCC) directly affects a patient’s prognosis. The development of preoperative noninvasive diagnostic methods is significant for guiding optimal treatment plans. In this study, we investigated 138 patients with HCC and presented a novel end-to-end deep learning strategy based on computed tomography (CT) radiomics (MVI-Mind), which integrates data preprocessing, automatic segmentation of lesions and other regions, automatic feature extraction, and MVI prediction. A lightweight transformer and a convolutional neural network (CNN) were proposed for the segmentation and prediction modules, respectively. To demonstrate the superiority of MVI-Mind, we compared the framework’s performance with that of current, mainstream segmentation, and classification models. The test results showed that MVI-Mind returned the best performance in both segmentation and prediction. The mean intersection over union (mIoU) of the segmentation module was 0.9006, and the area under the receiver operating characteristic curve (AUC) of the prediction module reached 0.9223. Additionally, it only took approximately 1 min to output a prediction for each patient, end-to-end using our computing device, which indicated that MVI-Mind could noninvasively, efficiently, and accurately predict the presence of MVI in HCC patients before surgery. This result will be helpful for doctors to make rational clinical decisions.

Phase Attention Model for Prediction of Early Recurrence of Hepatocellular Carcinoma With Multi-Phase CT Images and Clinical Data

Hepatocellular carcinoma (HCC) is a primary liver cancer that produces a high mortality rate. It is one of the most common malignancies worldwide, especially in Asia, Africa, and southern Europe. Although surgical resection is an effective treatment, patients with HCC are at risk of recurrence after surgery. Preoperative early recurrence prediction for patients with liver cancer can help physicians develop treatment plans and will enable physicians to guide patients in postoperative follow-up. However, the conventional clinical data based methods ignore the imaging information of patients. Certain studies have used radiomic models for early recurrence prediction in HCC patients with good results, and the medical images of patients have been shown to be effective in predicting the recurrence of HCC. In recent years, deep learning models have demonstrated the potential to outperform the radiomics-based models. In this paper, we propose a prediction model based on deep learning that contains intra-phase attention and inter-phase attention. Intra-phase attention focuses on important information of different channels and space in the same phase, whereas inter-phase attention focuses on important information between different phases. We also propose a fusion model to combine the image features with clinical data. Our experiment results prove that our fusion model has superior performance over the models that use clinical data only or the CT image only. Our model achieved a prediction accuracy of 81.2%, and the area under the curve was 0.869.