Noninvasive Evaluation of the Pathologic Grade of Hepatocellular Carcinoma Using MCF-3DCNN: A Pilot Study.Biomed Res Int. 2019;2019:9783106. [PMID: 31183380 DOI: 10.1155/2019/9783106]

Advanced Imaging of Hepatocellular Carcinoma: A Review of Current and Novel Techniques

Hepatocellular carcinoma (HCC) is the most common primary carcinoma arising from the liver. Although HCC can arise de novo, the vast majority of cases develop in the setting of chronic liver disease. Hepatocarcinogenesis follows a well-studied process during which chronic inflammation and cellular damage precipitate cellular and genetic aberrations, with subsequent propagation of precancerous and cancerous lesions. Surveillance of individuals at high risk of HCC, early diagnosis, and individualized treatment are keys to reducing the mortality associated with this disease. Radiological imaging plays a critical role in the diagnosis and management of these patients. HCC is a unique cancer in that it can be diagnosed with confidence by imaging that meets all radiologic criteria, obviating the risks associated with tissue sampling. This article discusses conventional and emerging imaging techniques for the evaluation of HCC.

Revisiting artificial intelligence diagnosis of hepatocellular carcinoma with DIKWH framework

Hepatocellular carcinoma (HCC) is the most common type of liver cancer with a high morbidity and fatality rate. Traditional diagnostic methods for HCC are primarily based on clinical presentation, imaging features, and histopathology. With the rapid development of artificial intelligence (AI), which is increasingly used in the diagnosis, treatment, and prognosis prediction of HCC, an automated approach to HCC status classification is promising. AI integrates labeled clinical data, trains on new data of the same type, and performs interpretation tasks. Several studies have shown that AI techniques can help clinicians and radiologists be more efficient and reduce the misdiagnosis rate. However, the coverage of AI technologies leads to difficulty in which the type of AI technology is preferred to choose for a given problem and situation. Solving this concern, it can significantly reduce the time required to determine the required healthcare approach and provide more precise and personalized solutions for different problems. In our review of research work, we summarize existing research works, compare and classify the main results of these according to the specified data, information, knowledge, wisdom (DIKW) framework.

Can a proposed double branch multimodality-contribution-aware TripNet improve the prediction performance of the microvascular invasion of hepatocellular carcinoma based on small samples?

OBJECTIVES

To evaluate the potential improvement of prediction performance of a proposed double branch multimodality-contribution-aware TripNet (MCAT) in microvascular invasion (MVI) of hepatocellular carcinoma (HCC) based on a small sample.

METHODS

In this retrospective study, 121 HCCs from 103 consecutive patients were included, with 44 MVI positive and 77 MVI negative, respectively. A MCAT model aiming to improve the accuracy of deep neural network and alleviate the negative effect of small sample size was proposed and the improvement of MCAT model was verified among comparisons between MCAT and other used deep neural networks including 2DCNN (two-dimentional convolutional neural network), ResNet (residual neural network) and SENet (squeeze-and-excitation network), respectively.

RESULTS

Through validation, the AUC value of MCAT is significantly higher than 2DCNN based on CT, MRI, and both imaging (P < 0.001 for all). The AUC value of model with single branch pretraining based on small samples is significantly higher than model with end-to-end training in CT branch and double branch (0.62 vs 0.69, p=0.016, 0.65 vs 0.83, p=0.010, respectively). The AUC value of the double branch MCAT based on both CT and MRI imaging (0.83) was significantly higher than that of the CT branch MCAT (0.69) and MRI branch MCAT (0.73) (P < 0.001, P = 0.03, respectively), which was also significantly higher than common-used ReNet (0.67) and SENet (0.70) model (P < 0.001, P = 0.005, respectively).

CONCLUSION

A proposed Double branch MCAT model based on a small sample can improve the effectiveness in comparison to other deep neural networks or single branch MCAT model, providing a potential solution for scenarios such as small-sample deep learning and fusion of multiple imaging modalities.

A Multimodality-Contribution-Aware TripNet for Histologic Grading of Hepatocellular Carcinoma

Hepatocellular carcinoma (HCC) is a type of primary liver malignant tumor with a high recurrence rate and poor prognosis even undergoing resection or transplantation. Accurate discrimination of the histologic grades of HCC plays a critical role in the management and therapy of HCC patients. In this paper, we discuss a deep learning-based diagnostic model for HCC histologic grading with multimodal Magnetic Resonance Imaging (MRI) images to overcome the problem of limited well-annotated data and extract the discriminated fusion feature referring to the clinical diagnosis experience of radiologists. Accordingly, we propose a novel Multimodality-Contribution-Aware TripNet (MCAT) based on the metric learning and the attention-aware weighted multimodal fusion. The novelty of the method lies in the multimodality small-shot learning architecture designation and the multimodality adaptive weighted computing scheme. The comprehensive experiments are done on the clinic dataset with the well-annotation of lesion location by the professional radiologist. The experimental results show that our proposed MCAT is not only able to achieve acceptable quantitative measuring of HCC histologic grading based on the MRI sequences with small cases but also outperforms previous models in HCC histologic grading, reaching an accuracy of 84 percent, a sensitivity of 87 percent and precision of 89 percent.

Assessment of Liver Function With MRI: Where Do We Stand?

Liver disease and hepatocellular carcinoma (HCC) have become a global health burden. For this reason, the determination of liver function plays a central role in the monitoring of patients with chronic liver disease or HCC. Furthermore, assessment of liver function is important, e.g., before surgery to prevent liver failure after hepatectomy or to monitor the course of treatment. Liver function and disease severity are usually assessed clinically based on clinical symptoms, biopsy, and blood parameters. These are rather static tests that reflect the current state of the liver without considering changes in liver function. With the development of liver-specific contrast agents for MRI, noninvasive dynamic determination of liver function based on signal intensity or using T1 relaxometry has become possible. The advantage of this imaging modality is that it provides additional information about the vascular structure, anatomy, and heterogeneous distribution of liver function. In this review, we summarized and discussed the results published in recent years on this technique. Indeed, recent data show that the T1 reduction rate seems to be the most appropriate value for determining liver function by MRI. Furthermore, attention has been paid to the development of automated tools for image analysis in order to uncover the steps necessary to obtain a complete process flow from image segmentation to image registration to image analysis. In conclusion, the published data show that liver function values obtained from contrast-enhanced MRI images correlate significantly with the global liver function parameters, making it possible to obtain both functional and anatomic information with a single modality.

Automatic discrimination of different sequences and phases of liver MRI using a dense feature fusion neural network: a preliminary study

PURPOSE

To develop and validate a dense feature fusion neural network (DFuNN) to automatically recognize different sequences and phases of liver magnetic resonance imaging (MRI).

MATERIALS AND METHODS

In total, 3869 sequences and phases from 384 liver MRI examinations, divided into training/validation (n = 2886 sequences from 287 patients) and test (n = 983 sequences from 97 patients) sets, were used in this retrospective study. Ten unenhanced sequences and enhanced phases were included. Manual sequence recognition, performed by two radiologists (20 and 10 years of experience) in a consensus reading, was used as the reference standard. The sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve (AUC) were calculated to evaluate the performance of the DFuNN on an identical unseen test set. Finally, we evaluated the factors impacting the model precision.

RESULTS

A fusion block improved the performance of the DFuNN. DFuNN with a fusion block achieved good recognition performance for both complete and incomplete sequences and phases in the test set. The average sensitivity of recognition performance for complete sequence and phase inputs ranged from 88.06 to 100%, the average specificity ranged from 99.12 to 99.94%, and the median accuracy ranged from 98.02 to 99.95%. The DFuNN prediction accuracy for patients without cirrhosis were significantly higher than those for patients with cirrhosis (P = 0.0153). No significant difference was found in the accuracy across other factors.

CONCLUSION

DFuNN can automatically and accurately identify specific unenhanced MRI sequences and enhanced MRI phases.

Application of artificial intelligence in preoperative imaging of hepatocellular carcinoma: Current status and future perspectives

Hepatocellular carcinoma (HCC) is the most common primary malignant liver tumor in China. Preoperative diagnosis of HCC is challenging because of atypical imaging manifestations and the diversity of focal liver lesions. Artificial intelligence (AI), such as machine learning (ML) and deep learning, has recently gained attention for its capability to reveal quantitative information on images. Currently, AI is used throughout the entire radiomics process and plays a critical role in multiple fields of medicine. This review summarizes the applications of AI in various aspects of preoperative imaging of HCC, including segmentation, differential diagnosis, prediction of histopathology, early detection of recurrence after curative treatment, and evaluation of treatment response. We also review the limitations of previous studies and discuss future directions for diagnostic imaging of HCC.

State of the Art in Artificial Intelligence and Radiomics in Hepatocellular Carcinoma

The most common liver malignancy is hepatocellular carcinoma (HCC), which is also associated with high mortality. Often HCC develops in a chronic liver disease setting, and early diagnosis as well as accurate screening of high-risk patients is crucial for appropriate and effective management of these patients. While imaging characteristics of HCC are well-defined in the diagnostic phase, challenging cases still occur, and current prognostic and predictive models are limited in their accuracy. Radiomics and machine learning (ML) offer new tools to address these issues and may lead to scientific breakthroughs with the potential to impact clinical practice and improve patient outcomes. In this review, we will present an overview of these technologies in the setting of HCC imaging across different modalities and a range of applications. These include lesion segmentation, diagnosis, prognostic modeling and prediction of treatment response. Finally, limitations preventing clinical application of radiomics and ML at the present time are discussed, together with necessary future developments to bring the field forward and outside of a purely academic endeavor.

A novel computer-aided diagnostic system for accurate detection and grading of liver tumors

Liver cancer is a major cause of morbidity and mortality in the world. The primary goals of this manuscript are the identification of novel imaging markers (morphological, functional, and anatomical/textural), and development of a computer-aided diagnostic (CAD) system to accurately detect and grade liver tumors non-invasively. A total of 95 patients with liver tumors (M = 65, F = 30, age range = 34–82 years) were enrolled in the study after consents were obtained. 38 patients had benign tumors (LR1 = 19 and LR2 = 19), 19 patients had intermediate tumors (LR3), and 38 patients had hepatocellular carcinoma (HCC) malignant tumors (LR4 = 19 and LR5 = 19). A multi-phase contrast-enhanced magnetic resonance imaging (CE-MRI) was collected to extract the imaging markers. A comprehensive CAD system was developed, which includes the following main steps: i) estimation of morphological markers using a new parametric spherical harmonic model, ii) estimation of textural markers using a novel rotation invariant gray-level co-occurrence matrix (GLCM) and gray-level run-length matrix (GLRLM) models, and iii) calculation of the functional markers by estimating the wash-in/wash-out slopes, which enable quantification of the enhancement characteristics across different CE-MR phases. These markers were subsequently processed using a two-stages random forest-based classifier to classify the liver tumor as benign, intermediate, or malignant and determine the corresponding grade (LR1, LR2, LR3, LR4, or LR5). The overall CAD system using all the identified imaging markers achieved a sensitivity of 91.8%±0.9%, specificity of 91.2%±1.9%, and F\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$_{1}$$\end{document}1 score of 0.91±0.01, using the leave-one-subject-out (LOSO) cross-validation approach. Importantly, the CAD system achieved overall accuracies of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$88\%\pm 5\%$$\end{document}88%±5%, 85%±2%, 78%±3%, 83%±4%, and 79%±3% in grading liver tumors into LR1, LR2, LR3, LR4, and LR5, respectively. In addition to LOSO, the developed CAD system was tested using randomly stratified 10-fold and 5-fold cross-validation approaches. Alternative classification algorithms, including support vector machine, naive Bayes classifier, k-nearest neighbors, and linear discriminant analysis all produced inferior results compared to the proposed two stage random forest classification model. These experiments demonstrate the feasibility of the proposed CAD system as a novel tool to objectively assess liver tumors based on the new comprehensive imaging markers. The identified imaging markers and CAD system can be used as a non-invasive diagnostic tool for early and accurate detection and grading of liver cancer.

Convolutional neural network for classifying primary liver cancer based on triple-phase CT and tumor marker information: a pilot study

PURPOSE

To develop convolutional neural network (CNN) models for differentiating intrahepatic cholangiocarcinoma (ICC) from hepatocellular carcinoma (HCC) and predicting histopathological grade of HCC.

MATERIALS AND METHODS

Preoperative computed tomography and tumor marker information of 617 primary liver cancer patients were retrospectively collected to develop CNN models categorizing tumors into three categories: moderately differentiated HCC (mHCC), poorly differentiated HCC (pHCC), and ICC, where the histopathological diagnoses were considered as ground truths. The models processed manually cropped tumor with and without tumor marker information (two-input and one-input models, respectively). Overall accuracy was assessed using a held-out dataset (10%). Area under the curve, sensitivity, and specificity for differentiating ICC from HCCs (mHCC + pHCC), and pHCC from mHCC were also evaluated. We assessed two radiologists' performance without tumor marker information as references (overall accuracy, sensitivity, and specificity). The two-input model was compared with the one-input model and radiologists using permutation tests.

RESULTS

The overall accuracy was 0.61, 0.60, 0.55, 0.53 for the two-input model, one-input model, radiologist 1, and radiologist 2, respectively. For differentiating pHCC from mHCC, the two-input model showed significantly higher specificity than radiologist 1 (0.68 [95% confidence interval: 0.50-0.83] vs 0.45 [95% confidence interval: 0.27-0.63]; p = 0.04).

CONCLUSION

Our CNN model with tumor marker information showed feasibility and potential for three-class classification within primary liver cancer.