Deep learning-based algorithm to detect primary hepatic malignancy in multiphase CT of patients at high risk for HCC

Artificial intelligence in hepatocellular carcinoma diagnosis: a comprehensive review of current literature

BACKGROUND AND AIM

Hepatocellular carcinoma (HCC) diagnosis mainly relies on its pathognomonic radiological profile, obviating the need for biopsy. The project of incorporating artificial intelligence (AI) techniques in HCC aims to improve the performance of image recognition. Herein, we thoroughly analyze and evaluate proposed AI models in the field of HCC diagnosis.

METHODS

A comprehensive review of the literature was performed utilizing MEDLINE/PubMed and Web of Science databases with the end of search date being the 30th of September 2023. The MESH terms "Artificial Intelligence," "Liver Cancer," "Hepatocellular Carcinoma," "Machine Learning," and "Deep Learning" were searched in the title and/or abstract. All references of the obtained articles were also evaluated for any additional information.

RESULTS

Our search resulted in 183 studies meeting our inclusion criteria. Across all diagnostic modalities, reported area under the curve (AUC) of most developed models surpassed 0.900. A B-mode US and a contrast-enhanced US model achieved AUCs of 0.947 and 0.957, respectively. Regarding the more challenging task of HCC diagnosis, a 2021 deep learning model, trained with CT scans, classified hepatic malignant lesions with an AUC of 0.986. Finally, a MRI machine learning model developed in 2021 displayed an AUC of 0.975 when differentiating small HCCs from benign lesions, while another MRI-based model achieved HCC diagnosis with an AUC of 0.970.

CONCLUSIONS

AI tools may lead to significant improvement in diagnostic management of HCC. Many models fared better or comparable to experienced radiologists while proving capable of elevating radiologists' accuracy, demonstrating promising results for AI implementation in HCC-related diagnostic tasks.

Leveraging radiomics and AI for precision diagnosis and prognostication of liver malignancies

Liver tumors, whether primary or metastatic, have emerged as a growing concern with substantial global health implications. Timely identification and characterization of liver tumors are pivotal factors in order to provide optimum treatment. Imaging is a crucial part of the detection of liver tumors; however, conventional imaging has shortcomings in the proper characterization of these tumors which leads to the need for tissue biopsy. Artificial intelligence (AI) and radiomics have recently emerged as investigational opportunities with the potential to enhance the detection and characterization of liver lesions. These advancements offer opportunities for better diagnostic accuracy, prognostication, and thereby improving patient care. In particular, these techniques have the potential to predict the histopathology, genotype, and immunophenotype of tumors based on imaging data, hence providing guidance for personalized treatment of such tumors. In this review, we outline the progression and potential of AI in the field of liver oncology imaging, specifically emphasizing manual radiomic techniques and deep learning-based representations. We discuss how these tools can aid in clinical decision-making challenges. These challenges encompass a broad range of tasks, from prognosticating patient outcomes, differentiating benign treatment-related factors and actual disease progression, recognizing uncommon response patterns, and even predicting the genetic and molecular characteristics of the tumors. Lastly, we discuss the pitfalls, technical limitations and future direction of these AI-based techniques.

Application of artificial intelligence radiomics in the diagnosis, treatment, and prognosis of hepatocellular carcinoma

Hepatocellular carcinoma (HCC) is the most common type of primary liver cancer, with an increasing incidence and poor prognosis. In the past decade, artificial intelligence (AI) technology has undergone rapid development in the field of clinical medicine, bringing the advantages of efficient data processing and accurate model construction. Promisingly, AI-based radiomics has played an increasingly important role in the clinical decision-making of HCC patients, providing new technical guarantees for prediction, diagnosis, and prognostication. In this review, we evaluated the current landscape of AI radiomics in the management of HCC, including its diagnosis, individual treatment, and survival prognosis. Furthermore, we discussed remaining challenges and future perspectives regarding the application of AI radiomics in HCC.

Artificial Intelligence in Liver Diseases: Recent Advances

Liver diseases cause a significant burden on public health worldwide. In spite of great advances during recent years, there are still many challenges in the diagnosis and treatment of liver diseases. During recent years, artificial intelligence (AI) has been widely used for the diagnosis, risk stratification, and prognostic prediction of various diseases based on clinical datasets and medical images. Accumulative studies have shown its performance for diagnosing patients with nonalcoholic fatty liver disease and liver fibrosis and assessing their severity, and for predicting treatment response and recurrence of hepatocellular carcinoma, outcomes of liver transplantation recipients, and risk of drug-induced liver injury. Herein, we aim to comprehensively summarize the current evidence regarding diagnostic, prognostic, and/or therapeutic role of AI in these common liver diseases.

Deep Learning Methods in Medical Image-Based Hepatocellular Carcinoma Diagnosis: A Systematic Review and Meta-Analysis

(1) Background: The aim of our research was to systematically review papers specifically focused on the hepatocellular carcinoma (HCC) diagnostic performance of DL methods based on medical images. (2) Materials: To identify related studies, a comprehensive search was conducted in prominent databases, including Embase, IEEE, PubMed, Web of Science, and the Cochrane Library. The search was limited to studies published before 3 July 2023. The inclusion criteria consisted of studies that either developed or utilized DL methods to diagnose HCC using medical images. To extract data, binary information on diagnostic accuracy was collected to determine the outcomes of interest, namely, the sensitivity, specificity, and area under the curve (AUC). (3) Results: Among the forty-eight initially identified eligible studies, thirty studies were included in the meta-analysis. The pooled sensitivity was 89% (95% CI: 87-91), the specificity was 90% (95% CI: 87-92), and the AUC was 0.95 (95% CI: 0.93-0.97). Analyses of subgroups based on medical image methods (contrast-enhanced and non-contrast-enhanced images), imaging modalities (ultrasound, magnetic resonance imaging, and computed tomography), and comparisons between DL methods and clinicians consistently showed the acceptable diagnostic performance of DL models. The publication bias and high heterogeneity observed between studies and subgroups can potentially result in an overestimation of the diagnostic accuracy of DL methods in medical imaging. (4) Conclusions: To improve future studies, it would be advantageous to establish more rigorous reporting standards that specifically address the challenges associated with DL research in this particular field.

Slice-Fusion: Reducing False Positives in Liver Tumor Detection for Mask R-CNN

Automatic liver tumor detection from computed tomography (CT) makes clinical examinations more accurate. However, deep learning-based detection algorithms are characterized by high sensitivity and low precision, which hinders diagnosis given that false-positive tumors must first be identified and excluded. These false positives arise because detection models incorrectly identify partial volume artifacts as lesions, which in turn stems from the inability to learn the perihepatic structure from a global perspective. To overcome this limitation, we propose a novel slice-fusion method in which mining the global structural relationship between the tissues in the target CT slices and fusing the features of adjacent slices according to the importance of the tissues. Furthermore, we design a new network based on our slice-fusion method and Mask R-CNN detection model, called Pinpoint-Net. We evaluated proposed model on the Liver Tumor Segmentation Challenge (LiTS) dataset and our liver metastases dataset. Experiments demonstrated that our slice-fusion method not only enhance tumor detection ability via reducing the number of false-positive tumors smaller than 10mm, but also improve segmentation performance. Without bells and whistles, a single Pinpoint-Net showed outstanding performance in liver tumor detection and segmentation on LiTS test dataset compared with other state-of-the-art models.

Spatiotemporal Excitation Module-based CNN for Diagnosis of Hepatic Malignancy in Four-phase CT Images

Liver cancer is a part of the common causes of cancer death worldwide, and the accurate diagnosis of hepatic malignancy is important for effective next treatment. In this paper, we propose a convolutional neural network (CNN) based on a spatiotemporal excitation (STE) module for identification of hepatic malignancy in four-phase computed tomography (CT) images. To enhance the display detail of lesion, we expand single-channel CT images into three channels by using the channel expansion method. Our proposed STE module consists of a spatial excitation (SE) module and a temporal interaction (TI) module. The SE module calculates the temporal differences of CT slices at the feature level, which is used to excite shape-sensitive channels of the lesion features. The TI module shifts a portion of the channels in the temporal dimension to exchange information among the current CT slice and adjacent CT slices. Four-phase CT images of 398 patients diagnosed with hepatocellular carcinoma (HCC) and intrahepatic cholangiocarcinoma (ICC) are used for experiments and five cross-validations are performed. Our model achieved average accuracy of 85.00% and average AUC of 88.91% for classifying HCC and ICC.Clinical Relevance- The proposed deep learning-based model can perform HCC and ICC recognition tasks based on four-phase CT images, assisting doctors to obtain better diagnostic performance.

Deep learning techniques in liver tumour diagnosis using CT and MR imaging - A systematic review

Deep learning has become a thriving force in the computer aided diagnosis of liver cancer, as it solves extremely complicated challenges with high accuracy over time and facilitates medical experts in their diagnostic and treatment procedures. This paper presents a comprehensive systematic review on deep learning techniques applied for various applications pertaining to liver images, challenges faced by the clinicians in liver tumour diagnosis and how deep learning bridges the gap between clinical practice and technological solutions with an in-depth summary of 113 articles. Since, deep learning is an emerging revolutionary technology, recent state-of-the-art research implemented on liver images are reviewed with more focus on classification, segmentation and clinical applications in the management of liver diseases. Additionally, similar review articles in literature are reviewed and compared. The review is concluded by presenting the contemporary trends and unaddressed research issues in the field of liver tumour diagnosis, offering directions for future research in this field.

Liver Transplant in Patients with Hepatocarcinoma: Imaging Guidelines and Future Perspectives Using Artificial Intelligence

Hepatocellular carcinoma is the most common primary malignant hepatic tumor and occurs most often in the setting of chronic liver disease. Liver transplantation is a curative treatment option and is an ideal solution because it solves the chronic underlying liver disorder while removing the malignant lesion. However, due to organ shortages, this treatment can only be applied to carefully selected patients according to clinical guidelines. Artificial intelligence is an emerging technology with multiple applications in medicine with a predilection for domains that work with medical imaging, like radiology. With the help of these technologies, laborious tasks can be automated, and new lesion imaging criteria can be developed based on pixel-level analysis. Our objectives are to review the developing AI applications that could be implemented to better stratify liver transplant candidates. The papers analysed applied AI for liver segmentation, evaluation of steatosis, sarcopenia assessment, lesion detection, segmentation, and characterization. A liver transplant is an optimal treatment for patients with hepatocellular carcinoma in the setting of chronic liver disease. Furthermore, AI could provide solutions for improving the management of liver transplant candidates to improve survival.

Radiomics: A radiological evidence-based artificial intelligence technique to facilitate personalized precision medicine in hepatocellular carcinoma

The high postoperative recurrence rates in hepatocellular carcinoma (HCC) remain a major hurdle in its management. Appropriate staging and treatment selection may alleviate the extent of fatal recurrence. However, effective methods to preoperatively evaluate pathophysiologic and molecular characteristics of HCC are lacking. Imaging plays a central role in HCC diagnosis and stratification due to the non-invasive diagnostic criteria. Vast and crucial information is hidden within image data. Other than providing a morphological sketch for lesion diagnosis, imaging could provide new insights to describe the pathophysiological and genetic landscape of HCC. Radiomics aims to facilitate diagnosis and prognosis of HCC using artificial intelligence techniques to harness the immense information contained in medical images. Radiomics produces a set of archetypal and robust imaging features that are correlated to key pathological or molecular biomarkers to preoperatively risk-stratify HCC patients. Inferred with outcome data, comprehensive combination of radiomic, clinical and/or multi-omics data could also improve direct prediction of response to treatment and prognosis. The evolution of radiomics is changing our understanding of personalized precision medicine in HCC management. Herein, we review the key techniques and clinical applications in HCC radiomics and discuss current limitations and future opportunities to improve clinical decision making.

The Role of Radiomics and AI Technologies in the Segmentation, Detection, and Management of Hepatocellular Carcinoma

Hepatocellular carcinoma (HCC) is the most common primary hepatic neoplasm. Thanks to recent advances in computed tomography (CT) and magnetic resonance imaging (MRI), there is potential to improve detection, segmentation, discrimination from HCC mimics, and monitoring of therapeutic response. Radiomics, artificial intelligence (AI), and derived tools have already been applied in other areas of diagnostic imaging with promising results. In this review, we briefly discuss the current clinical applications of radiomics and AI in the detection, segmentation, and management of HCC. Moreover, we investigate their potential to reach a more accurate diagnosis of HCC and to guide proper treatment planning.

Artificial Intelligence in the Diagnosis of Hepatocellular Carcinoma: A Systematic Review

Hepatocellular carcinoma ranks fifth amongst the most common malignancies and is the third most common cause of cancer-related death globally. Artificial Intelligence is a rapidly growing field of interest. Following the PRISMA reporting guidelines, we conducted a systematic review to retrieve articles reporting the application of AI in HCC detection and characterization. A total of 27 articles were included and analyzed with our composite score for the evaluation of the quality of the publications. The contingency table reported a statistically significant constant improvement over the years of the total quality score (p = 0.004). Different AI methods have been adopted in the included articles correlated with 19 articles studying CT (41.30%), 20 studying US (43.47%), and 7 studying MRI (15.21%). No article has discussed the use of artificial intelligence in PET and X-ray technology. Our systematic approach has shown that previous works in HCC detection and characterization have assessed the comparability of conventional interpretation with machine learning using US, CT, and MRI. The distribution of the imaging techniques in our analysis reflects the usefulness and evolution of medical imaging for the diagnosis of HCC. Moreover, our results highlight an imminent need for data sharing in collaborative data repositories to minimize unnecessary repetition and wastage of resources.

A flexible three‐dimensional heterophase computed tomography hepatocellular carcinoma detection algorithm for generalizable and practical screening

Hepatocellular carcinoma (HCC) can be potentially discovered from abdominal computed tomography (CT) studies under varied clinical scenarios (e.g., fully dynamic contrast‐enhanced [DCE] studies, noncontrast [NC] plus venous phase [VP] abdominal studies, or NC‐only studies). Each scenario presents its own clinical challenges that could benefit from computer‐aided detection (CADe) tools. We investigate whether a single CADe model can be made flexible enough to handle different contrast protocols and whether this flexibility imparts performance gains. We developed a flexible three‐dimensional deep algorithm, called heterophase volumetric detection (HPVD), that can accept any combination of contrast‐phase inputs with adjustable sensitivity depending on the clinical purpose. We trained HPVD on 771 DCE CT scans to detect HCCs and evaluated it on 164 positives and 206 controls. We compared performance against six clinical readers, including two radiologists, two hepatopancreaticobiliary surgeons, and two hepatologists. The area under the curve of the localization receiver operating characteristic for NC‐only, NC plus VP, and full DCE CT yielded 0.71 (95% confidence interval [CI], 0.64–0.77), 0.81 (95% CI, 0.75–0.87), and 0.89 (95% CI, 0.84–0.93), respectively. At a high‐sensitivity operating point of 80% on DCE CT, HPVD achieved 97% specificity, which is comparable to measured physician performance. We also demonstrated performance improvements over more typical and less flexible nonheterophase detectors. Conclusion: A single deep‐learning algorithm can be effectively applied to diverse HCC detection clinical scenarios, indicating that HPVD could serve as a useful clinical aid for at‐risk and opportunistic HCC surveillance.

Deep Learning Model With Convolutional Neural Network for Detecting and Segmenting Hepatocellular Carcinoma in CT: A Preliminary Study

Introduction

Hepatocellular carcinoma (HCC) is one of the most common malignancies in the world. Early detection and accurate diagnosis of HCC play an important role in patient management. This study aimed to develop a convolutional neural network-based model to identify and segment HCC lesions utilizing dynamic contrast agent-enhanced computed tomography (CT).

Methods

This retrospective study used CT image sets of histopathology-confirmed hepatocellular carcinoma over three phases (arterial, venous, and delayed). The proposed convolutional neural network (CNN) segmentation method was based on the U-Net architecture and trained using the domain adaptation technique. The proposed method was evaluated using 115 liver masses of 110 patients (87 men and 23 women; mean age, 56.9 years ± 11.9 (SD); mean mass size, 6.0 cm ± 3.6). The sensitivity for identifying HCC of the model and Dice score for segmentation of liver masses between radiologists and the CNN model were calculated for the test set.

Results

The sensitivity for HCC identification of the model was 100%. The median Dice score for HCC segmenting between radiologists and the CNN model was 0.81 for the test set.

Conclusion

Deep learning with CNN had high performance in the identification and segmentation of HCC on dynamic CT.

Segmentation of liver tumors with abdominal computed tomography using fully convolutional networks

BACKGROUND

Dividing liver organs or lesions depicting on computed tomography (CT) images could be applied to help tumor staging and treatment. However, most existing image segmentation technologies use manual or semi-automatic analysis, making the analysis process costly and time-consuming.

OBJECTIVE

This research aims to develop and apply a deep learning network architecture to segment liver tumors automatically after fine tuning parameters.

METHODS AND MATERIALS

The medical imaging is obtained from the International Symposium on Biomedical Imaging (ISBI), which includes 3D abdominal CT scans of 131 patients diagnosed with liver tumors. From these CT scans, there are 7,190 2D CT images along with the labeled binary images. The labeled binary images are regarded as gold standard for evaluation of the segmented results by FCN (Fully Convolutional Network). The backbones of FCN are extracted from Xception, InceptionresNetv2, MobileNetv2, ResNet18, ResNet50 in this study. Meanwhile, the parameters including optimizers (SGDM and ADAM), size of epoch, and size of batch are investigated. CT images are randomly divided into training and testing sets using a ratio of 9:1. Several evaluation indices including Global Accuracy, Mean Accuracy, Mean IoU (Intersection over Union), Weighted IoU and Mean BF Score are applied to evaluate tumor segmentation results in the testing images.

RESULTS

The Global Accuracy, Mean Accuracy, Mean IoU, Weighted IoU, and Mean BF Scores are 0.999, 0.969, 0.954, 0.998, 0.962 using ResNet50 in FCN with optimizer SGDM, batch size 12, and epoch 9. It is important to fine tuning the parameters in FCN model. Top 20 FNC models enable to achieve higher tumor segmentation accuracy with Mean IoU over 0.900. The occurred frequency of InceptionresNetv2, MobileNetv2, ResNet18, ResNet50, and Xception are 9, 6, 3, 5, and 2 times. Therefore, the InceptionresNetv2 has higher performance than others.

CONCLUSIONS

This study develop and test an automated liver tumor segmentation model based on FCN. Study results demonstrate that many deep learning models including InceptionresNetv2, MobileNetv2, ResNet18, ResNet50, and Xception have high potential to segment liver tumors from CT images with accuracy exceeding 90%. However, it is still difficult to accurately segment tiny and small size tumors by FCN models.

Predicting the Initial Treatment Response to Transarterial Chemoembolization in Intermediate-Stage Hepatocellular Carcinoma by the Integration of Radiomics and Deep Learning

Objectives

We aimed to develop radiology-based models for the preoperative prediction of the initial treatment response to transarterial chemoembolization (TACE) in patients with hepatocellular carcinoma (HCC) since the integration of radiomics and deep learning (DL) has not been reported for TACE.

Methods

Three hundred and ten intermediate-stage HCC patients who underwent TACE were recruited from three independent medical centers. Based on computed tomography (CT) images, recursive feature elimination (RFE) was used to select the most useful radiomics features. Five radiomics conventional machine learning (cML) models and a DL model were used for training and validation. Mutual correlations between each model were analyzed. The accuracies of integrating clinical variables, cML, and DL models were then evaluated.

Results

Good predictive accuracies were showed across the two cohorts in the five cML models, especially the random forest algorithm (AUC = 0.967 and 0.964, respectively). DL showed high accuracies in the training and validation cohorts (AUC = 0.981 and 0.972, respectively). Significant mutual correlations were revealed between tumor size and the five cML models and DL model (each P < 0.001). The highest accuracies were achieved by integrating DL and the random forest algorithm in the training and validation cohorts (AUC = 0.995 and 0.994, respectively).

Conclusion

The radiomics cML models and DL model showed notable accuracy for predicting the initial response to TACE treatment. Moreover, the integrated model could serve as a novel and accurate method for prediction in intermediate-stage HCC.

Artificial intelligence in gastroenterology: A state-of-the-art review

The development of artificial intelligence (AI) has increased dramatically in the last 20 years, with clinical applications progressively being explored for most of the medical specialties. The field of gastroenterology and hepatology, substantially reliant on vast amounts of imaging studies, is not an exception. The clinical applications of AI systems in this field include the identification of premalignant or malignant lesions (e.g., identification of dysplasia or esophageal adenocarcinoma in Barrett’s esophagus, pancreatic malignancies), detection of lesions (e.g., polyp identification and classification, small-bowel bleeding lesion on capsule endoscopy, pancreatic cystic lesions), development of objective scoring systems for risk stratification, predicting disease prognosis or treatment response [e.g., determining survival in patients post-resection of hepatocellular carcinoma), determining which patients with inflammatory bowel disease (IBD) will benefit from biologic therapy], or evaluation of metrics such as bowel preparation score or quality of endoscopic examination. The objective of this comprehensive review is to analyze the available AI-related studies pertaining to the entirety of the gastrointestinal tract, including the upper, middle and lower tracts; IBD; the hepatobiliary system; and the pancreas, discussing the findings and clinical applications, as well as outlining the current limitations and future directions in this field.