Deep learning LI-RADS grading system based on contrast enhanced multiphase MRI for differentiation between LR-3 and LR-4/LR-5 liver tumors

Artificial intelligence for detection and characterization of focal hepatic lesions: a review

Focal liver lesions (FLL) are common incidental findings in abdominal imaging. While the majority of FLLs are benign and asymptomatic, some can be malignant or pre-malignant, and need accurate detection and classification. Current imaging techniques, such as computed tomography (CT) and magnetic resonance imaging (MRI), play a crucial role in assessing these lesions. Artificial intelligence (AI), particularly deep learning (DL), offers potential solutions by analyzing large data to identify patterns and extract clinical features that aid in the early detection and classification of FLLs. This manuscript reviews the diagnostic capacity of AI-based algorithms in processing CT and MRIs to detect benign and malignant FLLs, with an emphasis in the characterization and classification of these lesions and focusing on differentiating benign from pre-malignant and potentially malignant lesions. A comprehensive literature search from January 2010 to April 2024 identified 45 relevant studies. The majority of AI systems employed convolutional neural networks (CNNs), with expert radiologists providing reference standards through manual lesion delineation, and histology as the gold standard. The studies reviewed indicate that AI-based algorithms demonstrate high accuracy, sensitivity, specificity, and AUCs in detecting and characterizing FLLs. These algorithms excel in differentiating between benign and malignant lesions, optimizing diagnostic protocols, and reducing the needs of invasive procedures. Future research should concentrate on the expansion of data sets, the improvement of model explainability, and the validation of AI tools across a range of clinical setting to ensure the applicability and reliability of such tools.

The power of deep learning in simplifying feature selection for hepatocellular carcinoma: a review

BACKGROUND

Hepatocellular Carcinoma (HCC) is a highly aggressive, prevalent, and deadly type of liver cancer. With the advent of deep learning techniques, significant advancements have been made in simplifying and optimizing the feature selection process.

OBJECTIVE

Our scoping review presents an overview of the various deep learning models and algorithms utilized to address feature selection for HCC. The paper highlights the strengths and limitations of each approach, along with their potential applications in clinical practice. Additionally, it discusses the benefits of using deep learning to identify relevant features and their impact on the accuracy and efficiency of diagnosis, prognosis, and treatment of HCC.

DESIGN

The review encompasses a comprehensive analysis of the research conducted in the past few years, focusing on the methodologies, datasets, and evaluation metrics adopted by different studies. The paper aims to identify the key trends and advancements in the field, shedding light on the promising areas for future research and development.

RESULTS

The findings of this review indicate that deep learning techniques have shown promising results in simplifying feature selection for HCC. By leveraging large-scale datasets and advanced neural network architectures, these methods have demonstrated improved accuracy and robustness in identifying predictive features.

CONCLUSIONS

We analyze published studies to reveal the state-of-the-art HCC prediction and showcase how deep learning can boost accuracy and decrease false positives. But we also acknowledge the challenges that remain in translating this potential into clinical reality.

Artificial intelligence techniques in liver cancer

Hepatocellular Carcinoma (HCC), the most common primary liver cancer, is a significant contributor to worldwide cancer-related deaths. Various medical imaging techniques, including computed tomography, magnetic resonance imaging, and ultrasound, play a crucial role in accurately evaluating HCC and formulating effective treatment plans. Artificial Intelligence (AI) technologies have demonstrated potential in supporting physicians by providing more accurate and consistent medical diagnoses. Recent advancements have led to the development of AI-based multi-modal prediction systems. These systems integrate medical imaging with other modalities, such as electronic health record reports and clinical parameters, to enhance the accuracy of predicting biological characteristics and prognosis, including those associated with HCC. These multi-modal prediction systems pave the way for predicting the response to transarterial chemoembolization and microvascular invasion treatments and can assist clinicians in identifying the optimal patients with HCC who could benefit from interventional therapy. This paper provides an overview of the latest AI-based medical imaging models developed for diagnosing and predicting HCC. It also explores the challenges and potential future directions related to the clinical application of AI techniques.

Enhancement Pattern Mapping for Early Detection of Hepatocellular Carcinoma in Patients with Cirrhosis

Background and Aims

Limited methods exist to accurately characterize the risk of malignant progression of liver lesions. Enhancement pattern mapping (EPM) measures voxel-based root mean square deviation (RMSD) of parenchyma and the contrast-to-noise (CNR) ratio enhances in malignant lesions. This study investigates the utilization of EPM to differentiate between HCC versus cirrhotic parenchyma with and without benign lesions.

Methods

Patients with cirrhosis undergoing MRI surveillance were studied prospectively. Cases (n=48) were defined as patients with LI-RADS 3 and 4 lesions who developed HCC during surveillance. Controls (n=99) were patients with and without LI-RADS 3 and 4 lesions who did not develop HCC. Manual and automated EPM signals of liver parenchyma between cases and controls were quantitatively validated on an independent patient set using cross validation with manual methods avoiding parenchyma with artifacts or blood vessels.

Results

With manual EPM, RMSD of 0.37 was identified as a cutoff for distinguishing lesions that progress to HCC from background parenchyma with and without lesions on pre-diagnostic scans (median time interval 6.8 months) with an area under the curve (AUC) of 0.83 (CI: 0.73-0.94) and a sensitivity, specificity, and accuracy of 0.65, 0.97, and 0.89, respectively. At the time of diagnostic scans, a sensitivity, specificity, and accuracy of 0.79, 0.93, and 0.88 were achieved with manual EPM with an AUC of 0.89 (CI: 0.82-0.96). EPM RMSD signals of background parenchyma that did not progress to HCC in cases and controls were similar (case EPM: 0.22 ± 0.08, control EPM: 0.22 ± 0.09, p=0.8). Automated EPM produced similar quantitative results and performance.

Conclusion

With manual EPM, a cutoff of 0.37 identifies quantifiable differences between HCC cases and controls approximately six months prior to diagnosis of HCC with an accuracy of 89%.

Deep learning approach for discrimination of liver lesions using nine time-phase images of contrast-enhanced ultrasound

PURPOSE

Contrast-enhanced ultrasound (CEUS) shows different enhancement patterns depending on the time after administration of the contrast agent. The aim of this study was to evaluate the diagnostic performance of liver nodule characterization using our proposed deep learning model with input of nine CEUS images.

METHODS

A total of 181 liver lesions (48 benign, 78 hepatocellular carcinoma (HCC), and 55 non-HCC malignant) were included in this prospective study. CEUS were performed using the contrast agent Sonazoid, and in addition to B-mode images before injection, image clips were stored every minute up to 10 min. A deep learning model was developed by arranging three ResNet50 transfer learning models in parallel. This proposed model allowed inputting up to nine datasets of different phases of CEUS and performing image augmentation of nine images synchronously. Using the results, the correct prediction rate, sensitivity, and specificity between "benign" and "malignant" cases were analyzed for each combination of the time phase. These accuracy values were also compared with the washout score judged by a human.

RESULTS

The proposed model showed performance superior to the referential standard model when the dataset from B-mode to the 10-min images were used (sensitivity: 93.2%, specificity: 65.3%, average correct answer rate: 60.1%). It also maintained 90.2% sensitivity and 61.2% specificity even when the dataset was limited to 2 min after injection, and this accuracy was equivalent to or better than human scoring by experts.

CONCLUSION

Our proposed model has the potential to identify tumor types earlier than the Kupffer phase, but at the same time, machine learning confirmed that Kupffer-phase Sonazoid images contain essential information for the classification of liver nodules.

Deep learning-assisted LI-RADS grading and distinguishing hepatocellular carcinoma (HCC) from non-HCC based on multiphase CT: a two-center study

OBJECTIVES

To develop a deep learning (DL) method that can determine the Liver Imaging Reporting and Data System (LI-RADS) grading of high-risk liver lesions and distinguish hepatocellular carcinoma (HCC) from non-HCC based on multiphase CT.

METHODS

This retrospective study included 1049 patients with 1082 lesions from two independent hospitals that were pathologically confirmed as HCC or non-HCC. All patients underwent a four-phase CT imaging protocol. All lesions were graded (LR 4/5/M) by radiologists and divided into an internal (n = 886) and external cohort (n = 196) based on the examination date. In the internal cohort, Swin-Transformer based on different CT protocols were trained and tested for their ability to LI-RADS grading and distinguish HCC from non-HCC, and then validated in the external cohort. We further developed a combined model with the optimal protocol and clinical information for distinguishing HCC from non-HCC.

RESULTS

In the test and external validation cohorts, the three-phase protocol without pre-contrast showed κ values of 0.6094 and 0.4845 for LI-RADS grading, and its accuracy was 0.8371 and 0.8061, while the accuracy of the radiologist was 0.8596 and 0.8622, respectively. The AUCs in distinguishing HCC from non-HCC were 0.865 and 0.715 in the test and external validation cohorts, while those of the combined model were 0.887 and 0.808.

CONCLUSION

The Swin-Transformer based on three-phase CT protocol without pre-contrast could feasibly simplify LI-RADS grading and distinguish HCC from non-HCC. Furthermore, the DL model have the potential in accurately distinguishing HCC from non-HCC using imaging and highly characteristic clinical data as inputs.

CLINICAL RELEVANCE STATEMENT

The application of deep learning model for multiphase CT has proven to improve the clinical applicability of the Liver Imaging Reporting and Data System and provide support to optimize the management of patients with liver diseases.

KEY POINTS

• Deep learning (DL) simplifies LI-RADS grading and helps distinguish hepatocellular carcinoma (HCC) from non-HCC. • The Swin-Transformer based on the three-phase CT protocol without pre-contrast outperformed other CT protocols. • The Swin-Transformer provide help in distinguishing HCC from non-HCC by using CT and characteristic clinical information as inputs.

Assessment of LI-RADS efficacy in classification of hepatocellular carcinoma and benign liver nodules using DCE-MRI features and machine learning

Purpose

The current study aimed to evaluate the efficiency of dynamic contrast-enhanced (DCE) MRI visual features in classifying benign liver nodules and hepatocellular carcinoma (HCC) using a machine learning model.

Methods

115 LI-RADS3, 137 LI-RADS4, and 140 LI-RADS5 nodules were included (392 nodules from 245 patients), which were evaluated by follow-up imaging for LR-3 and pathology results for LR-4 and LR-5 nodules. Data was collected retrospectively from 3 T and 1.5 T MRI scanners. All the lesions were categorized into 124 benign and 268 HCC lesions. Visual features included tumor size, arterial-phase hyper-enhancement (APHE), washout, lesion segment, mass/mass-like, and capsule presence. Gini-importance method extracted the most important features to prevent over-fitting. Final dataset was split into training(70%), validation(10%), and test dataset(20%). The SVM model was used to train the classifying algorithm. For model validation, 5-fold cross-validation was utilized, and the test data set was used to assess the final accuracy. The area under the curve and receiver operating characteristic curves were used to assess the performance of the classifier model.

Results

For test dataset, the accuracy, sensitivity, and specificity values for classifying benign and HCC lesions were 82%,84%, and 81%, respectively. APHE, washout, tumor size, and mass/mass-like features significantly differentiated benign and HCC lesions with p-value < .001.

Conclusions

The developed classification model employing DCE-MRI features showed significant performance of visual features in classifying benign and HCC lesions. Our study also highlighted the significance of mass and mass-like features in addition to LI-RADS categorization. For future work, this study suggests developing a deep-learning algorithm for automatic lesion segmentation and feature assessment to reduce lesion categorization errors.

Computer image analysis with artificial intelligence: a practical introduction to convolutional neural networks for medical professionals

Artificial intelligence tools, particularly convolutional neural networks (CNNs), are transforming healthcare by enhancing predictive, diagnostic, and decision-making capabilities. This review provides an accessible and practical explanation of CNNs for clinicians and highlights their relevance in medical image analysis. CNNs have shown themselves to be exceptionally useful in computer vision, a field that enables machines to 'see' and interpret visual data. Understanding how these models work can help clinicians leverage their full potential, especially as artificial intelligence continues to evolve and integrate into healthcare. CNNs have already demonstrated their efficacy in diverse medical fields, including radiology, histopathology, and medical photography. In radiology, CNNs have been used to automate the assessment of conditions such as pneumonia, pulmonary embolism, and rectal cancer. In histopathology, CNNs have been used to assess and classify colorectal polyps, gastric epithelial tumours, as well as assist in the assessment of multiple malignancies. In medical photography, CNNs have been used to assess retinal diseases and skin conditions, and to detect gastric and colorectal polyps during endoscopic procedures. In surgical laparoscopy, they may provide intraoperative assistance to surgeons, helping interpret surgical anatomy and demonstrate safe dissection zones. The integration of CNNs into medical image analysis promises to enhance diagnostic accuracy, streamline workflow efficiency, and expand access to expert-level image analysis, contributing to the ultimate goal of delivering further improvements in patient and healthcare outcomes.

Development of a deep-learning model for classification of LI-RADS major features by using subtraction images of MRI: a preliminary study

PURPOSE

Liver Imaging Reporting and Data System (LI-RADS) is limited by interreader variability. Thus, our study aimed to develop a deep-learning model for classifying LI-RADS major features using subtraction images using magnetic resonance imaging (MRI).

METHODS

This single-center retrospective study included 222 consecutive patients who underwent resection for hepatocellular carcinoma (HCC) between January, 2015 and December, 2017. Subtraction arterial, portal venous, and transitional phase images of preoperative gadoxetic acid-enhanced MRI were used to train and test the deep-learning models. Initially, a three-dimensional (3D) nnU-Net-based deep-learning model was developed for HCC segmentation. Subsequently, a 3D U-Net-based deep-learning model was developed to assess three LI-RADS major features (nonrim arterial phase hyperenhancement [APHE], nonperipheral washout, and enhancing capsule [EC]), utilizing the results determined by board-certified radiologists as reference standards. The HCC segmentation performance was assessed using the Dice similarity coefficient (DSC), sensitivity, and precision. The sensitivity, specificity, and accuracy of the deep-learning model for classifying LI-RADS major features were calculated.

RESULTS

The average DSC, sensitivity, and precision of our model for HCC segmentation were 0.884, 0.891, and 0.887, respectively, across all the phases. Our model demonstrated a sensitivity, specificity, and accuracy of 96.6% (28/29), 66.7% (4/6), and 91.4% (32/35), respectively, for nonrim APHE; 95.0% (19/20), 50.0% (4/8), and 82.1% (23/28), respectively, for nonperipheral washout; and 86.7% (26/30), 54.2% (13/24), and 72.2% (39/54) for EC, respectively.

CONCLUSION

We developed an end-to-end deep-learning model that classifies the LI-RADS major features using subtraction MRI images. Our model exhibited satisfactory performance in classifying LI-RADS major features.

Multiparametric MRI: From Simultaneous Rapid Acquisition Methods and Analysis Techniques Using Scoring, Machine Learning, Radiomics, and Deep Learning to the Generation of Novel Metrics

ABSTRACT

With the recent advancements in rapid imaging methods, higher numbers of contrasts and quantitative parameters can be acquired in less and less time. Some acquisition models simultaneously obtain multiparametric images and quantitative maps to reduce scan times and avoid potential issues associated with the registration of different images. Multiparametric magnetic resonance imaging (MRI) has the potential to provide complementary information on a target lesion and thus overcome the limitations of individual techniques. In this review, we introduce methods to acquire multiparametric MRI data in a clinically feasible scan time with a particular focus on simultaneous acquisition techniques, and we discuss how multiparametric MRI data can be analyzed as a whole rather than each parameter separately. Such data analysis approaches include clinical scoring systems, machine learning, radiomics, and deep learning. Other techniques combine multiple images to create new quantitative maps associated with meaningful aspects of human biology. They include the magnetic resonance g-ratio, the inner to the outer diameter of a nerve fiber, and the aerobic glycolytic index, which captures the metabolic status of tumor tissues.

Fully automating LI-RADS on MRI with deep learning-guided lesion segmentation, feature characterization, and score inference

Introduction

Leveraging deep learning in the radiology community has great potential and practical significance. To explore the potential of fitting deep learning methods into the current Liver Imaging Reporting and Data System (LI-RADS) system, this paper provides a complete and fully automatic deep learning solution for the LI-RADS system and investigates its model performance in liver lesion segmentation and classification.

Methods

To achieve this, a deep learning study design process is formulated, including clinical problem formulation, corresponding deep learning task identification, data acquisition, data preprocessing, and algorithm validation. On top of segmentation, a UNet++-based segmentation approach with supervised learning was performed by using 33,078 raw images obtained from 111 patients, which are collected from 2010 to 2017. The key innovation is that the proposed framework introduces one more step called feature characterization before LI-RADS score classification in comparison to prior work. In this step, a feature characterization network with multi-task learning and joint training strategy was proposed, followed by an inference module to generate the final LI-RADS score.

Results

Both liver segmentation and feature characterization models were evaluated, and comprehensive statistical analysis was conducted with detailed discussions. Median DICE of liver lesion segmentation was able to achieve 0.879. Based on different thresholds, recall changes within a range of 0.7 to 0.9, and precision always stays high greater than 0.9. Segmentation model performance was also evaluated on the patient level and lesion level, and the evaluation results of (precision, recall) on the patient level were much better at approximately (1, 0.9). Lesion classification was evaluated to have an overall accuracy of 76%, and most mis-classification cases happen in the neighboring categories, which is reasonable since it is naturally difficult to distinguish LI-RADS 4 from LI-RADS 5.

Discussion

In addition to investigating the performance of the proposed model itself, extensive comparison experiment was also conducted. This study shows that our proposed framework with feature characterization greatly improves the diagnostic performance which also validates the effectiveness of the added feature characterization step. Since this step could output the feature characterization results instead of simply generating a final score, it is able to unbox the black-box for the proposed algorithm thus improves the explainability.

Update on the Use of Artificial Intelligence in Hepatobiliary MR Imaging

The application of machine learning (ML) and deep learning (DL) in radiology has expanded exponentially. In recent years, an extremely large number of studies have reported about the hepatobiliary domain. Its applications range from differential diagnosis to the diagnosis of tumor invasion and prediction of treatment response and prognosis. Moreover, it has been utilized to improve the image quality of DL reconstruction. However, most clinicians are not familiar with ML and DL, and previous studies about these concepts are relatively challenging to understand. In this review article, we aimed to explain the concepts behind ML and DL and to summarize recent achievements in their use in the hepatobiliary region.

Imaging Diagnosis of Hepatocellular Carcinoma: A State-of-the-Art Review

Hepatocellular carcinoma (HCC) remains not only a cause of a considerable part of oncologic mortality, but also a diagnostic and therapeutic challenge for healthcare systems worldwide. Early detection of the disease and consequential adequate therapy are imperative to increase patients' quality of life and survival. Imaging plays, therefore, a crucial role in the surveillance of patients at risk, the detection and diagnosis of HCC nodules, as well as in the follow-up post-treatment. The unique imaging characteristics of HCC lesions, deriving mainly from the assessment of their vascularity on contrast-enhanced computed tomography (CT), magnetic resonance (MR) or contrast-enhanced ultrasound (CEUS), allow for a more accurate, noninvasive diagnosis and staging. The role of imaging in the management of HCC has further expanded beyond the plain confirmation of a suspected diagnosis due to the introduction of ultrasound and hepatobiliary MRI contrast agents, which allow for the detection of hepatocarcinogenesis even at an early stage. Moreover, the recent technological advancements in artificial intelligence (AI) in radiology contribute an important tool for the diagnostic prediction, prognosis and evaluation of treatment response in the clinical course of the disease. This review presents current imaging modalities and their central role in the management of patients at risk and with HCC.

Radiomics: A radiological evidence-based artificial intelligence technique to facilitate personalized precision medicine in hepatocellular carcinoma

The high postoperative recurrence rates in hepatocellular carcinoma (HCC) remain a major hurdle in its management. Appropriate staging and treatment selection may alleviate the extent of fatal recurrence. However, effective methods to preoperatively evaluate pathophysiologic and molecular characteristics of HCC are lacking. Imaging plays a central role in HCC diagnosis and stratification due to the non-invasive diagnostic criteria. Vast and crucial information is hidden within image data. Other than providing a morphological sketch for lesion diagnosis, imaging could provide new insights to describe the pathophysiological and genetic landscape of HCC. Radiomics aims to facilitate diagnosis and prognosis of HCC using artificial intelligence techniques to harness the immense information contained in medical images. Radiomics produces a set of archetypal and robust imaging features that are correlated to key pathological or molecular biomarkers to preoperatively risk-stratify HCC patients. Inferred with outcome data, comprehensive combination of radiomic, clinical and/or multi-omics data could also improve direct prediction of response to treatment and prognosis. The evolution of radiomics is changing our understanding of personalized precision medicine in HCC management. Herein, we review the key techniques and clinical applications in HCC radiomics and discuss current limitations and future opportunities to improve clinical decision making.

Artificial intelligence: A review of current applications in hepatocellular carcinoma imaging

Hepatocellular carcinoma (HCC) is the most common type of primary liver cancer and currently the third-leading cause of cancer-related death worldwide. Recently, artificial intelligence (AI) has emerged as an important tool to improve clinical management of HCC, including for diagnosis, prognostication and evaluation of treatment response. Different AI approaches, such as machine learning and deep learning, are both based on the concept of developing prediction algorithms from large amounts of data, or big data. The era of digital medicine has led to a rapidly expanding amount of routinely collected health data which can be leveraged for the development of AI models. Various studies have constructed AI models by using features extracted from ultrasound imaging, computed tomography imaging and magnetic resonance imaging. Most of these models have used convolutional neural networks. These tools have shown promising results for HCC detection, characterization of liver lesions and liver/tumor segmentation. Regarding treatment, studies have outlined a role for AI in evaluation of treatment response and improvement of pre-treatment planning. Several challenges remain to fully integrate AI models in clinical practice. Future research is still needed to robustly evaluate AI algorithms in prospective trials, and improve interpretability, generalizability and transparency. If such challenges can be overcome, AI has the potential to profoundly change the management of patients with HCC. The purpose of this review was to sum up current evidence on AI approaches using imaging for the clinical management of HCC.

Role of three-dimensional printing and artificial intelligence in the management of hepatocellular carcinoma: Challenges and opportunities

Hepatocellular carcinoma (HCC) constitutes the fifth most frequent malignancy worldwide and the third most frequent cause of cancer-related deaths. Currently, treatment selection is based on the stage of the disease. Emerging fields such as three-dimensional (3D) printing, 3D bioprinting, artificial intelligence (AI), and machine learning (ML) could lead to evidence-based, individualized management of HCC. In this review, we comprehensively report the current applications of 3D printing, 3D bioprinting, and AI/ML-based models in HCC management; we outline the significant challenges to the broad use of these novel technologies in the clinical setting with the goal of identifying means to overcome them, and finally, we discuss the opportunities that arise from these applications. Notably, regarding 3D printing and bioprinting-related challenges, we elaborate on cost and cost-effectiveness, cell sourcing, cell viability, safety, accessibility, regulation, and legal and ethical concerns. Similarly, regarding AI/ML-related challenges, we elaborate on intellectual property, liability, intrinsic biases, data protection, cybersecurity, ethical challenges, and transparency. Our findings show that AI and 3D printing applications in HCC management and healthcare, in general, are steadily expanding; thus, these technologies will be integrated into the clinical setting sooner or later. Therefore, we believe that physicians need to become familiar with these technologies and prepare to engage with them constructively.

Deep learning in hepatocellular carcinoma: Current status and future perspectives

Hepatocellular carcinoma (HCC) is among the leading causes of cancer incidence and death. Despite decades of research and development of new treatment options, the overall outcomes of patients with HCC continue to remain poor. There are areas of unmet need in risk prediction, early diagnosis, accurate prognostication, and individualized treatments for patients with HCC. Recent years have seen an explosive growth in the application of artificial intelligence (AI) technology in medical research, with the field of HCC being no exception. Among the various AI-based machine learning algorithms, deep learning algorithms are considered state-of-the-art techniques for handling and processing complex multimodal data ranging from routine clinical variables to high-resolution medical images. This article will provide a comprehensive review of the recently published studies that have applied deep learning for risk prediction, diagnosis, prognostication, and treatment planning for patients with HCC.

Imaging Diagnosis of HCC: Future directions with special emphasis on hepatobiliary MRI and contrast-enhanced ultrasound

Hepatocellular carcinoma (HCC) is a unique cancer entity that can be noninvasively diagnosed using imaging modalities without pathologic confirmation. In 2018, several major guidelines for HCC were updated to include hepatobiliary contrast agent magnetic resonance imaging (HBA-MRI) and contrast-enhanced ultrasound (CEUS) as major imaging modalities for HCC diagnosis. HBA-MRI enables the achievement of high sensitivity in HCC detection using the hepatobiliary phase (HBP). CEUS is another imaging modality with real-time imaging capability, and it is reported to be useful as a second-line modality to increase sensitivity without losing specificity for HCC diagnosis. However, until now, there is an unsolved discrepancy among guidelines on whether to accept “HBP hypointensity” as a definite diagnostic criterion for HCC or include CEUS in the diagnostic algorithm for HCC diagnosis. Furthermore, there is variability in terminology and inconsistencies in the definition of imaging findings among guidelines; therefore, there is an unmet need for the development of a standardized lexicon. In this article, we review the performance and limitations of HBA-MRI and CEUS after guideline updates in 2018 and briefly introduce some future aspects of imaging-based HCC diagnosis.

Emerging artificial intelligence applications in liver magnetic resonance imaging

Chronic liver diseases (CLDs) are becoming increasingly more prevalent in modern society. The use of imaging techniques for early detection, such as magnetic resonance imaging (MRI), is crucial in reducing the impact of these diseases on healthcare systems. Artificial intelligence (AI) algorithms have been shown over the past decade to excel at image-based analysis tasks such as detection and segmentation. When applied to liver MRI, they have the potential to improve clinical decision making, and increase throughput by automating analyses. With Liver diseases becoming more prevalent in society, the need to implement these techniques to utilize liver MRI to its full potential, is paramount. In this review, we report on the current methods and applications of AI methods in liver MRI, with a focus on machine learning and deep learning methods. We assess four main themes of segmentation, classification, image synthesis and artefact detection, and their respective potential in liver MRI and the wider clinic. We provide a brief explanation of some of the algorithms used and explore the current challenges affecting the field. Though there are many hurdles to overcome in implementing AI methods in the clinic, we conclude that AI methods have the potential to positively aid healthcare professionals for years to come.

Progress of MRI Radiomics in Hepatocellular Carcinoma

Background

Hepatocellular carcinoma (HCC) is the sixth most common cancer in the world and the third leading cause of cancer-related death. Although the diagnostic scheme of HCC is currently undergoing refinement, the prognosis of HCC is still not satisfactory. In addition to certain factors, such as tumor size and number and vascular invasion displayed on traditional imaging, some histopathological features and gene expression parameters are also important for the prognosis of HCC patients. However, most parameters are based on postoperative pathological examinations, which cannot help with preoperative decision-making. As a new field, radiomics extracts high-throughput imaging data from different types of images to build models and predict clinical outcomes noninvasively before surgery, rendering it a powerful aid for making personalized treatment decisions preoperatively.

Objective

This study reviewed the workflow of radiomics and the research progress on magnetic resonance imaging (MRI) radiomics in the diagnosis and treatment of HCC.

Methods

A literature review was conducted by searching PubMed for search of relevant peer-reviewed articles published from May 2017 to June 2021.The search keywords included HCC, MRI, radiomics, deep learning, artificial intelligence, machine learning, neural network, texture analysis, diagnosis, histopathology, microvascular invasion, surgical resection, radiofrequency, recurrence, relapse, transarterial chemoembolization, targeted therapy, immunotherapy, therapeutic response, and prognosis.

Results

Radiomics features on MRI can be used as biomarkers to determine the differential diagnosis, histological grade, microvascular invasion status, gene expression status, local and systemic therapeutic responses, and prognosis of HCC patients.

Conclusion

Radiomics is a promising new imaging method. MRI radiomics has high application value in the diagnosis and treatment of HCC.

Automatic discrimination of different sequences and phases of liver MRI using a dense feature fusion neural network: a preliminary study

PURPOSE

To develop and validate a dense feature fusion neural network (DFuNN) to automatically recognize different sequences and phases of liver magnetic resonance imaging (MRI).

MATERIALS AND METHODS

In total, 3869 sequences and phases from 384 liver MRI examinations, divided into training/validation (n = 2886 sequences from 287 patients) and test (n = 983 sequences from 97 patients) sets, were used in this retrospective study. Ten unenhanced sequences and enhanced phases were included. Manual sequence recognition, performed by two radiologists (20 and 10 years of experience) in a consensus reading, was used as the reference standard. The sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve (AUC) were calculated to evaluate the performance of the DFuNN on an identical unseen test set. Finally, we evaluated the factors impacting the model precision.

RESULTS

A fusion block improved the performance of the DFuNN. DFuNN with a fusion block achieved good recognition performance for both complete and incomplete sequences and phases in the test set. The average sensitivity of recognition performance for complete sequence and phase inputs ranged from 88.06 to 100%, the average specificity ranged from 99.12 to 99.94%, and the median accuracy ranged from 98.02 to 99.95%. The DFuNN prediction accuracy for patients without cirrhosis were significantly higher than those for patients with cirrhosis (P = 0.0153). No significant difference was found in the accuracy across other factors.

CONCLUSION

DFuNN can automatically and accurately identify specific unenhanced MRI sequences and enhanced MRI phases.

State of the Art in Artificial Intelligence and Radiomics in Hepatocellular Carcinoma

The most common liver malignancy is hepatocellular carcinoma (HCC), which is also associated with high mortality. Often HCC develops in a chronic liver disease setting, and early diagnosis as well as accurate screening of high-risk patients is crucial for appropriate and effective management of these patients. While imaging characteristics of HCC are well-defined in the diagnostic phase, challenging cases still occur, and current prognostic and predictive models are limited in their accuracy. Radiomics and machine learning (ML) offer new tools to address these issues and may lead to scientific breakthroughs with the potential to impact clinical practice and improve patient outcomes. In this review, we will present an overview of these technologies in the setting of HCC imaging across different modalities and a range of applications. These include lesion segmentation, diagnosis, prognostic modeling and prediction of treatment response. Finally, limitations preventing clinical application of radiomics and ML at the present time are discussed, together with necessary future developments to bring the field forward and outside of a purely academic endeavor.

A Semi-Automatic Step-by-Step Expert-Guided LI-RADS Grading System Based on Gadoxetic Acid-Enhanced MRI

PURPOSE

Liver imaging reporting and data system (LI-RADS) classification, especially the identification of LR-3 to 5 lesions with hepatocellular carcinoma (HCC) probability, is of great significance to treatment strategy determination. We aimed to develop a semi-automatic LI-RADS grading system on multiphase gadoxetic acid-enhanced MRI using deep convolutional neural networks (CNN).

PATIENTS AND METHODS

An internal data set of 439 patients and external data set of 71 patients with suspected HCC were included and underwent gadoxetic acid-enhanced MRI. The expert-guided LI-RADS grading system consisted of four deep 3D CNN models including a tumor segmentation model for automatic diameter estimation and three classification models of LI-RADS major features including arterial phase hyper-enhancement (APHE), washout and enhancing capsule. An end-to-end learning system comprising single deep CNN model that directly classified the LI-RADS grade was developed for comparison.

RESULTS

On internal testing set, the segmentation model reached a mean dice of 0.84, with the accuracy of mapped diameter intervals as 82.7% (95% CI: 74.4%, 91.7%). The area under the curves (AUCs) were 0.941 (95% CI: 0.914, 0.961), 0.859 (95% CI: 0.823, 0.890) and 0.712 (95% CI: 0.668, 0.754) for APHE, washout and capsule, respectively. The expert-guided system significantly outperformed the end-to-end system with a LI-RADS grading accuracy of 68.3% (95% CI: 60.8%, 76.5%) vs 55.6% (95% CI: 48.8%, 63.0%) (P<0.0001). On external testing set, the accuracy of mapped diameter intervals was 91.5% (95% CI: 81.9%, 100.0%). The AUCs were 0.792 (95% CI: 0.745, 0.833), 0.654 (95% CI: 0.602, 0.703) and 0.658 (95% CI: 0.606, 0.707) for APHE, washout and capsule, respectively. The expert-guided system achieved an overall grading accuracy of 66.2% (95% CI: 58.0%, 75.2%), significantly higher than the end-to-end system of 50.1% (95% CI: 43.1%, 58.1%) (P<0.0001).

CONCLUSION

We developed a semi-automatic step-by-step expert-guided LI-RADS grading system (LR-3 to 5), superior to the conventional end-to-end learning system. This deep learning-based system may improve workflow efficiency for HCC diagnosis in clinical practice.

A novel computer-aided diagnostic system for accurate detection and grading of liver tumors

Liver cancer is a major cause of morbidity and mortality in the world. The primary goals of this manuscript are the identification of novel imaging markers (morphological, functional, and anatomical/textural), and development of a computer-aided diagnostic (CAD) system to accurately detect and grade liver tumors non-invasively. A total of 95 patients with liver tumors (M = 65, F = 30, age range = 34–82 years) were enrolled in the study after consents were obtained. 38 patients had benign tumors (LR1 = 19 and LR2 = 19), 19 patients had intermediate tumors (LR3), and 38 patients had hepatocellular carcinoma (HCC) malignant tumors (LR4 = 19 and LR5 = 19). A multi-phase contrast-enhanced magnetic resonance imaging (CE-MRI) was collected to extract the imaging markers. A comprehensive CAD system was developed, which includes the following main steps: i) estimation of morphological markers using a new parametric spherical harmonic model, ii) estimation of textural markers using a novel rotation invariant gray-level co-occurrence matrix (GLCM) and gray-level run-length matrix (GLRLM) models, and iii) calculation of the functional markers by estimating the wash-in/wash-out slopes, which enable quantification of the enhancement characteristics across different CE-MR phases. These markers were subsequently processed using a two-stages random forest-based classifier to classify the liver tumor as benign, intermediate, or malignant and determine the corresponding grade (LR1, LR2, LR3, LR4, or LR5). The overall CAD system using all the identified imaging markers achieved a sensitivity of 91.8%±0.9%, specificity of 91.2%±1.9%, and F\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$_{1}$$\end{document}1 score of 0.91±0.01, using the leave-one-subject-out (LOSO) cross-validation approach. Importantly, the CAD system achieved overall accuracies of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$88\%\pm 5\%$$\end{document}88%±5%, 85%±2%, 78%±3%, 83%±4%, and 79%±3% in grading liver tumors into LR1, LR2, LR3, LR4, and LR5, respectively. In addition to LOSO, the developed CAD system was tested using randomly stratified 10-fold and 5-fold cross-validation approaches. Alternative classification algorithms, including support vector machine, naive Bayes classifier, k-nearest neighbors, and linear discriminant analysis all produced inferior results compared to the proposed two stage random forest classification model. These experiments demonstrate the feasibility of the proposed CAD system as a novel tool to objectively assess liver tumors based on the new comprehensive imaging markers. The identified imaging markers and CAD system can be used as a non-invasive diagnostic tool for early and accurate detection and grading of liver cancer.

An Overview of Artificial Intelligence Applications in Liver and Pancreatic Imaging

Artificial intelligence (AI) is one of the most promising fields of research in medical imaging so far. By means of specific algorithms, it can be used to help radiologists in their routine workflow. There are several papers that describe AI approaches to solve different problems in liver and pancreatic imaging. These problems may be summarized in four different categories: segmentation, quantification, characterization and image quality improvement. Segmentation is usually the first step of successive elaborations. If done manually, it is a time-consuming process. Therefore, the semi-automatic and automatic creation of a liver or a pancreatic mask may save time for other evaluations, such as quantification of various parameters, from organs volume to their textural features. The alterations of normal liver and pancreas structure may give a clue to the presence of a diffuse or focal pathology. AI can be trained to recognize these alterations and propose a diagnosis, which may then be confirmed or not by radiologists. Finally, AI may be applied in medical image reconstruction in order to increase image quality, decrease dose administration (referring to computed tomography) and reduce scan times. In this article, we report the state of the art of AI applications in these four main categories.

Hepatobiliary phase hypointensity on gadobenate dimeglumine-enhanced magnetic resonance imaging may improve the diagnosis of hepatocellular carcinoma

Background

To determine the clinical value of hepatobiliary phase (HBP) hypointensity for noninvasive diagnosis of hepatocellular carcinoma (HCC).

Methods

A total of 246 high-risk patients with 263 selected nodules (126 HCCs, 137 non-HCCs) undergoing gadobenate dimeglumine (Gd-BOPTA)-enhanced magnetic resonance imaging (MRI) were included in the study. Imaging-based diagnoses of small (≤3 cm) and large (>3 cm) HCCs were made using the following 4 criteria: (I) non-rim arterial phase hyper-enhancement (APHE) plus hypointensity on the portal venous phase (PVP); (II) non-rim APHE plus hypointensity on the PVP and/or transitional phase (TP); (III) non-rim APHE plus hypointensity on the PVP and/or TP and/or HBP; (IV) criterion 3 plus non-LR-1/2/M. Based on typical imaging features, LR-1, LR-2, or LR-M (if definitely benign, probably benign, malignant but not HCC specific, respectively) were defined according to the Liver Imaging Reporting and Data System (LI-RADS). Sensitivities and specificities of imaging criteria were calculated and compared using McNemar’s test.

Results

Among the diagnostic criteria for small HCCs, criterion 3 and 4, which included HBP hypointensity, showed significantly higher sensitivities (96.4% and 94.6%, respectively) than criterion 1 (58.9%, P<0.001 for both). Moreover, criterion 4, which included HBP hypointensity and ancillary features, showed significantly higher specificity (94.7%) than criterion 3 (66.7%, P<0.001) and comparable specificity to criterion 1 (97.4%, P=0.375), achieving the highest accuracies (94.7%). The diagnostic performance of criterion 4 for large HCCs was similar to that for small HCCs.

Conclusions

HBP hypointensity acquired from Gd-BOPTA-MRI can improve sensitivity and maintain high specificity in the diagnosis of both small and large HCCs after excluding benignities or non-HCC malignancies according to characteristic imaging features.