Machine Learning Models for Prediction of Posttreatment Recurrence in Early-Stage Hepatocellular Carcinoma Using Pretreatment Clinical and MRI Features: A Proof-of-Concept Study

A knowledge-enhanced interpretable network for early recurrence prediction of hepatocellular carcinoma via multi-phase CT imaging

BACKGROUND

Predicting early recurrence (ER) of hepatocellular carcinoma (HCC) accurately can guide treatment decisions and further enhance survival. Computed tomography (CT) imaging, analyzed by deep learning (DL) models combining domain knowledge, has been employed for the prediction. However, these DL models utilized late fusion, restricting the interaction between domain knowledge and images during feature extraction, thereby limiting the prediction performance and compromising decision-making interpretability.

METHODS

We propose a novel Vision Transformer (ViT)-based DL network, referred to as Dual-Style ViT (DSViT), to augment the interaction between domain knowledge and images and the effective fusion among multi-phase CT images for improving both predictive performance and interpretability. We apply the DSViT to develop pre-/post-operative models for predicting ER. Within DSViT, to balance the utilization between domain knowledge and images within DSViT, we propose an adaptive self-attention mechanism. Moreover, we present an attention-guided supervised learning module for balancing the contributions of multi-phase CT images to prediction and a domain knowledge self-supervision module for enhancing the fusion between domain knowledge and images, thereby further improving predictive performance. Finally, we provide the interpretability of the DSViT decision-making.

RESULTS

Experiments on our multi-phase data demonstrate that DSViTs surpass the existing models across multiple performance metrics and provide the decision-making interpretability. Additional validation on a publicly available dataset underscores the generalizability of DSViT.

CONCLUSIONS

The proposed DSViT can significantly improve the performance and interpretability of ER prediction, thereby fortifying the trustworthiness of artificial intelligence tool for HCC ER prediction in clinical settings.

Leveraging radiomics and AI for precision diagnosis and prognostication of liver malignancies

Liver tumors, whether primary or metastatic, have emerged as a growing concern with substantial global health implications. Timely identification and characterization of liver tumors are pivotal factors in order to provide optimum treatment. Imaging is a crucial part of the detection of liver tumors; however, conventional imaging has shortcomings in the proper characterization of these tumors which leads to the need for tissue biopsy. Artificial intelligence (AI) and radiomics have recently emerged as investigational opportunities with the potential to enhance the detection and characterization of liver lesions. These advancements offer opportunities for better diagnostic accuracy, prognostication, and thereby improving patient care. In particular, these techniques have the potential to predict the histopathology, genotype, and immunophenotype of tumors based on imaging data, hence providing guidance for personalized treatment of such tumors. In this review, we outline the progression and potential of AI in the field of liver oncology imaging, specifically emphasizing manual radiomic techniques and deep learning-based representations. We discuss how these tools can aid in clinical decision-making challenges. These challenges encompass a broad range of tasks, from prognosticating patient outcomes, differentiating benign treatment-related factors and actual disease progression, recognizing uncommon response patterns, and even predicting the genetic and molecular characteristics of the tumors. Lastly, we discuss the pitfalls, technical limitations and future direction of these AI-based techniques.

Application of artificial intelligence radiomics in the diagnosis, treatment, and prognosis of hepatocellular carcinoma

Hepatocellular carcinoma (HCC) is the most common type of primary liver cancer, with an increasing incidence and poor prognosis. In the past decade, artificial intelligence (AI) technology has undergone rapid development in the field of clinical medicine, bringing the advantages of efficient data processing and accurate model construction. Promisingly, AI-based radiomics has played an increasingly important role in the clinical decision-making of HCC patients, providing new technical guarantees for prediction, diagnosis, and prognostication. In this review, we evaluated the current landscape of AI radiomics in the management of HCC, including its diagnosis, individual treatment, and survival prognosis. Furthermore, we discussed remaining challenges and future perspectives regarding the application of AI radiomics in HCC.

An Interventional Radiologist's Primer of Critical Appraisal of Artificial Intelligence Research

Recent advances in artificial intelligence (AI) are expected to cause a significant paradigm shift in all digital data-driven aspects of information gain, processing, and decision making in both clinical healthcare and medical research. The field of interventional radiology (IR) will be enmeshed in this innovation, yet the collective IR expertise in the field of AI remains rudimentary because of lack of training. This primer provides the clinical interventional radiologist with a simple guide for critically appraising AI research and products by identifying 12 fundamental items that should be considered: (a) need for AI technology to address the clinical problem, (b) type of applied Al algorithm, (c) data quality and degree of annotation, (d) reporting of accuracy, (e) applicability of standardized reporting, (f) reproducibility of methodology and data transparency, (g) algorithm validation, (h) interpretability, (i) concrete impact on IR, (j) pathway toward translation to clinical practice, (k) clinical benefit and cost-effectiveness, and (l) regulatory framework.

Methods for improving colorectal cancer annotation efficiency for artificial intelligence-observer training

BACKGROUND

Missing occult cancer lesions accounts for the most diagnostic errors in retrospective radiology reviews as early cancer can be small or subtle, making the lesions difficult to detect. Second-observer is the most effective technique for reducing these events and can be economically implemented with the advent of artificial intelligence (AI).

AIM

To achieve appropriate AI model training, a large annotated dataset is necessary to train the AI models. Our goal in this research is to compare two methods for decreasing the annotation time to establish ground truth: Skip-slice annotation and AI-initiated annotation.

METHODS

We developed a 2D U-Net as an AI second observer for detecting colorectal cancer (CRC) and an ensemble of 5 differently initiated 2D U-Net for ensemble technique. Each model was trained with 51 cases of annotated CRC computed tomography of the abdomen and pelvis, tested with 7 cases, and validated with 20 cases from The Cancer Imaging Archive cases. The sensitivity, false positives per case, and estimated Dice coefficient were obtained for each method of training. We compared the two methods of annotations and the time reduction associated with the technique. The time differences were tested using Friedman's two-way analysis of variance.

RESULTS

Sparse annotation significantly reduces the time for annotation particularly skipping 2 slices at a time (P < 0.001). Reduction of up to 2/3 of the annotation does not reduce AI model sensitivity or false positives per case. Although initializing human annotation with AI reduces the annotation time, the reduction is minimal, even when using an ensemble AI to decrease false positives.

CONCLUSION

Our data support the sparse annotation technique as an efficient technique for reducing the time needed to establish the ground truth.

Using Machine Learning to Predict Response to Image-guided Therapies for Hepatocellular Carcinoma

Interventional oncology is a rapidly growing field with advances in minimally invasive image-guided local-regional treatments for hepatocellular carcinoma (HCC), including transarterial chemoembolization, transarterial radioembolization, and thermal ablation. However, current standardized clinical staging systems for HCC are limited in their ability to optimize patient selection for treatment as they rely primarily on serum markers and radiologist-defined imaging features. Given the variation in treatment responses, an updated scoring system that includes multidimensional aspects of the disease, including quantitative imaging features, serum markers, and functional biomarkers, is needed to optimally triage patients. With the vast amounts of numerical medical record data and imaging features, researchers have turned to image-based methods, such as radiomics and artificial intelligence (AI), to automatically extract and process multidimensional data from images. The synthesis of these data can provide clinically relevant results to guide personalized treatment plans and optimize resource utilization. Machine learning (ML) is a branch of AI in which a model learns from training data and makes effective predictions by teaching itself. This review article outlines the basics of ML and provides a comprehensive overview of its potential value in the prediction of treatment response in patients with HCC after minimally invasive image-guided therapy.

The Role of Artificial Intelligence in the Detection and Implementation of Biomarkers for Hepatocellular Carcinoma: Outlook and Opportunities

Liver cancer is a leading cause of cancer-related death worldwide, and its early detection and treatment are crucial for improving morbidity and mortality. Biomarkers have the potential to facilitate the early diagnosis and management of liver cancer, but identifying and implementing effective biomarkers remains a major challenge. In recent years, artificial intelligence has emerged as a promising tool in the cancer sphere, and recent literature suggests that it is very promising in facilitating biomarker use in liver cancer. This review provides an overview of the status of AI-based biomarker research in liver cancer, with a focus on the detection and implementation of biomarkers for risk prediction, diagnosis, staging, prognostication, prediction of treatment response, and recurrence of liver cancers.

Artificial Intelligence in CT and MR Imaging for Oncological Applications

Cancer care increasingly relies on imaging for patient management. The two most common cross-sectional imaging modalities in oncology are computed tomography (CT) and magnetic resonance imaging (MRI), which provide high-resolution anatomic and physiological imaging. Herewith is a summary of recent applications of rapidly advancing artificial intelligence (AI) in CT and MRI oncological imaging that addresses the benefits and challenges of the resultant opportunities with examples. Major challenges remain, such as how best to integrate AI developments into clinical radiology practice, the vigorous assessment of quantitative CT and MR imaging data accuracy, and reliability for clinical utility and research integrity in oncology. Such challenges necessitate an evaluation of the robustness of imaging biomarkers to be included in AI developments, a culture of data sharing, and the cooperation of knowledgeable academics with vendor scientists and companies operating in radiology and oncology fields. Herein, we will illustrate a few challenges and solutions of these efforts using novel methods for synthesizing different contrast modality images, auto-segmentation, and image reconstruction with examples from lung CT as well as abdome, pelvis, and head and neck MRI. The imaging community must embrace the need for quantitative CT and MRI metrics beyond lesion size measurement. AI methods for the extraction and longitudinal tracking of imaging metrics from registered lesions and understanding the tumor environment will be invaluable for interpreting disease status and treatment efficacy. This is an exciting time to work together to move the imaging field forward with narrow AI-specific tasks. New AI developments using CT and MRI datasets will be used to improve the personalized management of cancer patients.

Machine-Learning-Based Radiomic Features on Pre-Ablation MRI as Predictors of Pathologic Response in Patients with Hepatocellular Carcinoma Who Underwent Hepatic Transplant

Background: The aim was to investigate the role of pre-ablation tumor radiomics in predicting pathologic treatment response in patients with early-stage hepatocellular carcinoma (HCC) who underwent liver transplant. Methods: Using data collected from 2005–2015, we included adult patients who (1) had a contrast-enhanced MRI within 3 months prior to ablation therapy and (2) underwent liver transplantation. Demographics were obtained for each patient. The treated hepatic tumor volume was manually segmented on the arterial phase T1 MRI images. A vector with 112 radiomic features (shape, first-order, and texture) was extracted from each tumor. Feature selection was employed through minimum redundancy and maximum relevance using a training set. A random forest model was developed based on top radiomic and demographic features. Model performance was evaluated by ROC analysis. SHAP plots were constructed in order to visualize feature importance in model predictions. Results: Ninety-seven patients (117 tumors, 31 (32%) microwave ablation, 66 (68%) radiofrequency ablation) were included. The mean model for end-stage liver disease (MELD) score was 10.5 ± 3. The mean follow-up time was 336.2 ± 179 days. Complete response on pathology review was achieved in 62% of patients at the time of transplant. Incomplete pathologic response was associated with four features: two first-order and two GLRM features using univariate logistic regression analysis (p < 0.05). The random forest model included two radiomic features (diagnostics maximum and first-order maximum) and four clinical features (pre-procedure creatinine, pre-procedure albumin, age, and gender) achieving an AUC of 0.83, a sensitivity of 82%, a specificity of 67%, a PPV of 69%, and an NPV of 80%. Conclusions: Pre-ablation MRI radiomics could act as a valuable imaging biomarker for the prediction of tumor pathologic response in patients with HCC.

Current status and prospect of treatments for recurrent hepatocellular carcinoma

Owing to its heterogeneous and highly aggressive nature, hepatocellular carcinoma (HCC) has a high recurrence rate, which is a non-negligible problem despite the increasing number of available treatment options. Recent clinical trials have attempted to reduce the recurrence and develop innovative treatment options for patients with recurrent HCC. In the event of liver remnant recurrence, the currently available treatment options include repeat hepatectomy, salvage liver transplantation, tumor ablation, transcatheter arterial chemoembolization, stereotactic body radiotherapy, systemic therapies, and combination therapy. In this review, we summarize the strategies to reduce the recurrence of high-risk tumors and aggressive therapies for recurrent HCC. Additionally, we discuss methods to prevent HCC recurrence and prognostic models constructed based on predictors of recurrence to develop an appropriate surveillance program.