Deep learning-based automated quantification of the hepatorenal index for evaluation of fatty liver by ultrasonography

Artificial intelligence in abdominal and pelvic ultrasound imaging: current applications

BACKGROUND

In recent years, the integration of artificial intelligence (AI) techniques into medical imaging has shown great potential to transform the diagnostic process. This review aims to provide a comprehensive overview of current state-of-the-art applications for AI in abdominal and pelvic ultrasound imaging.

METHODS

We searched the PubMed, FDA, and ClinicalTrials.gov databases for applications of AI in abdominal and pelvic ultrasound imaging.

RESULTS

A total of 128 titles were identified from the database search and were eligible for screening. After screening, 57 manuscripts were included in the final review. The main anatomical applications included multi-organ detection (n = 16, 28%), gynecology (n = 15, 26%), hepatobiliary system (n = 13, 23%), and musculoskeletal (n = 8, 14%). The main methodological applications included deep learning (n = 37, 65%), machine learning (n = 13, 23%), natural language processing (n = 5, 9%), and robots (n = 2, 4%). The majority of the studies were single-center (n = 43, 75%) and retrospective (n = 56, 98%). We identified 17 FDA approved AI ultrasound devices, with only a few being specifically used for abdominal/pelvic imaging (infertility monitoring and follicle development).

CONCLUSION

The application of AI in abdominal/pelvic ultrasound shows promising early results for disease diagnosis, monitoring, and report refinement. However, the risk of bias remains high because very few of these applications have been prospectively validated (in multi-center studies) or have received FDA clearance.

Revisiting the Hepatorenal Index in the Quantification of Hepatic Steatosis: How it is done and the utility

METHODS

Twenty-three peer-reviewed articles on HRI measurements published between 2018 through 2023 were reviewed, and 11 were selected based on common subjects. The search terms included "hepatorenal index," "HRI," "HRI ultrasound," "hepatorenal ultrasound index," and "HRI ultrasound measurement."Three common subject areas were identified in the literature and synthesized down to 11 articles. The common subjects identified were HRI technique, HRI limitations, and HRI diagnostic accuracy. The matrix provided a quick overview of the general information in each piece, aiding in the paper's overall organization. Thirteen articles were rejected as not relevant or out of date. The research question leading this review was, "What does the literature say about the value of HRI in determining moderate to severe hepatic steatosis?"

RESULTS

The literature revealed that HRI could be valuable in determining moderate to severe hepatic steatosis. HRI could not accurately determine normal or mild steatosis and has several limitations.

CONCLUSIONS

HRI is a more objective method for determining the degree of hepatic steatosis compared with traditional B-mode ultrasound scoring and does not require additional or specialized equipment. Many studies excluded patients with various liver diseases, which may not make HRI a practical tool for clinical usefulness. Further studies should be conducted with larger patient cohorts, a greater degree of hepatic steatosis, and determine specific standardized cutoff values.

Early and accurate diagnosis of steatotic liver by artificial intelligence (AI)-supported ultrasonography

OBJECTIVES

Steatotic liver disease is the most frequent chronic liver disease worldwide. Ultrasonography (US) is commonly employed for the assessment and diagnosis. Few information is available on the possible use of artificial intelligence (AI) to ameliorate the diagnostic accuracy of ultrasonography.

MATERIALS AND METHODS

An AI-based algorithm was developed using a dataset of US images. We prospectively enrolled 134 patients for algorithm validation. Patients underwent abdominal US and Proton Density Fat Fraction MRI scans (MRI-PDFF), assumed as reference technique. The hepatorenal index was manually calculated (HRIM) by 4 operators. An automatic hepatorenal index (HRIA) was obtained by the algorithm. The accuracy of HRIA to discriminate steatosis grades was evaluated by ROC analysis using MRI-PDFF cut-offs.

RESULTS

Overweight was 40 % of subjects (BMI 26.4 kg/cm2). The median HRIA was 1.11 (IQR 0.32) and the average of 4 manually calculated HRIM was 1.08 (IQR 0.26), with a 15 % inter-operator variability. Both HRIA (R = 0.79, P < 0.0001) and HRIM (R = 0.69, P < 0.0001) significantly correlated with liver fat percentage (MRI-PDFF). According to MRI-PDFF, 32 % of enrolled subjects had steatosis. Discrimination capacity by AUC between patient with steatosis and patient without steatosis was better for HRIA than HRIM (AUC: 0.87 vs. 0.82, respectively). ROC analysis showed an AUC = 0.98 for HRIA with 1.64 cut-off in distinguishing between mild and moderate/severe groups.

CONCLUSIONS

The use of AI improves accuracy and speed of ultrasonography in the diagnosis of liver steatosis. Further studies should evaluate the routine use of this technique in the management of liver steatosis at high cardio-metabolic risk.

Methodology exploration and reproducibility evaluation of TAI and TSI for quantitative ultrasound assessment of hepatic steatosis

Background and aim

New quantitative ultrasound techniques can be used to quantify hepatic steatosis, including tissue attenuation imaging (TAI), tissue scatter -distribution imaging (TSI), and the hepatorenal index (HRI). However, the measurement norms and the effects of fasting on these measurements remain unclear. The present study performed a methodological exploration and investigated the reliability of these measurements.

Methods

In total, 103 participants were prospectively recruited for ultrasonography and magnetic resonance imaging (MRI) scans. For the TAI and TSI data, the upper (2 cm), middle (4 cm) and lower (6 cm) areas determined according to the depth of the region of interest from the liver capsule, were sampled three times. Correlation analyses were performed to compare the measurements of TAI, TSI, and HRI with the controlled attenuation parameter (CAP) or MRI-proton density fat fraction (MRI-PDFF). Intra- and inter-operator repeatability was assessed using intraclass correlation coefficients. The effects of fasting on these measurements were then compared.

Results

The TAI and TSI measurements obtained from the upper and middle depths exhibited stronger correlations with the CAP measurements than those obtained from the lower depth. Specifically, the mean TAI had a significant positive correlation with MRI-PDFF (r = 0.753, P < 0.0001). TAI and TSI measurements exhibited excellent intra- (0.933 and 0.925, respectively) and inter- (0.896 and 0.766, respectively) examiner reliability. However, the correlation between HRI and CAP measurements was only 0.281, with no significant correlation with MRI-PDFF, and intra- and inter-examiner reproducibility of 0.458 and 0.343, respectively. Fasting did not affect these measurements.

Conclusions

TAI and TSI measurements demonstrated good intra- and interobserver reliability and correlated well with CAP and MRI-PDFF measurements. However, in practice-based clinical applications, the sampling depth should be controlled within 2-4 cm of the hepatic capsule; no fasting is required before the examination.

The Future Is Beyond Bright: The Evolving Role of Quantitative US for Fatty Liver Disease

Nonalcoholic fatty liver disease (NAFLD) is a common cause of morbidity and mortality. Nonfocal liver biopsy is the historical reference standard for evaluating NAFLD, but it is limited by invasiveness, high cost, and sampling error. Imaging methods are ideally situated to provide quantifiable results and rule out other anatomic diseases of the liver. MRI and US have shown great promise for the noninvasive evaluation of NAFLD. US is particularly well suited to address the population-level problem of NAFLD because it is lower-cost, more available, and more tolerable to a broader range of patients than MRI. Noninvasive US methods to evaluate liver fibrosis are widely available, and US-based tools to evaluate steatosis and inflammation are gaining traction. US techniques including shear-wave elastography, Doppler spectral imaging, attenuation coefficient, hepatorenal index, speed of sound, and backscatter-based estimation have regulatory clearance and are in clinical use. New methods based on channel and radiofrequency data analysis approaches have shown promise but are mostly experimental. This review discusses the advantages and limitations of clinically available and experimental approaches to sonographic liver tissue characterization for NAFLD diagnosis as well as future applications and strategies to overcome current limitations.

Nonalcoholic fatty liver disease (NAFLD) detection and deep learning in a Chinese community-based population

OBJECTIVES

We aimed to develop and validate a deep learning system (DLS) by using an auxiliary section that extracts and outputs specific ultrasound diagnostic features to improve the explainable, clinical relevant utility of using DLS for detecting NAFLD.

METHODS

In a community-based study of 4144 participants with abdominal ultrasound scan in Hangzhou, China, we sampled 928 (617 [66.5%] females, mean age: 56 years ± 13 [standard deviation]) participants (2 images per participant) to develop and validate DLS, a two-section neural network (2S-NNet). Radiologists' consensus diagnosis classified hepatic steatosis as none steatosis, mild, moderate, and severe. We also explored the NAFLD detection performance of six one-section neural network models and five fatty liver indices on our data set. We further evaluated the influence of participants' characteristics on the correctness of 2S-NNet by logistic regression.

RESULTS

Area under the curve (AUROC) of 2S-NNet for hepatic steatosis was 0.90 for ≥ mild, 0.85 for ≥ moderate, and 0.93 for severe steatosis, and was 0.90 for NAFLD presence, 0.84 for moderate to severe NAFLD, and 0.93 for severe NAFLD. The AUROC of NAFLD severity was 0.88 for 2S-NNet, and 0.79-0.86 for one-section models. The AUROC of NAFLD presence was 0.90 for 2S-NNet, and 0.54-0.82 for fatty liver indices. Age, sex, body mass index, diabetes, fibrosis-4 index, android fat ratio, and skeletal muscle via dual-energy X-ray absorptiometry had no significant impact on the correctness of 2S-NNet (p > 0.05).

CONCLUSIONS

By using two-section design, 2S-NNet had improved the performance for detecting NAFLD with more explainable, clinical relevant utility than using one-section design.

KEY POINTS

• Based on the consensus review derived from radiologists, our DLS (2S-NNet) had an AUROC of 0.88 by using two-section design and yielded better performance for detecting NAFLD than using one-section design with more explainable, clinical relevant utility. • The 2S-NNet outperformed five fatty liver indices with the highest AUROCs (0.84-0.93 vs. 0.54-0.82) for different NAFLD severity screening, indicating screening utility of deep learning-based radiology may perform better than blood biomarker panels in epidemiology. • The correctness of 2S-NNet was not significantly influenced by individual's characteristics, including age, sex, body mass index, diabetes, fibrosis-4 index, android fat ratio, and skeletal muscle via dual-energy X-ray absorptiometry.

Radiobioinformatics: A novel bridge between basic research and clinical practice for clinical decision support in diffuse liver diseases

The liver is a multifaceted organ that is responsible for many critical functions encompassing amino acid, carbohydrate, and lipid metabolism, all of which make a healthy liver essential for the human body. Contemporary imaging methodologies have remarkable diagnostic accuracy in discerning focal liver lesions; however, a comprehensive understanding of diffuse liver diseases is a requisite for radiologists to accurately diagnose or predict the progression of such lesions within clinical contexts. Nonetheless, the conventional attributes of radiological features, including morphology, size, margin, density, signal intensity, and echoes, limit their clinical utility. Radiomics is a widely used approach that is characterized by the extraction of copious image features from radiographic depictions, which gives it considerable potential in addressing this limitation. It is worth noting that functional or molecular alterations occur significantly prior to the morphological shifts discernible by imaging modalities. Consequently, the explication of potential mechanisms by multiomics analyses (encompassing genomics, epigenomics, transcriptomics, proteomics, and metabolomics) is essential for investigating putative signal pathway regulations from a radiological viewpoint. In this review, we elaborate on the principal pathological categorizations of diffuse liver diseases, the evaluation of multiomics approaches pertaining to diffuse liver diseases, and the prospective value of predictive models. Accordingly, the overarching objective of this review is to scrutinize the interrelations between radiological features and bioinformatics as well as to consider the development of prediction models predicated on radiobioinformatics as integral components of clinical decision support systems for diffuse liver diseases.

Evaluation of Artificial Intelligence-Calculated Hepatorenal Index for Diagnosing Mild and Moderate Hepatic Steatosis in Non-Alcoholic Fatty Liver Disease

Background and Objectives: This study aims to evaluate artificial intelligence-calculated hepatorenal index (AI-HRI) as a diagnostic method for hepatic steatosis. Materials and Methods: We prospectively enrolled 102 patients with clinically suspected non-alcoholic fatty liver disease (NAFLD). All patients had a quantitative ultrasound (QUS), including AI-HRI, ultrasound attenuation coefficient (AC,) and ultrasound backscatter-distribution coefficient (SC) measurements. The ultrasonographic fatty liver indicator (US-FLI) score was also calculated. The magnetic resonance imaging fat fraction (MRI-PDFF) was the reference to classify patients into four grades of steatosis: none < 5%, mild 5–10%, moderate 10–20%, and severe ≥ 20%. We compared AI-HRI between steatosis grades and calculated Spearman’s correlation (rs) between the methods. We determined the agreement between AI-HRI by two examiners using the intraclass correlation coefficient (ICC) of 68 cases. We performed a receiver operating characteristics (ROC) analysis to estimate the area under the curve (AUC) for AI-HRI. Results: The mean AI-HRI was 2.27 (standard deviation, ±0.96) in the patient cohort. The AI-HRI was significantly different between groups without (1.480 ± 0.607, p < 0.003) and with mild steatosis (2.155 ± 0.776), as well as between mild and moderate steatosis (2.777 ± 0.923, p < 0.018). AI-HRI showed moderate correlation with AC (rs = 0.597), SC (rs = 0.473), US-FLI (rs = 0.5), and MRI-PDFF (rs = 0.528). The agreement in AI-HRI was good between the two examiners (ICC = 0.635, 95% confidence interval (CI) = 0.411–0.774, p < 0.001). The AI-HRI could detect mild steatosis (AUC = 0.758, 95% CI = 0.621–0.894) with fair and moderate/severe steatosis (AUC = 0.803, 95% CI = 0.721–0.885) with good accuracy. However, the performance of AI-HRI was not significantly different (p < 0.578) between the two diagnostic tasks. Conclusions: AI-HRI is an easy-to-use, reproducible, and accurate QUS method for diagnosing mild and moderate hepatic steatosis.

Ultrasound Radiomics for the Detection of Early-Stage Liver Fibrosis

Objective: The study evaluates quantitative ultrasound (QUS) texture features with machine learning (ML) to enhance the sensitivity of B-mode ultrasound (US) for the detection of fibrosis at an early stage and distinguish it from advanced fibrosis. Different ML methods were evaluated to determine the best diagnostic model. Methods: 233 B-mode images of liver lobes with early and advanced-stage fibrosis induced in a rat model were analyzed. Sixteen features describing liver texture were measured from regions of interest (ROIs) drawn on B-mode images. The texture features included a first-order statistics run length (RL) and gray-level co-occurrence matrix (GLCM). The features discriminating between early and advanced fibrosis were used to build diagnostic models with logistic regression (LR), naïve Bayes (nB), and multi-class perceptron (MLP). The diagnostic performances of the models were compared by ROC analysis using different train-test sampling approaches, including leave-one-out, 10-fold cross-validation, and varying percentage splits. METAVIR scoring was used for histological fibrosis staging of the liver. Results: 15 features showed a significant difference between the advanced and early liver fibrosis groups, p < 0.05. Among the individual features, first-order statics features led to the best classification with a sensitivity of 82.1−90.5% and a specificity of 87.1−89.8%. For the features combined, the diagnostic performances of nB and MLP were high, with the area under the ROC curve (AUC) approaching 0.95−0.96. LR also yielded high diagnostic performance (AUC = 0.91−0.92) but was lower than nB and MLP. The diagnostic variability between test-train trials, measured by the coefficient-of-variation (CV), was higher for LR (3−5%) than nB and MLP (1−2%). Conclusion: Quantitative ultrasound with machine learning differentiated early and advanced fibrosis. Ultrasound B-mode images contain a high level of information to enable accurate diagnosis with relatively straightforward machine learning methods like naïve Bayes and logistic regression. Implementing simple ML approaches with QUS features in clinical settings could reduce the user-dependent limitation of ultrasound in detecting early-stage liver fibrosis.

Deep learning for real-time auxiliary diagnosis of pancreatic cancer in endoscopic ultrasonography

In recent year, many deep learning have been playing an important role in the detection of cancers. This study aimed to real-timely differentiate a pancreatic cancer (PC) or a non-pancreatic cancer (NPC) lesion via endoscopic ultrasonography (EUS) image. A total of 1213 EUS images from 157 patients (99 male, 58 female) with pancreatic disease were used for training, validation and test groups. Before model training, regions of interest (ROIs) were manually drawn to mark the PC and NPC lesions using Labelimage software. Yolov5m was used as the algorithm model to automatically distinguish the presence of pancreatic lesion. After training the model based on EUS images using YOLOv5, the parameters achieved convergence within 300 rounds (GIoU Loss: 0.01532, Objectness Loss: 0.01247, precision: 0.713 and recall: 0.825). For the validation group, the mAP0.5 was 0.831, and mAP@.5:.95 was 0.512. In addition, the receiver operating characteristic (ROC) curve analysis showed this model seemed to have a trend of more AUC of 0.85 (0.665 to 0.956) than the area under the curve (AUC) of 0.838 (0.65 to 0.949) generated by physicians using EUS detection without puncture, although pairwise comparison of ROC curves showed that the AUC between the two groups was not significant (z= 0.15, p = 0.8804). This study suggested that the YOLOv5m would generate attractive results and allow for the real-time decision support for distinction of a PC or a NPC lesion.

Comparative Study of Raw Ultrasound Data Representations in Deep Learning to Classify Hepatic Steatosis

Adiposity accumulation in the liver is an early-stage indicator of non-alcoholic fatty liver disease. Analysis of ultrasound (US) backscatter echoes from liver parenchyma with deep learning (DL) may offer an affordable alternative for hepatic steatosis staging. The aim of this work was to compare DL classification scores for liver steatosis using different data representations constructed from raw US data. Steatosis in N = 31 patients with confirmed or suspected non-alcoholic fatty liver disease was stratified based on fat-fraction cutoff values using magnetic resonance imaging as a reference standard. US radiofrequency (RF) frames (raw data) and clinical B-mode images were acquired. Intermediate image formation stages were modeled from RF data. Power spectrum representations and phase representations were also calculated. Co-registered patches were used to independently train 1-, 2- and 3-D convolutional neural networks (CNNs), and classifications scores were compared with cross-validation. There were 67,800 patches available for 2-D/3-D classification and 1,830,600 patches for 1-D classification. The results were also compared with radiologist B-mode annotations and quantitative ultrasound (QUS) metrics. Patch classification scores (area under the receiver operating characteristic curve [AUROC]) revealed significant reductions along successive stages of the image formation process (p &lt; 0.001). Patient AUROCs were 0.994 for RF data and 0.938 for clinical B-mode images. For all image formation stages, 2-D CNNs revealed higher patch and patient AUROCs than 1-D CNNs. CNNs trained with power spectrum representations converged faster than those trained with RF data. Phase information, which is usually discarded in the image formation process, provided a patient AUROC of 0.988. DL models trained with RF and power spectrum data (AUROC = 0.998) provided higher scores than conventional QUS metrics and multiparametric combinations thereof (AUROC = 0.986). Radiologist annotations indicated lower hepatic steatosis classification accuracies (Acc = 0.914) with respect to magnetic resonance imaging proton density fat fraction that DL models (Acc = 0.989). Access to raw ultrasound data combined with artificial intelligence techniques may offer superior opportunities for quantitative tissue diagnostics than conventional sonographic images.

Artificial intelligence in liver ultrasound

Artificial intelligence (AI) is playing an increasingly important role in medicine, especially in the field of medical imaging. It can be used to diagnose diseases and predict certain statuses and possible events that may happen. Recently, more and more studies have confirmed the value of AI based on ultrasound in the evaluation of diffuse liver diseases and focal liver lesions. It can assess the severity of liver fibrosis and nonalcoholic fatty liver, differentially diagnose benign and malignant liver lesions, distinguish primary from secondary liver cancers, predict the curative effect of liver cancer treatment and recurrence after treatment, and predict microvascular invasion in hepatocellular carcinoma. The findings from these studies have great clinical application potential in the near future. The purpose of this review is to comprehensively introduce the current status and future perspectives of AI in liver ultrasound.

Recent Advances in Machine Learning Applied to Ultrasound Imaging

Machine learning (ML) methods are pervading an increasing number of fields of application because of their capacity to effectively solve a wide variety of challenging problems. The employment of ML techniques in ultrasound imaging applications started several years ago but the scientific interest in this issue has increased exponentially in the last few years. The present work reviews the most recent (2019 onwards) implementations of machine learning techniques for two of the most popular ultrasound imaging fields, medical diagnostics and non-destructive evaluation. The former, which covers the major part of the review, was analyzed by classifying studies according to the human organ investigated and the methodology (e.g., detection, segmentation, and/or classification) adopted, while for the latter, some solutions to the detection/classification of material defects or particular patterns are reported. Finally, the main merits of machine learning that emerged from the study analysis are summarized and discussed.