1
|
Kaffas AE, Bhatraju KC, Vo-Phamhi JM, Tiyarattanachai T, Antil N, Negrete LM, Kamaya A, Shen L. Development of a Deep Learning Model for Classification of Hepatic Steatosis from Clinical Standard Ultrasound. ULTRASOUND IN MEDICINE & BIOLOGY 2025; 51:242-249. [PMID: 39537545 DOI: 10.1016/j.ultrasmedbio.2024.09.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Revised: 09/26/2024] [Accepted: 09/29/2024] [Indexed: 11/16/2024]
Abstract
OBJECTIVE Early detection and monitoring of hepatic steatosis can help establish appropriate preventative measures against progression to more advanced disease. We aimed to develop a deep learning (DL) program for classification of hepatic steatosis from standard-of-care grayscale ultrasound (US) images. METHODS In this single-center retrospective study, we utilized grayscale US images from January 1, 2010, to October 23, 2022, labeled with magnetic resonance imaging (MRI) proton density fat fraction (MRI-PDFF) to develop a DL multi-instance program for differentiating normal (S0) from steatotic liver (S1/2/3) and normal/mild steatosis (S0/1) from moderate/severe steatosis (S2/3). Diagnostic performances were assessed with area under the receiver operating characteristic curves (AUC), sensitivity, specificity and balanced accuracy with 95% confidence interval (CI). RESULTS A total of 403 patients with 403 US exams were included: 171 (42%) were normal (S0: MRI-PDFF <5%), 154 (38%) had mild steatosis (S1: MRI-PDFF 5-17.4%), 29 (7%) had moderate steatosis (S2: MRI-PDFF >17.4%-22.1%) and 49 (12%) had severe steatosis (S3: MRI-PDFF >22.1%). The dataset was split to include 322 patients in train/validation and 81 patients in a holdout test set (kept blind). The S0 versus S1/2/3 model achieved 81.3% (95% CI 72.1-90.5) AUC, 81.1% (70.6-91.6) sensitivity, 71.4% (54.7-88.2) specificity and 76.3% (66.4-86.2) balanced accuracy. The S0/1 versus S2/3 model achieved 95.9% (89-100) AUC, 87.5% (71.3-100) sensitivity, 96.9% (92.7-100) specificity and 92.2% (83.8-100) balanced accuracy. A multi-class model achieved a sensitivity of 71.4% (54.7-88.2) for S0, 67.6% (52.5-82.7) for S1 and 87.5% (71.3-100) for S2/3; specificity for the same model was 81.1% (70.6-91.6) for S0, 77.3% (64.9-89.7) for S1 and 96.9% (92.7-100) for S2/3. CONCLUSION Our DL program offered high sensitivity and accuracy in detecting and categorizing hepatic steatosis from standard-of-care ultrasound.
Collapse
Affiliation(s)
- Ahmed El Kaffas
- Department of Radiology, University of California San Diego School of Medicine, La Jolla, CA, USA
| | - Krishna Chaitanya Bhatraju
- Department of Radiology, University of California San Diego School of Medicine, La Jolla, CA, USA; Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Jenny M Vo-Phamhi
- Department of Radiology, University of California San Diego School of Medicine, La Jolla, CA, USA; Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Thodsawit Tiyarattanachai
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA; Department of Biomedical Data Science, Stanford University School of Medicine, Stanford, CA, USA
| | - Neha Antil
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Lindsey M Negrete
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Aya Kamaya
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Luyao Shen
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA.
| |
Collapse
|
2
|
You H, Xu F, Ye Y, Xia P, Du J. Adaptive LiDAR scanning based on RGB information. AUTOMATION IN CONSTRUCTION 2024; 160:105337. [DOI: 10.1016/j.autcon.2024.105337] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
|
3
|
Yen TJ, Yang CT, Lee YJ, Chen CH, Yang HC. Fatty liver classification via risk controlled neural networks trained on grouped ultrasound image data. Sci Rep 2024; 14:7345. [PMID: 38538649 PMCID: PMC10973492 DOI: 10.1038/s41598-024-57386-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2023] [Accepted: 03/18/2024] [Indexed: 01/03/2025] Open
Abstract
Ultrasound imaging is a widely used technique for fatty liver diagnosis as it is practically affordable and can be quickly deployed by using suitable devices. When it is applied to a patient, multiple images of the targeted tissues are produced. We propose a machine learning model for fatty liver diagnosis from multiple ultrasound images. The machine learning model extracts features of the ultrasound images by using a pre-trained image encoder. It further produces a summary embedding on these features by using a graph neural network. The summary embedding is used as input for a classifier on fatty liver diagnosis. We train the machine learning model on a ultrasound image dataset collected by Taiwan Biobank. We also carry out risk control on the machine learning model using conformal prediction. Under the risk control procedure, the classifier can improve the results with high probabilistic guarantees.
Collapse
Affiliation(s)
- Tso-Jung Yen
- Institute of Statistical Science, Academia Sinica, Taipei, Taiwan.
| | - Chih-Ting Yang
- Institute of Statistical Science, Academia Sinica, Taipei, Taiwan
| | - Yi-Ju Lee
- Institute of Statistical Science, Academia Sinica, Taipei, Taiwan
| | - Chun-Houh Chen
- Institute of Statistical Science, Academia Sinica, Taipei, Taiwan
| | - Hsin-Chou Yang
- Institute of Statistical Science, Academia Sinica, Taipei, Taiwan
| |
Collapse
|
4
|
Li S, Tsui PH, Wu W, Wu S, Zhou Z. Ultrasound k-nearest neighbor entropy imaging: Theory, algorithm, and applications. ULTRASONICS 2024; 138:107256. [PMID: 38325231 DOI: 10.1016/j.ultras.2024.107256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Revised: 01/25/2024] [Accepted: 01/26/2024] [Indexed: 02/09/2024]
Abstract
Ultrasound information entropy is a flexible approach for analyzing ultrasound backscattering. Shannon entropy imaging based on probability distribution histograms (PDHs) has been implemented as a promising method for tissue characterization and diagnosis. However, the bin number affects the stability of entropy estimation. In this study, we introduced the k-nearest neighbor (KNN) algorithm to estimate entropy values and proposed ultrasound KNN entropy imaging. The proposed KNN estimator leveraged the Euclidean distance between data samples, rather than the histogram bins by conventional PDH estimators. We also proposed cumulative relative entropy (CRE) imaging to analyze time-series radiofrequency signals and applied it to monitor thermal lesions induced by microwave ablation (MWA). Computer simulation phantom experiments were conducted to validate and compare the performance of the proposed KNN entropy imaging, the conventional PDH entropy imaging, and Nakagami-m parametric imaging in detecting the variations of scatterer densities and visualizing inclusions. Clinical data of breast lesions were analyzed, and porcine liver MWA experiments ex vivo were conducted to validate the performance of KNN entropy imaging in classifying benign and malignant breast tumors and monitoring thermal lesions, respectively. Compared with PDH, the entropy estimation based on KNN was less affected by the tuning parameters. KNN entropy imaging was more sensitive to changes in scatterer densities and performed better visualizable capability than typical Shannon entropy (TSE) and Nakagami-m parametric imaging. Among different imaging methods, KNN-based Shannon entropy (KSE) imaging achieved the higher accuracy in classification of benign and malignant breast tumors and KNN-based CRE imaging had larger lesion-to-normal contrast when monitoring the ablated areas during MWA at different powers and treatment durations. Ultrasound KNN entropy imaging is a potential quantitative ultrasound approach for tissue characterization.
Collapse
Affiliation(s)
- Sinan Li
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing, China
| | - Po-Hsiang Tsui
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan, Taiwan; Institute for Radiological Research, Chang Gung University, Taoyuan, Taiwan; Division of Pediatric Gastroenterology, Department of Pediatrics, Chang Gung Memorial Hospital at Linkou, Taoyuan, Taiwan
| | - Weiwei Wu
- College of Biomedical Engineering, Capital Medical University, Beijing, China
| | - Shuicai Wu
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing, China.
| | - Zhuhuang Zhou
- Department of Biomedical Engineering, Faculty of Environment and Life, Beijing University of Technology, Beijing, China.
| |
Collapse
|
5
|
Harrison AP, Li B, Hsu TH, Chen CJ, Yu WT, Tai J, Lu L, Tai DI. Steatosis Quantification on Ultrasound Images by a Deep Learning Algorithm on Patients Undergoing Weight Changes. Diagnostics (Basel) 2023; 13:3225. [PMID: 37892046 PMCID: PMC10605714 DOI: 10.3390/diagnostics13203225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 09/30/2023] [Accepted: 10/11/2023] [Indexed: 10/29/2023] Open
Abstract
INTRODUCTION A deep learning algorithm to quantify steatosis from ultrasound images may change a subjective diagnosis to objective quantification. We evaluate this algorithm in patients with weight changes. MATERIALS AND METHODS Patients (N = 101) who experienced weight changes ≥ 5% were selected for the study, using serial ultrasound studies retrospectively collected from 2013 to 2021. After applying our exclusion criteria, 74 patients from 239 studies were included. We classified images into four scanning views and applied the algorithm. Mean values from 3-5 images in each group were used for the results and correlated against weight changes. RESULTS Images from the left lobe (G1) in 45 patients, right intercostal view (G2) in 67 patients, and subcostal view (G4) in 46 patients were collected. In a head-to-head comparison, G1 versus G2 or G2 versus G4 views showed identical steatosis scores (R2 > 0.86, p < 0.001). The body weight and steatosis scores were significantly correlated (R2 = 0.62, p < 0.001). Significant differences in steatosis scores between the highest and lowest body weight timepoints were found (p < 0.001). Men showed a higher liver steatosis/BMI ratio than women (p = 0.026). CONCLUSIONS The best scanning conditions are 3-5 images from the right intercostal view. The algorithm objectively quantified liver steatosis, which correlated with body weight changes and gender.
Collapse
Affiliation(s)
- Adam P. Harrison
- Research Division, Riverain Technologies, Miamisburg, OH 45342, USA;
| | - Bowen Li
- Department of Computer Science, Johns Hopkins University, Baltimore, MD 20818, USA;
| | - Tse-Hwa Hsu
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan 33305, Taiwan; (T.-H.H.); (C.-J.C.); (W.-T.Y.); (J.T.)
| | - Cheng-Jen Chen
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan 33305, Taiwan; (T.-H.H.); (C.-J.C.); (W.-T.Y.); (J.T.)
| | - Wan-Ting Yu
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan 33305, Taiwan; (T.-H.H.); (C.-J.C.); (W.-T.Y.); (J.T.)
| | - Jennifer Tai
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan 33305, Taiwan; (T.-H.H.); (C.-J.C.); (W.-T.Y.); (J.T.)
| | - Le Lu
- DAMO Academy, Alibaba Group, New York, NY 94085, USA;
| | - Dar-In Tai
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan 33305, Taiwan; (T.-H.H.); (C.-J.C.); (W.-T.Y.); (J.T.)
| |
Collapse
|
6
|
Yang Y, Liu J, Sun C, Shi Y, Hsing JC, Kamya A, Keller CA, Antil N, Rubin D, Wang H, Ying H, Zhao X, Wu YH, Nguyen M, Lu Y, Yang F, Huang P, Hsing AW, Wu J, Zhu S. Nonalcoholic fatty liver disease (NAFLD) detection and deep learning in a Chinese community-based population. Eur Radiol 2023; 33:5894-5906. [PMID: 36892645 DOI: 10.1007/s00330-023-09515-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Revised: 10/21/2022] [Accepted: 02/03/2023] [Indexed: 03/10/2023]
Abstract
OBJECTIVES We aimed to develop and validate a deep learning system (DLS) by using an auxiliary section that extracts and outputs specific ultrasound diagnostic features to improve the explainable, clinical relevant utility of using DLS for detecting NAFLD. METHODS In a community-based study of 4144 participants with abdominal ultrasound scan in Hangzhou, China, we sampled 928 (617 [66.5%] females, mean age: 56 years ± 13 [standard deviation]) participants (2 images per participant) to develop and validate DLS, a two-section neural network (2S-NNet). Radiologists' consensus diagnosis classified hepatic steatosis as none steatosis, mild, moderate, and severe. We also explored the NAFLD detection performance of six one-section neural network models and five fatty liver indices on our data set. We further evaluated the influence of participants' characteristics on the correctness of 2S-NNet by logistic regression. RESULTS Area under the curve (AUROC) of 2S-NNet for hepatic steatosis was 0.90 for ≥ mild, 0.85 for ≥ moderate, and 0.93 for severe steatosis, and was 0.90 for NAFLD presence, 0.84 for moderate to severe NAFLD, and 0.93 for severe NAFLD. The AUROC of NAFLD severity was 0.88 for 2S-NNet, and 0.79-0.86 for one-section models. The AUROC of NAFLD presence was 0.90 for 2S-NNet, and 0.54-0.82 for fatty liver indices. Age, sex, body mass index, diabetes, fibrosis-4 index, android fat ratio, and skeletal muscle via dual-energy X-ray absorptiometry had no significant impact on the correctness of 2S-NNet (p > 0.05). CONCLUSIONS By using two-section design, 2S-NNet had improved the performance for detecting NAFLD with more explainable, clinical relevant utility than using one-section design. KEY POINTS • Based on the consensus review derived from radiologists, our DLS (2S-NNet) had an AUROC of 0.88 by using two-section design and yielded better performance for detecting NAFLD than using one-section design with more explainable, clinical relevant utility. • The 2S-NNet outperformed five fatty liver indices with the highest AUROCs (0.84-0.93 vs. 0.54-0.82) for different NAFLD severity screening, indicating screening utility of deep learning-based radiology may perform better than blood biomarker panels in epidemiology. • The correctness of 2S-NNet was not significantly influenced by individual's characteristics, including age, sex, body mass index, diabetes, fibrosis-4 index, android fat ratio, and skeletal muscle via dual-energy X-ray absorptiometry.
Collapse
Affiliation(s)
- Yang Yang
- Chronic Disease Research Institute, The Children's Hospital, and National Clinical Research Center for Child Health, School of Public Health, School of Medicine, Zhejiang University, No.866 Yu Hang Tang Road, Hangzhou, 310058, Zhejiang, China
- Department of Nutrition and Food Hygiene, School of Public Health, Zhejiang University, Hangzhou, Zhejiang, China
| | - Jing Liu
- College of Computer Science and Technology, Zhejiang University, No.866 Yu Hang Tang Road, Hangzhou, 310058, China
| | - Changxuan Sun
- Chronic Disease Research Institute, The Children's Hospital, and National Clinical Research Center for Child Health, School of Public Health, School of Medicine, Zhejiang University, No.866 Yu Hang Tang Road, Hangzhou, 310058, Zhejiang, China
- Department of Nutrition and Food Hygiene, School of Public Health, Zhejiang University, Hangzhou, Zhejiang, China
| | - Yuwei Shi
- Chronic Disease Research Institute, The Children's Hospital, and National Clinical Research Center for Child Health, School of Public Health, School of Medicine, Zhejiang University, No.866 Yu Hang Tang Road, Hangzhou, 310058, Zhejiang, China
- Department of Nutrition and Food Hygiene, School of Public Health, Zhejiang University, Hangzhou, Zhejiang, China
| | - Julianna C Hsing
- Center for Policy, Outcomes, and Prevention, Stanford University School of Medicine, Stanford, CA, USA
| | - Aya Kamya
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Cody Auston Keller
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Neha Antil
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Daniel Rubin
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
- Department of Biomedical Data Sciences, Stanford University School of Medicine, Stanford, CA, USA
| | - Hongxia Wang
- Department of Ultrasound, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, Zhejiang, China
| | - Haochao Ying
- Department of Big Data in Health Science, School of Public Health, Zhejiang University, Hangzhou, China
| | - Xueyin Zhao
- Chronic Disease Research Institute, The Children's Hospital, and National Clinical Research Center for Child Health, School of Public Health, School of Medicine, Zhejiang University, No.866 Yu Hang Tang Road, Hangzhou, 310058, Zhejiang, China
- Department of Nutrition and Food Hygiene, School of Public Health, Zhejiang University, Hangzhou, Zhejiang, China
| | - Yi-Hsuan Wu
- Stanford Prevention Research Center, Department of Medicine, Stanford University School of Medicine, 780 Welch Road, CJ Huang Building, Suite 250D, Stanford, CA, 94305, USA
| | - Mindie Nguyen
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, USA
- Division of Gastroenterology and Hepatology, Stanford University Medical Center, Stanford, CA, USA
| | - Ying Lu
- Department of Biomedical Data Sciences, Stanford University School of Medicine, Stanford, CA, USA
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, USA
- Stanford Cancer Institute, Stanford University School of Medicine, Stanford, CA, USA
| | - Fei Yang
- Chronic Disease Research Institute, The Children's Hospital, and National Clinical Research Center for Child Health, School of Public Health, School of Medicine, Zhejiang University, No.866 Yu Hang Tang Road, Hangzhou, 310058, Zhejiang, China
- Department of Nutrition and Food Hygiene, School of Public Health, Zhejiang University, Hangzhou, Zhejiang, China
| | - Pinton Huang
- Department of Ultrasound, The Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, Zhejiang, China
| | - Ann W Hsing
- Stanford Prevention Research Center, Department of Medicine, Stanford University School of Medicine, 780 Welch Road, CJ Huang Building, Suite 250D, Stanford, CA, 94305, USA.
- Department of Epidemiology and Population Health, Stanford University School of Medicine, Stanford, CA, USA.
- Stanford Cancer Institute, Stanford University School of Medicine, Stanford, CA, USA.
| | - Jian Wu
- Second Affiliated Hospital School of Medicine, School of Public Health, and Institute of Wenzhou, Zhejiang University, Hangzhou, 310058, China.
| | - Shankuan Zhu
- Chronic Disease Research Institute, The Children's Hospital, and National Clinical Research Center for Child Health, School of Public Health, School of Medicine, Zhejiang University, No.866 Yu Hang Tang Road, Hangzhou, 310058, Zhejiang, China.
- Department of Nutrition and Food Hygiene, School of Public Health, Zhejiang University, Hangzhou, Zhejiang, China.
| |
Collapse
|
7
|
Ibrahim MN, Blázquez-García R, Lightstone A, Meng F, Bhat M, El Kaffas A, Ukwatta E. Automated fatty liver disease detection in point-of-care ultrasound B-mode images. J Med Imaging (Bellingham) 2023; 10:034505. [PMID: 37284231 PMCID: PMC10240349 DOI: 10.1117/1.jmi.10.3.034505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 04/24/2023] [Accepted: 05/19/2023] [Indexed: 06/08/2023] Open
Abstract
Purpose Non-alcoholic fatty liver disease (NAFLD) is an increasing global health concern, with a prevalence of 25% worldwide. The rising incidence of NAFLD, an asymptomatic condition, reinforces the need for systematic screening strategies in primary care. We present the use of non-expert acquired point-of-care ultrasound (POCUS) B-mode images for the development of an automated steatosis classification algorithm. Approach We obtained a Health Insurance Portability and Accountability Act compliant dataset consisting of 478 patients [body mass index 23.60 ± 3.55 , age 40.97 ± 10.61 ], imaged with POCUS by non-expert health care personnel. A U-Net deep learning (DL) model was used for liver segmentation in the POCUS B-mode images, followed by 224 × 224 patch extraction of liver parenchyma. Several DL models including VGG-16, ResNet-50, Inception V3, and DenseNet-121 were trained for binary classification of steatosis. All layers of each tested model were unfrozen, and the final layer was replaced with a custom classifier. Majority voting was applied for patient-level results. Results On a hold-out test set of 81 patients, the final DenseNet-121 model yielded an area under the receiver operator characteristic curve of 90.1%, sensitivity of 95.0%, and specificity of 85.2% for the detection of liver steatosis. Average cross-validation performance in models using patches of liver parenchyma as input outperformed methods using complete B-mode frames. Conclusions Despite minimal POCUS acquisition training, and low-quality B-mode images, it is possible to detect steatosis using DL algorithms. Implementation of this algorithm in POCUS software may offer an accessible, low-cost steatosis screening technology, for use by non-expert health care personnel.
Collapse
Affiliation(s)
- Miriam Naim Ibrahim
- University of Guelph, Faculty of Engineering, Biomedical Engineering, Guelph, Ontario, Canada
- Oncoustics, Toronto, Ontario, Canada
- Toronto General Hospital, Division of Gastroenterology and Hepatology, Toronto, Ontario, Canada
| | | | | | - Fankun Meng
- Beijing You An Hospital, Capital Medical University, Ultrasound and Functional Diagnosis Center, Beijing, China
| | - Mamatha Bhat
- Toronto General Hospital, Division of Gastroenterology and Hepatology, Toronto, Ontario, Canada
| | | | - Eranga Ukwatta
- University of Guelph, Faculty of Engineering, Biomedical Engineering, Guelph, Ontario, Canada
| |
Collapse
|
8
|
Gheorghe EC, Nicolau C, Kamal A, Udristoiu A, Gruionu L, Saftoiu A. Artificial Intelligence (AI)-Enhanced Ultrasound Techniques Used in Non-Alcoholic Fatty Liver Disease: Are They Ready for Prime Time? APPLIED SCIENCES 2023; 13:5080. [DOI: 10.3390/app13085080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2025]
Abstract
Non-alcoholic fatty liver disease (NAFLD) is the most prevalent cause of chronic liver disease, affecting approximately 2 billion individuals worldwide with a spectrum that can range from simple steatosis to cirrhosis. Typically, the diagnosis of NAFLD is based on imaging studies, but the gold standard remains liver biopsies. Hence, the use of artificial intelligence (AI) in this field, which has recently undergone rapid development in various aspects of medicine, has the potential to accurately diagnose NAFLD and steatohepatitis (NASH). This paper provides an overview of the latest research that employs AI for the diagnosis and staging of NAFLD, as well as applications for future developments in this field.
Collapse
Affiliation(s)
- Elena Codruta Gheorghe
- Department of Family Medicine, University of Medicine and Pharmacy Craiova, 200349 Craiova, Romania
| | - Carmen Nicolau
- Lotus Image Medical Center, ActaMedica SRL Târgu Mureș, 540084 Târgu Mureș, Romania
| | - Adina Kamal
- Department of Internal Medicine, University of Medicine and Pharmacy Craiova, 200349 Craiova, Romania
| | - Anca Udristoiu
- Faculty of Automation, Computers and Electronics, University of Craiova, 200776 Craiova, Romania
| | - Lucian Gruionu
- Faculty of Mechanics, University of Craiova, 200512 Craiova, Romania
| | - Adrian Saftoiu
- Department of Gastroenterology and Hepatology, University of Medicine and Pharmacy Carol Davila Bucharest, 050474 Bucharest, Romania
- Department of Gastroenterology, Ponderas Academic Hospital, 014142 Bucharest, Romania
| |
Collapse
|
9
|
Cernat C, Das S, Hendriks GAGM, Noort FVD, Manzini C, van der Vaart CH, de Korte CL. Tissue Characterization of Puborectalis Muscle From 3-D Ultrasound. ULTRASOUND IN MEDICINE & BIOLOGY 2023; 49:527-538. [PMID: 36376156 DOI: 10.1016/j.ultrasmedbio.2022.10.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Revised: 09/27/2022] [Accepted: 10/03/2022] [Indexed: 06/16/2023]
Abstract
Pelvic floor (PF) muscles have the role of preventing pelvic organ descent. The puborectalis muscle (PRM), which is one of the female PF muscles, can be damaged during child delivery. This damage can potentially cause irreversible muscle trauma and even lead to an avulsion, which is disconnection of the muscle from its insertion point, the pubic bone. Ultrasound imaging allows diagnosis of such trauma based on comparison of geometric features of a damaged muscle with the geometric features of a healthy muscle. Although avulsion, which is considered severe damage, can be diagnosed, microdamage within the muscle itself leading to structural changes cannot be diagnosed by visual inspection through imaging only. Therefore, we developed a quantitative ultrasound tissue characterization method to obtain information on the state of the tissue of the PRM and the presence of microdamage in avulsed PRMs. The muscle was segmented as the region of interest (ROI) and further subdivided into six regions of interest (sub-ROIs). Mean echogenicity, entropy and shape parameter of the statistical distribution of gray values were analyzed on two of these sub-ROIs nearest to the bone. The regions nearest to the bones are also the most likely regions to exhibit damage in case of disconnection or avulsion. This analysis was performed for both the muscle at rest and the muscle in contraction. We found that, for PRMs with unilateral avulsion compared with undamaged PRMs, the mean echogenicity (p = 0.02) and shape parameter (p < 0.01) were higher, whereas the entropy was lower (p < 0.01). This method might be applicable to quantification of PRM damage within the muscle.
Collapse
Affiliation(s)
- Catalin Cernat
- Medical Ultrasound Imaging Center (MUSIC), Radboud University Medical Center, Nijmegen, The Netherlands
| | - Shreya Das
- Medical Ultrasound Imaging Center (MUSIC), Radboud University Medical Center, Nijmegen, The Netherlands
| | - Gijs A G M Hendriks
- Medical Ultrasound Imaging Center (MUSIC), Radboud University Medical Center, Nijmegen, The Netherlands
| | - Frieda van den Noort
- Robotics and Mechatronics, Technical Medical Center, University of Twente, Enschede, The Netherlands
| | - Claudia Manzini
- Department of Reproductive Medicine and Gynecology, University Medical Center, Utrecht, The Netherlands
| | - C Huub van der Vaart
- Department of Reproductive Medicine and Gynecology, University Medical Center, Utrecht, The Netherlands
| | - Chris L de Korte
- Medical Ultrasound Imaging Center (MUSIC), Radboud University Medical Center, Nijmegen, The Netherlands; Physics of Fluids, Technical Medical Centre, University of Twente, Enschede, The Netherlands.
| |
Collapse
|
10
|
Atasever S, Azginoglu N, Terzi DS, Terzi R. A comprehensive survey of deep learning research on medical image analysis with focus on transfer learning. Clin Imaging 2023; 94:18-41. [PMID: 36462229 DOI: 10.1016/j.clinimag.2022.11.003] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 10/17/2022] [Accepted: 11/01/2022] [Indexed: 11/13/2022]
Abstract
This survey aims to identify commonly used methods, datasets, future trends, knowledge gaps, constraints, and limitations in the field to provide an overview of current solutions used in medical image analysis in parallel with the rapid developments in transfer learning (TL). Unlike previous studies, this survey grouped the last five years of current studies for the period between January 2017 and February 2021 according to different anatomical regions and detailed the modality, medical task, TL method, source data, target data, and public or private datasets used in medical imaging. Also, it provides readers with detailed information on technical challenges, opportunities, and future research trends. In this way, an overview of recent developments is provided to help researchers to select the most effective and efficient methods and access widely used and publicly available medical datasets, research gaps, and limitations of the available literature.
Collapse
Affiliation(s)
- Sema Atasever
- Computer Engineering Department, Nevsehir Hacı Bektas Veli University, Nevsehir, Turkey.
| | - Nuh Azginoglu
- Computer Engineering Department, Kayseri University, Kayseri, Turkey.
| | | | - Ramazan Terzi
- Computer Engineering Department, Amasya University, Amasya, Turkey.
| |
Collapse
|
11
|
Tsui PH. Information Entropy and Its Applications. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2023; 1403:153-167. [PMID: 37495918 DOI: 10.1007/978-3-031-21987-0_8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/28/2023]
Abstract
Ultrasound is a first-line diagnostic tool for imaging many disease states. A number of statistical distributions have been proposed to describe ultrasound backscattering measured from tissues having different disease states. As an example, in this chapter we use nonalcoholic fatty liver disease (NAFLD), which is a critical health issue on a global scale, to demonstrate the capabilities of ultrasound to diagnose disease. Ultrasound interaction with the liver is typically characterized by scattering, which is quantified for the purpose of determining the degree of liver steatosis and fibrosis. Information entropy provides an insight into signal uncertainty. This concept allows for the analysis of backscattered statistics without considering the distribution of data or the statistical properties of ultrasound signals. In this chapter, we examined the background of NAFLD and the sources of scattering in the liver. The fundamentals of information entropy and an algorithmic scheme for ultrasound entropy imaging are then presented. Lastly, some examples of using ultrasound entropy imaging to grade hepatic steatosis and evaluate the risk of liver fibrosis in patients with significant hepatic steatosis are presented to illustrate future opportunities for clinical use.
Collapse
Affiliation(s)
- Po-Hsiang Tsui
- Department of Medical Imaging and Radiological Sciences, Chang Gung University, Taoyuan City, Taiwan.
| |
Collapse
|
12
|
Elmhamudi A, Abubakar A, Ugail H, Thomson B, Wilson C, Turner M, Manas D, Tingle S, Colenutt S, Sen G, Hunter J, Sun M, Scully J. Deep Learning Assisted Kidney Organ Image Analysis for Assessing the Viability of Transplantation. 2022 14TH INTERNATIONAL CONFERENCE ON SOFTWARE, KNOWLEDGE, INFORMATION MANAGEMENT AND APPLICATIONS (SKIMA) 2022:204-209. [DOI: 10.1109/skima57145.2022.10029406] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
Affiliation(s)
- Ali Elmhamudi
- University of Bradford,Centre for Visual Computing, Faculty of Engineering and Informatics,Bradford,United Kingdom
| | - Aliyu Abubakar
- University of Bradford,Centre for Visual Computing, Faculty of Engineering and Informatics,Bradford,United Kingdom
| | - Hassan Ugail
- University of Bradford,Centre for Visual Computing, Faculty of Engineering and Informatics,Bradford,United Kingdom
| | - Brian Thomson
- University of Bradford,Centre for Visual Computing, Faculty of Engineering and Informatics,Bradford,United Kingdom
| | - Colin Wilson
- NIHR Blood and Transplant Research Unit in Organ Donation and Transplantation at Cambridge and Newcastle Universities,Newcastle upon Tyne,United Kingdom
| | - Mark Turner
- NIHR Blood and Transplant Research Unit in Organ Donation and Transplantation at Cambridge and Newcastle Universities,Newcastle upon Tyne,United Kingdom
| | - Derek Manas
- NIHR Blood and Transplant Research Unit in Organ Donation and Transplantation at Cambridge and Newcastle Universities,Newcastle upon Tyne,United Kingdom
| | - Samuel Tingle
- NIHR Blood and Transplant Research Unit in Organ Donation and Transplantation at Cambridge and Newcastle Universities,Newcastle upon Tyne,United Kingdom
| | - Sam Colenutt
- NIHR Blood and Transplant Research Unit in Organ Donation and Transplantation at Cambridge and Newcastle Universities,Newcastle upon Tyne,United Kingdom
| | - Gourab Sen
- NIHR Blood and Transplant Research Unit in Organ Donation and Transplantation at Cambridge and Newcastle Universities,Newcastle upon Tyne,United Kingdom
| | - James Hunter
- University of Oxford,Nuffield Department of Surgical Sciences,Oxford,United Kingdom
| | - Meng Sun
- University of Oxford,Nuffield Department of Surgical Sciences,Oxford,United Kingdom
| | - Jackie Scully
- Disability Innovation Institute UNSW, University of New South Wales,Kensington,Australia
| |
Collapse
|
13
|
Alshagathrh FM, Househ MS. Artificial Intelligence for Detecting and Quantifying Fatty Liver in Ultrasound Images: A Systematic Review. BIOENGINEERING (BASEL, SWITZERLAND) 2022; 9:bioengineering9120748. [PMID: 36550954 PMCID: PMC9774180 DOI: 10.3390/bioengineering9120748] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 10/20/2022] [Accepted: 10/30/2022] [Indexed: 12/05/2022]
Abstract
BACKGROUND Non-alcoholic Fatty Liver Disease (NAFLD) is growing more prevalent worldwide. Although non-invasive diagnostic approaches such as conventional ultrasonography and clinical scoring systems have been proposed as alternatives to liver biopsy, their efficacy has been called into doubt. Artificial Intelligence (AI) is now combined with traditional diagnostic processes to improve the performance of non-invasive approaches. OBJECTIVE This study explores how well various AI methods function and perform on ultrasound (US) images to diagnose and quantify non-alcoholic fatty liver disease. METHODOLOGY A systematic review was conducted to achieve this objective. Five science bibliographic databases were searched, including PubMed, Association for Computing Machinery ACM Digital Library, Institute of Electrical and Electronics Engineers IEEE Xplore, Scopus, and Google Scholar. Only peer-reviewed English articles, conferences, theses, and book chapters were included. Data from studies were synthesized using narrative methodologies per Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) criteria. RESULTS Forty-nine studies were included in the systematic review. According to the qualitative analysis, AI significantly enhanced the diagnosis of NAFLD, Non-Alcoholic Steatohepatitis (NASH), and liver fibrosis. In addition, modalities, image acquisition, feature extraction and selection, data management, and classifiers were assessed and compared in terms of performance measures (i.e., accuracy, sensitivity, and specificity). CONCLUSION AI-supported systems show potential performance increases in detecting and quantifying steatosis, NASH, and liver fibrosis in NAFLD patients. Before real-world implementation, prospective studies with direct comparisons of AI-assisted modalities and conventional techniques are necessary.
Collapse
|
14
|
Ma L, Wang R, He Q, Huang L, Wei X, Lu X, Du Y, Luo J, Liao H. Artificial intelligence-based ultrasound imaging technologies for hepatic diseases. ILIVER 2022; 1:252-264. [DOI: 10.1016/j.iliver.2022.11.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
|
15
|
Sanabria SJ, Pirmoazen AM, Dahl J, Kamaya A, El Kaffas A. Comparative Study of Raw Ultrasound Data Representations in Deep Learning to Classify Hepatic Steatosis. ULTRASOUND IN MEDICINE & BIOLOGY 2022; 48:2060-2078. [PMID: 35914993 DOI: 10.1016/j.ultrasmedbio.2022.05.031] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 05/23/2022] [Accepted: 05/24/2022] [Indexed: 06/15/2023]
Abstract
Adiposity accumulation in the liver is an early-stage indicator of non-alcoholic fatty liver disease. Analysis of ultrasound (US) backscatter echoes from liver parenchyma with deep learning (DL) may offer an affordable alternative for hepatic steatosis staging. The aim of this work was to compare DL classification scores for liver steatosis using different data representations constructed from raw US data. Steatosis in N = 31 patients with confirmed or suspected non-alcoholic fatty liver disease was stratified based on fat-fraction cutoff values using magnetic resonance imaging as a reference standard. US radiofrequency (RF) frames (raw data) and clinical B-mode images were acquired. Intermediate image formation stages were modeled from RF data. Power spectrum representations and phase representations were also calculated. Co-registered patches were used to independently train 1-, 2- and 3-D convolutional neural networks (CNNs), and classifications scores were compared with cross-validation. There were 67,800 patches available for 2-D/3-D classification and 1,830,600 patches for 1-D classification. The results were also compared with radiologist B-mode annotations and quantitative ultrasound (QUS) metrics. Patch classification scores (area under the receiver operating characteristic curve [AUROC]) revealed significant reductions along successive stages of the image formation process (p < 0.001). Patient AUROCs were 0.994 for RF data and 0.938 for clinical B-mode images. For all image formation stages, 2-D CNNs revealed higher patch and patient AUROCs than 1-D CNNs. CNNs trained with power spectrum representations converged faster than those trained with RF data. Phase information, which is usually discarded in the image formation process, provided a patient AUROC of 0.988. DL models trained with RF and power spectrum data (AUROC = 0.998) provided higher scores than conventional QUS metrics and multiparametric combinations thereof (AUROC = 0.986). Radiologist annotations indicated lower hepatic steatosis classification accuracies (Acc = 0.914) with respect to magnetic resonance imaging proton density fat fraction that DL models (Acc = 0.989). Access to raw ultrasound data combined with artificial intelligence techniques may offer superior opportunities for quantitative tissue diagnostics than conventional sonographic images.
Collapse
Affiliation(s)
- Sergio J Sanabria
- Department of Radiology, Stanford University, Stanford, California, USA; Deusto Institute of Technology, University of Deusto/Ikerbasque, Basque Foundation for Science, Bilbao, Spain.
| | - Amir M Pirmoazen
- Department of Radiology, Stanford University, Stanford, California, USA
| | - Jeremy Dahl
- Department of Radiology, Stanford University, Stanford, California, USA
| | - Aya Kamaya
- Department of Radiology, Stanford University, Stanford, California, USA
| | - Ahmed El Kaffas
- Department of Radiology, Stanford University, Stanford, California, USA
| |
Collapse
|
16
|
Sourav MSU, Wang H. Intelligent Identification of Jute Pests Based on Transfer Learning and Deep Convolutional Neural Networks. Neural Process Lett 2022; 55:1-18. [PMID: 35990859 PMCID: PMC9376051 DOI: 10.1007/s11063-022-10978-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/20/2022] [Indexed: 11/10/2022]
Abstract
Pest attacks pose a substantial threat to jute production and other significant crop plants. Jute farmers in Bangladesh generally distinguish between different pests that appear to be the same using their eyes and expertise, which isn't always accurate. We developed an intelligent model for jute pests identification based on transfer learning (TL) and deep convolutional neural networks (DCNN) to solve this practical problem. The proposed DCNN model can realize fast and accurate automatic identification of jute pests based on photographs. Specifically, the VGG19 CNN model was trained by TL on the ImageNet database. A well-structured image dataset of four dominant jute pests is also established. Our model shows a final accuracy of 95.86% on the four most vital jute pest classes. The model's performance is further demonstrated by the precision, recall, F1-score, and confusion matrix results. The proposed model is integrated into Android and IOS applications for practical uses.
Collapse
Affiliation(s)
- Md Sakib Ullah Sourav
- School of Management Science and Engineering, Shandong University of Finance and Economics, Jinan, China
| | - Huidong Wang
- School of Management Science and Engineering, Shandong University of Finance and Economics, Jinan, China
| |
Collapse
|
17
|
Li B, Tai DI, Yan K, Chen YC, Chen CJ, Huang SF, Hsu TH, Yu WT, Xiao J, Le L, Harrison AP. Accurate and generalizable quantitative scoring of liver steatosis from ultrasound images via scalable deep learning. World J Gastroenterol 2022; 28:2494-2508. [PMID: 35979264 PMCID: PMC9258285 DOI: 10.3748/wjg.v28.i22.2494] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/18/2021] [Revised: 02/03/2022] [Accepted: 04/25/2022] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Hepatic steatosis is a major cause of chronic liver disease. Two-dimensional (2D) ultrasound is the most widely used non-invasive tool for screening and monitoring, but associated diagnoses are highly subjective.
AIM To develop a scalable deep learning (DL) algorithm for quantitative scoring of liver steatosis from 2D ultrasound images.
METHODS Using multi-view ultrasound data from 3310 patients, 19513 studies, and 228075 images from a retrospective cohort of patients received elastography, we trained a DL algorithm to diagnose steatosis stages (healthy, mild, moderate, or severe) from clinical ultrasound diagnoses. Performance was validated on two multi-scanner unblinded and blinded (initially to DL developer) histology-proven cohorts (147 and 112 patients) with histopathology fatty cell percentage diagnoses and a subset with FibroScan diagnoses. We also quantified reliability across scanners and viewpoints. Results were evaluated using Bland-Altman and receiver operating characteristic (ROC) analysis.
RESULTS The DL algorithm demonstrated repeatable measurements with a moderate number of images (three for each viewpoint) and high agreement across three premium ultrasound scanners. High diagnostic performance was observed across all viewpoints: Areas under the curve of the ROC to classify mild, moderate, and severe steatosis grades were 0.85, 0.91, and 0.93, respectively. The DL algorithm outperformed or performed at least comparably to FibroScan control attenuation parameter (CAP) with statistically significant improvements for all levels on the unblinded histology-proven cohort and for “= severe” steatosis on the blinded histology-proven cohort.
CONCLUSION The DL algorithm provides a reliable quantitative steatosis assessment across view and scanners on two multi-scanner cohorts. Diagnostic performance was high with comparable or better performance than the CAP.
Collapse
Affiliation(s)
- Bowen Li
- Research and Development, PAII Inc., Bethesda, MD 20817, United States
| | - Dar-In Tai
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan 33305, Taiwan
| | - Ke Yan
- Research and Development, PAII Inc., Bethesda, MD 20817, United States
| | - Yi-Cheng Chen
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan 33305, Taiwan
| | - Cheng-Jen Chen
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan 33305, Taiwan
| | - Shiu-Feng Huang
- Division of Molecular and Genomic Medicine, National Health Research Institute, Taoyuan 33305, Taiwan
| | - Tse-Hwa Hsu
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan 33305, Taiwan
| | - Wan-Ting Yu
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, Taoyuan 33305, Taiwan
| | - Jing Xiao
- Research and Development, Ping An Insurance Group, Shenzhen 518001, Guangdong, China
| | - Lu Le
- Research and Development, PAII Inc., Bethesda, MD 20817, United States
| | - Adam P Harrison
- Research and Development, PAII Inc., Bethesda, MD 20817, United States
| |
Collapse
|
18
|
Hao Y, Wang L, Liu Y, Fan J. Information Entropy Augmented High Density Crowd Counting Network. INT J SEMANT WEB INF 2022; 18:1-15. [DOI: 10.4018/ijswis.297144] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
Abstract
The research proposes an innovated structure of the density map-based crowd counting network augmented by information entropy. The network comprises of a front-end network to extract features and a back-end network to generate density maps. In order to validate the assumption that the entropy can boost the accuracy of density map generation, a multi-scale entropy map extraction process is imported into the front-end network along with a fine-tuned convolutional feature extraction process, In the back-end network, extracted features are decoded into the density map with a multi-column dilated convolution network. Finally, the decoded density map can be mapped as the estimated counting number. Experimental results indicate that the devised network is capable of accurately estimating the count in extremely high crowd density. Compared to similar structured networks which don’t adapt entropy feature, the proposed network exhibits higher performance. This result proves the feature of information entropy is capable of enhancing the efficiency of density map-based crowd counting approaches.
Collapse
Affiliation(s)
- Yu Hao
- Xi'an University of Posts and Telecommunications, China
| | - Lingzhe Wang
- Xi'an University of Posts and Telecommunications, China
| | - Ying Liu
- Xi'an University of Posts and Telecommunications, China
| | - Jiulun Fan
- Xi'an University of Posts and Telecommunications, China
| |
Collapse
|
19
|
Chan HJ, Zhou Z, Fang J, Tai DI, Tseng JH, Lai MW, Hsieh BY, Yamaguchi T, Tsui PH. Ultrasound Sample Entropy Imaging: A New Approach for Evaluating Hepatic Steatosis and Fibrosis. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2021; 9:1800612. [PMID: 34786215 PMCID: PMC8580366 DOI: 10.1109/jtehm.2021.3124937] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Revised: 08/20/2021] [Accepted: 10/10/2021] [Indexed: 02/05/2023]
Abstract
Objective: Hepatic steatosis causes nonalcoholic fatty liver disease and may progress to fibrosis. Ultrasound is the first-line approach to examining hepatic steatosis. Fatty droplets in the liver parenchyma alter ultrasound radiofrequency (RF) signal statistical properties. This study proposes using sample entropy, a measure of irregularity in time-series data determined by the dimension [Formula: see text] and tolerance [Formula: see text], for ultrasound parametric imaging of hepatic steatosis and fibrosis. Methods: Liver donors and patients were enrolled, and their hepatic fat fraction (HFF) ([Formula: see text]), steatosis grade ([Formula: see text]), and fibrosis score ([Formula: see text]) were measured to verify the results of sample entropy imaging using sliding-window processing of ultrasound RF data. Results: The sample entropy calculated using [Formula: see text] 4 and [Formula: see text] was highly correlated with the HFF when a small window with a side length of one pulse was used. The areas under the receiver operating characteristic curve for detecting hepatic steatosis that was [Formula: see text]mild, [Formula: see text]moderate, and [Formula: see text]severe were 0.86, 0.90, and 0.88, respectively, and the area was 0.87 for detecting liver fibrosis in individuals with significant steatosis. Discussion/Conclusions: Ultrasound sample entropy imaging enables the identification of time-series patterns in RF signals received from the liver. The algorithmic scheme proposed in this study is compatible with general ultrasound pulse-echo systems, allowing clinical fibrosis risk evaluations of individuals with developing hepatic steatosis.
Collapse
Affiliation(s)
- Hsien-Jung Chan
- Department of Medical Imaging and Radiological SciencesCollege of Medicine, Chang Gung UniversityTaoyuan333323Taiwan
| | - Zhuhuang Zhou
- Department of Biomedical EngineeringFaculty of Environment and LifeBeijing University of TechnologyBeijing100124China
| | - Jui Fang
- X-Dimension Center for Medical Research and TranslationChina Medical University HospitalTaichung40447Taiwan
| | - Dar-In Tai
- Department of Gastroenterology and HepatologyChang Gung Memorial Hospital at LinkouTaoyuan333423Taiwan
| | - Jeng-Hwei Tseng
- Department of Medical Imaging and InterventionChang Gung Memorial Hospital at LinkouTaoyuan333423Taiwan
| | - Ming-Wei Lai
- Division of Pediatric GastroenterologyDepartment of PediatricsChang Gung Memorial Hospital at LinkouTaoyuan333423Taiwan
| | - Bao-Yu Hsieh
- Department of Medical Imaging and Radiological SciencesCollege of Medicine, Chang Gung UniversityTaoyuan333323Taiwan
- Department of Medical Imaging and InterventionChang Gung Memorial Hospital at LinkouTaoyuan333423Taiwan
| | - Tadashi Yamaguchi
- Center for Frontier Medical EngineeringChiba UniversityChiba263-8522Japan
| | - Po-Hsiang Tsui
- Department of Medical Imaging and Radiological SciencesCollege of Medicine, Chang Gung UniversityTaoyuan333323Taiwan
- Division of Pediatric GastroenterologyDepartment of PediatricsChang Gung Memorial Hospital at LinkouTaoyuan333423Taiwan
- Institute for Radiological Research, Chang Gung UniversityTaoyuan333323Taiwan
| |
Collapse
|
20
|
Liao AH, Chen JR, Liu SH, Lu CH, Lin CW, Shieh JY, Weng WC, Tsui PH. Deep Learning of Ultrasound Imaging for Evaluating Ambulatory Function of Individuals with Duchenne Muscular Dystrophy. Diagnostics (Basel) 2021; 11:diagnostics11060963. [PMID: 34071811 PMCID: PMC8228495 DOI: 10.3390/diagnostics11060963] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2021] [Revised: 05/25/2021] [Accepted: 05/26/2021] [Indexed: 11/16/2022] Open
Abstract
Duchenne muscular dystrophy (DMD) results in loss of ambulation and premature death. Ultrasound provides real-time, safe, and cost-effective routine examinations. Deep learning allows the automatic generation of useful features for classification. This study utilized deep learning of ultrasound imaging for classifying patients with DMD based on their ambulatory function. A total of 85 individuals (including ambulatory and nonambulatory subjects) underwent ultrasound examinations of the gastrocnemius for deep learning of image data using LeNet, AlexNet, VGG-16, VGG-16TL, VGG-19, and VGG-19TL models (the notation TL indicates fine-tuning pretrained models). Gradient-weighted class activation mapping (Grad-CAM) was used to visualize features recognized by the models. The classification performance was evaluated using the confusion matrix and receiver operating characteristic (ROC) curve analysis. The results show that each deep learning model endows muscle ultrasound imaging with the ability to enable DMD evaluations. The Grad-CAMs indicated that boundary visibility, muscular texture clarity, and posterior shadowing are relevant sonographic features recognized by the models for evaluating ambulatory function. Of the proposed models, VGG-19 provided satisfying classification performance (the area under the ROC curve: 0.98; accuracy: 94.18%) and feature recognition in terms of physical characteristics. Deep learning of muscle ultrasound is a potential strategy for DMD characterization.
Collapse
Affiliation(s)
- Ai-Ho Liao
- Graduate Institute of Biomedical Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan; (A.-H.L.); (S.-H.L.)
- Department of Biomedical Engineering, National Defense Medical Center, Taipei 114201, Taiwan
| | - Jheng-Ru Chen
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan 333323, Taiwan; (J.-R.C.); (C.-H.L.)
| | - Shi-Hong Liu
- Graduate Institute of Biomedical Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan; (A.-H.L.); (S.-H.L.)
| | - Chun-Hao Lu
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan 333323, Taiwan; (J.-R.C.); (C.-H.L.)
| | - Chia-Wei Lin
- Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital Hsin-Chu Branch, Hsin-Chu 300195, Taiwan;
| | - Jeng-Yi Shieh
- Department of Physical Medicine and Rehabilitation, National Taiwan University Hospital, Taipei 100225, Taiwan;
| | - Wen-Chin Weng
- Department of Pediatrics, National Taiwan University Hospital, Taipei 100225, Taiwan
- Department of Pediatric Neurology, National Taiwan University Children’s Hospital, Taipei 100226, Taiwan
- Department of Pediatrics, College of Medicine, National Taiwan University, Taipei 100233, Taiwan
- Correspondence: (W.-C.W.); (P.-H.T.)
| | - Po-Hsiang Tsui
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan 333323, Taiwan; (J.-R.C.); (C.-H.L.)
- Institute for Radiological Research, Chang Gung University and Chang Gung Memorial Hospital, Linkou, Taoyuan 333323, Taiwan
- Division of Pediatric Gastroenterology, Department of Pediatrics, Chang Gung Memorial Hospital at Linkou, Taoyuan 333423, Taiwan
- Correspondence: (W.-C.W.); (P.-H.T.)
| |
Collapse
|
21
|
Chang TY, Chang SH, Lin YH, Ho WC, Wang CY, Jeng WJ, Wan YL, Tsui PH. Utility of quantitative ultrasound in community screening for hepatic steatosis. ULTRASONICS 2021; 111:106329. [PMID: 33338730 DOI: 10.1016/j.ultras.2020.106329] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/14/2020] [Revised: 11/10/2020] [Accepted: 12/01/2020] [Indexed: 06/12/2023]
Abstract
Nonalcoholic fatty liver disease (NAFLD) is the most common chronic liver disease. Quantitative ultrasound facilitates clinical grading of hepatic steatosis (the early stage of NAFLD). However, the utility of quantitative ultrasound as a first-line method for community screening of hepatic steatosis remains unclear. Therefore, this study aimed to investigate the utility of quantitative ultrasound to screen for hepatic steatosis and for metabolic evaluation at the community level. In total, 278 participants enrolled from a community satisfied the study criteria. Each subject underwent anthropometric and biochemical examinations, and abdominal ultrasound imaging was performed to measure the controlled attenuation (CAP), integrated backscatter (IB), and information Shannon entropy (ISE). The assessment outcomes were compared with the fatty liver index (FLI), hepatic steatosis index (HSI), metabolic syndrome (MetS), and insulin resistance to evaluate the screening performance through the area under the receiver operating characteristic curve (AUROC) and Delong's test. Ultrasound ISE, CAP, and IB were effective in screening hepatic steatosis, MetS, and insulin resistance. In screening for hepatic steatosis, the AUROCs of ISE, CAP, and IB were 0.85, 0.83, and 0.80 (the cutoff FLI = 60), respectively, and 0.84, 0.75, 0.77 (the cutoff HSI = 36), respectively, and those for the evaluation of MetS and insulin resistance were 0.79, 0.75, 0.79, respectively, and 0.83, 0.76, 0.78, respectively. Delong's test revealed that ISE outperformed CAP and IB for the detection of hepatic steatosis and insulin resistance (P < .05). Based on the present results, ultrasound ISE is a potential imaging biomarker during first-line community screening of hepatic steatosis and insulin resistance.
Collapse
Affiliation(s)
- Tu-Yung Chang
- Department of Anatomic Pathology, Chang Gung Memorial Hospital at Linkou, Taoyuan, Taiwan
| | - Shu-Hung Chang
- Graduate Institute of Gerontology and Health Care Management, Chang Gung University of Science and Technology, Taoyuan, Taiwan; Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Ying-Hsiu Lin
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Wen-Chao Ho
- Department of Public Health, College of Public Health, China Medical University, Taichung, Taiwan; Department of Nursing & Graduate Institute of Nursing, Asia University, Taichung, Taiwan
| | - Chiao-Yin Wang
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Wen-Juei Jeng
- Department of Gastroenterology and Hepatology, Chang Gung Memorial Hospital, Linkou Medical Center, College of Medicine, Chang Gung University, Taoyuan, Taiwan
| | - Yung-Liang Wan
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan, Taiwan; Department of Medical Imaging and Intervention, Chang Gung Memorial Hospital at Linkou, Taoyuan, Taiwan; Institute for Radiological Research, Chang Gung University and Chang Gung Memorial Hospital at Linkou, Taoyuan, Taiwan.
| | - Po-Hsiang Tsui
- Department of Medical Imaging and Radiological Sciences, College of Medicine, Chang Gung University, Taoyuan, Taiwan; Department of Medical Imaging and Intervention, Chang Gung Memorial Hospital at Linkou, Taoyuan, Taiwan; Institute for Radiological Research, Chang Gung University and Chang Gung Memorial Hospital at Linkou, Taoyuan, Taiwan.
| |
Collapse
|