1
|
Urhuț MC, Săndulescu LD, Streba CT, Mămuleanu M, Ciocâlteu A, Cazacu SM, Dănoiu S. Diagnostic Performance of an Artificial Intelligence Model Based on Contrast-Enhanced Ultrasound in Patients with Liver Lesions: A Comparative Study with Clinicians. Diagnostics (Basel) 2023; 13:3387. [PMID: 37958282 PMCID: PMC10650544 DOI: 10.3390/diagnostics13213387] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 10/29/2023] [Accepted: 11/02/2023] [Indexed: 11/15/2023] Open
Abstract
Contrast-enhanced ultrasound (CEUS) is widely used in the characterization of liver tumors; however, the evaluation of perfusion patterns using CEUS has a subjective character. This study aims to evaluate the accuracy of an automated method based on CEUS for classifying liver lesions and to compare its performance with that of two experienced clinicians. The system used for automatic classification is based on artificial intelligence (AI) algorithms. For an interpretation close to the clinical setting, both clinicians knew which patients were at high risk for hepatocellular carcinoma (HCC), but only one was aware of all the clinical data. In total, 49 patients with 59 liver tumors were included. For the benign and malignant classification, the AI model outperformed both clinicians in terms of specificity (100% vs. 93.33%); still, the sensitivity was lower (74% vs. 93.18% vs. 90.91%). In the second stage of multiclass diagnosis, the automatic model achieved a diagnostic accuracy of 69.93% for HCC and 89.15% for liver metastases. Readers demonstrated greater diagnostic accuracy for HCC (83.05% and 79.66%) and liver metastases (94.92% and 96.61%) compared to the AI system; however, both were experienced sonographers. The AI model could potentially assist and guide less-experienced clinicians to discriminate malignant from benign liver tumors with high accuracy and specificity.
Collapse
Affiliation(s)
- Marinela-Cristiana Urhuț
- Department of Gastroenterology, Emergency County Hospital of Craiova, Doctoral School, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania;
| | - Larisa Daniela Săndulescu
- Department of Gastroenterology, Research Center of Gastroenterology and Hepatology, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania; (C.T.S.); (A.C.); (S.M.C.)
| | - Costin Teodor Streba
- Department of Gastroenterology, Research Center of Gastroenterology and Hepatology, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania; (C.T.S.); (A.C.); (S.M.C.)
- Department of Pulmonology, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania
- Oncometrics S.R.L., 200677 Craiova, Romania;
| | - Mădălin Mămuleanu
- Oncometrics S.R.L., 200677 Craiova, Romania;
- Department of Automatic Control and Electronics, University of Craiova, 200585 Craiova, Romania
| | - Adriana Ciocâlteu
- Department of Gastroenterology, Research Center of Gastroenterology and Hepatology, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania; (C.T.S.); (A.C.); (S.M.C.)
| | - Sergiu Marian Cazacu
- Department of Gastroenterology, Research Center of Gastroenterology and Hepatology, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania; (C.T.S.); (A.C.); (S.M.C.)
| | - Suzana Dănoiu
- Department of Pathophysiology, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania;
| |
Collapse
|
2
|
Vetter M, Waldner MJ, Zundler S, Klett D, Bocklitz T, Neurath MF, Adler W, Jesper D. Artificial intelligence for the classification of focal liver lesions in ultrasound - a systematic review. ULTRASCHALL IN DER MEDIZIN (STUTTGART, GERMANY : 1980) 2023; 44:395-407. [PMID: 37001563 DOI: 10.1055/a-2066-9372] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
Focal liver lesions are detected in about 15% of abdominal ultrasound examinations. The diagnosis of frequent benign lesions can be determined reliably based on the characteristic B-mode appearance of cysts, hemangiomas, or typical focal fatty changes. In the case of focal liver lesions which remain unclear on B-mode ultrasound, contrast-enhanced ultrasound (CEUS) increases diagnostic accuracy for the distinction between benign and malignant liver lesions. Artificial intelligence describes applications that try to emulate human intelligence, at least in subfields such as the classification of images. Since ultrasound is considered to be a particularly examiner-dependent technique, the application of artificial intelligence could be an interesting approach for an objective and accurate diagnosis. In this systematic review we analyzed how artificial intelligence can be used to classify the benign or malignant nature and entity of focal liver lesions on the basis of B-mode or CEUS data. In a structured search on Scopus, Web of Science, PubMed, and IEEE, we found 52 studies that met the inclusion criteria. Studies showed good diagnostic performance for both the classification as benign or malignant and the differentiation of individual tumor entities. The results could be improved by inclusion of clinical parameters and were comparable to those of experienced investigators in terms of diagnostic accuracy. However, due to the limited spectrum of lesions included in the studies and a lack of independent validation cohorts, the transfer of the results into clinical practice is limited.
Collapse
Affiliation(s)
- Marcel Vetter
- Department of Internal Medicine 1, Erlangen University Hospital Department of Medicine 1 Gastroenterology Endocrinology and Pneumology, Erlangen, Germany
| | - Maximilian J Waldner
- Department of Internal Medicine 1, Erlangen University Hospital Department of Medicine 1 Gastroenterology Endocrinology and Pneumology, Erlangen, Germany
| | - Sebastian Zundler
- Department of Internal Medicine 1, Erlangen University Hospital Department of Medicine 1 Gastroenterology Endocrinology and Pneumology, Erlangen, Germany
| | - Daniel Klett
- Department of Internal Medicine 1, Erlangen University Hospital Department of Medicine 1 Gastroenterology Endocrinology and Pneumology, Erlangen, Germany
| | - Thomas Bocklitz
- Institute of Physical Chemistry and Abbe Center of Photonics, Friedrich-Schiller-Universitat Jena, Jena, Germany
- Leibniz-Institute of Photonic Technology, Friedrich Schiller University Jena, Jena, Germany
| | - Markus F Neurath
- Department of Internal Medicine 1, Erlangen University Hospital Department of Medicine 1 Gastroenterology Endocrinology and Pneumology, Erlangen, Germany
| | - Werner Adler
- Department of Medical Informatics, Biometry and Epidemiology, Friedrich-Alexander University Erlangen-Nuremberg, Erlangen, Germany
| | - Daniel Jesper
- Department of Internal Medicine 1, Erlangen University Hospital Department of Medicine 1 Gastroenterology Endocrinology and Pneumology, Erlangen, Germany
| |
Collapse
|
3
|
Martinino A, Aloulou M, Chatterjee S, Scarano Pereira JP, Singhal S, Patel T, Kirchgesner TPE, Agnes S, Annunziata S, Treglia G, Giovinazzo F. Artificial Intelligence in the Diagnosis of Hepatocellular Carcinoma: A Systematic Review. J Clin Med 2022; 11:6368. [PMID: 36362596 PMCID: PMC9655417 DOI: 10.3390/jcm11216368] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 10/21/2022] [Accepted: 10/26/2022] [Indexed: 09/21/2023] Open
Abstract
Hepatocellular carcinoma ranks fifth amongst the most common malignancies and is the third most common cause of cancer-related death globally. Artificial Intelligence is a rapidly growing field of interest. Following the PRISMA reporting guidelines, we conducted a systematic review to retrieve articles reporting the application of AI in HCC detection and characterization. A total of 27 articles were included and analyzed with our composite score for the evaluation of the quality of the publications. The contingency table reported a statistically significant constant improvement over the years of the total quality score (p = 0.004). Different AI methods have been adopted in the included articles correlated with 19 articles studying CT (41.30%), 20 studying US (43.47%), and 7 studying MRI (15.21%). No article has discussed the use of artificial intelligence in PET and X-ray technology. Our systematic approach has shown that previous works in HCC detection and characterization have assessed the comparability of conventional interpretation with machine learning using US, CT, and MRI. The distribution of the imaging techniques in our analysis reflects the usefulness and evolution of medical imaging for the diagnosis of HCC. Moreover, our results highlight an imminent need for data sharing in collaborative data repositories to minimize unnecessary repetition and wastage of resources.
Collapse
Affiliation(s)
| | | | - Surobhi Chatterjee
- Department of Internal Medicine, King George’s Medical University, Lucknow 226003, Uttar Pradesh, India
| | | | - Saurabh Singhal
- Department of HPB Surgery and Liver Transplantation, BLK-MAX Superspeciality Hospital, New Delhi 110005, Delhi, India
| | - Tapan Patel
- Department of Surgery, Baroda Medical College and SSG Hospital, Vadodara 390001, Gujarat, India
| | - Thomas Paul-Emile Kirchgesner
- Département of Radiology and Medical Imaging, Cliniques Universitaires Saint-Luc, Institut de Recherche Expérimentale et Clinique, Université Catholique de Louvain, 1348 Brussels, Belgium
| | - Salvatore Agnes
- General Surgery and Liver Transplantation Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, 00168 Rome, Italy
| | - Salvatore Annunziata
- Unit of Nuclear Medicine, Department of Radiology, Radiotherapy and Hematology, Fondazione Policlinico Universitario A. Gemelli IRCCS, 00168 Rome, Italy
| | - Giorgio Treglia
- Imaging Institute of Southern Switzerland, Ente Ospedaliero Cantonale, 6500 Bellinzona, Switzerland
- Faculty of Biomedical Sciences, Università della Svizzera Italiana, 6900 Lugano, Switzerland
- Faculty of Biology and Medicine, University of Lausanne, 1015 Lausanne, Switzerland
| | - Francesco Giovinazzo
- General Surgery and Liver Transplantation Unit, Fondazione Policlinico Universitario Agostino Gemelli IRCCS, 00168 Rome, Italy
| |
Collapse
|
4
|
Saito A, Yamamoto M, Katagiri S, Yamashita S, Nakano M, Morizane T. Early hemodynamics of hepatocellular carcinoma using contrast-enhanced ultrasound with Sonazoid: focus on the pure arterial and early portal phases. Glob Health Med 2020; 2:319-327. [PMID: 33330827 DOI: 10.35772/ghm.2020.01092] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2020] [Revised: 10/22/2020] [Accepted: 10/26/2020] [Indexed: 12/13/2022]
Abstract
To clarify the early hemodynamics of hepatocellular carcinoma (HCC), we defined the early portal phase of contrast-enhanced ultrasound (CEUS) and examined the reliability of this modality for determining HCC differentiation. Starting in 2007, we performed Sonazoid CEUS in 146 pathologically confirmed hepatic nodules; 118 HCC (8 poorly [Pd], 73 moderately [Md] and 37 well-differentiated [Wd]) and 28 benign nodules. We focused on the pure arterial and early portal phases up to 45 seconds after Sonazoid injection, and then the subsequent phase up to 30 minutes. We calculated covariance-adjusted sensitivities for nodule enhancement combinations of these three phases. Nodule enhancements were divided into hypo, iso and hyper. A positive predictive value of 100% was obtained for the following patterns: iso-iso-hypo, hypo-iso-iso, and hypo-hypo-hypo for Wd, hyper-iso-hypo and hyper-hypo-hypo for Md, hypo-hyper-hypo for Pd, and hyper-hyper-hyper for benign nodules. In Wd HCC (early HCC), there were seven enhancement patterns, thought to be characterized by various hemodynamic changes from early to advanced HCC. Two patterns allowing a diagnosis of Wd HCC were hypo in the pure arterial phase. Subsequent iso-enhancement in the early portal phase indicated a portal blood supply. Decreased enhancement in the early portal phase allows a diagnosis of Md HCC. However, gradual enhancement observed from the pure arterial to the early portal phase allows a diagnosis of Pd HCC. Therefore, even in the early portal phase, hemodynamic changes were visible not only in Wd but also in Md and Pd HCC. In conclusion, with division of the early phase hemodynamics into pure arterial and early portal phases, CEUS can provide information useful for determining the likely degree of HCC differentiation and for distinguishing early stage HCC from benign nodules.
Collapse
Affiliation(s)
- Akiko Saito
- Gastroenterology and Hepatology, National Center for Global Health and Medicine, Tokyo, Japan
| | - Masakazu Yamamoto
- Department of Surgery, Institute of Gastroenterology, Tokyo Women's Medical University, Tokyo, Japan
| | - Satoshi Katagiri
- Department of Surgery, Institute of Gastroenterology, Tokyo Women's Medical University, Tokyo, Japan
| | - Shingo Yamashita
- Department of Surgery, Institute of Gastroenterology, Tokyo Women's Medical University, Tokyo, Japan
| | | | | |
Collapse
|
5
|
Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI. Eur Radiol 2019; 29:3338-3347. [PMID: 31016442 DOI: 10.1007/s00330-019-06205-9] [Citation(s) in RCA: 166] [Impact Index Per Article: 33.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2018] [Revised: 03/06/2019] [Accepted: 03/26/2019] [Indexed: 02/07/2023]
Abstract
OBJECTIVES To develop and validate a proof-of-concept convolutional neural network (CNN)-based deep learning system (DLS) that classifies common hepatic lesions on multi-phasic MRI. METHODS A custom CNN was engineered by iteratively optimizing the network architecture and training cases, finally consisting of three convolutional layers with associated rectified linear units, two maximum pooling layers, and two fully connected layers. Four hundred ninety-four hepatic lesions with typical imaging features from six categories were utilized, divided into training (n = 434) and test (n = 60) sets. Established augmentation techniques were used to generate 43,400 training samples. An Adam optimizer was used for training. Monte Carlo cross-validation was performed. After model engineering was finalized, classification accuracy for the final CNN was compared with two board-certified radiologists on an identical unseen test set. RESULTS The DLS demonstrated a 92% accuracy, a 92% sensitivity (Sn), and a 98% specificity (Sp). Test set performance in a single run of random unseen cases showed an average 90% Sn and 98% Sp. The average Sn/Sp on these same cases for radiologists was 82.5%/96.5%. Results showed a 90% Sn for classifying hepatocellular carcinoma (HCC) compared to 60%/70% for radiologists. For HCC classification, the true positive and false positive rates were 93.5% and 1.6%, respectively, with a receiver operating characteristic area under the curve of 0.992. Computation time per lesion was 5.6 ms. CONCLUSION This preliminary deep learning study demonstrated feasibility for classifying lesions with typical imaging features from six common hepatic lesion types, motivating future studies with larger multi-institutional datasets and more complex imaging appearances. KEY POINTS • Deep learning demonstrates high performance in the classification of liver lesions on volumetric multi-phasic MRI, showing potential as an eventual decision-support tool for radiologists. • Demonstrating a classification runtime of a few milliseconds per lesion, a deep learning system could be incorporated into the clinical workflow in a time-efficient manner.
Collapse
|
6
|
Automated diagnosis of focal liver lesions using bidirectional empirical mode decomposition features. Comput Biol Med 2018; 94:11-18. [PMID: 29353161 DOI: 10.1016/j.compbiomed.2017.12.024] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2017] [Revised: 12/29/2017] [Accepted: 12/29/2017] [Indexed: 12/12/2022]
Abstract
Liver is the heaviest internal organ of the human body and performs many vital functions. Prolonged cirrhosis and fatty liver disease may lead to the formation of benign or malignant lesions in this organ, and an early and reliable evaluation of these conditions can improve treatment outcomes. Ultrasound imaging is a safe, non-invasive, and cost-effective way of diagnosing liver lesions. However, this technique has limited performance in determining the nature of the lesions. This study initiates a computer-aided diagnosis (CAD) system to aid radiologists in an objective and more reliable interpretation of ultrasound images of liver lesions. In this work, we have employed radon transform and bi-directional empirical mode decomposition (BEMD) to extract features from the focal liver lesions. After which, the extracted features were subjected to particle swarm optimization (PSO) technique for the selection of a set of optimized features for classification. Our automated CAD system can differentiate normal, malignant, and benign liver lesions using machine learning algorithms. It was trained using 78 normal, 26 benign and 36 malignant focal lesions of the liver. The accuracy, sensitivity, and specificity of lesion classification were 92.95%, 90.80%, and 97.44%, respectively. The proposed CAD system is fully automatic as no segmentation of region-of-interest (ROI) is required.
Collapse
|
7
|
Sugimoto K, Shiraishi J, Tanaka H, Tsuchiya K, Aso K, Kobayashi Y, Iijima H, Moriyasu F. Computer-aided diagnosis for estimating the malignancy grade of hepatocellular carcinoma using contrast-enhanced ultrasound: an ROC observer study. Liver Int 2016; 36:1026-32. [PMID: 26681659 DOI: 10.1111/liv.13043] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/26/2015] [Accepted: 12/07/2015] [Indexed: 02/13/2023]
Abstract
BACKGROUND & AIMS We are developing a computer-aided diagnosis (CAD) system for estimating the malignancy grade of hepatocellular carcinoma (HCC) using contrast-enhanced ultrasound (CEUS). In this study, observers estimated the malignancy grade of HCC with and without the cues provided by CAD. MATERIALS AND METHODS Institutional review board approval was obtained and informed consent was waived. A total of 232 histologically confirmed HCCs were studied: 76 well-differentiated HCC (w-HCC), 133 moderately differentiated HCC (m-HCC), and 23 poorly differentiated HCC (p-HCC). In this observer study, CEUS vascular images acquired using the maximum intensity projection technique were displayed together with static B-mode and Kupffer-phase (defined as 10 min after injection) images. Five hepatologists independently assigned confidence ratings for the malignancy grade of each HCC. Each hepatologist first read each case without CAD and then immediately afterwards with CAD. The observers' rating data were evaluated by multireader multicase receiver operating characteristic (ROC) analysis. RESULTS The overall sensitivity of our CAD system for discrimination between three histological differentiation grades of HCC was 87.5% (203/232). For discrimination between w-HCC and m/p-HCC, the mean area under the ROC curve (AUC) for the five observers was significantly improved from 0.779 ± 0.074 to 0.872 ± 0.090 with CAD (P = 0.0069). For discrimination between m-HCC and p-HCC, the mean AUC was also significantly improved from 0.713 ± 0.107 to 0.863 ± 0.101 with CAD (P = 0.0321). CONCLUSION The use of our CAD system can significantly improve the diagnostic performance of hepatologists in discriminating between three histological differentiation grades of HCC using CEUS.
Collapse
Affiliation(s)
- Katsutoshi Sugimoto
- Department of Gastroenterology and Hepatology, Tokyo Medical University, Tokyo, Japan
| | - Junji Shiraishi
- School of Health Sciences, Kumamoto University, Kumamoto, Japan
| | - Hironori Tanaka
- Ultrasound Imaging Center, Hyogo College of Medicine, Hyogo, Japan.,Department of Gastroenterology and Hepatology, Takarazuka City Hospital, Osaka, Japan
| | - Kaoru Tsuchiya
- Department of Gastroenterology and Hepatology, Musashino Red Cross Hospital, Tokyo, Japan
| | - Kazunobu Aso
- Division of Metabolism and Biosystemic Science, Department of Medicine, Asahikawa Medical University, Asahikawa, Japan
| | - Yoshiyuki Kobayashi
- Department of Gastroenterology and Hepatology, Tokyo Medical University, Tokyo, Japan
| | - Hiroko Iijima
- Ultrasound Imaging Center, Hyogo College of Medicine, Hyogo, Japan
| | - Fuminori Moriyasu
- Department of Gastroenterology and Hepatology, Tokyo Medical University, Tokyo, Japan
| |
Collapse
|
8
|
Moraru L, Bibicu D, Biswas A. Standalone functional CAD system for multi-object case analysis in hepatic disorders. Comput Biol Med 2013; 43:967-74. [DOI: 10.1016/j.compbiomed.2013.04.014] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2013] [Revised: 04/20/2013] [Accepted: 04/23/2013] [Indexed: 11/28/2022]
|