1
|
Lin Y, Huang J, Chen Y, Wen Z, Cao Y, Zhang L, Cai T, Yu C, He X. Evaluation of perfluoropropane (C 3F 8)-filled chitosan polyacrylic acid nanobubbles for ultrasound imaging of sentinel lymph nodes and tumors. Biomater Sci 2022; 10:6447-6459. [PMID: 36018299 DOI: 10.1039/d2bm01140a] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
Abstract
Accurate sentinel lymph node (SLN) identification is an important prerequisite for sentinel lymph node biopsy (SLNB). However, existing SLN mapping techniques, mainly imaging-guided methods, are severely restricted by the high cost of the instruments, harmful radiation or unsatisfactory imaging depths. Herein, we prepared a new ultrasound contrast agent by filling perfluoropropane (C3F8) into chitosan polyacrylic acid nanobubbles for precise SLN identification. The obtained ultrasound contrast agent, coined C3F8-CS-PAA nanobubbles, presents a nanometer size with a diameter of approximately 120 nm. The C3F8-CS-PAA nanobubbles of desirable size are able to enter lymphatic vessels and accumulate in the sentinel lymph node to enhance ultrasound imaging. As a result, the injection of C3F8-CS-PAA nanobubbles can remarkably enhance the ultrasound imaging lymph system, providing image guidance for sentinel lymph node biopsy. Furthermore, it was shown that such C3F8-CS-PAA nanobubbles can effectively permeate into the tumor region via the tumor-enhanced permeability and retention (EPR) effect to enhance tumor ultrasound imaging for monitoring tumorigenesis. This work highlights a novel nanoscale ultrasound contrast agent for the lymphatic system and tumor imaging, with great promise for subsequent studies and clinical applications.
Collapse
Affiliation(s)
- Yi Lin
- Department of Ultrasound, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400010, China.
| | - Ju Huang
- Chongqing Key Laboratory of Ultrasound Molecular Imaging, Institute of Ultrasound Imaging, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400010, China
| | - Yinyin Chen
- State Key Laboratory of Ultrasound in Medicine and Engineering & Chongqing Key Laboratory of Biomedical Engineering, College of Biomedical Engineering, Chongqing Medical University, Chongqing 400010, China
| | - Ziwei Wen
- Department of Ultrasound, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400010, China.
| | - Yang Cao
- Chongqing Key Laboratory of Ultrasound Molecular Imaging, Institute of Ultrasound Imaging, The Second Affiliated Hospital of Chongqing Medical University, Chongqing 400010, China
| | - Liang Zhang
- Department of Ultrasound, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400010, China.
| | - Tao Cai
- Department of Dermatology, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400010, China
| | - Chaoqun Yu
- College of Pharmacy, Chongqing Medical University, Chongqing 400010, China.
| | - Xuemei He
- Department of Ultrasound, The First Affiliated Hospital of Chongqing Medical University, Chongqing 400010, China.
| |
Collapse
|
2
|
Sunanda Biradar, Akkasaligar PT, Biradar S. Feature Extraction and Classification of Digital Kidney Ultrasound Images: A Hybrid Approach. PATTERN RECOGNITION AND IMAGE ANALYSIS 2022. [DOI: 10.1134/s1054661822020043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
3
|
Assessing Changes in Diabetic Retinopathy Caused by Diabetes Mellitus and Glaucoma Using Support Vector Machines in Combination with Differential Evolution Algorithm. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11093944] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The aim of this study is to evaluate the changes related to diabetic retinopathy (DR) (no changes, small or moderate changes) in patients with glaucoma and diabetes using artificial intelligence instruments: Support Vector Machines (SVM) in combination with a powerful optimization algorithm—Differential Evolution (DE). In order to classify the DR changes and to make predictions in various situations, an approach including SVM optimized with DE was applied. The role of the optimizer was to automatically determine the SVM parameters that lead to the lowest classification error. The study was conducted on a sample of 52 patients: particularly, 101 eyes with glaucoma and diabetes mellitus, in the Ophthalmology Clinic I of the “St. Spiridon” Clinical Hospital of Iaşi. The criteria considered in the modelling action were normal or hypertensive open-angle glaucoma, intraocular hypertension and associated diabetes. The patients with other types of glaucoma pseudoexfoliation, pigment, cortisone, neovascular and primitive angle-closure, and those without associated diabetes, were excluded. The assessment of diabetic retinopathy changes were carried out with Volk lens and Fundus Camera Zeiss retinal photography on the dilated pupil, inspecting all quadrants. The criteria for classifying the DR (early treatment diabetic retinopathy study—ETDRS) changes were: without changes (absence of DR), mild forma nonproliferative diabetic retinopathy (the presence of a single micro aneurysm), moderate form (micro aneurysms, hemorrhages in 2–3 quadrants, venous dilatations and soft exudates in a quadrant), severe form (micro aneurysms, hemorrhages in all quadrants, venous dilatation in 2–3 quadrants) and proliferative diabetic retinopathy (disk and retinal neovascularization in different quadrants). Any new clinical element that occurred in subsequent checks, which led to their inclusion in severe nonproliferative or proliferative forms of diabetic retinopathy, was considered to be the result of the progression of diabetic retinopathy. The results obtained were very good; in the testing phase, a 95.23% accuracy has been obtained, only one sample being wrongly classified. The effectiveness of the classification algorithm (SVM), developed in optimal form with DE, and used in predictions of retinal changes related to diabetes, was demonstrated.
Collapse
|
4
|
Shen YT, Chen L, Yue WW, Xu HX. Artificial intelligence in ultrasound. Eur J Radiol 2021; 139:109717. [PMID: 33962110 DOI: 10.1016/j.ejrad.2021.109717] [Citation(s) in RCA: 68] [Impact Index Per Article: 22.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Revised: 03/28/2021] [Accepted: 04/11/2021] [Indexed: 12/13/2022]
Abstract
Ultrasound (US), a flexible green imaging modality, is expanding globally as a first-line imaging technique in various clinical fields following with the continual emergence of advanced ultrasonic technologies and the well-established US-based digital health system. Actually, in US practice, qualified physicians should manually collect and visually evaluate images for the detection, identification and monitoring of diseases. The diagnostic performance is inevitably reduced due to the intrinsic property of high operator-dependence from US. In contrast, artificial intelligence (AI) excels at automatically recognizing complex patterns and providing quantitative assessment for imaging data, showing high potential to assist physicians in acquiring more accurate and reproducible results. In this article, we will provide a general understanding of AI, machine learning (ML) and deep learning (DL) technologies; We then review the rapidly growing applications of AI-especially DL technology in the field of US-based on the following anatomical regions: thyroid, breast, abdomen and pelvis, obstetrics heart and blood vessels, musculoskeletal system and other organs by covering image quality control, anatomy localization, object detection, lesion segmentation, and computer-aided diagnosis and prognosis evaluation; Finally, we offer our perspective on the challenges and opportunities for the clinical practice of biomedical AI systems in US.
Collapse
Affiliation(s)
- Yu-Ting Shen
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, Ultrasound Research and Education Institute, Tongji University School of Medicine, Tongji University Cancer Center, Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, National Clnical Research Center of Interventional Medicine, Shanghai, 200072, PR China
| | - Liang Chen
- Department of Gastroenterology, Shanghai Tenth People's Hospital, Tongji University School of Medicine, Shanghai, 200072, PR China
| | - Wen-Wen Yue
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, Ultrasound Research and Education Institute, Tongji University School of Medicine, Tongji University Cancer Center, Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, National Clnical Research Center of Interventional Medicine, Shanghai, 200072, PR China.
| | - Hui-Xiong Xu
- Department of Medical Ultrasound, Shanghai Tenth People's Hospital, Ultrasound Research and Education Institute, Tongji University School of Medicine, Tongji University Cancer Center, Shanghai Engineering Research Center of Ultrasound Diagnosis and Treatment, National Clnical Research Center of Interventional Medicine, Shanghai, 200072, PR China.
| |
Collapse
|
5
|
A AA, A R S, J A, A M. Correlation between Kidney Function and Sonographic Texture Features after Allograft Transplantation with Corresponding to Serum Creatinine: A Long Term Follow-Up Study. J Biomed Phys Eng 2020; 10:713-726. [PMID: 33364209 PMCID: PMC7753263 DOI: 10.31661/jbpe.v0i0.928] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2018] [Accepted: 06/17/2018] [Indexed: 01/18/2023]
Abstract
Background: The ability to monitor kidney function after transplantation is one of the major factors to improve care of patients. Objective: Authors recommend a computerized texture analysis using run-length matrix features for detection of changes in kidney tissue after allograft in ultrasound imaging. Material and Methods: A total of 40 kidney allograft recipients (28 male, 12 female) were used in this longitudinal study. Of the 40 patients, 23 and 17 patients showed increased serum creatinine (sCr) (increased group) and decreased sCr (decreased group), respectively. Twenty run-length matrix features were used for texture analysis in three normalizations. Correlations of texture features with serum creatinine (sCr) level and differences between before and after follow-up for each group were analyzed. An area under the receiver operating characteristic curve (Az) was measured to evaluate potential of proposed method. Results: The features under default and 3sigma normalization schemes via linear discriminant analysis (LDA) showed high performance in classifying decreased group with an Az
of 1. In classification of the increased group, the best performance gains were determined in the 3sigma normalization schemes via LDA with an Az of 0.974 corresponding to 95.65% sensitivity, 91.30% specificity, 93.47% accuracy, 91.67% PPV, and 95.45% NPV. Conclusion: Run-length matrix features not only have high potential for characterization but also can help physicians to diagnose kidney failure after transplantation.
Collapse
Affiliation(s)
- Abbasian Ardakani A
- PhD, Department of Medical Physics, School of Medicine, Iran University of Medical Sciences, Tehran, Iran
| | - Sattar A R
- MD, Department of Vascular and Interventional Radiology, School of Medicine, Namazi Hospital, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Abolghasemi J
- PhD, Department of Biostatistics, School of Public Health, Iran University of Medical Sciences, Tehran, Iran
| | - Mohammadi A
- MD, Department of Vascular and Interventional Radiology, School of Medicine, Namazi Hospital, Shiraz University of Medical Sciences, Shiraz, Iran
| |
Collapse
|
6
|
Yin S, Peng Q, Li H, Zhang Z, You X, Liu H, Fischer K, Furth SL, Tasian GE, Fan Y. Multi-instance Deep Learning with Graph Convolutional Neural Networks for Diagnosis of Kidney Diseases Using Ultrasound Imaging. UNCERTAINTY FOR SAFE UTILIZATION OF MACHINE LEARNING IN MEDICAL IMAGING AND CLINICAL IMAGE-BASED PROCEDURES : FIRST INTERNATIONAL WORKSHOP, UNSURE 2019, AND 8TH INTERNATIONAL WORKSHOP, CLIP 2019, HELD IN CONJUNCTION WITH MICCAI 2019, SH... 2019; 11840:146-154. [PMID: 31893285 PMCID: PMC6938161 DOI: 10.1007/978-3-030-32689-0_15] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
Ultrasound imaging (US) is commonly used in nephrology for diagnostic studies of the kidneys and lower urinary tract. However, it remains challenging to automate the disease diagnosis based on clinical 2D US images since they provide partial anatomic information of the kidney and the 2D images of the same kidney may have heterogeneous appearance. To overcome this challenge, we develop a novel multi-instance deep learning method to build a robust classifier by treating multiple 2D US images of each individual subject as multiple instances of one bag. Particularly, we adopt convolutional neural networks (CNNs) to learn instance-level features from 2D US kidney images and graph convolutional networks (GCNs) to further optimize the instance-level features by exploring potential correlation among instances of the same bag. We also adopt a gated attention-based MIL pooling to learn bag-level features using full-connected neural networks (FCNs). Finally, we integrate both instance-level and bag-level supervision to further improve the bag-level classification accuracy. Ablation studies and comparison results have demonstrated that our method could accurately diagnose kidney diseases using ultrasound imaging, with better performance than alternative state-of-the-art multi-instance deep learning methods.
Collapse
Affiliation(s)
- Shi Yin
- School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan, China
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Qinmu Peng
- School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan, China
| | - Hongming Li
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Zhengqiang Zhang
- School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan, China
| | - Xinge You
- School of Electronic Information and Communications, Huazhong University of Science and Technology, Wuhan, China
| | - Hangfan Liu
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Katherine Fischer
- Department of Surgery, Division of Pediatric Nephrology, The Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA
- Center for Pediatric Clinical Effectiveness, The Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA
| | - Susan L Furth
- Department of Pediatrics, The Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA
| | - Gregory E Tasian
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania, Philadelphia, PA 19104, USA
- Department of Surgery, Division of Pediatric Nephrology, The Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA
- Center for Pediatric Clinical Effectiveness, The Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA
| | - Yong Fan
- Department of Radiology, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| |
Collapse
|
7
|
Sagreiya H, Akhbardeh A, Li D, Sigrist R, Chung BI, Sonn GA, Tian L, Rubin DL, Willmann JK. Point Shear Wave Elastography Using Machine Learning to Differentiate Renal Cell Carcinoma and Angiomyolipoma. ULTRASOUND IN MEDICINE & BIOLOGY 2019; 45:1944-1954. [PMID: 31133445 PMCID: PMC6689386 DOI: 10.1016/j.ultrasmedbio.2019.04.009] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/05/2018] [Revised: 03/31/2019] [Accepted: 04/03/2019] [Indexed: 05/09/2023]
Abstract
The question of whether ultrasound point shear wave elastography can differentiate renal cell carcinoma (RCC) from angiomyolipoma (AML) is controversial. This study prospectively enrolled 51 patients with 52 renal tumors (42 RCCs, 10 AMLs). We obtained 10 measurements of shear wave velocity (SWV) in the renal tumor, cortex and medulla. Median SWV was first used to classify RCC versus AML. Next, the prediction accuracy of 4 machine learning algorithms-logistic regression, naïve Bayes, quadratic discriminant analysis and support vector machines (SVMs)-was evaluated, using statistical inputs from the tumor, cortex and combined statistical inputs from tumor, cortex and medulla. After leave-one-out cross validation, models were evaluated using the area under the receiver operating characteristic (ROC) curve (AUC). Tumor median SWV performed poorly (AUC = 0.62; p = 0.23). Except logistic regression, all machine learning algorithms reached statistical significance using combined statistical inputs (AUC = 0.78-0.98; p < 7.1 × 10-3). SVMs demonstrated 94% accuracy (AUC = 0.98; p = 3.13 × 10-6) and clearly outperformed median SWV in differentiating RCC from AML (p = 2.8 × 10-4).
Collapse
Affiliation(s)
- Hersh Sagreiya
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Alireza Akhbardeh
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Dandan Li
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Rosa Sigrist
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| | - Benjamin I Chung
- Department of Urology, Stanford University School of Medicine, Stanford, CA, USA
| | - Geoffrey A Sonn
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA; Department of Urology, Stanford University School of Medicine, Stanford, CA, USA
| | - Lu Tian
- Department of Health, Research & Policy, Stanford University, Stanford, CA, USA
| | - Daniel L Rubin
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA; Department of Biomedical Data Science, Stanford University, Stanford, CA, USA; Department of Medicine (Biomedical Informatics Research), Stanford University, Stanford, CA, USA.
| | - Jürgen K Willmann
- Department of Radiology, Stanford University School of Medicine, Stanford, CA, USA
| |
Collapse
|
8
|
Behr M, Noseworthy M, Kumbhare D. Feasibility of a Support Vector Machine Classifier for Myofascial Pain Syndrome: Diagnostic Case-Control Study. JOURNAL OF ULTRASOUND IN MEDICINE : OFFICIAL JOURNAL OF THE AMERICAN INSTITUTE OF ULTRASOUND IN MEDICINE 2019; 38:2119-2132. [PMID: 30614553 DOI: 10.1002/jum.14909] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/30/2018] [Revised: 11/09/2018] [Accepted: 11/26/2018] [Indexed: 06/09/2023]
Abstract
OBJECTIVES Myofascial pain syndrome (MPS) is the most common cause of chronic pain worldwide. The diagnosis of MPS is subjective, which has created a need for a robust quantitative method of diagnosing MPS. We propose that using a support vector machine (SVM) along with ultrasound (US) texture features can differentiate between healthy and MPS-affected skeletal muscle. METHODS B-mode US video data were collected in the upper trapezius muscle of healthy (29) participants and patients with active (21) and latent (19) MPS, using an acquisition method outlined in previous works. Regions of interest were extracted and filtered to obtain a unique set of 917 images where texture features were extracted from each region of interest to characterize each image. These texture features were then used to train 4 separate binary SVM classifiers using nested cross-validation to implement feature selection and hyperparameter tuning. The performance of each kernel was estimated on the data and validated through testing on a final holdout set. RESULTS The radial basis function kernel classifier had the greatest Matthews correlation coefficient performance estimate of 0.627 ± 0.073 (mean ± SD) along with the largest area under the curve of 91.0% ± 3.0%. The final holdout test for the radial basis function classifier resulted in 86.96 accuracy, a Matthews correlation coefficient of 0.724, 88% sensitivity, and 86% specificity, validating our earlier performance estimates. CONCLUSIONS We have demonstrated that specific US texture features that have been used in other computer-aided diagnostic literature are feasible to use for the classification of healthy and MPS muscle using a binary SVM classifier.
Collapse
Affiliation(s)
- Michael Behr
- Department of Medicine, Division of Physical Medicine and Rehabilitation, University of Toronto, Toronto, Ontario, Canada
| | - Michael Noseworthy
- McMaster School of Biomedical Engineering, McMaster University, Hamilton, Ontario, Canada
- Departments of Radiology, McMaster University, Hamilton, Ontario, Canada
- Departments of Electrical and Computer Engineering, McMaster University, Hamilton, Ontario, Canada
- Imaging Research Center, St Joseph's Healthcare, Hamilton, Ontario, Canada
| | - Dinesh Kumbhare
- Department of Medicine, Division of Physical Medicine and Rehabilitation, University of Toronto, Toronto, Ontario, Canada
- Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada
- McMaster School of Biomedical Engineering, McMaster University, Hamilton, Ontario, Canada
- Imaging Research Center, St Joseph's Healthcare, Hamilton, Ontario, Canada
| |
Collapse
|
9
|
Kokil P, Sudharson S. Automatic Detection of Renal Abnormalities by Off-the-shelf CNN Features. ACTA ACUST UNITED AC 2019. [DOI: 10.1080/09747338.2019.1613936] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Affiliation(s)
- Priyanka Kokil
- Department of Electronics and Communication Engineering, Indian Institute of Information Technology, Design and Manufacturing, Kancheepuram, 600127 Chennai, India
| | - S. Sudharson
- Department of Electronics and Communication Engineering, Indian Institute of Information Technology, Design and Manufacturing, Kancheepuram, 600127 Chennai, India
| |
Collapse
|
10
|
Zheng Q, Furth SL, Tasian GE, Fan Y. Computer-aided diagnosis of congenital abnormalities of the kidney and urinary tract in children based on ultrasound imaging data by integrating texture image features and deep transfer learning image features. J Pediatr Urol 2019; 15:75.e1-75.e7. [PMID: 30473474 PMCID: PMC6410741 DOI: 10.1016/j.jpurol.2018.10.020] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/10/2018] [Revised: 10/20/2018] [Accepted: 10/25/2018] [Indexed: 12/29/2022]
Abstract
INTRODUCTION Anatomic characteristics of kidneys derived from ultrasound images are potential biomarkers of children with congenital abnormalities of the kidney and urinary tract (CAKUT), but current methods are limited by the lack of automated processes that accurately classify diseased and normal kidneys. OBJECTIVE The objective of the study was to evaluate the diagnostic performance of deep transfer learning techniques to classify kidneys of normal children and those with CAKUT. STUDY DESIGN A transfer learning method was developed to extract features of kidneys from ultrasound images obtained during routine clinical care of 50 children with CAKUT and 50 controls. To classify diseased and normal kidneys, support vector machine classifiers were built on the extracted features using (1) transfer learning imaging features from a pretrained deep learning model, (2) conventional imaging features, and (3) their combination. These classifiers were compared, and their diagnosis performance was measured using area under the receiver operating characteristic curve (AUC), accuracy, specificity, and sensitivity. RESULTS The AUC for classifiers built on the combination features were 0.92, 0.88, and 0.92 for discriminating the left, right, and bilateral abnormal kidney scans from controls with classification rates of 84%, 81%, and 87%; specificity of 84%, 74%, and 88%; and sensitivity of 85%, 88%, and 86%, respectively. These classifiers performed better than classifiers built on either the transfer learning features or the conventional features alone (p < 0.001). DISCUSSION The present study validated transfer learning techniques for imaging feature extraction of ultrasound images to build classifiers for distinguishing children with CAKUT from controls. The experiments have demonstrated that the classifiers built on the transfer learning features and conventional image features could distinguish abnormal kidney images from controls with AUCs greater than 0.88, indicating that classification of ultrasound kidney scans has a great potential to aid kidney disease diagnosis. A limitation of the present study is the moderate number of patients that contributed data to the transfer learning approach. CONCLUSIONS The combination of transfer learning and conventional imaging features yielded the best classification performance for distinguishing children with CAKUT from controls based on ultrasound images of kidneys.
Collapse
Affiliation(s)
- Q Zheng
- Department of Radiology, School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA; School of Computer and Control Engineering, Yantai University, Yantai, 264005, China
| | - S L Furth
- Department of Pediatrics, Division of Pediatric Nephrology, The Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA
| | - G E Tasian
- Department of Surgery, Division of Pediatric Urology, The Children's Hospital of Philadelphia, Philadelphia, PA 19104, USA; Center for Pediatric Clinical Effectiveness, The Children's Hospital of Philadelphia, Philadelphia, PA, USA; Department of Biostatistics, Epidemiology, and Informatics, The University of Pennsylvania, Philadelphia, PA, USA
| | - Y Fan
- Department of Radiology, School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA.
| |
Collapse
|
11
|
Kriti, Virmani J, Agarwal R. Assessment of despeckle filtering algorithms for segmentation of breast tumours from ultrasound images. Biocybern Biomed Eng 2019. [DOI: 10.1016/j.bbe.2018.10.002] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
12
|
Zheng Q, Tasian G, Fan Y. TRANSFER LEARNING FOR DIAGNOSIS OF CONGENITAL ABNORMALITIES OF THE KIDNEY AND URINARY TRACT IN CHILDREN BASED ON ULTRASOUND IMAGING DATA. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2018; 2018:1487-1490. [PMID: 30079128 DOI: 10.1109/isbi.2018.8363854] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Classification of ultrasound (US) kidney images for diagnosis of congenital abnormalities of the kidney and urinary tract (CAKUT) in children is a challenging task. It is desirable to improve existing pattern classification models that are built upon conventional image features. In this study, we propose a transfer learning-based method to extract imaging features from US kidney images in order to improve the CAKUT diagnosis in children. Particularly, a pre-trained deep learning model (imagenet-caffe-alex) is adopted for transfer learning-based feature extraction from 3-channel feature maps computed from US images, including original images, gradient features, and distanced transform features. Support vector machine classifiers are then built upon different sets of features, including the transfer learning features, conventional imaging features, and their combination. Experimental results have demonstrated that the combination of transfer learning features and conventional imaging features yielded the best classification performance for distinguishing CAKUT patients from normal controls based on their US kidney images.
Collapse
Affiliation(s)
- Qiang Zheng
- Department of Radiology, School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA.,School of Computer and Control Engineering, Yantai University, Yantai, 264005, China.,National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China
| | - Gregory Tasian
- The Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA
| | - Yong Fan
- Department of Radiology, School of Medicine, University of Pennsylvania, Philadelphia, PA, 19104, USA
| |
Collapse
|
13
|
Brattain LJ, Telfer BA, Dhyani M, Grajo JR, Samir AE. Machine learning for medical ultrasound: status, methods, and future opportunities. Abdom Radiol (NY) 2018; 43:786-799. [PMID: 29492605 PMCID: PMC5886811 DOI: 10.1007/s00261-018-1517-0] [Citation(s) in RCA: 109] [Impact Index Per Article: 18.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Ultrasound (US) imaging is the most commonly performed cross-sectional diagnostic imaging modality in the practice of medicine. It is low-cost, non-ionizing, portable, and capable of real-time image acquisition and display. US is a rapidly evolving technology with significant challenges and opportunities. Challenges include high inter- and intra-operator variability and limited image quality control. Tremendous opportunities have arisen in the last decade as a result of exponential growth in available computational power coupled with progressive miniaturization of US devices. As US devices become smaller, enhanced computational capability can contribute significantly to decreasing variability through advanced image processing. In this paper, we review leading machine learning (ML) approaches and research directions in US, with an emphasis on recent ML advances. We also present our outlook on future opportunities for ML techniques to further improve clinical workflow and US-based disease diagnosis and characterization.
Collapse
Affiliation(s)
| | - Brian A Telfer
- MIT Lincoln Laboratory, 244 Wood St, Lexington, MA, 02420, USA
| | - Manish Dhyani
- Department of Internal Medicine, Steward Carney Hospital, Boston, MA, 02124, USA
- Division of Ultrasound, Department of Radiology, Center for Ultrasound Research & Translation, Massachusetts General Hospital, Boston, MA, 02114, USA
| | - Joseph R Grajo
- Department of Radiology, Division of Abdominal Imaging, University of Florida College of Medicine, Gainesville, FL, USA
| | - Anthony E Samir
- Division of Ultrasound, Department of Radiology, Center for Ultrasound Research & Translation, Massachusetts General Hospital, Boston, MA, 02114, USA
| |
Collapse
|
14
|
Sharma K, Virmani J. A Decision Support System for Classification of Normal and Medical Renal Disease Using Ultrasound Images. ACTA ACUST UNITED AC 2017. [DOI: 10.4018/ijaci.2017040104] [Citation(s) in RCA: 79] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Early detection of medical renal disease is important as the same may lead to chronic kidney disease which is an irreversible stage. The present work proposes an efficient decision support system for detection of medical renal disease using small feature space consisting of only second order GLCM statistical features computed from raw renal ultrasound images. The GLCM mean feature vector and GLCM range feature vector are computed for inter-pixel distance d varying from 1 to 10. These texture feature vectors are combined in various ways yielding GLCM ratio feature vector, GLCM additive feature vector and GLCM concatenated feature vector. The present work explores the potential of five texture feature vectors computed using GLCM statistics exhaustively for differential diagnosis between normal and MRD images using SVM classifier. The result of the study indicates that GLCM range feature vector computed with d = 1 yields the highest overall classification accuracy of 85.7% with individual classification accuracy values of 93.3% and 77.9% for normal and MRD classes respectively.
Collapse
Affiliation(s)
- Komal Sharma
- Electrical and Instrumentation Engineering Department, Thapar University, Patiala, India
| | - Jitendra Virmani
- Electrical and Instrumentation Engineering Department, Thapar University, Patiala, India
| |
Collapse
|