1
|
Kabir MH, Reformat M, Southon Hryniuk S, Stampe K, Lou E. Automated Method for Growing Rod Length Measurement on Ultrasound Images in Children With Early Onset Scoliosis. ULTRASOUND IN MEDICINE & BIOLOGY 2024:S0301-5629(24)00269-2. [PMID: 39127521 DOI: 10.1016/j.ultrasmedbio.2024.07.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Revised: 07/11/2024] [Accepted: 07/16/2024] [Indexed: 08/12/2024]
Abstract
OBJECTIVE To develop and validate machine learning algorithms to automatically extract the rod length of the magnetically controlled growing rod from ultrasound images (US) in a pilot study. METHODS Two machine-learning (ML) models, called the "Boundary model" and "Rod model," were developed to identify specific rod segments on ultrasound images. The models were developed utilizing Mask Regional Convolutional Neural Networks (Mask RCNN). Ninety US images were acquired from 23 participants who had early onset scoliosis (EOS) surgeries; among those, 70 were used for model development, including training and validation, and 20 were used for testing by comparing the AI-based vs. manual measurements. RESULTS The average precision (AP) of the ML models was 88.5% and 60.2%, respectively. The inter-method correlation coefficient (ICC) was 0.98, and the mean absolute difference ± standard deviation (MAD ± SD) between AI and manual measurements was 0.86 ± 1.0 mm. The Bland-Altman analysis showed no bias, and 90% of the data were within the 95% confidence interval. The automated method was reliable, accurate, and fast. Measurements were displayed in 4.6 seconds after the US image was inputted. CONCLUSION This was the first AI-based method to measure the MCGR rod length on US images automatically.
Collapse
Affiliation(s)
- Mohammad Humayun Kabir
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
| | - Marek Reformat
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
| | | | - Kyle Stampe
- Department of Surgery, University of Alberta, Edmonton, AB, Canada
| | - Edmond Lou
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada.
| |
Collapse
|
2
|
Ali AM, Benjdira B, Koubaa A, El-Shafai W, Khan Z, Boulila W. Vision Transformers in Image Restoration: A Survey. SENSORS (BASEL, SWITZERLAND) 2023; 23:2385. [PMID: 36904589 PMCID: PMC10006889 DOI: 10.3390/s23052385] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Revised: 02/14/2023] [Accepted: 02/17/2023] [Indexed: 06/18/2023]
Abstract
The Vision Transformer (ViT) architecture has been remarkably successful in image restoration. For a while, Convolutional Neural Networks (CNN) predominated in most computer vision tasks. Now, both CNN and ViT are efficient approaches that demonstrate powerful capabilities to restore a better version of an image given in a low-quality format. In this study, the efficiency of ViT in image restoration is studied extensively. The ViT architectures are classified for every task of image restoration. Seven image restoration tasks are considered: Image Super-Resolution, Image Denoising, General Image Enhancement, JPEG Compression Artifact Reduction, Image Deblurring, Removing Adverse Weather Conditions, and Image Dehazing. The outcomes, the advantages, the limitations, and the possible areas for future research are detailed. Overall, it is noted that incorporating ViT in the new architectures for image restoration is becoming a rule. This is due to some advantages compared to CNN, such as better efficiency, especially when more data are fed to the network, robustness in feature extraction, and a better feature learning approach that sees better the variances and characteristics of the input. Nevertheless, some drawbacks exist, such as the need for more data to show the benefits of ViT over CNN, the increased computational cost due to the complexity of the self-attention block, a more challenging training process, and the lack of interpretability. These drawbacks represent the future research direction that should be targeted to increase the efficiency of ViT in the image restoration domain.
Collapse
Affiliation(s)
- Anas M. Ali
- Robotics and Internet-of-Things Laboratory, Prince Sultan University, Riyadh 12435, Saudi Arabia
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf 32952, Egypt
| | - Bilel Benjdira
- Robotics and Internet-of-Things Laboratory, Prince Sultan University, Riyadh 12435, Saudi Arabia
- SE & ICT Laboratory, LR18ES44, ENICarthage, University of Carthage, Tunis 1054, Tunisia
| | - Anis Koubaa
- Robotics and Internet-of-Things Laboratory, Prince Sultan University, Riyadh 12435, Saudi Arabia
| | - Walid El-Shafai
- Department of Electronics and Electrical Communications Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf 32952, Egypt
- Security Engineering Laboratory, Computer Science Department, Prince Sultan University, Riyadh 11586, Saudi Arabia
| | - Zahid Khan
- Robotics and Internet-of-Things Laboratory, Prince Sultan University, Riyadh 12435, Saudi Arabia
| | - Wadii Boulila
- Robotics and Internet-of-Things Laboratory, Prince Sultan University, Riyadh 12435, Saudi Arabia
- RIADI Laboratory, University of Manouba, Manouba 2010, Tunisia
| |
Collapse
|
3
|
Madireddy I, Wu T. Rule and Neural Network-Based Image Segmentation of Mice Vertebrae Images. Cureus 2022; 14:e27247. [PMID: 36039207 PMCID: PMC9401637 DOI: 10.7759/cureus.27247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/23/2022] [Indexed: 12/03/2022] Open
Abstract
Background Image segmentation is a fundamental technique that allows researchers to process images from various sources into individual components for certain applications, such as visual or numerical evaluations. Image segmentation is beneficial when studying medical images for healthcare purposes. However, existing semantic image segmentation models like the U-net are computationally intensive. This work aimed to develop less complicated models that could still accurately segment images. Methodology Rule-based and linear layer neural network models were developed in Mathematica and trained on mouse vertebrae micro-computed tomography scans. These models were tasked with segmenting the cortical shell from the whole bone image. A U-net model was also set up for comparison. Results It was found that the linear layer neural network had comparable accuracy to the U-net model in segmenting the mice vertebrae scans. Conclusions This work provides two separate models that allow for automated segmentation of mouse vertebral scans, which could be potentially valuable in applications such as pre-processing the murine vertebral scans for further evaluations of the effect of drug treatment on bone micro-architecture.
Collapse
|
4
|
Awasthi N, Vermeer L, Fixsen LS, Lopata RGP, Pluim JPW. LVNet: Lightweight Model for Left Ventricle Segmentation for Short Axis Views in Echocardiographic Imaging. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2022; 69:2115-2128. [PMID: 35452387 DOI: 10.1109/tuffc.2022.3169684] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Lightweight segmentation models are becoming more popular for fast diagnosis on small and low cost medical imaging devices. This study focuses on the segmentation of the left ventricle (LV) in cardiac ultrasound (US) images. A new lightweight model [LV network (LVNet)] is proposed for segmentation, which gives the benefits of requiring fewer parameters but with improved segmentation performance in terms of Dice score (DS). The proposed model is compared with state-of-the-art methods, such as UNet, MiniNetV2, and fully convolutional dense dilated network (FCdDN). The model proposed comes with a post-processing pipeline that further enhances the segmentation results. In general, the training is done directly using the segmentation mask as the output and the US image as the input of the model. A new strategy for segmentation is also introduced in addition to the direct training method used. Compared with the UNet model, an improvement in DS performance as high as 5% for segmentation with papillary (WP) muscles was found, while showcasing an improvement of 18.5% when the papillary muscles are excluded. The model proposed requires only 5% of the memory required by a UNet model. LVNet achieves a better trade-off between the number of parameters and its segmentation performance as compared with other conventional models. The developed codes are available at https://github.com/navchetanawasthi/Left_Ventricle_Segmentation.
Collapse
|
5
|
COVID-19 Diagnosis in Chest X-rays Using Deep Learning and Majority Voting. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11062884] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
The COVID-19 disease has spread all over the world, representing an intriguing challenge for humanity as a whole. The efficient diagnosis of humans infected by COVID-19 still remains an increasing need worldwide. The chest X-ray imagery represents, among others, one attractive means to detect COVID-19 cases efficiently. Many studies have reported the efficiency of using deep learning classifiers in diagnosing COVID-19 from chest X-ray images. They conducted several comparisons among a subset of classifiers to identify the most accurate. In this paper, we investigate the potential of the combination of state-of-the-art classifiers in achieving the highest possible accuracy for the detection of COVID-19 from X-ray. For this purpose, we conducted a comprehensive comparison study among 16 state-of-the-art classifiers. To the best of our knowledge, this is the first study considering this number of classifiers. This paper’s innovation lies in the methodology that we followed to develop the inference system that allows us to detect COVID-19 with high accuracy. The methodology consists of three steps: (1) comprehensive comparative study between 16 state-of-the-art classifiers; (2) comparison between different ensemble classification techniques, including hard/soft majority, weighted voting, Support Vector Machine, and Random Forest; and (3) finding the combination of deep learning models and ensemble classification techniques that lead to the highest classification confidence on three classes. We found that using the Majority Voting approach is an adequate strategy to adopt in general cases for this task and may achieve an average accuracy up to 99.314%.
Collapse
|
6
|
Chen WF, Ou HY, Liu KH, Li ZY, Liao CC, Wang SY, Huang W, Cheng YF, Pan CT. In-Series U-Net Network to 3D Tumor Image Reconstruction for Liver Hepatocellular Carcinoma Recognition. Diagnostics (Basel) 2020; 11:E11. [PMID: 33374672 PMCID: PMC7822491 DOI: 10.3390/diagnostics11010011] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2020] [Revised: 12/16/2020] [Accepted: 12/20/2020] [Indexed: 12/27/2022] Open
Abstract
Cancer is one of the common diseases. Quantitative biomarkers extracted from standard-of-care computed tomography (CT) scan can create a robust clinical decision tool for the diagnosis of hepatocellular carcinoma (HCC). According to the current clinical methods, the situation usually accounts for high expenditure of time and resources. To improve the current clinical diagnosis and therapeutic procedure, this paper proposes a deep learning-based approach, called Successive Encoder-Decoder (SED), to assist in the automatic interpretation of liver lesion/tumor segmentation through CT images. The SED framework consists of two different encoder-decoder networks connected in series. The first network aims to remove unwanted voxels and organs and to extract liver locations from CT images. The second network uses the results of the first network to further segment the lesions. For practical purpose, the predicted lesions on individual CTs were extracted and reconstructed on 3D images. The experiments conducted on 4300 CT images and LiTS dataset demonstrate that the liver segmentation and the tumor prediction achieved 0.92 and 0.75 in Dice score, respectively, by as-proposed SED method.
Collapse
Affiliation(s)
- Wen-Fan Chen
- Institute of Medical Science and Technology, National Sun Yat-sen University, Kaohsiung 80424, Taiwan;
| | - Hsin-You Ou
- Liver Transplantation Program and Departments of Diagnostic Radiology, Kaohsiung Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Kaohsiung 833401, Taiwan; (H.-Y.O.); (C.-C.L.)
| | - Keng-Hao Liu
- Department of Mechanical and Electro-Mechanical Engineering, National SunYat-sen University, Kaohsiung 80424, Taiwan; (K.-H.L.); (Z.-Y.L.); (S.-Y.W.); (W.H.)
| | - Zhi-Yun Li
- Department of Mechanical and Electro-Mechanical Engineering, National SunYat-sen University, Kaohsiung 80424, Taiwan; (K.-H.L.); (Z.-Y.L.); (S.-Y.W.); (W.H.)
| | - Chien-Chang Liao
- Liver Transplantation Program and Departments of Diagnostic Radiology, Kaohsiung Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Kaohsiung 833401, Taiwan; (H.-Y.O.); (C.-C.L.)
| | - Shao-Yu Wang
- Department of Mechanical and Electro-Mechanical Engineering, National SunYat-sen University, Kaohsiung 80424, Taiwan; (K.-H.L.); (Z.-Y.L.); (S.-Y.W.); (W.H.)
| | - Wen Huang
- Department of Mechanical and Electro-Mechanical Engineering, National SunYat-sen University, Kaohsiung 80424, Taiwan; (K.-H.L.); (Z.-Y.L.); (S.-Y.W.); (W.H.)
| | - Yu-Fan Cheng
- Liver Transplantation Program and Departments of Diagnostic Radiology, Kaohsiung Chang Gung Memorial Hospital, Chang Gung University College of Medicine, Kaohsiung 833401, Taiwan; (H.-Y.O.); (C.-C.L.)
| | - Cheng-Tang Pan
- Institute of Medical Science and Technology, National Sun Yat-sen University, Kaohsiung 80424, Taiwan;
- Department of Mechanical and Electro-Mechanical Engineering, National SunYat-sen University, Kaohsiung 80424, Taiwan; (K.-H.L.); (Z.-Y.L.); (S.-Y.W.); (W.H.)
| |
Collapse
|