1
|
Liu Z, Kainth K, Zhou A, Deyer TW, Fayad ZA, Greenspan H, Mei X. A review of self-supervised, generative, and few-shot deep learning methods for data-limited magnetic resonance imaging segmentation. NMR IN BIOMEDICINE 2024; 37:e5143. [PMID: 38523402 DOI: 10.1002/nbm.5143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Revised: 02/15/2024] [Accepted: 02/16/2024] [Indexed: 03/26/2024]
Abstract
Magnetic resonance imaging (MRI) is a ubiquitous medical imaging technology with applications in disease diagnostics, intervention, and treatment planning. Accurate MRI segmentation is critical for diagnosing abnormalities, monitoring diseases, and deciding on a course of treatment. With the advent of advanced deep learning frameworks, fully automated and accurate MRI segmentation is advancing. Traditional supervised deep learning techniques have advanced tremendously, reaching clinical-level accuracy in the field of segmentation. However, these algorithms still require a large amount of annotated data, which is oftentimes unavailable or impractical. One way to circumvent this issue is to utilize algorithms that exploit a limited amount of labeled data. This paper aims to review such state-of-the-art algorithms that use a limited number of annotated samples. We explain the fundamental principles of self-supervised learning, generative models, few-shot learning, and semi-supervised learning and summarize their applications in cardiac, abdomen, and brain MRI segmentation. Throughout this review, we highlight algorithms that can be employed based on the quantity of annotated data available. We also present a comprehensive list of notable publicly available MRI segmentation datasets. To conclude, we discuss possible future directions of the field-including emerging algorithms, such as contrastive language-image pretraining, and potential combinations across the methods discussed-that can further increase the efficacy of image segmentation with limited labels.
Collapse
Affiliation(s)
- Zelong Liu
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Komal Kainth
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Alexander Zhou
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Timothy W Deyer
- East River Medical Imaging, New York, New York, USA
- Department of Radiology, Cornell Medicine, New York, New York, USA
| | - Zahi A Fayad
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Department of Diagnostic, Molecular, and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Hayit Greenspan
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Department of Diagnostic, Molecular, and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Xueyan Mei
- BioMedical Engineering and Imaging Institute, Icahn School of Medicine at Mount Sinai, New York, New York, USA
- Department of Diagnostic, Molecular, and Interventional Radiology, Icahn School of Medicine at Mount Sinai, New York, New York, USA
| |
Collapse
|
2
|
Ilesanmi AE, Ilesanmi TO, Ajayi BO. Reviewing 3D convolutional neural network approaches for medical image segmentation. Heliyon 2024; 10:e27398. [PMID: 38496891 PMCID: PMC10944240 DOI: 10.1016/j.heliyon.2024.e27398] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 02/27/2024] [Accepted: 02/28/2024] [Indexed: 03/19/2024] Open
Abstract
Background Convolutional neural networks (CNNs) assume pivotal roles in aiding clinicians in diagnosis and treatment decisions. The rapid evolution of imaging technology has established three-dimensional (3D) CNNs as a formidable framework for delineating organs and anomalies in medical images. The prominence of 3D CNN frameworks is steadily growing within medical image segmentation and classification. Thus, our proposition entails a comprehensive review, encapsulating diverse 3D CNN algorithms for the segmentation of medical image anomalies and organs. Methods This study systematically presents an exhaustive review of recent 3D CNN methodologies. Rigorous screening of abstracts and titles were carried out to establish their relevance. Research papers disseminated across academic repositories were meticulously chosen, analyzed, and appraised against specific criteria. Insights into the realm of anomalies and organ segmentation were derived, encompassing details such as network architecture and achieved accuracies. Results This paper offers an all-encompassing analysis, unveiling the prevailing trends in 3D CNN segmentation. In-depth elucidations encompass essential insights, constraints, observations, and avenues for future exploration. A discerning examination indicates the preponderance of the encoder-decoder network in segmentation tasks. The encoder-decoder framework affords a coherent methodology for the segmentation of medical images. Conclusion The findings of this study are poised to find application in clinical diagnosis and therapeutic interventions. Despite inherent limitations, CNN algorithms showcase commendable accuracy levels, solidifying their potential in medical image segmentation and classification endeavors.
Collapse
Affiliation(s)
- Ademola E. Ilesanmi
- University of Pennsylvania, 3710 Hamilton Walk, 6th Floor, Philadelphia, PA, 19104, United States
| | | | - Babatunde O. Ajayi
- National Astronomical Research Institute of Thailand, Chiang Mai 50180, Thailand
| |
Collapse
|
3
|
Emam MM, Samee NA, Jamjoom MM, Houssein EH. Optimized deep learning architecture for brain tumor classification using improved Hunger Games Search Algorithm. Comput Biol Med 2023; 160:106966. [PMID: 37141655 DOI: 10.1016/j.compbiomed.2023.106966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Revised: 04/05/2023] [Accepted: 04/19/2023] [Indexed: 05/06/2023]
Abstract
One of the worst diseases is a brain tumor, which is defined by abnormal development of synapses in the brain. Early detection of brain tumors is essential for improving prognosis, and classifying tumors is a vital step in the disease's treatment. Different classification strategies using deep learning have been presented for the diagnosis of brain tumors. However, several challenges exist, such as the need for a competent specialist in classifying brain cancers by deep learning models and the problem of building the most precise deep learning model for categorizing brain tumors. We propose an evolved and highly efficient model based on deep learning and improved metaheuristic algorithms to address these challenges. Specifically, we develop an optimized residual learning architecture for classifying multiple brain tumors and propose an improved variant of the Hunger Games Search algorithm (I-HGS) based on combining two enhancing strategies: Local Escaping Operator (LEO) and Brownian motion. These two strategies balance solution diversity and convergence speed, boosting the optimization performance and staying away from the local optima. First, we have evaluated the I-HGS algorithm on the IEEE Congress on Evolutionary Computation held in 2020 (CEC'2020) test functions, demonstrating that I-HGS outperformed the basic HGS and other popular algorithms regarding statistical convergence, and various measures. The suggested model is then applied to the optimization of the hyperparameters of the Residual Network 50 (ResNet50) model (I-HGS-ResNet50) for brain cancer identification, proving its overall efficacy. We utilize several publicly available, gold-standard datasets of brain MRI images. The proposed I-HGS-ResNet50 model is compared with other existing studies as well as with other deep learning architectures, including Visual Geometry Group 16-layer (VGG16), MobileNet, and Densely Connected Convolutional Network 201 (DenseNet201). The experiments demonstrated that the proposed I-HGS-ResNet50 model surpasses the previous studies and other well-known deep learning models. I-HGS-ResNet50 acquired an accuracy of 99.89%, 99.72%, and 99.88% for the three datasets. These results efficiently prove the potential of the proposed I-HGS-ResNet50 model for accurate brain tumor classification.
Collapse
Affiliation(s)
- Marwa M Emam
- Faculty of Computers and Information, Minia University, Minia, Egypt.
| | - Nagwan Abdel Samee
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia.
| | - Mona M Jamjoom
- Department of Computer Sciences, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, Riyadh 11671, Saudi Arabia.
| | - Essam H Houssein
- Faculty of Computers and Information, Minia University, Minia, Egypt.
| |
Collapse
|
4
|
Celik G. Detection of Covid-19 and other pneumonia cases from CT and X-ray chest images using deep learning based on feature reuse residual block and depthwise dilated convolutions neural network. Appl Soft Comput 2023; 133:109906. [PMID: 36504726 PMCID: PMC9726212 DOI: 10.1016/j.asoc.2022.109906] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2022] [Revised: 11/29/2022] [Accepted: 12/01/2022] [Indexed: 12/12/2022]
Abstract
Covid-19 has become a worldwide epidemic which has caused the death of millions in a very short time. This disease, which is transmitted rapidly, has mutated and different variations have emerged. Early diagnosis is important to prevent the spread of this disease. In this study, a new deep learning-based architecture is proposed for rapid detection of Covid-19 and other symptoms using CT and X-ray chest images. This method, called CovidDWNet, is based on a structure based on feature reuse residual block (FRB) and depthwise dilated convolutions (DDC) units. The FRB and DDC units efficiently acquired various features in the chest scan images and it was seen that the proposed architecture significantly improved its performance. In addition, the feature maps obtained with the CovidDWNet architecture were estimated with the Gradient boosting (GB) algorithm. With the CovidDWNet+GB architecture, which is a combination of CovidDWNet and GB, a performance increase of approximately 7% in CT images and between 3% and 4% in X-ray images has been achieved. The CovidDWNet+GB architecture achieved the highest success compared to other architectures, with 99.84% and 100% accuracy rates, respectively, on different datasets containing binary class (Covid-19 and Normal) CT images. Similarly, the proposed architecture showed the highest success with 96.81% accuracy in multi-class (Covid-19, Lung Opacity, Normal and Viral Pneumonia) X-ray images and 96.32% accuracy in the dataset containing X-ray and CT images. When the time to predict the disease in CT or X-ray images is examined, it is possible to say that it has a high speed because the CovidDWNet+GB method predicts thousands of images within seconds.
Collapse
Affiliation(s)
- Gaffari Celik
- Agri Ibrahim Cecen University, Department of Computer Technology, Agri, Turkey
| |
Collapse
|
5
|
Brain tumor detection using deep ensemble model with wavelet features. HEALTH AND TECHNOLOGY 2022. [DOI: 10.1007/s12553-022-00699-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
6
|
A new brain tumor diagnostic model: Selection of textural feature extraction algorithms and convolution neural network features with optimization algorithms. Comput Biol Med 2022; 148:105857. [PMID: 35868050 DOI: 10.1016/j.compbiomed.2022.105857] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Revised: 06/17/2022] [Accepted: 06/17/2022] [Indexed: 11/22/2022]
Abstract
Brain tumors are one of the most dangerous diseases that affect human health and maybe result in death. Detection of brain tumors can be made by using biopsy. However, this is an invasive procedure. It is an extremely dangerous procedure because it can cause bleeding and damage certain brain functions. For this reason, the type and the stage of the disease can be determined after a detailed examination by medical imaging techniques made by field experts. In this study, a computer-based hybrid diagnostic model with high accuracy rate is proposed to diagnose normal brain and brain having types of tumors from brain images obtained by magnetic resonance imaging (MRI) techniques. This diagnostic model consists of three stages. In the first stage, the features of the images were obtained with two different traditional methods, which are widely used in the literature, and the results were examined. In the second stage, different convolutional neural networks that can learn comprehensive information about images were used and the results were tested by obtaining the features of the images. In the third stage, all the feature sets that are obtained were combined, and genetic algorithms, particle swarm optimization technique and artificial bee colony optimization techniques were used for feature selection. The common features of the optimization techniques were used only once. Thus, metaheuristic optimization algorithms were used for feature selection and distinctive features of the images appeared. Feature sets were classified using support vector machine kernels. The proposed diagnostic model is better than the directly used methods with an accuracy rate of 98.22%. Consequently, this method can also be used in clinic service to diagnose tumor by using images of brain MRI.
Collapse
|