1
|
Jafrasteh B, Lubián-Gutiérrez M, Lubián-López SP, Benavente-Fernández I. Enhanced Spatial Fuzzy C-Means Algorithm for Brain Tissue Segmentation in T1 Images. Neuroinformatics 2024:10.1007/s12021-024-09661-x. [PMID: 38656595 DOI: 10.1007/s12021-024-09661-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/15/2024] [Indexed: 04/26/2024]
Abstract
Magnetic Resonance Imaging (MRI) plays an important role in neurology, particularly in the precise segmentation of brain tissues. Accurate segmentation is crucial for diagnosing brain injuries and neurodegenerative conditions. We introduce an Enhanced Spatial Fuzzy C-means (esFCM) algorithm for 3D T1 MRI segmentation to three tissues, i.e. White Matter (WM), Gray Matter (GM), and Cerebrospinal Fluid (CSF). The esFCM employs a weighted least square algorithm utilizing the Structural Similarity Index (SSIM) for polynomial bias field correction. It also takes advantage of the information from the membership function of the last iteration to compute neighborhood impact. This strategic refinement enhances the algorithm's adaptability to complex image structures, effectively addressing challenges such as intensity irregularities and contributing to heightened segmentation accuracy. We compare the segmentation accuracy of esFCM against four variants of FCM, Gaussian Mixture Model (GMM) and FSL and ANTs algorithms using four various dataset, employing three measurement criteria. Comparative assessments underscore esFCM's superior performance, particularly in scenarios involving added noise and bias fields.The obtained results emphasize the significant potential of the proposed method in the segmentation of MRI images.
Collapse
Affiliation(s)
- Bahram Jafrasteh
- Biomedical Research and Innovation Institute of Cádiz (INiBICA) Research Unit, Puerta del Mar University Hospital, Cádiz, 11008, Spain.
| | - Manuel Lubián-Gutiérrez
- Biomedical Research and Innovation Institute of Cádiz (INiBICA) Research Unit, Puerta del Mar University Hospital, Cádiz, 11008, Spain
- Division of Neonatology, Department of Paediatrics, Puerta del Mar University Hospital, Cádiz, 11008, Spain
| | - Simón Pedro Lubián-López
- Biomedical Research and Innovation Institute of Cádiz (INiBICA) Research Unit, Puerta del Mar University Hospital, Cádiz, 11008, Spain
- Division of Neonatology, Department of Paediatrics, Puerta del Mar University Hospital, Cádiz, 11008, Spain
| | - Isabel Benavente-Fernández
- Biomedical Research and Innovation Institute of Cádiz (INiBICA) Research Unit, Puerta del Mar University Hospital, Cádiz, 11008, Spain
- Division of Neonatology, Department of Paediatrics, Puerta del Mar University Hospital, Cádiz, 11008, Spain
- Area of Paediatrics, Department of Child and Mother Health and Radiology, Medical School, University of Cádiz, Cádiz, 11003, Spain
| |
Collapse
|
2
|
Guo Y, Chen M, Yang L, Yin H, Yang H, Zhou Y. A neural network with a human learning paradigm for breast fibroadenoma segmentation in sonography. Biomed Eng Online 2024; 23:5. [PMID: 38221632 PMCID: PMC10787993 DOI: 10.1186/s12938-024-01198-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Accepted: 01/04/2024] [Indexed: 01/16/2024] Open
Abstract
BACKGROUND Breast fibroadenoma poses a significant health concern, particularly for young women. Computer-aided diagnosis has emerged as an effective and efficient method for the early and accurate detection of various solid tumors. Automatic segmentation of the breast fibroadenoma is important and potentially reduces unnecessary biopsies, but challenging due to the low image quality and presence of various artifacts in sonography. METHODS Human learning involves modularizing complete information and then integrating it through dense contextual connections in an intuitive and efficient way. Here, a human learning paradigm was introduced to guide the neural network by using two consecutive phases: the feature fragmentation stage and the information aggregation stage. To optimize this paradigm, three fragmentation attention mechanisms and information aggregation mechanisms were adapted according to the characteristics of sonography. The evaluation was conducted using a local dataset comprising 600 breast ultrasound images from 30 patients at Suining Central Hospital in China. Additionally, a public dataset consisting of 246 breast ultrasound images from Dataset_BUSI and DatasetB was used to further validate the robustness of the proposed network. Segmentation performance and inference speed were assessed by Dice similarity coefficient (DSC), Hausdorff distance (HD), and training time and then compared with those of the baseline model (TransUNet) and other state-of-the-art methods. RESULTS Most models guided by the human learning paradigm demonstrated improved segmentation on the local dataset with the best one (incorporating C3ECA and LogSparse Attention modules) outperforming the baseline model by 0.76% in DSC and 3.14 mm in HD and reducing the training time by 31.25%. Its robustness and efficiency on the public dataset are also confirmed, surpassing TransUNet by 0.42% in DSC and 5.13 mm in HD. CONCLUSIONS Our proposed human learning paradigm has demonstrated the superiority and efficiency of ultrasound breast fibroadenoma segmentation across both public and local datasets. This intuitive and efficient learning paradigm as the core of neural networks holds immense potential in medical image processing.
Collapse
Affiliation(s)
- Yongxin Guo
- State Key Laboratory of Ultrasound in Medicine and Engineering, College of Biomedical Engineering, Chongqing Medical University, 1 Medical College Road, Chongqing, 400016, China
- Chongqing Key Laboratory of Biomedical Engineering, Chongqing Medical University, Chongqing, 400016, China
| | - Maoshan Chen
- Department of Breast and Thyroid Surgery, Suining Central Hospital, Suining, 629000, China
| | - Lei Yang
- Department of Breast and Thyroid Surgery, Suining Central Hospital, Suining, 629000, China
| | - Heng Yin
- Department of Breast and Thyroid Surgery, Suining Central Hospital, Suining, 629000, China
| | - Hongwei Yang
- Department of Breast and Thyroid Surgery, Suining Central Hospital, Suining, 629000, China
| | - Yufeng Zhou
- State Key Laboratory of Ultrasound in Medicine and Engineering, College of Biomedical Engineering, Chongqing Medical University, 1 Medical College Road, Chongqing, 400016, China.
- Chongqing Key Laboratory of Biomedical Engineering, Chongqing Medical University, Chongqing, 400016, China.
- National Medical Products Administration (NMPA) Key Laboratory for Quality Evaluation of Ultrasonic Surgical Equipment, 507 Gaoxin Ave., Donghu New Technology Development Zone, Wuhan, 430075, Hubei, China.
| |
Collapse
|
3
|
Yu L, Liu J, Wu Q, Wang J, Qu A. A Siamese-Transport Domain Adaptation Framework for 3D MRI Classification of Gliomas and Alzheimer's Diseases. IEEE J Biomed Health Inform 2024; 28:391-402. [PMID: 37955996 DOI: 10.1109/jbhi.2023.3332419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2023]
Abstract
Accurate and fully automated brain structure examination and prediction from 3D volumetric magnetic resonance imaging (MRI) is a necessary step in medical imaging analysis, which can assist greatly in clinical diagnosis. Traditional deep learning models suffer from severe performance degradation when applied to clinically acquired unlabeled data. The performance degradation is mainly caused by domain discrepancy such as different device types and parameter settings for data acquisition. However, existing approaches focus on the reduction of domain discrepancies but ignore the entanglement of semantic features and domain information. In this article, we explore the feature invariance of categories and domains in different projection spaces and propose a Siamese-Transport Domain Adaptation (STDA) method using a joint optimal transport theory and contrastive learning for automatic 3D MRI classification and glioma multi-grade prediction. Specifically, the learning framework updates the distribution of features across domains and categories by Siamese transport network training with an Optimal Cost Transfer Strategy (OCTS) and a Mutual Invariant Constraint (MIC) in two projective spaces to find multiple invariants in potential heterogeneity. We design three sets of transfer task scenarios with different source and target domains, and demonstrate that STDA yields substantially higher generalization performance than other state-of-the-art unsupervised domain adaptation (UDA) methods. The method is applicable on 3D MRI data from glioma to Alzheimer's disease and has promising applications in the future clinical diagnosis and treatment of brain diseases.
Collapse
|
4
|
Nour Eddin J, Dorez H, Curcio V. Automatic brain extraction and brain tissues segmentation on multi-contrast animal MRI. Sci Rep 2023; 13:6416. [PMID: 37076580 PMCID: PMC10115851 DOI: 10.1038/s41598-023-33289-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 04/11/2023] [Indexed: 04/21/2023] Open
Abstract
For many neuroscience applications, brain extraction in MRI images is the first pre-processing step of a quantification pipeline. Once the brain is extracted, further post-processing calculations become faster, more specific and easier to implement and interpret. It is the case, for example, of functional MRI brain studies, or relaxation time mappings and brain tissues classifications to characterise brain pathologies. Existing brain extraction tools are mostly adapted to work on the human anatomy, this gives poor results when applied to animal brain images. We have developed an atlas-based Veterinary Images Brain Extraction (VIBE) algorithm that encompasses a pre-processing step to adapt the atlas to the patient's image, and a subsequent registration step. We show that the brain extraction is achieved with excellent results in terms of Dice and Jaccard metrics. The algorithm is automatic, with no need to adapt the parameters in a broad range of situations: we successfully tested multiple MRI contrasts (T1-weighted, T2-weighted, T2-weighted FLAIR), all the acquisition planes (sagittal, dorsal, transverse), different animal species (dogs and cats) and canine cranial conformations (brachycephalic, mesocephalic, dolichocephalic). VIBE can be successfully extended to other animal species, provided that an atlas for that specific species exists. We show also how brain extraction, as a preliminary step, can help to segment brain tissues with a K-Means clustering algorithm.
Collapse
|
5
|
Wang X, Yang Y, Wu T, Zhu H, Yu J, Tian J, Li H. Energy minimization segmentation model based on MRI images. Front Neurosci 2023; 17:1175451. [PMID: 37123357 PMCID: PMC10140403 DOI: 10.3389/fnins.2023.1175451] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Accepted: 03/24/2023] [Indexed: 05/02/2023] Open
Abstract
Introduction Medical image segmentation is an important tool for doctors to accurately analyze the volume of brain tissue and lesions, which is important for the correct diagnosis of brain diseases. However, manual image segmentation methods are time-consuming, subjective and lack of repeatability, it needs to develop automatic and reliable methods for image segmentation. Methods Magnetic Resonance Imaging (MRI), a non-invasive imaging technique, is commonly used to detect, characterize and quantify tissues and lesions in the brain. Partial volume effect, gray scale in homogeneity, and lesions presents a great challenge for automatic medical image segmentation methods. So, the paper is dedicated to address the impact of partial volume effect and multiple sclerosis lesions on the segmentation accuracy in MRI. The objective function of the improved model and the post-processing method of lesion filling are researched based on the fuzzy clustering space and energy model. Results In particular, an energy-minimized segmentation algorithm is proposed. Through experimental verification, the AR-FCM algorithm can better overcome the problem of low segmentation accuracy of the RFCM algorithm for tissue boundary voxels and improve the segmentation accuracy of this algorithm. Meanwhile, a multi-channel input energy-minimization segmentation method with lesion filling and anatomical mapping is further proposed. Discussion The feasibility of the lesion filling strategy using post-processing can be confirmed and the segmentation accuracy is increased by comparison experiments.
Collapse
Affiliation(s)
- Xiuxin Wang
- Chongqing University of Posts and Telecommunications, Chongqing, China
- Institute for Advanced Sciences, Chongqing University of Posts and Telecommunications, Chongqing, China
- *Correspondence: Xiuxin Wang,
| | - Yuling Yang
- Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Ting Wu
- Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Hao Zhu
- Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Jisheng Yu
- Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Jian Tian
- Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Hongzhong Li
- School of Civil Engineering, Guangdong Communication Polytechnic, Guangzhou, China
- Hongzhong Li,
| |
Collapse
|
6
|
Wang Y, Cao Y, Li J, Wu H, Wang S, Dong X, Yu H. A lightweight hierarchical convolution network for brain tumor segmentation. BMC Bioinformatics 2022; 22:636. [PMID: 36513986 PMCID: PMC9749147 DOI: 10.1186/s12859-022-05039-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 11/04/2022] [Indexed: 12/14/2022] Open
Abstract
BACKGROUND Brain tumor segmentation plays a significant role in clinical treatment and surgical planning. Recently, several deep convolutional networks have been proposed for brain tumor segmentation and have achieved impressive performance. However, most state-of-the-art models use 3D convolution networks, which require high computational costs. This makes it difficult to apply these models to medical equipment in the future. Additionally, due to the large diversity of the brain tumor and uncertain boundaries between sub-regions, some models cannot well-segment multiple tumors in the brain at the same time. RESULTS In this paper, we proposed a lightweight hierarchical convolution network, called LHC-Net. Our network uses a multi-scale strategy which the common 3D convolution is replaced by the hierarchical convolution with residual-like connections. It improves the ability of multi-scale feature extraction and greatly reduces parameters and computation resources. On the BraTS2020 dataset, LHC-Net achieves the Dice scores of 76.38%, 90.01% and 83.32% for ET, WT and TC, respectively, which is better than that of 3D U-Net with 73.50%, 89.42% and 81.92%. Especially on the multi-tumor set, our model shows significant performance improvement. In addition, LHC-Net has 1.65M parameters and 35.58G FLOPs, which is two times fewer parameters and three times less computation compared with 3D U-Net. CONCLUSION Our proposed method achieves automatic segmentation of tumor sub-regions from four-modal brain MRI images. LHC-Net achieves competitive segmentation performance with fewer parameters and less computation than the state-of-the-art models. It means that our model can be applied under limited medical computing resources. By using the multi-scale strategy on channels, LHC-Net can well-segment multiple tumors in the patient's brain. It has great potential for application to other multi-scale segmentation tasks.
Collapse
Affiliation(s)
- Yuhu Wang
- Tianjin International Engineering Institute, Tianjin University, Tianjin, China
| | - Yuzhen Cao
- Department of Biomedical Engineering, Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin University, Tianjin, China
| | - Jinqiu Li
- Tianjin International Engineering Institute, Tianjin University, Tianjin, China
| | - Hongtao Wu
- Department of Biomedical Engineering, Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin University, Tianjin, China
| | - Shuo Wang
- Department of Biomedical Engineering, Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin University, Tianjin, China
| | - Xinming Dong
- Tianjin Rehabilitation Convalescent Center, Tianjin, China.
| | - Hui Yu
- Department of Biomedical Engineering, Tianjin Key Laboratory of Biomedical Detecting Techniques and Instruments, Tianjin University, Tianjin, China. .,Tianjin International Engineering Institute, Tianjin University, Tianjin, China. .,Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China.
| |
Collapse
|
7
|
Dias MDFM, Carvalho P, Castelo-Branco M, Valente Duarte J. Cortical thickness in brain imaging studies using FreeSurfer and CAT12: A matter of reproducibility. NEUROIMAGE: REPORTS 2022. [DOI: 10.1016/j.ynirp.2022.100137] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/05/2022]
|
8
|
Rao VM, Wan Z, Arabshahi S, Ma DJ, Lee PY, Tian Y, Zhang X, Laine AF, Guo J. Improving across-dataset brain tissue segmentation for MRI imaging using transformer. FRONTIERS IN NEUROIMAGING 2022; 1:1023481. [PMID: 37555170 PMCID: PMC10406272 DOI: 10.3389/fnimg.2022.1023481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/19/2022] [Accepted: 10/24/2022] [Indexed: 08/10/2023]
Abstract
Brain tissue segmentation has demonstrated great utility in quantifying MRI data by serving as a precursor to further post-processing analysis. However, manual segmentation is highly labor-intensive, and automated approaches, including convolutional neural networks (CNNs), have struggled to generalize well due to properties inherent to MRI acquisition, leaving a great need for an effective segmentation tool. This study introduces a novel CNN-Transformer hybrid architecture designed to improve brain tissue segmentation by taking advantage of the increased performance and generality conferred by Transformers for 3D medical image segmentation tasks. We first demonstrate the superior performance of our model on various T1w MRI datasets. Then, we rigorously validate our model's generality applied across four multi-site T1w MRI datasets, covering different vendors, field strengths, scan parameters, and neuropsychiatric conditions. Finally, we highlight the reliability of our model on test-retest scans taken in different time points. In all situations, our model achieved the greatest generality and reliability compared to the benchmarks. As such, our method is inherently robust and can serve as a valuable tool for brain related T1w MRI studies. The code for the TABS network is available at: https://github.com/raovish6/TABS.
Collapse
Affiliation(s)
- Vishwanatha M. Rao
- Department of Biomedical Engineering, Columbia University, New York, NY, United States
| | - Zihan Wan
- Department of Applied Mathematics, Columbia University, New York, NY, United States
| | - Soroush Arabshahi
- Department of Biomedical Engineering, Columbia University, New York, NY, United States
| | - David J. Ma
- Department of Biomedical Engineering, Columbia University, New York, NY, United States
| | - Pin-Yu Lee
- Department of Biomedical Engineering, Columbia University, New York, NY, United States
| | - Ye Tian
- Department of Biomedical Engineering, Columbia University, New York, NY, United States
| | - Xuzhe Zhang
- Department of Biomedical Engineering, Columbia University, New York, NY, United States
| | - Andrew F. Laine
- Department of Biomedical Engineering, Columbia University, New York, NY, United States
| | - Jia Guo
- Department of Psychiatry, Columbia University, New York, NY, United States
- Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY, United States
| |
Collapse
|
9
|
Vijayaragavan K, Cannon BJ, Tebaykin D, Bossé M, Baranski A, Oliveria JP, Bukhari SA, Mrdjen D, Corces MR, McCaffrey EF, Greenwald NF, Sigal Y, Marquez D, Khair Z, Bruce T, Goldston M, Bharadwaj A, Montine KS, Angelo RM, Montine TJ, Bendall SC. Single-cell spatial proteomic imaging for human neuropathology. Acta Neuropathol Commun 2022; 10:158. [PMID: 36333818 PMCID: PMC9636771 DOI: 10.1186/s40478-022-01465-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2022] [Accepted: 10/18/2022] [Indexed: 11/06/2022] Open
Abstract
Neurodegenerative disorders are characterized by phenotypic changes and hallmark proteopathies. Quantifying these in archival human brain tissues remains indispensable for validating animal models and understanding disease mechanisms. We present a framework for nanometer-scale, spatial proteomics with multiplex ion beam imaging (MIBI) for capturing neuropathological features. MIBI facilitated simultaneous, quantitative imaging of 36 proteins on archival human hippocampus from individuals spanning cognitively normal to dementia. Customized analysis strategies identified cell types and proteopathies in the hippocampus across stages of Alzheimer's disease (AD) neuropathologic change. We show microglia-pathologic tau interactions in hippocampal CA1 subfield in AD dementia. Data driven, sample independent creation of spatial proteomic regions identified persistent neurons in pathologic tau neighborhoods expressing mitochondrial protein MFN2, regardless of cognitive status, suggesting a survival advantage. Our study revealed unique insights from multiplexed imaging and data-driven approaches for neuropathologic analysis and serves broadly as a methodology for spatial proteomic analysis of archival human neuropathology. TEASER: Multiplex Ion beam Imaging enables deep spatial phenotyping of human neuropathology-associated cellular and disease features.
Collapse
Affiliation(s)
| | - Bryan J Cannon
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Dmitry Tebaykin
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Marc Bossé
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Alex Baranski
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - J P Oliveria
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Syed A Bukhari
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Dunja Mrdjen
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | | | - Erin F McCaffrey
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Noah F Greenwald
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | | | - Diana Marquez
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Zumana Khair
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Trevor Bruce
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Mako Goldston
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Anusha Bharadwaj
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Kathleen S Montine
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - R Michael Angelo
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Thomas J Montine
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA
| | - Sean C Bendall
- Department of Pathology, School of Medicine, Stanford University, Stanford, CA, USA.
| |
Collapse
|
10
|
Liu L, Zhang P, Liang G, Xiong S, Wang J, Zheng G. A spatiotemporal correlation deep learning network for brain penumbra disease. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.11.041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
11
|
Review on Hybrid Segmentation Methods for Identification of Brain Tumor in MRI. CONTRAST MEDIA & MOLECULAR IMAGING 2022; 2022:1541980. [PMID: 35919500 PMCID: PMC9293518 DOI: 10.1155/2022/1541980] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/30/2021] [Accepted: 04/22/2022] [Indexed: 12/03/2022]
Abstract
Modalities like MRI give information about organs and highlight diseases. Organ information is visualized in intensities. The segmentation method plays an important role in the identification of the region of interest (ROI). The ROI can be segmented from the image using clustering, features, and region extraction. Segmentation can be performed in steps; firstly, the region is extracted from the image. Secondly, feature extraction performed, and better features are selected. They can be shape, texture, or intensity. Thirdly, clustering segments the shape of tumor, tumor has specified shape, and shape is detected by feature. Clustering consists of FCM, K-means, FKM, and their hybrid. To support the segmentation, we conducted three studies (region extraction, feature, and clustering) which are discussed in the first line of this review paper. All these studies are targeting MRI as a modality. MRI visualization proved to be more accurate for the identification of diseases compared with other modalities. Information of the modality is compromised due to low pass image. In MRI Images, the tumor intensities are variable in tumor areas as well as in tumor boundaries.
Collapse
|
12
|
Machine learning in neuro-oncology: toward novel development fields. J Neurooncol 2022; 159:333-346. [PMID: 35761160 DOI: 10.1007/s11060-022-04068-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/17/2022] [Accepted: 06/11/2022] [Indexed: 10/17/2022]
Abstract
PURPOSE Artificial Intelligence (AI) involves several and different techniques able to elaborate a large amount of data responding to a specific planned outcome. There are several possible applications of this technology in neuro-oncology. METHODS We reviewed, according to PRISMA guidelines, available studies adopting AI in different fields of neuro-oncology including neuro-radiology, pathology, surgery, radiation therapy, and systemic treatments. RESULTS Neuro-radiology presented the major number of studies assessing AI. However, this technology is being successfully tested also in other operative settings including surgery and radiation therapy. In this context, AI shows to significantly reduce resources and costs maintaining an elevated qualitative standard. Pathological diagnosis and development of novel systemic treatments are other two fields in which AI showed promising preliminary data. CONCLUSION It is likely that AI will be quickly included in some aspects of daily clinical practice. Possible applications of these techniques are impressive and cover all aspects of neuro-oncology.
Collapse
|
13
|
Iredale E, Voigt B, Rankin A, Kim KW, Chen JZ, Schmid S, Hebb MO, Peters TM, Wong E. Planning System for the Optimization of Electric Field Delivery using Implanted Electrodes for Brain Tumor Control. Med Phys 2022; 49:6055-6067. [PMID: 35754362 DOI: 10.1002/mp.15825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Revised: 06/06/2022] [Accepted: 06/17/2022] [Indexed: 11/07/2022] Open
Abstract
BACKGROUND The use of non-ionizing electric fields from low intensity voltage sources (<10 V) to control malignant tumor growth is showing increasing potential as a cancer treatment modality. A method of applying these low intensity electric fields using multiple implanted electrodes within or adjacent to tumor volumes has been termed as intratumoral modulation therapy (IMT). PURPOSE This study explores advancements in the previously established IMT optimization algorithm, and the development of a custom treatment planning system for patient specific IMT. The practicality of the treatment planning system is demonstrated by implementing the full optimization pipeline on a brain phantom with robotic electrode implantation, post-operative imaging, and treatment stimulation. METHODS The integrated planning pipeline in 3D Slicer begins with importing and segmenting patient magnetic resonance images (MRI) or computed tomography (CT) images. The segmentation process is manual, followed by a semi-automatic smoothing step that allows the segmented brain and tumor mesh volumes to be smoothed and simplified by applying selected filters. Electrode trajectories are planned manually on the patient MRI or CT by selecting insertion and tip coordinates for a chosen number of electrodes. The electrode tip positions, and stimulation parameters (phase shift and voltage) can then be optimized with the custom semi-automatic IMT optimization algorithm where users can select the prescription electric field, voltage amplitude limit, tissue electrical properties, nearby organs at risk, optimization parameters (electrode tip location, individual contact phase shift and voltage), desired field coverage percent, and field conformity optimization. Tables of optimization results are displayed, and the resulting electric field is visualized as a field-map superimposed on the MR or CT image, with 3D renderings of the brain, tumor, and electrodes. Optimized electrode coordinates are transferred to robotic electrode implantation software to enable planning and subsequent implantation of the electrodes at the desired trajectories. RESULTS An IMT treatment planning system was developed that incorporates patient specific MRI or CT, segmentation, volume smoothing, electrode trajectory planning, electrode tip location and stimulation parameter optimization, and results visualization. All previous manual pipeline steps operating on diverse software platforms were coalesced into a single semi-automated 3D Slicer based user interface. Brain phantom validation of the full system implementation was successful in pre-operative planning, robotic electrode implantation, and post-operative treatment planning to adjust stimulation parameters based on actual implant locations. Voltage measurements were obtained in the brain phantom to determine the electrical parameters of the phantom and validate the simulated electric field distribution. CONCLUSIONS A custom treatment planning and implantation system for IMT has been developed in this study, and validated on a phantom brain model, providing an essential step in advancing IMT technology towards future clinical safety and efficacy investigations. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Erin Iredale
- Department of Medical Biophysics, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Brynn Voigt
- Department of Physics and Astronomy, Western University, London, ON, Canada
| | - Adam Rankin
- Robarts Research Institute, Western University, London, ON, Canada
| | - Kyungho W Kim
- Department of Physics and Astronomy, Western University, London, ON, Canada
| | - Jeff Z Chen
- Department of Medical Biophysics, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Susanne Schmid
- Department of Anatomy and Cell Biology, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Matthew O Hebb
- Department of Anatomy and Cell Biology, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada.,Department of Clinical Neurological Sciences, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada
| | - Terry M Peters
- Department of Medical Biophysics, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada.,Robarts Research Institute, Western University, London, ON, Canada
| | - Eugene Wong
- Department of Medical Biophysics, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada.,Department of Physics and Astronomy, Western University, London, ON, Canada
| |
Collapse
|
14
|
Liu L, Wang Y, Chang J, Zhang P, Liang G, Zhang H. LLRHNet: Multiple Lesions Segmentation Using Local-Long Range Features. Front Neuroinform 2022; 16:859973. [PMID: 35600503 PMCID: PMC9119082 DOI: 10.3389/fninf.2022.859973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2022] [Accepted: 03/22/2022] [Indexed: 11/13/2022] Open
Abstract
The encoder-decoder-based deep convolutional neural networks (CNNs) have made great improvements in medical image segmentation tasks. However, due to the inherent locality of convolution, CNNs generally are demonstrated to have limitations in obtaining features across layers and long-range features from the medical image. In this study, we develop a local-long range hybrid features network (LLRHNet), which inherits the merits of the iterative aggregation mechanism and the transformer technology, as a medical image segmentation model. LLRHNet adopts encoder-decoder architecture as the backbone which iteratively aggregates the projection and up-sampling to fuse local low-high resolution features across isolated layers. The transformer adopts the multi-head self-attention mechanism to extract long-range features from the tokenized image patches and fuses these features with the local-range features extracted by down-sampling operation in the backbone network. These hybrid features are used to assist the cascaded up-sampling operations to local the position of the target tissues. LLRHNet is evaluated on two multiple lesions medical image data sets, including a public liver-related segmentation data set (3DIRCADb) and an in-house stroke and white matter hyperintensity (SWMH) segmentation data set. Experimental results denote that LLRHNet achieves state-of-the-art performance on both data sets.
Collapse
Affiliation(s)
- Liangliang Liu
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Ying Wang
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Jing Chang
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Pei Zhang
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Gongbo Liang
- Department of Computer Science, Eastern Kentucky University, Richmond, KY, United States
| | - Hui Zhang
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| |
Collapse
|
15
|
Liu L, Zhang J, Wang JX, Xiong S, Zhang H. Co-optimization Learning Network for MRI Segmentation of Ischemic Penumbra Tissues. Front Neuroinform 2021; 15:782262. [PMID: 34975444 PMCID: PMC8717777 DOI: 10.3389/fninf.2021.782262] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2021] [Accepted: 11/25/2021] [Indexed: 11/17/2022] Open
Abstract
Convolutional neural networks (CNNs) have brought hope for the medical image auxiliary diagnosis. However, the shortfall of labeled medical image data is the bottleneck that limits the performance improvement of supervised CNN methods. In addition, annotating a large number of labeled medical image data is often expensive and time-consuming. In this study, we propose a co-optimization learning network (COL-Net) for Magnetic Resonance Imaging (MRI) segmentation of ischemic penumbra tissues. COL-Net base on the limited labeled samples and consists of an unsupervised reconstruction network (R), a supervised segmentation network (S), and a transfer block (T). The reconstruction network extracts the robust features from reconstructing pseudo unlabeled samples, which is the auxiliary branch of the segmentation network. The segmentation network is used to segment the target lesions under the limited labeled samples and the auxiliary of the reconstruction network. The transfer block is used to co-optimization the feature maps between the bottlenecks of the reconstruction network and segmentation network. We propose a mix loss function to optimize COL-Net. COL-Net is verified on the public ischemic penumbra segmentation challenge (SPES) with two dozen labeled samples. Results demonstrate that COL-Net has high predictive accuracy and generalization with the Dice coefficient of 0.79. The extended experiment also shows COL-Net outperforms most supervised segmentation methods. COL-Net is a meaningful attempt to alleviate the limited labeled sample problem in medical image segmentation.
Collapse
Affiliation(s)
- Liangliang Liu
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Jing Zhang
- Department of Computer Science, Henan Quality Engineering Vocational College, Pingdingshan, China
| | - Jin-xiang Wang
- Department of Computer Science, University of Melbourne, Parkville, VIC, Australia
| | - Shufeng Xiong
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| | - Hui Zhang
- College of Information and Management Science, Henan Agricultural University, Zhengzhou, China
| |
Collapse
|
16
|
Cahyo DAY, Yow AP, Saw SM, Ang M, Girard M, Schmetterer L, Wong D. Multi-task learning approach for volumetric segmentation and reconstruction in 3D OCT images. BIOMEDICAL OPTICS EXPRESS 2021; 12:7348-7360. [PMID: 35003838 PMCID: PMC8713660 DOI: 10.1364/boe.428140] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/22/2021] [Revised: 07/11/2021] [Accepted: 08/27/2021] [Indexed: 06/14/2023]
Abstract
The choroid is the vascular layer of the eye that supplies photoreceptors with oxygen. Changes in the choroid are associated with many pathologies including myopia where the choroid progressively thins due to axial elongation. To quantize these changes, there is a need to automatically and accurately segment the choroidal layer from optical coherence tomography (OCT) images. In this paper, we propose a multi-task learning approach to segment the choroid from three-dimensional OCT images. Our proposed architecture aggregates the spatial context from adjacent cross-sectional slices to reconstruct the central slice. Spatial context learned by this reconstruction mechanism is then fused with a U-Net based architecture for segmentation. The proposed approach was evaluated on volumetric OCT scans of 166 myopic eyes acquired with a commercial OCT system, and achieved a cross-validation Intersection over Union (IoU) score of 94.69% which significantly outperformed (p<0.001) the other state-of-the-art methods on the same data set. Choroidal thickness maps generated by our approach also achieved a better structural similarity index (SSIM) of 72.11% with respect to the groundtruth. In particular, our approach performs well for highly challenging eyes with thinner choroids. Compared to other methods, our proposed approach also requires lesser processing time and has lower computational requirements. The results suggest that our proposed approach could potentially be used as a fast and reliable method for automated choroidal segmentation.
Collapse
Affiliation(s)
- Dheo A. Y. Cahyo
- SERI-NTU Advanced Ocular Engineering (STANCE), Singapore
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
| | - Ai Ping Yow
- SERI-NTU Advanced Ocular Engineering (STANCE), Singapore
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
- Singapore Centre for Environmental Life Sciences Engineering (SCELSE), Singapore
| | - Seang-Mei Saw
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
| | - Marcus Ang
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
| | - Michael Girard
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
| | - Leopold Schmetterer
- SERI-NTU Advanced Ocular Engineering (STANCE), Singapore
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
- School of Chemical and Biomedical Engineering, Nanyang Technological University, Singapore
- Department of Clinical Pharmacology, Medical University of Vienna, Austria
- Center for Medical Physics and Biomedical Engineering, Medical University of Vienna, Austria
- Institute of Molecular and Clinical Ophthalmology, Basel, Switzerland
| | - Damon Wong
- SERI-NTU Advanced Ocular Engineering (STANCE), Singapore
- Singapore Eye Research Institute, Singapore National Eye Centre, Singapore
- School of Chemical and Biomedical Engineering, Nanyang Technological University, Singapore
- Institute of Molecular and Clinical Ophthalmology, Basel, Switzerland
| |
Collapse
|
17
|
Towards an Architecture of a Multi-purpose, User-Extendable Reference Human Brain Atlas. Neuroinformatics 2021; 20:405-426. [PMID: 34825350 PMCID: PMC9546954 DOI: 10.1007/s12021-021-09555-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/09/2021] [Indexed: 11/29/2022]
Abstract
Human brain atlas development is predominantly research-oriented and the use of atlases in clinical practice is limited. Here I introduce a new definition of a reference human brain atlas that serves education, research and clinical applications, and is extendable by its user. Subsequently, an architecture of a multi-purpose, user-extendable reference human brain atlas is proposed and its implementation discussed. The human brain atlas is defined as a vehicle to gather, present, use, share, and discover knowledge about the human brain with highly organized content, tools enabling a wide range of its applications, massive and heterogeneous knowledge database, and means for content and knowledge growing by its users. The proposed architecture determines major components of the atlas, their mutual relationships, and functional roles. It contains four functional units, core cerebral models, knowledge database, research and clinical data input and conversion, and toolkit (supporting processing, content extension, atlas individualization, navigation, exploration, and display), all united by a user interface. Each unit is described in terms of its function, component modules and sub-modules, data handling, and implementation aspects. This novel architecture supports brain knowledge gathering, presentation, use, sharing, and discovery and is broadly applicable and useful in student- and educator-oriented neuroeducation for knowledge presentation and communication, research for knowledge acquisition, aggregation and discovery, and clinical applications in decision making support for prevention, diagnosis, treatment, monitoring, and prediction. It establishes a backbone for designing and developing new, multi-purpose and user-extendable brain atlas platforms, serving as a potential standard across labs, hospitals, and medical schools.
Collapse
|
18
|
Li Y, Cui J, Sheng Y, Liang X, Wang J, Chang EIC, Xu Y. Whole brain segmentation with full volume neural network. Comput Med Imaging Graph 2021; 93:101991. [PMID: 34634548 DOI: 10.1016/j.compmedimag.2021.101991] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Revised: 06/13/2021] [Accepted: 09/06/2021] [Indexed: 10/20/2022]
Abstract
Whole brain segmentation is an important neuroimaging task that segments the whole brain volume into anatomically labeled regions-of-interest. Convolutional neural networks have demonstrated good performance in this task. Existing solutions, usually segment the brain image by classifying the voxels, or labeling the slices or the sub-volumes separately. Their representation learning is based on parts of the whole volume whereas their labeling result is produced by aggregation of partial segmentation. Learning and inference with incomplete information could lead to sub-optimal final segmentation result. To address these issues, we propose to adopt a full volume framework, which feeds the full volume brain image into the segmentation network and directly outputs the segmentation result for the whole brain volume. The framework makes use of complete information in each volume and can be implemented easily. An effective instance in this framework is given subsequently. We adopt the 3D high-resolution network (HRNet) for learning spatially fine-grained representations and the mixed precision training scheme for memory-efficient training. Extensive experiment results on a publicly available 3D MRI brain dataset show that our proposed model advances the state-of-the-art methods in terms of segmentation performance.
Collapse
Affiliation(s)
- Yeshu Li
- Department of Computer Science, University of Illinois at Chicago, Chicago, IL 60607, United States.
| | - Jonathan Cui
- Vacaville Christian Schools, Vacaville, CA 95687, United States.
| | - Yilun Sheng
- Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing 100084, China; Microsoft Research, Beijing 100080, China.
| | - Xiao Liang
- High School Affiliated to Renmin University of China, Beijing 100080, China.
| | | | | | - Yan Xu
- School of Biological Science and Medical Engineering and Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University, Beijing 100191, China; Microsoft Research, Beijing 100080, China.
| |
Collapse
|
19
|
Wang S, Liu X, Zhao J, Liu Y, Liu S, Liu Y, Zhao J. Computer auxiliary diagnosis technique of detecting cholangiocarcinoma based on medical imaging: A review. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 208:106265. [PMID: 34311415 DOI: 10.1016/j.cmpb.2021.106265] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Accepted: 06/28/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVES Cholangiocarcinoma (CCA) is one of the most aggressive human malignant tumors and is becoming one of the main factors of death and disability globally. Specifically, 60% to 70% of CCA patients were diagnosed with local invasion or distant metastasis and lost the chance of radical operation. The overall median survival time was less than 12 months. As a non-invasive diagnostic technology, medical imaging consisting of computed tomography (CT) imaging, magnetic resonance imaging (MRI), and ultrasound (US) imaging, is the most effectively and commonly used method to detect CCA. The computer auxiliary diagnosis (CAD) system based on medical imaging is helpful for rapid diagnosis and provides credible "second opinion" for specialists. The purpose of this review is to categorize and review the CAD technique of detecting CCA based on medical imaging. METHODS This work applies a four-level screening process to choose suitable publications. 125 research papers published in different academic research databases were selected and analyzed according to specific criteria. From the five steps of medical image acquisition, processing, analysis, understanding and verification of CAD combined with artificial intelligence algorithms, we obtain the most advanced insights related to CCA detection. RESULTS This work provides a comprehensive analysis and comparison analysis of the current CAD systems of detecting CCA. After careful investigation, we find that the main detection methods are traditional machine learning method and deep learning method. For the detection, the most commonly used method is semi-automatic segmentation algorithm combined with support vector machine classifier method, combination of which has good detection performance. The end-to-end training mode makes deep learning method more and more popular in CAD systems. However, due to the limited medical training data, the accuracy of deep learning method is unsatisfactory. CONCLUSIONS Based on analysis of artificial intelligence methods applied in CCA, this work is expected to be truly applied in clinical practice in the future to improve the level of clinical diagnosis and treatment of it. This work concludes by providing a prediction of future trends, which will be of great significance for researchers in the medical imaging of CCA and artificial intelligence.
Collapse
Affiliation(s)
- Shiyu Wang
- School of Electronic and Electric Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
| | - Xiang Liu
- School of Electronic and Electric Engineering, Shanghai University of Engineering Science, Shanghai 201620, China.
| | - Jingwen Zhao
- School of Electronic and Electric Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
| | - Yiwen Liu
- School of Electronic and Electric Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
| | - Shuhong Liu
- Department of Pathology and Hepatology, The Fifth Medical Centre of Chinese PLA General Hospital, Beijing 100039, China
| | - Yisi Liu
- Department of Pathology and Hepatology, The Fifth Medical Centre of Chinese PLA General Hospital, Beijing 100039, China
| | - Jingmin Zhao
- Department of Pathology and Hepatology, The Fifth Medical Centre of Chinese PLA General Hospital, Beijing 100039, China.
| |
Collapse
|
20
|
Mishro PK, Agrawal S, Panda R, Abraham A. A Novel Type-2 Fuzzy C-Means Clustering for Brain MR Image Segmentation. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:3901-3912. [PMID: 32568716 DOI: 10.1109/tcyb.2020.2994235] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
The fuzzy C -means (FCM) clustering procedure is an unsupervised form of grouping the homogenous pixels of an image in the feature space into clusters. A brain magnetic resonance (MR) image is affected by noise and intensity inhomogeneity (IIH) during the acquisition process. FCM has been used in MR brain tissue segmentation. However, it does not consider the neighboring pixels for computing the membership values, thereby misclassifying the noisy pixels. The inaccurate cluster centers obtained in FCM do not address the problem of IIH. A fixed value of the fuzzifier ( m ) used in FCM brings uncertainty in controlling the fuzziness of the extracted clusters. To resolve these issues, we suggest a novel type-2 adaptive weighted spatial FCM (AWSFCM) clustering algorithm for MR brain tissue segmentation. The idea of type-2 FCM applied to the problem on hand is new and is reported in this article. The application of the proposed technique to the problem of MR brain tissue segmentation replaces the fixed fuzzifier value with a fuzzy linguistic fuzzifier value ( M ). The introduction of the spatial information in the membership function reduces the misclassification of noisy pixels. Furthermore, the incorporation of adaptive weights into the cluster center update function improves the accuracy of the final cluster centers, thereby reducing the effect of IIH. The suggested algorithm is evaluated using T1-w, T2-w, and proton density (PD) brain MR image slices. The performance is justified in terms of qualitative and quantitative measures followed by statistical analysis. The outcomes demonstrate the superiority and robustness of the algorithm in comparison to the state-of-the-art methods. This article is useful for the cybernetics application.
Collapse
|
21
|
Gordon S, Kodner B, Goldfryd T, Sidorov M, Goldberger J, Raviv TR. An atlas of classifiers-a machine learning paradigm for brain MRI segmentation. Med Biol Eng Comput 2021; 59:1833-1849. [PMID: 34313921 DOI: 10.1007/s11517-021-02414-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Accepted: 04/21/2021] [Indexed: 11/25/2022]
Abstract
We present the Atlas of Classifiers (AoC)-a conceptually novel framework for brain MRI segmentation. The AoC is a spatial map of voxel-wise multinomial logistic regression (LR) functions learned from the labeled data. Upon convergence, the resulting fixed LR weights, a few for each voxel, represent the training dataset. It can, therefore, be considered as a light-weight learning machine, which despite its low capacity does not underfit the problem. The AoC construction is independent of the actual intensities of the test images, providing the flexibility to train it on the available labeled data and use it for the segmentation of images from different datasets and modalities. In this sense, it does not overfit the training data, as well. The proposed method has been applied to numerous publicly available datasets for the segmentation of brain MRI tissues and is shown to be robust to noise and outreach commonly used methods. Promising results were also obtained for multi-modal, cross-modality MRI segmentation. Finally, we show how AoC trained on brain MRIs of healthy subjects can be exploited for lesion segmentation of multiple sclerosis patients.
Collapse
Affiliation(s)
- Shiri Gordon
- The School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Boris Kodner
- The School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Tal Goldfryd
- The School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Michael Sidorov
- The School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer-Sheva, Israel
| | - Jacob Goldberger
- The Faculty of Electrical Engineering, Ber-Ilan University, Ramat-Gan, Israel
| | - Tammy Riklin Raviv
- The School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer-Sheva, Israel.
| |
Collapse
|
22
|
Hamwood J, Schmutz B, Collins MJ, Allenby MC, Alonso-Caneiro D. A deep learning method for automatic segmentation of the bony orbit in MRI and CT images. Sci Rep 2021; 11:13693. [PMID: 34211081 PMCID: PMC8249400 DOI: 10.1038/s41598-021-93227-3] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Accepted: 06/15/2021] [Indexed: 12/23/2022] Open
Abstract
This paper proposes a fully automatic method to segment the inner boundary of the bony orbit in two different image modalities: magnetic resonance imaging (MRI) and computed tomography (CT). The method, based on a deep learning architecture, uses two fully convolutional neural networks in series followed by a graph-search method to generate a boundary for the orbit. When compared to human performance for segmentation of both CT and MRI data, the proposed method achieves high Dice coefficients on both orbit and background, with scores of 0.813 and 0.975 in CT images and 0.930 and 0.995 in MRI images, showing a high degree of agreement with a manual segmentation by a human expert. Given the volumetric characteristics of these imaging modalities and the complexity and time-consuming nature of the segmentation of the orbital region in the human skull, it is often impractical to manually segment these images. Thus, the proposed method provides a valid clinical and research tool that performs similarly to the human observer.
Collapse
Affiliation(s)
- Jared Hamwood
- Contact Lens and Visual Optics Laboratory, Centre for Vision and Eye Research, School of Optometry and Vision Science, Queensland University of Technology (QUT), Kelvin Grove, Qld, 4059, Australia
| | - Beat Schmutz
- Centre in Regenerative Medicine, Institute of Health and Biomedical Innovation, Queensland University of Technology, Kelvin Grove, QLD, 4059, Australia
- Metro North Hospital and Health Service, Jamieson Trauma Institute, Herston, QLD, 4029, Australia
| | - Michael J Collins
- Contact Lens and Visual Optics Laboratory, Centre for Vision and Eye Research, School of Optometry and Vision Science, Queensland University of Technology (QUT), Kelvin Grove, Qld, 4059, Australia
| | - Mark C Allenby
- Biofabrication and Tissue Morphology Laboratory, Centre for Biomedical Technologies, School of Mechanical Medical and Process Engineering, Queensland University of Technology (QUT), Herston, Qld, 4000, Australia
| | - David Alonso-Caneiro
- Contact Lens and Visual Optics Laboratory, Centre for Vision and Eye Research, School of Optometry and Vision Science, Queensland University of Technology (QUT), Kelvin Grove, Qld, 4059, Australia.
| |
Collapse
|
23
|
You Z, Jiang M, Shi Z, Ning X, Shi C, Du S, Hérard AS, Jan C, Souedet N, Delzescaux T. Evaluation of automated segmentation algorithms for neurons in macaque cerebral microscopic images. Microsc Res Tech 2021; 84:2311-2324. [PMID: 33908123 DOI: 10.1002/jemt.23786] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2021] [Revised: 03/21/2021] [Accepted: 04/07/2021] [Indexed: 11/12/2022]
Abstract
Accurate cerebral neuron segmentation is required before neuron counting and neuron morphological analysis. Numerous algorithms for neuron segmentation have been published, but they are mainly evaluated using limited subsets from a specific anatomical region, targeting neurons of clear contrast and/or neurons with similar staining intensity. It is thus unclear how these algorithms perform on cerebral neurons in diverse anatomical regions. In this article, we introduce and reliably evaluate existing machine learning algorithms using a data set of microscopy images of macaque brain. This data set highlights various anatomical regions (e.g., cortex, caudate, thalamus, claustrum, putamen, hippocampus, subiculum, lateral geniculate, globus pallidus, etc.), poor contrast, and staining intensity differences of neurons. The evaluation was performed using 10 architectures of six classic machine learning algorithms in terms of typical Recall, Precision, F-score, aggregated Jaccard index (AJI), as well as a performance ranking of algorithms. F-score of most of the algorithms is superior to 0.7. Deep learning algorithms facilitate generally higher F-scores. U-net with suitable layer depth has been evaluated to be excellent classifiers with F-score of 0.846 and 0.837 when performing cross validation. The evaluation and analysis indicate the performance gap among algorithms in various anatomical regions and the strengths and limitations of each algorithm. The comparative result highlights at the same time the importance and difficulty of neuron segmentation and provides clues for future improvement. To the best of our knowledge, this work is the first comprehensive study for neuron segmentation in such large-scale anatomical regions.
Collapse
Affiliation(s)
- Zhenzhen You
- Shaanxi Key Laboratory for Network Computing and Security Technology, School of Computer Science and Engineering, Xi'an University of Technology, Xi'an, China.,CEA-CNRS-UMR 9199, Laboratoire des Maladies Neurodégénératives, MIRCen, Fontenay-aux-Roses, Université Paris-Saclay, Gif-sur-Yvette, France
| | - Ming Jiang
- National Laboratory of Radar Signal Processing, Xidian University, Xi'an, China
| | - Zhenghao Shi
- Shaanxi Key Laboratory for Network Computing and Security Technology, School of Computer Science and Engineering, Xi'an University of Technology, Xi'an, China
| | - Xiaojuan Ning
- Shaanxi Key Laboratory for Network Computing and Security Technology, School of Computer Science and Engineering, Xi'an University of Technology, Xi'an, China
| | - Cheng Shi
- Shaanxi Key Laboratory for Network Computing and Security Technology, School of Computer Science and Engineering, Xi'an University of Technology, Xi'an, China
| | - Shuangli Du
- Shaanxi Key Laboratory for Network Computing and Security Technology, School of Computer Science and Engineering, Xi'an University of Technology, Xi'an, China
| | - Anne-Sophie Hérard
- CEA-CNRS-UMR 9199, Laboratoire des Maladies Neurodégénératives, MIRCen, Fontenay-aux-Roses, Université Paris-Saclay, Gif-sur-Yvette, France
| | - Caroline Jan
- CEA-CNRS-UMR 9199, Laboratoire des Maladies Neurodégénératives, MIRCen, Fontenay-aux-Roses, Université Paris-Saclay, Gif-sur-Yvette, France
| | - Nicolas Souedet
- CEA-CNRS-UMR 9199, Laboratoire des Maladies Neurodégénératives, MIRCen, Fontenay-aux-Roses, Université Paris-Saclay, Gif-sur-Yvette, France
| | - Thierry Delzescaux
- CEA-CNRS-UMR 9199, Laboratoire des Maladies Neurodégénératives, MIRCen, Fontenay-aux-Roses, Université Paris-Saclay, Gif-sur-Yvette, France
| |
Collapse
|
24
|
Messina D, Borrelli P, Russo P, Salvatore M, Aiello M. Voxel-Wise Feature Selection Method for CNN Binary Classification of Neuroimaging Data. Front Neurosci 2021; 15:630747. [PMID: 33958980 PMCID: PMC8093438 DOI: 10.3389/fnins.2021.630747] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2020] [Accepted: 02/26/2021] [Indexed: 11/23/2022] Open
Abstract
Voxel-wise group analysis is presented as a novel feature selection (FS) technique for a deep learning (DL) approach to brain imaging data classification. The method, based on a voxel-wise two-sample t-test and denoted as t-masking, is integrated into the learning procedure as a data-driven FS strategy. t-Masking has been introduced in a convolutional neural network (CNN) for the test bench of binary classification of very-mild Alzheimer’s disease vs. normal control, using a structural magnetic resonance imaging dataset of 180 subjects. To better characterize the t-masking impact on CNN classification performance, six different experimental configurations were designed. Moreover, the performances of the presented FS method were compared to those of similar machine learning (ML) models that relied on different FS approaches. Overall, our results show an enhancement of about 6% in performance when t-masking was applied. Moreover, the reported performance enhancement was higher with respect to similar FS-based ML models. In addition, evaluation of the impact of t-masking on various selection rates has been provided, serving as a useful characterization for future insights. The proposed approach is also highly generalizable to other DL architectures, neuroimaging modalities, and brain pathologies.
Collapse
Affiliation(s)
| | | | - Paolo Russo
- Dipartimento di Fisica "Ettore Pancini", Università Degli Studi di Napoli "Federico II" - Complesso Universitario di Monte Sant'Angelo, Naples, Italy
| | | | | |
Collapse
|
25
|
Ghosal P, Chowdhury T, Kumar A, Bhadra AK, Chakraborty J, Nandi D. MhURI:A Supervised Segmentation Approach to Leverage Salient Brain Tissues in Magnetic Resonance Images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 200:105841. [PMID: 33221057 PMCID: PMC9096474 DOI: 10.1016/j.cmpb.2020.105841] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2020] [Accepted: 11/07/2020] [Indexed: 05/09/2023]
Abstract
BACKGROUND AND OBJECTIVES Accurate segmentation of critical tissues from a brain MRI is pivotal for characterization and quantitative pattern analysis of the human brain and thereby, identifies the earliest signs of various neurodegenerative diseases. To date, in most cases, it is done manually by the radiologists. The overwhelming workload in some of the thickly populated nations may cause exhaustion leading to interruption for the doctors, which may pose a continuing threat to patient safety. A novel fusion method called U-Net inception based on 3D convolutions and transition layers is proposed to address this issue. METHODS A 3D deep learning method called Multi headed U-Net with Residual Inception (MhURI) accompanied by Morphological Gradient channel for brain tissue segmentation is proposed, which incorporates Residual Inception 2-Residual (RI2R) module as the basic building block. The model exploits the benefits of morphological pre-processing for structural enhancement of MR images. A multi-path data encoding pipeline is introduced on top of the U-Net backbone, which encapsulates initial global features and captures the information from each MRI modality. RESULTS The proposed model has accomplished encouraging outcomes, which appreciates the adequacy in terms of some of the established quality metrices when compared with some of the state-of-the-art methods while evaluating with respect to two popular publicly available data sets. CONCLUSION The model is entirely automatic and able to segment gray matter (GM), white matter (WM), and cerebrospinal fluid (CSF) from brain MRI effectively with sufficient accuracy. Hence, it may be considered to be a potential computer-aided diagnostic (CAD) tool for radiologists and other medical practitioners in their clinical diagnosis workflow.
Collapse
Affiliation(s)
- Palash Ghosal
- Department of Computer Science and Engineering, National Institute of Technology Durgapur-713209, West Bengal, India.
| | - Tamal Chowdhury
- Department of Electronics and Communication Engineering, National Institute of Technology Durgapur-713209, West Bengal, India.
| | - Amish Kumar
- Department of Computer Science and Engineering, National Institute of Technology Durgapur-713209, West Bengal, India.
| | - Ashok Kumar Bhadra
- Department of Radiology, KPC Medical College and Hospital, Jadavpur, 700032, West Bengal, India.
| | - Jayasree Chakraborty
- Department of Hepatopancreatobiliary Service, Memorial Sloan Kettering Cancer Center, New York, NY 10065, USA.
| | - Debashis Nandi
- Department of Computer Science and Engineering, National Institute of Technology Durgapur-713209, West Bengal, India.
| |
Collapse
|
26
|
Mishro PK, Agrawal S, Panda R, Abraham A. A Survey on State-of-the-art Denoising Techniques for Brain Magnetic Resonance Images. IEEE Rev Biomed Eng 2021; 15:184-199. [PMID: 33513109 DOI: 10.1109/rbme.2021.3055556] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The accuracy of the magnetic resonance (MR) image diagnosis depends on the quality of the image, which degrades mainly due to noise and artifacts. The noise is introduced because of erroneous imaging environment or distortion in the transmission system. Therefore, denoising methods play an important role in enhancing the image quality. However, a tradeoff between denoising and preserving the structural details is required. Most of the existing surveys are conducted on a specific MR image modality or on limited denoising schemes. In this context, a comprehensive review on different MR image denoising techniques is inevitable. This survey suggests a new direction in categorizing the MR image denoising techniques. The categorization of the different image models used in medical image processing serves as the basis of our classification. This study includes recent improvements on deep learning-based denoising methods alongwith important traditional MR image denoising methods. The major challenges and their scope of improvement are also discussed. Further, many more evaluation indices are considered for a fair comparison. An elaborate discussion on selecting appropriate method and evaluation metric as per the kind of data is presented. This study may encourage researchers for further work in this domain.
Collapse
|
27
|
Magnetic resonance imaging manifestations of cerebral small vessel disease: automated quantification and clinical application. Chin Med J (Engl) 2020; 134:151-160. [PMID: 33443936 PMCID: PMC7817342 DOI: 10.1097/cm9.0000000000001299] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
The common cerebral small vessel disease (CSVD) neuroimaging features visible on conventional structural magnetic resonance imaging include recent small subcortical infarcts, lacunes, white matter hyperintensities, perivascular spaces, microbleeds, and brain atrophy. The CSVD neuroimaging features have shared and distinct clinical consequences, and the automatic quantification methods for these features are increasingly used in research and clinical settings. This review article explores the recent progress in CSVD neuroimaging feature quantification and provides an overview of the clinical consequences of these CSVD features as well as the possibilities of using these features as endpoints in clinical trials. The added value of CSVD neuroimaging quantification is also discussed for researches focused on the mechanism of CSVD and the prognosis in subjects with CSVD.
Collapse
|
28
|
Mahata N, Sing JK. A novel fuzzy clustering algorithm by minimizing global and spatially constrained likelihood-based local entropies for noisy 3D brain MR image segmentation. Appl Soft Comput 2020. [DOI: 10.1016/j.asoc.2020.106171] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
29
|
Pham TX, Siarry P, Oulhadj H. Segmentation of MR Brain Images Through Hidden Markov Random Field and Hybrid Metaheuristic Algorithm. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2020; 29:6507-6522. [PMID: 32365028 DOI: 10.1109/tip.2020.2990346] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Image segmentation is one of the most critical tasks in Magnetic Resonance (MR) images analysis. Since the performance of most current image segmentation methods is suffered by noise and intensity non-uniformity artifact (INU), a precise and artifact resistant method is desired. In this work, we propose a new segmentation method combining a new Hidden Markov Random Field (HMRF) model and a novel hybrid metaheuristic method based on Cuckoo search (CS) and Particle swarm optimization algorithms (PSO). The new model uses adaptive parameters to allow balancing between the segmented components of the model. In addition, to improve the quality of searching solutions in the Maximum a posteriori (MAP) estimation of the HMRF model, the hybrid metaheuristic algorithm is introduced. This algorithm takes into account both the advantages of CS and PSO algorithms in searching ability by cooperating them with the same population in a parallel way and with a solution selection mechanism. Since CS and PSO are performing exploration and exploitation in the search space, respectively, hybridizing them in an intelligent way can provide better solutions in terms of quality. Furthermore, initialization of the population is carefully taken into account to improve the performance of the proposed method. The whole algorithm is evaluated on benchmark images including both the simulated and real MR brain images. Experimental results show that the proposed method can achieve satisfactory performance for images with noise and intensity inhomogeneity, and provides better results than its considered competitors.
Collapse
|
30
|
Sun L, Ma W, Ding X, Huang Y, Liang D, Paisley J. A 3D Spatially Weighted Network for Segmentation of Brain Tissue From MRI. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:898-909. [PMID: 31449009 DOI: 10.1109/tmi.2019.2937271] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
The segmentation of brain tissue in MRI is valuable for extracting brain structure to aid diagnosis, treatment and tracking the progression of different neurologic diseases. Medical image data are volumetric and some neural network models for medical image segmentation have addressed this using a 3D convolutional architecture. However, this volumetric spatial information has not been fully exploited to enhance the representative ability of deep networks, and these networks have not fully addressed the practical issues facing the analysis of multimodal MRI data. In this paper, we propose a spatially-weighted 3D network (SW-3D-UNet) for brain tissue segmentation of single-modality MRI, and extend it using multimodality MRI data. We validate our model on the MRBrainS13 and MALC12 datasets. This unpublished model ranked first on the leaderboard of the MRBrainS13 Challenge.
Collapse
|
31
|
Yeh CH, Smith RE, Dhollander T, Calamante F, Connelly A. Connectomes from streamlines tractography: Assigning streamlines to brain parcellations is not trivial but highly consequential. Neuroimage 2019; 199:160-171. [DOI: 10.1016/j.neuroimage.2019.05.005] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2018] [Revised: 04/12/2019] [Accepted: 05/02/2019] [Indexed: 12/13/2022] Open
|
32
|
Biswas B, Ghosh SK, Ghosh A. A novel CT image segmentation algorithm using PCNN and Sobolev gradient methods in GPU frameworks. Pattern Anal Appl 2019. [DOI: 10.1007/s10044-019-00837-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
33
|
Das PK, Meher S, Panda R, Abraham A. A Review of Automated Methods for the Detection of Sickle Cell Disease. IEEE Rev Biomed Eng 2019; 13:309-324. [PMID: 31107662 DOI: 10.1109/rbme.2019.2917780] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Detection of sickle cell disease is a crucial job in medical image analysis. It emphasizes elaborate analysis of proper disease diagnosis after accurate detection followed by a classification of irregularities, which plays a vital role in the sickle cell disease diagnosis, treatment planning, and treatment outcome evaluation. Proper segmentation of complex cell clusters makes sickle cell detection more accurate and robust. Cell morphology has a key role in the detection of the sickle cell because the shapes of the normal blood cell and sickle cell differ significantly. This review emphasizes state-of-the-art methods and recent advances in detection, segmentation, and classification of sickle cell disease. We discuss key challenges encountered during the segmentation of overlapping blood cells. Moreover, standard validation measures that have been employed to yield performance analysis of various methods are also discussed. The methodologies and experiments in this review will be useful to further research and work in this area.
Collapse
|
34
|
Pham TX, Siarry P, Oulhadj H. A multi-objective optimization approach for brain MRI segmentation using fuzzy entropy clustering and region-based active contour methods. Magn Reson Imaging 2019; 61:41-65. [PMID: 31108153 DOI: 10.1016/j.mri.2019.05.009] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2018] [Revised: 04/16/2019] [Accepted: 05/04/2019] [Indexed: 11/20/2022]
Abstract
In this paper, we present a new multi-objective optimization approach for segmentation of Magnetic Resonance Imaging (MRI) of the human brain. The proposed algorithm not only takes advantages but also solves major drawbacks of two well-known complementary techniques, called fuzzy entropy clustering method and region-based active contour method, using multi-objective particle swarm optimization (MOPSO) approach. In order to obtain accurate segmentation results, firstly, two fitness functions with independent characteristics, compactness and separation, are derived from kernelized fuzzy entropy clustering with local spatial information and bias correction (KFECSB) and a novel adaptive energy weight combined with global and local fitting energy active contour (AWGLAC) model. Then, they are simultaneously optimized to finally produce a set of non-dominated solutions, from which L2-metric method is used to select the best trade-off solution. Our algorithm is both verified and compared with other state-of-the-art methods using simulated MR images and real MR images from the McConnell Brain Imaging Center (BrainWeb) and the Internet Brain Segmentation Repository (IBSR), respectively. The experimental results demonstrate that the proposed technique achieves superior segmentation performance in terms of accuracy and robustness.
Collapse
Affiliation(s)
- Thuy Xuan Pham
- Laboratory Images, Signals, and Intelligent Systems (LiSSi), University Paris-Est Créteil, 94400 Vitry sur Seine, France.
| | - Patrick Siarry
- Laboratory Images, Signals, and Intelligent Systems (LiSSi), University Paris-Est Créteil, 94400 Vitry sur Seine, France.
| | - Hamouche Oulhadj
- Laboratory Images, Signals, and Intelligent Systems (LiSSi), University Paris-Est Créteil, 94400 Vitry sur Seine, France.
| |
Collapse
|
35
|
Orea-Flores IY, Gallegos-Funes FJ, Arellano-Reynoso A. Local Complexity Estimation Based Filtering Method in Wavelet Domain for Magnetic Resonance Imaging Denoising. ENTROPY (BASEL, SWITZERLAND) 2019; 21:e21040401. [PMID: 33267115 PMCID: PMC7514888 DOI: 10.3390/e21040401] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/01/2019] [Revised: 03/22/2019] [Accepted: 04/04/2019] [Indexed: 06/12/2023]
Abstract
In this paper, we propose the local complexity estimation based filtering method in wavelet domain for MRI (magnetic resonance imaging) denoising. A threshold selection methodology is proposed in which the edge and detail preservation properties for each pixel are determined by the local complexity of the input image. In the proposed filtering method, the current wavelet kernel is compared with a threshold to identify the signal- or noise-dominant pixels in a scale providing a good visual quality avoiding blurred and over smoothened processed images. We present a comparative performance analysis with different wavelets to find the optimal wavelet for MRI denoising. Numerical experiments and visual results in simulated MR images degraded with Rician noise demonstrate that the proposed algorithm consistently outperforms other denoising methods by balancing the tradeoff between noise suppression and fine detail preservation. The proposed algorithm can enhance the contrast between regions allowing the delineation of the regions of interest between different textures or tissues in the processed images. The proposed approach produces a satisfactory result in the case of real MRI denoising by balancing the detail preservation and noise removal, by enhancing the contrast between the regions of the image. Additionally, the proposed algorithm is compared with other approaches in the case of Additive White Gaussian Noise (AWGN) using standard images to demonstrate that the proposed approach does not need to be adapted specifically to Rician or AWGN noise; it is an advantage of the proposed approach in comparison with other methods. Finally, the proposed scheme is simple, efficient and feasible for MRI denoising.
Collapse
Affiliation(s)
- Izlian Y. Orea-Flores
- Escuela Superior de Ingeniería Mecánica y Eléctrica, Instituto Politécnico Nacional Av. IPN s/n, Edificio Z, acceso 3, 3 piso; SEPI-Electrónica, Col. Lindavista, 07738 Ciudad de México, Mexico
| | - Francisco J. Gallegos-Funes
- Escuela Superior de Ingeniería Mecánica y Eléctrica, Instituto Politécnico Nacional Av. IPN s/n, Edificio Z, acceso 3, 3 piso; SEPI-Electrónica, Col. Lindavista, 07738 Ciudad de México, Mexico
| | - Alfonso Arellano-Reynoso
- Instituto Nacional de Neurología y Neurocirugía, Av. Insurgentes Sur 3877, Col. La Farma, 14269 Ciudad de México, Mexico
| |
Collapse
|
36
|
Lundervold AS, Lundervold A. An overview of deep learning in medical imaging focusing on MRI. Z Med Phys 2018; 29:102-127. [PMID: 30553609 DOI: 10.1016/j.zemedi.2018.11.002] [Citation(s) in RCA: 705] [Impact Index Per Article: 117.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2018] [Revised: 11/19/2018] [Accepted: 11/21/2018] [Indexed: 02/06/2023]
Abstract
What has happened in machine learning lately, and what does it mean for the future of medical image analysis? Machine learning has witnessed a tremendous amount of attention over the last few years. The current boom started around 2009 when so-called deep artificial neural networks began outperforming other established models on a number of important benchmarks. Deep neural networks are now the state-of-the-art machine learning models across a variety of areas, from image analysis to natural language processing, and widely deployed in academia and industry. These developments have a huge potential for medical imaging technology, medical data analysis, medical diagnostics and healthcare in general, slowly being realized. We provide a short overview of recent advances and some associated challenges in machine learning applied to medical image processing and image analysis. As this has become a very broad and fast expanding field we will not survey the entire landscape of applications, but put particular focus on deep learning in MRI. Our aim is threefold: (i) give a brief introduction to deep learning with pointers to core references; (ii) indicate how deep learning has been applied to the entire MRI processing chain, from acquisition to image retrieval, from segmentation to disease prediction; (iii) provide a starting point for people interested in experimenting and perhaps contributing to the field of deep learning for medical imaging by pointing out good educational resources, state-of-the-art open-source code, and interesting sources of data and problems related medical imaging.
Collapse
Affiliation(s)
- Alexander Selvikvåg Lundervold
- Mohn Medical Imaging and Visualization Centre (MMIV), Haukeland University Hospital, Norway; Department of Computing, Mathematics and Physics, Western Norway University of Applied Sciences, Norway.
| | - Arvid Lundervold
- Mohn Medical Imaging and Visualization Centre (MMIV), Haukeland University Hospital, Norway; Neuroinformatics and Image Analysis Laboratory, Department of Biomedicine, University of Bergen, Norway; Department of Health and Functioning, Western Norway University of Applied Sciences, Norway.
| |
Collapse
|
37
|
Schramm G, Holler M, Rezaei A, Vunckx K, Knoll F, Bredies K, Boada F, Nuyts J. Evaluation of Parallel Level Sets and Bowsher's Method as Segmentation-Free Anatomical Priors for Time-of-Flight PET Reconstruction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:590-603. [PMID: 29408787 PMCID: PMC5821901 DOI: 10.1109/tmi.2017.2767940] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/11/2023]
Abstract
In this article, we evaluate Parallel Level Sets (PLS) and Bowsher's method as segmentation-free anatomical priors for regularized brain positron emission tomography (PET) reconstruction. We derive the proximity operators for two PLS priors and use the EM-TV algorithm in combination with the first order primal-dual algorithm by Chambolle and Pock to solve the non-smooth optimization problem for PET reconstruction with PLS regularization. In addition, we compare the performance of two PLS versions against the symmetric and asymmetric Bowsher priors with quadratic and relative difference penalty function. For this aim, we first evaluate reconstructions of 30 noise realizations of simulated PET data derived from a real hybrid positron emission tomography/magnetic resonance imaging (PET/MR) acquisition in terms of regional bias and noise. Second, we evaluate reconstructions of a real brain PET/MR data set acquired on a GE Signa time-of-flight PET/MR in a similar way. The reconstructions of simulated and real 3D PET/MR data show that all priors were superior to post-smoothed maximum likelihood expectation maximization with ordered subsets (OSEM) in terms of bias-noise characteristics in different regions of interest where the PET uptake follows anatomical boundaries. Our implementation of the asymmetric Bowsher prior showed slightly superior performance compared with the two versions of PLS and the symmetric Bowsher prior. At very high regularization weights, all investigated anatomical priors suffer from the transfer of non-shared gradients.
Collapse
|
38
|
Kundu S, Kolouri S, Erickson KI, Kramer AF, McAuley E, Rohde GK. Discovery and visualization of structural biomarkers from MRI using transport-based morphometry. Neuroimage 2017; 167:256-275. [PMID: 29117580 PMCID: PMC5912801 DOI: 10.1016/j.neuroimage.2017.11.006] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2017] [Revised: 10/10/2017] [Accepted: 11/02/2017] [Indexed: 01/14/2023] Open
Abstract
Disease in the brain is often associated with subtle, spatially diffuse, or complex tissue changes that may lie beneath the level of gross visual inspection, even on magnetic resonance imaging (MRI). Unfortunately, current computer-assisted approaches that examine pre-specified features, whether anatomically-defined (i.e. thalamic volume, cortical thickness) or based on pixelwise comparison (i.e. deformation-based methods), are prone to missing a vast array of physical changes that are not well-encapsulated by these metrics. In this paper, we have developed a technique for automated pattern analysis that can fully determine the relationship between brain structure and observable phenotype without requiring any a priori features. Our technique, called transport-based morphometry (TBM), is an image transformation that maps brain images losslessly to a domain where they become much more separable. The new approach is validated on structural brain images of healthy older adult subjects where even linear models for discrimination, regression, and blind source separation enable TBM to independently discover the characteristic changes of aging and highlight potential mechanisms by which aerobic fitness may mediate brain health later in life. TBM is a generative approach that can provide visualization of physically meaningful shifts in tissue distribution through inverse transformation. The proposed framework is a powerful technique that can potentially elucidate genotype-structural-behavioral associations in myriad diseases.
Collapse
Affiliation(s)
- Shinjini Kundu
- Medical Scientist Training Program, University of Pittsburgh, 526 Scaife Hall, 3550 Terrace Street, Pittsburgh, PA 15261, USA.
| | | | - Kirk I Erickson
- Brain Aging & Cognitive Health Lab, Department of Psychology, University of Pittsburgh, 3601 Sennot Square, Pittsburgh, PA 15260, USA.
| | - Arthur F Kramer
- Beckman Institute, University of Illinois, 405 North Mathews Ave, Urbana, IL 61801, USA.
| | - Edward McAuley
- Exercise Psychology Laboratory, Department of Kinesiology and Community Health, Louise Freer Hall, 906 S Goodwin Avenue, Urbana, IL 61801, USA.
| | - Gustavo K Rohde
- Biomedical Engineering, Electrical and Computer Engineering, Box 800759, Room 1115, 415 Lane Road (MR5 Building), University of Virginia, Charlottesville, VA 22908, USA.
| |
Collapse
|