1
|
Computational Complexity Reduction of Neural Networks of Brain Tumor Image Segmentation by Introducing Fermi-Dirac Correction Functions. ENTROPY 2021; 23:e23020223. [PMID: 33670368 PMCID: PMC7918890 DOI: 10.3390/e23020223] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/16/2020] [Revised: 01/29/2021] [Accepted: 02/07/2021] [Indexed: 11/16/2022]
Abstract
Nowadays, deep learning methods with high structural complexity and flexibility inevitably lean on the computational capability of the hardware. A platform with high-performance GPUs and large amounts of memory could support neural networks having large numbers of layers and kernels. However, naively pursuing high-cost hardware would probably drag the technical development of deep learning methods. In the article, we thus establish a new preprocessing method to reduce the computational complexity of the neural networks. Inspired by the band theory of solids in physics, we map the image space into a noninteraction physical system isomorphically and then treat image voxels as particle-like clusters. Then, we reconstruct the Fermi-Dirac distribution to be a correction function for the normalization of the voxel intensity and as a filter of insignificant cluster components. The filtered clusters at the circumstance can delineate the morphological heterogeneity of the image voxels. We used the BraTS 2019 datasets and the dimensional fusion U-net for the algorithmic validation, and the proposed Fermi-Dirac correction function exhibited comparable performance to other employed preprocessing methods. By comparing to the conventional z-score normalization function and the Gamma correction function, the proposed algorithm can save at least 38% of computational time cost under a low-cost hardware architecture. Even though the correction function of global histogram equalization has the lowest computational time among the employed correction functions, the proposed Fermi-Dirac correction function exhibits better capabilities of image augmentation and segmentation.
Collapse
|
2
|
Liu Y, Yan Z. A Combined Deep-Learning and Lattice Boltzmann Model for Segmentation of the Hippocampus in MRI. SENSORS 2020; 20:s20133628. [PMID: 32605230 PMCID: PMC7374374 DOI: 10.3390/s20133628] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/24/2020] [Revised: 06/23/2020] [Accepted: 06/24/2020] [Indexed: 11/16/2022]
Abstract
Segmentation of the hippocampus (HC) in magnetic resonance imaging (MRI) is an essential step for diagnosis and monitoring of several clinical situations such as Alzheimer's disease (AD), schizophrenia and epilepsy. Automatic segmentation of HC structures is challenging due to their small volume, complex shape, low contrast and discontinuous boundaries. The active contour model (ACM) with a statistical shape prior is robust. However, it is difficult to build a shape prior that is general enough to cover all possible shapes of the HC and that suffers the problems of complicated registration of the shape prior and the target object and of low efficiency. In this paper, we propose a semi-automatic model that combines a deep belief network (DBN) and the lattice Boltzmann (LB) method for the segmentation of HC. The training process of DBN consists of unsupervised bottom-up training and supervised training of a top restricted Boltzmann machine (RBM). Given an input image, the trained DBN is utilized to infer the patient-specific shape prior of the HC. The specific shape prior is not only used to determine the initial contour, but is also introduced into the LB model as part of the external force to refine the segmentation. We used a subset of OASIS-1 as the training set and the preliminary release of EADC-ADNI as the testing set. The segmentation results of our method have good correlation and consistency with the manual segmentation results.
Collapse
Affiliation(s)
- Yingqian Liu
- School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China;
- School of Electrical Engineering, Binzhou University, Binzhou 256600, China
- Correspondence: ; Tel.: +86-13581150864
| | - Zhuangzhi Yan
- School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China;
| |
Collapse
|
3
|
Ataloglou D, Dimou A, Zarpalas D, Daras P. Fast and Precise Hippocampus Segmentation Through Deep Convolutional Neural Network Ensembles and Transfer Learning. Neuroinformatics 2020; 17:563-582. [PMID: 30877605 DOI: 10.1007/s12021-019-09417-y] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Automatic segmentation of the hippocampus from 3D magnetic resonance imaging mostly relied on multi-atlas registration methods. In this work, we exploit recent advances in deep learning to design and implement a fully automatic segmentation method, offering both superior accuracy and fast result. The proposed method is based on deep Convolutional Neural Networks (CNNs) and incorporates distinct segmentation and error correction steps. Segmentation masks are produced by an ensemble of three independent models, operating with orthogonal slices of the input volume, while erroneous labels are subsequently corrected by a combination of Replace and Refine networks. We explore different training approaches and demonstrate how, in CNN-based segmentation, multiple datasets can be effectively combined through transfer learning techniques, allowing for improved segmentation quality. The proposed method was evaluated using two different public datasets and compared favorably to existing methodologies. In the EADC-ADNI HarP dataset, the correspondence between the method's output and the available ground truth manual tracings yielded a mean Dice value of 0.9015, while the required segmentation time for an entire MRI volume was 14.8 seconds. In the MICCAI dataset, the mean Dice value increased to 0.8835 through transfer learning from the larger EADC-ADNI HarP dataset.
Collapse
Affiliation(s)
- Dimitrios Ataloglou
- Information Technologies Institute (ITI), Centre for Research and Technology HELLAS, 1st km Thermi - Panorama, 57001, Thessaloniki, Greece.
| | - Anastasios Dimou
- Information Technologies Institute (ITI), Centre for Research and Technology HELLAS, 1st km Thermi - Panorama, 57001, Thessaloniki, Greece
| | - Dimitrios Zarpalas
- Information Technologies Institute (ITI), Centre for Research and Technology HELLAS, 1st km Thermi - Panorama, 57001, Thessaloniki, Greece
| | - Petros Daras
- Information Technologies Institute (ITI), Centre for Research and Technology HELLAS, 1st km Thermi - Panorama, 57001, Thessaloniki, Greece
| |
Collapse
|
5
|
Chang C, Huang C, Zhou N, Li SX, Ver Hoef L, Gao Y. The bumps under the hippocampus. Hum Brain Mapp 2017; 39:472-490. [PMID: 29058349 DOI: 10.1002/hbm.23856] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2017] [Revised: 10/09/2017] [Accepted: 10/11/2017] [Indexed: 12/27/2022] Open
Abstract
Shown in every neuroanatomy textbook, a key morphological feature is the bumpy ridges, which we refer to as hippocampal dentation, on the inferior aspect of the hippocampus. Like the folding of the cerebral cortex, hippocampal dentation allows for greater surface area in a confined space. However, examining numerous approaches to hippocampal segmentation and morphology analysis, virtually all published 3D renderings of the hippocampus show the inferior surface to be quite smooth or mildly irregular; we have rarely seen the characteristic bumpy structure on reconstructed 3D surfaces. The only exception is a 9.4T postmortem study (Yushkevich et al. [2009]: NeuroImage 44:385-398). An apparent question is, does this indicate that this specific morphological signature can only be captured using ultra high-resolution techniques? Or, is such information buried in the data we commonly acquire, awaiting a computation technique that can extract and render it clearly? In this study, we propose an automatic and robust super-resolution technique that captures the fine scale morphometric features of the hippocampus based on common 3T MR images. The method is validated on 9.4T ultra-high field images and then applied on 3T data sets. This method opens possibilities of future research on the hippocampus and other sub-cortical structural morphometry correlating the degree of dentation with a range of diseases including epilepsy, Alzheimer's disease, and schizophrenia. Hum Brain Mapp 39:472-490, 2018. © 2017 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
- Cheng Chang
- Department of Electrical and Computer Engineering, Stony Brook University, Stony Brook, New York, 11794
| | - Chuan Huang
- Department of Radiology, Stony Brook University, Stony Brook, New York, 11794.,Department of Psychiatry, Stony Brook University, Stony Brook, New York, 11794
| | - Naiyun Zhou
- Department of Biomedical Engineering, Stony Brook University, Stony Brook, New York, 11794
| | - Shawn Xiang Li
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, 518060, China
| | - Lawrence Ver Hoef
- Department of Neurology, The University of Alabama at Birmingham, CIRC 312, Birmingham, Alabama, 35294.,Epilepsy center, The University of Alabama at Birmingham, CIRC 312, Birmingham, Alabama, 35294
| | - Yi Gao
- School of Biomedical Engineering, Health Science Center, Shenzhen University, Shenzhen, 518060, China.,Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen, 518060, China.,Department of Applied Mathematics and Statistics, Stony Brook University, Stony Brook, New York, 11794
| |
Collapse
|
6
|
Consistent Multi-Atlas Hippocampus Segmentation for Longitudinal MR Brain Images with Temporal Sparse Representation. PATCH-BASED TECHNIQUES IN MEDICAL IMAGING : SECOND INTERNATIONAL WORKSHOP, PATCH-MI 2016, HELD IN CONJUNCTION WITH MICCAI 2016, ATHENS, GREECE, OCTOBER 17, 2016 : PROCEEDINGS. PATCH-MI (WORKSHOP) (2ND : 2016 : ATHENS, GREECE) 2016; 9993:34-42. [PMID: 30294728 DOI: 10.1007/978-3-319-47118-1_5] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/03/2022]
Abstract
In this paper, we propose a novel multi-atlas based longitudinal label fusion method with temporal sparse representation technique to segment hippocampi at all time points simultaneously. First, we use groupwise longitudinal registration to simultaneously (1) estimate a group-mean image of a subject image sequence and (2) register its all time-point images to the estimated group-mean image consistently over time. Then, by registering all atlases with the group-mean image, we can align all atlases longitudinally consistently to each time point of the subject image sequence. Finally, we propose a longitudinal label fusion method to propagate all atlas labels to the subject image sequence by simultaneously labeling a set of temporally-corresponded voxels with a temporal consistency constraint on sparse representation. Experimental results demonstrate that our proposed method can achieve more accurate and consistent hippocampus segmentation than the state-of-the-art counterpart methods.
Collapse
|