1
|
Wee CY, Yap PT, Zhang D, Denny K, Browndyke JN, Potter GG, Welsh-Bohmer KA, Wang L, Shen D. Identification of MCI individuals using structural and functional connectivity networks. Neuroimage 2011; 59:2045-56. [PMID: 22019883 DOI: 10.1016/j.neuroimage.2011.10.015] [Citation(s) in RCA: 272] [Impact Index Per Article: 19.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2011] [Revised: 09/15/2011] [Accepted: 10/05/2011] [Indexed: 02/02/2023] Open
Abstract
Different imaging modalities provide essential complementary information that can be used to enhance our understanding of brain disorders. This study focuses on integrating multiple imaging modalities to identify individuals at risk for mild cognitive impairment (MCI). MCI, often an early stage of Alzheimer's disease (AD), is difficult to diagnose due to its very mild or insignificant symptoms of cognitive impairment. Recent emergence of brain network analysis has made characterization of neurological disorders at a whole-brain connectivity level possible, thus providing new avenues for brain diseases classification. Employing multiple-kernel Support Vector Machines (SVMs), we attempt to integrate information from diffusion tensor imaging (DTI) and resting-state functional magnetic resonance imaging (rs-fMRI) for improving classification performance. Our results indicate that the multimodality classification approach yields statistically significant improvement in accuracy over using each modality independently. The classification accuracy obtained by the proposed method is 96.3%, which is an increase of at least 7.4% from the single modality-based methods and the direct data fusion method. A cross-validation estimation of the generalization performance gives an area of 0.953 under the receiver operating characteristic (ROC) curve, indicating excellent diagnostic power. The multimodality classification approach hence allows more accurate early detection of brain abnormalities with greater sensitivity.
Collapse
|
Research Support, Non-U.S. Gov't |
14 |
272 |
2
|
Howell BR, Styner MA, Gao W, Yap PT, Wang L, Baluyot K, Yacoub E, Chen G, Potts T, Salzwedel A, Li G, Gilmore JH, Piven J, Smith JK, Shen D, Ugurbil K, Zhu H, Lin W, Elison JT. The UNC/UMN Baby Connectome Project (BCP): An overview of the study design and protocol development. Neuroimage 2018; 185:891-905. [PMID: 29578031 DOI: 10.1016/j.neuroimage.2018.03.049] [Citation(s) in RCA: 228] [Impact Index Per Article: 32.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2017] [Revised: 03/05/2018] [Accepted: 03/21/2018] [Indexed: 11/28/2022] Open
Abstract
The human brain undergoes extensive and dynamic growth during the first years of life. The UNC/UMN Baby Connectome Project (BCP), one of the Lifespan Connectome Projects funded by NIH, is an ongoing study jointly conducted by investigators at the University of North Carolina at Chapel Hill and the University of Minnesota. The primary objective of the BCP is to characterize brain and behavioral development in typically developing infants across the first 5 years of life. The ultimate goals are to chart emerging patterns of structural and functional connectivity during this period, map brain-behavior associations, and establish a foundation from which to further explore trajectories of health and disease. To accomplish these goals, we are combining state of the art MRI acquisition and analysis techniques, including high-resolution structural MRI (T1-and T2-weighted images), diffusion imaging (dMRI), and resting state functional connectivity MRI (rfMRI). While the overall design of the BCP largely is built on the protocol developed by the Lifespan Human Connectome Project (HCP), given the unique age range of the BCP cohort, additional optimization of imaging parameters and consideration of an age appropriate battery of behavioral assessments were needed. Here we provide the overall study protocol, including approaches for subject recruitment, strategies for imaging typically developing children 0-5 years of age without sedation, imaging protocol and optimization, a description of the battery of behavioral assessments, and QA/QC procedures. Combining HCP inspired neuroimaging data with well-established behavioral assessments during this time period will yield an invaluable resource for the scientific community.
Collapse
|
Review |
7 |
228 |
3
|
Wee CY, Yap PT, Shen D. Prediction of Alzheimer's disease and mild cognitive impairment using cortical morphological patterns. Hum Brain Mapp 2012; 34:3411-25. [PMID: 22927119 DOI: 10.1002/hbm.22156] [Citation(s) in RCA: 159] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2012] [Revised: 05/25/2012] [Accepted: 06/02/2012] [Indexed: 11/09/2022] Open
Abstract
This article describes a novel approach to extract cortical morphological abnormality patterns from structural magnetic resonance imaging (MRI) data to improve the prediction accuracy of Alzheimer's disease (AD) and its prodromal stage, i.e., mild cognitive impairment (MCI). Conventional approaches extract cortical morphological information, such as regional mean cortical thickness and regional cortical volumes, independently at different regions of interest (ROIs) without considering the relationship between these regions. Our approach involves constructing a similarity map where every element in the map represents the correlation of regional mean cortical thickness between a pair of ROIs. We will demonstrate in this article that this correlative morphological information gives significant improvement in classification performance when compared with ROI-based morphological information. Classification performance is further improved by integrating the correlative information with ROI-based information via multi-kernel support vector machines. This integrated framework achieves an accuracy of 92.35% for AD classification with an area of 0.9744 under the receiver operating characteristic (ROC) curve, and an accuracy of 83.75% for MCI classification with an area of 0.9233. In differentiating MCI subjects who converted to AD within 36 months from non-converters, an accuracy of 75.05% with an area of 0.8426 under ROC curve was achieved, indicating excellent diagnostic power and generalizability. The current work provides an alternative approach to extraction of high-order cortical information from structural MRI data for prediction of neurodegenerative diseases such as AD.
Collapse
|
Research Support, Non-U.S. Gov't |
13 |
159 |
4
|
Yap PT, Fan Y, Chen Y, Gilmore JH, Lin W, Shen D. Development trends of white matter connectivity in the first years of life. PLoS One 2011; 6:e24678. [PMID: 21966364 PMCID: PMC3179462 DOI: 10.1371/journal.pone.0024678] [Citation(s) in RCA: 157] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2011] [Accepted: 08/18/2011] [Indexed: 01/19/2023] Open
Abstract
The human brain is organized into a collection of interacting networks with specialized functions to support various cognitive functions. Recent research has reached a consensus that the brain manifests small-world topology, which implicates both global and local efficiency at minimal wiring costs, and also modular organization, which indicates functional segregation and specialization. However, the important questions of how and when the small-world topology and modular organization come into existence remain largely unanswered. Taking a graph theoretic approach, we attempt to shed light on this matter by an in vivo study, using diffusion tensor imaging based fiber tractography, on 39 healthy pediatric subjects with longitudinal data collected at average ages of 2 weeks, 1 year, and 2 years. Our results indicate that the small-world architecture exists at birth with efficiency that increases in later stages of development. In addition, we found that the networks are broad scale in nature, signifying the existence of pivotal connection hubs and resilience of the brain network to random and targeted attacks. We also observed, with development, that the brain network seems to evolve progressively from a local, predominantly proximity based, connectivity pattern to a more distributed, predominantly functional based, connectivity pattern. These observations suggest that the brain in the early years of life has relatively efficient systems that may solve similar information processing problems, but in divergent ways.
Collapse
|
Research Support, N.I.H., Extramural |
14 |
157 |
5
|
Wee CY, Yap PT, Li W, Denny K, Browndyke JN, Potter GG, Welsh-Bohmer KA, Wang L, Shen D. Enriched white matter connectivity networks for accurate identification of MCI patients. Neuroimage 2010; 54:1812-22. [PMID: 20970508 DOI: 10.1016/j.neuroimage.2010.10.026] [Citation(s) in RCA: 141] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2010] [Revised: 09/27/2010] [Accepted: 10/08/2010] [Indexed: 11/29/2022] Open
Abstract
Mild cognitive impairment (MCI), often a prodromal phase of Alzheimer's disease (AD), is frequently considered to be a good target for early diagnosis and therapeutic interventions of AD. Recent emergence of reliable network characterization techniques has made it possible to understand neurological disorders at a whole-brain connectivity level. Accordingly, we propose an effective network-based multivariate classification algorithm, using a collection of measures derived from white matter (WM) connectivity networks, to accurately identify MCI patients from normal controls. An enriched description of WM connections, utilizing six physiological parameters, i.e., fiber count, fractional anisotropy (FA), mean diffusivity (MD), and principal diffusivities(λ(1), λ(2), and λ(3)), results in six connectivity networks for each subject to account for the connection topology and the biophysical properties of the connections. Upon parcellating the brain into 90 regions-of-interest (ROIs), these properties can be quantified for each pair of regions with common traversing fibers. For building an MCI classifier, clustering coefficient of each ROI in relation to the remaining ROIs is extracted as feature for classification. These features are then ranked according to their Pearson correlation with respect to the clinical labels, and are further sieved to select the most discriminant subset of features using an SVM-based feature selection algorithm. Finally, support vector machines (SVMs) are trained using the selected subset of features. Classification accuracy was evaluated via leave-one-out cross-validation to ensure generalization of performance. The classification accuracy given by our enriched description of WM connections is 88.9%, which is an increase of at least 14.8% from that using simple WM connectivity description with any single physiological parameter. A cross-validation estimation of the generalization performance shows an area of 0.929 under the receiver operating characteristic (ROC) curve, indicating excellent diagnostic power. It was also found, based on the selected features, that portions of the prefrontal cortex, orbitofrontal cortex, parietal lobe and insula regions provided the most discriminant features for classification, in line with results reported in previous studies. Our MCI classification framework, especially the enriched description of WM connections, allows accurate early detection of brain abnormalities, which is of paramount importance for treatment management of potential AD patients.
Collapse
|
Research Support, Non-U.S. Gov't |
15 |
141 |
6
|
Fan J, Cao X, Yap PT, Shen D. BIRNet: Brain image registration using dual-supervised fully convolutional networks. Med Image Anal 2019; 54:193-206. [PMID: 30939419 DOI: 10.1016/j.media.2019.03.006] [Citation(s) in RCA: 122] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2018] [Revised: 03/09/2019] [Accepted: 03/21/2019] [Indexed: 11/30/2022]
Abstract
In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional network that is subject to dual-guidance: (1) Ground-truth guidance using deformation fields obtained by an existing registration method; and (2) Image dissimilarity guidance using the difference between the images after registration. The latter guidance helps avoid overly relying on the supervision from the training deformation fields, which could be inaccurate. For effective training, we further improve the deep convolutional network with gap filling, hierarchical loss, and multi-source strategies. Experiments on a variety of datasets show promising registration accuracy and efficiency compared with state-of-the-art methods.
Collapse
|
Validation Study |
6 |
122 |
7
|
Wee CY, Yap PT, Zhang D, Wang L, Shen D. Group-constrained sparse fMRI connectivity modeling for mild cognitive impairment identification. Brain Struct Funct 2014; 219:641-56. [PMID: 23468090 PMCID: PMC3710527 DOI: 10.1007/s00429-013-0524-8] [Citation(s) in RCA: 111] [Impact Index Per Article: 10.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2012] [Accepted: 02/08/2013] [Indexed: 12/14/2022]
Abstract
Emergence of advanced network analysis techniques utilizing resting-state functional magnetic resonance imaging (R-fMRI) has enabled a more comprehensive understanding of neurological disorders at a whole-brain level. However, inferring brain connectivity from R-fMRI is a challenging task, particularly when the ultimate goal is to achieve good control-patient classification performance, owing to perplexing noise effects, curse of dimensionality, and inter-subject variability. Incorporating sparsity into connectivity modeling may be a possible solution to partially remedy this problem since most biological networks are intrinsically sparse. Nevertheless, sparsity constraint, when applied at an individual level, will inevitably cause inter-subject variability and hence degrade classification performance. To this end, we formulate the R-fMRI time series of each region of interest (ROI) as a linear representation of time series of other ROIs to infer sparse connectivity networks that are topologically identical across individuals. This formulation allows simultaneous selection of a common set of ROIs across subjects so that their linear combination is best in estimating the time series of the considered ROI. Specifically, l 1-norm is imposed on each subject to filter out spurious or insignificant connections to produce sparse networks. A group-constraint is hence imposed via multi-task learning using a l 2-norm to encourage consistent non-zero connections across subjects. This group-constraint is crucial since the network topology is identical for all subjects while still preserving individual information via different connectivity values. We validated the proposed modeling in mild cognitive impairment identification and promising results achieved demonstrate its superiority in disease characterization, particularly greater sensitivity to early stage brain pathologies. The inferred group-constrained sparse network is found to be biologically plausible and is highly associated with the disease-associated anatomical anomalies. Furthermore, our proposed approach achieved similar classification performance when finer atlas was used to parcellate the brain space.
Collapse
|
Research Support, N.I.H., Extramural |
11 |
111 |
8
|
Shi F, Yap PT, Gao W, Lin W, Gilmore JH, Shen D. Altered structural connectivity in neonates at genetic risk for schizophrenia: a combined study using morphological and white matter networks. Neuroimage 2012; 62:1622-33. [PMID: 22613620 DOI: 10.1016/j.neuroimage.2012.05.026] [Citation(s) in RCA: 109] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2012] [Revised: 05/07/2012] [Accepted: 05/11/2012] [Indexed: 11/17/2022] Open
Abstract
Recently, an increasing body of evidence suggests that developmental abnormalities related to schizophrenia may occur as early as the neonatal stage. Impairments of brain gray matter and wiring problems of axonal fibers are commonly suspected to be responsible for the disconnection hypothesis in schizophrenia adults, but significantly less is known in neonates. In this study, we investigated 26 neonates who were at genetic risk for schizophrenia and 26 demographically matched healthy neonates using both morphological and white matter networks to examine possible brain connectivity abnormalities. The results showed that both populations exhibited small-world network topology. Morphological network analysis indicated that the brain structural associations of the high-risk neonates tended to have globally lower efficiency, longer connection distance, and less number of hub nodes and edges with relatively higher betweenness. Subgroup analysis showed that male neonates were significantly disease-affected, while the female neonates were not. White matter network analysis, however, showed that the fiber networks were globally unaffected, although several subcortical-cortical connections had significantly less number of fibers in high-risk neonates. This study provides new lines of evidence in support of the disconnection hypothesis, reinforcing the notion that the genetic risk of schizophrenia induces alterations in both gray matter structural associations and white matter connectivity.
Collapse
|
Research Support, N.I.H., Extramural |
13 |
109 |
9
|
Wee CY, Yang S, Yap PT, Shen D. Sparse temporally dynamic resting-state functional connectivity networks for early MCI identification. Brain Imaging Behav 2017; 10:342-56. [PMID: 26123390 DOI: 10.1007/s11682-015-9408-2] [Citation(s) in RCA: 109] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023]
Abstract
In conventional resting-state functional MRI (R-fMRI) analysis, functional connectivity is assumed to be temporally stationary, overlooking neural activities or interactions that may happen within the scan duration. Dynamic changes of neural interactions can be reflected by variations of topology and correlation strength in temporally correlated functional connectivity networks. These connectivity networks may potentially capture subtle yet short neural connectivity disruptions induced by disease pathologies. Accordingly, we are motivated to utilize disrupted temporal network properties for improving control-patient classification performance. Specifically, a sliding window approach is firstly employed to generate a sequence of overlapping R-fMRI sub-series. Based on these sub-series, sliding window correlations, which characterize the neural interactions between brain regions, are then computed to construct a series of temporal networks. Individual estimation of these temporal networks using conventional network construction approaches fails to take into consideration intrinsic temporal smoothness among successive overlapping R-fMRI sub-series. To preserve temporal smoothness of R-fMRI sub-series, we suggest to jointly estimate the temporal networks by maximizing a penalized log likelihood using a fused sparse learning algorithm. This sparse learning algorithm encourages temporally correlated networks to have similar network topology and correlation strengths. We design a disease identification framework based on the estimated temporal networks, and group level network property differences and classification results demonstrate the importance of including temporally dynamic R-fMRI scan information to improve diagnosis accuracy of mild cognitive impairment patients.
Collapse
|
Research Support, Non-U.S. Gov't |
8 |
109 |
10
|
Nie J, Guo L, Li K, Wang Y, Chen G, Li L, Chen H, Deng F, Jiang X, Zhang T, Huang L, Faraco C, Zhang D, Guo C, Yap PT, Hu X, Li G, Lv J, Yuan Y, Zhu D, Han J, Sabatinelli D, Zhao Q, Miller LS, Xu B, Shen P, Platt S, Shen D, Hu X, Liu T. Axonal fiber terminations concentrate on gyri. ACTA ACUST UNITED AC 2011; 22:2831-9. [PMID: 22190432 DOI: 10.1093/cercor/bhr361] [Citation(s) in RCA: 101] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Convoluted cortical folding and neuronal wiring are 2 prominent attributes of the mammalian brain. However, the macroscale intrinsic relationship between these 2 general cross-species attributes, as well as the underlying principles that sculpt the architecture of the cerebral cortex, remains unclear. Here, we show that the axonal fibers connected to gyri are significantly denser than those connected to sulci. In human, chimpanzee, and macaque brains, a dominant fraction of axonal fibers were found to be connected to the gyri. This finding has been replicated in a range of mammalian brains via diffusion tensor imaging and high-angular resolution diffusion imaging. These results may have shed some lights on fundamental mechanisms for development and organization of the cerebral cortex, suggesting that axonal pushing is a mechanism of cortical folding.
Collapse
|
Research Support, Non-U.S. Gov't |
14 |
101 |
11
|
Zhou Y, Chen H, Li Y, Liu Q, Xu X, Wang S, Yap PT, Shen D. Multi-task learning for segmentation and classification of tumors in 3D automated breast ultrasound images. Med Image Anal 2020; 70:101918. [PMID: 33676100 DOI: 10.1016/j.media.2020.101918] [Citation(s) in RCA: 98] [Impact Index Per Article: 19.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Revised: 11/22/2020] [Accepted: 11/23/2020] [Indexed: 12/12/2022]
Abstract
Tumor classification and segmentation are two important tasks for computer-aided diagnosis (CAD) using 3D automated breast ultrasound (ABUS) images. However, they are challenging due to the significant shape variation of breast tumors and the fuzzy nature of ultrasound images (e.g., low contrast and signal to noise ratio). Considering the correlation between tumor classification and segmentation, we argue that learning these two tasks jointly is able to improve the outcomes of both tasks. In this paper, we propose a novel multi-task learning framework for joint segmentation and classification of tumors in ABUS images. The proposed framework consists of two sub-networks: an encoder-decoder network for segmentation and a light-weight multi-scale network for classification. To account for the fuzzy boundaries of tumors in ABUS images, our framework uses an iterative training strategy to refine feature maps with the help of probability maps obtained from previous iterations. Experimental results based on a clinical dataset of 170 3D ABUS volumes collected from 107 patients indicate that the proposed multi-task framework improves tumor segmentation and classification over the single-task learning counterparts.
Collapse
|
Research Support, Non-U.S. Gov't |
5 |
98 |
12
|
Wee CY, Yap PT, Denny K, Browndyke JN, Potter GG, Welsh-Bohmer KA, Wang L, Shen D. Resting-state multi-spectrum functional connectivity networks for identification of MCI patients. PLoS One 2012; 7:e37828. [PMID: 22666397 PMCID: PMC3364275 DOI: 10.1371/journal.pone.0037828] [Citation(s) in RCA: 98] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2011] [Accepted: 04/25/2012] [Indexed: 01/18/2023] Open
Abstract
In this paper, a high-dimensional pattern classification framework, based on functional associations between brain regions during resting-state, is proposed to accurately identify MCI individuals from subjects who experience normal aging. The proposed technique employs multi-spectrum networks to characterize the complex yet subtle blood oxygenation level dependent (BOLD) signal changes caused by pathological attacks. The utilization of multi-spectrum networks in identifying MCI individuals is motivated by the inherent frequency-specific properties of BOLD spectrum. It is believed that frequency specific information extracted from different spectra may delineate the complex yet subtle variations of BOLD signals more effectively. In the proposed technique, regional mean time series of each region-of-interest (ROI) is band-pass filtered ( Hz) before it is decomposed into five frequency sub-bands. Five connectivity networks are constructed, one from each frequency sub-band. Clustering coefficient of each ROI in relation to the other ROIs are extracted as features for classification. Classification accuracy was evaluated via leave-one-out cross-validation to ensure generalization of performance. The classification accuracy obtained by this approach is 86.5%, which is an increase of at least 18.9% from the conventional full-spectrum methods. A cross-validation estimation of the generalization performance shows an area of 0.863 under the receiver operating characteristic (ROC) curve, indicating good diagnostic power. It was also found that, based on the selected features, portions of the prefrontal cortex, orbitofrontal cortex, temporal lobe, and parietal lobe regions provided the most discriminant information for classification, in line with results reported in previous studies. Analysis on individual frequency sub-bands demonstrated that different sub-bands contribute differently to classification, providing extra evidence regarding frequency-specific distribution of BOLD signals. Our MCI classification framework, which allows accurate early detection of functional brain abnormalities, makes an important positive contribution to the treatment management of potential AD patients.
Collapse
|
Research Support, Non-U.S. Gov't |
13 |
98 |
13
|
Shi F, Cheng J, Wang L, Yap PT, Shen D. LRTV: MR Image Super-Resolution With Low-Rank and Total Variation Regularizations. IEEE TRANSACTIONS ON MEDICAL IMAGING 2015; 34:2459-66. [PMID: 26641727 PMCID: PMC5572670 DOI: 10.1109/tmi.2015.2437894] [Citation(s) in RCA: 93] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
Image super-resolution (SR) aims to recover high-resolution images from their low-resolution counterparts for improving image analysis and visualization. Interpolation methods, widely used for this purpose, often result in images with blurred edges and blocking effects. More advanced methods such as total variation (TV) retain edge sharpness during image recovery. However, these methods only utilize information from local neighborhoods, neglecting useful information from remote voxels. In this paper, we propose a novel image SR method that integrates both local and global information for effective image recovery. This is achieved by, in addition to TV, low-rank regularization that enables utilization of information throughout the image. The optimization problem can be solved effectively via alternating direction method of multipliers (ADMM). Experiments on MR images of both adult and pediatric subjects demonstrate that the proposed method enhances the details in the recovered high-resolution images, and outperforms methods such as the nearest-neighbor interpolation, cubic interpolation, iterative back projection (IBP), non-local means (NLM), and TV-based up-sampling.
Collapse
|
Research Support, N.I.H., Extramural |
10 |
93 |
14
|
Shi F, Yap PT, Fan Y, Gilmore JH, Lin W, Shen D. Construction of multi-region-multi-reference atlases for neonatal brain MRI segmentation. Neuroimage 2010; 51:684-93. [PMID: 20171290 DOI: 10.1016/j.neuroimage.2010.02.025] [Citation(s) in RCA: 84] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2009] [Revised: 02/09/2010] [Accepted: 02/10/2010] [Indexed: 01/01/2023] Open
Abstract
Neonatal brain MRI segmentation is a challenging problem due to its poor image quality. Atlas-based segmentation approaches have been widely used for guiding brain tissue segmentation. Existing brain atlases are usually constructed by equally averaging pre-segmented images in a population. However, such approaches diminish local inter-subject structural variability and thus lead to lower segmentation guidance capability. To deal with this problem, we propose a multi-region-multi-reference framework for atlas-based neonatal brain segmentation. For each region of a brain parcellation, a population of spatially normalized pre-segmented images is clustered into a number of sub-populations. Each sub-population of a region represents an independent distribution from which a regional probability atlas can be generated. A selection of these regional atlases, across different sub-regions, will in the end be adaptively combined to form an overall atlas specific to the query image. Given a query image, the determination of the appropriate set of regional atlases is achieved by comparing the query image regionally with the reference, or exemplar, of each sub-population. Upon obtaining an overall atlas, an atlas-based joint registration-segmentation strategy is employed to segment the query image. Since the proposed method generates an atlas which is significant more similar to the query image than the traditional average-shape atlas, better tissue segmentation results can be expected. This is validated by applying the proposed method on a large set of neonatal brain images available in our institute. Experimental results on a randomly selected set of 10 neonatal brain images indicate that the proposed method achieves higher tissue overlap rates and lower standard deviations (SDs) in comparison with manual segmentations, i.e., 0.86 (SD 0.02) for GM, 0.83 (SD 0.03) for WM, and 0.80 (SD 0.05) for CSF. The proposed method also outperforms two other average-shape atlas-based segmentation methods.
Collapse
|
Research Support, N.I.H., Extramural |
15 |
84 |
15
|
Jia H, Yap PT, Shen D. Iterative multi-atlas-based multi-image segmentation with tree-based registration. Neuroimage 2011; 59:422-30. [PMID: 21807102 DOI: 10.1016/j.neuroimage.2011.07.036] [Citation(s) in RCA: 83] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2011] [Revised: 07/07/2011] [Accepted: 07/13/2011] [Indexed: 10/18/2022] Open
Abstract
In this paper, we present a multi-atlas-based framework for accurate, consistent and simultaneous segmentation of a group of target images. Multi-atlas-based segmentation algorithms consider concurrently complementary information from multiple atlases to produce optimal segmentation outcomes. However, the accuracy of these algorithms relies heavily on the precise alignment of the atlases with the target image. In particular, the commonly used pairwise registration may result in inaccurate alignment especially between images with large shape differences. Additionally, when segmenting a group of target images, most current methods consider these images independently with disregard of their correlation, thus resulting in inconsistent segmentations of the same structures across different target images. We propose two novel strategies to address these limitations: 1) a novel tree-based groupwise registration method for concurrent alignment of both the atlases and the target images, and 2) an iterative groupwise segmentation method for simultaneous consideration of segmentation information propagated from all available images, including the atlases and other newly segmented target images. Evaluation based on various datasets indicates that the proposed multi-atlas-based multi-image segmentation (MABMIS) framework yields substantial improvements in terms of consistency and accuracy over methods that do not consider the group of target images holistically.
Collapse
|
Research Support, N.I.H., Extramural |
14 |
83 |
16
|
Wang Y, Nie J, Yap PT, Shi F, Guo L, Shen D. Robust deformable-surface-based skull-stripping for large-scale studies. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2011; 14:635-42. [PMID: 22003753 DOI: 10.1007/978-3-642-23626-6_78] [Citation(s) in RCA: 78] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Skull-stripping refers to the separation of brain tissue from non-brain tissue, such as the scalp, skull, and dura. In large-scale studies involving a significant number of subjects, a fully automatic method is highly desirable, since manual skull-stripping requires tremendous human effort and can be inconsistent even after sufficient training. We propose in this paper a robust and effective method that is capable of skull-stripping a large number of images accurately with minimal dependence on the parameter setting. The key of our method involves an initial skull-stripping by co-registration of an atlas, followed by a refinement phase with a surface deformation scheme that is guided by prior information obtained from a set of real brain images. Evaluation based on a total of 831 images, consisting of normal controls (NC) and patients with mild cognitive impairment (MCI) or Alzheimer's Disease (AD), from the Alzheimer's Disease Neuroimaging Initiative (ADNI) database indicates that our method performs favorably at a consistent overall overlap rate of approximately 98% when compared with expert results. The software package will be made available to the public to facilitate neuroimaging studies.
Collapse
|
Research Support, N.I.H., Extramural |
14 |
78 |
17
|
Wang Y, Nie J, Yap PT, Li G, Shi F, Geng X, Guo L, Shen D. Knowledge-guided robust MRI brain extraction for diverse large-scale neuroimaging studies on humans and non-human primates. PLoS One 2014; 9:e77810. [PMID: 24489639 PMCID: PMC3906014 DOI: 10.1371/journal.pone.0077810] [Citation(s) in RCA: 75] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2013] [Accepted: 09/04/2013] [Indexed: 11/18/2022] Open
Abstract
Accurate and robust brain extraction is a critical step in most neuroimaging analysis pipelines. In particular, for the large-scale multi-site neuroimaging studies involving a significant number of subjects with diverse age and diagnostic groups, accurate and robust extraction of the brain automatically and consistently is highly desirable. In this paper, we introduce population-specific probability maps to guide the brain extraction of diverse subject groups, including both healthy and diseased adult human populations, both developing and aging human populations, as well as non-human primates. Specifically, the proposed method combines an atlas-based approach, for coarse skull-stripping, with a deformable-surface-based approach that is guided by local intensity information and population-specific prior information learned from a set of real brain images for more localized refinement. Comprehensive quantitative evaluations were performed on the diverse large-scale populations of ADNI dataset with over 800 subjects (55∼90 years of age, multi-site, various diagnosis groups), OASIS dataset with over 400 subjects (18∼96 years of age, wide age range, various diagnosis groups), and NIH pediatrics dataset with 150 subjects (5∼18 years of age, multi-site, wide age range as a complementary age group to the adult dataset). The results demonstrate that our method consistently yields the best overall results across almost the entire human life span, with only a single set of parameters. To demonstrate its capability to work on non-human primates, the proposed method is further evaluated using a rhesus macaque dataset with 20 subjects. Quantitative comparisons with popularly used state-of-the-art methods, including BET, Two-pass BET, BET-B, BSE, HWA, ROBEX and AFNI, demonstrate that the proposed method performs favorably with superior performance on all testing datasets, indicating its robustness and effectiveness.
Collapse
|
Research Support, Non-U.S. Gov't |
11 |
75 |
18
|
Fan J, Cao X, Wang Q, Yap PT, Shen D. Adversarial learning for mono- or multi-modal registration. Med Image Anal 2019; 58:101545. [PMID: 31557633 PMCID: PMC7455790 DOI: 10.1016/j.media.2019.101545] [Citation(s) in RCA: 70] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2019] [Revised: 06/16/2019] [Accepted: 08/19/2019] [Indexed: 11/29/2022]
Abstract
This paper introduces an unsupervised adversarial similarity network for image registration. Unlike existing deep learning registration methods, our approach can train a deformable registration network without the need of ground-truth deformations and specific similarity metrics. We connect a registration network and a discrimination network with a deformable transformation layer. The registration network is trained with the feedback from the discrimination network, which is designed to judge whether a pair of registered images are sufficiently similar. Using adversarial training, the registration network is trained to predict deformations that are accurate enough to fool the discrimination network. The proposed method is thus a general registration framework, which can be applied for both mono-modal and multi-modal image registration. Experiments on four brain MRI datasets and a multi-modal pelvic image dataset indicate that our method yields promising registration performance in accuracy, efficiency and generalizability compared with state-of-the-art registration methods, including those based on deep learning.
Collapse
|
Research Support, N.I.H., Extramural |
6 |
70 |
19
|
Wang M, Zhang D, Huang J, Yap PT, Shen D, Liu M. Identifying Autism Spectrum Disorder With Multi-Site fMRI via Low-Rank Domain Adaptation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:644-655. [PMID: 31395542 PMCID: PMC7169995 DOI: 10.1109/tmi.2019.2933160] [Citation(s) in RCA: 68] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/06/2023]
Abstract
Autism spectrum disorder (ASD) is a neurodevelopmental disorder that is characterized by a wide range of symptoms. Identifying biomarkers for accurate diagnosis is crucial for early intervention of ASD. While multi-site data increase sample size and statistical power, they suffer from inter-site heterogeneity. To address this issue, we propose a multi-site adaption framework via low-rank representation decomposition (maLRR) for ASD identification based on functional MRI (fMRI). The main idea is to determine a common low-rank representation for data from the multiple sites, aiming to reduce differences in data distributions. Treating one site as a target domain and the remaining sites as source domains, data from these domains are transformed (i.e., adapted) to a common space using low-rank representation. To reduce data heterogeneity between the target and source domains, data from the source domains are linearly represented in the common space by those from the target domain. We evaluated the proposed method on both synthetic and real multi-site fMRI data for ASD identification. The results suggest that our method yields superior performance over several state-of-the-art domain adaptation methods.
Collapse
|
Research Support, N.I.H., Extramural |
5 |
68 |
20
|
Wang L, Shi F, Yap PT, Lin W, Gilmore JH, Shen D. Longitudinally guided level sets for consistent tissue segmentation of neonates. Hum Brain Mapp 2011; 34:956-72. [PMID: 22140029 DOI: 10.1002/hbm.21486] [Citation(s) in RCA: 65] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2011] [Revised: 09/11/2011] [Accepted: 09/12/2011] [Indexed: 11/10/2022] Open
Abstract
Quantification of brain development as well as disease-induced pathologies in neonates often requires precise delineation of white matter, grey matter and cerebrospinal fluid. Unlike adults, tissue segmentation in neonates is significantly more challenging due to the inherently lower tissue contrast. Most existing methods take a voxel-based approach and are limited to working with images from a single time-point, even though longitudinal scans are available. We take a different approach by taking advantage of the fact that the pattern of the major sulci and gyri are already present in the neonates and generally preserved but fine-tuned during brain development. That is, the segmentation of late-time-point image can be used to guide the segmentation of neonatal image. Accordingly, we propose a novel longitudinally guided level-sets method for consistent neonatal image segmentation by combining local intensity information, atlas spatial prior, cortical thickness constraint, and longitudinal information into a variational framework. The minimization of the proposed energy functional is strictly derived from a variational principle. Validation performed on both simulated and in vivo neonatal brain images shows promising results.
Collapse
|
Research Support, N.I.H., Extramural |
14 |
65 |
21
|
Liu M, Zhang J, Nie D, Yap PT, Shen D. Anatomical Landmark Based Deep Feature Representation for MR Images in Brain Disease Diagnosis. IEEE J Biomed Health Inform 2018; 22:1476-1485. [PMID: 29994175 PMCID: PMC6238951 DOI: 10.1109/jbhi.2018.2791863] [Citation(s) in RCA: 65] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Most automated techniques for brain disease diagnosis utilize hand-crafted (e.g., voxel-based or region-based) biomarkers from structural magnetic resonance (MR) images as feature representations. However, these hand-crafted features are usually high-dimensional or require regions-of-interest defined by experts. Also, because of possibly heterogeneous property between the hand-crafted features and the subsequent model, existing methods may lead to sub-optimal performances in brain disease diagnosis. In this paper, we propose a landmark-based deep feature learning (LDFL) framework to automatically extract patch-based representation from MRI for automatic diagnosis of Alzheimer's disease. We first identify discriminative anatomical landmarks from MR images in a data-driven manner, and then propose a convolutional neural network for patch-based deep feature learning. We have evaluated the proposed method on subjects from three public datasets, including the Alzheimer's disease neuroimaging initiative (ADNI-1), ADNI-2, and the minimal interval resonance imaging in alzheimer's disease (MIRIAD) dataset. Experimental results of both tasks of brain disease classification and MR image retrieval demonstrate that the proposed LDFL method improves the performance of disease classification and MR image retrieval.
Collapse
|
Research Support, N.I.H., Extramural |
7 |
65 |
22
|
Cao X, Yang J, Zhang J, Wang Q, Yap PT, Shen D. Deformable Image Registration Using a Cue-Aware Deep Regression Network. IEEE Trans Biomed Eng 2018; 65:1900-1911. [PMID: 29993391 PMCID: PMC6178830 DOI: 10.1109/tbme.2018.2822826] [Citation(s) in RCA: 64] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/11/2022]
Abstract
SIGNIFICANCE Analysis of modern large-scale, multicenter or diseased data requires deformable registration algorithms that can cope with data of diverse nature. OBJECTIVE We propose a novel deformable registration method, which is based on a cue-aware deep regression network, to deal with multiple databases with minimal parameter tuning. METHODS Our method learns and predicts the deformation field between a reference image and a subject image. Specifically, given a set of training images, our method learns the displacement vector associated with a pair of reference-subject patches. To achieve this, we first introduce a key-point truncated-balanced sampling strategy to facilitate accurate learning from the image database of limited size. Then, we design a cue-aware deep regression network, where we propose to employ the contextual cue, i.e., the scale-adaptive local similarity, to more apparently guide the learning process. The deep regression network is aware of the contextual cue for accurate prediction of local deformation. RESULTS AND CONCLUSION Our experiments show that the proposed method can tackle various registration tasks on different databases, giving consistent good performance without the need of manual parameter tuning, which could be applicable to various clinical applications.
Collapse
|
Research Support, N.I.H., Extramural |
7 |
64 |
23
|
Zhou L, Wang Y, Li Y, Yap PT, Shen D. Hierarchical anatomical brain networks for MCI prediction: revisiting volumetric measures. PLoS One 2011; 6:e21935. [PMID: 21818280 PMCID: PMC3139571 DOI: 10.1371/journal.pone.0021935] [Citation(s) in RCA: 64] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2011] [Accepted: 06/10/2011] [Indexed: 12/02/2022] Open
Abstract
Owning to its clinical accessibility, T1-weighted MRI (Magnetic Resonance Imaging) has been extensively studied in the past decades for prediction of Alzheimer's disease (AD) and mild cognitive impairment (MCI). The volumes of gray matter (GM), white matter (WM) and cerebrospinal fluid (CSF) are the most commonly used measurements, resulting in many successful applications. It has been widely observed that disease-induced structural changes may not occur at isolated spots, but in several inter-related regions. Therefore, for better characterization of brain pathology, we propose in this paper a means to extract inter-regional correlation based features from local volumetric measurements. Specifically, our approach involves constructing an anatomical brain network for each subject, with each node representing a Region of Interest (ROI) and each edge representing Pearson correlation of tissue volumetric measurements between ROI pairs. As second order volumetric measurements, network features are more descriptive but also more sensitive to noise. To overcome this limitation, a hierarchy of ROIs is used to suppress noise at different scales. Pairwise interactions are considered not only for ROIs with the same scale in the same layer of the hierarchy, but also for ROIs across different scales in different layers. To address the high dimensionality problem resulting from the large number of network features, a supervised dimensionality reduction method is further employed to embed a selected subset of features into a low dimensional feature space, while at the same time preserving discriminative information. We demonstrate with experimental results the efficacy of this embedding strategy in comparison with some other commonly used approaches. In addition, although the proposed method can be easily generalized to incorporate other metrics of regional similarities, the benefits of using Pearson correlation in our application are reinforced by the experimental results. Without requiring new sources of information, our proposed approach improves the accuracy of MCI prediction from 80.83% (of conventional volumetric features) to 84.35% (of hierarchical network features), evaluated using data sets randomly drawn from the ADNI (Alzheimer's Disease Neuroimaging Initiative) dataset.
Collapse
|
Research Support, N.I.H., Extramural |
14 |
64 |
24
|
Jin Y, Wee CY, Shi F, Thung KH, Ni D, Yap PT, Shen D. Identification of infants at high-risk for autism spectrum disorder using multiparameter multiscale white matter connectivity networks. Hum Brain Mapp 2015; 36:4880-96. [PMID: 26368659 DOI: 10.1002/hbm.22957] [Citation(s) in RCA: 63] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2015] [Revised: 07/27/2015] [Accepted: 08/20/2015] [Indexed: 12/26/2022] Open
Abstract
Autism spectrum disorder (ASD) is a wide range of disabilities that cause life-long cognitive impairment and social, communication, and behavioral challenges. Early diagnosis and medical intervention are important for improving the life quality of autistic patients. However, in the current practice, diagnosis often has to be delayed until the behavioral symptoms become evident during childhood. In this study, we demonstrate the feasibility of using machine learning techniques for identifying high-risk ASD infants at as early as six months after birth. This is based on the observation that ASD-induced abnormalities in white matter (WM) tracts and whole-brain connectivity have already started to appear within 24 months after birth. In particular, we propose a novel multikernel support vector machine classification framework by using the connectivity features gathered from WM connectivity networks, which are generated via multiscale regions of interest (ROIs) and multiple diffusion statistics such as fractional anisotropy, mean diffusivity, and average fiber length. Our proposed framework achieves an accuracy of 76% and an area of 0.80 under the receiver operating characteristic curve (AUC), in comparison to the accuracy of 70% and the AUC of 70% provided by the best single-parameter single-scale network. The improvement in accuracy is mainly due to the complementary information provided by multiparameter multiscale networks. In addition, our framework also provides the potential imaging connectomic markers and an objective means for early ASD diagnosis.
Collapse
|
Research Support, Non-U.S. Gov't |
10 |
63 |
25
|
Wee CY, Zhao Z, Yap PT, Wu G, Shi F, Price T, Du Y, Xu J, Zhou Y, Shen D. Disrupted brain functional network in internet addiction disorder: a resting-state functional magnetic resonance imaging study. PLoS One 2014; 9:e107306. [PMID: 25226035 PMCID: PMC4165900 DOI: 10.1371/journal.pone.0107306] [Citation(s) in RCA: 63] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2014] [Accepted: 08/11/2014] [Indexed: 11/18/2022] Open
Abstract
Internet addiction disorder (IAD) is increasingly recognized as a mental health disorder, particularly among adolescents. The pathogenesis associated with IAD, however, remains unclear. In this study, we aim to explore the encephalic functional characteristics of IAD adolescents at rest using functional magnetic resonance imaging data. We adopted a graph-theoretic approach to investigate possible disruptions of functional connectivity in terms of network properties including small-worldness, efficiency, and nodal centrality on 17 adolescents with IAD and 16 socio-demographically matched healthy controls. False discovery rate-corrected parametric tests were performed to evaluate the statistical significance of group-level network topological differences. In addition, a correlation analysis was performed to assess the relationships between functional connectivity and clinical measures in the IAD group. Our results demonstrate that there is significant disruption in the functional connectome of IAD patients, particularly between regions located in the frontal, occipital, and parietal lobes. The affected connections are long-range and inter-hemispheric connections. Although significant alterations are observed for regional nodal metrics, there is no difference in global network topology between IAD and healthy groups. In addition, correlation analysis demonstrates that the observed regional abnormalities are correlated with the IAD severity and behavioral clinical assessments. Our findings, which are relatively consistent between anatomically and functionally defined atlases, suggest that IAD causes disruptions of functional connectivity and, importantly, that such disruptions might link to behavioral impairments.
Collapse
|
Research Support, Non-U.S. Gov't |
11 |
63 |