1
|
Wang F, Zhang H, Wu Z, Hu D, Zhou Z, Girault JB, Wang L, Lin W, Li G. Fine-grained functional parcellation maps of the infant cerebral cortex. eLife 2023; 12:e75401. [PMID: 37526293 PMCID: PMC10393291 DOI: 10.7554/elife.75401] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Accepted: 07/17/2023] [Indexed: 08/02/2023] Open
Abstract
Resting-state functional MRI (rs-fMRI) is widely used to examine the dynamic brain functional development of infants, but these studies typically require precise cortical parcellation maps, which cannot be directly borrowed from adult-based functional parcellation maps due to the substantial differences in functional brain organization between infants and adults. Creating infant-specific cortical parcellation maps is thus highly desired but remains challenging due to difficulties in acquiring and processing infant brain MRIs. In this study, we leveraged 1064 high-resolution longitudinal rs-fMRIs from 197 typically developing infants and toddlers from birth to 24 months who participated in the Baby Connectome Project to develop the first set of infant-specific, fine-grained, surface-based cortical functional parcellation maps. To establish meaningful cortical functional correspondence across individuals, we performed cortical co-registration using both the cortical folding geometric features and the local gradient of functional connectivity (FC). Then we generated both age-related and age-independent cortical parcellation maps with over 800 fine-grained parcels during infancy based on aligned and averaged local gradient maps of FC across individuals. These parcellation maps reveal complex functional developmental patterns, such as changes in local gradient, network size, and local efficiency, especially during the first 9 postnatal months. Our generated fine-grained infant cortical functional parcellation maps are publicly available at https://www.nitrc.org/projects/infantsurfatlas/ for advancing the pediatric neuroimaging field.
Collapse
Affiliation(s)
- Fan Wang
- Key Laboratory of Biomedical Information Engineering of Ministry of Education, Department of Biomedical Engineering, School of Life Science and Technology, Xi'an Jiaotong UniversityXi'anChina
- Department of Radiology and Biomedical Research Imaging Center, the University of North Carolina at Chapel HillChapel HillUnited States
| | - Han Zhang
- Department of Radiology and Biomedical Research Imaging Center, the University of North Carolina at Chapel HillChapel HillUnited States
| | - Zhengwang Wu
- Department of Radiology and Biomedical Research Imaging Center, the University of North Carolina at Chapel HillChapel HillUnited States
| | - Dan Hu
- Department of Radiology and Biomedical Research Imaging Center, the University of North Carolina at Chapel HillChapel HillUnited States
| | - Zhen Zhou
- Department of Radiology and Biomedical Research Imaging Center, the University of North Carolina at Chapel HillChapel HillUnited States
| | - Jessica B Girault
- Department of Psychiatry, the University of North Carolina at Chapel HillChapel HillUnited States
| | - Li Wang
- Department of Radiology and Biomedical Research Imaging Center, the University of North Carolina at Chapel HillChapel HillUnited States
| | - Weili Lin
- Department of Radiology and Biomedical Research Imaging Center, the University of North Carolina at Chapel HillChapel HillUnited States
| | - Gang Li
- Department of Radiology and Biomedical Research Imaging Center, the University of North Carolina at Chapel HillChapel HillUnited States
| |
Collapse
|
2
|
Cheng J, Zhang X, Zhao F, Wu Z, Yuan X, Gilmore JH, Wang L, Lin W, Li G. Spherical Transformer on Cortical Surfaces. MACHINE LEARNING IN MEDICAL IMAGING. MLMI (WORKSHOP) 2022; 2022:406-415. [PMID: 38107539 PMCID: PMC10722887 DOI: 10.1007/978-3-031-21014-3_42] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/19/2023]
Abstract
Motivated by the recent great success of attention modeling in computer vision, it is highly desired to extend the Transformer architecture from the conventional Euclidean space to non-Euclidean spaces. Given the intrinsic spherical topology of brain cortical surfaces in neuroimaging, in this study, we propose a novel Spherical Transformer, an effective general-purpose backbone using the self-attention mechanism for analysis of cortical surface data represented by triangular meshes. By mapping the cortical surface onto a sphere and splitting it uniformly into overlapping spherical surface patches, we encode the long-range dependency within each patch by the self-attention operation and formulate the cross-patch feature transmission via overlapping regions. By limiting the self-attention computation to local patches, our proposed Spherical Transformer preserves detailed contextual information and enjoys great efficiency with linear computational complexity with respect to the patch size. Moreover, to better process longitudinal cortical surfaces, which are increasingly popular in neuroimaging studies, we unprecedentedly propose the spatiotemporal self-attention operation to jointly extract the spatial context and dynamic developmental patterns within a single layer, thus further enlarging the expressive power of the generated representation. To comprehensively evaluate the performance of our Spherical Transformer, we validate it on a surface-level prediction task and a vertex-level dense prediction task, respectively, i.e., the cognition prediction and cortical thickness map development prediction, which are important in early brain development mapping. Both applications demonstrate the competitive performance of our Spherical Transformer in comparison with the state-of-the-art methods.
Collapse
Affiliation(s)
- Jiale Cheng
- South China University of Technology, Guangzhou, China
- Department of Radiology and BRIC. University of North Carolina at Chapel Hill, NC, USA
| | - Xin Zhang
- South China University of Technology, Guangzhou, China
| | - Fenqiang Zhao
- Department of Radiology and BRIC. University of North Carolina at Chapel Hill, NC, USA
| | - Zhengwang Wu
- Department of Radiology and BRIC. University of North Carolina at Chapel Hill, NC, USA
| | - Xinrui Yuan
- Department of Radiology and BRIC. University of North Carolina at Chapel Hill, NC, USA
| | - John H Gilmore
- Department of Psychiatry. University of North Carolina at Chapel Hill, NC, USA
| | - Li Wang
- Department of Radiology and BRIC. University of North Carolina at Chapel Hill, NC, USA
| | - Weili Lin
- Department of Radiology and BRIC. University of North Carolina at Chapel Hill, NC, USA
| | - Gang Li
- Department of Radiology and BRIC. University of North Carolina at Chapel Hill, NC, USA
| |
Collapse
|
3
|
Cheng J, Zhang X, Ni H, Li C, Xu X, Wu Z, Wang L, Lin W, Li G. Path Signature Neural Network of Cortical Features for Prediction of Infant Cognitive Scores. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:1665-1676. [PMID: 35089858 PMCID: PMC9246848 DOI: 10.1109/tmi.2022.3147690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Studies have shown that there is a tight connection between cognition skills and brain morphology during infancy. Nonetheless, it is still a great challenge to predict individual cognitive scores using their brain morphological features, considering issues like the excessive feature dimension, small sample size and missing data. Due to the limited data, a compact but expressive feature set is desirable as it can reduce the dimension and avoid the potential overfitting issue. Therefore, we pioneer the path signature method to further explore the essential hidden dynamic patterns of longitudinal cortical features. To form a hierarchical and more informative temporal representation, in this work, a novel cortical feature based path signature neural network (CF-PSNet) is proposed with stacked differentiable temporal path signature layers for prediction of individual cognitive scores. By introducing the existence embedding in path generation, we can improve the robustness against the missing data. Benefiting from the global temporal receptive field of CF-PSNet, characteristics consisted in the existing data can be fully leveraged. Further, as there is no need for the whole brain to work for a certain cognitive ability, a top K selection module is used to select the most influential brain regions, decreasing the model size and the risk of overfitting. Extensive experiments are conducted on an in-house longitudinal infant dataset within 9 time points. By comparing with several recent algorithms, we illustrate the state-of-the-art performance of our CF-PSNet (i.e., root mean square error of 0.027 with the time latency of 518 milliseconds for each sample).
Collapse
|
4
|
Hu D, Wang F, Zhang H, Wu Z, Zhou Z, Li G, Wang L, Lin W, Li G. Existence of Functional Connectome Fingerprint during Infancy and Its Stability over Months. J Neurosci 2022; 42:377-389. [PMID: 34789554 PMCID: PMC8802925 DOI: 10.1523/jneurosci.0480-21.2021] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Revised: 11/01/2021] [Accepted: 11/07/2021] [Indexed: 11/21/2022] Open
Abstract
The functional connectome fingerprint is a cluster of individualized brain functional connectivity patterns that are capable of distinguishing one individual from others. Although its existence has been demonstrated in adolescents and adults, whether such individualized patterns exist during infancy is barely investigated despite its importance in identifying the origin of the intrinsic connectome patterns that potentially mirror distinct behavioral phenotypes. To fill this knowledge gap, capitalizing on a longitudinal high-resolution structural and resting-state functional MRI dataset with 104 human infants (53 females) with 806 longitudinal scans (age, 16-876 d) and infant-specific functional parcellation maps, we observe that the brain functional connectome fingerprint may exist since infancy and keeps stable over months during early brain development. Specifically, we achieve an ∼78% individual identification rate by using ∼5% selected functional connections, compared with the best identification rate of 60% without connection selection. The frontoparietal networks recognized as the most contributive networks in adult functional connectome fingerprinting retain their superiority in infants despite being widely acknowledged as rapidly developing systems during childhood. The existence and stability of the functional connectome fingerprint are further validated on adjacent age groups. Moreover, we show that the infant frontoparietal networks can reach similar accuracy in predicting individual early learning composite scores as the whole-brain connectome, again resembling the observations in adults and highlighting the relevance of functional connectome fingerprint to cognitive performance. For the first time, these results suggest that each individual may retain a unique and stable marker of functional connectome during early brain development.SIGNIFICANCE STATEMENT Functional connectome fingerprinting during infancy featuring rapid brain development remains almost uninvestigated even though it is essential for understanding the early individual-level intrinsic pattern of functional organization and its relationship with distinct behavioral phenotypes. With an infant-tailored functional connection selection and validation strategy, we strive to provide the delineation of the infant functional connectome fingerprint by examining its existence, stability, and relationship with early cognitive performance. We observe that the brain functional connectome fingerprint may exist since early infancy and remains stable over months during the first 2 years. The identified key contributive functional connections and networks for fingerprinting are also verified to be highly predictive for cognitive score prediction, which reveals the association between infant connectome fingerprint and cognitive performance.
Collapse
Affiliation(s)
- Dan Hu
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, North Carolina 27599
| | - Fan Wang
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, North Carolina 27599
| | - Han Zhang
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, North Carolina 27599
| | - Zhengwang Wu
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, North Carolina 27599
| | - Zhen Zhou
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, North Carolina 27599
| | - Guoshi Li
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, North Carolina 27599
| | - Li Wang
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, North Carolina 27599
| | - Weili Lin
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, North Carolina 27599
| | - Gang Li
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, North Carolina 27599
| |
Collapse
|
5
|
Ghribi O, Li G, Lin W, Shen D, Rekik I. Multi-Regression based supervised sample selection for predicting baby connectome evolution trajectory from neonatal timepoint. Med Image Anal 2020; 68:101853. [PMID: 33264713 DOI: 10.1016/j.media.2020.101853] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Revised: 07/27/2020] [Accepted: 09/14/2020] [Indexed: 01/06/2023]
Abstract
The connectional map of the baby brain undergoes dramatic changes over the first year of postnatal development, which makes its mapping a challenging task, let alone learning how to predict its evolution. Currently, learning models for predicting brain connectomic developmental trajectories remain broadly absent despite their great potential in spotting atypical neurodevelopmental disorders early. This is most likely due to the scarcity and often incompleteness of longitudinal infant neuroimaging studies for training such models. In this paper, we propose the first approach for progressively predicting longitudinal development of brain networks during the postnatal period solely from a baseline connectome around birth. To this end, a supervised multi-regression sample selection strategy is designed to learn how to identify the best set of neighbors of a testing baseline connectome to eventually predict its evolution trajectory at follow-up timepoints. However, given that the training dataset may have missing samples (connectomes) at certain timepoints, this may affect the training of the predictive model. To overcome this problem, we perform a low-rank tensor completion based on a robust principal component analysis to impute the missing training connectomes by linearly approximating similar complete training networks. In the prediction step, our sample selection strategy aims to preserve spatiotemporal relationships between consecutive timepoints. Therefore, the proposed method learns how to identify the set of the local closest neighbors to a target network by training an ensemble of bidirectional regressors leveraging temporal dependency between consecutive timepoints with a recall to the baseline observations to progressively predict the evolution of a testing network over time. Our method achieves the best prediction results and better captures the dynamic changes of each brain connectome over time in comparison to its ablated versions using leave-one-out cross-validation strategy.
Collapse
Affiliation(s)
- Olfa Ghribi
- BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey; National School of Engineers of Sfax, University of Sfax, Tunisia
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Dinggang Shen
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, China; Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea.
| | - Islem Rekik
- BASIRA lab, Faculty of Computer and Informatics, Istanbul Technical University, Istanbul, Turkey; School of Science and Engineering, Computing, University of Dundee, UK.
| |
Collapse
|
6
|
Zhang C, Adeli E, Wu Z, Li G, Lin W, Shen D. Infant Brain Development Prediction With Latent Partial Multi-View Representation Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:909-918. [PMID: 30307859 PMCID: PMC6450718 DOI: 10.1109/tmi.2018.2874964] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
The early postnatal period witnesses rapid and dynamic brain development. However, the relationship between brain anatomical structure and cognitive ability is still unknown. Currently, there is no explicit model to characterize this relationship in the literature. In this paper, we explore this relationship by investigating the mapping between morphological features of the cerebral cortex and cognitive scores. To this end, we introduce a multi-view multi-task learning approach to intuitively explore complementary information from different time-points and handle the missing data issue in longitudinal studies simultaneously. Accordingly, we establish a novel model, latent partial multi-view representation learning. Our approach regards data from different time-points as different views and constructs a latent representation to capture the complementary information from incomplete time-points. The latent representation explores the complementarity across different time-points and improves the accuracy of prediction. The minimization problem is solved by the alternating direction method of multipliers. Experimental results on both synthetic and real data validate the effectiveness of our proposed algorithm.
Collapse
Affiliation(s)
- Changqing Zhang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA and College of Intelligence and Computing, Tianjin University, Tianjin, China, ()
| | - Ehsan Adeli
- Department of Psychiatry and Behavioral Sciences, Stanford University, California, USA, ()
| | - Zhengwang Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA, ()
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA, ()
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA, ()
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA, and also with Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea, ()
| |
Collapse
|
7
|
Zhang H, Shen D, Lin W. Resting-state functional MRI studies on infant brains: A decade of gap-filling efforts. Neuroimage 2019; 185:664-684. [PMID: 29990581 PMCID: PMC6289773 DOI: 10.1016/j.neuroimage.2018.07.004] [Citation(s) in RCA: 68] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2017] [Revised: 05/19/2018] [Accepted: 07/02/2018] [Indexed: 12/16/2022] Open
Abstract
Resting-state functional MRI (rs-fMRI) is one of the most prevalent brain functional imaging modalities. Previous rs-fMRI studies have mainly focused on adults and elderly subjects. Recently, infant rs-fMRI studies have become an area of active research. After a decade of gap filling studies, many facets of the brain functional development from early infancy to toddler has been uncovered. However, infant rs-fMRI is still in its infancy. The image analysis tools for neonates and young infants can be quite different from those for adults. From data analysis to result interpretation, more questions and issues have been raised, and new hypotheses have been formed. With the anticipated availability of unprecedented high-resolution rs-fMRI and dedicated analysis pipelines from the Baby Connectome Project (BCP), it is important now to revisit previous findings and hypotheses, discuss and comment existing issues and problems, and make a "to-do-list" for the future studies. This review article aims to comprehensively review a decade of the findings, unveiling hidden jewels of the fields of developmental neuroscience and neuroimage computing. Emphases will be given to early infancy, particularly the first few years of life. In this review, an end-to-end summary, from infant rs-fMRI experimental design to data processing, and from the development of individual functional systems to large-scale brain functional networks, is provided. A comprehensive summary of the rs-fMRI findings in developmental patterns is highlighted. Furthermore, an extensive summary of the neurodevelopmental disorders and the effects of other hazardous factors is provided. Finally, future research trends focusing on emerging dynamic functional connectivity and state-of-the-art functional connectome analysis are summarized. In next decade, early infant rs-fMRI and developmental connectome study could be one of the shining research topics.
Collapse
Affiliation(s)
- Han Zhang
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, 27599, USA
| | - Dinggang Shen
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, 27599, USA; Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Republic of Korea.
| | - Weili Lin
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, 27599, USA.
| |
Collapse
|
8
|
Ghribi O, Li G, Lin W, Shen D, Rekik I. Progressive Infant Brain Connectivity Evolution Prediction from Neonatal MRI Using Bidirectionally Supervised Sample Selection. PREDICTIVE INTELLIGENCE IN MEDICINE 2019. [DOI: 10.1007/978-3-030-32281-6_7] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
|
9
|
Adeli E, Meng Y, Li G, Lin W, Shen D. Multi-task prediction of infant cognitive scores from longitudinal incomplete neuroimaging data. Neuroimage 2018; 185:783-792. [PMID: 29709627 DOI: 10.1016/j.neuroimage.2018.04.052] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2017] [Revised: 03/26/2018] [Accepted: 04/23/2018] [Indexed: 01/13/2023] Open
Abstract
Early postnatal brain undergoes a stunning period of development. Over the past few years, research on dynamic infant brain development has received increased attention, exhibiting how important the early stages of a child's life are in terms of brain development. To precisely chart the early brain developmental trajectories, longitudinal studies with data acquired over a long-enough period of infants' early life is essential. However, in practice, missing data from different time point(s) during the data gathering procedure is often inevitable. This leads to incomplete set of longitudinal data, which poses a major challenge for such studies. In this paper, prediction of multiple future cognitive scores with incomplete longitudinal imaging data is modeled into a multi-task machine learning framework. To efficiently learn this model, we account for selection of informative features (i.e., neuroimaging morphometric measurements for different time points), while preserving the structural information and the interrelation between these multiple cognitive scores. Several experiments are conducted on a carefully acquired in-house dataset, and the results affirm that we can predict the cognitive scores measured at the age of four years old, using the imaging data of earlier time points, as early as 24 months of age, with a reasonable performance (i.e., root mean square error of 0.18).
Collapse
Affiliation(s)
- Ehsan Adeli
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, United States; Department of Psychiatry & Behavioral Sciences, Stanford University, Stanford, CA 94305, United States.
| | - Yu Meng
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, United States; Department of Computer Science, University of North Carolina at Chapel Hill, NC 27599, United States
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, United States
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, United States
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, United States; Department of Brain & Cognitive Eng, Korea University, Seoul, 02841, Republic of Korea.
| |
Collapse
|
10
|
Zhang C, Adeli E, Wu Z, Li G, Lin W, Shen D. INFANT BRAIN DEVELOPMENT PREDICTION WITH LATENT PARTIAL MULTI-VIEW REPRESENTATION LEARNING. PROCEEDINGS. IEEE INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING 2018; 2018:1048-1051. [PMID: 30464798 PMCID: PMC6242279 DOI: 10.1109/isbi.2018.8363751] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The early postnatal period witnesses rapid and dynamic brain development. Understanding the cognitive development patterns can help identify various disorders at early ages of life and is essential for the health and well-being of children. This inspires us to investigate the relation between cognitive ability and the cerebral cortex by exploiting brain images in a longitudinal study. Specifically, we aim to predict the infant brain development status based on the morphological features of the cerebral cortex. For this goal, we introduce a multi-view multi-task learning approach to dexterously explore complementary information from different time points and handle the missing data simultaneously. Specifically, we establish a novel model termed as Latent Partial Multi-view Representation Learning. The approach regards data of different time points as different views, and constructs a latent representation to capture the complementary underlying information from different and even incomplete time points. It uncovers the latent representation that can be jointly used to learn the prediction model. This formulation elegantly explores the complementarity, effectively reduces the redundancy of different views, and improves the accuracy of prediction. The minimization problem is solved by the Alternating Direction Method of Multipliers (ADMM). Experimental results on real data validate the proposed method.
Collapse
Affiliation(s)
- Changqing Zhang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA
- School of Computer Science and Technology, Tianjin University, Tianjin, China
| | - Ehsan Adeli
- Department of Psychiatry and Behavioral Sciences, Stanford University, California, USA
| | - Zhengwang Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA
| |
Collapse
|
11
|
Adeli E, Meng Y, Li G, Lin W, Shen D. Joint Sparse and Low-Rank Regularized MultiTask Multi-Linear Regression for Prediction of Infant Brain Development with Incomplete Data. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2017; 10433:40-48. [PMID: 30159549 PMCID: PMC6110528 DOI: 10.1007/978-3-319-66182-7_5] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
Studies involving dynamic infant brain development has received increasing attention in the past few years. For such studies, a complete longitudinal dataset is often required to precisely chart the early brain developmental trajectories. Whereas, in practice, we often face missing data at different time point(s) for different subjects. In this paper, we propose a new method for prediction of infant brain development scores at future time points based on longitudinal imaging measures at early time points with possible missing data. We treat this as a multi-dimensional regression problem, for predicting multiple brain development scores (multi-task) from multiple previous time points (multi-linear). To solve this problem, we propose an objective function with a joint ℓ1 and low-rank regularization on the mapping weight tensor, to enforce feature selection, while preserving the structural information from multiple dimensions. Also, based on the bag-of-words model, we propose to extract features from longitudinal imaging data. The experimental results reveal that we can effectively predict the brain development scores assessed at the age of four years, using the imaging data as early as two years of age.
Collapse
Affiliation(s)
- Ehsan Adeli
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill
| | - Yu Meng
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill
| |
Collapse
|
12
|
Rekik I, Li G, Yap PT, Chen G, Lin W, Shen D. Joint prediction of longitudinal development of cortical surfaces and white matter fibers from neonatal MRI. Neuroimage 2017; 152:411-424. [PMID: 28284800 PMCID: PMC5432411 DOI: 10.1016/j.neuroimage.2017.03.012] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2016] [Revised: 03/05/2017] [Accepted: 03/06/2017] [Indexed: 10/20/2022] Open
Abstract
The human brain can be modeled as multiple interrelated shapes (or a multishape), each for characterizing one aspect of the brain, such as the cortex and white matter pathways. Predicting the developing multishape is a very challenging task due to the contrasting nature of the developmental trajectories of the constituent shapes: smooth for the cortical surface and non-smooth for white matter tracts due to changes such as bifurcation. We recently addressed this problem and proposed an approach for predicting the multishape developmental spatiotemporal trajectories of infant brains based only on neonatal MRI data using a set of geometric, dynamic, and fiber-to-surface connectivity features. In this paper, we propose two key innovations to further improve the prediction of multishape evolution. First, for a more accurate cortical surface prediction, instead of simply relying on one neonatal atlas to guide the prediction of the multishape, we propose to use multiple neonatal atlases to build a spatially heterogeneous atlas using the multidirectional varifold representation. This individualizes the atlas by locally maximizing its similarity to the testing baseline cortical shape for each cortical region, thereby better representing the baseline testing cortical surface, which founds the multishape prediction process. Second, for temporally consistent fiber prediction, we propose to reliably estimate spatiotemporal connectivity features using low-rank tensor completion, thereby capturing the variability and richness of the temporal development of fibers. Experimental results confirm that the proposed variants significantly improve the prediction performance of our original multishape prediction framework for both cortical surfaces and fiber tracts shape at 3, 6, and 9 months of age. Our pioneering model will pave the way for learning how to predict the evolution of anatomical shapes with abnormal changes. Ultimately, devising accurate shape evolution prediction models that can help quantify and predict the severity of a brain disorder as it progresses will be of great aid in individualized treatment planning.
Collapse
Affiliation(s)
- Islem Rekik
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA; CVIP, Computing, School of Science and Engineering, University of Dundee, UK
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Pew-Thian Yap
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Geng Chen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA; Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea.
| |
Collapse
|