1
|
Longitudinal Infant Functional Connectivity Prediction via Conditional Intensive Triplet Network. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2022; 13438:255-264. [PMID: 36563062 PMCID: PMC9769983 DOI: 10.1007/978-3-031-16452-1_25] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
Longitudinal infant brain functional connectivity (FC) constructed from resting-state functional MRI (rs-fMRI) has increasingly become a pivotal tool in studying the dynamics of early brain development. However, due to various reasons including high acquisition cost, strong motion artifact, and subject dropout, there has been an extreme shortage of usable longitudinal infant rs-fMRI scans to construct longitudinal FCs, which hinders comprehensive understanding and modeling of brain functional development at early ages. To address this issue, in this paper, we propose a novel conditional intensive triplet network (CITN) for longitudinal prediction of the dynamic development of infant FC, which can traverse FCs within a long duration and predict the target FC at any specific age during infancy. Targeting at accurately modeling of the progression pattern of FC, while maintaining the individual functional uniqueness, our model effectively disentangles the intrinsically mixed age-related and identity-related information from the source FC and predicts the target FC by fusing well-disentangled identity-related information with the specific age-related information. Specifically, we introduce an intensive triplet auto-encoder for effective disentanglement of age-related and identity-related information and an identity conditional module to mix identity-related information with designated age-related information. We train the proposed model in a self-supervised way and design downstream tasks to help robustly disentangle age-related and identity-related features. Experiments on 464 longitudinal infant fMRI scans show the superior performance of the proposed method in longitudinal FC prediction in comparison with state-of-the-art approaches.
Collapse
|
2
|
Longitudinal Structural MRI Data Prediction in Nondemented and Demented Older Adults via Generative Adversarial Convolutional Network. Neural Process Lett 2022. [DOI: 10.1007/s11063-022-10922-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
|
3
|
Copeland A, Silver E, Korja R, Lehtola SJ, Merisaari H, Saukko E, Sinisalo S, Saunavaara J, Lähdesmäki T, Parkkola R, Nolvi S, Karlsson L, Karlsson H, Tuulari JJ. Infant and Child MRI: A Review of Scanning Procedures. Front Neurosci 2021; 15:666020. [PMID: 34321992 PMCID: PMC8311184 DOI: 10.3389/fnins.2021.666020] [Citation(s) in RCA: 27] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2021] [Accepted: 05/04/2021] [Indexed: 12/13/2022] Open
Abstract
Magnetic resonance imaging (MRI) is a safe method to examine human brain. However, a typical MR scan is very sensitive to motion, and it requires the subject to lie still during the acquisition, which is a major challenge for pediatric scans. Consequently, in a clinical setting, sedation or general anesthesia is often used. In the research setting including healthy subjects anesthetics are not recommended for ethical reasons and potential longer-term harm. Here we review the methods used to prepare a child for an MRI scan, but also on the techniques and tools used during the scanning to enable a successful scan. Additionally, we critically evaluate how studies have reported the scanning procedure and success of scanning. We searched articles based on special subject headings from PubMed and identified 86 studies using brain MRI in healthy subjects between 0 and 6 years of age. Scan preparations expectedly depended on subject's age; infants and young children were scanned asleep after feeding and swaddling and older children were scanned awake. Comparing the efficiency of different procedures was difficult because of the heterogeneous reporting of the used methods and the success rates. Based on this review, we recommend more detailed reporting of scanning procedure to help find out which are the factors affecting the success of scanning. In the long term, this could help the research field to get high quality data, but also the clinical field to reduce the use of anesthetics. Finally, we introduce the protocol used in scanning 2 to 5-week-old infants in the FinnBrain Birth Cohort Study, and tips for calming neonates during the scans.
Collapse
Affiliation(s)
- Anni Copeland
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
- Department of Psychiatry, Turku University Hospital, University of Turku, Turku, Finland
| | - Eero Silver
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
- Department of Psychiatry, Turku University Hospital, University of Turku, Turku, Finland
| | - Riikka Korja
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
- Department of Psychology, University of Turku, Turku, Finland
| | - Satu J. Lehtola
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
| | - Harri Merisaari
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
- Department of Radiology, Turku University Hospital, University of Turku, Turku, Finland
| | - Ekaterina Saukko
- Department of Radiology, Turku University Hospital, University of Turku, Turku, Finland
| | - Susanne Sinisalo
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
| | - Jani Saunavaara
- Department of Medical Physics, Turku University Hospital, Turku, Finland
| | - Tuire Lähdesmäki
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
- Department of Pediatric Neurology, Turku University Hospital, University of Turku, Turku, Finland
| | - Riitta Parkkola
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
- Department of Radiology, Turku University Hospital, University of Turku, Turku, Finland
| | - Saara Nolvi
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
- Department of Psychology and Speech-Language Pathology, Turku Institute for Advanced Studies, University of Turku, Turku, Finland
| | - Linnea Karlsson
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
- Department of Psychiatry, Turku University Hospital, University of Turku, Turku, Finland
- Centre for Population Health Research, Turku University Hospital, University of Turku, Turku, Finland
| | - Hasse Karlsson
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
- Department of Psychiatry, Turku University Hospital, University of Turku, Turku, Finland
| | - Jetro J. Tuulari
- FinnBrain Birth Cohort Study, Turku Brain and Mind Center, Department of Clinical Medicine, University of Turku, Turku, Finland
- Department of Psychiatry, Turku University Hospital, University of Turku, Turku, Finland
- Turku Collegium for Science, Medicine and Technology, University of Turku, Turku, Finland
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
4
|
Zhao F, Wu Z, Wang L, Lin W, Gilmore JH, Xia S, Shen D, Li G. Spherical Deformable U-Net: Application to Cortical Surface Parcellation and Development Prediction. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:1217-1228. [PMID: 33417540 PMCID: PMC8016713 DOI: 10.1109/tmi.2021.3050072] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Convolutional Neural Networks (CNNs) have achieved overwhelming success in learning-related problems for 2D/3D images in the Euclidean space. However, unlike in the Euclidean space, the shapes of many structures in medical imaging have an inherent spherical topology in a manifold space, e.g., the convoluted brain cortical surfaces represented by triangular meshes. There is no consistent neighborhood definition and thus no straightforward convolution/pooling operations for such cortical surface data. In this paper, leveraging the regular and hierarchical geometric structure of the resampled spherical cortical surfaces, we create the 1-ring filter on spherical cortical triangular meshes and accordingly develop convolution/pooling operations for constructing Spherical U-Net for cortical surface data. However, the regular nature of the 1-ring filter makes it inherently limited to model fixed geometric transformations. To further enhance the transformation modeling capability of Spherical U-Net, we introduce the deformable convolution and deformable pooling to cortical surface data and accordingly propose the Spherical Deformable U-Net (SDU-Net). Specifically, spherical offsets are learned to freely deform the 1-ring filter on the sphere to adaptively localize cortical structures with different sizes and shapes. We then apply the SDU-Net to two challenging and scientifically important tasks in neuroimaging: cortical surface parcellation and cortical attribute map prediction. Both applications validate the competitive performance of our approach in accuracy and computational efficiency in comparison with state-of-the-art methods.
Collapse
|
5
|
Peng L, Lin L, Lin Y, Chen YW, Mo Z, Vlasova RM, Kim SH, Evans AC, Dager SR, Estes AM, McKinstry RC, Botteron KN, Gerig G, Schultz RT, Hazlett HC, Piven J, Burrows CA, Grzadzinski RL, Girault JB, Shen MD, Styner MA. Longitudinal Prediction of Infant MR Images With Multi-Contrast Perceptual Adversarial Learning. Front Neurosci 2021; 15:653213. [PMID: 34566556 PMCID: PMC8458966 DOI: 10.3389/fnins.2021.653213] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 08/09/2021] [Indexed: 11/28/2022] Open
Abstract
The infant brain undergoes a remarkable period of neural development that is crucial for the development of cognitive and behavioral capacities (Hasegawa et al., 2018). Longitudinal magnetic resonance imaging (MRI) is able to characterize the developmental trajectories and is critical in neuroimaging studies of early brain development. However, missing data at different time points is an unavoidable occurrence in longitudinal studies owing to participant attrition and scan failure. Compared to dropping incomplete data, data imputation is considered a better solution to address such missing data in order to preserve all available samples. In this paper, we adapt generative adversarial networks (GAN) to a new application: longitudinal image prediction of structural MRI in the first year of life. In contrast to existing medical image-to-image translation applications of GANs, where inputs and outputs share a very close anatomical structure, our task is more challenging as brain size, shape and tissue contrast vary significantly between the input data and the predicted data. Several improvements over existing GAN approaches are proposed to address these challenges in our task. To enhance the realism, crispness, and accuracy of the predicted images, we incorporate both a traditional voxel-wise reconstruction loss as well as a perceptual loss term into the adversarial learning scheme. As the differing contrast changes in T1w and T2w MR images in the first year of life, we incorporate multi-contrast images leading to our proposed 3D multi-contrast perceptual adversarial network (MPGAN). Extensive evaluations are performed to assess the qualityand fidelity of the predicted images, including qualitative and quantitative assessments of the image appearance, as well as quantitative assessment on two segmentation tasks. Our experimental results show that our MPGAN is an effective solution for longitudinal MR image data imputation in the infant brain. We further apply our predicted/imputed images to two practical tasks, a regression task and a classification task, in order to highlight the enhanced task-related performance following image imputation. The results show that the model performance in both tasks is improved by including the additional imputed data, demonstrating the usability of the predicted images generated from our approach.
Collapse
Affiliation(s)
- Liying Peng
- Department of Computer Science, Zhejiang University, Hangzhou, China
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
| | - Lanfen Lin
- Department of Computer Science, Zhejiang University, Hangzhou, China
| | - Yusen Lin
- Department of Electrical and Computer Engineering Department, University of Maryland, College Park, MD, United States
| | - Yen-wei Chen
- Department of Information Science and Engineering, Ritsumeikan University, Shiga, Japan
| | - Zhanhao Mo
- Department of Radiology, China-Japan Union Hospital of Jilin University, Changchun, Jilin, China
| | - Roza M. Vlasova
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
| | - Sun Hyung Kim
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
| | - Alan C. Evans
- Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Stephen R. Dager
- Department of Radiology, University of Washington, Seattle, WA, United States
| | - Annette M. Estes
- Department of Speech and Hearing Sciences, University of Washington, Seattle, WA, United States
| | - Robert C. McKinstry
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, United States
| | - Kelly N. Botteron
- Mallinckrodt Institute of Radiology, Washington University School of Medicine, St Louis, MO, United States
- Department of Psychiatry, Washington University School of Medicine, St. Louis, MO, United States
| | - Guido Gerig
- Department of Computer Science and Engineering, New York University, New York, NY, United States
| | - Robert T. Schultz
- Center for Autism Research, Department of Pediatrics, Children's Hospital of Philadelphia, and University of Pennsylvania, Philadelphia, PA, United States
| | - Heather C. Hazlett
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
- Carolina Institute for Developmental Disabilities, University of North Carolina School of Medicine, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
| | - Joseph Piven
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
- Carolina Institute for Developmental Disabilities, University of North Carolina School of Medicine, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
| | - Catherine A. Burrows
- Department of Pediatrics, University of Minnesota, Minneapolis, MN, United States
| | - Rebecca L. Grzadzinski
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
- Carolina Institute for Developmental Disabilities, University of North Carolina School of Medicine, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
| | - Jessica B. Girault
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
- Carolina Institute for Developmental Disabilities, University of North Carolina School of Medicine, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
| | - Mark D. Shen
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
- Carolina Institute for Developmental Disabilities, University of North Carolina School of Medicine, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
- UNC Neuroscience Center, University of North Carolina-Chapel Hill, Chapel Hill, NC, United States
| | - Martin A. Styner
- Department of Psychiatry, UNC School of Medicine, University of North Carolina, Chapel Hill, NC, United States
- Department of Computer Science, University of North Carolina, Chapel Hill, NC, United States
- *Correspondence: Martin A. Styner
| |
Collapse
|
6
|
Kirk-Provencher KT, Nelson-Aguiar RJ, Spillane NS. Neuroanatomical Differences Among Sexual Offenders: A Targeted Review with Limitations and Implications for Future Directions. VIOLENCE AND GENDER 2020; 7:86-97. [PMID: 32939353 PMCID: PMC7488205 DOI: 10.1089/vio.2019.0051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
As sexual assault and child sexual abuse continue to be worldwide public health concerns, research has continued to explore factors associated with sexual offending. Structural and functional neuroanatomical brain differences have been examined in an effort to differentiate sexual offenders and their behavior. This targeted review searched PubMed and Google Scholar for empirical studies using brain imaging techniques to examine possible structural or functional differences among control groups compared with at least one group of sexual offenders with contact offenses. This targeted review summarizes the structural and functional findings of 15 brain imaging studies (i.e., computed tomography, diffusion tensor imaging, magnetic resonance imaging, positron emission tomography, and functional magnetic resonance imaging), which suggest possible differences in brain size and gray matter volume, cortical thickness, white matter connectivity, and specific structural and functional differences among brain regions (fronto-temporal region, amygdala, prefrontal cortex, etc.). The methodological limitations of brain imaging studies and the associated findings with regard to sexual offenders are highlighted, as research indicates that many of the proposed differences in brain structure and function are not unique to this population. We further highlight several limitations to using neuroimaging studies to examine this population of interest, including publication bias, small sample size, underpowered studies, and all-male samples. As these results are mixed and findings are not seemingly unique to sexual offenders, we suggest future sexual offender research may benefit from focusing on more financially feasible options, such as neuropsychological assessment approaches, to assess for and attend to offenders' criminogenic and rehabilitative/therapeutic needs in alignment with the risk-need-responsivity model.
Collapse
Affiliation(s)
| | | | - Nichea S. Spillane
- Department of Psychology, University of Rhode Island, Kingston, Rhode Island, USA
| |
Collapse
|
7
|
Hong Y, Kim J, Chen G, Lin W, Yap PT, Shen D. Longitudinal Prediction of Infant Diffusion MRI Data via Graph Convolutional Adversarial Networks. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2717-2725. [PMID: 30990424 PMCID: PMC6935161 DOI: 10.1109/tmi.2019.2911203] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Missing data is a common problem in longitudinal studies due to subject dropouts and failed scans. We present a graph-based convolutional neural network to predict missing diffusion MRI data. In particular, we consider the relationships between sampling points in the spatial domain and the diffusion wave-vector domain to construct a graph. We then use a graph convolutional network to learn the non-linear mapping from available data to missing data. Our method harnesses a multi-scale residual architecture with adversarial learning for prediction with greater accuracy and perceptual quality. Experimental results show that our method is accurate and robust in the longitudinal prediction of infant brain diffusion MRI data.
Collapse
Affiliation(s)
- Yoonmi Hong
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, U.S.A
| | - Jaeil Kim
- School of Computer Science and Engineering, Kyungpook National University, Daegu, Korea
| | - Geng Chen
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, U.S.A
| | - Weili Lin
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, U.S.A
| | - Pew-Thian Yap
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, U.S.A
| | - Dinggang Shen
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina at Chapel Hill, NC, U.S.A
- Department of Brain and Cognitive Engineering, Korea University, Seoul, Korea
| |
Collapse
|
8
|
Zhao F, Xia S, Wu Z, Duan D, Wang L, Lin W, Gilmore JH, Shen D, Li G. Spherical U-Net on Cortical Surfaces: Methods and Applications. INFORMATION PROCESSING IN MEDICAL IMAGING : PROCEEDINGS OF THE ... CONFERENCE 2019; 11492:855-866. [PMID: 32180666 PMCID: PMC7074928 DOI: 10.1007/978-3-030-20351-1_67] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Convolutional Neural Networks (CNNs) have been providing the state-of-the-art performance for learning-related problems involving 2D/3D images in Euclidean space. However, unlike in the Euclidean space, the shapes of many structures in medical imaging have a spherical topology in a manifold space, e.g., brain cortical or subcortical surfaces represented by triangular meshes, with large inter-subject and intra-subject variations in vertex number and local connectivity. Hence, there is no consistent neighborhood definition and thus no straightforward convolution/transposed convolution operations for cortical/subcortical surface data. In this paper, by leveraging the regular and consistent geometric structure of the resampled cortical surface mapped onto the spherical space, we propose a novel convolution filter analogous to the standard convolution on the image grid. Accordingly, we develop corresponding operations for convolution, pooling, and transposed convolution for spherical surface data and thus construct spherical CNNs. Specifically, we propose the Spherical U-Net architecture by replacing all operations in the standard U-Net with their spherical operation counterparts. We then apply the Spherical U-Net to two challenging and neuroscientifically important tasks in infant brains: cortical surface parcellation and cortical attribute map development prediction. Both applications demonstrate the competitive performance in the accuracy, computational efficiency, and effectiveness of our proposed Spherical U-Net, in comparison with the state-of-the-art methods.
Collapse
Affiliation(s)
- Fenqiang Zhao
- Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, China
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Shunren Xia
- Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, China
| | - Zhengwang Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Dingna Duan
- Key Laboratory of Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, China
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - John H Gilmore
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| |
Collapse
|
9
|
Wu Z, Wang L, Lin W, Gilmore JH, Li G, Shen D. Construction of 4D infant cortical surface atlases with sharp folding patterns via spherical patch-based group-wise sparse representation. Hum Brain Mapp 2019; 40:3860-3880. [PMID: 31115143 DOI: 10.1002/hbm.24636] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2018] [Revised: 04/14/2019] [Accepted: 05/09/2019] [Indexed: 11/08/2022] Open
Abstract
4D (spatial + temporal) infant cortical surface atlases covering dense time points are highly needed for understanding dynamic early brain development. In this article, we construct a set of 4D infant cortical surface atlases with longitudinally consistent and sharp cortical attribute patterns at 11 time points in the first six postnatal years, that is, at 1, 3, 6, 9, 12, 18, 24, 36, 48, 60, and 72 months of age, which is targeted for better normalization of the dynamic changing early brain cortical surfaces. To ensure longitudinal consistency and unbiasedness, we adopt a two-stage group-wise surface registration. To preserve sharp cortical attribute patterns on the atlas, instead of simply averaging over the coregistered cortical surfaces, we leverage a spherical patch-based sparse representation using the augmented dictionary to overcome the potential registration errors. Our atlases provide not only geometric attributes of the cortical folding, but also cortical thickness and myelin content. Therefore, to address the consistency across different cortical attributes on the atlas, instead of sparsely representing each attribute independently, we jointly represent all cortical attributes with a group-wise sparsity constraint. In addition, to further facilitate region-based analysis using our atlases, we have also provided two widely used parcellations, that is, FreeSurfer parcellation and multimodal parcellation, on our 4D infant cortical surface atlases. Compared to cortical surface atlases constructed with other methods, our cortical surface atlases preserve sharper cortical folding attribute patterns, thus leading to better accuracy in registration of individual infant cortical surfaces to the atlas.
Collapse
Affiliation(s)
- Zhengwang Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - John H Gilmore
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina.,Department of Brain and Cognitive Engineering, Korea University, Seoul, Republic of Korea
| |
Collapse
|
10
|
Zhang C, Adeli E, Wu Z, Li G, Lin W, Shen D. Infant Brain Development Prediction With Latent Partial Multi-View Representation Learning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:909-918. [PMID: 30307859 PMCID: PMC6450718 DOI: 10.1109/tmi.2018.2874964] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
The early postnatal period witnesses rapid and dynamic brain development. However, the relationship between brain anatomical structure and cognitive ability is still unknown. Currently, there is no explicit model to characterize this relationship in the literature. In this paper, we explore this relationship by investigating the mapping between morphological features of the cerebral cortex and cognitive scores. To this end, we introduce a multi-view multi-task learning approach to intuitively explore complementary information from different time-points and handle the missing data issue in longitudinal studies simultaneously. Accordingly, we establish a novel model, latent partial multi-view representation learning. Our approach regards data from different time-points as different views and constructs a latent representation to capture the complementary information from incomplete time-points. The latent representation explores the complementarity across different time-points and improves the accuracy of prediction. The minimization problem is solved by the alternating direction method of multipliers. Experimental results on both synthetic and real data validate the effectiveness of our proposed algorithm.
Collapse
Affiliation(s)
- Changqing Zhang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA and College of Intelligence and Computing, Tianjin University, Tianjin, China, ()
| | - Ehsan Adeli
- Department of Psychiatry and Behavioral Sciences, Stanford University, California, USA, ()
| | - Zhengwang Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA, ()
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA, ()
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA, ()
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina, USA, and also with Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea, ()
| |
Collapse
|
11
|
Lebenberg J, Mangin JF, Thirion B, Poupon C, Hertz-Pannier L, Leroy F, Adibpour P, Dehaene-Lambertz G, Dubois J. Mapping the asynchrony of cortical maturation in the infant brain: A MRI multi-parametric clustering approach. Neuroimage 2019; 185:641-653. [DOI: 10.1016/j.neuroimage.2018.07.022] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2017] [Revised: 07/02/2018] [Accepted: 07/10/2018] [Indexed: 12/28/2022] Open
|
12
|
Xia J, Wang F, Meng Y, Wu Z, Wang L, Lin W, Zhang C, Shen D, Li G. A computational method for longitudinal mapping of orientation-specific expansion of cortical surface in infants. Med Image Anal 2018; 49:46-59. [PMID: 30092545 PMCID: PMC6276374 DOI: 10.1016/j.media.2018.07.006] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2018] [Revised: 05/24/2018] [Accepted: 07/17/2018] [Indexed: 12/29/2022]
Abstract
The cortical surface of the human brain expands dynamically and regionally heterogeneously during the first postnatal year. As all primary and secondary cortical folds as well as many tertiary cortical folds are well established at term birth, the cortical surface area expansion during this stage is largely driven by the increase of surface area in two orthogonal orientations in the tangent plane: 1) the expansion parallel to the folding orientation (i.e., increasing the lengths of folds) and 2) the expansion perpendicular to the folding orientation (i.e., increasing the depths of folds). This information would help us better understand the mechanisms of cortical development and provide important insights into neurodevelopmental disorders, but still remains largely unknown due to lack of dedicated computational methods. To address this issue, we propose a novel method for longitudinal mapping of orientation-specific expansion of cortical surface area in these two orthogonal orientations during early infancy. First, to derive the two orientation fields perpendicular and parallel to cortical folds, we propose to adaptively and smoothly fuse the gradient field of sulcal depth and also the maximum principal direction field, by leveraging their region-specific reliability. Specifically, we formulate this task as a discrete labeling problem, in which each vertex is assigned to an orientation label, and solve it by graph cuts. Then, based on the computed longitudinal deformation of the cortical surface, we estimate the Jacobian matrix at each vertex by solving a least-squares problem and derive its corresponding stretch tensor. Finally, to obtain the orientation-specific cortical surface expansion, we project the stretch tensor into the two orthogonal orientations separately. We have applied the proposed method to 30 healthy infants, and for the first time we revealed the orientation-specific longitudinal cortical surface expansion maps during the first postnatal year.
Collapse
Affiliation(s)
- Jing Xia
- Department of Computer Science and Technology, Shandong University, Jinan 250100, China; Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA.
| | - Fan Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Yu Meng
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Zhengwang Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Caiming Zhang
- Digital Media Technology Key Lab of Shandong Province, Jinan 250061, China; Department of Software, Shandong University, Jinan 250100, China
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA; Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea.
| | - Gang Li
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA.
| |
Collapse
|
13
|
Computational neuroanatomy of baby brains: A review. Neuroimage 2018; 185:906-925. [PMID: 29574033 DOI: 10.1016/j.neuroimage.2018.03.042] [Citation(s) in RCA: 95] [Impact Index Per Article: 15.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2017] [Revised: 02/23/2018] [Accepted: 03/19/2018] [Indexed: 12/12/2022] Open
Abstract
The first postnatal years are an exceptionally dynamic and critical period of structural, functional and connectivity development of the human brain. The increasing availability of non-invasive infant brain MR images provides unprecedented opportunities for accurate and reliable charting of dynamic early brain developmental trajectories in understanding normative and aberrant growth. However, infant brain MR images typically exhibit reduced tissue contrast (especially around 6 months of age), large within-tissue intensity variations, and regionally-heterogeneous, dynamic changes, in comparison with adult brain MR images. Consequently, the existing computational tools developed typically for adult brains are not suitable for infant brain MR image processing. To address these challenges, many infant-tailored computational methods have been proposed for computational neuroanatomy of infant brains. In this review paper, we provide a comprehensive review of the state-of-the-art computational methods for infant brain MRI processing and analysis, which have advanced our understanding of early postnatal brain development. We also summarize publically available infant-dedicated resources, including MRI datasets, computational tools, grand challenges, and brain atlases. Finally, we discuss the limitations in current research and suggest potential future research directions.
Collapse
|