Learning-based subject-specific estimation of dynamic maps of cortical morphology at missing time points in longitudinal infant studies

Fine-grained functional parcellation maps of the infant cerebral cortex

Resting-state functional MRI (rs-fMRI) is widely used to examine the dynamic brain functional development of infants, but these studies typically require precise cortical parcellation maps, which cannot be directly borrowed from adult-based functional parcellation maps due to the substantial differences in functional brain organization between infants and adults. Creating infant-specific cortical parcellation maps is thus highly desired but remains challenging due to difficulties in acquiring and processing infant brain MRIs. In this study, we leveraged 1064 high-resolution longitudinal rs-fMRIs from 197 typically developing infants and toddlers from birth to 24 months who participated in the Baby Connectome Project to develop the first set of infant-specific, fine-grained, surface-based cortical functional parcellation maps. To establish meaningful cortical functional correspondence across individuals, we performed cortical co-registration using both the cortical folding geometric features and the local gradient of functional connectivity (FC). Then we generated both age-related and age-independent cortical parcellation maps with over 800 fine-grained parcels during infancy based on aligned and averaged local gradient maps of FC across individuals. These parcellation maps reveal complex functional developmental patterns, such as changes in local gradient, network size, and local efficiency, especially during the first 9 postnatal months. Our generated fine-grained infant cortical functional parcellation maps are publicly available at https://www.nitrc.org/projects/infantsurfatlas/ for advancing the pediatric neuroimaging field.

Spherical Transformer on Cortical Surfaces

Motivated by the recent great success of attention modeling in computer vision, it is highly desired to extend the Transformer architecture from the conventional Euclidean space to non-Euclidean spaces. Given the intrinsic spherical topology of brain cortical surfaces in neuroimaging, in this study, we propose a novel Spherical Transformer, an effective general-purpose backbone using the self-attention mechanism for analysis of cortical surface data represented by triangular meshes. By mapping the cortical surface onto a sphere and splitting it uniformly into overlapping spherical surface patches, we encode the long-range dependency within each patch by the self-attention operation and formulate the cross-patch feature transmission via overlapping regions. By limiting the self-attention computation to local patches, our proposed Spherical Transformer preserves detailed contextual information and enjoys great efficiency with linear computational complexity with respect to the patch size. Moreover, to better process longitudinal cortical surfaces, which are increasingly popular in neuroimaging studies, we unprecedentedly propose the spatiotemporal self-attention operation to jointly extract the spatial context and dynamic developmental patterns within a single layer, thus further enlarging the expressive power of the generated representation. To comprehensively evaluate the performance of our Spherical Transformer, we validate it on a surface-level prediction task and a vertex-level dense prediction task, respectively, i.e., the cognition prediction and cortical thickness map development prediction, which are important in early brain development mapping. Both applications demonstrate the competitive performance of our Spherical Transformer in comparison with the state-of-the-art methods.

Path Signature Neural Network of Cortical Features for Prediction of Infant Cognitive Scores

Studies have shown that there is a tight connection between cognition skills and brain morphology during infancy. Nonetheless, it is still a great challenge to predict individual cognitive scores using their brain morphological features, considering issues like the excessive feature dimension, small sample size and missing data. Due to the limited data, a compact but expressive feature set is desirable as it can reduce the dimension and avoid the potential overfitting issue. Therefore, we pioneer the path signature method to further explore the essential hidden dynamic patterns of longitudinal cortical features. To form a hierarchical and more informative temporal representation, in this work, a novel cortical feature based path signature neural network (CF-PSNet) is proposed with stacked differentiable temporal path signature layers for prediction of individual cognitive scores. By introducing the existence embedding in path generation, we can improve the robustness against the missing data. Benefiting from the global temporal receptive field of CF-PSNet, characteristics consisted in the existing data can be fully leveraged. Further, as there is no need for the whole brain to work for a certain cognitive ability, a top K selection module is used to select the most influential brain regions, decreasing the model size and the risk of overfitting. Extensive experiments are conducted on an in-house longitudinal infant dataset within 9 time points. By comparing with several recent algorithms, we illustrate the state-of-the-art performance of our CF-PSNet (i.e., root mean square error of 0.027 with the time latency of 518 milliseconds for each sample).

Existence of Functional Connectome Fingerprint during Infancy and Its Stability over Months

The functional connectome fingerprint is a cluster of individualized brain functional connectivity patterns that are capable of distinguishing one individual from others. Although its existence has been demonstrated in adolescents and adults, whether such individualized patterns exist during infancy is barely investigated despite its importance in identifying the origin of the intrinsic connectome patterns that potentially mirror distinct behavioral phenotypes. To fill this knowledge gap, capitalizing on a longitudinal high-resolution structural and resting-state functional MRI dataset with 104 human infants (53 females) with 806 longitudinal scans (age, 16-876 d) and infant-specific functional parcellation maps, we observe that the brain functional connectome fingerprint may exist since infancy and keeps stable over months during early brain development. Specifically, we achieve an ∼78% individual identification rate by using ∼5% selected functional connections, compared with the best identification rate of 60% without connection selection. The frontoparietal networks recognized as the most contributive networks in adult functional connectome fingerprinting retain their superiority in infants despite being widely acknowledged as rapidly developing systems during childhood. The existence and stability of the functional connectome fingerprint are further validated on adjacent age groups. Moreover, we show that the infant frontoparietal networks can reach similar accuracy in predicting individual early learning composite scores as the whole-brain connectome, again resembling the observations in adults and highlighting the relevance of functional connectome fingerprint to cognitive performance. For the first time, these results suggest that each individual may retain a unique and stable marker of functional connectome during early brain development.SIGNIFICANCE STATEMENT Functional connectome fingerprinting during infancy featuring rapid brain development remains almost uninvestigated even though it is essential for understanding the early individual-level intrinsic pattern of functional organization and its relationship with distinct behavioral phenotypes. With an infant-tailored functional connection selection and validation strategy, we strive to provide the delineation of the infant functional connectome fingerprint by examining its existence, stability, and relationship with early cognitive performance. We observe that the brain functional connectome fingerprint may exist since early infancy and remains stable over months during the first 2 years. The identified key contributive functional connections and networks for fingerprinting are also verified to be highly predictive for cognitive score prediction, which reveals the association between infant connectome fingerprint and cognitive performance.

Multi-Regression based supervised sample selection for predicting baby connectome evolution trajectory from neonatal timepoint

The connectional map of the baby brain undergoes dramatic changes over the first year of postnatal development, which makes its mapping a challenging task, let alone learning how to predict its evolution. Currently, learning models for predicting brain connectomic developmental trajectories remain broadly absent despite their great potential in spotting atypical neurodevelopmental disorders early. This is most likely due to the scarcity and often incompleteness of longitudinal infant neuroimaging studies for training such models. In this paper, we propose the first approach for progressively predicting longitudinal development of brain networks during the postnatal period solely from a baseline connectome around birth. To this end, a supervised multi-regression sample selection strategy is designed to learn how to identify the best set of neighbors of a testing baseline connectome to eventually predict its evolution trajectory at follow-up timepoints. However, given that the training dataset may have missing samples (connectomes) at certain timepoints, this may affect the training of the predictive model. To overcome this problem, we perform a low-rank tensor completion based on a robust principal component analysis to impute the missing training connectomes by linearly approximating similar complete training networks. In the prediction step, our sample selection strategy aims to preserve spatiotemporal relationships between consecutive timepoints. Therefore, the proposed method learns how to identify the set of the local closest neighbors to a target network by training an ensemble of bidirectional regressors leveraging temporal dependency between consecutive timepoints with a recall to the baseline observations to progressively predict the evolution of a testing network over time. Our method achieves the best prediction results and better captures the dynamic changes of each brain connectome over time in comparison to its ablated versions using leave-one-out cross-validation strategy.

Infant Brain Development Prediction With Latent Partial Multi-View Representation Learning

The early postnatal period witnesses rapid and dynamic brain development. However, the relationship between brain anatomical structure and cognitive ability is still unknown. Currently, there is no explicit model to characterize this relationship in the literature. In this paper, we explore this relationship by investigating the mapping between morphological features of the cerebral cortex and cognitive scores. To this end, we introduce a multi-view multi-task learning approach to intuitively explore complementary information from different time-points and handle the missing data issue in longitudinal studies simultaneously. Accordingly, we establish a novel model, latent partial multi-view representation learning. Our approach regards data from different time-points as different views and constructs a latent representation to capture the complementary information from incomplete time-points. The latent representation explores the complementarity across different time-points and improves the accuracy of prediction. The minimization problem is solved by the alternating direction method of multipliers. Experimental results on both synthetic and real data validate the effectiveness of our proposed algorithm.

Resting-state functional MRI studies on infant brains: A decade of gap-filling efforts

Resting-state functional MRI (rs-fMRI) is one of the most prevalent brain functional imaging modalities. Previous rs-fMRI studies have mainly focused on adults and elderly subjects. Recently, infant rs-fMRI studies have become an area of active research. After a decade of gap filling studies, many facets of the brain functional development from early infancy to toddler has been uncovered. However, infant rs-fMRI is still in its infancy. The image analysis tools for neonates and young infants can be quite different from those for adults. From data analysis to result interpretation, more questions and issues have been raised, and new hypotheses have been formed. With the anticipated availability of unprecedented high-resolution rs-fMRI and dedicated analysis pipelines from the Baby Connectome Project (BCP), it is important now to revisit previous findings and hypotheses, discuss and comment existing issues and problems, and make a "to-do-list" for the future studies. This review article aims to comprehensively review a decade of the findings, unveiling hidden jewels of the fields of developmental neuroscience and neuroimage computing. Emphases will be given to early infancy, particularly the first few years of life. In this review, an end-to-end summary, from infant rs-fMRI experimental design to data processing, and from the development of individual functional systems to large-scale brain functional networks, is provided. A comprehensive summary of the rs-fMRI findings in developmental patterns is highlighted. Furthermore, an extensive summary of the neurodevelopmental disorders and the effects of other hazardous factors is provided. Finally, future research trends focusing on emerging dynamic functional connectivity and state-of-the-art functional connectome analysis are summarized. In next decade, early infant rs-fMRI and developmental connectome study could be one of the shining research topics.

Multi-task prediction of infant cognitive scores from longitudinal incomplete neuroimaging data

Early postnatal brain undergoes a stunning period of development. Over the past few years, research on dynamic infant brain development has received increased attention, exhibiting how important the early stages of a child's life are in terms of brain development. To precisely chart the early brain developmental trajectories, longitudinal studies with data acquired over a long-enough period of infants' early life is essential. However, in practice, missing data from different time point(s) during the data gathering procedure is often inevitable. This leads to incomplete set of longitudinal data, which poses a major challenge for such studies. In this paper, prediction of multiple future cognitive scores with incomplete longitudinal imaging data is modeled into a multi-task machine learning framework. To efficiently learn this model, we account for selection of informative features (i.e., neuroimaging morphometric measurements for different time points), while preserving the structural information and the interrelation between these multiple cognitive scores. Several experiments are conducted on a carefully acquired in-house dataset, and the results affirm that we can predict the cognitive scores measured at the age of four years old, using the imaging data of earlier time points, as early as 24 months of age, with a reasonable performance (i.e., root mean square error of 0.18).

INFANT BRAIN DEVELOPMENT PREDICTION WITH LATENT PARTIAL MULTI-VIEW REPRESENTATION LEARNING

The early postnatal period witnesses rapid and dynamic brain development. Understanding the cognitive development patterns can help identify various disorders at early ages of life and is essential for the health and well-being of children. This inspires us to investigate the relation between cognitive ability and the cerebral cortex by exploiting brain images in a longitudinal study. Specifically, we aim to predict the infant brain development status based on the morphological features of the cerebral cortex. For this goal, we introduce a multi-view multi-task learning approach to dexterously explore complementary information from different time points and handle the missing data simultaneously. Specifically, we establish a novel model termed as Latent Partial Multi-view Representation Learning. The approach regards data of different time points as different views, and constructs a latent representation to capture the complementary underlying information from different and even incomplete time points. It uncovers the latent representation that can be jointly used to learn the prediction model. This formulation elegantly explores the complementarity, effectively reduces the redundancy of different views, and improves the accuracy of prediction. The minimization problem is solved by the Alternating Direction Method of Multipliers (ADMM). Experimental results on real data validate the proposed method.

Joint Sparse and Low-Rank Regularized MultiTask Multi-Linear Regression for Prediction of Infant Brain Development with Incomplete Data

Studies involving dynamic infant brain development has received increasing attention in the past few years. For such studies, a complete longitudinal dataset is often required to precisely chart the early brain developmental trajectories. Whereas, in practice, we often face missing data at different time point(s) for different subjects. In this paper, we propose a new method for prediction of infant brain development scores at future time points based on longitudinal imaging measures at early time points with possible missing data. We treat this as a multi-dimensional regression problem, for predicting multiple brain development scores (multi-task) from multiple previous time points (multi-linear). To solve this problem, we propose an objective function with a joint ℓ1 and low-rank regularization on the mapping weight tensor, to enforce feature selection, while preserving the structural information from multiple dimensions. Also, based on the bag-of-words model, we propose to extract features from longitudinal imaging data. The experimental results reveal that we can effectively predict the brain development scores assessed at the age of four years, using the imaging data as early as two years of age.

Joint prediction of longitudinal development of cortical surfaces and white matter fibers from neonatal MRI

The human brain can be modeled as multiple interrelated shapes (or a multishape), each for characterizing one aspect of the brain, such as the cortex and white matter pathways. Predicting the developing multishape is a very challenging task due to the contrasting nature of the developmental trajectories of the constituent shapes: smooth for the cortical surface and non-smooth for white matter tracts due to changes such as bifurcation. We recently addressed this problem and proposed an approach for predicting the multishape developmental spatiotemporal trajectories of infant brains based only on neonatal MRI data using a set of geometric, dynamic, and fiber-to-surface connectivity features. In this paper, we propose two key innovations to further improve the prediction of multishape evolution. First, for a more accurate cortical surface prediction, instead of simply relying on one neonatal atlas to guide the prediction of the multishape, we propose to use multiple neonatal atlases to build a spatially heterogeneous atlas using the multidirectional varifold representation. This individualizes the atlas by locally maximizing its similarity to the testing baseline cortical shape for each cortical region, thereby better representing the baseline testing cortical surface, which founds the multishape prediction process. Second, for temporally consistent fiber prediction, we propose to reliably estimate spatiotemporal connectivity features using low-rank tensor completion, thereby capturing the variability and richness of the temporal development of fibers. Experimental results confirm that the proposed variants significantly improve the prediction performance of our original multishape prediction framework for both cortical surfaces and fiber tracts shape at 3, 6, and 9 months of age. Our pioneering model will pave the way for learning how to predict the evolution of anatomical shapes with abnormal changes. Ultimately, devising accurate shape evolution prediction models that can help quantify and predict the severity of a brain disorder as it progresses will be of great aid in individualized treatment planning.