Consistent sulcal parcellation of longitudinal cortical surfaces

Longitudinally consistent registration and parcellation of cortical surfaces using semi-supervised learning

Temporally consistent and accurate registration and parcellation of longitudinal cortical surfaces is of great importance in studying longitudinal morphological and functional changes of human brains. However, most existing methods are developed for registration or parcellation of a single cortical surface. When applying to longitudinal studies, these methods independently register/parcellate each surface from longitudinal scans, thus often generating longitudinally inconsistent and inaccurate results, especially in small or ambiguous cortical regions. Essentially, longitudinal cortical surface registration and parcellation are highly correlated tasks with inherently shared constraints on both spatial and temporal feature representations, which are unfortunately ignored in existing methods. To this end, we unprecedentedly propose a novel semi-supervised learning framework to exploit these inherent relationships from limited labeled data and extensive unlabeled data for more robust and consistent registration and parcellation of longitudinal cortical surfaces. Our method utilizes the spherical topology characteristic of cortical surfaces. It employs a spherical network to function as an encoder, which extracts high-level cortical features. Subsequently, we build two specialized decoders dedicated to the tasks of registration and parcellation, respectively. To extract more meaningful spatial features, we design a novel parcellation map similarity loss to utilize the relationship between registration and parcellation tasks, i.e., the parcellation map warped by the deformation field in registration should match the atlas parcellation map, thereby providing extra supervision for the registration task and augmented data for parcellation task by warping the atlas parcellation map to unlabeled surfaces. To enable temporally more consistent feature representation, we additionally enforce longitudinal consistency among longitudinal surfaces after registering them together using their concatenated features. Experiments on two longitudinal datasets of infants and adults have shown that our method achieves significant improvements on both registration/parcellation accuracy and longitudinal consistency compared to existing methods, especially in small and challenging cortical regions.

Automatic cortical surface parcellation in the fetal brain using attention-gated spherical U-net

Cortical surface parcellation for fetal brains is essential for the understanding of neurodevelopmental trajectories during gestations with regional analyses of brain structures and functions. This study proposes the attention-gated spherical U-net, a novel deep-learning model designed for automatic cortical surface parcellation of the fetal brain. We trained and validated the model using MRIs from 55 typically developing fetuses [gestational weeks: 32.9 ± 3.3 (mean ± SD), 27.4-38.7]. The proposed model was compared with the surface registration-based method, SPHARM-net, and the original spherical U-net. Our model demonstrated significantly higher accuracy in parcellation performance compared to previous methods, achieving an overall Dice coefficient of 0.899 ± 0.020. It also showed the lowest error in terms of the median boundary distance, 2.47 ± 1.322 (mm), and mean absolute percent error in surface area measurement, 10.40 ± 2.64 (%). In this study, we showed the efficacy of the attention gates in capturing the subtle but important information in fetal cortical surface parcellation. Our precise automatic parcellation model could increase sensitivity in detecting regional cortical anomalies and lead to the potential for early detection of neurodevelopmental disorders in fetuses.

Intrinsic Patch-Based Cortical Anatomical Parcellation Using Graph Convolutional Neural Network on Surface Manifold

Automatic parcellation of cortical surfaces into anatomically meaningful regions of interest (ROIs) is of great importance in brain analysis. Due to the complex shape of the convoluted cerebral cortex, conventional methods generally require three steps to obtain the parcellations. First, the original cortical surface is iteratively inflated and mapped onto a spherical surface with minimal metric distortion, for providing a simpler shape for analysis. Then, a registration or learning-based labeling method is adopted to parcellate ROIs on the mapped spherical surface. Finally, parcellation labels on the spherical surface are mapped back to the original cortical surface. Despite great success, spherical mapping of the original cortical surface is inherently sensitive to topological noise and cannot deal with the impaired brains that violate spherical topology. To address these issues, in this paper, we propose to directly parcellate the cerebral cortex on the original cortical surface manifold without requiring spherical mapping, by leveraging the strong learning ability of the graph convolutional neural networks. Also, we extend the convolution to the surface manifold using the kernel strategy, which enables us to over-come the notorious shape difference issue (e.g., different vertex number and connections) across different subjects. Our method aims to learn the highly nonlinear mapping between cortical attribute patterns (on local intrinsic surface patches) and parcellation labels. We have validated our method on a normal cortical surface dataset and a synthetic dataset with impaired brains, which shows that our method achieves comparable accuracy to the methods using spherical mapping, and works well on cortical surfaces violating the spherical topology.

Robust estimation of sulcal morphology

While it is well established that cortical morphology differs in relation to a variety of inter-individual factors, it is often characterized using estimates of volume, thickness, surface area, or gyrification. Here we developed a computational approach for estimating sulcal width and depth that relies on cortical surface reconstructions output by FreeSurfer. While other approaches for estimating sulcal morphology exist, studies often require the use of multiple brain morphology programs that have been shown to differ in their approaches to localize sulcal landmarks, yielding morphological estimates based on inconsistent boundaries. To demonstrate the approach, sulcal morphology was estimated in three large sample of adults across the lifespan, in relation to aging. A fourth sample is additionally used to estimate test–retest reliability of the approach. This toolbox is now made freely available as supplemental to this paper: https://cmadan.github.io/calcSulc/.

SPHERICAL U-NET FOR INFANT CORTICAL SURFACE PARCELLATION

In human brain MRI studies, it is of great importance to accurately parcellate cortical surfaces into anatomically and functionally meaningful regions. In this paper, we propose a novel end-to-end deep learning method by formulating surface parcellation as a semantic segmentation task on the sphere. To extend the convolutional neural networks (CNNs) to the spherical space, corresponding operations of surface convolution, pooling and upsampling are first developed to deal with data representation on spherical surface meshes, and then spherical CNNs are constructed accordingly. Specifically, the U-Net and SegNet architectures are transformed to the spherical representation for neonatal cortical surface parcellation. Experimental results on 90 neonates indicate the effectiveness and efficiency of our proposed spherical U-Net, in comparison with the spherical SegNet and the previous patch-wise classification method.

Registration-Free Infant Cortical Surface Parcellation using Deep Convolutional Neural Networks

Automatic parcellation of infant cortical surfaces into anatomical regions of interest (ROIs) is of great importance in brain structural and functional analysis. Conventional cortical surface parcellation methods suffer from two main issues: 1) Cortical surface registration is needed for establishing the atlas-to-individual correspondences; 2) The mapping from cortical shape to the parcellation labels requires designing of specific hand-crafted features. To address these issues, in this paper, we propose a novel cortical surface parcellation method, which is free of surface registration and designing of hand-crafted features, based on deep convolutional neural network (DCNN). Our main idea is to formulate surface parcellation as a patch-wise classification problem. Briefly, we use DCNN to train a classifier, whose inputs are the local cortical surface patches with multi-channel cortical shape descriptors such as mean curvature, sulcal depth, and average convexity; while the outputs are the parcellation label probabilities of cortical vertices. To enable effective convolutional operation on the surface data, we project each spherical surface patch onto its intrinsic tangent plane by a geodesic-distance-preserving mapping. Then, after classification, we further adopt the graph cuts method to improve spatial consistency of the parcellation. We have validated our method based on 90 neonatal cortical surfaces with manual parcellations, showing superior accuracy and efficiency of our proposed method.

Gyral net: A new representation of cortical folding organization

One distinct feature of the cerebral cortex is its convex (gyri) and concave (sulci) folding patterns. Due to the remarkable complexity and variability of gyral/sulcal shapes, it has been challenging to quantitatively model their organization patterns. Inspired by the observation that the lines of gyral crests can form a connected graph on each brain hemisphere, we propose a new representation of cortical gyri/sulci organization pattern - gyral net, which models cortical architecture from a graph perspective, starting with nodes and edges obtained from the reconstructed cortical surfaces. A novel computational framework is developed to efficiently and automatically construct gyral nets from surface meshes, and four measurements are devised to quantify the folding patterns. Using an MRI dataset for autism study as a test bed, we identified reduced local connectivity cost and increased curviness of gyral net bilaterally on the parietal lobe, occipital lobe, and temporal lobe in autistic patients. Additionally, we found that the cortical thickness and the gyral straightness of gyral joints are higher than the rest of gyral crest regions. The proposed representation offers a new tool for a comprehensive and reliable characterization of the cortical folding organization. This novel computational framework will enable large-scale analyses of cortical folding patterns in the future.

Simultaneous and consistent labeling of longitudinal dynamic developing cortical surfaces in infants

The human cerebral cortex develops extremely dynamically in the first 2years of life. Accurate and consistent parcellation of longitudinal dynamic cortical surfaces during this critical stage is essential to understand the early development of cortical structure and function in both normal and high-risk infant brains. However, directly applying the existing methods developed for the cross-sectional studies often generates longitudinally-inconsistent results, thus leading to inaccurate measurements of the cortex development. In this paper, we propose a new method for accurate, consistent, and simultaneous labeling of longitudinal cortical surfaces in the serial infant brain MR images. The proposed method is explicitly formulated as a minimization problem with an energy function that includes a data fitting term, a spatial smoothness term, and a temporal consistency term. Specifically, inspired by multi-atlas based label fusion, the data fitting term is designed to integrate the contributions from multi-atlas surfaces adaptively, according to the similarities of their local cortical folding with that of the subject cortical surface. The spatial smoothness term is then designed to adaptively encourage label smoothness based on the local cortical folding geometries, i.e., allowing label discontinuity at sulcal bottoms (which often are the boundaries of cytoarchitecturally and functionally distinct regions). The temporal consistency term is to adaptively encourage the label consistency among the temporally-corresponding vertices, based on their similarity of local cortical folding. Finally, the entire energy function is efficiently minimized by a graph cuts method. The proposed method has been applied to the parcellation of longitudinal cortical surfaces of 13 healthy infants, each with 6 serial MRI scans acquired at 0, 3, 6, 9, 12 and 18months of age. Qualitative and quantitative evaluations demonstrated both accuracy and longitudinal consistency of the proposed method. By using our method, for the first time, we reveal several hitherto unseen properties of the dynamic and regionally heterogeneous development of the cortical surface area in the first 18months of life.

Measuring the dynamic longitudinal cortex development in infants by reconstruction of temporally consistent cortical surfaces

Quantitative measurement of the dynamic longitudinal cortex development during early postnatal stages is of great importance to understand the early cortical structural and functional development. Conventional methods usually reconstruct the cortical surfaces of longitudinal images from the same subject independently, which often generate longitudinally-inconsistent cortical surfaces and thus lead to inaccurate measurement of cortical changes, especially for vertex-wise mapping of cortical development. This paper aims to address this problem by presenting a method to reconstruct temporally-consistent cortical surfaces from longitudinal infant brain MR images, for accurate and consistent measurement of the dynamic cortex development in infants. Specifically, the longitudinal development of the inner cortical surface is first modeled by a deformable growth sheet with elasto-plasticity property to establish longitudinally smooth correspondences of the inner cortical surfaces. Then, the modeled longitudinal inner cortical surfaces are jointly deformed to locate both inner and outer cortical surfaces with a spatial-temporal deformable surface method. The method has been applied to 13 healthy infants, each with 6 serial MR scans acquired at 2 weeks, 3 months, 6 months, 9 months, 12 months and 18 months of age. Experimental results showed that our method with the incorporated longitudinal constraints can reconstruct the longitudinally-dynamic cortical surfaces from serial infant MR images more consistently and accurately than the previously published methods. By using our method, for the first time, we can characterize the vertex-wise longitudinal cortical thickness development trajectory at multiple time points in the first 18 months of life. Specifically, we found the highly age-related and regionally-heterogeneous developmental trajectories of the cortical thickness during this period, with the cortical thickness increased most from 3 to 6 months (16.2%) and least from 9 to 12 months (less than 0.1%). Specifically, the central sulcus only underwent significant increase of cortical thickness from 6 to 9 months and the occipital cortex underwent significant increase from 0 to 9 months, while the frontal, temporal and parietal cortices grew continuously in this first 18 months of life. The adult-like spatial patterns of cortical thickness were generally present at 18 months of age. These results provided detailed insights into the dynamic trajectory of the cortical thickness development in infants.

Segmentation of neonatal brain MR images using patch-driven level sets

The segmentation of neonatal brain MR image into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF), is challenging due to the low spatial resolution, severe partial volume effect, high image noise, and dynamic myelination and maturation processes. Atlas-based methods have been widely used for guiding neonatal brain segmentation. Existing brain atlases were generally constructed by equally averaging all the aligned template images from a population. However, such population-based atlases might not be representative of a testing subject in the regions with high inter-subject variability and thus often lead to a low capability in guiding segmentation in those regions. Recently, patch-based sparse representation techniques have been proposed to effectively select the most relevant elements from a large group of candidates, which can be used to generate a subject-specific representation with rich local anatomical details for guiding the segmentation. Accordingly, in this paper, we propose a novel patch-driven level set method for the segmentation of neonatal brain MR images by taking advantage of sparse representation techniques. Specifically, we first build a subject-specific atlas from a library of aligned, manually segmented images by using sparse representation in a patch-based fashion. Then, the spatial consistency in the probability maps from the subject-specific atlas is further enforced by considering the similarities of a patch with its neighboring patches. Finally, the probability maps are integrated into a coupled level set framework for more accurate segmentation. The proposed method has been extensively evaluated on 20 training subjects using leave-one-out cross validation, and also on 132 additional testing subjects. Our method achieved a high accuracy of 0.919±0.008 for white matter and 0.901±0.005 for gray matter, respectively, measured by Dice ratio for the overlap between the automated and manual segmentations in the cortical region.

Consistent reconstruction of cortical surfaces from longitudinal brain MR images

Accurate and consistent reconstruction of cortical surfaces from longitudinal human brain MR images is of great importance in studying longitudinal subtle change of the cerebral cortex. This paper presents a novel deformable surface method for consistent and accurate reconstruction of inner, central and outer cortical surfaces from longitudinal brain MR images. Specifically, the cortical surfaces of the group-mean image of all aligned longitudinal images of the same subject are first reconstructed by a deformable surface method, which is driven by a force derived from the Laplace's equation. And then the longitudinal cortical surfaces are consistently reconstructed by jointly deforming the cortical surfaces of the group-mean image to all longitudinal images. The proposed method has been successfully applied to two sets of longitudinal human brain MR images. Both qualitative and quantitative experimental results demonstrate the accuracy and consistency of the proposed method. Furthermore, the reconstructed longitudinal cortical surfaces are used to measure the longitudinal changes of cortical thickness in both normal and diseased groups, where the overall decline trend of cortical thickness has been clearly observed. Meanwhile, the longitudinal cortical thickness also shows its potential in distinguishing different clinical groups.