Infant Brain Development Prediction With Latent Partial Multi-View Representation Learning

Human-to-monkey transfer learning identifies the frontal white matter as a key determinant for predicting monkey brain age

The application of artificial intelligence (AI) to summarize a whole-brain magnetic resonance image (MRI) into an effective "brain age" metric can provide a holistic, individualized, and objective view of how the brain interacts with various factors (e.g., genetics and lifestyle) during aging. Brain age predictions using deep learning (DL) have been widely used to quantify the developmental status of human brains, but their wider application to serve biomedical purposes is under criticism for requiring large samples and complicated interpretability. Animal models, i.e., rhesus monkeys, have offered a unique lens to understand the human brain - being a species in which aging patterns are similar, for which environmental and lifestyle factors are more readily controlled. However, applying DL methods in animal models suffers from data insufficiency as the availability of animal brain MRIs is limited compared to many thousands of human MRIs. We showed that transfer learning can mitigate the sample size problem, where transferring the pre-trained AI models from 8,859 human brain MRIs improved monkey brain age estimation accuracy and stability. The highest accuracy and stability occurred when transferring the 3D ResNet [mean absolute error (MAE) = 1.83 years] and the 2D global-local transformer (MAE = 1.92 years) models. Our models identified the frontal white matter as the most important feature for monkey brain age predictions, which is consistent with previous histological findings. This first DL-based, anatomically interpretable, and adaptive brain age estimator could broaden the application of AI techniques to various animal or disease samples and widen opportunities for research in non-human primate brains across the lifespan.

Path Signature Neural Network of Cortical Features for Prediction of Infant Cognitive Scores

Studies have shown that there is a tight connection between cognition skills and brain morphology during infancy. Nonetheless, it is still a great challenge to predict individual cognitive scores using their brain morphological features, considering issues like the excessive feature dimension, small sample size and missing data. Due to the limited data, a compact but expressive feature set is desirable as it can reduce the dimension and avoid the potential overfitting issue. Therefore, we pioneer the path signature method to further explore the essential hidden dynamic patterns of longitudinal cortical features. To form a hierarchical and more informative temporal representation, in this work, a novel cortical feature based path signature neural network (CF-PSNet) is proposed with stacked differentiable temporal path signature layers for prediction of individual cognitive scores. By introducing the existence embedding in path generation, we can improve the robustness against the missing data. Benefiting from the global temporal receptive field of CF-PSNet, characteristics consisted in the existing data can be fully leveraged. Further, as there is no need for the whole brain to work for a certain cognitive ability, a top K selection module is used to select the most influential brain regions, decreasing the model size and the risk of overfitting. Extensive experiments are conducted on an in-house longitudinal infant dataset within 9 time points. By comparing with several recent algorithms, we illustrate the state-of-the-art performance of our CF-PSNet (i.e., root mean square error of 0.027 with the time latency of 518 milliseconds for each sample).

DarkASDNet: Classification of ASD on Functional MRI Using Deep Neural Network

Non-invasive whole-brain scans aid the diagnosis of neuropsychiatric disorder diseases such as autism, dementia, and brain cancer. The assessable analysis for autism spectrum disorders (ASD) is rationally challenging due to the limitations of publicly available datasets. For diagnostic or prognostic tools, functional Magnetic Resonance Imaging (fMRI) exposed affirmation to the biomarkers in neuroimaging research because of fMRI pickup inherent connectivity between the brain and regions. There are profound studies in ASD with introducing machine learning or deep learning methods that have manifested advanced steps for ASD predictions based on fMRI data. However, utmost antecedent models have an inadequacy in their capacity to manipulate performance metrics such as accuracy, precision, recall, and F1-score. To overcome these problems, we proposed an avant-garde DarkASDNet, which has the competence to extract features from a lower level to a higher level and bring out promising results. In this work, we considered 3D fMRI data to predict binary classification between ASD and typical control (TC). Firstly, we pre-processed the 3D fMRI data by adopting proper slice time correction and normalization. Then, we introduced a novel DarkASDNet which surpassed the benchmark accuracy for the classification of ASD. Our model's outcomes unveil that our proposed method established state-of-the-art accuracy of 94.70% to classify ASD vs. TC in ABIDE-I, NYU dataset. Finally, we contemplated our model by performing evaluation metrics including precision, recall, F1-score, ROC curve, and AUC score, and legitimize by distinguishing with recent literature descriptions to vindicate our outcomes. The proposed DarkASDNet architecture provides a novel benchmark approach for ASD classification using fMRI processed data.

Infant Cognitive Scores Prediction with Multi-stream Attention-Based Temporal Path Signature Features

There is stunning rapid development of human brains in the first year of life. Some studies have revealed the tight connection between cognition skills and cortical morphology in this period. Nonetheless, it is still a great challenge to predict cognitive scores using brain morphological features, given issues like small sample size and missing data in longitudinal studies. In this work, for the first time, we introduce the path signature method to explore hidden analytical and geometric properties of longitudinal cortical morphology features. A novel BrainPSNet is proposed with a differentiable temporal path signature layer to produce informative representations of different time points and various temporal granules. Further, a two-stream neural network is included to combine groups of raw features and path signature features for predicting the cognitive score. More importantly, considering different influences of each brain region on the cognitive function, we design a learning-based attention mask generator to automatically weight regions correspondingly. Experiments are conducted on an in-house longitudinal dataset. By comparing with several recent algorithms, the proposed method achieves the state-of-the-art performance. The relationship between morphological features and cognitive abilities is also analyzed.

Deep Multi-Scale Mesh Feature Learning for Automated Labeling of Raw Dental Surfaces From 3D Intraoral Scanners

Precisely labeling teeth on digitalized 3D dental surface models is the precondition for tooth position rearrangements in orthodontic treatment planning. However, it is a challenging task primarily due to the abnormal and varying appearance of patients' teeth. The emerging utilization of intraoral scanners (IOSs) in clinics further increases the difficulty in automated tooth labeling, as the raw surfaces acquired by IOS are typically low-quality at gingival and deep intraoral regions. In recent years, some pioneering end-to-end methods (e.g., PointNet) have been proposed in the communities of computer vision and graphics to consume directly raw surface for 3D shape segmentation. Although these methods are potentially applicable to our task, most of them fail to capture fine-grained local geometric context that is critical to the identification of small teeth with varying shapes and appearances. In this paper, we propose an end-to-end deep-learning method, called MeshSegNet, for automated tooth labeling on raw dental surfaces. Using multiple raw surface attributes as inputs, MeshSegNet integrates a series of graph-constrained learning modules along its forward path to hierarchically extract multi-scale local contextual features. Then, a dense fusion strategy is applied to combine local-to-global geometric features for the learning of higher-level features for mesh cell annotation. The predictions produced by our MeshSegNet are further post-processed by a graph-cut refinement step for final segmentation. We evaluated MeshSegNet using a real-patient dataset consisting of raw maxillary surfaces acquired by 3D IOS. Experimental results, performed 5-fold cross-validation, demonstrate that MeshSegNet significantly outperforms state-of-the-art deep learning methods for 3D shape segmentation.

A multi-view pyramid network for skull stripping on neonatal T1-weighted MRI

Skull stripping or brain extraction on magnetic resonance imaging is a crucial step for structure analyses. In spite of good performances of conventional methods on adult brains, the skull stripping for T1-weighted imaging (T1WI) images on the neonatal brain remains a challenge because of the low image contrast. Therefore, this paper proposes a multi-view pyramid skull stripping network (PSSNet) for neonatal T1WI. To achieve superior skull stripping performance, the conventional pyramid scene parsing network was modified through (1) adding the spatial information of raw feature maps by squeezing the channel information during the feature extraction; (2) increasing the receptive field and adding boundary repair block instead of direct up-sampling; (3) obtaining the final mask through a fusion module on multi-view 2D slices. The 3D skull stripping problem was decomposed into multi-view 2D segmentation tasks to improve the efficiency. We enrolled T1WI images of 70 neonates from the local hospital and 7 infants from the publicly available dataset NeuroBrainS12 (MICCAI 2012). Images of 51 and 26 subjects were used for model training and validation. We compared the proposed method with 7 commonly used methods by using the Dice ratio, sensitivity, specificity, and efficiency. The proposed multi-view PSSNet with the highest Dice ratio (95.44-97.33%) was superior to other methods. Meanwhile, the sensitivity (93.19-97.02%), specificity (97.52-99.68%), and efficiency (8.59-9.30 s per subject) of the proposed method were comparable with the state-of-the-art method. In conclusion, the proposed skull stripping network was robust on neonatal T1WI datasets and feasible in clinical applications.