Deep Cerebellar Nuclei Segmentation via Semi-Supervised Deep Context-Aware Learning from 7T Diffusion MRI

A review of self-supervised, generative, and few-shot deep learning methods for data-limited magnetic resonance imaging segmentation

Magnetic resonance imaging (MRI) is a ubiquitous medical imaging technology with applications in disease diagnostics, intervention, and treatment planning. Accurate MRI segmentation is critical for diagnosing abnormalities, monitoring diseases, and deciding on a course of treatment. With the advent of advanced deep learning frameworks, fully automated and accurate MRI segmentation is advancing. Traditional supervised deep learning techniques have advanced tremendously, reaching clinical-level accuracy in the field of segmentation. However, these algorithms still require a large amount of annotated data, which is oftentimes unavailable or impractical. One way to circumvent this issue is to utilize algorithms that exploit a limited amount of labeled data. This paper aims to review such state-of-the-art algorithms that use a limited number of annotated samples. We explain the fundamental principles of self-supervised learning, generative models, few-shot learning, and semi-supervised learning and summarize their applications in cardiac, abdomen, and brain MRI segmentation. Throughout this review, we highlight algorithms that can be employed based on the quantity of annotated data available. We also present a comprehensive list of notable publicly available MRI segmentation datasets. To conclude, we discuss possible future directions of the field-including emerging algorithms, such as contrastive language-image pretraining, and potential combinations across the methods discussed-that can further increase the efficacy of image segmentation with limited labels.

A multimodal submillimeter MRI atlas of the human cerebellum

The human cerebellum is engaged in a broad array of tasks related to motor coordination, cognition, language, attention, memory, and emotional regulation. A detailed cerebellar atlas can facilitate the investigation of the structural and functional organization of the cerebellum. However, existing cerebellar atlases are typically limited to a single imaging modality with insufficient characterization of tissue properties. Here, we introduce a multifaceted cerebellar atlas based on high-resolution multimodal MRI, facilitating the understanding of the neurodevelopment and neurodegeneration of the cerebellum based on cortical morphology, tissue microstructure, and intra-cerebellar and cerebello-cerebral connectivity.

Deep Learning Segmentation of the Nucleus Basalis of Meynert on 3T MRI

BACKGROUND AND PURPOSE

The nucleus basalis of Meynert is a key subcortical structure that is important in arousal and cognition and has been explored as a deep brain stimulation target but is difficult to study due to its small size, variability among patients, and lack of contrast on 3T MR imaging. Thus, our goal was to establish and evaluate a deep learning network for automatic, accurate, and patient-specific segmentations with 3T MR imaging.

MATERIALS AND METHODS

Patient-specific segmentations can be produced manually; however, the nucleus basalis of Meynert is difficult to accurately segment on 3T MR imaging, with 7T being preferred. Thus, paired 3T and 7T MR imaging data sets of 21 healthy subjects were obtained. A test data set of 6 subjects was completely withheld. The nucleus was expertly segmented on 7T, providing accurate labels for the paired 3T MR imaging. An external data set of 14 patients with temporal lobe epilepsy was used to test the model on brains with neurologic disorders. A 3D-Unet convolutional neural network was constructed, and a 5-fold cross-validation was performed.

RESULTS

The novel segmentation model demonstrated significantly improved Dice coefficients over the standard probabilistic atlas for both healthy subjects (mean, 0.68 [SD, 0.10] versus 0.45 [SD, 0.11], P = .002, t test) and patients (0.64 [SD, 0.10] versus 0.37 [SD, 0.22], P < .001). Additionally, the model demonstrated significantly decreased centroid distance in patients (1.18 [SD, 0.43] mm, 3.09 [SD, 2.56] mm, P = .007).

CONCLUSIONS

We developed the first model, to our knowledge, for automatic and accurate patient-specific segmentation of the nucleus basalis of Meynert. This model may enable further study into the nucleus, impacting new treatments such as deep brain stimulation.

ConvNets for automatic detection of polyglutamine SCAs from brain MRIs: state of the art applications

Polyglutamine spinocerebellar ataxias (polyQ SCAs) are a group of neurodegenerative diseases, clinically and genetically heterogeneous, characterized by loss of balance and motor coordination due to dysfunction of the cerebellum and its connections. The diagnosis of each type of polyQ SCA, alongside with genetic tests, includes medical images analysis, and its automation may help specialists to distinguish between each type. Convolutional neural networks (ConvNets or CNNs) have been recently used for medical image processing, with outstanding results. In this work, we present the main clinical and imaging features of polyglutamine SCAs, and the basics of CNNs. Finally, we review studies that have used this approach to automatically process brain medical images and may be applied to SCAs detection. We conclude by discussing the possible limitations and opportunities of using ConvNets for SCAs diagnose in the future.

Baseline Cerebro-Cerebellar Functional Connectivity in Afferent and Efferent Pathways Reveal Dissociable Improvements in Visuomotor Learning

Visuomotor coordination is a complex process involving several brain regions, primarily the cerebellum and motor cortex. Studies have shown inconsistent resting-state functional magnetic resonance imaging (rsfMRI) results in the cerebellar cortex and dentate nucleus of the cerebro-cerebellar connections. Echoing anatomical pathways, these two different cerebellar regions are differentially responsible for afferent and efferent cerebro-cerebellar functional connections. The aim of this study was to measure the baseline resting-state functional connectivity of different cerebellar afferent and efferent pathways and to investigate their relationship to visuomotor learning abilities. We used different cerebellar repetitive transcranial magnetic stimulation (rTMS) frequencies before a pursuit rotor task to influence visuomotor performance. Thirty-eight right-handed participants were included and randomly assigned to three different rTMS frequency groups (1 Hz, 10 Hz and sham) and underwent baseline rsfMRI and pursuit rotor task assessments. We report that greater baseline functional connectivity in the afferent cerebro-cerebellar pathways was associated with greater accuracy improvements. Interestingly, lower baseline functional connectivity in the efferent dentato-thalamo-cortical pathways was associated with greater stability in visuomotor performance, possibly associated with the inhibitory role of the dentate nucleus and caused a reduction in the efferent functional connectivity. The functional dissociation of the cerebellar cortex and dentate nucleus and their connections, suggests that distinct mechanisms in the cerebellum regarding visuomotor learning, which should be investigated in future research.

Convolutional Neural Networks for Segmenting Cerebellar Fissures from Magnetic Resonance Imaging

The human cerebellum plays an important role in coordination tasks. Diseases such as spinocerebellar ataxias tend to cause severe damage to the cerebellum, leading patients to a progressive loss of motor coordination. The detection of such damages can help specialists to approximate the state of the disease, as well as to perform statistical analysis, in order to propose treatment therapies for the patients. Manual segmentation of such patterns from magnetic resonance imaging is a very difficult and time-consuming task, and is not a viable solution if the number of images to process is relatively large. In recent years, deep learning techniques such as convolutional neural networks (CNNs or convnets) have experienced an increased development, and many researchers have used them to automatically segment medical images. In this research, we propose the use of convolutional neural networks for automatically segmenting the cerebellar fissures from brain magnetic resonance imaging. Three models are presented, based on the same CNN architecture, for obtaining three different binary masks: fissures, cerebellum with fissures, and cerebellum without fissures. The models perform well in terms of precision and efficiency. Evaluation results show that convnets can be trained for such purposes, and could be considered as additional tools in the diagnosis and characterization of neurodegenerative diseases.

Automated segmentation of deep brain nuclei using convolutional neural networks and susceptibility weighted imaging

The advent of susceptibility-sensitive MRI techniques, such as susceptibility weighted imaging (SWI), has enabled accurate in vivo visualization and quantification of iron deposition within the human brain. Although previous approaches have been introduced to segment iron-rich brain regions, such as the substantia nigra, subthalamic nucleus, red nucleus, and dentate nucleus, these methods are largely unavailable and manual annotation remains the most used approach to label these regions. Furthermore, given their recent success in outperforming other segmentation approaches, convolutional neural networks (CNN) promise better performances. The aim of this study was thus to evaluate state-of-the-art CNN architectures for the labeling of deep brain nuclei from SW images. We implemented five CNN architectures and considered ensembles of these models. Furthermore, a multi-atlas segmentation model was included to provide a comparison not based on CNN. We evaluated two prediction strategies: individual prediction, where a model is trained independently for each region, and combined prediction, which simultaneously predicts multiple closely located regions. In the training dataset, all models performed with high accuracy with Dice coefficients ranging from 0.80 to 0.95. The regional SWI intensities and volumes from the models' labels were strongly correlated with those obtained from manual labels. Performances were reduced on the external dataset, but were higher or comparable to the intrarater reliability and most models achieved significantly better results compared to multi-atlas segmentation. CNNs can accurately capture the individual variability of deep brain nuclei and represent a highly useful tool for their segmentation from SW images.

Deep-learning based fully automatic segmentation of the globus pallidus interna and externa using ultra-high 7 Tesla MRI

Deep brain stimulation (DBS) surgery has been shown to dramatically improve the quality of life for patients with various motor dysfunctions, such as those afflicted with Parkinson's disease (PD), dystonia, and essential tremor (ET), by relieving motor symptoms associated with such pathologies. The success of DBS procedures is directly related to the proper placement of the electrodes, which requires the ability to accurately detect and identify relevant target structures within the subcortical basal ganglia region. In particular, accurate and reliable segmentation of the globus pallidus (GP) interna is of great interest for DBS surgery for PD and dystonia. In this study, we present a deep-learning based neural network, which we term GP-net, for the automatic segmentation of both the external and internal segments of the globus pallidus. High resolution 7 Tesla images from 101 subjects were used in this study; GP-net is trained on a cohort of 58 subjects, containing patients with movement disorders as well as healthy control subjects. GP-net performs 3D inference in a patient-specific manner, alleviating the need for atlas-based segmentation. GP-net was extensively validated, both quantitatively and qualitatively over 43 test subjects including patients with movement disorders and healthy control and is shown to consistently produce improved segmentation results compared with state-of-the-art atlas-based segmentations. We also demonstrate a postoperative lead location assessment with respect to a segmented globus pallidus obtained by GP-net.