Automated Individualization of Size-Varying and Touching Neurons in Macaque Cerebral Microscopic Images

Between neurons and networks: investigating mesoscale brain connectivity in neurological and psychiatric disorders

The study of brain connectivity has been a cornerstone in understanding the complexities of neurological and psychiatric disorders. It has provided invaluable insights into the functional architecture of the brain and how it is perturbed in disorders. However, a persistent challenge has been achieving the proper spatial resolution, and developing computational algorithms to address biological questions at the multi-cellular level, a scale often referred to as the mesoscale. Historically, neuroimaging studies of brain connectivity have predominantly focused on the macroscale, providing insights into inter-regional brain connections but often falling short of resolving the intricacies of neural circuitry at the cellular or mesoscale level. This limitation has hindered our ability to fully comprehend the underlying mechanisms of neurological and psychiatric disorders and to develop targeted interventions. In light of this issue, our review manuscript seeks to bridge this critical gap by delving into the domain of mesoscale neuroimaging. We aim to provide a comprehensive overview of conditions affected by aberrant neural connections, image acquisition techniques, feature extraction, and data analysis methods that are specifically tailored to the mesoscale. We further delineate the potential of brain connectivity research to elucidate complex biological questions, with a particular focus on schizophrenia and epilepsy. This review encompasses topics such as dendritic spine quantification, single neuron morphology, and brain region connectivity. We aim to showcase the applicability and significance of mesoscale neuroimaging techniques in the field of neuroscience, highlighting their potential for gaining insights into the complexities of neurological and psychiatric disorders.

Stereology neuron counts correlate with deep learning estimates in the human hippocampal subregions

Hippocampal subregions differ in specialization and vulnerability to cell death. Neuron death and hippocampal atrophy have been a marker for the progression of Alzheimer's disease. Relatively few studies have examined neuronal loss in the human brain using stereology. We characterize an automated high-throughput deep learning pipeline to segment hippocampal pyramidal neurons, generate pyramidal neuron estimates within the human hippocampal subfields, and relate our results to stereology neuron counts. Based on seven cases and 168 partitions, we vet deep learning parameters to segment hippocampal pyramidal neurons from the background using the open-source CellPose algorithm, and show the automated removal of false-positive segmentations. There was no difference in Dice scores between neurons segmented by the deep learning pipeline and manual segmentations (Independent Samples t-Test: t(28) = 0.33, p = 0.742). Deep-learning neuron estimates strongly correlate with manual stereological counts per subregion (Spearman's correlation (n = 9): r(7) = 0.97, p < 0.001), and for each partition individually (Spearman's correlation (n = 168): r(166) = 0.90, p <0 .001). The high-throughput deep-learning pipeline provides validation to existing standards. This deep learning approach may benefit future studies in tracking baseline and resilient healthy aging to the earliest disease progression.

A general deep learning framework for neuron instance segmentation based on Efficient UNet and morphological post-processing

Recent studies have demonstrated the superiority of deep learning in medical image analysis, especially in cell instance segmentation, a fundamental step for many biological studies. However, the excellent performance of the neural networks requires training on large, unbiased dataset and annotations, which is labor-intensive and expertise-demanding. This paper presents an end-to-end framework to automatically detect and segment NeuN stained neuronal cells on histological images using only point annotations. Unlike traditional nuclei segmentation with point annotation, we propose using point annotation and binary segmentation to synthesize pixel-level annotations. The synthetic masks are used as the ground truth to train the neural network, a U-Net-like architecture with a state-of-the-art network, EfficientNet, as the encoder. Validation results show the superiority of our model compared to other recent methods. In addition, we investigated multiple post-processing schemes and proposed an original strategy to convert the probability map into segmented instances using ultimate erosion and dynamic reconstruction. This approach is easy to configure and outperforms other classical post-processing techniques. This work aims to develop a robust and efficient framework for analyzing neurons using optical microscopic data, which can be used in preclinical biological studies and, more specifically, in the context of neurodegenerative diseases. Code is available at: https://github.com/MIRCen/NeuronInstanceSeg.

Multiscale segmentation- and error-guided iterative convolutional neural network for cerebral neuron segmentation in microscopic images

This article uses microscopy images obtained from diverse anatomical regions of macaque brain for neuron semantic segmentation. The complex structure of brain, the large intra-class staining intensity difference within neuron class, the small inter-class staining intensity difference between neuron and tissue class, and the unbalanced dataset increase the difficulty of neuron semantic segmentation. To address this problem, we propose a multiscale segmentation- and error-guided iterative convolutional neural network (MSEG-iCNN) to improve the semantic segmentation performance in major anatomical regions of the macaque brain. After evaluating microscopic images from 17 anatomical regions, the semantic segmentation performance of neurons is improved by 10.6%, 4.0%, 1.5%, and 1.2% compared with Random Forest, FCN-8s, U-Net, and UNet++, respectively. Especially for neurons with brighter staining intensity in the anatomical regions such as lateral geniculate, globus pallidus and hypothalamus, the performance is improved by 66.1%, 23.9%, 11.2%, and 6.7%, respectively. Experiments show that our proposed method can efficiently segment neurons with a wide range of staining intensities. The semantic segmentation results are of great significance and can be further used for neuron instance segmentation, morphological analysis and disease diagnosis. Cell segmentation plays a critical role in extracting cerebral information, such as cell counting, cell morphometry and distribution analysis. Accurate automated neuron segmentation is challenging due to the complex structure of brain, the large intra-class staining intensity difference within neuron class, the small inter-class staining intensity difference between neuron and tissue class, and the unbalanced dataset. The proposed multiscale segmentation- and error-guided iterative convolutional neural network (MSEG-iCNN) improve the segmentation performance in 17 major anatomical regions of the macaque brain.

Reduced and stable feature sets selection with random forest for neurons segmentation in histological images of macaque brain

In preclinical research, histology images are produced using powerful optical microscopes to digitize entire sections at cell scale. Quantification of stained tissue relies on machine learning driven segmentation. However, such methods require multiple additional information, or features, which are increasing the quantity of data to process. As a result, the quantity of features to deal with represents a drawback to process large series or massive histological images rapidly in a robust manner. Existing feature selection methods can reduce the amount of required information but the selected subsets lack reproducibility. We propose a novel methodology operating on high performance computing (HPC) infrastructures and aiming at finding small and stable sets of features for fast and robust segmentation of high-resolution histological images. This selection has two steps: (1) selection at features families scale (an intermediate pool of features, between spaces and individual features) and (2) feature selection performed on pre-selected features families. We show that the selected sets of features are stables for two different neuron staining. In order to test different configurations, one of these dataset is a mono-subject dataset and the other is a multi-subjects dataset to test different configurations. Furthermore, the feature selection results in a significant reduction of computation time and memory cost. This methodology will allow exhaustive histological studies at a high-resolution scale on HPC infrastructures for both preclinical and clinical research.

Evaluation of Deep Learning Topcoders Method for Neuron Individualization in Histological Macaque Brain Section. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021;2021:2985-2988. [PMID: 34891872 DOI: 10.1109/embc46164.2021.9630914]

Cell individualization has a vital role in digital pathology image analysis. Deep Learning is considered as an efficient tool for instance segmentation tasks, including cell individualization. However, the precision of the Deep Learning model relies on massive unbiased dataset and manual pixel-level annotations, which is labor intensive. Moreover, most applications of Deep Learning have been developed for processing oncological data. To overcome these challenges, i) we established a pipeline to synthesize pixel-level labels with only point annotations provided; ii) we tested an ensemble Deep Learning algorithm to perform cell individualization on neurological data. Results suggest that the proposed method successfully segments neuronal cells in both object-level and pixel-level, with an average detection accuracy of 0.93.

Evaluation of automated segmentation algorithms for neurons in macaque cerebral microscopic images

Accurate cerebral neuron segmentation is required before neuron counting and neuron morphological analysis. Numerous algorithms for neuron segmentation have been published, but they are mainly evaluated using limited subsets from a specific anatomical region, targeting neurons of clear contrast and/or neurons with similar staining intensity. It is thus unclear how these algorithms perform on cerebral neurons in diverse anatomical regions. In this article, we introduce and reliably evaluate existing machine learning algorithms using a data set of microscopy images of macaque brain. This data set highlights various anatomical regions (e.g., cortex, caudate, thalamus, claustrum, putamen, hippocampus, subiculum, lateral geniculate, globus pallidus, etc.), poor contrast, and staining intensity differences of neurons. The evaluation was performed using 10 architectures of six classic machine learning algorithms in terms of typical Recall, Precision, F-score, aggregated Jaccard index (AJI), as well as a performance ranking of algorithms. F-score of most of the algorithms is superior to 0.7. Deep learning algorithms facilitate generally higher F-scores. U-net with suitable layer depth has been evaluated to be excellent classifiers with F-score of 0.846 and 0.837 when performing cross validation. The evaluation and analysis indicate the performance gap among algorithms in various anatomical regions and the strengths and limitations of each algorithm. The comparative result highlights at the same time the importance and difficulty of neuron segmentation and provides clues for future improvement. To the best of our knowledge, this work is the first comprehensive study for neuron segmentation in such large-scale anatomical regions.