Gotta Trace 'em All: A Mini-Review on Tools and Procedures for Segmenting Single Neurons Toward Deciphering the Structural Connectome

Automated Analysis of Neuronal Morphology in 2D Fluorescence Micrographs through an Unsupervised Semantic Segmentation of Neurons

Brain function emerges from a highly complex network of specialized cells that are interlinked by billions of synapses. The synaptic connectivity between neurons is established between the elongated processes of their axons and dendrites or, together, neurites. To establish these connections, cellular neurites have to grow in highly specialized, cell-type dependent patterns covering extensive distances and connecting with thousands of other neurons. The outgrowth and branching of neurites are tightly controlled during development and are a commonly used functional readout of imaging in the neurosciences. Manual analysis of neuronal morphology from microscopy images, however, is very time intensive and prone to bias. Most automated analyses of neurons rely on reconstruction of the neuron as a whole without a semantic analysis of each neurite. A fully-automated classification of all neurites still remains unavailable in open-source software. Here we present a standalone, GUI-based software for batch-quantification of neuronal morphology in two-dimensional fluorescence micrographs of cultured neurons with minimal requirements for user interaction. Single neurons are first reconstructed into binarized images using a Hessian-based segmentation algorithm to detect thin neurite structures combined with intensity- and shape-based reconstruction of the cell body. Neurites are then classified into axon, dendrites and their branches of increasing order using a geodesic distance transform of the cell skeleton. The software was benchmarked against a published dataset and reproduced the phenotype observed after manual annotation. Our tool promises accelerated and improved morphometric studies of neuronal morphology by allowing for consistent and automated analysis of large datasets.

Gossamer: Scaling Image Processing and Reconstruction to Whole Brains

Neuronal reconstruction-a process that transforms image volumes into 3D geometries and skeletons of cells- bottlenecks the study of brain function, connectomics and pathology. Domain scientists need exact and complete segmentations to study subtle topological differences. Existing methods are diskbound, dense-access, coupled, single-threaded, algorithmically unscalable and require manual cropping of small windows and proofreading of skeletons due to low topological accuracy. Designing a data-intensive parallel solution suited to a neurons' shape, topology and far-ranging connectivity is particularly challenging due to I/O and load-balance, yet by abstracting these vision tasks into strategically ordered specializations of search, we progressively lower memory by 4 orders of magnitude. This enables 1 mouse brain to be fully processed in-memory on a single server, at 67× the scale with 870× less memory while having 78% higher automated yield than APP2, the previous state of the art in performant reconstruction.

Computational Tools for Neuronal Morphometric Analysis: A Systematic Search and Review

Morphometry is fundamental for studying and correlating neuronal morphology with brain functions. With increasing computational power, it is possible to extract morphometric characteristics automatically, including features such as length, volume, and number of neuron branches. However, to the best of our knowledge, there is no mapping of morphometric tools yet. In this context, we conducted a systematic search and review to identify and analyze tools within the scope of neuron analysis. Thus, the work followed a well-defined protocol and sought to answer the following research questions: What open-source tools are available for neuronal morphometric analysis? What morphometric characteristics are extracted by these tools? For this, aiming for greater robustness and coverage, the study was based on the paper analysis as well as the study of documentation and tests with the tools available in repositories. We analyzed 1,586 papers and mapped 23 tools, where NeuroM, L-Measure, and NeuroMorphoVis extract the most features. Furthermore, we contribute to the body of knowledge with the unprecedented presentation of 150 unique morphometric features whose terminologies were categorized and standardized. Overall, the study contributes to advancing the understanding of the complex mechanisms underlying the brain.

A modular framework for multi-scale tissue imaging and neuronal segmentation

The development of robust tools for segmenting cellular and sub-cellular neuronal structures lags behind the massive production of high-resolution 3D images of neurons in brain tissue. The challenges are principally related to high neuronal density and low signal-to-noise characteristics in thick samples, as well as the heterogeneity of data acquired with different imaging methods. To address this issue, we design a framework which includes sample preparation for high resolution imaging and image analysis. Specifically, we set up a method for labeling thick samples and develop SENPAI, a scalable algorithm for segmenting neurons at cellular and sub-cellular scales in conventional and super-resolution STimulated Emission Depletion (STED) microscopy images of brain tissues. Further, we propose a validation paradigm for testing segmentation performance when a manual ground-truth may not exhaustively describe neuronal arborization. We show that SENPAI provides accurate multi-scale segmentation, from entire neurons down to spines, outperforming state-of-the-art tools. The framework will empower image processing of complex neuronal circuitries.

From pixels to connections: exploring in vitro neuron reconstruction software for network graph generation

Digital reconstruction has been instrumental in deciphering how in vitro neuron architecture shapes information flow. Emerging approaches reconstruct neural systems as networks with the aim of understanding their organization through graph theory. Computational tools dedicated to this objective build models of nodes and edges based on key cellular features such as somata, axons, and dendrites. Fully automatic implementations of these tools are readily available, but they may also be purpose-built from specialized algorithms in the form of multi-step pipelines. Here we review software tools informing the construction of network models, spanning from noise reduction and segmentation to full network reconstruction. The scope and core specifications of each tool are explicitly defined to assist bench scientists in selecting the most suitable option for their microscopy dataset. Existing tools provide a foundation for complete network reconstruction, however more progress is needed in establishing morphological bases for directed/weighted connectivity and in software validation.

Between neurons and networks: investigating mesoscale brain connectivity in neurological and psychiatric disorders

The study of brain connectivity has been a cornerstone in understanding the complexities of neurological and psychiatric disorders. It has provided invaluable insights into the functional architecture of the brain and how it is perturbed in disorders. However, a persistent challenge has been achieving the proper spatial resolution, and developing computational algorithms to address biological questions at the multi-cellular level, a scale often referred to as the mesoscale. Historically, neuroimaging studies of brain connectivity have predominantly focused on the macroscale, providing insights into inter-regional brain connections but often falling short of resolving the intricacies of neural circuitry at the cellular or mesoscale level. This limitation has hindered our ability to fully comprehend the underlying mechanisms of neurological and psychiatric disorders and to develop targeted interventions. In light of this issue, our review manuscript seeks to bridge this critical gap by delving into the domain of mesoscale neuroimaging. We aim to provide a comprehensive overview of conditions affected by aberrant neural connections, image acquisition techniques, feature extraction, and data analysis methods that are specifically tailored to the mesoscale. We further delineate the potential of brain connectivity research to elucidate complex biological questions, with a particular focus on schizophrenia and epilepsy. This review encompasses topics such as dendritic spine quantification, single neuron morphology, and brain region connectivity. We aim to showcase the applicability and significance of mesoscale neuroimaging techniques in the field of neuroscience, highlighting their potential for gaining insights into the complexities of neurological and psychiatric disorders.

Molecular mapping of neuronal architecture using STORM microscopy and new fluorescent probes for SMLM imaging

Imaging neuronal architecture has been a recurrent challenge over the years, and the localization of synaptic proteins is a frequent challenge in neuroscience. To quantitatively detect and analyze the structure of synapses, we recently developed free SODA software to detect the association of pre and postsynaptic proteins. To fully take advantage of spatial distribution analysis in complex cells, such as neurons, we also selected some new dyes for plasma membrane labeling. Using Icy SODA plugin, we could detect and analyze synaptic association in both conventional and single molecule localization microscopy, giving access to a molecular map at the nanoscale level. To replace those molecular distributions within the neuronal three-dimensional (3D) shape, we used MemBright probes and 3D STORM analysis to decipher the entire 3D shape of various dendritic spine types at the single-molecule resolution level. We report here the example of synaptic proteins within neuronal mask, but these tools have a broader spectrum of interest since they can be used whatever the proteins or the cellular type. Altogether with SODA plugin, MemBright probes thus provide the perfect toolkit to decipher a nanometric molecular map of proteins within a 3D cellular context.

nAdder: A scale-space approach for the 3D analysis of neuronal traces

Tridimensional microscopy and algorithms for automated segmentation and tracing are revolutionizing neuroscience through the generation of growing libraries of neuron reconstructions. Innovative computational methods are needed to analyze these neuronal traces. In particular, means to characterize the geometric properties of traced neurites along their trajectory have been lacking. Here, we propose a local tridimensional (3D) scale metric derived from differential geometry, measuring for each point of a curve the characteristic length where it is fully 3D as opposed to being embedded in a 2D plane or 1D line. The larger this metric is and the more complex the local 3D loops and turns of the curve are. Available through the GeNePy3D open-source Python quantitative geometry library (https://genepy3d.gitlab.io), this approach termed nAdder offers new means of describing and comparing axonal and dendritic arbors. We validate this metric on simulated and real traces. By reanalysing a published zebrafish larva whole brain dataset, we show its ability to characterize different population of commissural axons, distinguish afferent connections to a target region and differentiate portions of axons and dendrites according to their behavior, shedding new light on the stereotypical nature of neurites' local geometry.

Blind demixing methods for recovering dense neuronal morphology from barcode imaging data

Cellular barcoding methods offer the exciting possibility of 'infinite-pseudocolor' anatomical reconstruction-i.e., assigning each neuron its own random unique barcoded 'pseudocolor,' and then using these pseudocolors to trace the microanatomy of each neuron. Here we use simulations, based on densely-reconstructed electron microscopy microanatomy, with signal structure matched to real barcoding data, to quantify the feasibility of this procedure. We develop a new blind demixing approach to recover the barcodes that label each neuron, and validate this method on real data with known barcodes. We also develop a neural network which uses the recovered barcodes to reconstruct the neuronal morphology from the observed fluorescence imaging data, 'connecting the dots' between discontiguous barcode amplicon signals. We find that accurate recovery should be feasible, provided that the barcode signal density is sufficiently high. This study suggests the possibility of mapping the morphology and projection pattern of many individual neurons simultaneously, at high resolution and at large scale, via conventional light microscopy.

Quantitative mapping of keratin networks in 3D

Mechanobiology requires precise quantitative information on processes taking place in specific 3D microenvironments. Connecting the abundance of microscopical, molecular, biochemical, and cell mechanical data with defined topologies has turned out to be extremely difficult. Establishing such structural and functional 3D maps needed for biophysical modeling is a particular challenge for the cytoskeleton, which consists of long and interwoven filamentous polymers coordinating subcellular processes and interactions of cells with their environment. To date, useful tools are available for the segmentation and modeling of actin filaments and microtubules but comprehensive tools for the mapping of intermediate filament organization are still lacking. In this work, we describe a workflow to model and examine the complete 3D arrangement of the keratin intermediate filament cytoskeleton in canine, murine, and human epithelial cells both, in vitro and in vivo. Numerical models are derived from confocal airyscan high-resolution 3D imaging of fluorescence-tagged keratin filaments. They are interrogated and annotated at different length scales using different modes of visualization including immersive virtual reality. In this way, information is provided on network organization at the subcellular level including mesh arrangement, density and isotropic configuration as well as details on filament morphology such as bundling, curvature, and orientation. We show that the comparison of these parameters helps to identify, in quantitative terms, similarities and differences of keratin network organization in epithelial cell types defining subcellular domains, notably basal, apical, lateral, and perinuclear systems. The described approach and the presented data are pivotal for generating mechanobiological models that can be experimentally tested.

Axonal and Dendritic Morphology of Excitatory Neurons in Layer 2/3 Mouse Barrel Cortex Imaged Through Whole-Brain Two-Photon Tomography and Registered to a Digital Brain Atlas

Communication between cortical areas contributes importantly to sensory perception and cognition. On the millisecond time scale, information is signaled from one brain area to another by action potentials propagating across long-range axonal arborizations. Here, we develop and test methodology for imaging and annotating the brain-wide axonal arborizations of individual excitatory layer 2/3 neurons in mouse barrel cortex through single-cell electroporation and two-photon serial section tomography followed by registration to a digital brain atlas. Each neuron had an extensive local axon within the barrel cortex. In addition, individual neurons innervated subsets of secondary somatosensory cortex; primary somatosensory cortex for upper limb, trunk, and lower limb; primary and secondary motor cortex; visual and auditory cortical regions; dorsolateral striatum; and various fiber bundles. In the future, it will be important to assess if the diversity of axonal projections across individual layer 2/3 mouse barrel cortex neurons is accompanied by functional differences in their activity patterns.

Weakly Supervised Neuron Reconstruction From Optical Microscopy Images With Morphological Priors

Manually labeling neurons from high-resolution but noisy and low-contrast optical microscopy (OM) images is tedious. As a result, the lack of annotated data poses a key challenge when applying deep learning techniques for reconstructing neurons from noisy and low-contrast OM images. While traditional tracing methods provide a possible way to efficiently generate labels for supervised network training, the generated pseudo-labels contain many noisy and incorrect labels, which lead to severe performance degradation. On the other hand, the publicly available dataset, BigNeuron, provides a large number of single 3D neurons that are reconstructed using various imaging paradigms and tracing methods. Though the raw OM images are not fully available for these neurons, they convey essential morphological priors for complex 3D neuron structures. In this paper, we propose a new approach to exploit morphological priors from neurons that have been reconstructed for training a deep neural network to extract neuron signals from OM images. We integrate a deep segmentation network in a generative adversarial network (GAN), expecting the segmentation network to be weakly supervised by pseudo-labels at the pixel level while utilizing the supervision of previously reconstructed neurons at the morphology level. In our morphological-prior-guided neuron reconstruction GAN, named MP-NRGAN, the segmentation network extracts neuron signals from raw images, and the discriminator network encourages the extracted neurons to follow the morphology distribution of reconstructed neurons. Comprehensive experiments on the public VISoR-40 dataset and BigNeuron dataset demonstrate that our proposed MP-NRGAN outperforms state-of-the-art approaches with less training effort.

NeuroRetriever: Automatic Neuron Segmentation for Connectome Assembly

Segmenting individual neurons from a large number of noisy raw images is the first step in building a comprehensive map of neuron-to-neuron connections for predicting information flow in the brain. Thousands of fluorescence-labeled brain neurons have been imaged. However, mapping a complete connectome remains challenging because imaged neurons are often entangled and manual segmentation of a large population of single neurons is laborious and prone to bias. In this study, we report an automatic algorithm, NeuroRetriever, for unbiased large-scale segmentation of confocal fluorescence images of single neurons in the adult Drosophila brain. NeuroRetriever uses a high-dynamic-range thresholding method to segment three-dimensional morphology of single neurons based on branch-specific structural features. Applying NeuroRetriever to automatically segment single neurons in 22,037 raw brain images, we successfully retrieved 28,125 individual neurons validated by human segmentation. Thus, automated NeuroRetriever will greatly accelerate 3D reconstruction of the single neurons for constructing the complete connectomes.

Automated and semi-automated enhancement, segmentation and tracing of cytoskeletal networks in microscopic images: A review

Cytoskeletal filaments are structures of utmost importance to biological cells and organisms due to their versatility and the significant functions they perform. These biopolymers are most often organised into network-like scaffolds with a complex morphology. Understanding the geometrical and topological organisation of these networks provides key insights into their functional roles. However, this non-trivial task requires a combination of high-resolution microscopy and sophisticated image processing/analysis software. The correct analysis of the network structure and connectivity needs precise segmentation of microscopic images. While segmentation of filament-like objects is a well-studied concept in biomedical imaging, where tracing of neurons and blood vessels is routine, there are comparatively fewer studies focusing on the segmentation of cytoskeletal filaments and networks from microscopic images. The developments in the fields of microscopy, computer vision and deep learning, however, began to facilitate the task, as reflected by an increase in the recent literature on the topic. Here, we aim to provide a short summary of the research on the (semi-)automated enhancement, segmentation and tracing methods that are particularly designed and developed for microscopic images of cytoskeletal networks. In addition to providing an overview of the conventional methods, we cover the recently introduced, deep-learning-assisted methods alongside the advantages they offer over classical methods.

Improving the Usability of Virtual Reality Neuron Tracing with Topological Elements

Researchers in the field of connectomics are working to reconstruct a map of neural connections in the brain in order to understand at a fundamental level how the brain processes information. Constructing this wiring diagram is done by tracing neurons through high-resolution image stacks acquired with fluorescence microscopy imaging techniques. While a large number of automatic tracing algorithms have been proposed, these frequently rely on local features in the data and fail on noisy data or ambiguous cases, requiring time-consuming manual correction. As a result, manual and semi-automatic tracing methods remain the state-of-the-art for creating accurate neuron reconstructions. We propose a new semi-automatic method that uses topological features to guide users in tracing neurons and integrate this method within a virtual reality (VR) framework previously used for manual tracing. Our approach augments both visualization and interaction with topological elements, allowing rapid understanding and tracing of complex morphologies. In our pilot study, neuroscientists demonstrated a strong preference for using our tool over prior approaches, reported less fatigue during tracing, and commended the ability to better understand possible paths and alternatives. Quantitative evaluation of the traces reveals that users' tracing speed increased, while retaining similar accuracy compared to a fully manual approach.

Dissecting Neuronal Activation on a Brain-Wide Scale With Immediate Early Genes

Visualizing neuronal activation on a brain-wide scale yet with cellular resolution is a fundamental technical challenge for neuroscience. This would enable analyzing how different neuronal circuits are disrupted in pathology and how they could be rescued by pharmacological treatments. Although this goal would have appeared visionary a decade ago, recent technological advances make it eventually feasible. Here, we review the latest developments in the fields of genetics, sample preparation, imaging, and image analysis that could be combined to afford whole-brain cell-resolution activation mapping. We show how the different biochemical and optical methods have been coupled to study neuronal circuits at different spatial and temporal scales, and with cell-type specificity. The inventory of techniques presented here could be useful to find the tools best suited for a specific experiment. We envision that in the next years, mapping of neuronal activation could become routine in many laboratories, allowing dissecting the neuronal counterpart of behavior.

Weakly Supervised Learning of 3D Deep Network for Neuron Reconstruction

Digital reconstruction or tracing of 3D tree-like neuronal structures from optical microscopy images is essential for understanding the functionality of neurons and reveal the connectivity of neuronal networks. Despite the existence of numerous tracing methods, reconstructing a neuron from highly noisy images remains challenging, particularly for neurites with low and inhomogeneous intensities. Conducting deep convolutional neural network (CNN)-based segmentation prior to neuron tracing facilitates an approach to solving this problem via separation of weak neurites from a noisy background. However, large manual annotations are needed in deep learning-based methods, which is labor-intensive and limits the algorithm's generalization for different datasets. In this study, we present a weakly supervised learning method of a deep CNN for neuron reconstruction without manual annotations. Specifically, we apply a 3D residual CNN as the architecture for discriminative neuronal feature extraction. We construct the initial pseudo-labels (without manual segmentation) of the neuronal images on the basis of an existing automatic tracing method. A weakly supervised learning framework is proposed via iterative training of the CNN model for improved prediction and refining of the pseudo-labels to update training samples. The pseudo-label was iteratively modified via mining and addition of weak neurites from the CNN predicted probability map on the basis of their tubularity and continuity. The proposed method was evaluated on several challenging images from the public BigNeuron and Diadem datasets, to fMOST datasets. Owing to the adaption of 3D deep CNNs and weakly supervised learning, the presented method demonstrates effective detection of weak neurites from noisy images and achieves results similar to those of the CNN model with manual annotations. The tracing performance was significantly improved by the proposed method on both small and large datasets (>100 GB). Moreover, the proposed method proved to be superior to several novel tracing methods on original images. The results obtained on various large-scale datasets demonstrated the generalization and high precision achieved by the proposed method for neuron reconstruction.

A Smart Region-Growing Algorithm for Single-Neuron Segmentation From Confocal and 2-Photon Datasets

Accurately digitizing the brain at the micro-scale is crucial for investigating brain structure-function relationships and documenting morphological alterations due to neuropathies. Here we present a new Smart Region Growing algorithm (SmRG) for the segmentation of single neurons in their intricate 3D arrangement within the brain. Its Region Growing procedure is based on a homogeneity predicate determined by describing the pixel intensity statistics of confocal acquisitions with a mixture model, enabling an accurate reconstruction of complex 3D cellular structures from high-resolution images of neural tissue. The algorithm's outcome is a 3D matrix of logical values identifying the voxels belonging to the segmented structure, thus providing additional useful volumetric information on neurons. To highlight the algorithm's full potential, we compared its performance in terms of accuracy, reproducibility, precision and robustness of 3D neuron reconstructions based on microscopic data from different brain locations and imaging protocols against both manual and state-of-the-art reconstruction tools.