Automated sorting of neuronal trees in fluorescent images of neuronal networks using NeuroTreeTracer

Brain Image Segmentation for Ultrascale Neuron Reconstruction via an Adaptive Dual-Task Learning Network

Accurate morphological reconstruction of neurons in whole brain images is critical for brain science research. However, due to the wide range of whole brain imaging, uneven staining, and optical system fluctuations, there are significant differences in image properties between different regions of the ultrascale brain image, such as dramatically varying voxel intensities and inhomogeneous distribution of background noise, posing an enormous challenge to neuron reconstruction from whole brain images. In this paper, we propose an adaptive dual-task learning network (ADTL-Net) to quickly and accurately extract neuronal structures from ultrascale brain images. Specifically, this framework includes an External Features Classifier (EFC) and a Parameter Adaptive Segmentation Decoder (PASD), which share the same Multi-Scale Feature Encoder (MSFE). MSFE introduces an attention module named Channel Space Fusion Module (CSFM) to extract structure and intensity distribution features of neurons at different scales for addressing the problem of anisotropy in 3D space. Then, EFC is designed to classify these feature maps based on external features, such as foreground intensity distributions and image smoothness, and select specific PASD parameters to decode them of different classes to obtain accurate segmentation results. PASD contains multiple sets of parameters trained by different representative complex signal-to-noise distribution image blocks to handle various images more robustly. Experimental results prove that compared with other advanced segmentation methods for neuron reconstruction, the proposed method achieves state-of-the-art results in the task of neuron reconstruction from ultrascale brain images, with an improvement of about 49% in speed and 12% in F1 score.

From pixels to connections: exploring in vitro neuron reconstruction software for network graph generation

Digital reconstruction has been instrumental in deciphering how in vitro neuron architecture shapes information flow. Emerging approaches reconstruct neural systems as networks with the aim of understanding their organization through graph theory. Computational tools dedicated to this objective build models of nodes and edges based on key cellular features such as somata, axons, and dendrites. Fully automatic implementations of these tools are readily available, but they may also be purpose-built from specialized algorithms in the form of multi-step pipelines. Here we review software tools informing the construction of network models, spanning from noise reduction and segmentation to full network reconstruction. The scope and core specifications of each tool are explicitly defined to assist bench scientists in selecting the most suitable option for their microscopy dataset. Existing tools provide a foundation for complete network reconstruction, however more progress is needed in establishing morphological bases for directed/weighted connectivity and in software validation.

Deep learning in mesoscale brain image analysis: A review

Mesoscale microscopy images of the brain contain a wealth of information which can help us understand the working mechanisms of the brain. However, it is a challenging task to process and analyze these data because of the large size of the images, their high noise levels, the complex morphology of the brain from the cellular to the regional and anatomical levels, the inhomogeneous distribution of fluorescent labels in the cells and tissues, and imaging artifacts. Due to their impressive ability to extract relevant information from images, deep learning algorithms are widely applied to microscopy images of the brain to address these challenges and they perform superiorly in a wide range of microscopy image processing and analysis tasks. This article reviews the applications of deep learning algorithms in brain mesoscale microscopy image processing and analysis, including image synthesis, image segmentation, object detection, and neuron reconstruction and analysis. We also discuss the difficulties of each task and possible directions for further research.

Neuron tracing from light microscopy images: automation, deep learning and bench testing

MOTIVATION

Large-scale neuronal morphologies are essential to neuronal typing, connectivity characterization and brain modeling. It is widely accepted that automation is critical to the production of neuronal morphology. Despite previous survey papers about neuron tracing from light microscopy data in the last decade, thanks to the rapid development of the field, there is a need to update recent progress in a review focusing on new methods and remarkable applications.

RESULTS

This review outlines neuron tracing in various scenarios with the goal to help the community understand and navigate tools and resources. We describe the status, examples and accessibility of automatic neuron tracing. We survey recent advances of the increasingly popular deep-learning enhanced methods. We highlight the semi-automatic methods for single neuron tracing of mammalian whole brains as well as the resulting datasets, each containing thousands of full neuron morphologies. Finally, we exemplify the commonly used datasets and metrics for neuron tracing bench testing.

Super-Resolution Imaging Approaches for Quantifying F-Actin in Immune Cells

Immune cells comprise a diverse set of cells that undergo a complex array of biological processes that must be tightly regulated. A key component of cellular machinery that achieves this is the cytoskeleton. Therefore, imaging and quantitatively describing the architecture and dynamics of the cytoskeleton is an important research goal. Optical microscopy is well suited to this task. Here, we review the latest in the state-of-the-art methodology for labeling the cytoskeleton, fluorescence microscopy hardware suitable for such imaging and quantitative statistical analysis software applicable to describing cytoskeletal structures. We also highlight ongoing challenges and areas for future development.

NeuroRetriever: Automatic Neuron Segmentation for Connectome Assembly

Segmenting individual neurons from a large number of noisy raw images is the first step in building a comprehensive map of neuron-to-neuron connections for predicting information flow in the brain. Thousands of fluorescence-labeled brain neurons have been imaged. However, mapping a complete connectome remains challenging because imaged neurons are often entangled and manual segmentation of a large population of single neurons is laborious and prone to bias. In this study, we report an automatic algorithm, NeuroRetriever, for unbiased large-scale segmentation of confocal fluorescence images of single neurons in the adult Drosophila brain. NeuroRetriever uses a high-dynamic-range thresholding method to segment three-dimensional morphology of single neurons based on branch-specific structural features. Applying NeuroRetriever to automatically segment single neurons in 22,037 raw brain images, we successfully retrieved 28,125 individual neurons validated by human segmentation. Thus, automated NeuroRetriever will greatly accelerate 3D reconstruction of the single neurons for constructing the complete connectomes.

Imaging of the Axon Initial Segment

The axon initial segment (AIS) is the first 20- to 60-μm segment of the axon proximal to the soma of a neuron. This highly specialized subcellular domain is the initiation site of the action potential and contains a high concentration of voltage-gated ion channels held in place by a complex nexus of scaffolding and regulatory proteins that ensure proper electrical activity of the neuron. Studies have shown that dysfunction of many AIS channels and scaffolding proteins occurs in a variety of neuropsychiatric and neurodegenerative diseases, raising the need to develop accurate methods for visualization and quantification of the AIS and its protein content in models of normal and disease conditions. In this article, we describe methods for immunolabeling AIS proteins in cultured neurons and brain slices as well as methods for quantifying protein expression and pattern distribution using fluorescent labeling of these proteins. © 2019 by John Wiley & Sons, Inc.

Serotonergic Axons as Fractional Brownian Motion Paths: Insights Into the Self-Organization of Regional Densities

All vertebrate brains contain a dense matrix of thin fibers that release serotonin (5-hydroxytryptamine), a neurotransmitter that modulates a wide range of neural, glial, and vascular processes. Perturbations in the density of this matrix have been associated with a number of mental disorders, including autism and depression, but its self-organization and plasticity remain poorly understood. We introduce a model based on reflected Fractional Brownian Motion (FBM), a rigorously defined stochastic process, and show that it recapitulates some key features of regional serotonergic fiber densities. Specifically, we use supercomputing simulations to model fibers as FBM-paths in two-dimensional brain-like domains and demonstrate that the resultant steady state distributions approximate the fiber distributions in physical brain sections immunostained for the serotonin transporter (a marker for serotonergic axons in the adult brain). We suggest that this framework can support predictive descriptions and manipulations of the serotonergic matrix and that it can be further extended to incorporate the detailed physical properties of the fibers and their environment.

A Smart Region-Growing Algorithm for Single-Neuron Segmentation From Confocal and 2-Photon Datasets

Accurately digitizing the brain at the micro-scale is crucial for investigating brain structure-function relationships and documenting morphological alterations due to neuropathies. Here we present a new Smart Region Growing algorithm (SmRG) for the segmentation of single neurons in their intricate 3D arrangement within the brain. Its Region Growing procedure is based on a homogeneity predicate determined by describing the pixel intensity statistics of confocal acquisitions with a mixture model, enabling an accurate reconstruction of complex 3D cellular structures from high-resolution images of neural tissue. The algorithm's outcome is a 3D matrix of logical values identifying the voxels belonging to the segmented structure, thus providing additional useful volumetric information on neurons. To highlight the algorithm's full potential, we compared its performance in terms of accuracy, reproducibility, precision and robustness of 3D neuron reconstructions based on microscopic data from different brain locations and imaging protocols against both manual and state-of-the-art reconstruction tools.

Random-Reaction-Seed Method for Automated Identification of Neurite Elongation and Branching

Conventional deterministic algorithms (i.e., skeletonization and edge-detection) lack robustness and sensitivity to reliably detect the neurite elongation and branching of low signal-to-noise-ratio microscopy images. Neurite outgrowth experiments produce an enormous number of images that require automated measurement; however, the tracking of neurites is easily lost in the automated process due to the intrinsic variability of neurites (either axon or dendrite) under stimuli. We have developed a stochastic random-reaction-seed (RRS) method to identify neurite elongation and branching accurately and automatically. The random-seeding algorithm of RRS is based on the hidden-Markov-model (HMM) to offer a robust enough way for tracing arbitrary neurite structures, while the reaction-seeding algorithm of RRS secures the efficiency of random seeding. It is noteworthy that RRS is capable of tracing a whole neurite branch by only one initial seed, so that RRS is proficient at quantifying extensive amounts of neurite outgrowth images with noisy background in microfluidic devices of biomedical engineering fields. The method also showed notable performance for reconstructing of net-like structures, and thus is expected to be proficient for biomedical feature extractions in a wide range of applications, such as retinal vessel segmentation and cell membrane profiling in spurious-edge-tissues.