Semi-automated reconstruction of neural processes from large numbers of fluorescence images

Reducing Manual Operation Time to Obtain a Segmentation Learning Model for Volume Electron Microscopy Using Stepwise Deep Learning With Manual Correction

Three-dimensional (3D) observation of a biological sample using serial-section electron microscopy is widely used. However, organelle segmentation requires a significant amount of manual time. Therefore, several studies have been conducted to improve their efficiency. One such promising method is 3D deep learning (DL), which is highly accurate. However, the creation of training data for 3D DL still requires manual time and effort. In this study, we developed a highly efficient integrated image segmentation tool that includes stepwise DL with manual correction. The tool has four functions: efficient tracers for annotation, model training/inference for organelle segmentation using a lightweight convolutional neural network, efficient proofreading, and model refinement. We applied this tool to increase the training data step by step (stepwise annotation method) to segment the mitochondria in the cells of the cerebral cortex. We found that the stepwise annotation method reduced the manual operation time by one-third compared with that of the fully manual method, where all the training data were created manually. Moreover, we demonstrated that the F1 score, the metric of segmentation accuracy, was 0.9 by training the 3D DL model with these training data. The stepwise annotation method using this tool and the 3D DL model improved the segmentation efficiency for various organelles.

Neurogranin Regulates Adult-Born Olfactory Granule Cell Spine Density and Odor-Reward Associative Memory in Mice

Neurogranin (Ng) is a brain-specific postsynaptic protein, whose role in modulating Ca²⁺/calmodulin signaling in glutamatergic neurons has been linked to enhancement in synaptic plasticity and cognitive functions. Accordingly, Ng knock-out (Ng-ko) mice display hippocampal-dependent learning and memory impairments associated with a deficit in long-term potentiation induction. In the adult olfactory bulb (OB), Ng is expressed by a large population of GABAergic granule cells (GCs) that are continuously generated during adult life, undergo high synaptic remodeling in response to the sensory context, and play a key role in odor processing. However, the possible implication of Ng in OB plasticity and function is yet to be investigated. Here, we show that Ng expression in the OB is associated with the mature state of adult-born GCs, where its active-phosphorylated form is concentrated at post-synaptic sites. Constitutive loss of Ng in Ng-ko mice resulted in defective spine density in adult-born GCs, while their survival remained unaltered. Moreover, Ng-ko mice show an impaired odor-reward associative memory coupled with reduced expression of the activity-dependent transcription factor Zif268 in olfactory GCs. Overall, our data support a role for Ng in the molecular mechanisms underlying GC plasticity and the formation of olfactory associative memory.

Neuromuscular reinnervation efficacy using a YFP model

INTRODUCTION

The gold standard reconstruction for facial reanimation is the functional muscle transfer. The reinnervation of a muscle is never complete, and clinical results are variable with 20% not achieving a satisfactory outcome. We hypothesise that this may be due to a mismatch between the characteristics of the donor nerve and transferred muscle.

METHOD

81 YFP-16 and 14 YFP-H mice were studied in three intervention groups over three time periods. Two parameters were investigated: the number and surface area of reinnervated neuromuscular junctions and regenerating axons. An assessment was made of motor unit proportions.

RESULTS

All cases of nerve repair and nerve graft, the neuromuscular junctions (NMJ) were completely reinnervated by regenerating axons. The number and calibre of the regenerating axons were significantly different from controls for both intervention groups. The motor units were smaller in both intervention groups.

DISCUSSION

Reinnervation occurs after nerve repair or graft; however, the arbour was reinnervated by large numbers of much smaller axons. These axons showed some evidence of remodelling in the repair group, but not in the graft group. Neither group achieved the parameters of the control group. There were persistent qualitative changes to the morphology of both axons and junctions. Imaging documented both synkinesis and alterations that resemble those seen in ageing.

CONCLUSION

Overall, the efficacy of reinnervation is very high with all NMJ reoccupied by regenerating axons. The way small axons are remodelled is different in the nerve repairs compared with the nerve grafts.

Soma Detection in 3D Images of Neurons using Machine Learning Technique

Computing and analyzing the neuronal structure is essential to studying connectome. Two important tasks for such analysis are finding the soma and constructing the neuronal structure. Finding the soma is considered more important because it is required for some neuron tracing algorithms. We describe a robust automatic soma detection method developed based on the machine learning technique. Images of neurons were three-dimensional confocal microscopic images in the FlyCircuit database. The testing data were randomly selected raw images that contained noises and partial neuronal structures. The number of somas in the images was not known in advance. Our method tries to identify all the somas in the images. Experimental results showed that the method is efficient and robust.

A Segmentation Scheme for Complex Neuronal Arbors and Application to Vibration Sensitive Neurons in the Honeybee Brain

The morphology of a neuron is strongly related to its physiological properties, application of logical product and thus to information processing functions. Optical microscope images are widely used for extracting the structure of neurons. Although several approaches have been proposed to trace and extract complex neuronal structures from microscopy images, available methods remain prone to errors. In this study, we present a practical scheme for processing confocal microscope images and reconstructing neuronal structures. We evaluated this scheme using image data samples and associated “gold standard” reconstructions from the BigNeuron Project. In these samples, dendritic arbors belonging to multiple projection branches of the same neuron overlapped in space, making it difficult to automatically and accurately trace their structural connectivity. Our proposed scheme, which combines several software tools for image masking and filtering with an existing tool for dendritic segmentation and tracing, outperformed state-of-the-art automatic methods in reconstructing such neuron structures. For evaluating our scheme, we applied it to a honeybee local interneuron, DL-Int-1, which has complex arbors and is considered to be a critical neuron for encoding the distance information indicated in the waggle dance of the honeybee.

Ensemble Neuron Tracer for 3D Neuron Reconstruction

Tracing of neuron paths is important in neuroscience. Recent studies have shown that it is possible to segment and reconstruct three-dimensional morphology of axons and dendrites using fully automatic neuron tracing methods. A specific tracer may be better than others for a specific dataset, but another tracer could perform better for some other datasets. Ensemble of learners is an effective way to improve learning accuracy in machine learning. We developed automatic ensemble neuron tracers, which consistently perform well on 57 datasets of 5 species collected from 7 laboratories worldwide. Quantitative evaluation based on the data generated by human annotators shows that the proposed ensemble tracers are valuable for 3D neuron tracing and can be widely applied to different datasets.

Fuzzy-Logic Based Detection and Characterization of Junctions and Terminations in Fluorescence Microscopy Images of Neurons

Digital reconstruction of neuronal cell morphology is an important step toward understanding the functionality of neuronal networks. Neurons are tree-like structures whose description depends critically on the junctions and terminations, collectively called critical points, making the correct localization and identification of these points a crucial task in the reconstruction process. Here we present a fully automatic method for the integrated detection and characterization of both types of critical points in fluorescence microscopy images of neurons. In view of the majority of our current studies, which are based on cultured neurons, we describe and evaluate the method for application to two-dimensional (2D) images. The method relies on directional filtering and angular profile analysis to extract essential features about the main streamlines at any location in an image, and employs fuzzy logic with carefully designed rules to reason about the feature values in order to make well-informed decisions about the presence of a critical point and its type. Experiments on simulated as well as real images of neurons demonstrate the detection performance of our method. A comparison with the output of two existing neuron reconstruction methods reveals that our method achieves substantially higher detection rates and could provide beneficial information to the reconstruction process.

TReMAP: Automatic 3D Neuron Reconstruction Based on Tracing, Reverse Mapping and Assembling of 2D Projections

Efficient and accurate digital reconstruction of neurons from large-scale 3D microscopic images remains a challenge in neuroscience. We propose a new automatic 3D neuron reconstruction algorithm, TReMAP, which utilizes 3D Virtual Finger (a reverse-mapping technique) to detect 3D neuron structures based on tracing results on 2D projection planes. Our fully automatic tracing strategy achieves close performance with the state-of-the-art neuron tracing algorithms, with the crucial advantage of efficient computation (much less memory consumption and parallel computation) for large-scale images.

Tomographic brain imaging with nucleolar detail and automatic cell counting

Brain tissue evaluation is essential for gaining in-depth insight into its diseases and disorders. Imaging the human brain in three dimensions has always been a challenge on the cell level. In vivo methods lack spatial resolution, and optical microscopy has a limited penetration depth. Herein, we show that hard X-ray phase tomography can visualise a volume of up to 43 mm³ of human post mortem or biopsy brain samples, by demonstrating the method on the cerebellum. We automatically identified 5,000 Purkinje cells with an error of less than 5% at their layer and determined the local surface density to 165 cells per mm² on average. Moreover, we highlight that three-dimensional data allows for the segmentation of sub-cellular structures, including dendritic tree and Purkinje cell nucleoli, without dedicated staining. The method suggests that automatic cell feature quantification of human tissues is feasible in phase tomograms obtained with isotropic resolution in a label-free manner.

Adaptive Image Enhancement for Tracing 3D Morphologies of Neurons and Brain Vasculatures

It is important to digitally reconstruct the 3D morphology of neurons and brain vasculatures. A number of previous methods have been proposed to automate the reconstruction process. However, in many cases, noise and low signal contrast with respect to the image background still hamper our ability to use automation methods directly. Here, we propose an adaptive image enhancement method specifically designed to improve the signal-to-noise ratio of several types of individual neurons and brain vasculature images. Our method is based on detecting the salient features of fibrous structures, e.g. the axon and dendrites combined with adaptive estimation of the optimal context windows where such saliency would be detected. We tested this method for a range of brain image datasets and imaging modalities, including bright-field, confocal and multiphoton fluorescent images of neurons, and magnetic resonance angiograms. Applying our adaptive enhancement to these datasets led to improved accuracy and speed in automated tracing of complicated morphology of neurons and vasculatures.

Clonal Analysis of Newborn Hippocampal Dentate Granule Cell Proliferation and Development in Temporal Lobe Epilepsy

Hippocampal dentate granule cells are among the few neuronal cell types generated throughout adult life in mammals. In the normal brain, new granule cells are generated from progenitors in the subgranular zone and integrate in a typical fashion. During the development of epilepsy, granule cell integration is profoundly altered. The new cells migrate to ectopic locations and develop misoriented "basal" dendrites. Although it has been established that these abnormal cells are newly generated, it is not known whether they arise ubiquitously throughout the progenitor cell pool or are derived from a smaller number of "bad actor" progenitors. To explore this question, we conducted a clonal analysis study in mice expressing the Brainbow fluorescent protein reporter construct in dentate granule cell progenitors. Mice were examined 2 months after pilocarpine-induced status epilepticus, a treatment that leads to the development of epilepsy. Brain sections were rendered translucent so that entire hippocampi could be reconstructed and all fluorescently labeled cells identified. Our findings reveal that a small number of progenitors produce the majority of ectopic cells following status epilepticus, indicating that either the affected progenitors or their local microenvironments have become pathological. By contrast, granule cells with "basal" dendrites were equally distributed among clonal groups. This indicates that these progenitors can produce normal cells and suggests that global factors sporadically disrupt the dendritic development of some new cells. Together, these findings strongly predict that distinct mechanisms regulate different aspects of granule cell pathology in epilepsy.

Neuron anatomy structure reconstruction based on a sliding filter

BACKGROUND

Reconstruction of neuron anatomy structure is a challenging and important task in neuroscience. However, few algorithms can automatically reconstruct the full structure well without manual assistance, making it essential to develop new methods for this task.

METHODS

This paper introduces a new pipeline for reconstructing neuron anatomy structure from 3-D microscopy image stacks. This pipeline is initialized with a set of seeds that were detected by our proposed Sliding Volume Filter (SVF), given a non-circular cross-section of a neuron cell. Then, an improved open curve snake model combined with a SVF external force is applied to trace the full skeleton of the neuron cell. A radius estimation method based on a 2D sliding band filter is developed to fit the real edge of the cross-section of the neuron cell. Finally, a surface reconstruction method based on non-parallel curve networks is used to generate the neuron cell surface to finish this pipeline.

RESULTS

The proposed pipeline has been evaluated using publicly available datasets. The results show that the proposed method achieves promising results in some datasets from the DIgital reconstruction of Axonal and DEndritic Morphology (DIADEM) challenge and new BigNeuron project.

CONCLUSION

The new pipeline works well in neuron tracing and reconstruction. It can achieve higher efficiency, stability and robustness in neuron skeleton tracing. Furthermore, the proposed radius estimation method and applied surface reconstruction method can obtain more accurate neuron anatomy structures.

VolRoverN: enhancing surface and volumetric reconstruction for realistic dynamical simulation of cellular and subcellular function

Establishing meaningful relationships between cellular structure and function requires accurate morphological reconstructions. In particular, there is an unmet need for high quality surface reconstructions to model subcellular and synaptic interactions among neurons and glia at nanometer resolution. We address this need with VolRoverN, a software package that produces accurate, efficient, and automated 3D surface reconstructions from stacked 2D contour tracings. While many techniques and tools have been developed in the past for 3D visualization of cellular structure, the reconstructions from VolRoverN meet specific quality criteria that are important for dynamical simulations. These criteria include manifoldness, water-tightness, lack of self- and object-object-intersections, and geometric accuracy. These enhanced surface reconstructions are readily extensible to any cell type and are used here on spiny dendrites with complex morphology and axons from mature rat hippocampal area CA1. Both spatially realistic surface reconstructions and reduced skeletonizations are produced and formatted by VolRoverN for easy input into analysis software packages for neurophysiological simulations at multiple spatial and temporal scales ranging from ion electro-diffusion to electrical cable models.

Input clustering and the microscale structure of local circuits

The recent development of powerful tools for high-throughput mapping of synaptic networks promises major advances in understanding brain function. One open question is how circuits integrate and store information. Competing models based on random vs. structured connectivity make distinct predictions regarding the dendritic addressing of synaptic inputs. In this article we review recent experimental tests of one of these models, the input clustering hypothesis. Across circuits, brain regions and species, there is growing evidence of a link between synaptic co-activation and dendritic location, although this finding is not universal. The functional implications of input clustering and future challenges are discussed.

A pipeline for neuron reconstruction based on spatial sliding volume filter seeding

Neuron's shape and dendritic architecture are important for biosignal transduction in neuron networks. And the anatomy architecture reconstruction of neuron cell is one of the foremost challenges and important issues in neuroscience. Accurate reconstruction results can facilitate the subsequent neuron system simulation. With the development of confocal microscopy technology, researchers can scan neurons at submicron resolution for experiments. These make the reconstruction of complex dendritic trees become more feasible; however, it is still a tedious, time consuming, and labor intensity task. For decades, computer aided methods have been playing an important role in this task, but none of the prevalent algorithms can reconstruct full anatomy structure automatically. All of these make it essential for developing new method for reconstruction. This paper proposes a pipeline with a novel seeding method for reconstructing neuron structures from 3D microscopy images stacks. The pipeline is initialized with a set of seeds detected by sliding volume filter (SVF), and then the open curve snake is applied to the detected seeds for reconstructing the full structure of neuron cells. The experimental results demonstrate that the proposed pipeline exhibits excellent performance in terms of accuracy compared with traditional method, which is clearly a benefit for 3D neuron detection and reconstruction.

Rapid reconstruction of 3D neuronal morphology from light microscopy images with augmented rayburst sampling

Digital reconstruction of three-dimensional (3D) neuronal morphology from light microscopy images provides a powerful technique for analysis of neural circuits. It is time-consuming to manually perform this process. Thus, efficient computer-assisted approaches are preferable. In this paper, we present an innovative method for the tracing and reconstruction of 3D neuronal morphology from light microscopy images. The method uses a prediction and refinement strategy that is based on exploration of local neuron structural features. We extended the rayburst sampling algorithm to a marching fashion, which starts from a single or a few seed points and marches recursively forward along neurite branches to trace and reconstruct the whole tree-like structure. A local radius-related but size-independent hemispherical sampling was used to predict the neurite centerline and detect branches. Iterative rayburst sampling was performed in the orthogonal plane, to refine the centerline location and to estimate the local radius. We implemented the method in a cooperative 3D interactive visualization-assisted system named flNeuronTool. The source code in C++ and the binaries are freely available at http://sourceforge.net/projects/flneurontool/. We validated and evaluated the proposed method using synthetic data and real datasets from the Digital Reconstruction of Axonal and Dendritic Morphology (DIADEM) challenge. Then, flNeuronTool was applied to mouse brain images acquired with the Micro-Optical Sectioning Tomography (MOST) system, to reconstruct single neurons and local neural circuits. The results showed that the system achieves a reasonable balance between fast speed and acceptable accuracy, which is promising for interactive applications in neuronal image analysis.

Mapping mammalian synaptic connectivity

Mapping mammalian synaptic connectivity has long been an important goal of neuroscientists since it is considered crucial for explaining human perception and behavior. Yet, despite enormous efforts, the overwhelming complexity of the neural circuitry and the lack of appropriate techniques to unravel it have limited the success of efforts to map connectivity. However, recent technological advances designed to overcome the limitations of conventional methods for connectivity mapping may bring about a turning point. Here, we address the promises and pitfalls of these new mapping technologies.

Somato-dendritic localization and signaling by leptin receptors in hypothalamic POMC and AgRP neurons

Leptin acts via neuronal leptin receptors to control energy balance. Hypothalamic pro-opiomelanocortin (POMC) and agouti-related peptide (AgRP)/Neuropeptide Y (NPY)/GABA neurons produce anorexigenic and orexigenic neuropeptides and neurotransmitters, and express the long signaling form of the leptin receptor (LepRb). Despite progress in the understanding of LepRb signaling and function, the sub-cellular localization of LepRb in target neurons has not been determined, primarily due to lack of sensitive anti-LepRb antibodies. Here we applied light microscopy (LM), confocal-laser scanning microscopy (CLSM), and electron microscopy (EM) to investigate LepRb localization and signaling in mice expressing a HA-tagged LepRb selectively in POMC or AgRP/NPY/GABA neurons. We report that LepRb receptors exhibit a somato-dendritic expression pattern. We further show that LepRb activates STAT3 phosphorylation in neuronal fibers within several hypothalamic and hindbrain nuclei of wild-type mice and rats, and specifically in dendrites of arcuate POMC and AgRP/NPY/GABA neurons of Leprb^+/+ mice and in Leprb^db/db mice expressing HA-LepRb in a neuron specific manner. We did not find evidence of LepRb localization or STAT3-signaling in axon-fibers or nerve-terminals of POMC and AgRP/NPY/GABA neurons. Three-dimensional serial EM-reconstruction of dendritic segments from POMC and AgRP/NPY/GABA neurons indicates a high density of shaft synapses. In addition, we found that the leptin activates STAT3 signaling in proximity to synapses on POMC and AgRP/NPY/GABA dendritic shafts. Taken together, these data suggest that the signaling-form of the leptin receptor exhibits a somato-dendritic expression pattern in POMC and AgRP/NPY/GABA neurons. Dendritic LepRb signaling may therefore play an important role in leptin’s central effects on energy balance, possibly through modulation of synaptic activity via post-synaptic mechanisms.

Computational tissue volume reconstruction of a peripheral nerve using high-resolution light-microscopy and reconstruct

The development of neural cuff-electrodes requires several in vivo studies and revisions of the electrode design before the electrode is completely adapted to its target nerve. It is therefore favorable to simulate many of the steps involved in this process to reduce costs and animal testing. As the restoration of motor function is one of the most interesting applications of cuff-electrodes, the position and trajectories of myelinated fibers in the simulated nerve are important. In this paper, we investigate a method for building a precise neuroanatomical model of myelinated fibers in a peripheral nerve based on images obtained using high-resolution light microscopy. This anatomical model describes the first aim of our "Virtual workbench" project to establish a method for creating realistic neural simulation models based on image datasets. The imaging, processing, segmentation and technical limitations are described, and the steps involved in the transition into a simulation model are presented. The results showed that the position and trajectories of the myelinated axons were traced and virtualized using our technique, and small nerves could be reliably modeled based on of light microscopy images using low-cost OpenSource software and standard hardware. The anatomical model will be released to the scientific community.

APP2: automatic tracing of 3D neuron morphology based on hierarchical pruning of a gray-weighted image distance-tree

MOTIVATION

Tracing of neuron morphology is an essential technique in computational neuroscience. However, despite a number of existing methods, few open-source techniques are completely or sufficiently automated and at the same time are able to generate robust results for real 3D microscopy images.

RESULTS

We developed all-path-pruning 2.0 (APP2) for 3D neuron tracing. The most important idea is to prune an initial reconstruction tree of a neuron's morphology using a long-segment-first hierarchical procedure instead of the original termini-first-search process in APP. To further enhance the robustness of APP2, we compute the distance transform of all image voxels directly for a gray-scale image, without the need to binarize the image before invoking the conventional distance transform. We also design a fast-marching algorithm-based method to compute the initial reconstruction trees without pre-computing a large graph. This method allows us to trace large images. We bench-tested APP2 on ~700 3D microscopic images and found that APP2 can generate more satisfactory results in most cases than several previous methods.

AVAILABILITY

The software has been implemented as an open-source Vaa3D plugin. The source code is available in the Vaa3D code repository http://vaa3d.org.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Optogenetic approaches for functional mouse brain mapping

To better understand the connectivity of the brain, it is important to map both structural and functional connections between neurons and cortical regions. In recent years, a set of optogenetic tools have been developed that permit selective manipulation and investigation of neural systems. These tools have enabled the mapping of functional connections between stimulated cortical targets and other brain regions. Advantages of the approach include the ability to arbitrarily stimulate brain regions that express opsins, allowing for brain mapping independent of behavior or sensory processing. The ability of opsins to be rapidly and locally activated allows for investigation of connectivity with spatial resolution on the order of single neurons and temporal resolution on the order of milliseconds. Optogenetic methods for functional mapping have been applied in experiments ranging from in vitro investigation of microcircuits, to in vivo probing of inter-regional cortical connections, to examination of global connections within the whole brain. We review recently developed functional mapping methods that use optogenetic single-point stimulation in the rodent brain and employ cellular electrophysiology, evoked motor movements, voltage sensitive dyes (VSDs), calcium indicators, or functional magnetic resonance imaging (fMRI) to assess activity. In particular we highlight results using red-shifted organic VSDs that permit high temporal resolution imaging in a manner spectrally separated from Channelrhodopsin-2 (ChR2) activation. VSD maps stimulated by ChR2 were dependent on intracortical synaptic activity and were able to reflect circuits used for sensory processing. Although the methods reviewed are powerful, challenges remain with respect to finding approaches that permit selective high temporal resolution assessment of stimulated activity in animals that can be followed longitudinally.

Segmentation and tracing of single neurons from 3D confocal microscope images

In order to understand the brain, we need to first understand the morphology of neurons. In the neurobiology community, there have been recent pushes to analyze both neuron connectivity and the influence of structure on function. Currently, a technical road block that stands in the way of these studies is the inability to automatically trace neuronal structure from microscopy. On the image processing side, proposed tracing algorithms face difficulties in low contrast, indistinct boundaries, clutter, and complex branching structure. To tackle these difficulties, we develop Tree2Tree, a robust automatic neuron segmentation and morphology generation algorithm. Tree2Tree uses a local medial tree generation strategy in combination with a global tree linking to build a maximum likelihood global tree. Recasting the neuron tracing problem in a graph-theoretic context enables Tree2Tree to estimate bifurcations naturally, which is currently a challenge for current neuron tracing algorithms. Tests on cluttered confocal microscopy images of Drosophila neurons give results that correspond to ground truth within a margin of ±2.75% normalized mean absolute error.

Automatic reconstruction of neural morphologies with multi-scale tracking

Neurons have complex axonal and dendritic morphologies that are the structural building blocks of neural circuits. The traditional method to capture these morphological structures using manual reconstructions is time-consuming and partly subjective, so it appears important to develop automatic or semi-automatic methods to reconstruct neurons. Here we introduce a fast algorithm for tracking neural morphologies in 3D with simultaneous detection of branching processes. The method is based on existing tracking procedures, adding the machine vision technique of multi-scaling. Starting from a seed point, our algorithm tracks axonal or dendritic arbors within a sphere of a variable radius, then moves the sphere center to the point on its surface with the shortest Dijkstra path, detects branching points on the surface of the sphere, scales it until branches are well separated and then continues tracking each branch. We evaluate the performance of our algorithm on preprocessed data stacks obtained by manual reconstructions of neural cells, corrupted with different levels of artificial noise, and unprocessed data sets, achieving 90% precision and 81% recall in branch detection. We also discuss limitations of our method, such as reconstructing highly overlapping neural processes, and suggest possible improvements. Multi-scaling techniques, well suited to detect branching structures, appear a promising strategy for automatic neuronal reconstructions.

Neuronal tracing for connectomic studies

Reconstruction of the complete wiring diagram, or connectome, of a neural circuit provides an alternative approach to conventional circuit analysis. One major obstacle of connectomics lies in segmenting and tracing neuronal processes from the vast number of images obtained with optical or electron microscopy. Here I review recent progress in automated tracing algorithms for connectomic reconstruction with fluorescence and electron microscopy, and discuss the challenges to image analysis posed by novel optical imaging techniques.

A broadly applicable 3-D neuron tracing method based on open-curve snake

This paper presents a broadly applicable algorithm and a comprehensive open-source software implementation for automated tracing of neuronal structures in 3-D microscopy images. The core 3-D neuron tracing algorithm is based on three-dimensional (3-D) open-curve active Contour (Snake). It is initiated from a set of automatically detected seed points. Its evolution is driven by a combination of deforming forces based on the Gradient Vector Flow (GVF), stretching forces based on estimation of the fiber orientations, and a set of control rules. In this tracing model, bifurcation points are detected implicitly as points where multiple snakes collide. A boundariness measure is employed to allow local radius estimation. A suite of pre-processing algorithms enable the system to accommodate diverse neuronal image datasets by reducing them to a common image format. The above algorithms form the basis for a comprehensive, scalable, and efficient software system developed for confocal or brightfield images. It provides multiple automated tracing modes. The user can optionally interact with the tracing system using multiple view visualization, and exercise full control to ensure a high quality reconstruction. We illustrate the utility of this tracing system by presenting results from a synthetic dataset, a brightfield dataset and two confocal datasets from the DIADEM challenge.

Motor neurons and the sense of place

Seventy years ago George Romanes began to document the anatomical organization of the spinal motor system, uncovering a multilayered topographic plan that links the clustering and settling position of motor neurons to the spatial arrangement and biomechanical features of limb muscles. To this day, these findings have provided a structural foundation for analysis of the neural control of movement and serve as a guide for studies to explore mechanisms that direct the wiring of spinal motor circuits. In this brief essay we outline the core of Romanes's findings and place them in the context of recent studies that begin to provide insight into molecular programs that assign motor pool position and to resolve how motor neuron position shapes circuit assembly. Romanes's findings reveal how and why neuronal positioning contributes to sensory-motor connectivity and may have relevance to circuit organization in other regions of the central nervous system.

Are mental properties supervenient on brain properties?

The "mind-brain supervenience" conjecture suggests that all mental properties are derived from the physical properties of the brain. To address the question of whether the mind supervenes on the brain, we frame a supervenience hypothesis in rigorous statistical terms. Specifically, we propose a modified version of supervenience (called ε-supervenience) that is amenable to experimental investigation and statistical analysis. To illustrate this approach, we perform a thought experiment that illustrates how the probabilistic theory of pattern recognition can be used to make a one-sided determination of ε-supervenience. The physical property of the brain employed in this analysis is the graph describing brain connectivity (i.e., the brain-graph or connectome). ε-supervenience allows us to determine whether a particular mental property can be inferred from one's connectome to within any given positive misclassification rate, regardless of the relationship between the two. This may provide further motivation for cross-disciplinary research between neuroscientists and statisticians.

A multiscale parallel computing architecture for automated segmentation of the brain connectome

Several groups in neurobiology have embarked into deciphering the brain circuitry using large-scale imaging of a mouse brain and manual tracing of the connections between neurons. Creating a graph of the brain circuitry, also called a connectome, could have a huge impact on the understanding of neurodegenerative diseases such as Alzheimer's disease. Although considerably smaller than a human brain, a mouse brain already exhibits one billion connections and manually tracing the connectome of a mouse brain can only be achieved partially. This paper proposes to scale up the tracing by using automated image segmentation and a parallel computing approach designed for domain experts. We explain the design decisions behind our parallel approach and we present our results for the segmentation of the vasculature and the cell nuclei, which have been obtained without any manual intervention.

The DIADEM data sets: representative light microscopy images of neuronal morphology to advance automation of digital reconstructions

The comprehensive characterization of neuronal morphology requires tracing extensive axonal and dendritic arbors imaged with light microscopy into digital reconstructions. Considerable effort is ongoing to automate this greatly labor-intensive and currently rate-determining process. Experimental data in the form of manually traced digital reconstructions and corresponding image stacks play a vital role in developing increasingly more powerful reconstruction algorithms. The DIADEM challenge (short for DIgital reconstruction of Axonal and DEndritic Morphology) successfully stimulated progress in this area by utilizing six data set collections from different animal species, brain regions, neuron types, and visualization methods. The original research projects that provided these data are representative of the diverse scientific questions addressed in this field. At the same time, these data provide a benchmark for the types of demands automated software must meet to achieve the quality of manual reconstructions while minimizing human involvement. The DIADEM data underwent extensive curation, including quality control, metadata annotation, and format standardization, to focus the challenge on the most substantial technical obstacles. This data set package is now freely released ( http://diademchallenge.org ) to train, test, and aid development of automated reconstruction algorithms.

Topical perspective on massive threading and parallelism

Unquestionably computer architectures have undergone a recent and noteworthy paradigm shift that now delivers multi- and many-core systems with tens to many thousands of concurrent hardware processing elements per workstation or supercomputer node. GPGPU (General Purpose Graphics Processor Unit) technology in particular has attracted significant attention as new software development capabilities, namely CUDA (Compute Unified Device Architecture) and OpenCL™, have made it possible for students as well as small and large research organizations to achieve excellent speedup for many applications over more conventional computing architectures. The current scientific literature reflects this shift with numerous examples of GPGPU applications that have achieved one, two, and in some special cases, three-orders of magnitude increased computational performance through the use of massive threading to exploit parallelism. Multi-core architectures are also evolving quickly to exploit both massive-threading and massive-parallelism such as the 1.3 million threads Blue Waters supercomputer. The challenge confronting scientists in planning future experimental and theoretical research efforts--be they individual efforts with one computer or collaborative efforts proposing to use the largest supercomputers in the world is how to capitalize on these new massively threaded computational architectures--especially as not all computational problems will scale to massive parallelism. In particular, the costs associated with restructuring software (and potentially redesigning algorithms) to exploit the parallelism of these multi- and many-threaded machines must be considered along with application scalability and lifespan. This perspective is an overview of the current state of threading and parallelize with some insight into the future.

Localization of presynaptic inputs on dendrites of individually labeled neurons in three dimensional space using a center distance algorithm

The spatial distribution of synaptic inputs on the dendritic tree of a neuron can have significant influence on neuronal function. Consequently, accurate anatomical reconstructions of neuron morphology and synaptic localization are critical when modeling and predicting physiological responses of individual neurons. Historically, generation of three-dimensional (3D) neuronal reconstructions together with comprehensive mapping of synaptic inputs has been an extensive task requiring manual identification of putative synaptic contacts directly from tissue samples or digital images. Recent developments in neuronal tracing software applications have improved the speed and accuracy of 3D reconstructions, but localization of synaptic sites through the use of pre- and/or post-synaptic markers has remained largely a manual process. To address this problem, we have developed an algorithm, based on 3D distance measurements between putative pre-synaptic terminals and the post-synaptic dendrite, to automate synaptic contact detection on dendrites of individually labeled neurons from 3D immunofluorescence image sets. In this study, the algorithm is implemented with custom routines in Matlab, and its effectiveness is evaluated through analysis of primary sensory afferent terminals on motor neurons. Optimization of algorithm parameters enabled automated identification of synaptic contacts that matched those identified by manual inspection with low incidence of error. Substantial time savings and the elimination of variability in contact detection introduced by different users are significant advantages of this method.

Combining confocal laser scanning microscopy with serial section reconstruction in the study of adult neurogenesis

Current advances in imaging techniques have extended the possibility of visualizing small structures within large volumes of both fixed and live specimens without sectioning. These techniques have contributed valuable information to study neuronal plasticity in the adult brain. However, technical limits still hamper the use of these approaches to investigate neurogenic regions located far from the ventricular surface such as parenchymal neurogenic niches, or the scattered neuroblasts induced by brain lesions. Here, we present a method to combine confocal laser scanning microscopy (CLSM) and serial section reconstruction in order to reconstruct large volumes of brain tissue at cellular resolution. In this method a series of thick sections are imaged with CLSM and the resulting stacks of images are registered and 3D reconstructed. This approach is based on existing freeware software and can be performed on ordinary laboratory personal computers. By using this technique we have investigated the morphology and spatial organization of a group of doublecortin (DCX)+ neuroblasts located in the lateral striatum of the late post-natal guinea pig. The 3D study unraveled a complex network of long and poorly ramified cell processes, often fascicled and mostly oriented along the internal capsule fiber bundles. These data support CLSM serial section reconstruction as a reliable alternative to the whole mount approaches to analyze cyto-architectural features of adult germinative niches.

Understanding complexity in the human brain

Although the ultimate aim of neuroscientific enquiry is to gain an understanding of the brain and how its workings relate to the mind, the majority of current efforts are largely focused on small questions using increasingly detailed data. However, it might be possible to successfully address the larger question of mind-brain mechanisms if the cumulative findings from these neuroscientific studies are coupled with complementary approaches from physics and philosophy. The brain, we argue, can be understood as a complex system or network, in which mental states emerge from the interaction between multiple physical and functional levels. Achieving further conceptual progress will crucially depend on broad-scale discussions regarding the properties of cognition and the tools that are currently available or must be developed in order to study mind-brain mechanisms.

The non-random brain: efficiency, economy, and complex dynamics

Modern anatomical tracing and imaging techniques are beginning to reveal the structural anatomy of neural circuits at small and large scales in unprecedented detail. When examined with analytic tools from graph theory and network science, neural connectivity exhibits highly non-random features, including high clustering and short path length, as well as modules and highly central hub nodes. These characteristic topological features of neural connections shape non-random dynamic interactions that occur during spontaneous activity or in response to external stimulation. Disturbances of connectivity and thus of neural dynamics are thought to underlie a number of disease states of the brain, and some evidence suggests that degraded functional performance of brain networks may be the outcome of a process of randomization affecting their nodes and edges. This article provides a survey of the non-random structure of neural connectivity, primarily at the large scale of regions and pathways in the mammalian cerebral cortex. In addition, we will discuss how non-random connections can give rise to differentiated and complex patterns of dynamics and information flow. Finally, we will explore the idea that at least some disorders of the nervous system are associated with increased randomness of neural connections.

Automated reconstruction of neuronal morphology: an overview

Digital reconstruction of neuronal morphology is a powerful technique for investigating the nervous system. This process consists of tracing the axonal and dendritic arbors of neurons imaged by optical microscopy into a geometrical format suitable for quantitative analysis and computational modeling. Algorithmic automation of neuronal tracing promises to increase the speed, accuracy, and reproducibility of morphological reconstructions. Together with recent breakthroughs in cellular imaging and accelerating progress in optical microscopy, automated reconstruction of neuronal morphology will play a central role in the development of high throughput screening and the acquisition of connectomic data. Yet, despite continuous advances in image processing algorithms, to date manual tracing remains the overwhelming choice for digitizing neuronal morphology. We summarize the issues involved in automated reconstruction, overview the available techniques, and provide a realistic assessment of future perspectives.

Reconstruction of the neuromuscular junction connectome

MOTIVATION

Unraveling the structure and behavior of the brain and central nervous system (CNS) has always been a major goal of neuroscience. Understanding the wiring diagrams of the neuromuscular junction connectomes (full connectivity of nervous system neuronal components) is a starting point for this, as it helps in the study of the organizational and developmental properties of the mammalian CNS. The phenomenon of synapse elimination during developmental stages of the neuronal circuitry is such an example. Due to the organizational specificity of the axons in the connectomes, it becomes important to label and extract individual axons for morphological analysis. Features such as axonal trajectories, their branching patterns, geometric information, the spatial relations of groups of axons, etc. are of great interests for neurobiologists in the study of wiring diagrams. However, due to the complexity of spatial structure of the axons, automatically tracking and reconstructing them from microscopy images in 3D is an unresolved problem. In this article, AxonTracker-3D, an interactive 3D axon tracking and labeling tool is built to obtain quantitative information by reconstruction of the axonal structures in the entire innervation field. The ease of use along with accuracy of results makes AxonTracker-3D an attractive tool to obtain valuable quantitative information from axon datasets.

AVAILABILITY

The software is freely available for download at http://www.cbi-tmhs.org/AxonTracker/.

Neuron tracing in perspective

The study of the structure and function of neuronal cells and networks is of crucial importance in the endeavor to understand how the brain works. A key component in this process is the extraction of neuronal morphology from microscopic imaging data. In the past four decades, many computational methods and tools have been developed for digital reconstruction of neurons from images, with limited success. As witnessed by the growing body of literature on the subject, as well as the organization of challenging competitions in the field, the quest for a robust and fully automated system of more general applicability still continues. The aim of this work, is to contribute by surveying recent developments in the field for anyone interested in taking up the challenge. Relevant aspects discussed in the article include proposed image segmentation methods, quantitative measures of neuronal morphology, currently available software tools for various related purposes, and morphology databases. (c) 2010 International Society for Advancement of Cytometry.

Ssecrett and NeuroTrace: interactive visualization and analysis tools for large-scale neuroscience data sets

Data sets imaged with modern electron microscopes can range from tens of terabytes to about one petabyte. Two new tools, Ssecrett and NeuroTrace, support interactive exploration and analysis of large-scale optical-and electron-microscopy images to help scientists reconstruct complex neural circuits of the mammalian nervous system.

On optical detection of densely labeled synapses in neuropil and mapping connectivity with combinatorially multiplexed fluorescent synaptic markers

We propose a new method for mapping neural connectivity optically, by utilizing Cre/Lox system Brainbow to tag synapses of different neurons with random mixtures of different fluorophores, such as GFP, YFP, etc., and then detecting patterns of fluorophores at different synapses using light microscopy (LM). Such patterns will immediately report the pre- and post-synaptic cells at each synaptic connection, without tracing neural projections from individual synapses to corresponding cell bodies. We simulate fluorescence from a population of densely labeled synapses in a block of hippocampal neuropil, completely reconstructed from electron microscopy data, and show that high-end LM is able to detect such patterns with over 95% accuracy. We conclude, therefore, that with the described approach neural connectivity in macroscopically large neural circuits can be mapped with great accuracy, in scalable manner, using fast optical tools, and straightforward image processing. Relying on an electron microscopy dataset, we also derive and explicitly enumerate the conditions that should be met to allow synaptic connectivity studies with high-resolution optical tools.

Genetic and optical targeting of neural circuits and behavior--zebrafish in the spotlight

Methods to label neurons and to monitor their activity with genetically encoded fluorescent reporters have been a staple of neuroscience research for several years. The recent introduction of photoswitchable ion channels and pumps, such as channelrhodopsin (ChR2), halorhodopsin (NpHR), and light-gated glutamate receptor (LiGluR), is enabling remote optical manipulation of neuronal activity. The translucent brains of zebrafish offer superior experimental conditions for optogenetic approaches in vivo. Enhancer and gene trapping approaches have generated hundreds of Gal4 driver lines in which the expression of UAS-linked effectors can be targeted to subpopulations of neurons. Local photoactivation of genetically targeted LiGluR, ChR2, or NpHR has uncovered novel functions for specific areas and cell types in zebrafish behavior. Because the manipulation is restricted to times and places where genetics (cell types) and optics (beams of light) intersect, this method affords excellent resolving power for the functional analysis of neural circuitry.