Repulsive force based snake model to segment and track neuronal axons in 3D microscopy image stacks

Neuronal Population Reconstruction From Ultra-Scale Optical Microscopy Images via Progressive Learning

Reconstruction of neuronal populations from ultra-scale optical microscopy (OM) images is essential to investigate neuronal circuits and brain mechanisms. The noises, low contrast, huge memory requirement, and high computational cost pose significant challenges in the neuronal population reconstruction. Recently, many studies have been conducted to extract neuron signals using deep neural networks (DNNs). However, training such DNNs usually relies on a huge amount of voxel-wise annotations in OM images, which are expensive in terms of both finance and labor. In this paper, we propose a novel framework for dense neuronal population reconstruction from ultra-scale images. To solve the problem of high cost in obtaining manual annotations for training DNNs, we propose a progressive learning scheme for neuronal population reconstruction (PLNPR) which does not require any manual annotations. Our PLNPR scheme consists of a traditional neuron tracing module and a deep segmentation network that mutually complement and progressively promote each other. To reconstruct dense neuronal populations from a terabyte-sized ultra-scale image, we introduce an automatic framework which adaptively traces neurons block by block and fuses fragmented neurites in overlapped regions continuously and smoothly. We build a dataset "VISoR-40" which consists of 40 large-scale OM image blocks from cortical regions of a mouse. Extensive experimental results on our VISoR-40 dataset and the public BigNeuron dataset demonstrate the effectiveness and superiority of our method on neuronal population reconstruction and single neuron reconstruction. Furthermore, we successfully apply our method to reconstruct dense neuronal populations from an ultra-scale mouse brain slice. The proposed adaptive block propagation and fusion strategies greatly improve the completeness of neurites in dense neuronal population reconstruction.

Identifying Weak Signals in Inhomogeneous Neuronal Images for Large-Scale Tracing of Sparsely Distributed Neurites

Tracing neurites constitutes the core of neuronal morphology reconstruction, a key step toward neuronal circuit mapping. Modern optical-imaging techniques allow observation of nearly complete mouse neuron morphologies across brain regions or even the whole brain. However, high-level automation reconstruction of neurons, i.e., the reconstruction with a few of manual edits requires discrimination of weak foreground points from the inhomogeneous background. We constructed an identification model, where empirical observations made from neuronal images were summarized into rules for designing feature vectors that to classify foreground and background, and a support vector machine (SVM) was used to learn these feature vectors. We embedded this constructed SVM classifier into a previously developed tool, SparseTracer, to obtain SparseTracer-Learned Feature Vector (ST-LFV). ST-LFV can trace sparsely distributed neurites with weak signals (contrast-to-noise ratio < 1.5) against an inhomogeneous background in datasets imaged by widely used light-microscopy techniques like confocal microscopy and two-photon microscopy. Moreover, 12 sub-blocks were extracted from different brain regions. The average recall and precision rates were 99% and 97%, respectively. These results indicated that ST-LFV is well suited for weak signal identification with varying image characteristics. We also applied ST-LFV to trace long-range neurites from images where neurites are sparsely distributed but their image intensities are weak in some cases. When tracing this long-range neurites, manual edit was required once to obtain results equivalent to the ground truth, compared with 20 times of manual edits required by SparseTracer. This improvement in the level of automatic reconstruction indicates that ST-LFV has the potential to rapidly reconstruct sparsely distributed neurons at the large scale.

Automated neuron tracing using probability hypothesis density filtering

Motivation

The functionality of neurons and their role in neuronal networks is tightly connected to the cell morphology. A fundamental problem in many neurobiological studies aiming to unravel this connection is the digital reconstruction of neuronal cell morphology from microscopic image data. Many methods have been developed for this, but they are far from perfect, and better methods are needed.

Results

Here we present a new method for tracing neuron centerlines needed for full reconstruction. The method uses a fundamentally different approach than previous methods by considering neuron tracing as a Bayesian multi-object tracking problem. The problem is solved using probability hypothesis density filtering. Results of experiments on 2D and 3D fluorescence microscopy image datasets of real neurons indicate the proposed method performs comparably or even better than the state of the art.

Availability and Implementation

Software implementing the proposed neuron tracing method was written in the Java programming language as a plugin for the ImageJ platform. Source code is freely available for non-commercial use at https://bitbucket.org/miroslavradojevic/phd .

Contact

meijering@imagescience.org.

Supplementary information

Supplementary data are available at Bioinformatics online.

M-AMST: an automatic 3D neuron tracing method based on mean shift and adapted minimum spanning tree

BACKGROUND

Understanding the working mechanism of the brain is one of the grandest challenges for modern science. Toward this end, the BigNeuron project was launched to gather a worldwide community to establish a big data resource and a set of the state-of-the-art of single neuron reconstruction algorithms. Many groups contributed their own algorithms for the project, including our mean shift and minimum spanning tree (M-MST). Although M-MST is intuitive and easy to implement, the MST just considers spatial information of single neuron and ignores the shape information, which might lead to less precise connections between some neuron segments. In this paper, we propose an improved algorithm, namely M-AMST, in which a rotating sphere model based on coordinate transformation is used to improve the weight calculation method in M-MST.

RESULTS

Two experiments are designed to illustrate the effect of adapted minimum spanning tree algorithm and the adoptability of M-AMST in reconstructing variety of neuron image datasets respectively. In the experiment 1, taking the reconstruction of APP2 as reference, we produce the four difference scores (entire structure average (ESA), different structure average (DSA), percentage of different structure (PDS) and max distance of neurons' nodes (MDNN)) by comparing the neuron reconstruction of the APP2 and the other 5 competing algorithm. The result shows that M-AMST gets lower difference scores than M-MST in ESA, PDS and MDNN. Meanwhile, M-AMST is better than N-MST in ESA and MDNN. It indicates that utilizing the adapted minimum spanning tree algorithm which took the shape information of neuron into account can achieve better neuron reconstructions. In the experiment 2, 7 neuron image datasets are reconstructed and the four difference scores are calculated by comparing the gold standard reconstruction and the reconstructions produced by 6 competing algorithms. Comparing the four difference scores of M-AMST and the other 5 algorithm, we can conclude that M-AMST is able to achieve the best difference score in 3 datasets and get the second-best difference score in the other 2 datasets.

CONCLUSIONS

We develop a pathway extraction method using a rotating sphere model based on coordinate transformation to improve the weight calculation approach in MST. The experimental results show that M-AMST utilizes the adapted minimum spanning tree algorithm which takes the shape information of neuron into account can achieve better neuron reconstructions. Moreover, M-AMST is able to get good neuron reconstruction in variety of image datasets.

Reconstructing Curvilinear Networks Using Path Classifiers and Integer Programming

We propose a novel approach to automated delineation of curvilinear structures that form complex and potentially loopy networks. By representing the image data as a graph of potential paths, we first show how to weight these paths using discriminatively-trained classifiers that are both robust and generic enough to be applied to very different imaging modalities. We then present an Integer Programming approach to finding the optimal subset of paths, subject to structural and topological constraints that eliminate implausible solutions. Unlike earlier approaches that assume a tree topology for the networks, ours explicitly models the fact that the networks may contain loops, and can reconstruct both cyclic and acyclic ones. We demonstrate the effectiveness of our approach on a variety of challenging datasets including aerial images of road networks and micrographs of neural arbors, and show that it outperforms state-of-the-art techniques.

An Automatic Learning-Based Framework for Robust Nucleus Segmentation

Computer-aided image analysis of histopathology specimens could potentially provide support for early detection and improved characterization of diseases such as brain tumor, pancreatic neuroendocrine tumor (NET), and breast cancer. Automated nucleus segmentation is a prerequisite for various quantitative analyses including automatic morphological feature computation. However, it remains to be a challenging problem due to the complex nature of histopathology images. In this paper, we propose a learning-based framework for robust and automatic nucleus segmentation with shape preservation. Given a nucleus image, it begins with a deep convolutional neural network (CNN) model to generate a probability map, on which an iterative region merging approach is performed for shape initializations. Next, a novel segmentation algorithm is exploited to separate individual nuclei combining a robust selection-based sparse shape model and a local repulsive deformable model. One of the significant benefits of the proposed framework is that it is applicable to different staining histopathology images. Due to the feature learning characteristic of the deep CNN and the high level shape prior modeling, the proposed method is general enough to perform well across multiple scenarios. We have tested the proposed algorithm on three large-scale pathology image datasets using a range of different tissue and stain preparations, and the comparative experiments with recent state of the arts demonstrate the superior performance of the proposed approach.

Robust Nucleus/Cell Detection and Segmentation in Digital Pathology and Microscopy Images: A Comprehensive Review

Digital pathology and microscopy image analysis is widely used for comprehensive studies of cell morphology or tissue structure. Manual assessment is labor intensive and prone to interobserver variations. Computer-aided methods, which can significantly improve the objectivity and reproducibility, have attracted a great deal of interest in recent literature. Among the pipeline of building a computer-aided diagnosis system, nucleus or cell detection and segmentation play a very important role to describe the molecular morphological information. In the past few decades, many efforts have been devoted to automated nucleus/cell detection and segmentation. In this review, we provide a comprehensive summary of the recent state-of-the-art nucleus/cell segmentation approaches on different types of microscopy images including bright-field, phase-contrast, differential interference contrast, fluorescence, and electron microscopies. In addition, we discuss the challenges for the current methods and the potential future work of nucleus/cell detection and segmentation.

High-throughput histopathological image analysis via robust cell segmentation and hashing

Computer-aided diagnosis of histopathological images usually requires to examine all cells for accurate diagnosis. Traditional computational methods may have efficiency issues when performing cell-level analysis. In this paper, we propose a robust and scalable solution to enable such analysis in a real-time fashion. Specifically, a robust segmentation method is developed to delineate cells accurately using Gaussian-based hierarchical voting and repulsive balloon model. A large-scale image retrieval approach is also designed to examine and classify each cell of a testing image by comparing it with a massive database, e.g., half-million cells extracted from the training dataset. We evaluate this proposed framework on a challenging and important clinical use case, i.e., differentiation of two types of lung cancers (the adenocarcinoma and squamous carcinoma), using thousands of lung microscopic tissue images extracted from hundreds of patients. Our method has achieved promising accuracy and running time by searching among half-million cells .

Neuron anatomy structure reconstruction based on a sliding filter

BACKGROUND

Reconstruction of neuron anatomy structure is a challenging and important task in neuroscience. However, few algorithms can automatically reconstruct the full structure well without manual assistance, making it essential to develop new methods for this task.

METHODS

This paper introduces a new pipeline for reconstructing neuron anatomy structure from 3-D microscopy image stacks. This pipeline is initialized with a set of seeds that were detected by our proposed Sliding Volume Filter (SVF), given a non-circular cross-section of a neuron cell. Then, an improved open curve snake model combined with a SVF external force is applied to trace the full skeleton of the neuron cell. A radius estimation method based on a 2D sliding band filter is developed to fit the real edge of the cross-section of the neuron cell. Finally, a surface reconstruction method based on non-parallel curve networks is used to generate the neuron cell surface to finish this pipeline.

RESULTS

The proposed pipeline has been evaluated using publicly available datasets. The results show that the proposed method achieves promising results in some datasets from the DIgital reconstruction of Axonal and DEndritic Morphology (DIADEM) challenge and new BigNeuron project.

CONCLUSION

The new pipeline works well in neuron tracing and reconstruction. It can achieve higher efficiency, stability and robustness in neuron skeleton tracing. Furthermore, the proposed radius estimation method and applied surface reconstruction method can obtain more accurate neuron anatomy structures.

UNSUPERVISED SHAPE PRIOR MODELING FOR CELL SEGMENTATION IN NEUROENDOCRINE TUMOR

Automated and accurate cell segmentation provides support for many quantitative analyses on digitized neuroendocrine tumor (NET) images. It is a challenging task due to complex variations of cell characteristics. In this paper, we incorporate unsupervised shape priors into an efficient repulsive deformable model for automated cell segmentation on NET images. Unlike other supervised learning based shape models, which usually require a large number of annotated data for training, the proposed algorithm is an unsupervised approach that applies group similarity to shape constraints to avoid any labor intensive annotation. The algorithm is extensively tested on 51 NET images, and the comparative experiments with the state of the arts demonstrate the superior performance of this method using an unsupervised shape model.

Image segmentation for integrated multiphoton microscopy and reflectance confocal microscopy imaging of human skin in vivo

BACKGROUND

Non-invasive cellular imaging of the skin in vivo can be achieved in reflectance confocal microscopy (RCM) and multiphoton microscopy (MPM) modalities to yield complementary images of the skin based on different optical properties. One of the challenges of in vivo microscopy is the delineation (i.e., segmentation) of cellular and subcellular architectural features.

METHODS

In this work we present a method for combining watershed and level-set models for segmentation of multimodality images obtained by an integrated MPM and RCM imaging system from human skin in vivo.

RESULTS

Firstly, a segmentation model based on watershed is introduced for obtaining the accurate structure of cell borders from the RCM image. Secondly,, a global region based energy level-set model is constructed for extracting the nucleus of each cell from the MPM image. Thirdly, a local region-based Lagrange Continuous level-set approach is used for segmenting cytoplasm from the MPM image.

CONCLUSIONS

Experimental results demonstrated that cell borders from RCM image and boundaries of cytoplasm and nucleus from MPM image can be obtained by our segmentation method with better accuracy and effectiveness. We are planning to use this method to perform quantitative analysis of MPM and RCM images of in vivo human skin to study the variations of cellular parameters such as cell size, nucleus size and other mophormetric features with skin pathologies.

A pipeline for neuron reconstruction based on spatial sliding volume filter seeding

Neuron's shape and dendritic architecture are important for biosignal transduction in neuron networks. And the anatomy architecture reconstruction of neuron cell is one of the foremost challenges and important issues in neuroscience. Accurate reconstruction results can facilitate the subsequent neuron system simulation. With the development of confocal microscopy technology, researchers can scan neurons at submicron resolution for experiments. These make the reconstruction of complex dendritic trees become more feasible; however, it is still a tedious, time consuming, and labor intensity task. For decades, computer aided methods have been playing an important role in this task, but none of the prevalent algorithms can reconstruct full anatomy structure automatically. All of these make it essential for developing new method for reconstruction. This paper proposes a pipeline with a novel seeding method for reconstructing neuron structures from 3D microscopy images stacks. The pipeline is initialized with a set of seeds detected by sliding volume filter (SVF), and then the open curve snake is applied to the detected seeds for reconstructing the full structure of neuron cells. The experimental results demonstrate that the proposed pipeline exhibits excellent performance in terms of accuracy compared with traditional method, which is clearly a benefit for 3D neuron detection and reconstruction.

Rapid reconstruction of 3D neuronal morphology from light microscopy images with augmented rayburst sampling

Digital reconstruction of three-dimensional (3D) neuronal morphology from light microscopy images provides a powerful technique for analysis of neural circuits. It is time-consuming to manually perform this process. Thus, efficient computer-assisted approaches are preferable. In this paper, we present an innovative method for the tracing and reconstruction of 3D neuronal morphology from light microscopy images. The method uses a prediction and refinement strategy that is based on exploration of local neuron structural features. We extended the rayburst sampling algorithm to a marching fashion, which starts from a single or a few seed points and marches recursively forward along neurite branches to trace and reconstruct the whole tree-like structure. A local radius-related but size-independent hemispherical sampling was used to predict the neurite centerline and detect branches. Iterative rayburst sampling was performed in the orthogonal plane, to refine the centerline location and to estimate the local radius. We implemented the method in a cooperative 3D interactive visualization-assisted system named flNeuronTool. The source code in C++ and the binaries are freely available at http://sourceforge.net/projects/flneurontool/. We validated and evaluated the proposed method using synthetic data and real datasets from the Digital Reconstruction of Axonal and Dendritic Morphology (DIADEM) challenge. Then, flNeuronTool was applied to mouse brain images acquired with the Micro-Optical Sectioning Tomography (MOST) system, to reconstruct single neurons and local neural circuits. The results showed that the system achieves a reasonable balance between fast speed and acceptable accuracy, which is promising for interactive applications in neuronal image analysis.

A novel approach to segment and classify regional lymph nodes on computed tomography images

Morphology of lymph nodal metastasis is critical for diagnosis and prognosis of cancer patients. However, accurate prediction of lymph node type based on morphological information is rarely available due to lack of pathological validation. To obtain correct morphological information, lymph nodes must be segmented from computed tomography (CT) image accurately. In this paper we described a novel approach to segment and predict the status of lymph nodes from CT images and confirmed the diagnostic performance by clinical pathological results. We firstly removed noise and preserved edge details using a revised nonlinear diffusion equation, and secondly we used a repulsive-force-based snake method to segment the lymph nodes. Morphological measurements for the characterization of the node status were obtained from the segmented node image. These measurements were further selected to derive a highly representative set of node status, called feature vector. Finally, classical classification scheme based on support vector machine model was employed to simulate the prediction of nodal status. Experiments on real clinical rectal cancer data showed that the prediction performance with the proposed framework is highly consistent with pathological results. Therefore, this novel algorithm is promising for status prediction of lymph nodes.

Principal curves as skeletons of tubular objects: locally characterizing the structures of axons

Developments in image acquisition technology make high volumes of neuron images available to neuroscientists for analysis. However, manual processing of these images is not practical and is infeasible for larger and larger scale studies. Reliable interpretation and analysis of high volume data requires accurate quantitative measures. This requires analysis algorithms to use mathematical models that inherit the underlying geometry of biological structures in order to extract topological information. In this paper, we first introduce principal curves as a model for the underlying skeleton of axons and branches, then describe a recursive principal curve tracing (RPCT) method to extract this topology information from 3D microscopy imagery. RPCT first finds samples on the one dimensional principal set of the intensity function in space. Then, given an initial direction and location, the algorithm iteratively traces the principal curve in space using our principal curve tracing (PCT) method. Recursive implementation of PCT provides a compact solution for extracting complex tubular structures that exhibit bifurcations.

Neuronal tracing for connectomic studies

Reconstruction of the complete wiring diagram, or connectome, of a neural circuit provides an alternative approach to conventional circuit analysis. One major obstacle of connectomics lies in segmenting and tracing neuronal processes from the vast number of images obtained with optical or electron microscopy. Here I review recent progress in automated tracing algorithms for connectomic reconstruction with fluorescence and electron microscopy, and discuss the challenges to image analysis posed by novel optical imaging techniques.

Automated reconstruction of dendritic and axonal trees by global optimization with geometric priors

We present a novel probabilistic approach to fully automated delineation of tree structures in noisy 2D images and 3D image stacks. Unlike earlier methods that rely mostly on local evidence, ours builds a set of candidate trees over many different subsets of points likely to belong to the optimal tree and then chooses the best one according to a global objective function that combines image evidence with geometric priors. Since the best tree does not necessarily span all the points, the algorithm is able to eliminate false detections while retaining the correct tree topology. Manually annotated brightfield micrographs, retinal scans and the DIADEM challenge datasets are used to evaluate the performance of our method. We used the DIADEM metric to quantitatively evaluate the topological accuracy of the reconstructions and showed that the use of the geometric regularization yields a substantial improvement.

A broadly applicable 3-D neuron tracing method based on open-curve snake

This paper presents a broadly applicable algorithm and a comprehensive open-source software implementation for automated tracing of neuronal structures in 3-D microscopy images. The core 3-D neuron tracing algorithm is based on three-dimensional (3-D) open-curve active Contour (Snake). It is initiated from a set of automatically detected seed points. Its evolution is driven by a combination of deforming forces based on the Gradient Vector Flow (GVF), stretching forces based on estimation of the fiber orientations, and a set of control rules. In this tracing model, bifurcation points are detected implicitly as points where multiple snakes collide. A boundariness measure is employed to allow local radius estimation. A suite of pre-processing algorithms enable the system to accommodate diverse neuronal image datasets by reducing them to a common image format. The above algorithms form the basis for a comprehensive, scalable, and efficient software system developed for confocal or brightfield images. It provides multiple automated tracing modes. The user can optionally interact with the tracing system using multiple view visualization, and exercise full control to ensure a high quality reconstruction. We illustrate the utility of this tracing system by presenting results from a synthetic dataset, a brightfield dataset and two confocal datasets from the DIADEM challenge.

Reconstruction of the neuromuscular junction connectome

MOTIVATION

Unraveling the structure and behavior of the brain and central nervous system (CNS) has always been a major goal of neuroscience. Understanding the wiring diagrams of the neuromuscular junction connectomes (full connectivity of nervous system neuronal components) is a starting point for this, as it helps in the study of the organizational and developmental properties of the mammalian CNS. The phenomenon of synapse elimination during developmental stages of the neuronal circuitry is such an example. Due to the organizational specificity of the axons in the connectomes, it becomes important to label and extract individual axons for morphological analysis. Features such as axonal trajectories, their branching patterns, geometric information, the spatial relations of groups of axons, etc. are of great interests for neurobiologists in the study of wiring diagrams. However, due to the complexity of spatial structure of the axons, automatically tracking and reconstructing them from microscopy images in 3D is an unresolved problem. In this article, AxonTracker-3D, an interactive 3D axon tracking and labeling tool is built to obtain quantitative information by reconstruction of the axonal structures in the entire innervation field. The ease of use along with accuracy of results makes AxonTracker-3D an attractive tool to obtain valuable quantitative information from axon datasets.

AVAILABILITY

The software is freely available for download at http://www.cbi-tmhs.org/AxonTracker/.

Neuron tracing in perspective

The study of the structure and function of neuronal cells and networks is of crucial importance in the endeavor to understand how the brain works. A key component in this process is the extraction of neuronal morphology from microscopic imaging data. In the past four decades, many computational methods and tools have been developed for digital reconstruction of neurons from images, with limited success. As witnessed by the growing body of literature on the subject, as well as the organization of challenging competitions in the field, the quest for a robust and fully automated system of more general applicability still continues. The aim of this work, is to contribute by surveying recent developments in the field for anyone interested in taking up the challenge. Relevant aspects discussed in the article include proposed image segmentation methods, quantitative measures of neuronal morphology, currently available software tools for various related purposes, and morphology databases. (c) 2010 International Society for Advancement of Cytometry.

MDL constrained 3-D grayscale skeletonization algorithm for automated extraction of dendrites and spines from fluorescence confocal images

This paper presents a method for improved automatic delineation of dendrites and spines from three-dimensional (3-D) images of neurons acquired by confocal or multi-photon fluorescence microscopy. The core advance presented here is a direct grayscale skeletonization algorithm that is constrained by a structural complexity penalty using the minimum description length (MDL) principle, and additional neuroanatomy-specific constraints. The 3-D skeleton is extracted directly from the grayscale image data, avoiding errors introduced by image binarization. The MDL method achieves a practical tradeoff between the complexity of the skeleton and its coverage of the fluorescence signal. Additional advances include the use of 3-D spline smoothing of dendrites to improve spine detection, and graph-theoretic algorithms to explore and extract the dendritic structure from the grayscale skeleton using an intensity-weighted minimum spanning tree (IW-MST) algorithm. This algorithm was evaluated on 30 datasets organized in 8 groups from multiple laboratories. Spines were detected with false negative rates less than 10% on most datasets (the average is 7.1%), and the average false positive rate was 11.8%. The software is available in open source form.

Semi-automated reconstruction of neural processes from large numbers of fluorescence images

We introduce a method for large scale reconstruction of complex bundles of neural processes from fluorescent image stacks. We imaged yellow fluorescent protein labeled axons that innervated a whole muscle, as well as dendrites in cerebral cortex, in transgenic mice, at the diffraction limit with a confocal microscope. Each image stack was digitally re-sampled along an orientation such that the majority of axons appeared in cross-section. A region growing algorithm was implemented in the open-source Reconstruct software and applied to the semi-automatic tracing of individual axons in three dimensions. The progression of region growing is constrained by user-specified criteria based on pixel values and object sizes, and the user has full control over the segmentation process. A full montage of reconstructed axons was assembled from the approximately 200 individually reconstructed stacks. Average reconstruction speed is approximately 0.5 mm per hour. We found an error rate in the automatic tracing mode of approximately 1 error per 250 um of axonal length. We demonstrated the capacity of the program by reconstructing the connectome of motor axons in a small mouse muscle.

3D structural imaging of the brain with photons and electrons

Recent technological developments have renewed the interest in large-scale neural circuit reconstruction. To resolve the structure of entire circuits, thousands of neurons must be reconstructed and their synapses identified. Reconstruction techniques at the light microscopic level are capable of following sparsely labeled neurites over long distances, but fail with densely labeled neuropil. Electron microscopy provides the resolution required to resolve densely stained neuropil, but is challenged when data for volumes large enough to contain complete circuits need to be collected. Both photon-based and electron-based imaging methods will ultimately need highly automated data analysis, because the manual tracing of most networks of interest would require hundreds to tens of thousands of years in human labor.

3D Axon structure extraction and analysis in confocal fluorescence microscopy images

The morphological properties of axons, such as their branching patterns and oriented structures, are of great interest for biologists in the study of the synaptic connectivity of neurons. In these studies, researchers use triple immunofluorescent confocal microscopy to record morphological changes of neuronal processes. Three-dimensional (3D) microscopy image analysis is then required to extract morphological features of the neuronal structures. In this article, we propose a highly automated 3D centerline extraction tool to assist in this task. For this project, the most difficult part is that some axons are overlapping such that the boundaries distinguishing them are barely visible. Our approach combines a 3D dynamic programming (DP) technique and marker-controlled watershed algorithm to solve this problem. The approach consists of tracking and updating along the navigation directions of multiple axons simultaneously. The experimental results show that the proposed method can rapidly and accurately extract multiple axon centerlines and can handle complicated axon structures such as cross-over sections and overlapping objects.

Bioimage informatics: a new area of engineering biology

In recent years, the deluge of complicated molecular and cellular microscopic images creates compelling challenges for the image computing community. There has been an increasing focus on developing novel image processing, data mining, database and visualization techniques to extract, compare, search and manage the biological knowledge in these data-intensive problems. This emerging new area of bioinformatics can be called ‘bioimage informatics’. This article reviews the advances of this field from several aspects, including applications, key techniques, available tools and resources. Application examples such as high-throughput/high-content phenotyping and atlas building for model organisms demonstrate the importance of bioimage informatics. The essential techniques to the success of these applications, such as bioimage feature identification, segmentation and tracking, registration, annotation, mining, image data management and visualization, are further summarized, along with a brief overview of the available bioimage databases, analysis tools and other resources.

Contact:pengh@janelia.hhmi.org

Supplementary information:Supplementary data are available at Bioinformatics online.

AN OPTIMAL-PATH APPROACH FOR NEURAL CIRCUIT RECONSTRUCTION

Neurobiologists are collecting large amounts of electron microscopy image data to gain a better understanding of neuron organization in the central nervous system. Image analysis plays an important role in extracting the connectivity present in these images; however, due to the large size of these datasets, manual analysis is essentially impractical. Automated analysis, however, is challenging because of the difficulty in reliably segmenting individual neurons in 3D. In this paper, we describe an automatic method for finding neurons in sequences of 2D sections. The proposed method formulates the problem of finding paths through sets of sections as an optimal path computation, which applies a cost function to the identification of a cell from one section to the next and solves this optimization problem using Dijkstra's algorithm. This basic formulation allows us to account for variability or inconsistencies between sections and to prioritize cells based on the evidence of their connectivity.

Automated axon tracking of 3D confocal laser scanning microscopy images using guided probabilistic region merging

This paper presents a new algorithm for extracting the centerlines of the axons from a 3D data stack collected by a confocal laser scanning microscope. Recovery of neuronal structures from such datasets is critical for quantitatively addressing a range of neurobiological questions such as the manner in which the branching pattern of motor neurons change during synapse elimination. Unfortunately, the data acquired using fluorescence microscopy contains many imaging artifacts, such as blurry boundaries and non-uniform intensities of fluorescent radiation. This makes the centerline extraction difficult. We propose a robust segmentation method based on probabilistic region merging to extract the centerlines of individual axons with minimal user interaction. The 3D model of the extracted axon centerlines in three datasets is presented in this paper. The results are validated with the manual tracking results while the robustness of the algorithm is compared with the published repulsive snake algorithm.

Circuit reconstruction tools today

To understand how a brain processes information, we must understand the structure of its neural circuits-especially circuit interconnection topologies and the cell and synapse molecular architectures that determine circuit-signaling dynamics. Our information on these key aspects of neural circuit structure has remained incomplete and fragmentary, however, because of limitations of the best available imaging methods. Now, new transgenic tool mice and new image acquisition tools appear poised to permit very significant advances in our abilities to reconstruct circuit connection topologies and molecular architectures.