1
|
Vogel FW, Alipek S, Eppler JB, Osuna-Vargas P, Triesch J, Bissen D, Acker-Palmer A, Rumpel S, Kaschube M. Utilizing 2D-region-based CNNs for automatic dendritic spine detection in 3D live cell imaging. Sci Rep 2023; 13:20497. [PMID: 37993550 PMCID: PMC10665560 DOI: 10.1038/s41598-023-47070-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Accepted: 11/08/2023] [Indexed: 11/24/2023] Open
Abstract
Dendritic spines are considered a morphological proxy for excitatory synapses, rendering them a target of many different lines of research. Over recent years, it has become possible to simultaneously image large numbers of dendritic spines in 3D volumes of neural tissue. In contrast, currently no automated method for 3D spine detection exists that comes close to the detection performance reached by human experts. However, exploiting such datasets requires new tools for the fully automated detection and analysis of large numbers of spines. Here, we developed an efficient analysis pipeline to detect large numbers of dendritic spines in volumetric fluorescence imaging data acquired by two-photon imaging in vivo. The core of our pipeline is a deep convolutional neural network that was pretrained on a general-purpose image library and then optimized on the spine detection task. This transfer learning approach is data efficient while achieving a high detection precision. To train and validate the model we generated a labeled dataset using five human expert annotators to account for the variability in human spine detection. The pipeline enables fully automated dendritic spine detection reaching a performance slightly below that of the human experts. Our method for spine detection is fast, accurate and robust, and thus well suited for large-scale datasets with thousands of spines. The code is easily applicable to new datasets, achieving high detection performance, even without any retraining or adjustment of model parameters.
Collapse
Affiliation(s)
- Fabian W Vogel
- Frankfurt Institute for Advanced Studies and Department of Computer Science and Mathematics, Goethe University Frankfurt, Ruth-Moufang-Straße 1, 60438, Frankfurt am Main, Germany
| | - Sercan Alipek
- Frankfurt Institute for Advanced Studies and Department of Computer Science and Mathematics, Goethe University Frankfurt, Ruth-Moufang-Straße 1, 60438, Frankfurt am Main, Germany
| | - Jens-Bastian Eppler
- Frankfurt Institute for Advanced Studies and Department of Computer Science and Mathematics, Goethe University Frankfurt, Ruth-Moufang-Straße 1, 60438, Frankfurt am Main, Germany
| | - Pamela Osuna-Vargas
- Frankfurt Institute for Advanced Studies and Department of Computer Science and Mathematics, Goethe University Frankfurt, Ruth-Moufang-Straße 1, 60438, Frankfurt am Main, Germany
| | - Jochen Triesch
- Frankfurt Institute for Advanced Studies and Department of Computer Science and Mathematics, Goethe University Frankfurt, Ruth-Moufang-Straße 1, 60438, Frankfurt am Main, Germany
| | - Diane Bissen
- Institute for Cell Biology and Neuroscience, Goethe University Frankfurt, Max-von-Laue-Str. 15, 60438, Frankfurt am Main, Germany
| | - Amparo Acker-Palmer
- Institute for Cell Biology and Neuroscience, Goethe University Frankfurt, Max-von-Laue-Str. 15, 60438, Frankfurt am Main, Germany
| | - Simon Rumpel
- Institute of Physiology, FTN, University Medical Center, Johannes Gutenberg University Mainz, Hanns-Dieter-Hüsch-Weg 19, 55128, Mainz, Germany
| | - Matthias Kaschube
- Frankfurt Institute for Advanced Studies and Department of Computer Science and Mathematics, Goethe University Frankfurt, Ruth-Moufang-Straße 1, 60438, Frankfurt am Main, Germany.
| |
Collapse
|
2
|
Liu Y, Wang G, Ascoli GA, Zhou J, Liu L. Neuron tracing from light microscopy images: automation, deep learning and bench testing. Bioinformatics 2022; 38:5329-5339. [PMID: 36303315 PMCID: PMC9750132 DOI: 10.1093/bioinformatics/btac712] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 10/19/2022] [Accepted: 10/26/2022] [Indexed: 12/24/2022] Open
Abstract
MOTIVATION Large-scale neuronal morphologies are essential to neuronal typing, connectivity characterization and brain modeling. It is widely accepted that automation is critical to the production of neuronal morphology. Despite previous survey papers about neuron tracing from light microscopy data in the last decade, thanks to the rapid development of the field, there is a need to update recent progress in a review focusing on new methods and remarkable applications. RESULTS This review outlines neuron tracing in various scenarios with the goal to help the community understand and navigate tools and resources. We describe the status, examples and accessibility of automatic neuron tracing. We survey recent advances of the increasingly popular deep-learning enhanced methods. We highlight the semi-automatic methods for single neuron tracing of mammalian whole brains as well as the resulting datasets, each containing thousands of full neuron morphologies. Finally, we exemplify the commonly used datasets and metrics for neuron tracing bench testing.
Collapse
Affiliation(s)
- Yufeng Liu
- School of Biological Science and Medical Engineering, Southeast University, Nanjing, China
| | - Gaoyu Wang
- School of Computer Science and Engineering, Southeast University, Nanjing, China
| | - Giorgio A Ascoli
- Center for Neural Informatics, Structures, & Plasticity, Krasnow Institute for Advanced Study, George Mason University, Fairfax, VA, USA
| | - Jiangning Zhou
- Institute of Brain Science, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Lijuan Liu
- School of Biological Science and Medical Engineering, Southeast University, Nanjing, China
| |
Collapse
|
3
|
Guo S, Xue J, Liu J, Ye X, Guo Y, Liu D, Zhao X, Xiong F, Han X, Peng H. Smart imaging to empower brain-wide neuroscience at single-cell levels. Brain Inform 2022; 9:10. [PMID: 35543774 PMCID: PMC9095808 DOI: 10.1186/s40708-022-00158-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2021] [Accepted: 04/12/2022] [Indexed: 11/10/2022] Open
Abstract
A deep understanding of the neuronal connectivity and networks with detailed cell typing across brain regions is necessary to unravel the mechanisms behind the emotional and memorial functions as well as to find the treatment of brain impairment. Brain-wide imaging with single-cell resolution provides unique advantages to access morphological features of a neuron and to investigate the connectivity of neuron networks, which has led to exciting discoveries over the past years based on animal models, such as rodents. Nonetheless, high-throughput systems are in urgent demand to support studies of neural morphologies at larger scale and more detailed level, as well as to enable research on non-human primates (NHP) and human brains. The advances in artificial intelligence (AI) and computational resources bring great opportunity to 'smart' imaging systems, i.e., to automate, speed up, optimize and upgrade the imaging systems with AI and computational strategies. In this light, we review the important computational techniques that can support smart systems in brain-wide imaging at single-cell resolution.
Collapse
Affiliation(s)
- Shuxia Guo
- Institute for Brain and Intelligence, Southeast University, Nanjing, 210096, Jiangsu, China.
| | - Jie Xue
- Institute for Brain and Intelligence, Southeast University, Nanjing, 210096, Jiangsu, China
| | - Jian Liu
- Institute for Brain and Intelligence, Southeast University, Nanjing, 210096, Jiangsu, China
| | - Xiangqiao Ye
- Institute for Brain and Intelligence, Southeast University, Nanjing, 210096, Jiangsu, China
| | - Yichen Guo
- Institute for Brain and Intelligence, Southeast University, Nanjing, 210096, Jiangsu, China
| | - Di Liu
- Institute for Brain and Intelligence, Southeast University, Nanjing, 210096, Jiangsu, China
| | - Xuan Zhao
- Institute for Brain and Intelligence, Southeast University, Nanjing, 210096, Jiangsu, China
| | - Feng Xiong
- Institute for Brain and Intelligence, Southeast University, Nanjing, 210096, Jiangsu, China
| | - Xiaofeng Han
- Institute for Brain and Intelligence, Southeast University, Nanjing, 210096, Jiangsu, China.
| | - Hanchuan Peng
- Institute for Brain and Intelligence, Southeast University, Nanjing, 210096, Jiangsu, China
| |
Collapse
|
4
|
Liu S, Huang Q, Quan T, Zeng S, Li H. Foreground Estimation in Neuronal Images With a Sparse-Smooth Model for Robust Quantification. Front Neuroanat 2021; 15:716718. [PMID: 34764857 PMCID: PMC8576439 DOI: 10.3389/fnana.2021.716718] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2021] [Accepted: 10/04/2021] [Indexed: 11/13/2022] Open
Abstract
3D volume imaging has been regarded as a basic tool to explore the organization and function of the neuronal system. Foreground estimation from neuronal image is essential in the quantification and analysis of neuronal image such as soma counting, neurite tracing and neuron reconstruction. However, the complexity of neuronal structure itself and differences in the imaging procedure, including different optical systems and biological labeling methods, result in various and complex neuronal images, which greatly challenge foreground estimation from neuronal image. In this study, we propose a robust sparse-smooth model (RSSM) to separate the foreground and the background of neuronal image. The model combines the different smoothness levels of the foreground and the background, and the sparsity of the foreground. These prior constraints together contribute to the robustness of foreground estimation from a variety of neuronal images. We demonstrate the proposed RSSM method could promote some best available tools to trace neurites or locate somas from neuronal images with their default parameters, and the quantified results are similar or superior to the results that generated from the original images. The proposed method is proved to be robust in the foreground estimation from different neuronal images, and helps to improve the usability of current quantitative tools on various neuronal images with several applications.
Collapse
Affiliation(s)
- Shijie Liu
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.,MoE Key Laboratory for Biomedical Photonics, Collaborative Innovation Center for Biomedical Engineering, School of Engineering Sciences, Huazhong University of Science and Technology, Wuhan, China
| | - Qing Huang
- School of Computer Science and Engineering/Artificial Intelligence, Hubei Key Laboratory of Intelligent Robot, Wuhan Institute of Technology, Wuhan, China
| | - Tingwei Quan
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.,MoE Key Laboratory for Biomedical Photonics, Collaborative Innovation Center for Biomedical Engineering, School of Engineering Sciences, Huazhong University of Science and Technology, Wuhan, China
| | - Shaoqun Zeng
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.,MoE Key Laboratory for Biomedical Photonics, Collaborative Innovation Center for Biomedical Engineering, School of Engineering Sciences, Huazhong University of Science and Technology, Wuhan, China
| | - Hongwei Li
- School of Mathematics and Physics, China University of Geosciences, Wuhan, China
| |
Collapse
|
5
|
Radojević M, Meijering E. Automated Neuron Reconstruction from 3D Fluorescence Microscopy Images Using Sequential Monte Carlo Estimation. Neuroinformatics 2020; 17:423-442. [PMID: 30542954 PMCID: PMC6594993 DOI: 10.1007/s12021-018-9407-8] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Microscopic images of neuronal cells provide essential structural information about the key constituents of the brain and form the basis of many neuroscientific studies. Computational analyses of the morphological properties of the captured neurons require first converting the structural information into digital tree-like reconstructions. Many dedicated computational methods and corresponding software tools have been and are continuously being developed with the aim to automate this step while achieving human-comparable reconstruction accuracy. This pursuit is hampered by the immense diversity and intricacy of neuronal morphologies as well as the often low quality and ambiguity of the images. Here we present a novel method we developed in an effort to improve the robustness of digital reconstruction against these complicating factors. The method is based on probabilistic filtering by sequential Monte Carlo estimation and uses prediction and update models designed specifically for tracing neuronal branches in microscopic image stacks. Moreover, it uses multiple probabilistic traces to arrive at a more robust, ensemble reconstruction. The proposed method was evaluated on fluorescence microscopy image stacks of single neurons and dense neuronal networks with expert manual annotations serving as the gold standard, as well as on synthetic images with known ground truth. The results indicate that our method performs well under varying experimental conditions and compares favorably to state-of-the-art alternative methods.
Collapse
Affiliation(s)
- Miroslav Radojević
- Biomedical Imaging Group Rotterdam, Departments of Medical Informatics and Radiology, Erasmus University Medical Center, Rotterdam, The Netherlands.
| | - Erik Meijering
- Biomedical Imaging Group Rotterdam, Departments of Medical Informatics and Radiology, Erasmus University Medical Center, Rotterdam, The Netherlands
| |
Collapse
|
6
|
Xiao X, Djurisic M, Hoogi A, Sapp RW, Shatz CJ, Rubin DL. Automated dendritic spine detection using convolutional neural networks on maximum intensity projected microscopic volumes. J Neurosci Methods 2018; 309:25-34. [PMID: 30130608 PMCID: PMC6402488 DOI: 10.1016/j.jneumeth.2018.08.019] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2018] [Revised: 08/16/2018] [Accepted: 08/16/2018] [Indexed: 11/25/2022]
Abstract
BACKGROUND Dendritic spines are structural correlates of excitatory synapses in the brain. Their density and structure are shaped by experience, pointing to their role in memory encoding. Dendritic spine imaging, followed by manual analysis, is a primary way to study spines. However, an approach that analyses dendritic spines images in an automated and unbiased manner is needed to fully capture how spines change with normal experience, as well as in disease. NEW METHOD We propose an approach based on fully convolutional neural networks (FCNs) to detect dendritic spines in two-dimensional maximum-intensity projected images from confocal fluorescent micrographs. We experiment on both fractionally strided convolution and efficient sub-pixel convolutions. Dendritic spines far from the dendritic shaft are pruned by extraction of the shaft to reduce false positives. Performance of the proposed method is evaluated by comparing predicted spine positions to those manually marked by experts. RESULTS The averaged distance between predicted and manually annotated spines is 2.81 ± 2.63 pixels (0.082 ± 0.076 microns) and 2.87 ± 2.33 pixels (0.084 ± 0.068 microns) based on two different experts. FCN-based detection achieves F scores > 0.80 for both sets of expert annotations. COMPARISON WITH EXISTING METHODS Our method significantly outperforms two well-known software, NeuronStudio and Neurolucida (p-value < 0.02). CONCLUSIONS FCN architectures used in this work allow for automated dendritic spine detection. Superior outcomes are possible even with small training data-sets. The proposed method may generalize to other datasets on larger scales.
Collapse
Affiliation(s)
- Xuerong Xiao
- Department of Electrical Engineering, Stanford University, David Packard Building, 350 Serra Mall, Stanford, CA 94305, USA.
| | - Maja Djurisic
- Departments of Biology and Neurobiology, and Bio-X, Stanford University, James H. Clark Center, 318 Campus Dr, Stanford, CA 94305, USA
| | - Assaf Hoogi
- Department of Biomedical Data Science, Stanford University, Medical School Office Building, 1265 Welch Rd, Stanford, CA 94305, USA
| | - Richard W Sapp
- Departments of Biology and Neurobiology, and Bio-X, Stanford University, James H. Clark Center, 318 Campus Dr, Stanford, CA 94305, USA
| | - Carla J Shatz
- Departments of Biology and Neurobiology, and Bio-X, Stanford University, James H. Clark Center, 318 Campus Dr, Stanford, CA 94305, USA
| | - Daniel L Rubin
- Department of Biomedical Data Science, Stanford University, Medical School Office Building, 1265 Welch Rd, Stanford, CA 94305, USA
| |
Collapse
|
7
|
Kayasandik C, Negi P, Laezza F, Papadakis M, Labate D. Automated sorting of neuronal trees in fluorescent images of neuronal networks using NeuroTreeTracer. Sci Rep 2018; 8:6450. [PMID: 29691458 PMCID: PMC5915526 DOI: 10.1038/s41598-018-24753-w] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2017] [Accepted: 04/10/2018] [Indexed: 11/09/2022] Open
Abstract
Fluorescence confocal microscopy has become increasingly more important in neuroscience due to its applications in image-based screening and profiling of neurons. Multispectral confocal imaging is useful to simultaneously probe for distribution of multiple analytes over networks of neurons. However, current automated image analysis algorithms are not designed to extract single-neuron arbors in images where neurons are not separated, hampering the ability map fluorescence signals at the single cell level. To overcome this limitation, we introduce NeuroTreeTracer - a novel image processing framework aimed at automatically extracting and sorting single-neuron traces in fluorescent images of multicellular neuronal networks. This method applies directional multiscale filters for automated segmentation of neurons and soma detection, and includes a novel tracing routine that sorts neuronal trees in the image by resolving network connectivity even when neurites appear to intersect. By extracting each neuronal tree, NeuroTreetracer enables to automatically quantify the spatial distribution of analytes of interest in the subcellular compartments of individual neurons. This software is released open-source and freely available with the goal to facilitate applications in neuron screening and profiling.
Collapse
Affiliation(s)
- Cihan Kayasandik
- University of Houston, Department of Mathematics, Houston, Texas, United States of America
| | - Pooran Negi
- University of Houston, Department of Mathematics, Houston, Texas, United States of America
| | - Fernanda Laezza
- University of Texas Medical Branch, Department of Pharmacology and Toxicology, Galveston, Texas, United States of America
| | - Manos Papadakis
- University of Houston, Department of Mathematics, Houston, Texas, United States of America
| | - Demetrio Labate
- University of Houston, Department of Mathematics, Houston, Texas, United States of America.
| |
Collapse
|
8
|
Abstract
Digital reconstruction of a single neuron occupies an important position in computational neuroscience. Although many novel methods have been proposed, recent advances in molecular labeling and imaging systems allow for the production of large and complicated neuronal datasets, which pose many challenges for neuron reconstruction, especially when discontinuous neuronal morphology appears in a strong noise environment. Here, we develop a new pipeline to address this challenge. Our pipeline is based on two methods, one is the region-to-region connection (RRC) method for detecting the initial part of a neurite, which can effectively gather local cues, i.e., avoid the whole image analysis, and thus boosts the efficacy of computation; the other is constrained principal curves method for completing the neurite reconstruction, which uses the past reconstruction information of a neurite for current reconstruction and thus can be suitable for tracing discontinuous neurites. We investigate the reconstruction performances of our pipeline and some of the best state-of-the-art algorithms on the experimental datasets, indicating the superiority of our method in reconstructing sparsely distributed neurons with discontinuous neuronal morphologies in noisy environment. We show the strong ability of our pipeline in dealing with the large-scale image dataset. We validate the effectiveness in dealing with various kinds of image stacks including those from the DIADEM challenge and BigNeuron project.
Collapse
|
9
|
Nunez-Iglesias J, Blanch AJ, Looker O, Dixon MW, Tilley L. A new Python library to analyse skeleton images confirms malaria parasite remodelling of the red blood cell membrane skeleton. PeerJ 2018; 6:e4312. [PMID: 29472997 PMCID: PMC5816961 DOI: 10.7717/peerj.4312] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2017] [Accepted: 01/11/2018] [Indexed: 12/13/2022] Open
Abstract
We present Skan (Skeleton analysis), a Python library for the analysis of the skeleton structures of objects. It was inspired by the “analyse skeletons” plugin for the Fiji image analysis software, but its extensive Application Programming Interface (API) allows users to examine and manipulate any intermediate data structures produced during the analysis. Further, its use of common Python data structures such as SciPy sparse matrices and pandas data frames opens the results to analysis within the extensive ecosystem of scientific libraries available in Python. We demonstrate the validity of Skan’s measurements by comparing its output to the established Analyze Skeletons Fiji plugin, and, with a new scanning electron microscopy (SEM)-based method, we confirm that the malaria parasite Plasmodium falciparum remodels the host red blood cell cytoskeleton, increasing the average distance between spectrin-actin junctions.
Collapse
Affiliation(s)
| | - Adam J Blanch
- Department of Biochemistry and Molecular Biology, Bio21 Institute, University of Melbourne, Melbourne, Australia
| | - Oliver Looker
- Department of Biochemistry and Molecular Biology, Bio21 Institute, University of Melbourne, Melbourne, Australia
| | - Matthew W Dixon
- Department of Biochemistry and Molecular Biology, Bio21 Institute, University of Melbourne, Melbourne, Australia
| | - Leann Tilley
- Department of Biochemistry and Molecular Biology, Bio21 Institute, University of Melbourne, Melbourne, Australia
| |
Collapse
|
10
|
Abstract
The reconstruction of neuron morphology allows to investigate how the brain works, which is one of the foremost challenges in neuroscience. This process aims at extracting the neuronal structures from microscopic imaging data. The great advances in microscopic technologies have made a huge amount of data available at the micro-, or even lower, resolution where manual inspection is time consuming, prone to error and utterly impractical. This has motivated the development of methods to automatically trace the neuronal structures, a task also known as neuron tracing. This paper surveys the latest neuron tracing methods available in the scientific literature as well as a selection of significant older papers to better place these proposals into context. They are categorized into global processing, local processing and meta-algorithm approaches. Furthermore, we point out the algorithmic components used to design each method and we report information on the datasets and the performance metrics used.
Collapse
|
11
|
Liu S, Zhang D, Liu S, Feng D, Peng H, Cai W. Rivulet: 3D Neuron Morphology Tracing with Iterative Back-Tracking. Neuroinformatics 2018; 14:387-401. [PMID: 27184384 DOI: 10.1007/s12021-016-9302-0] [Citation(s) in RCA: 52] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
The digital reconstruction of single neurons from 3D confocal microscopic images is an important tool for understanding the neuron morphology and function. However the accurate automatic neuron reconstruction remains a challenging task due to the varying image quality and the complexity in the neuronal arborisation. Targeting the common challenges of neuron tracing, we propose a novel automatic 3D neuron reconstruction algorithm, named Rivulet, which is based on the multi-stencils fast-marching and iterative back-tracking. The proposed Rivulet algorithm is capable of tracing discontinuous areas without being interrupted by densely distributed noises. By evaluating the proposed pipeline with the data provided by the Diadem challenge and the recent BigNeuron project, Rivulet is shown to be robust to challenging microscopic imagestacks. We discussed the algorithm design in technical details regarding the relationships between the proposed algorithm and the other state-of-the-art neuron tracing algorithms.
Collapse
Affiliation(s)
- Siqi Liu
- School of Information Technologies, University of Sydney, Darlington, NSW, Australia.
| | - Donghao Zhang
- School of Information Technologies, University of Sydney, Darlington, NSW, Australia
| | - Sidong Liu
- School of Information Technologies, University of Sydney, Darlington, NSW, Australia
| | - Dagan Feng
- School of Information Technologies, University of Sydney, Darlington, NSW, Australia
| | | | - Weidong Cai
- School of Information Technologies, University of Sydney, Darlington, NSW, Australia.
| |
Collapse
|
12
|
Bass C, Helkkula P, De Paola V, Clopath C, Bharath AA. Detection of axonal synapses in 3D two-photon images. PLoS One 2017; 12:e0183309. [PMID: 28873436 PMCID: PMC5584757 DOI: 10.1371/journal.pone.0183309] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2017] [Accepted: 07/27/2017] [Indexed: 12/29/2022] Open
Abstract
Studies of structural plasticity in the brain often require the detection and analysis of axonal synapses (boutons). To date, bouton detection has been largely manual or semi-automated, relying on a step that traces the axons before detection the boutons. If tracing the axon fails, the accuracy of bouton detection is compromised. In this paper, we propose a new algorithm that does not require tracing the axon to detect axonal boutons in 3D two-photon images taken from the mouse cortex. To find the most appropriate techniques for this task, we compared several well-known algorithms for interest point detection and feature descriptor generation. The final algorithm proposed has the following main steps: (1) a Laplacian of Gaussian (LoG) based feature enhancement module to accentuate the appearance of boutons; (2) a Speeded Up Robust Features (SURF) interest point detector to find candidate locations for feature extraction; (3) non-maximum suppression to eliminate candidates that were detected more than once in the same local region; (4) generation of feature descriptors based on Gabor filters; (5) a Support Vector Machine (SVM) classifier, trained on features from labelled data, and was used to distinguish between bouton and non-bouton candidates. We found that our method achieved a Recall of 95%, Precision of 76%, and F1 score of 84% within a new dataset that we make available for accessing bouton detection. On average, Recall and F1 score were significantly better than the current state-of-the-art method, while Precision was not significantly different. In conclusion, in this article we demonstrate that our approach, which is independent of axon tracing, can detect boutons to a high level of accuracy, and improves on the detection performance of existing approaches. The data and code (with an easy to use GUI) used in this article are available from open source repositories.
Collapse
Affiliation(s)
- Cher Bass
- Centre for Neurotechnology, South Kensington Campus, Imperial College London, London, United Kingdom
- Department of Bioengineering, South Kensington Campus, Imperial College London, London, United Kingdom
- MRC Clinical Science Centre, Faculty of Medicine, Hammersmith Campus, Imperial College London, London, United Kingdom
- * E-mail:
| | - Pyry Helkkula
- Department of Bioengineering, South Kensington Campus, Imperial College London, London, United Kingdom
| | - Vincenzo De Paola
- MRC Clinical Science Centre, Faculty of Medicine, Hammersmith Campus, Imperial College London, London, United Kingdom
| | - Claudia Clopath
- Department of Bioengineering, South Kensington Campus, Imperial College London, London, United Kingdom
| | - Anil Anthony Bharath
- Department of Bioengineering, South Kensington Campus, Imperial College London, London, United Kingdom
| |
Collapse
|
13
|
Song J, Xiao L, Lian Z. Boundary-to-Marker Evidence-Controlled Segmentation and MDL-Based Contour Inference for Overlapping Nuclei. IEEE J Biomed Health Inform 2017; 21:451-464. [DOI: 10.1109/jbhi.2015.2504422] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
14
|
Fuzzy-Logic Based Detection and Characterization of Junctions and Terminations in Fluorescence Microscopy Images of Neurons. Neuroinformatics 2016; 14:201-19. [PMID: 26701809 PMCID: PMC4823367 DOI: 10.1007/s12021-015-9287-0] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023]
Abstract
Digital reconstruction of neuronal cell morphology is an important step toward understanding the functionality of neuronal networks. Neurons are tree-like structures whose description depends critically on the junctions and terminations, collectively called critical points, making the correct localization and identification of these points a crucial task in the reconstruction process. Here we present a fully automatic method for the integrated detection and characterization of both types of critical points in fluorescence microscopy images of neurons. In view of the majority of our current studies, which are based on cultured neurons, we describe and evaluate the method for application to two-dimensional (2D) images. The method relies on directional filtering and angular profile analysis to extract essential features about the main streamlines at any location in an image, and employs fuzzy logic with carefully designed rules to reason about the feature values in order to make well-informed decisions about the presence of a critical point and its type. Experiments on simulated as well as real images of neurons demonstrate the detection performance of our method. A comparison with the output of two existing neuron reconstruction methods reveals that our method achieves substantially higher detection rates and could provide beneficial information to the reconstruction process.
Collapse
|
15
|
Santamaría-Pang A, Hernandez-Herrera P, Papadakis M, Saggau P, Kakadiaris IA. Automatic Morphological Reconstruction of Neurons from Multiphoton and Confocal Microscopy Images Using 3D Tubular Models. Neuroinformatics 2016; 13:297-320. [PMID: 25631538 DOI: 10.1007/s12021-014-9253-2] [Citation(s) in RCA: 36] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
The challenges faced in analyzing optical imaging data from neurons include a low signal-to-noise ratio of the acquired images and the multiscale nature of the tubular structures that range in size from hundreds of microns to hundreds of nanometers. In this paper, we address these challenges and present a computational framework for an automatic, three-dimensional (3D) morphological reconstruction of live nerve cells. The key aspects of this approach are: (i) detection of neuronal dendrites through learning 3D tubular models, and (ii) skeletonization by a new algorithm using a morphology-guided deformable model for extracting the dendritic centerline. To represent the neuron morphology, we introduce a novel representation, the Minimum Shape-Cost (MSC) Tree that approximates the dendrite centerline with sub-voxel accuracy and demonstrate the uniqueness of such a shape representation as well as its computational efficiency. We present extensive quantitative and qualitative results that demonstrate the accuracy and robustness of our method.
Collapse
Affiliation(s)
- Alberto Santamaría-Pang
- Computational Biomedicine Lab, Department of Computer Science, University of Houston, Houston, TX, 77204, USA
| | | | | | | | | |
Collapse
|
16
|
Luo G, Sui D, Wang K, Chae J. Neuron anatomy structure reconstruction based on a sliding filter. BMC Bioinformatics 2015; 16:342. [PMID: 26498293 PMCID: PMC4619512 DOI: 10.1186/s12859-015-0780-0] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2015] [Accepted: 10/16/2015] [Indexed: 12/18/2022] Open
Abstract
BACKGROUND Reconstruction of neuron anatomy structure is a challenging and important task in neuroscience. However, few algorithms can automatically reconstruct the full structure well without manual assistance, making it essential to develop new methods for this task. METHODS This paper introduces a new pipeline for reconstructing neuron anatomy structure from 3-D microscopy image stacks. This pipeline is initialized with a set of seeds that were detected by our proposed Sliding Volume Filter (SVF), given a non-circular cross-section of a neuron cell. Then, an improved open curve snake model combined with a SVF external force is applied to trace the full skeleton of the neuron cell. A radius estimation method based on a 2D sliding band filter is developed to fit the real edge of the cross-section of the neuron cell. Finally, a surface reconstruction method based on non-parallel curve networks is used to generate the neuron cell surface to finish this pipeline. RESULTS The proposed pipeline has been evaluated using publicly available datasets. The results show that the proposed method achieves promising results in some datasets from the DIgital reconstruction of Axonal and DEndritic Morphology (DIADEM) challenge and new BigNeuron project. CONCLUSION The new pipeline works well in neuron tracing and reconstruction. It can achieve higher efficiency, stability and robustness in neuron skeleton tracing. Furthermore, the proposed radius estimation method and applied surface reconstruction method can obtain more accurate neuron anatomy structures.
Collapse
Affiliation(s)
- Gongning Luo
- Research Center of Perception and Computing, School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China.
| | - Dong Sui
- Research Center of Perception and Computing, School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China.
| | - Kuanquan Wang
- Research Center of Perception and Computing, School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China.
| | - Jinseok Chae
- Department of Computer Science and Engineering, Incheon National University, Incheon, Korea.
| |
Collapse
|
17
|
SOAX: a software for quantification of 3D biopolymer networks. Sci Rep 2015; 5:9081. [PMID: 25765313 PMCID: PMC4357869 DOI: 10.1038/srep09081] [Citation(s) in RCA: 61] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2014] [Accepted: 02/16/2015] [Indexed: 12/20/2022] Open
Abstract
Filamentous biopolymer networks in cells and tissues are routinely imaged by confocal microscopy. Image analysis methods enable quantitative study of the properties of these curvilinear networks. However, software tools to quantify the geometry and topology of these often dense 3D networks and to localize network junctions are scarce. To fill this gap, we developed a new software tool called “SOAX”, which can accurately extract the centerlines of 3D biopolymer networks and identify network junctions using Stretching Open Active Contours (SOACs). It provides an open-source, user-friendly platform for network centerline extraction, 2D/3D visualization, manual editing and quantitative analysis. We propose a method to quantify the performance of SOAX, which helps determine the optimal extraction parameter values. We quantify several different types of biopolymer networks to demonstrate SOAX's potential to help answer key questions in cell biology and biophysics from a quantitative viewpoint.
Collapse
|
18
|
Megjhani M, Rey-Villamizar N, Merouane A, Lu Y, Mukherjee A, Trett K, Chong P, Harris C, Shain W, Roysam B. Population-scale three-dimensional reconstruction and quantitative profiling of microglia arbors. ACTA ACUST UNITED AC 2015; 31:2190-8. [PMID: 25701570 DOI: 10.1093/bioinformatics/btv109] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2014] [Accepted: 02/16/2015] [Indexed: 11/14/2022]
Abstract
MOTIVATION The arbor morphologies of brain microglia are important indicators of cell activation. This article fills the need for accurate, robust, adaptive and scalable methods for reconstructing 3-D microglial arbors and quantitatively mapping microglia activation states over extended brain tissue regions. RESULTS Thick rat brain sections (100-300 µm) were multiplex immunolabeled for IBA1 and Hoechst, and imaged by step-and-image confocal microscopy with automated 3-D image mosaicing, producing seamless images of extended brain regions (e.g. 5903 × 9874 × 229 voxels). An over-complete dictionary-based model was learned for the image-specific local structure of microglial processes. The microglial arbors were reconstructed seamlessly using an automated and scalable algorithm that exploits microglia-specific constraints. This method detected 80.1 and 92.8% more centered arbor points, and 53.5 and 55.5% fewer spurious points than existing vesselness and LoG-based methods, respectively, and the traces were 13.1 and 15.5% more accurate based on the DIADEM metric. The arbor morphologies were quantified using Scorcioni's L-measure. Coifman's harmonic co-clustering revealed four morphologically distinct classes that concord with known microglia activation patterns. This enabled us to map spatial distributions of microglial activation and cell abundances. AVAILABILITY AND IMPLEMENTATION Experimental protocols, sample datasets, scalable open-source multi-threaded software implementation (C++, MATLAB) in the electronic supplement, and website (www.farsight-toolkit.org). http://www.farsight-toolkit.org/wiki/Population-scale_Three-dimensional_Reconstruction_and_Quanti-tative_Profiling_of_Microglia_Arbors CONTACT broysam@central.uh.edu SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Murad Megjhani
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA, Center for Integrative Brain Research, Seattle Children's Hospital, Seattle, WA 98101, USA and Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| | - Nicolas Rey-Villamizar
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA, Center for Integrative Brain Research, Seattle Children's Hospital, Seattle, WA 98101, USA and Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| | - Amine Merouane
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA, Center for Integrative Brain Research, Seattle Children's Hospital, Seattle, WA 98101, USA and Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| | - Yanbin Lu
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA, Center for Integrative Brain Research, Seattle Children's Hospital, Seattle, WA 98101, USA and Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| | - Amit Mukherjee
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA, Center for Integrative Brain Research, Seattle Children's Hospital, Seattle, WA 98101, USA and Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| | - Kristen Trett
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA, Center for Integrative Brain Research, Seattle Children's Hospital, Seattle, WA 98101, USA and Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| | - Peter Chong
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA, Center for Integrative Brain Research, Seattle Children's Hospital, Seattle, WA 98101, USA and Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| | - Carolyn Harris
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA, Center for Integrative Brain Research, Seattle Children's Hospital, Seattle, WA 98101, USA and Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| | - William Shain
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA, Center for Integrative Brain Research, Seattle Children's Hospital, Seattle, WA 98101, USA and Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| | - Badrinath Roysam
- Department of Electrical and Computer Engineering, University of Houston, Houston, TX, USA, Center for Integrative Brain Research, Seattle Children's Hospital, Seattle, WA 98101, USA and Cold Spring Harbor Laboratory, Cold Spring Harbor, NY 11724, USA
| |
Collapse
|
19
|
Usov I, Mezzenga R. FiberApp: An Open-Source Software for Tracking and Analyzing Polymers, Filaments, Biomacromolecules, and Fibrous Objects. Macromolecules 2015. [DOI: 10.1021/ma502264c] [Citation(s) in RCA: 189] [Impact Index Per Article: 21.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Affiliation(s)
- Ivan Usov
- Department of Health Science & Technology, ETH Zurich, Schmelzbergstrasse 9, LFO E23, 8092 Zurich, Switzerland
| | - Raffaele Mezzenga
- Department of Health Science & Technology, ETH Zurich, Schmelzbergstrasse 9, LFO E23, 8092 Zurich, Switzerland
| |
Collapse
|
20
|
Blumer C, Vivien C, Genoud C, Perez-Alvarez A, Wiegert JS, Vetter T, Oertner TG. Automated analysis of spine dynamics on live CA1 pyramidal cells. Med Image Anal 2015; 19:87-97. [DOI: 10.1016/j.media.2014.09.004] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2014] [Revised: 06/25/2014] [Accepted: 09/05/2014] [Indexed: 11/25/2022]
|
21
|
Jiménez D, Labate D, Kakadiaris IA, Papadakis M. Improved Automatic Centerline Tracing for Dendritic and Axonal Structures. Neuroinformatics 2014; 13:227-44. [DOI: 10.1007/s12021-014-9256-z] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
|
22
|
A pipeline for neuron reconstruction based on spatial sliding volume filter seeding. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2014; 2014:386974. [PMID: 25101141 PMCID: PMC4101938 DOI: 10.1155/2014/386974] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/08/2014] [Accepted: 06/16/2014] [Indexed: 11/17/2022]
Abstract
Neuron's shape and dendritic architecture are important for biosignal transduction in neuron networks. And the anatomy architecture reconstruction of neuron cell is one of the foremost challenges and important issues in neuroscience. Accurate reconstruction results can facilitate the subsequent neuron system simulation. With the development of confocal microscopy technology, researchers can scan neurons at submicron resolution for experiments. These make the reconstruction of complex dendritic trees become more feasible; however, it is still a tedious, time consuming, and labor intensity task. For decades, computer aided methods have been playing an important role in this task, but none of the prevalent algorithms can reconstruct full anatomy structure automatically. All of these make it essential for developing new method for reconstruction. This paper proposes a pipeline with a novel seeding method for reconstructing neuron structures from 3D microscopy images stacks. The pipeline is initialized with a set of seeds detected by sliding volume filter (SVF), and then the open curve snake is applied to the detected seeds for reconstructing the full structure of neuron cells. The experimental results demonstrate that the proposed pipeline exhibits excellent performance in terms of accuracy compared with traditional method, which is clearly a benefit for 3D neuron detection and reconstruction.
Collapse
|
23
|
Greenblum A, Sznitman R, Fua P, Arratia PE, Oren M, Podbilewicz B, Sznitman J. Dendritic tree extraction from noisy maximum intensity projection images in C. elegans. Biomed Eng Online 2014; 13:74. [PMID: 25012210 PMCID: PMC4090658 DOI: 10.1186/1475-925x-13-74] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2013] [Accepted: 05/27/2014] [Indexed: 11/25/2022] Open
Abstract
BACKGROUND Maximum Intensity Projections (MIP) of neuronal dendritic trees obtained from confocal microscopy are frequently used to study the relationship between tree morphology and mechanosensory function in the model organism C. elegans. Extracting dendritic trees from noisy images remains however a strenuous process that has traditionally relied on manual approaches. Here, we focus on automated and reliable 2D segmentations of dendritic trees following a statistical learning framework. METHODS Our dendritic tree extraction (DTE) method uses small amounts of labelled training data on MIPs to learn noise models of texture-based features from the responses of tree structures and image background. Our strategy lies in evaluating statistical models of noise that account for both the variability generated from the imaging process and from the aggregation of information in the MIP images. These noisy models are then used within a probabilistic, or Bayesian framework to provide a coarse 2D dendritic tree segmentation. Finally, some post-processing is applied to refine the segmentations and provide skeletonized trees using a morphological thinning process. RESULTS Following a Leave-One-Out Cross Validation (LOOCV) method for an MIP databse with available "ground truth" images, we demonstrate that our approach provides significant improvements in tree-structure segmentations over traditional intensity-based methods. Improvements for MIPs under various imaging conditions are both qualitative and quantitative, as measured from Receiver Operator Characteristic (ROC) curves and the yield and error rates in the final segmentations. In a final step, we demonstrate our DTE approach on previously unseen MIP samples including the extraction of skeletonized structures, and compare our method to a state-of-the art dendritic tree tracing software. CONCLUSIONS Overall, our DTE method allows for robust dendritic tree segmentations in noisy MIPs, outperforming traditional intensity-based methods. Such approach provides a useable segmentation framework, ultimately delivering a speed-up for dendritic tree identification on the user end and a reliable first step towards further morphological characterizations of tree arborization.
Collapse
Affiliation(s)
- Ayala Greenblum
- Department of Biomedical Engineering, Technion - Israel Institute of Technology, 32000, Haifa, Israel
| | - Raphael Sznitman
- School of Computer and Communications, Ecole Polytechnique Fédérale de Lausanne (EPFL), 1015, Lausanne, Switzerland
| | - Pascal Fua
- School of Computer and Communications, Ecole Polytechnique Fédérale de Lausanne (EPFL), 1015, Lausanne, Switzerland
| | - Paulo E Arratia
- Department of Mechanical Engineering and Applied Mechanics, University of Pennsylvania, 19104, Philadelphia, USA
| | - Meital Oren
- Department of Biology, Technion - Israel Institute of Technology, 32000, Haifa, Israel
- Current address: Department of Biochemistry & Molecular Biophysics, Columbia University, 1032, New York, USA
| | - Benjamin Podbilewicz
- Current address: Department of Biochemistry & Molecular Biophysics, Columbia University, 1032, New York, USA
| | - Josué Sznitman
- Department of Biomedical Engineering, Technion - Israel Institute of Technology, 32000, Haifa, Israel
| |
Collapse
|
24
|
Ming X, Li A, Wu J, Yan C, Ding W, Gong H, Zeng S, Liu Q. Rapid reconstruction of 3D neuronal morphology from light microscopy images with augmented rayburst sampling. PLoS One 2013; 8:e84557. [PMID: 24391966 PMCID: PMC3877282 DOI: 10.1371/journal.pone.0084557] [Citation(s) in RCA: 43] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2013] [Accepted: 11/16/2013] [Indexed: 11/22/2022] Open
Abstract
Digital reconstruction of three-dimensional (3D) neuronal morphology from light microscopy images provides a powerful technique for analysis of neural circuits. It is time-consuming to manually perform this process. Thus, efficient computer-assisted approaches are preferable. In this paper, we present an innovative method for the tracing and reconstruction of 3D neuronal morphology from light microscopy images. The method uses a prediction and refinement strategy that is based on exploration of local neuron structural features. We extended the rayburst sampling algorithm to a marching fashion, which starts from a single or a few seed points and marches recursively forward along neurite branches to trace and reconstruct the whole tree-like structure. A local radius-related but size-independent hemispherical sampling was used to predict the neurite centerline and detect branches. Iterative rayburst sampling was performed in the orthogonal plane, to refine the centerline location and to estimate the local radius. We implemented the method in a cooperative 3D interactive visualization-assisted system named flNeuronTool. The source code in C++ and the binaries are freely available at http://sourceforge.net/projects/flneurontool/. We validated and evaluated the proposed method using synthetic data and real datasets from the Digital Reconstruction of Axonal and Dendritic Morphology (DIADEM) challenge. Then, flNeuronTool was applied to mouse brain images acquired with the Micro-Optical Sectioning Tomography (MOST) system, to reconstruct single neurons and local neural circuits. The results showed that the system achieves a reasonable balance between fast speed and acceptable accuracy, which is promising for interactive applications in neuronal image analysis.
Collapse
Affiliation(s)
- Xing Ming
- Britton Chance Center for Biomedical Photonics, Huazhong University of Science and Technology - Wuhan National Laboratory for Optoelectronics, Wuhan, China
- MoE Key Laboratory of Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Anan Li
- Britton Chance Center for Biomedical Photonics, Huazhong University of Science and Technology - Wuhan National Laboratory for Optoelectronics, Wuhan, China
- MoE Key Laboratory of Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Jingpeng Wu
- Britton Chance Center for Biomedical Photonics, Huazhong University of Science and Technology - Wuhan National Laboratory for Optoelectronics, Wuhan, China
- MoE Key Laboratory of Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Cheng Yan
- Britton Chance Center for Biomedical Photonics, Huazhong University of Science and Technology - Wuhan National Laboratory for Optoelectronics, Wuhan, China
- MoE Key Laboratory of Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Wenxiang Ding
- Britton Chance Center for Biomedical Photonics, Huazhong University of Science and Technology - Wuhan National Laboratory for Optoelectronics, Wuhan, China
- MoE Key Laboratory of Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Hui Gong
- Britton Chance Center for Biomedical Photonics, Huazhong University of Science and Technology - Wuhan National Laboratory for Optoelectronics, Wuhan, China
- MoE Key Laboratory of Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Shaoqun Zeng
- Britton Chance Center for Biomedical Photonics, Huazhong University of Science and Technology - Wuhan National Laboratory for Optoelectronics, Wuhan, China
- MoE Key Laboratory of Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, China
| | - Qian Liu
- Britton Chance Center for Biomedical Photonics, Huazhong University of Science and Technology - Wuhan National Laboratory for Optoelectronics, Wuhan, China
- MoE Key Laboratory of Biomedical Photonics, Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, China
- * E-mail:
| |
Collapse
|
25
|
Choromanska A, Chang SF, Yuste R. Automatic reconstruction of neural morphologies with multi-scale tracking. Front Neural Circuits 2012; 6:25. [PMID: 22754498 PMCID: PMC3385559 DOI: 10.3389/fncir.2012.00025] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2011] [Accepted: 04/19/2012] [Indexed: 11/21/2022] Open
Abstract
Neurons have complex axonal and dendritic morphologies that are the structural building blocks of neural circuits. The traditional method to capture these morphological structures using manual reconstructions is time-consuming and partly subjective, so it appears important to develop automatic or semi-automatic methods to reconstruct neurons. Here we introduce a fast algorithm for tracking neural morphologies in 3D with simultaneous detection of branching processes. The method is based on existing tracking procedures, adding the machine vision technique of multi-scaling. Starting from a seed point, our algorithm tracks axonal or dendritic arbors within a sphere of a variable radius, then moves the sphere center to the point on its surface with the shortest Dijkstra path, detects branching points on the surface of the sphere, scales it until branches are well separated and then continues tracking each branch. We evaluate the performance of our algorithm on preprocessed data stacks obtained by manual reconstructions of neural cells, corrupted with different levels of artificial noise, and unprocessed data sets, achieving 90% precision and 81% recall in branch detection. We also discuss limitations of our method, such as reconstructing highly overlapping neural processes, and suggest possible improvements. Multi-scaling techniques, well suited to detect branching structures, appear a promising strategy for automatic neuronal reconstructions.
Collapse
Affiliation(s)
- Anna Choromanska
- Department of Electrical Engineering, Columbia University New York, NY, USA
| | | | | |
Collapse
|
26
|
Abstract
Reconstruction of the complete wiring diagram, or connectome, of a neural circuit provides an alternative approach to conventional circuit analysis. One major obstacle of connectomics lies in segmenting and tracing neuronal processes from the vast number of images obtained with optical or electron microscopy. Here I review recent progress in automated tracing algorithms for connectomic reconstruction with fluorescence and electron microscopy, and discuss the challenges to image analysis posed by novel optical imaging techniques.
Collapse
Affiliation(s)
- Ju Lu
- James H. Clark Center for Biomedical Engineering and Sciences, Department of Biological Sciences, Stanford University, Stanford, CA, USA.
| |
Collapse
|
27
|
Zhao T, Xie J, Amat F, Clack N, Ahammad P, Peng H, Long F, Myers E. Automated reconstruction of neuronal morphology based on local geometrical and global structural models. Neuroinformatics 2012; 9:247-61. [PMID: 21547564 PMCID: PMC3104133 DOI: 10.1007/s12021-011-9120-3] [Citation(s) in RCA: 90] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Digital reconstruction of neurons from microscope images is an important and challenging problem in neuroscience. In this paper, we propose a model-based method to tackle this problem. We first formulate a model structure, then develop an algorithm for computing it by carefully taking into account morphological characteristics of neurons, as well as the image properties under typical imaging protocols. The method has been tested on the data sets used in the DIADEM competition and produced promising results for four out of the five data sets.
Collapse
Affiliation(s)
- Ting Zhao
- Qiushi Academy for Advanced Studies, Zhejiang University, 38 ZheDa Road, Hangzhou, 310027 China
| | - Jun Xie
- HHMI Janelia Farm Research Campus, 19700 Helix Dr., Ashburn, VA 20147 USA
| | - Fernando Amat
- HHMI Janelia Farm Research Campus, 19700 Helix Dr., Ashburn, VA 20147 USA
| | - Nathan Clack
- HHMI Janelia Farm Research Campus, 19700 Helix Dr., Ashburn, VA 20147 USA
| | - Parvez Ahammad
- HHMI Janelia Farm Research Campus, 19700 Helix Dr., Ashburn, VA 20147 USA
| | - Hanchuan Peng
- HHMI Janelia Farm Research Campus, 19700 Helix Dr., Ashburn, VA 20147 USA
| | - Fuhui Long
- HHMI Janelia Farm Research Campus, 19700 Helix Dr., Ashburn, VA 20147 USA
| | - Eugene Myers
- HHMI Janelia Farm Research Campus, 19700 Helix Dr., Ashburn, VA 20147 USA
| |
Collapse
|
28
|
Abstract
This paper presents a broadly applicable algorithm and a comprehensive open-source software implementation for automated tracing of neuronal structures in 3-D microscopy images. The core 3-D neuron tracing algorithm is based on three-dimensional (3-D) open-curve active Contour (Snake). It is initiated from a set of automatically detected seed points. Its evolution is driven by a combination of deforming forces based on the Gradient Vector Flow (GVF), stretching forces based on estimation of the fiber orientations, and a set of control rules. In this tracing model, bifurcation points are detected implicitly as points where multiple snakes collide. A boundariness measure is employed to allow local radius estimation. A suite of pre-processing algorithms enable the system to accommodate diverse neuronal image datasets by reducing them to a common image format. The above algorithms form the basis for a comprehensive, scalable, and efficient software system developed for confocal or brightfield images. It provides multiple automated tracing modes. The user can optionally interact with the tracing system using multiple view visualization, and exercise full control to ensure a high quality reconstruction. We illustrate the utility of this tracing system by presenting results from a synthetic dataset, a brightfield dataset and two confocal datasets from the DIADEM challenge.
Collapse
|
29
|
Tsechpenakis G, Mukherjee P, Kim MD, Chiba A. Three-dimensional motor neuron morphology estimation in the Drosophila ventral nerve cord. IEEE Trans Biomed Eng 2011; 59:1253-63. [PMID: 22203698 DOI: 10.1109/tbme.2011.2181166] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Type-specific dendritic arborization patterns dictate synaptic connectivity and are fundamental determinants of neuronal function. We exploit the morphological stereotypy and relative simplicity of the Drosophila nervous system to model the diverse neuronal morphologies of individual motor neurons (MNs) and understand underlying principles of synaptic connectivity in a motor circuit. Our computational approach aims at the reconstruction of the neuron morphology, namely the robust segmentation of the neuron volumes from their surroundings with the simultaneous partitioning into their compartments, namely the soma, axon, and dendrites. We use the idea of cosegmentation, where every image along the z -axis (depth) is segmented using information from "neighboring" depths. We use 3-D Haar-like features to model appearance. Because soma and axon are determined by their distinctive shapes, we define an implicit shape representation of the 2-D segmentation sets to drive cosegmentation and achieve the desired partitioning. We validate our method using image stacks depicting single neurons labeled with green fluorescent protein (GFP) and serially imaged with laser scanning confocal microscopy.
Collapse
Affiliation(s)
- Gavriil Tsechpenakis
- Computer and Information Science Department, Indiana University-Purdue University, Indianapolis, IN 46202, USA.
| | | | | | | |
Collapse
|
30
|
Abstract
Motivation: Digital reconstruction, or tracing, of 3D neuron structures is critical toward reverse engineering the wiring and functions of a brain. However, despite a number of existing studies, this task is still challenging, especially when a 3D microscopic image has low signal-to-noise ratio (SNR) and fragmented neuron segments. Published work can handle these hard situations only by introducing global prior information, such as where a neurite segment starts and terminates. However, manual incorporation of such global information can be very time consuming. Thus, a completely automatic approach for these hard situations is highly desirable. Results: We have developed an automatic graph algorithm, called the all-path pruning (APP), to trace the 3D structure of a neuron. To avoid potential mis-tracing of some parts of a neuron, an APP first produces an initial over-reconstruction, by tracing the optimal geodesic shortest path from the seed location to every possible destination voxel/pixel location in the image. Since the initial reconstruction contains all the possible paths and thus could contain redundant structural components (SC), we simplify the entire reconstruction without compromising its connectedness by pruning the redundant structural elements, using a new maximal-covering minimal-redundant (MCMR) subgraph algorithm. We show that MCMR has a linear computational complexity and will converge. We examined the performance of our method using challenging 3D neuronal image datasets of model organisms (e.g. fruit fly). Availability: The software is available upon request. We plan to eventually release the software as a plugin of the V3D-Neuron package at http://penglab.janelia.org/proj/v3d. Contact:pengh@janelia.hhmi.org
Collapse
Affiliation(s)
- Hanchuan Peng
- Janelia Farm Research Campus, Howard Hughes Medical Institute, Ashburn, VA 20147, USA.
| | | | | |
Collapse
|
31
|
Gurevich I, Beloozerov V, Myagkov A, Sidorov Y, Trusova Y. Systems of neuron image recognition for solving problems of automated diagnoses of neurodegenerative diseases. PATTERN RECOGNITION AND IMAGE ANALYSIS 2011. [DOI: 10.1134/s1054661811020398] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
32
|
A deconvolution method to improve automated 3D-analysis of dendritic spines: application to a mouse model of Huntington’s disease. Brain Struct Funct 2011; 217:421-34. [DOI: 10.1007/s00429-011-0340-y] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2011] [Accepted: 07/23/2011] [Indexed: 12/27/2022]
|
33
|
Smith MB, Li H, Shen T, Huang X, Yusuf E, Vavylonis D. Segmentation and tracking of cytoskeletal filaments using open active contours. Cytoskeleton (Hoboken) 2011; 67:693-705. [PMID: 20814909 DOI: 10.1002/cm.20481] [Citation(s) in RCA: 129] [Impact Index Per Article: 9.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
We use open active contours to quantify cytoskeletal structures imaged by fluorescence microscopy in two and three dimensions. We developed an interactive software tool for segmentation, tracking, and visualization of individual fibers. Open active contours are parametric curves that deform to minimize the sum of an external energy derived from the image and an internal bending and stretching energy. The external energy generates (i) forces that attract the contour toward the central bright line of a filament in the image, and (ii) forces that stretch the active contour toward the ends of bright ridges. Images of simulated semiflexible polymers with known bending and torsional rigidity are analyzed to validate the method. We apply our methods to quantify the conformations and dynamics of actin in two examples: actin filaments imaged by TIRF microscopy in vitro, and actin cables in fission yeast imaged by spinning disk confocal microscopy.
Collapse
Affiliation(s)
- Matthew B Smith
- Department of Physics, Lehigh University, Bethlehem, Pennsylvania 18015, USA
| | | | | | | | | | | |
Collapse
|
34
|
Automated and quantitative image analysis of ischemic dendritic blebbing using in vivo 2-photon microscopy data. J Neurosci Methods 2010; 195:222-31. [PMID: 21184780 DOI: 10.1016/j.jneumeth.2010.12.018] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2010] [Revised: 12/11/2010] [Accepted: 12/13/2010] [Indexed: 11/21/2022]
Abstract
Ischemia induces a 'blebbing' of dendrites, a structural alteration where dendrites take on a 'beads on a string' appearance. We developed a toolkit program, BlebQuant, for quantitative automated bleb analysis to chart the morphology of dendrites labeled with GFP/YFP under normal conditions and after ischemia-induced damage. In vivo 2-photon data from mouse layer 5 neurons with apical dendritic tufts extending to the cortical surface were examined before, during, and after global ischemia. To quantify changes in dendritic structure, we used morphometric tools that exploit characteristic features of blebbing, distinguished as localized regions of spherical or ellipsoid swellings. By comparing acquired images during ischemia and reperfusion to a pre-ischemia reference image, our automated approach detected blebs based on defined eccentricity and area thresholds and quantified the percentage of blebbed dendrites based on a block-selection method. Our results indicate that the automated morphometric indices we employ yield results that correlate with manual assessment. The automated approach permits rapid and effective analysis of dendritic structure and may facilitate the study of ischemic dendritic damage.
Collapse
|
35
|
Abstract
The study of the structure and function of neuronal cells and networks is of crucial importance in the endeavor to understand how the brain works. A key component in this process is the extraction of neuronal morphology from microscopic imaging data. In the past four decades, many computational methods and tools have been developed for digital reconstruction of neurons from images, with limited success. As witnessed by the growing body of literature on the subject, as well as the organization of challenging competitions in the field, the quest for a robust and fully automated system of more general applicability still continues. The aim of this work, is to contribute by surveying recent developments in the field for anyone interested in taking up the challenge. Relevant aspects discussed in the article include proposed image segmentation methods, quantitative measures of neuronal morphology, currently available software tools for various related purposes, and morphology databases. (c) 2010 International Society for Advancement of Cytometry.
Collapse
Affiliation(s)
- Erik Meijering
- Biomedical Imaging Group Rotterdam, Erasmus MC, University Medical Center Rotterdam, 3000 CA Rotterdam, The Netherlands
| |
Collapse
|
36
|
|