BigNeuron: Large-Scale 3D Neuron Reconstruction from Optical Microscopy Images

DeepEM3D: approaching human-level performance on 3D anisotropic EM image segmentation

MOTIVATION

Progress in 3D electron microscopy (EM) imaging has greatly facilitated neuroscience research in high-throughput data acquisition. Correspondingly, high-throughput automated image analysis methods are necessary to work on par with the speed of data being produced. One such example is the need for automated EM image segmentation for neurite reconstruction. However, the efficiency and reliability of current methods are still lagging far behind human performance.

RESULTS

Here, we propose DeepEM3D, a deep learning method for segmenting 3D anisotropic brain electron microscopy images. In this method, the deep learning model can efficiently build feature representation and incorporate sufficient multi-scale contextual information. We propose employing a combination of novel boundary map generation methods with optimized model ensembles to address the inherent challenges of segmenting anisotropic images. We evaluated our method by participating in the 3D segmentation of neurites in EM images (SNEMI3D) challenge. Our submission is ranked #1 on the current leaderboard as of Oct 15, 2016. More importantly, our result was very close to human-level performance in terms of the challenge evaluation metric: namely, a Rand error of 0.06015 versus the human value of 0.05998.

AVAILABILITY AND IMPLEMENTATION

The code is available at https://github.com/divelab/deepem3d/.

CONTACT

sji@eecs.wsu.edu.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Neuronal cell-type classification: challenges, opportunities and the path forward

Neurons have diverse molecular, morphological, connectional and functional properties. We believe that the only realistic way to manage this complexity - and thereby pave the way for understanding the structure, function and development of brain circuits - is to group neurons into types, which can then be analysed systematically and reproducibly. However, neuronal classification has been challenging both technically and conceptually. New high-throughput methods have created opportunities to address the technical challenges associated with neuronal classification by collecting comprehensive information about individual cells. Nonetheless, conceptual difficulties persist. Borrowing from the field of species taxonomy, we propose principles to be followed in the cell-type classification effort, including the incorporation of multiple, quantitative features as criteria, the use of discontinuous variation to define types and the creation of a hierarchical system to represent relationships between cells. We review the progress of classifying cell types in the retina and cerebral cortex and propose a staged approach for moving forward with a systematic cell-type classification in the nervous system.

Toward Whole-Body Connectomics

Recent advances in neuro-technologies have revolutionized knowledge of brain structure and functions. Governments and private organizations worldwide have initiated several large-scale brain connectome projects, to further understand how the brain works at the systems levels. Most recent projects focus on only brain neurons, with the exception of an early effort to reconstruct the 302 neurons that comprise the whole body of the small worm, Caenorhabditis elegans However, to fully elucidate the neural circuitry of complex behavior, it is crucial to understand brain interactions with the whole body, which can be achieved only by mapping the whole-body connectome. In this article, we discuss the current state of connectomics study, focusing on novel optical approaches and related imaging technologies. We also discuss the challenges encountered by scientists who endeavor to map these whole-body connectomes in large animals.

Deep Learning Segmentation of Optical Microscopy Images Improves 3-D Neuron Reconstruction

Digital reconstruction, or tracing, of 3-D neuron structure from microscopy images is a critical step toward reversing engineering the wiring and anatomy of a brain. Despite a number of prior attempts, this task remains very challenging, especially when images are contaminated by noises or have discontinued segments of neurite patterns. An approach for addressing such problems is to identify the locations of neuronal voxels using image segmentation methods, prior to applying tracing or reconstruction techniques. This preprocessing step is expected to remove noises in the data, thereby leading to improved reconstruction results. In this paper, we proposed to use 3-D convolutional neural networks (CNNs) for segmenting the neuronal microscopy images. Specifically, we designed a novel CNN architecture, that takes volumetric images as the inputs and their voxel-wise segmentation maps as the outputs. The developed architecture allows us to train and predict using large microscopy images in an end-to-end manner. We evaluated the performance of our model on a variety of challenging 3-D microscopy images from different organisms. Results showed that the proposed methods improved the tracing performance significantly when combined with different reconstruction algorithms.

Imaging of anticancer drug action in single cells

Imaging is widely used in anticancer drug development, typically for whole-body tracking of labelled drugs to different organs or to assess drug efficacy through volumetric measurements. However, increasing attention has been drawn to pharmacology at the single-cell level. Diverse cell types, including cancer-associated immune cells, physicochemical features of the tumour microenvironment and heterogeneous cell behaviour all affect drug delivery, response and resistance. This Review summarizes developments in the imaging of in vivo anticancer drug action, with a focus on microscopy approaches at the single-cell level and translational lessons for the clinic.

Automated neuron tracing using probability hypothesis density filtering

Motivation

The functionality of neurons and their role in neuronal networks is tightly connected to the cell morphology. A fundamental problem in many neurobiological studies aiming to unravel this connection is the digital reconstruction of neuronal cell morphology from microscopic image data. Many methods have been developed for this, but they are far from perfect, and better methods are needed.

Results

Here we present a new method for tracing neuron centerlines needed for full reconstruction. The method uses a fundamentally different approach than previous methods by considering neuron tracing as a Bayesian multi-object tracking problem. The problem is solved using probability hypothesis density filtering. Results of experiments on 2D and 3D fluorescence microscopy image datasets of real neurons indicate the proposed method performs comparably or even better than the state of the art.

Availability and Implementation

Software implementing the proposed neuron tracing method was written in the Java programming language as a plugin for the ImageJ platform. Source code is freely available for non-commercial use at https://bitbucket.org/miroslavradojevic/phd .

Contact

meijering@imagescience.org.

Supplementary information

Supplementary data are available at Bioinformatics online.

The Wistar Audiogenic Rat (WAR) strain and its contributions to epileptology and related comorbidities: History and perspectives

In the context of modeling epilepsy and neuropsychiatric comorbidities, we review the Wistar Audiogenic Rat (WAR), first introduced to the neuroscience international community more than 25years ago. The WAR strain is a genetically selected reflex model susceptible to audiogenic seizures (AS), acutely mimicking brainstem-dependent tonic-clonic seizures and chronically (by audiogenic kindling), temporal lobe epilepsy (TLE). Seminal neuroethological, electrophysiological, cellular, and molecular protocols support the WAR strain as a suitable and reliable animal model to study the complexity and emergent functions typical of epileptogenic networks. Furthermore, since epilepsy comorbidities have emerged as a hot topic in epilepsy research, we discuss the use of WARs in fields such as neuropsychiatry, memory and learning, neuroplasticity, neuroendocrinology, and cardio-respiratory autonomic regulation. Last, but not least, we propose that this strain be used in "omics" studies, as well as with the most advanced molecular and computational modeling techniques. Collectively, pioneering and recent findings reinforce the complexity associated with WAR alterations, consequent to the combination of their genetically-dependent background and seizure profile. To add to previous studies, we are currently developing more powerful behavioral, EEG, and molecular methods, combined with computational neuroscience/network modeling tools, to further increase the WAR strain's contributions to contemporary neuroscience in addition to increasing knowledge in a wide array of neuropsychiatric and other comorbidities, given shared neural networks. During the many years that the WAR strain has been studied, a constantly expanding network of multidisciplinary collaborators has generated a growing research and knowledge network. Our current and major wish is to make the WARs available internationally to share our knowledge and to facilitate the planning and execution of multi-institutional projects, eagerly needed to contribute to paradigm shifts in epileptology. This article is part of a Special Issue entitled "Genetic and Reflex Epilepsies, Audiogenic Seizures and Strains: From Experimental Models to the Clinic".

A Quantitative Golgi Study of Dendritic Morphology in the Mice Striatal Medium Spiny Neurons

In this study we have provided a detailed quantitative morphological analysis of medium spiny neurons (MSNs) in the mice dorsal striatum and determined the consistency of values among three groups of animals obtained in different set of experiments. Dendritic trees of 162 Golgi Cox (FD Rapid GolgiStain Kit) impregnated MSNs from 15 adult C57BL/6 mice were 3-dimensionally reconstructed using Neurolucida software, and parameters of dendritic morphology have been compared among experimental groups. The parameters of length and branching pattern did not show statistically significant difference and were highly consistent among groups. The average neuronal soma surface was between 160 μm² and 180 μm², and the cells had 5–6 primary dendrites with close to 40 segments per neuron. Sholl analysis confirmed regular pattern of dendritic branching. The total length of dendrites was around 2100 μm with the average length of individual branching (intermediate) segment around 22 μm and for the terminal segment around 100 μm. Even though each experimental group underwent the same strictly defined protocol in tissue preparation and Golgi staining, we found inconsistency in dendritic volume and soma surface. These changes could be methodologically influenced during the Golgi procedure, although without affecting the dendritic length and tree complexity. Since the neuronal activity affects the dendritic thickness, it could not be excluded that observed volume inconsistency was related with functional states of neurons prior to animal sacrifice. Comprehensive analyses of tree complexity and dendritic length provided here could serve as an additional tool for understanding morphological variability in the most numerous neuronal population of the striatum. As reference values they could provide basic ground for comparisons with the results obtained in studies that use various models of genetically modified mice in explaining different pathological conditions that involve MSNs.

M-AMST: an automatic 3D neuron tracing method based on mean shift and adapted minimum spanning tree

BACKGROUND

Understanding the working mechanism of the brain is one of the grandest challenges for modern science. Toward this end, the BigNeuron project was launched to gather a worldwide community to establish a big data resource and a set of the state-of-the-art of single neuron reconstruction algorithms. Many groups contributed their own algorithms for the project, including our mean shift and minimum spanning tree (M-MST). Although M-MST is intuitive and easy to implement, the MST just considers spatial information of single neuron and ignores the shape information, which might lead to less precise connections between some neuron segments. In this paper, we propose an improved algorithm, namely M-AMST, in which a rotating sphere model based on coordinate transformation is used to improve the weight calculation method in M-MST.

RESULTS

Two experiments are designed to illustrate the effect of adapted minimum spanning tree algorithm and the adoptability of M-AMST in reconstructing variety of neuron image datasets respectively. In the experiment 1, taking the reconstruction of APP2 as reference, we produce the four difference scores (entire structure average (ESA), different structure average (DSA), percentage of different structure (PDS) and max distance of neurons' nodes (MDNN)) by comparing the neuron reconstruction of the APP2 and the other 5 competing algorithm. The result shows that M-AMST gets lower difference scores than M-MST in ESA, PDS and MDNN. Meanwhile, M-AMST is better than N-MST in ESA and MDNN. It indicates that utilizing the adapted minimum spanning tree algorithm which took the shape information of neuron into account can achieve better neuron reconstructions. In the experiment 2, 7 neuron image datasets are reconstructed and the four difference scores are calculated by comparing the gold standard reconstruction and the reconstructions produced by 6 competing algorithms. Comparing the four difference scores of M-AMST and the other 5 algorithm, we can conclude that M-AMST is able to achieve the best difference score in 3 datasets and get the second-best difference score in the other 2 datasets.

CONCLUSIONS

We develop a pathway extraction method using a rotating sphere model based on coordinate transformation to improve the weight calculation approach in MST. The experimental results show that M-AMST utilizes the adapted minimum spanning tree algorithm which takes the shape information of neuron into account can achieve better neuron reconstructions. Moreover, M-AMST is able to get good neuron reconstruction in variety of image datasets.

Win-win data sharing in neuroscience

Most neuroscientists have yet to embrace a culture of data sharing. Using our decade-long experience at NeuroMorpho.Org as an example, we discuss how publicly available repositories may benefit data producers and end-users alike. We outline practical recipes for resource developers to maximize the research impact of data sharing platforms for both contributors and users.

Long distance projections of cortical pyramidal neurons

The neuronal circuits defined by the axonal projections of pyramidal neurons in the cerebral cortex are responsible for processing sensory and other information to plan and execute behavior. Subtypes of cortical pyramidal neurons are organized across layers, with those in different layers distinguished by their patterns of axonal projections and connectivity. For example, those in layers 2 and 3 project between cortical areas to integrate sensory and other information with motor areas; while those in layers 5 and 6 also integrate information between cortical areas, but also project to subcortical structures involved in the generation of behavior. Recent advances in neuroanatomical techniques allow one to target specific subtypes of cortical pyramidal neurons and label both their inputs and projections. Combining these methods with neurophysiological recording techniques and newly introduced atlases of the mouse brain provide the opportunity to achieve a detailed view of the organization of cerebral cortical circuits. © 2016 Wiley Periodicals, Inc.

TReMAP: Automatic 3D Neuron Reconstruction Based on Tracing, Reverse Mapping and Assembling of 2D Projections

Efficient and accurate digital reconstruction of neurons from large-scale 3D microscopic images remains a challenge in neuroscience. We propose a new automatic 3D neuron reconstruction algorithm, TReMAP, which utilizes 3D Virtual Finger (a reverse-mapping technique) to detect 3D neuron structures based on tracing results on 2D projection planes. Our fully automatic tracing strategy achieves close performance with the state-of-the-art neuron tracing algorithms, with the crucial advantage of efficient computation (much less memory consumption and parallel computation) for large-scale images.

Reproducibility in Computational Neuroscience Models and Simulations

OBJECTIVE

Like all scientific research, computational neuroscience research must be reproducible. Big data science, including simulation research, cannot depend exclusively on journal articles as the method to provide the sharing and transparency required for reproducibility.

METHODS

Ensuring model reproducibility requires the use of multiple standard software practices and tools, including version control, strong commenting and documentation, and code modularity.

RESULTS

Building on these standard practices, model-sharing sites and tools have been developed that fit into several categories: 1) standardized neural simulators; 2) shared computational resources; 3) declarative model descriptors, ontologies, and standardized annotations; and 4) model-sharing repositories and sharing standards.

CONCLUSION

A number of complementary innovations have been proposed to enhance sharing, transparency, and reproducibility. The individual user can be encouraged to make use of version control, commenting, documentation, and modularity in development of models. The community can help by requiring model sharing as a condition of publication and funding.

SIGNIFICANCE

Model management will become increasingly important as multiscale models become larger, more detailed, and correspondingly more difficult to manage by any single investigator or single laboratory. Additional big data management complexity will come as the models become more useful in interpreting experiments, thus increasing the need to ensure clear alignment between modeling data, both parameters and results, and experiment.

Data Publications Correlate with Citation Impact

Neuroscience and molecular biology have been generating large datasets over the past years that are reshaping how research is being conducted. In their wake, open data sharing has been singled out as a major challenge for the future of research. We conducted a comparative study of citations of data publications in both fields, showing that the average publication tagged with a data-related term by the NCBI MeSH (Medical Subject Headings) curators achieves a significantly larger citation impact than the average in either field. We introduce a new metric, the data article citation index (DAC-index), to identify the most prolific authors among those data-related publications. The study is fully reproducible from an executable Rmd (R Markdown) script together with all the citation datasets. We hope these results can encourage authors to more openly publish their data.

In search of a periodic table of the neurons: Axonal-dendritic circuitry as the organizing principle: Patterns of axons and dendrites within distinct anatomical parcels provide the blueprint for circuit-based neuronal classification

No one knows yet how to organize, in a simple yet predictive form, the knowledge concerning the anatomical, biophysical, and molecular properties of neurons that are accumulating in thousands of publications every year. The situation is not dissimilar to the state of Chemistry prior to Mendeleev's tabulation of the elements. We propose that the patterns of presence or absence of axons and dendrites within known anatomical parcels may serve as the key principle to define neuron types. Just as the positions of the elements in the periodic table indicate their potential to combine into molecules, axonal and dendritic distributions provide the blueprint for network connectivity. Furthermore, among the features commonly employed to describe neurons, morphology is considerably robust to experimental conditions. At the same time, this core classification scheme is suitable for aggregating biochemical, physiological, and synaptic information.

High-throughput dual-colour precision imaging for brain-wide connectome with cytoarchitectonic landmarks at the cellular level

The precise annotation and accurate identification of neural structures are prerequisites for studying mammalian brain function. The orientation of neurons and neural circuits is usually determined by mapping brain images to coarse axial-sampling planar reference atlases. However, individual differences at the cellular level likely lead to position errors and an inability to orient neural projections at single-cell resolution. Here, we present a high-throughput precision imaging method that can acquire a co-localized brain-wide data set of both fluorescent-labelled neurons and counterstained cell bodies at a voxel size of 0.32 × 0.32 × 2.0 μm in 3 days for a single mouse brain. We acquire mouse whole-brain imaging data sets of multiple types of neurons and projections with anatomical annotation at single-neuron resolution. The results show that the simultaneous acquisition of labelled neural structures and cytoarchitecture reference in the same brain greatly facilitates precise tracing of long-range projections and accurate locating of nuclei.

High-throughput imaging methods for brain-wide connectome mapping with precise location reference have been lacking. Here authors report a method that allows simultaneous acquisition of fluorescently labelled neurons and cytoarchitectural landmarks in the same mouse brain at the single-cell resolution.

NBLAST: Rapid, Sensitive Comparison of Neuronal Structure and Construction of Neuron Family Databases

Neural circuit mapping is generating datasets of tens of thousands of labeled neurons. New computational tools are needed to search and organize these data. We present NBLAST, a sensitive and rapid algorithm, for measuring pairwise neuronal similarity. NBLAST considers both position and local geometry, decomposing neurons into short segments; matched segments are scored using a probabilistic scoring matrix defined by statistics of matches and non-matches. We validated NBLAST on a published dataset of 16,129 single Drosophila neurons. NBLAST can distinguish neuronal types down to the finest level (single identified neurons) without a priori information. Cluster analysis of extensively studied neuronal classes identified new types and unreported topographical features. Fully automated clustering organized the validation dataset into 1,052 clusters, many of which map onto previously described neuronal types. NBLAST supports additional query types, including searching neurons against transgene expression patterns. Finally, we show that NBLAST is effective with data from other invertebrates and zebrafish.

Video Abstract

•

NBLAST is a fast and sensitive algorithm to measure pairwise neuronal similarity

•

NBLAST can distinguish neuronal types at the finest level without training

•

Automated clustering of 16,129 Drosophila neurons identifies 1,052 classes

•

Online search tool for databases of single neurons or genetic driver lines

Multi-scale segmentation of neurons based on one-class classification

BACKGROUND

High resolution multiphoton and confocal microscopy has allowed the acquisition of large amounts of data to be analyzed by neuroscientists. However, manual processing of these images has become infeasible. Thus, there is a need to create automatic methods for the morphological reconstruction of 3D neuronal image stacks.

NEW METHOD

An algorithm to extract the 3D morphology from a neuron is presented. The main contribution of the paper is the segmentation of the neuron from the background. Our segmentation method is based on one-class classification where the 3D image stack is analyzed at different scales. First, a multi-scale approach is proposed to compute the Laplacian of the 3D image stack. The Laplacian is used to select a training set consisting of background points. A decision function is learned for each scale from the training set that allows determining how similar an unlabeled point is to the points in the background class. Foreground points (dendrites and axons) are assigned as those points that are rejected as background. Finally, the morphological reconstruction of the neuron is extracted by applying a state-of-the-art centerline tracing algorithm on the segmentation.

RESULTS

Quantitative and qualitative results on several datasets demonstrate the ability of our algorithm to accurately and robustly segment and trace neurons.

COMPARISON WITH EXISTING METHOD(S)

Our method was compared to state-of-the-art neuron tracing algorithms.

CONCLUSIONS

Our approach allows segmentation of thin and low contrast dendrites that are usually difficult to segment. Compared to our previous approach, this algorithm is more accurate and much faster.

Deep models for brain EM image segmentation: novel insights and improved performance

MOTIVATION

Accurate segmentation of brain electron microscopy (EM) images is a critical step in dense circuit reconstruction. Although deep neural networks (DNNs) have been widely used in a number of applications in computer vision, most of these models that proved to be effective on image classification tasks cannot be applied directly to EM image segmentation, due to the different objectives of these tasks. As a result, it is desirable to develop an optimized architecture that uses the full power of DNNs and tailored specifically for EM image segmentation.

RESULTS

In this work, we proposed a novel design of DNNs for this task. We trained a pixel classifier that operates on raw pixel intensities with no preprocessing to generate probability values for each pixel being a membrane or not. Although the use of neural networks in image segmentation is not completely new, we developed novel insights and model architectures that allow us to achieve superior performance on EM image segmentation tasks. Our submission based on these insights to the 2D EM Image Segmentation Challenge achieved the best performance consistently across all the three evaluation metrics. This challenge is still ongoing and the results in this paper are as of June 5, 2015.

AVAILABILITY AND IMPLEMENTATION

https://github.com/ahmed-fakhry/dive

CONTACT

: sji@eecs.wsu.edu.

Reconstructing the brain: from image stacks to neuron synthesis

Large-scale brain initiatives such as the US BRAIN initiative and the European Human Brain Project aim to marshall a vast amount of data and tools for the purpose of furthering our understanding of brains. Fundamental to this goal is that neuronal morphologies must be seamlessly reconstructed and aggregated on scales up to the whole rodent brain. The experimental labor needed to manually produce this number of digital morphologies is prohibitively large. The BigNeuron initiative is assembling community-generated, open-source, automated reconstruction algorithms into an open platform, and is beginning to generate an increasing flow of high-quality reconstructed neurons. We propose a novel extension of this workflow to use this data stream to generate an unlimited number of statistically equivalent, yet distinct, digital morphologies. This will bring automated processing of reconstructed cells into digital neurons to the wider neuroscience community, and enable a range of morphologically accurate computational models.

REMOD: A Tool for Analyzing and Remodeling the Dendritic Architecture of Neural Cells

Dendritic morphology is a key determinant of how individual neurons acquire a unique signal processing profile. The highly branched dendritic structure that originates from the cell body, explores the surrounding 3D space in a fractal-like manner, until it reaches a certain amount of complexity. Its shape undergoes significant alterations under various physiological or neuropathological conditions. Yet, despite the profound effect that these alterations can have on neuronal function, the causal relationship between the two remains largely elusive. The lack of a systematic approach for remodeling neural cells and their dendritic trees is a key limitation that contributes to this problem. Such causal relationships can be inferred via the use of large-scale neuronal models whereby the anatomical plasticity of neurons is accounted for, in order to enhance their biological relevance and hence their predictive performance. To facilitate this effort, we developed a computational tool named REMOD that allows the structural remodeling of any type of virtual neuron. REMOD is written in Python and can be accessed through a dedicated web interface that guides the user through various options to manipulate selected neuronal morphologies. REMOD can also be used to extract meaningful morphology statistics for one or multiple reconstructions, including features such as sholl analysis, total dendritic length and area, path length to the soma, centrifugal branch order, diameter tapering and more. As such, the tool can be used both for the analysis and/or the remodeling of neuronal morphologies of any type.

Challenges and Benchmarks in Bioimage Analysis

Similar to the medical imaging community, the bioimaging community has recently realized the need to benchmark various image analysis methods to compare their performance and assess their suitability for specific applications. Challenges sponsored by prestigious conferences have proven to be an effective means of encouraging benchmarking and new algorithm development for a particular type of image data. Bioimage analysis challenges have recently complemented medical image analysis challenges, especially in the case of the International Symposium on Biomedical Imaging (ISBI). This review summarizes recent progress in this respect and describes the general process of designing a bioimage analysis benchmark or challenge, including the proper selection of datasets and evaluation metrics. It also presents examples of specific target applications and biological research tasks that have benefited from these challenges with respect to the performance of automatic image analysis methods that are crucial for the given task. Finally, available benchmarks and challenges in terms of common features, possible classification and implications drawn from the results are analysed.

Image Informatics Strategies for Deciphering Neuronal Network Connectivity

Brain function relies on an intricate network of highly dynamic neuronal connections that rewires dramatically under the impulse of various external cues and pathological conditions. Amongst the neuronal structures that show morphological plasticity are neurites, synapses, dendritic spines and even nuclei. This structural remodelling is directly connected with functional changes such as intercellular communication and the associated calcium bursting behaviour. In vitro cultured neuronal networks are valuable models for studying these morpho-functional changes. Owing to the automation and standardization of both image acquisition and image analysis, it has become possible to extract statistically relevant readouts from such networks. Here, we focus on the current state-of-the-art in image informatics that enables quantitative microscopic interrogation of neuronal networks. We describe the major correlates of neuronal connectivity and present workflows for analysing them. Finally, we provide an outlook on the challenges that remain to be addressed, and discuss how imaging algorithms can be extended beyond in vitro imaging studies.

Recent advancement in the challenges to connectomics

Advancement of microscopic technologies established significant progress in our understanding of the brain. In the recent effort to elucidate the complete wiring map of the brain circuitry termed 'connectome', the different modalities of imaging technology, including those of light and electron microscopy, have started providing essential contribution in multiple organisms. The contribution would be impossible without the recent innovation in both acquisition and analyses of the big connectomic data. The current data demonstrated complicated networks with unidirectional and reciprocal connections of the cerebral circuits at the macroscopic and light microscopic ('mesoscopic') levels, and the unimaginable complexity of synaptic connections between axons and dendrites at the electron microscopic ('microscopic') level. At the same time, the data highlighted the necessity to make substantial advancement in methodology of the connectomic studies, including efficient handling and automated analyses of the acquired dataset. Further understanding about structural and functional connectome seems to be facilitated by combinations of the different imaging modalities. Such multidisciplinary approaches will give us the clues to address whether the complete connectome can elucidate fundamental mechanisms processing the basic and higher functions of human brains.

DeFiNe: an optimisation-based method for robust disentangling of filamentous networks

Thread-like structures are pervasive across scales, from polymeric proteins to root systems to galaxy filaments, and their characteristics can be readily investigated in the network formalism. Yet, network links usually represent only parts of filaments, which, when neglected, may lead to erroneous conclusions from network-based analyses. The existing alternatives to detect filaments in network representations require tuning of parameters over a large range of values and treat all filaments equally, thus, precluding automated analysis of diverse filamentous systems. Here, we propose a fully automated and robust optimisation-based approach to detect filaments of consistent intensities and angles in a given network. We test and demonstrate the accuracy of our solution with contrived, biological, and cosmic filamentous structures. In particular, we show that the proposed approach provides powerful automated means to study properties of individual actin filaments in their network context. Our solution is made publicly available as an open-source tool, "DeFiNe", facilitating decomposition of any given network into individual filaments.

Whole-body tissue stabilization and selective extractions via tissue-hydrogel hybrids for high-resolution intact circuit mapping and phenotyping

To facilitate fine-scale phenotyping of whole specimens, we describe here a set of tissue fixation-embedding, detergent-clearing and staining protocols that can be used to transform excised organs and whole organisms into optically transparent samples within 1-2 weeks without compromising their cellular architecture or endogenous fluorescence. PACT (passive CLARITY technique) and PARS (perfusion-assisted agent release in situ) use tissue-hydrogel hybrids to stabilize tissue biomolecules during selective lipid extraction, resulting in enhanced clearing efficiency and sample integrity. Furthermore, the macromolecule permeability of PACT- and PARS-processed tissue hybrids supports the diffusion of immunolabels throughout intact tissue, whereas RIMS (refractive index matching solution) grants high-resolution imaging at depth by further reducing light scattering in cleared and uncleared samples alike. These methods are adaptable to difficult-to-image tissues, such as bone (PACT-deCAL), and to magnified single-cell visualization (ePACT). Together, these protocols and solutions enable phenotyping of subcellular components and tracing cellular connectivity in intact biological networks.

Neuron anatomy structure reconstruction based on a sliding filter

BACKGROUND

Reconstruction of neuron anatomy structure is a challenging and important task in neuroscience. However, few algorithms can automatically reconstruct the full structure well without manual assistance, making it essential to develop new methods for this task.

METHODS

This paper introduces a new pipeline for reconstructing neuron anatomy structure from 3-D microscopy image stacks. This pipeline is initialized with a set of seeds that were detected by our proposed Sliding Volume Filter (SVF), given a non-circular cross-section of a neuron cell. Then, an improved open curve snake model combined with a SVF external force is applied to trace the full skeleton of the neuron cell. A radius estimation method based on a 2D sliding band filter is developed to fit the real edge of the cross-section of the neuron cell. Finally, a surface reconstruction method based on non-parallel curve networks is used to generate the neuron cell surface to finish this pipeline.

RESULTS

The proposed pipeline has been evaluated using publicly available datasets. The results show that the proposed method achieves promising results in some datasets from the DIgital reconstruction of Axonal and DEndritic Morphology (DIADEM) challenge and new BigNeuron project.

CONCLUSION

The new pipeline works well in neuron tracing and reconstruction. It can achieve higher efficiency, stability and robustness in neuron skeleton tracing. Furthermore, the proposed radius estimation method and applied surface reconstruction method can obtain more accurate neuron anatomy structures.

SmartTracing: self-learning-based Neuron reconstruction

In this work, we propose SmartTracing, an automatic tracing framework that does not require substantial human intervention. There are two major novelties in SmartTracing. First, given an input image, SmartTracing invokes a user-provided existing neuron tracing method to produce an initial neuron reconstruction, from which the likelihood of every neuron reconstruction unit is estimated. This likelihood serves as a confidence score to identify reliable regions in a neuron reconstruction. With this score, SmartTracing automatically identifies reliable portions of a neuron reconstruction generated by some existing neuron tracing algorithms, without human intervention. These reliable regions are used as training exemplars. Second, from the training exemplars the most characteristic wavelet features are automatically selected and used in a machine learning framework to predict all image areas that most probably contain neuron signal. Since the training samples and their most characterizing features are selected from each individual image, the whole process is automatically adaptive to different images. Notably, SmartTracing can improve the performance of an existing automatic tracing method. In our experiment, with SmartTracing we have successfully reconstructed complete neuron morphology of 120 Drosophila neurons. In the future, the performance of SmartTracing will be tested in the BigNeuron project (bigneuron.org). It may lead to more advanced tracing algorithms and increase the throughput of neuron morphology-related studies.