Efficient processing of fluorescence images using directional multiscale representations

Machine learning approach for recognition and morphological analysis of isolated astrocytes in phase contrast microscopy

Astrocytes are glycolytically active cells in the central nervous system playing a crucial role in various brain processes from homeostasis to neurotransmission. Astrocytes possess a complex branched morphology, frequently examined by fluorescent microscopy. However, staining and fixation may impact the properties of astrocytes, thereby affecting the accuracy of the experimental data of astrocytes dynamics and morphology. On the other hand, phase contrast microscopy can be used to study astrocytes morphology without affecting them, but the post-processing of the resulting low-contrast images is challenging. The main result of this work is a novel approach for recognition and morphological analysis of unstained astrocytes based on machine-learning recognition of microscopic images. We conducted a series of experiments involving the cultivation of isolated astrocytes from the rat brain cortex followed by microscopy. Using the proposed approach, we tracked the temporal evolution of the average total length of branches, branching, and area per astrocyte in our experiments. We believe that the proposed approach and the obtained experimental data will be of interest and benefit to the scientific communities in cell biology, biophysics, and machine learning.

Optimal sparsity allows reliable system-aware restoration of fluorescence microscopy images

Fluorescence microscopy is one of the most indispensable and informative driving forces for biological research, but the extent of observable biological phenomena is essentially determined by the content and quality of the acquired images. To address the different noise sources that can degrade these images, we introduce an algorithm for multiscale image restoration through optimally sparse representation (MIRO). MIRO is a deterministic framework that models the acquisition process and uses pixelwise noise correction to improve image quality. Our study demonstrates that this approach yields a remarkable restoration of the fluorescence signal for a wide range of microscopy systems, regardless of the detector used (e.g., electron-multiplying charge-coupled device, scientific complementary metal-oxide semiconductor, or photomultiplier tube). MIRO improves current imaging capabilities, enabling fast, low-light optical microscopy, accurate image analysis, and robust machine intelligence when integrated with deep neural networks. This expands the range of biological knowledge that can be obtained from fluorescence microscopy.

A multistep deep learning framework for the automated detection and segmentation of astrocytes in fluorescent images of brain tissue

While astrocytes have been traditionally described as passive supportive cells, studies during the last decade have shown they are active players in many aspects of CNS physiology and function both in normal and disease states. However, the precise mechanisms regulating astrocytes function and interactions within the CNS are still poorly understood. This knowledge gap is due in large part to the limitations of current image analysis tools that cannot process astrocyte images efficiently and to the lack of methods capable of quantifying their complex morphological characteristics. To provide an unbiased and accurate framework for the quantitative analysis of fluorescent images of astrocytes, we introduce a new automated image processing pipeline whose main novelties include an innovative module for cell detection based on multiscale directional filters and a segmentation routine that leverages deep learning and sparse representations to reduce the need of training data and improve performance. Extensive numerical tests show that our method performs very competitively with respect to state-of-the-art methods also in challenging images where astrocytes are clustered together. Our code is released open source and freely available to the scientific community.

Automated 3D Soma Segmentation with Morphological Surface Evolution for Neuron Reconstruction

The automatic neuron reconstruction is important since it accelerates the collection of 3D neuron models for the neuronal morphological studies. The majority of the previous neuron reconstruction methods only focused on tracing neuron fibres without considering the somatic surface. Thus, topological errors often present around the soma area in the results obtained by these tracing methods. Segmentation of the soma structures can be embedded in the existing neuron tracing methods to reduce such topological errors. In this paper, we present a novel method to segment the soma structures with complex geometry. It can be applied along with the existing methods in a fully automated pipeline. An approximate bounding block is firstly estimated based on a geodesic distance transform. Then the soma segmentation is obtained by evolving the surface with a set of morphological operators inside the initial bounding region. By evaluating the methods against the challenging images released by the BigNeuron project, we showed that the proposed method can outperform the existing soma segmentation methods regarding the accuracy. We also showed that the soma segmentation can be used for enhancing the results of existing neuron tracing methods.

Automated sorting of neuronal trees in fluorescent images of neuronal networks using NeuroTreeTracer

Fluorescence confocal microscopy has become increasingly more important in neuroscience due to its applications in image-based screening and profiling of neurons. Multispectral confocal imaging is useful to simultaneously probe for distribution of multiple analytes over networks of neurons. However, current automated image analysis algorithms are not designed to extract single-neuron arbors in images where neurons are not separated, hampering the ability map fluorescence signals at the single cell level. To overcome this limitation, we introduce NeuroTreeTracer - a novel image processing framework aimed at automatically extracting and sorting single-neuron traces in fluorescent images of multicellular neuronal networks. This method applies directional multiscale filters for automated segmentation of neurons and soma detection, and includes a novel tracing routine that sorts neuronal trees in the image by resolving network connectivity even when neurites appear to intersect. By extracting each neuronal tree, NeuroTreetracer enables to automatically quantify the spatial distribution of analytes of interest in the subcellular compartments of individual neurons. This software is released open-source and freely available with the goal to facilitate applications in neuron screening and profiling.

A novel glomerular basement membrane segmentation using neutrsophic set and shearlet transform on microscopic images

Purpose

Glomerular basement membrane segmentation is an ultimate step in several image processing applications for kidney diseases and abnormalities in microscopic images. However, extracting the glomerular basement membrane (GBM) regions accurately is considered challenging because of the large variants in the microscopic images. The contribution of this work is to propose a computer-aided detection system to provide accurate GBM segmentation.

Methods

A novel GBM segmentation algorithm is developed based on neutrsophic set and shearlet transform. Firstly, the shearlet features are extracted from the microscopic image samples using shearlet transform. Afterward, the neutrosophic image is defined using shearlet features, and the indeterminacy on the neutrosophic image is reduced using an α-mean operation. Lastly, the k-means clustering algorithm is applied to segment the neutrsophic image and the GBM is identified using its intensity feature.

Results

Three metrics, namely the average distance (AvgDist), the Hausdorff distance (Hdist), and percentage overlap area (POA); were employed to assess the proposed method performance. The results established that the proposed method achieved smaller distance errors and larger POAs. For the tested image, the average of AvgDist, HDist and POA are 1.99204, 4.59535 and 0.67857, respectively. The results established that the cases were segmented accurately using the proposed NS based shearlet transform.

Conclusions

The new method utilizing the shearlet features and neutrosophic set improved the accuracy of GBM segmentation. Further study is underway to improve an automated CAD system using the refined segmentation results.

Improved detection of soma location and morphology in fluorescence microscopy images of neurons

BACKGROUND

Automated detection and segmentation of somas in fluorescent images of neurons is a major goal in quantitative studies of neuronal networks, including applications of high-content-screenings where it is required to quantify multiple morphological properties of neurons. Despite recent advances in image processing targeted to neurobiological applications, existing algorithms of soma detection are often unreliable, especially when processing fluorescence image stacks of neuronal cultures.

NEW METHOD

In this paper, we introduce an innovative algorithm for the detection and extraction of somas in fluorescent images of networks of cultured neurons where somas and other structures exist in the same fluorescent channel. Our method relies on a new geometrical descriptor called Directional Ratio and a collection of multiscale orientable filters to quantify the level of local isotropy in an image. To optimize the application of this approach, we introduce a new construction of multiscale anisotropic filters that is implemented by separable convolution.

RESULTS

Extensive numerical experiments using 2D and 3D confocal images show that our automated algorithm reliably detects somas, accurately segments them, and separates contiguous ones.

COMPARISON WITH EXISTING METHODS

We include a detailed comparison with state-of-the-art existing methods to demonstrate that our algorithm is extremely competitive in terms of accuracy, reliability and computational efficiency.

CONCLUSIONS

Our algorithm will facilitate the development of automated platforms for high content neuron image processing. A Matlab code is released open-source and freely available to the scientific community.

Improved Methods for Fluorescence Microscopy Detection of Macromolecules at the Axon Initial Segment

The axonal initial segment (AIS) is the subcellular compartment required for initiation of the action potential in neurons. Scaffolding and regulatory proteins at the AIS cluster with ion channels ensuring the integrity of electrical signaling. Interference with the configuration of this protein network can lead to profound effects on neuronal polarity, excitability, cell-to-cell connectivity and brain circuit plasticity. As such, the ability to visualize AIS components with precision provides an invaluable opportunity for parsing out key molecular determinants of neuronal function. Fluorescence-based immunolabeling is a sensitive method for morphological and molecular characterization of fine structures in neurons. Yet, even when combined with confocal microscopy, detection of AIS elements with immunofluorescence has been limited by the loss of antigenicity caused by fixative materials. This technical barrier has posed significant limitations in detecting AIS components alone or in combination with other markers. Here, we designed improved protocols targeted to confocal immunofluorescence detection of the AIS marker fibroblast growth factor 14 (FGF14) in combination with the cytoskeletal-associated protein Ankyrin-G, the scaffolding protein βIV-spectrin, voltage-gated Na⁺ (Nav) channels (especially the Nav1.6 isoform) and critical cell type-specific neuronal markers such as parvalbumin, calbindin, and NeuN in the mouse brain. Notably, we demonstrate that intracardiac perfusion of animals with a commercially available solution containing 1% formaldehyde and 0.5% methanol, followed by brief fixation with cold acetone is an optimal and sensitive protocol for FGF14 and other AIS marker detection that guarantees excellent tissue integrity. With variations in the procedure, we also significantly improved the detection of Nav1.6, a Nav isoform known for its fixative-sensitivity. Overall, this study provides an ensemble of immunohistochemical recipes that permit excellent staining of otherwise invisible molecules within well-preserved tissue architecture. While improving the specific investigation of AIS physiology and cell biology, our thorough study can also serve as a roadmap for optimizing immunodetection of other fixative-sensitive proteins expanding the repertoire of enabling methods for brain studies.

Automated detection of soma location and morphology in neuronal network cultures

Automated identification of the primary components of a neuron and extraction of its sub-cellular features are essential steps in many quantitative studies of neuronal networks. The focus of this paper is the development of an algorithm for the automated detection of the location and morphology of somas in confocal images of neuronal network cultures. This problem is motivated by applications in high-content screenings (HCS), where the extraction of multiple morphological features of neurons on large data sets is required. Existing algorithms are not very efficient when applied to the analysis of confocal image stacks of neuronal cultures. In addition to the usual difficulties associated with the processing of fluorescent images, these types of stacks contain a small number of images so that only a small number of pixels are available along the z-direction and it is challenging to apply conventional 3D filters. The algorithm we present in this paper applies a number of innovative ideas from the theory of directional multiscale representations and involves the following steps: (i) image segmentation based on support vector machines with specially designed multiscale filters; (ii) soma extraction and separation of contiguous somas, using a combination of level set method and directional multiscale filters. We also present an approach to extract the soma's surface morphology using the 3D shearlet transform. Extensive numerical experiments show that our algorithms are computationally efficient and highly accurate in segmenting the somas and separating contiguous ones. The algorithms presented in this paper will facilitate the development of a high-throughput quantitative platform for the study of neuronal networks for HCS applications.