Automated identification of microtubules in cellular electron tomography

Automated and semi-automated enhancement, segmentation and tracing of cytoskeletal networks in microscopic images: A review

Cytoskeletal filaments are structures of utmost importance to biological cells and organisms due to their versatility and the significant functions they perform. These biopolymers are most often organised into network-like scaffolds with a complex morphology. Understanding the geometrical and topological organisation of these networks provides key insights into their functional roles. However, this non-trivial task requires a combination of high-resolution microscopy and sophisticated image processing/analysis software. The correct analysis of the network structure and connectivity needs precise segmentation of microscopic images. While segmentation of filament-like objects is a well-studied concept in biomedical imaging, where tracing of neurons and blood vessels is routine, there are comparatively fewer studies focusing on the segmentation of cytoskeletal filaments and networks from microscopic images. The developments in the fields of microscopy, computer vision and deep learning, however, began to facilitate the task, as reflected by an increase in the recent literature on the topic. Here, we aim to provide a short summary of the research on the (semi-)automated enhancement, segmentation and tracing methods that are particularly designed and developed for microscopic images of cytoskeletal networks. In addition to providing an overview of the conventional methods, we cover the recently introduced, deep-learning-assisted methods alongside the advantages they offer over classical methods.

Extracting microtubule networks from superresolution single-molecule localization microscopy data

Microtubule filaments form ubiquitous networks. However, quantitative analysis of this structure is difficult due to its complex architecture. A tool is given for the automated retrieval of microtubule filaments from superresolution microscopy images and used for a quantitative analysis of microtubule network architecture phenotypes in fibroblasts.

Microtubule filaments form ubiquitous networks that specify spatial organization in cells. However, quantitative analysis of microtubule networks is hampered by their complex architecture, limiting insights into the interplay between their organization and cellular functions. Although superresolution microscopy has greatly facilitated high-resolution imaging of microtubule filaments, extraction of complete filament networks from such data sets is challenging. Here we describe a computational tool for automated retrieval of microtubule filaments from single-molecule-localization–based superresolution microscopy images. We present a user-friendly, graphically interfaced implementation and a quantitative analysis of microtubule network architecture phenotypes in fibroblasts.

Robust membrane detection based on tensor voting for electron tomography

Electron tomography enables three-dimensional (3D) visualization and analysis of the subcellular architecture at a resolution of a few nanometers. Segmentation of structural components present in 3D images (tomograms) is often necessary for their interpretation. However, it is severely hampered by a number of factors that are inherent to electron tomography (e.g. noise, low contrast, distortion). Thus, there is a need for new and improved computational methods to facilitate this challenging task. In this work, we present a new method for membrane segmentation that is based on anisotropic propagation of the local structural information using the tensor voting algorithm. The local structure at each voxel is then refined according to the information received from other voxels. Because voxels belonging to the same membrane have coherent structural information, the underlying global structure is strengthened. In this way, local information is easily integrated at a global scale to yield segmented structures. This method performs well under low signal-to-noise ratio typically found in tomograms of vitrified samples under cryo-tomography conditions and can bridge gaps present on membranes. The performance of the method is demonstrated by applications to tomograms of different biological samples and by quantitative comparison with standard template matching procedure.

3D actin network centerline extraction with multiple active contours

Fluorescence microscopy is frequently used to study two and three dimensional network structures formed by cytoskeletal polymer fibers such as actin filaments and actin cables. While these cytoskeletal structures are often dilute enough to allow imaging of individual filaments or bundles of them, quantitative analysis of these images is challenging. To facilitate quantitative, reproducible and objective analysis of the image data, we propose a semi-automated method to extract actin networks and retrieve their topology in 3D. Our method uses multiple Stretching Open Active Contours (SOACs) that are automatically initialized at image intensity ridges and then evolve along the centerlines of filaments in the network. SOACs can merge, stop at junctions, and reconfigure with others to allow smooth crossing at junctions of filaments. The proposed approach is generally applicable to images of curvilinear networks with low SNR. We demonstrate its potential by extracting the centerlines of synthetic meshwork images, actin networks in 2D Total Internal Reflection Fluorescence Microscopy images, and 3D actin cable meshworks of live fission yeast cells imaged by spinning disk confocal microscopy. Quantitative evaluation of the method using synthetic images shows that for images with SNR above 5.0, the average vertex error measured by the distance between our result and ground truth is 1 voxel, and the average Hausdorff distance is below 10 voxels.

Automated tracing of microtubules in electron tomograms of plastic embedded samples of Caenorhabditis elegans embryos

The ability to rapidly assess microtubule number in 3D image stacks from electron tomograms is essential for collecting statistically meaningful data sets. Here we implement microtubule tracing using 3D template matching. We evaluate our results by comparing the automatically traced centerlines to manual tracings in a large number of electron tomograms of the centrosome of the early Caenorhabditis elegans embryo. Furthermore, we give a qualitative description of the tracing results for three other types of samples. For dual-axis tomograms, the automatic tracing yields 4% false negatives and 8% false positives on average. For single-axis tomograms, the accuracy of tracing is lower (16% false negatives and 14% false positives) due to the missing wedge in electron tomography. We also implemented an editor specifically designed for correcting the automatic tracing. Besides, this editor can be used for annotating microtubules. The automatic tracing together with a manual correction significantly reduces the amount of manual labor for tracing microtubule centerlines so that large-scale analysis of microtubule network properties becomes feasible.

EXTRACTION AND ANALYSIS OF ACTIN NETWORKS BASED ON OPEN ACTIVE CONTOUR MODELS

Network structures formed by actin filaments are present in many kinds of fluorescence microscopy images. In order to quantify the conformations and dynamics of such actin filaments, we propose a fully automated method to extract actin networks from images and analyze network topology. The method handles well intersecting filaments and, to some extent, overlapping filaments. First we automatically initialize a large number of Stretching Open Active Contours (SOACs) from ridge points detected by searching for plus-to-minus sign changes in the gradient map of the image. These initial SOACs then elongate simultaneously along the bright center-lines of filaments by minimizing an energy function. During their evolution, they may merge or stop growing, thus forming a network that represents the topology of the filament ensemble. We further detect junction points in the network and break the SOACs at junctions to obtain "SOAC segments". These segments are then re-grouped using a graph-cut spectral clustering method to represent the configuration of actin filaments. The proposed approach is generally applicable to extracting intersecting curvilinear structures in noisy images. We demonstrate its potential using two kinds of data: (1) actin filaments imaged by Total Internal Reflection Fluorescence Microscopy (TIRFM) in vitro; (2) actin cytoskeleton networks in fission yeast imaged by spinning disk confocal microscopy.