Tracking cells in Life Cell Imaging videos using topological alignments

A graph-based cell tracking algorithm with few manually tunable parameters and automated segmentation error correction

Automatic cell segmentation and tracking enables to gain quantitative insights into the processes driving cell migration. To investigate new data with minimal manual effort, cell tracking algorithms should be easy to apply and reduce manual curation time by providing automatic correction of segmentation errors. Current cell tracking algorithms, however, are either easy to apply to new data sets but lack automatic segmentation error correction, or have a vast set of parameters that needs either manual tuning or annotated data for parameter tuning. In this work, we propose a tracking algorithm with only few manually tunable parameters and automatic segmentation error correction. Moreover, no training data is needed. We compare the performance of our approach to three well-performing tracking algorithms from the Cell Tracking Challenge on data sets with simulated, degraded segmentation—including false negatives, over- and under-segmentation errors. Our tracking algorithm can correct false negatives, over- and under-segmentation errors as well as a mixture of the aforementioned segmentation errors. On data sets with under-segmentation errors or a mixture of segmentation errors our approach performs best. Moreover, without requiring additional manual tuning, our approach ranks several times in the top 3 on the 6^th edition of the Cell Tracking Challenge.

Uncertainty Footprint: Visualization of Nonuniform Behavior of Iterative Algorithms Applied to 4D Cell Tracking

Research on microscopy data from developing biological samples usually requires tracking individual cells over time. When cells are three-dimensionally and densely packed in a time-dependent scan of volumes, tracking results can become unreliable and uncertain. Not only are cell segmentation results often inaccurate to start with, but it also lacks a simple method to evaluate the tracking outcome. Previous cell tracking methods have been validated against benchmark data from real scans or artificial data, whose ground truth results are established by manual work or simulation. However, the wide variety of real-world data makes an exhaustive validation impossible. Established cell tracking tools often fail on new data, whose issues are also difficult to diagnose with only manual examinations. Therefore, data-independent tracking evaluation methods are desired for an explosion of microscopy data with increasing scale and resolution. In this paper, we propose the uncertainty footprint, an uncertainty quantification and visualization technique that examines nonuniformity at local convergence for an iterative evaluation process on a spatial domain supported by partially overlapping bases. We demonstrate that the patterns revealed by the uncertainty footprint indicate data processing quality in two algorithms from a typical cell tracking workflow - cell identification and association. A detailed analysis of the patterns further allows us to diagnose issues and design methods for improvements. A 4D cell tracking workflow equipped with the uncertainty footprint is capable of self diagnosis and correction for a higher accuracy than previous methods whose evaluation is limited by manual examinations.

Directional reversals enable Myxococcus xanthus cells to produce collective one-dimensional streams during fruiting-body formation

The formation of a collectively moving group benefits individuals within a population in a variety of ways. The surface-dwelling bacterium Myxococcus xanthus forms dynamic collective groups both to feed on prey and to aggregate during times of starvation. The latter behaviour, termed fruiting-body formation, involves a complex, coordinated series of density changes that ultimately lead to three-dimensional aggregates comprising hundreds of thousands of cells and spores. How a loose, two-dimensional sheet of motile cells produces a fixed aggregate has remained a mystery as current models of aggregation are either inconsistent with experimental data or ultimately predict unstable structures that do not remain fixed in space. Here, we use high-resolution microscopy and computer vision software to spatio-temporally track the motion of thousands of individuals during the initial stages of fruiting-body formation. We find that cells undergo a phase transition from exploratory flocking, in which unstable cell groups move rapidly and coherently over long distances, to a reversal-mediated localization into one-dimensional growing streams that are inherently stable in space. These observations identify a new phase of active collective behaviour and answer a long-standing open question in Myxococcus development by describing how motile cell groups can remain statistically fixed in a spatial location.

Similarity maps and hierarchical clustering for annotating FT-IR spectral images

Background

Unsupervised segmentation of multi-spectral images plays an important role in annotating infrared microscopic images and is an essential step in label-free spectral histopathology. In this context, diverse clustering approaches have been utilized and evaluated in order to achieve segmentations of Fourier Transform Infrared (FT-IR) microscopic images that agree with histopathological characterization.

Results

We introduce so-called interactive similarity maps as an alternative annotation strategy for annotating infrared microscopic images. We demonstrate that segmentations obtained from interactive similarity maps lead to similarly accurate segmentations as segmentations obtained from conventionally used hierarchical clustering approaches. In order to perform this comparison on quantitative grounds, we provide a scheme that allows to identify non-horizontal cuts in dendrograms. This yields a validation scheme for hierarchical clustering approaches commonly used in infrared microscopy.

Conclusions

We demonstrate that interactive similarity maps may identify more accurate segmentations than hierarchical clustering based approaches, and thus are a viable and due to their interactive nature attractive alternative to hierarchical clustering. Our validation scheme furthermore shows that performance of hierarchical two-means is comparable to the traditionally used Ward’s clustering. As the former is much more efficient in time and memory, our results suggest another less resource demanding alternative for annotating large spectral images.

A novel validation algorithm allows for automated cell tracking and the extraction of biologically meaningful parameters

Automated microscopy is currently the only method to non-invasively and label-free observe complex multi-cellular processes, such as cell migration, cell cycle, and cell differentiation. Extracting biological information from a time-series of micrographs requires each cell to be recognized and followed through sequential microscopic snapshots. Although recent attempts to automatize this process resulted in ever improving cell detection rates, manual identification of identical cells is still the most reliable technique. However, its tedious and subjective nature prevented tracking from becoming a standardized tool for the investigation of cell cultures. Here, we present a novel method to accomplish automated cell tracking with a reliability comparable to manual tracking. Previously, automated cell tracking could not rival the reliability of manual tracking because, in contrast to the human way of solving this task, none of the algorithms had an independent quality control mechanism; they missed validation. Thus, instead of trying to improve the cell detection or tracking rates, we proceeded from the idea to automatically inspect the tracking results and accept only those of high trustworthiness, while rejecting all other results. This validation algorithm works independently of the quality of cell detection and tracking through a systematic search for tracking errors. It is based only on very general assumptions about the spatiotemporal contiguity of cell paths. While traditional tracking often aims to yield genealogic information about single cells, the natural outcome of a validated cell tracking algorithm turns out to be a set of complete, but often unconnected cell paths, i.e. records of cells from mitosis to mitosis. This is a consequence of the fact that the validation algorithm takes complete paths as the unit of rejection/acceptance. The resulting set of complete paths can be used to automatically extract important biological parameters with high reliability and statistical significance. These include the distribution of life/cycle times and cell areas, as well as of the symmetry of cell divisions and motion analyses. The new algorithm thus allows for the quantification and parameterization of cell culture with unprecedented accuracy. To evaluate our validation algorithm, two large reference data sets were manually created. These data sets comprise more than 320,000 unstained adult pancreatic stem cells from rat, including 2592 mitotic events. The reference data sets specify every cell position and shape, and assign each cell to the correct branch of its genealogic tree. We provide these reference data sets for free use by others as a benchmark for the future improvement of automated tracking methods.

3-D active meshes: fast discrete deformable models for cell tracking in 3-D time-lapse microscopy

Variational deformable models have proven over the past decades a high efficiency for segmentation and tracking in 2-D sequences. Yet, their application to 3-D time-lapse images has been hampered by discretization issues, heavy computational loads and lack of proper user visualization and interaction, limiting their use for routine analysis of large data-sets. We propose here to address these limitations by reformulating the problem entirely in the discrete domain using 3-D active meshes, which express a surface as a discrete triangular mesh, and minimize the energy functional accordingly. By performing computations in the discrete domain, computational costs are drastically reduced, whilst the mesh formalism allows to benefit from real-time 3-D rendering and other GPU-based optimizations. Performance evaluations on both simulated and real biological data sets show that this novel framework outperforms current state-of-the-art methods, constituting a light and fast alternative to traditional variational models for segmentation and tracking applications.

Microfluidics for synthetic biology: from design to execution

With the expanding interest in cellular responses to dynamic environments, microfluidic devices have become important experimental platforms for biological research. Microfluidic "microchemostat" devices enable precise environmental control while capturing high quality, single-cell gene expression data. For studies of population heterogeneity and gene expression noise, these abilities are crucial. Here, we describe the necessary steps for experimental microfluidics using devices created in our lab as examples. First, we discuss the rational design of microchemostats and the tools available to predict their performance. We carefully analyze the critical parts of an example device, focusing on the most important part of any microchemostat: the cell trap. Next, we present a method for generating on-chip dynamic environments using an integrated fluidic junction coupled to linear actuators. Our system relies on the simple modulation of hydrostatic pressure to alter the mixing ratio between two source reservoirs and we detail the software and hardware behind it. To expand the throughput of microchemostat experiments, we describe how to build larger, parallel versions of simpler devices. To analyze the large amounts of data, we discuss methods for automated cell tracking, focusing on the special problems presented by Saccharomyces cerevisiae cells. The manufacturing of microchemostats is described in complete detail: from the photolithographic processing of the wafer to the final bonding of the PDMS chip to glass coverslip. Finally, the procedures for conducting Escherichia coli and S. cerevisiae microchemostat experiments are addressed.

Ct3d: tracking microglia motility in 3D using a novel cosegmentation approach

MOTIVATION

Cell tracking is an important method to quantitatively analyze time-lapse microscopy data. While numerous methods and tools exist for tracking cells in 2D time-lapse images, only few and very application-specific tracking tools are available for 3D time-lapse images, which is of high relevance in immunoimaging, in particular for studying the motility of microglia in vivo.

RESULTS

We introduce a novel algorithm for tracking cells in 3D time-lapse microscopy data, based on computing cosegmentations between component trees representing individual time frames using the so-called tree-assignments. For the first time, our method allows to track microglia in three dimensional confocal time-lapse microscopy images. We also evaluate our method on synthetically generated data, demonstrating that our algorithm is robust even in the presence of different types of inhomogeneous background noise.

AVAILABILITY

Our algorithm is implemented in the ct3d package, which is available under http://www.picb.ac.cn/patterns/Software/ct3d; supplementary videos are available from http://www.picb.ac.cn/patterns/Supplements/ct3d.

Fast Graph Partitioning Active Contours for Image Segmentation Using Histograms

We present a method to improve the accuracy and speed, as well as significantly reduce the memory requirements, for the recently proposed Graph Partitioning Active Contours (GPACs) algorithm for image segmentation in the work of Sumengen and Manjunath (2006). Instead of computing an approximate but still expensive dissimilarity matrix of quadratic size, ( N s 2 M s 2 ) ∕ ( n s m s ) , for a 2D image of size N_s ×M_s and regular image tiles of size n_s ×m_s , we use fixed length histograms and an intensity-based symmetric-centrosymmetric extensor matrix to jointly compute terms associated with the complete N_sM_s × N_sM_s dissimilarity matrix. This computationally efficient reformulation of GPAC using a very small memory footprint offers two distinct advantages over the original implementation. It speeds up convergence of the evolving active contour and seamlessly extends performance of GPAC to multidimensional images.

DYNAMIK: a software environment for cell DYNAmics, Motility, and Information tracKing, with an application to Ras pathways

The emergence of new microscopy techniques in combination with the increasing resource of bioimaging data has given fresh impetus to utilizing image processing methods for studying biological processes. Cell tracking studies in particular, which are important for a wide range of biological processes such as embryonic development or the immune system, have recently become the focus of attention. These studies typically produce large volumes of data that are hard to investigate manually and therefore call for an automated approach. Due to the large variety of biological cells and the inhomogeneity of applications, however, there exists no widely accepted method or system for cell tracking until today. In this article, we present our publicly available DYNAMIK software environment that allows users to compute a suit of cell features and plot the trajectory of multiple cells over a sequence of frames. Using chemotaxis and Ras pathways as an example, we show how users can employ our software to compute statistics about cell motility and other cell information, and how to evaluate their test series based on the data computed. We see that DYNAMIK's segmentation and tracking compares favorably with the output produced by other software packages.