A computational framework for particle and whole cell tracking applied to a real biological dataset

Adaptive tracking algorithm for trajectory analysis of cells and layer-by-layer assessment of motility dynamics

Tracking biological objects such as cells or subcellular components imaged with time-lapse microscopy enables us to understand the molecular principles about the dynamics of cell behaviors. However, automatic object detection, segmentation and extracting trajectories remain as a rate-limiting step due to intrinsic challenges of video processing. This paper presents an adaptive tracking algorithm (Adtari) that automatically finds the optimum search radius and cell linkages to determine trajectories in consecutive frames. A critical assumption in most tracking studies is that displacement remains unchanged throughout the movie and cells in a few frames are usually analyzed to determine its magnitude. Tracking errors and inaccurate association of cells may occur if the user does not correctly evaluate the value or prior knowledge is not present on cell movement. The key novelty of our method is that minimum intercellular distance and maximum displacement of cells between frames are dynamically computed and used to determine the threshold distance. Since the space between cells is highly variable in a given frame, our software recursively alters the magnitude to determine all plausible matches in the trajectory analysis. Our method therefore eliminates a major preprocessing step where a constant distance was used to determine the neighbor cells in tracking methods. Cells having multiple overlaps and splitting events were further evaluated by using the shape attributes including perimeter, area, ellipticity and distance. The features were applied to determine the closest matches by minimizing the difference in their magnitudes. Finally, reporting section of our software were used to generate instant maps by overlaying cell features and trajectories. Adtari was validated by using videos with variable signal-to-noise, contrast ratio and cell density. We compared the adaptive tracking with constant distance and other methods to evaluate performance and its efficiency. Our algorithm yields reduced mismatch ratio, increased ratio of whole cell track, higher frame tracking efficiency and allows layer-by-layer assessment of motility to characterize single-cells. Adaptive tracking provides a reliable, accurate, time efficient and user-friendly open source software that is well suited for analysis of 2D fluorescence microscopy video datasets.

A review for Cell and Particle Tracking on Microscopy Images using Algorithms and Deep Learning Technologies

Time-lapse microscopy images generated by biological experiments have been widely used for observing target activities, such as the motion trajectories and survival states. Based on these observations, biologists can conclude experimental results or present new hypotheses for several biological applications, i.e. virus research or drug design. Many methods or tools have been proposed in the past to observe cell and particle activities, which are defined as single cell tracking and single particle tracking problems, by using algorithms and deep learning technologies. In this article, a review for these works is presented in order to summarize the past methods and research topics at first, then points out the problems raised by these works, and finally proposes future research directions. The contributions of this article will help researchers to understand past development trends and further propose innovative technologies.

Investigating Optimal Time Step Intervals of Imaging for Data Quality through a Novel Fully-Automated Cell Tracking Approach

Computer-based fully-automated cell tracking is becoming increasingly important in cell biology, since it provides unrivalled capacity and efficiency for the analysis of large datasets. However, automatic cell tracking’s lack of superior pattern recognition and error-handling capability compared to its human manual tracking counterpart inspired decades-long research. Enormous efforts have been made in developing advanced cell tracking packages and software algorithms. Typical research in this field focuses on dealing with existing data and finding a best solution. Here, we investigate a novel approach where the quality of data acquisition could help improve the accuracy of cell tracking algorithms and vice-versa. Generally speaking, when tracking cell movement, the more frequent the images are taken, the more accurate cells are tracked and, yet, issues such as damage to cells due to light intensity, overheating in equipment, as well as the size of the data prevent a constant data streaming. Hence, a trade-off between the frequency at which data images are collected and the accuracy of the cell tracking algorithms needs to be studied. In this paper, we look at the effects of different choices of the time step interval (i.e., the frequency of data acquisition) within the microscope to our existing cell tracking algorithms. We generate several experimental data sets where the true outcomes are known (i.e., the direction of cell migration) by either using an effective chemoattractant or employing no-chemoattractant. We specify a relatively short time step interval (i.e., 30 s) between pictures that are taken at the data generational stage, so that, later on, we may choose some portion of the images to produce datasets with different time step intervals, such as 1 min, 2 min, and so on. We evaluate the accuracy of our cell tracking algorithms to illustrate the effects of these different time step intervals. We establish that there exist certain relationships between the tracking accuracy and the time step interval associated with experimental microscope data acquisition. We perform fully-automatic adaptive cell tracking on multiple datasets, to identify optimal time step intervals for data acquisition, while at the same time demonstrating the performance of the computer cell tracking algorithms.

Multi-Object Portion Tracking in 4D Fluorescence Microscopy Imagery with Deep Feature Maps

3D fluorescence microscopy of living organisms has increasingly become an essential and powerful tool in biomedical research and diagnosis. An exploding amount of imaging data has been collected, whereas efficient and effective computational tools to extract information from them are still lagging behind. This is largely due to the challenges in analyzing biological data. Interesting biological structures are not only small, but are often morphologically irregular and highly dynamic. Although tracking cells in live organisms has been studied for years, existing tracking methods for cells are not effective in tracking subcellular structures, such as protein complexes, which feature in continuous morphological changes including split and merge, in addition to fast migration and complex motion. In this paper, we first define the problem of multi-object portion tracking to model the protein object tracking process. A multi-object tracking method with portion matching is proposed based on 3D segmentation results. The proposed method distills deep feature maps from deep networks, then recognizes and matches objects' portions using an extended search. Experimental results confirm that the proposed method achieves 2.96% higher on consistent tracking accuracy and 35.48% higher on event identification accuracy than the state-of-art methods.