Instance-Level Microtubule Tracking

SpindlesTracker: An Automatic and Low-Cost Labeled Workflow for Spindle Analysis

Quantitative analysis of spindle dynamics in mitosis through fluorescence microscopy requires tracking spindle elongation in noisy image sequences. Deterministic methods, which use typical microtubule detection and tracking methods, perform poorly in the sophisticated background of spindles. In addition, the expensive data labeling cost also limits the application of machine learning in this field. Here we present a fully automatic and low-cost labeled workflow that efficiently analyzes the dynamic spindle mechanism of time-lapse images, called SpindlesTracker. In this workflow, we design a network named YOLOX-SP which can accurately detect the location and endpoint of each spindle under box-level data supervision. We then optimize the algorithm SORT and MCP for spindle's tracking and skeletonization. As there was no publicly available dataset, we annotated a S.pombe dataset that was entirely acquired from the real world for both training and evaluation. Extensive experiments demonstrate that SpindlesTracker achieves excellent performance in all aspects, while reducing label costs by 60%. Specifically, it achieves 84.1% mAP in spindle detection and over 90% accuracy in endpoint detection. Furthermore, the improved algorithm enhances tracking accuracy by 1.3% and tracking precision by 6.5%. Statistical results also indicate that the mean error of spindle length is within 1 μm. In summary, SpindlesTracker holds significant implications for the study of mitotic dynamic mechanisms and can be readily extended to the analysis of other filamentous objects. The code and the dataset are both released on GitHub.

Segmentation-based tracking of macrophages in 2D＋time microscopy movies inside a living animal

The automated segmentation and tracking of macrophages during their migration are challenging tasks due to their dynamically changing shapes and motions. This paper proposes a new algorithm to achieve automatic cell tracking in time-lapse microscopy macrophage data. First, we design a segmentation method employing space-time filtering, local Otsu's thresholding, and the SUBSURF (subjective surface segmentation) method. Next, the partial trajectories for cells overlapping in the temporal direction are extracted in the segmented images. Finally, the extracted trajectories are linked by considering their direction of movement. The segmented images and the obtained trajectories from the proposed method are compared with those of the semi-automatic segmentation and manual tracking. The proposed tracking achieved 97.4% of accuracy for macrophage data under challenging situations, feeble fluorescent intensity, irregular shapes, and motion of macrophages. We expect that the automatically extracted trajectories of macrophages can provide pieces of evidence of how macrophages migrate depending on their polarization modes in the situation, such as during wound healing.

Tracing and tracking filamentous structures across scales: A systematic review

Filamentous structures are ubiquitous in nature, are studied in diverse scientific fields, and span vastly different spatial scales. Filamentous structures in biological systems fulfill different functions and often form dynamic networks that respond to perturbations. Therefore, characterizing the properties of filamentous structures and the networks they form is important to gain better understanding of systems level functions and dynamics. Filamentous structures are captured by various imaging technologies, and analysis of the resulting imaging data addresses two problems: (i) identification (tracing) of filamentous structures in a single snapshot and (ii) characterizing the dynamics (i.e., tracking) of filamentous structures over time. Therefore, considerable research efforts have been made in developing automated methods for tracing and tracking of filamentous structures. Here, we provide a systematic review in which we present, categorize, and discuss the state-of-the-art methods for tracing and tracking of filamentous structures in sparse and dense networks. We highlight the mathematical approaches, assumptions, and constraints particular for each method, allowing us to pinpoint outstanding challenges and offer perspectives for future research aimed at gaining better understanding of filamentous structures in biological systems.

A survey on applications of deep learning in microscopy image analysis

Advanced microscopy enables us to acquire quantities of time-lapse images to visualize the dynamic characteristics of tissues, cells or molecules. Microscopy images typically vary in signal-to-noise ratios and include a wealth of information which require multiple parameters and time-consuming iterative algorithms for processing. Precise analysis and statistical quantification are often needed for the understanding of the biological mechanisms underlying these dynamic image sequences, which has become a big challenge in the field. As deep learning technologies develop quickly, they have been applied in bioimage processing more and more frequently. Novel deep learning models based on convolution neural networks have been developed and illustrated to achieve inspiring outcomes. This review article introduces the applications of deep learning algorithms in microscopy image analysis, which include image classification, region segmentation, object tracking and super-resolution reconstruction. We also discuss the drawbacks of existing deep learning-based methods, especially on the challenges of training datasets acquisition and evaluation, and propose the potential solutions. Furthermore, the latest development of augmented intelligent microscopy that based on deep learning technology may lead to revolution in biomedical research.

Automated and semi-automated enhancement, segmentation and tracing of cytoskeletal networks in microscopic images: A review

Cytoskeletal filaments are structures of utmost importance to biological cells and organisms due to their versatility and the significant functions they perform. These biopolymers are most often organised into network-like scaffolds with a complex morphology. Understanding the geometrical and topological organisation of these networks provides key insights into their functional roles. However, this non-trivial task requires a combination of high-resolution microscopy and sophisticated image processing/analysis software. The correct analysis of the network structure and connectivity needs precise segmentation of microscopic images. While segmentation of filament-like objects is a well-studied concept in biomedical imaging, where tracing of neurons and blood vessels is routine, there are comparatively fewer studies focusing on the segmentation of cytoskeletal filaments and networks from microscopic images. The developments in the fields of microscopy, computer vision and deep learning, however, began to facilitate the task, as reflected by an increase in the recent literature on the topic. Here, we aim to provide a short summary of the research on the (semi-)automated enhancement, segmentation and tracing methods that are particularly designed and developed for microscopic images of cytoskeletal networks. In addition to providing an overview of the conventional methods, we cover the recently introduced, deep-learning-assisted methods alongside the advantages they offer over classical methods.