Review of research on the instance segmentation of cell images

ConfluentFUCCI for fully-automated analysis of cell-cycle progression in a highly dense collective of migrating cells

Understanding mechanisms underlying various physiological and pathological processes often requires accurate and fully automated analysis of dense cell populations that collectively migrate. In such multicellular systems, there is a rising interest in the relations between biophysical and cell cycle progression aspects. A seminal tool that led to a leap in real-time study of cell cycle is the fluorescent ubiquitination-based cell cycle indicator (FUCCI). Here, we introduce ConfluentFUCCI, an open-source graphical user interface-based framework that is designed, unlike previous tools, for fully automated analysis of cell cycle progression, cellular dynamics, and cellular morphology, in highly dense migrating cell collectives. We integrated into ConfluentFUCCI's pipeline state-of-the-art tools such as Cellpose, TrackMate, and Napari, some of which incorporate deep learning, and we wrap the entire tool into an isolated computational environment termed container. This provides an easy installation and workflow that is independent of any specific operation system. ConfluentFUCCI offers accurate nuclear segmentation and tracking using FUCCI tags, enabling comprehensive investigation of cell cycle progression at both the tissue and single-cell levels. We compare ConfluentFUCCI to the most recent relevant tool, showcasing its accuracy and efficiency in handling large datasets. Furthermore, we demonstrate the ability of ConfluentFUCCI to monitor cell cycle transitions, dynamics, and morphology within densely packed epithelial cell populations, enabling insights into mechanotransductive regulation of cell cycle progression. The presented tool provides a robust approach for investigating cell cycle-related phenomena in complex biological systems, offering potential applications in cancer research and other fields.

A Convexity-Preserving Level-Set Method for the Segmentation of Tumor Organoids

Tumor organoid cultures play a crucial role in clinical practice, particularly in guiding medication by accurately determining the morphology and size of the organoids. However, segmenting individual tumor organoids is challenging due to their inhomogeneous internal intensity and overlapping structures. This paper proposes a convexity-preserving level-set segmentation 4 model based on the characteristics of tumor organoid images to segment individual tumor organoids precisely. Considering the predominant spherical shape exhibited by organoid growth, we propose a level-set model that includes a data-driven term, a curvature term, and a regularization term. The data-driven term pulls the contour to the vicinity of the boundary; the curvature term ensures the maintenance of convexity in the targeted segmentation, and the regularization term controls the smoothness and propagation of the contour. The proposed model aids in overcoming interference from factors such as overlap and noise, enabling the evolving curve to converge to the actual boundary of the target accurately. Furthermore, we propose a selectable and targeted initialization method that guarantees precise segmentation of specific regions of interest. Experiments on 51 pancreatic ductal adenocarcinoma organoid images show that our model achieved excellent segmentation results. The average Dice value and computation time are 98.81±0.48% and 20.67 s. Compared with the C-V and CPLSE models, it is more accurate and takes less time.

Generating single-cell gene expression profiles for high-resolution spatial transcriptomics based on cell boundary images

In spatially resolved transcriptomics, Stereo-seq facilitates the analysis of large tissues at the single-cell level, offering subcellular resolution and centimeter-level field-of-view. Our previous work on StereoCell introduced a one-stop software using cell nuclei staining images and statistical methods to generate high-confidence single-cell spatial gene expression profiles for Stereo-seq data. With advancements allowing the acquisition of cell boundary information, such as cell membrane/wall staining images, we updated our software to a new version, STCellbin. Using cell nuclei staining images, STCellbin aligns cell membrane/wall staining images with spatial gene expression maps. Advanced cell segmentation ensures the detection of accurate cell boundaries, leading to more reliable single-cell spatial gene expression profiles. We verified that STCellbin can be applied to mouse liver (cell membranes) and Arabidopsis seed (cell walls) datasets, outperforming other methods. The improved capability of capturing single-cell gene expression profiles results in a deeper understanding of the contribution of single-cell phenotypes to tissue biology.

Availability & Implementation

The source code of STCellbin is available at https://github.com/STOmics/STCellbin.

Organelle-specific phase contrast microscopy (OS-PCM) enables facile correlation study of organelles and proteins

Current methods for studying organelle and protein interactions and correlations depend on multiplex fluorescent labeling, which is experimentally complex and harmful to cells. Here we propose to solve this challenge via OS-PCM, where organelles are imaged and segmented without labels, and combined with standard fluorescence microscopy of protein distributions. In this work, we develop new neural networks to obtain unlabeled organelle, nucleus and membrane predictions from a single 2D image. Automated analysis is also implemented to obtain quantitative information regarding the spatial distribution and co-localization of both protein and organelle, as well as their relationship to the landmark structures of nucleus and membrane. Using mitochondria and DRP1 protein as a proof-of-concept, we conducted a correlation study where only DRP1 is labeled, with results consistent with prior reports utilizing multiplex labeling. Thus our work demonstrates that OS-PCM simplifies the correlation study of organelles and proteins.

Lung nodule segmentation via semi-residual multi-resolution neural networks

The integration of deep neural networks and cloud computing has become increasingly prevalent within the domain of medical image processing, facilitated by the recent strides in neural network theory and the advent of the internet of things (IoTs). This juncture has led to the emergence of numerous image segmentation networks and innovative solutions that facilitate medical practitioners in diagnosing lung cancer. Within the contours of this study, we present an end-to-end neural network model, christened as the "semi-residual Multi-resolution Convolutional Neural Network" (semi-residual MCNN), devised to engender precise lung nodule segmentation maps within the milieu of cloud computing. Central to the architecture are three pivotal features, each coalescing to effectuate a notable enhancement in predictive accuracy: the incorporation of semi-residual building blocks, the deployment of group normalization techniques, and the orchestration of multi-resolution output heads. This innovative model is systematically subjected to rigorous training and testing regimes, using the LIDC-IDRI dataset - a widely embraced and accessible repository - comprising a diverse ensemble of 1,018 distinct lung CT images tailored to the realm of lung nodule segmentation.

Impact of Training Data, Ground Truth and Shape Variability in the Deep Learning-Based Semantic Segmentation of HeLa Cells Observed with Electron Microscopy

This paper investigates the impact of the amount of training data and the shape variability on the segmentation provided by the deep learning architecture U-Net. Further, the correctness of ground truth (GT) was also evaluated. The input data consisted of a three-dimensional set of images of HeLa cells observed with an electron microscope with dimensions 8192×8192×517. From there, a smaller region of interest (ROI) of 2000×2000×300 was cropped and manually delineated to obtain the ground truth necessary for a quantitative evaluation. A qualitative evaluation was performed on the 8192×8192 slices due to the lack of ground truth. Pairs of patches of data and labels for the classes nucleus, nuclear envelope, cell and background were generated to train U-Net architectures from scratch. Several training strategies were followed, and the results were compared against a traditional image processing algorithm. The correctness of GT, that is, the inclusion of one or more nuclei within the region of interest was also evaluated. The impact of the extent of training data was evaluated by comparing results from 36,000 pairs of data and label patches extracted from the odd slices in the central region, to 135,000 patches obtained from every other slice in the set. Then, 135,000 patches from several cells from the 8192×8192 slices were generated automatically using the image processing algorithm. Finally, the two sets of 135,000 pairs were combined to train once more with 270,000 pairs. As would be expected, the accuracy and Jaccard similarity index improved as the number of pairs increased for the ROI. This was also observed qualitatively for the 8192×8192 slices. When the 8192×8192 slices were segmented with U-Nets trained with 135,000 pairs, the architecture trained with automatically generated pairs provided better results than the architecture trained with the pairs from the manually segmented ground truths. This suggests that the pairs that were extracted automatically from many cells provided a better representation of the four classes of the various cells in the 8192×8192 slice than those pairs that were manually segmented from a single cell. Finally, the two sets of 135,000 pairs were combined, and the U-Net trained with these provided the best results.