Contrastive and uncertainty-aware nuclei segmentation and classification

Nuclei segmentation and classification play a crucial role in pathology diagnosis, enabling pathologists to analyze cellular characteristics accurately. Overlapping cluster nuclei, misdetection of small-scale nuclei, and pleomorphic nuclei-induced misclassification have always been major challenges in the nuclei segmentation and classification tasks. To this end, we introduce an auxiliary task of nuclei boundary-guided contrastive learning to enhance the representativeness and discriminative power of visual features, particularly for addressing the challenge posed by the unclear contours of adherent nuclei and small nuclei. In addition, misclassifications resulting from pleomorphic nuclei often exhibit low classification confidence, indicating a high level of uncertainty. To mitigate misclassification, we capitalize on the characteristic clustering of similar cells to propose a locality-aware class embedding module, offering a regional perspective to capture category information. Moreover, we address uncertain classification in densely aggregated nuclei by designing a top-k uncertainty attention module that leverages deep features to enhance shallow features, thereby improving the learning of contextual semantic information. We demonstrate that the proposed network outperforms the off-the-shelf methods in both nuclei segmentation and classification experiments, achieving the state-of-the-art performance.

HeLa cell segmentation using digital image processing

Computational cell segmentation is a vital area of research, particularly in the analysis of images of cancer cells. The use of cell lines, such as the widely utilized HeLa cell line, is crucial for studying cancer. While deep learning algorithms have been commonly employed for cell segmentation, their resource and data requirements can be impractical for many laboratories. In contrast, image processing algorithms provide a promising alternative due to their effectiveness and minimal resource demands. This article presents the development of an algorithm utilizing digital image processing to segment the nucleus and shape of HeLa cells. The research aims to segment the cell shape in the image center and accurately identify the nucleus. The study uses and processes 300 images obtained from Serial Block-Face Scanning Electron Microscopy (SBF-SEM). For cell segmentation, the morphological operation of erosion was used to separate the cells, and through distance calculation, the cell located at the center of the image was selected. Subsequently, the eroded shape was employed to restore the original cell shape. The nucleus segmentation uses parameters such as distances and sizes, along with the implementation of verification stages to ensure accurate detection. The accuracy of the algorithm is demonstrated by comparing it with another algorithm meeting the same conditions, using four segmentation similarity metrics. The evaluation results rank the proposed algorithm as the superior choice, highlighting significant outcomes. The algorithm developed represents a crucial initial step towards more accurate disease analysis. In addition, it enables the measurement of shapes and the identification of morphological alterations, damages, and changes in organelles within the cell, which can be vital for diagnostic purposes.

SFE-Net: Spatial-Frequency Enhancement Network for robust nuclei segmentation in histopathology images

Morphological features of individual nuclei serve as a dependable foundation for pathologists in making accurate diagnoses. Existing methods that rely on spatial information for feature extraction have achieved commendable results in nuclei segmentation tasks. However, these approaches are not sufficient to extract edge information of nuclei with small sizes and blurred outlines. Moreover, the lack of attention to the interior of the nuclei leads to significant internal inconsistencies. To address these challenges, we introduce a novel Spatial-Frequency Enhancement Network (SFE-Net) to incorporate spatial-frequency features and promote intra-nuclei consistency for robust nuclei segmentation. Specifically, SFE-Net incorporates a distinctive Spatial-Frequency Feature Extraction module and a Spatial-Guided Feature Enhancement module, which are designed to preserve spatial-frequency information and enhance feature representation respectively, to achieve comprehensive extraction of edge information. Furthermore, we introduce the Label-Guided Distillation method, which utilizes semantic features to guide the segmentation network in strengthening boundary constraints and learning the intra-nuclei consistency of individual nuclei, to improve the robustness of nuclei segmentation. Extensive experiments on three publicly available histopathology image datasets (MoNuSeg, TNBC and CryoNuSeg) demonstrate the superiority of our proposed method, which achieves 79.23%, 81.96% and 73.26% Aggregated Jaccard Index, respectively. The proposed model is available at https://github.com/jinshachen/SFE-Net.

Spatial mapping of cellular senescence: emerging challenges and opportunities

Cellular senescence is a well-established driver of aging and age-related diseases. There are many challenges to mapping senescent cells in tissues such as the absence of specific markers and their relatively low abundance and vast heterogeneity. Single-cell technologies have allowed unprecedented characterization of senescence; however, many methodologies fail to provide spatial insights. The spatial component is essential, as senescent cells communicate with neighboring cells, impacting their function and the composition of extracellular space. The Cellular Senescence Network (SenNet), a National Institutes of Health (NIH) Common Fund initiative, aims to map senescent cells across the lifespan of humans and mice. Here, we provide a comprehensive review of the existing and emerging methodologies for spatial imaging and their application toward mapping senescent cells. Moreover, we discuss the limitations and challenges inherent to each technology. We argue that the development of spatially resolved methods is essential toward the goal of attaining an atlas of senescent cells.

Cell region fingerprints enable highly precise single-cell tracking and lineage reconstruction

Experimental studies of cell growth, inheritance and their associated processes by microscopy require accurate single-cell observations of sufficient duration to reconstruct the genealogy. However, cell tracking-assigning identical cells on consecutive images to a track-is often challenging, resulting in laborious manual verification. Here, we propose fingerprints to identify problematic assignments rapidly. A fingerprint distance compares the structural information contained in the low frequencies of a Fourier transform to measure the similarity between cells in two consecutive images. We show that fingerprints are broadly applicable across cell types and image modalities, provided the image has sufficient structural information. Our tracker (Trac^X) uses fingerprints to reject unlikely assignments, thereby increasing tracking performance on published and newly generated long-term data sets. For Saccharomyces cerevisiae, we propose a comprehensive model for cell size control at the single-cell and population level centered on the Whi5 regulator, demonstrating how precise tracking can help uncover previously undescribed single-cell biology.

Live cell microscopy: From image to insight

Live-cell microscopy is a powerful tool that can reveal cellular behavior as well as the underlying molecular processes. A key advantage of microscopy is that by visualizing biological processes, it can provide direct insights. Nevertheless, live-cell imaging can be technically challenging and prone to artifacts. For a successful experiment, many careful decisions are required at all steps from hardware selection to downstream image analysis. Facing these questions can be particularly intimidating due to the requirement for expertise in multiple disciplines, ranging from optics, biophysics, and programming to cell biology. In this review, we aim to summarize the key points that need to be considered when setting up and analyzing a live-cell imaging experiment. While we put a particular focus on yeast, many of the concepts discussed are applicable also to other organisms. In addition, we discuss reporting and data sharing strategies that we think are critical to improve reproducibility in the field.

In vivo study of dose-dependent antioxidant efficacy of functionalized core-shell yttrium oxide nanoparticles

Abstract

Herein, we assess the dose-dependent antioxidant efficacy of ultrafine spherical functionalized core–shell yttrium oxide nanoparticles (YNPs) with a mean size of 7–8 nm and modified with poly EGMP (ethylene glycol methacrylate phosphate) and N-Fluorescein Acrylamide. The antioxidant properties of these nanoparticles were investigated in three groups of Sprague–Dawley rats (10 per group) exposed to environmental stress daily for 1 week and one control group. Groups 2 and 3 were intravenously injected twice a week with YNPs at 0.3 and 0.5 mg at 2nd and 5th day of environmental stress exposure respectively. Different samples of blood and serum were collected from all experimental groups at end of the experiment to measure oxidative biomarkers such as total antioxidant capacity (TAC), hydroxyl radical antioxidant capacity (HORAC), oxygen radical antioxidant capacity (ORAC), malondialdehyde (MDA), and oxidants concentration as hydrogen peroxide (H₂O₂). The liver, brain, and spleen tissues were collected for fluorescence imaging and histopathological examination in addition to brain tissue examination by transmission electron microscope (TEM). Inductively coupled plasma-mass spectrometry (ICP-MS) was used to estimate YNPs translocation and concentration in tissues which is consecutively dependent on the dose of administration. Depending on all results, poly EGMP YNPs (poly EGMP yttrium oxide nanoparticles) can act as a potent direct antioxidant in a dose-dependent manner with good permeability through blood–brain barrier (BBB). Also, the neuroprotective effect of YNPs opening the door to a new therapeutic approach for modulating oxidative stress–related neural disorders.

Highlights

• The dose-dependent antioxidant efficacy of ultrafine spherical functionalized core–shell yttrium oxide nanoparticles (YNPs) with a mean size of 7–8 nm and modified with poly EGMP (ethylene glycol methacrylate phosphate) and N-Fluorescein Acrylamide was assessed.

• The dose of administration directly affecting the brain, liver, and spleen tissues distribution, retention, and uptake of YNPs and direct correlation between the absorbed amount and higher dose administered.

• YNPs can act as a potent direct antioxidant in a dose-dependent manner with good permeability through blood–brain barrier (BBB).

Graphical abstract

Supplementary Information

The online version contains supplementary material available at 10.1007/s00210-022-02219-1.

Membrane marker selection for segmenting single cell spatial proteomics data

The ability to profile spatial proteomics at the single cell level enables the study of cell types, their spatial distribution, and interactions in several tissues and conditions. Current methods for cell segmentation in such studies rely on known membrane or cell boundary markers. However, for many tissues, an optimal set of markers is not known, and even within a tissue, different cell types may express different markers. Here we present RAMCES, a method that uses a convolutional neural network to learn the optimal markers for a new sample and outputs a weighted combination of the selected markers for segmentation. Testing RAMCES on several existing datasets indicates that it correctly identifies cell boundary markers, improving on methods that rely on a single marker or those that extend nuclei segmentations. Application to new spatial proteomics data demonstrates its usefulness for accurately assigning cell types based on the proteins expressed in segmented cells.

Cell segmentation of single-cell spatial proteomics data remains a challenge and often relies on the selection of a membrane marker, which is not always known. Here, the authors introduce RAMCES, a method that selects the optimal membrane markers to use for more accurate cell segmentation.

A convolutional neural network for segmentation of yeast cells without manual training annotations

MOTIVATION

Single-cell time-lapse microscopy is a ubiquitous tool for studying the dynamics of complex cellular processes. While imaging can be automated to generate very large volumes of data, the processing of the resulting movies to extract high-quality single-cell information remains a challenging task. The development of software tools that automatically identify and track cells is essential for realizing the full potential of time-lapse microscopy data. Convolutional neural networks (CNNs) are ideally suited for such applications, but require great amounts of manually annotated data for training, a time-consuming and tedious process.

RESULTS

We developed a new approach to CNN training for yeast cell segmentation based on synthetic data and present (i) a software tool for the generation of synthetic images mimicking brightfield images of budding yeast cells and (ii) a convolutional neural network (Mask R-CNN) for yeast segmentation that was trained on a fully synthetic dataset. The Mask R-CNN performed excellently on segmenting actual microscopy images of budding yeast cells, and a density-based spatial clustering algorithm (DBSCAN) was able to track the detected cells across the frames of microscopy movies. Our synthetic data creation tool completely bypassed the laborious generation of manually annotated training datasets, and can be easily adjusted to produce images with many different features. The incorporation of synthetic data creation into the development pipeline of CNN-based tools for budding yeast microscopy is a critical step toward the generation of more powerful, widely applicable and user-friendly image processing tools for this microorganism.

AVAILABILITY AND IMPLEMENTATION

The synthetic data generation code can be found at https://github.com/prhbrt/synthetic-yeast-cells. The Mask R-CNN as well as the tuning and benchmarking scripts can be found at https://github.com/ymzayek/yeastcells-detection-maskrcnn. We also provide Google Colab scripts that reproduce all the results of this work.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Ice2 promotes ER membrane biogenesis in yeast by inhibiting the conserved lipin phosphatase complex

Cells dynamically adapt organelle size to current physiological demand. Organelle growth requires membrane biogenesis and therefore needs to be coordinated with lipid metabolism. The endoplasmic reticulum (ER) can undergo massive expansion, but the underlying regulatory mechanisms are largely unclear. Here, we describe a genetic screen for factors involved in ER membrane expansion in budding yeast and identify the ER transmembrane protein Ice2 as a strong hit. We show that Ice2 promotes ER membrane biogenesis by opposing the phosphatidic acid phosphatase Pah1, called lipin in metazoa. Specifically, Ice2 inhibits the conserved Nem1‐Spo7 complex and thus suppresses the dephosphorylation and activation of Pah1. Furthermore, Ice2 cooperates with the transcriptional regulation of lipid synthesis genes and helps to maintain cell homeostasis during ER stress. These findings establish the control of the lipin phosphatase complex as an important mechanism for regulating ER membrane biogenesis.

Yeast cell segmentation in microstructured environments with deep learning

Cell segmentation is a major bottleneck in extracting quantitative single-cell information from microscopy data. The challenge is exasperated in the setting of microstructured environments. While deep learning approaches have proven useful for general cell segmentation tasks, previously available segmentation tools for the yeast-microstructure setting rely on traditional machine learning approaches. Here we present convolutional neural networks trained for multiclass segmenting of individual yeast cells and discerning these from cell-similar microstructures. An U-Net based semantic segmentaiton approach, as well as a direct instance segmentation approach with a Mask R-CNN are demonstrated. We give an overview of the datasets recorded for training, validating and testing the networks, as well as a typical use-case. We showcase the methods' contribution to segmenting yeast in microstructured environments with a typical systems or synthetic biology application. The models achieve robust segmentation results, outperforming the previous state-of-the-art in both accuracy and speed. The combination of fast and accurate segmentation is not only beneficial for a posteriori data processing, it also makes online monitoring of thousands of trapped cells or closed-loop optimal experimental design feasible from an image processing perspective. Code is and data samples are available at https://git.rwth-aachen.de/bcs/projects/tp/multiclass-yeast-seg.

A review for Cell and Particle Tracking on Microscopy Images using Algorithms and Deep Learning Technologies

Time-lapse microscopy images generated by biological experiments have been widely used for observing target activities, such as the motion trajectories and survival states. Based on these observations, biologists can conclude experimental results or present new hypotheses for several biological applications, i.e. virus research or drug design. Many methods or tools have been proposed in the past to observe cell and particle activities, which are defined as single cell tracking and single particle tracking problems, by using algorithms and deep learning technologies. In this article, a review for these works is presented in order to summarize the past methods and research topics at first, then points out the problems raised by these works, and finally proposes future research directions. The contributions of this article will help researchers to understand past development trends and further propose innovative technologies.

Advances in spatial transcriptomic data analysis

Spatial transcriptomics is a rapidly growing field that promises to comprehensively characterize tissue organization and architecture at the single-cell or subcellular resolution. Such information provides a solid foundation for mechanistic understanding of many biological processes in both health and disease that cannot be obtained by using traditional technologies. The development of computational methods plays important roles in extracting biological signals from raw data. Various approaches have been developed to overcome technology-specific limitations such as spatial resolution, gene coverage, sensitivity, and technical biases. Downstream analysis tools formulate spatial organization and cell-cell communications as quantifiable properties, and provide algorithms to derive such properties. Integrative pipelines further assemble multiple tools in one package, allowing biologists to conveniently analyze data from beginning to end. In this review, we summarize the state of the art of spatial transcriptomic data analysis methods and pipelines, and discuss how they operate on different technological platforms.

Rapid prototyping and design of cybergenetic single-cell controllers

The design and implementation of synthetic circuits that operate robustly in the cellular context is fundamental for the advancement of synthetic biology. However, their practical implementation presents challenges due to low predictability of synthetic circuit design and time-intensive troubleshooting. Here, we present the Cyberloop, a testing framework to accelerate the design process and implementation of biomolecular controllers. Cellular fluorescence measurements are sent in real-time to a computer simulating candidate stochastic controllers, which in turn compute the control inputs and feed them back to the controlled cells via light stimulation. Applying this framework to yeast cells engineered with optogenetic tools, we examine and characterize different biomolecular controllers, test the impact of non-ideal circuit behaviors such as dilution on their operation, and qualitatively demonstrate improvements in controller function with certain network modifications. From this analysis, we derive conditions for desirable biomolecular controller performance, thereby avoiding pitfalls during its biological implementation.

Automatic Improvement of Deep Learning Based Cell Segmentation in Time-Lapse Microscopy by Neural Architecture Search

Motivation

Live cell segmentation is a crucial step in biological image analysis and is also a challenging task because time-lapse microscopy cell sequences usually exhibit complex spatial structures and complicated temporal behaviors. In recent years, numerous deep learning-based methods have been proposed to tackle this task and obtained promising results. However, designing a network with excellent performance requires professional knowledge and expertise and is very time-consuming and labor-intensive. Recently emerged neural architecture search (NAS) methods hold great promise in eliminating these disadvantages, because they can automatically search an optimal network for the task.

Results

We propose a novel NAS-based solution for deep learning-based cell segmentation in time-lapse microscopy images. Different from current NAS methods, we propose (i) jointly searching non-repeatable micro architectures to construct the macro network for exploring greater NAS potential and better performance and (ii) defining a specific search space suitable for the live cell segmentation task, including the incorporation of a convolutional long short-term memory network for exploring the temporal information in time-lapse sequences. Comprehensive evaluations on the 2D datasets from the cell tracking challenge demonstrate the competitiveness of the proposed method compared to the state of the art. The experimental results show that the method is capable of achieving more consistent top performance across all ten datasets than the other challenge methods.

Availabilityand implementation

The executable files of the proposed method as well as configurations for each dataset used in the presented experiments will be available for non-commercial purposes from https://github.com/291498346/nas_cellseg.

Supplementary information

Supplementary data are available at Bioinformatics online.

Automatic segmentation of skin cells in multiphoton data using multi-stage merging

We propose a novel automatic segmentation algorithm that separates the components of human skin cells from the rest of the tissue in fluorescence data of three-dimensional scans using non-invasive multiphoton tomography. The algorithm encompasses a multi-stage merging on preprocessed superpixel images to ensure independence from a single empirical global threshold. This leads to a high robustness of the segmentation considering the depth-dependent data characteristics, which include variable contrasts and cell sizes. The subsequent classification of cell cytoplasm and nuclei are based on a cell model described by a set of four features. Two novel features, a relationship between outer cell and inner nucleus (OCIN) and a stability index, were derived. The OCIN feature describes the topology of the model, while the stability index indicates segment quality in the multi-stage merging process. These two new features, combined with the local gradient magnitude and compactness, are used for the model-based fuzzy evaluation of the cell segments. We exemplify our approach on an image stack with 200 × 200 × 100  μm³, including the skin layers of the stratum spinosum and the stratum basale of a healthy volunteer. Our image processing pipeline contributes to the fully automated classification of human skin cells in multiphoton data and provides a basis for the detection of skin cancer using non-invasive optical biopsy.

Deep Neural Networks Offer Morphologic Classification and Diagnosis of Bacterial Vaginosis

Bacterial vaginosis (BV) is caused by the excessive and imbalanced growth of bacteria in vagina, affecting 30 to 50% of women. Gram staining followed by Nugent scoring based on bacterial morphotypes under the microscope is considered the gold standard for BV diagnosis; this method is often labor-intensive and time-consuming, and results vary from person to person. We developed and optimized a convolutional neural network (CNN) model and evaluated its ability to automatically identify and classify three categories of Nugent scores from microscope images. The CNN model was first established with a panel of microscopic images with Nugent scores determined by experts. The model was trained by minimizing the cross-entropy loss function and optimized by using a momentum optimizer. The separate test sets of images collected from three hospitals were evaluated by the CNN model. The CNN model consisted of 25 convolutional layers, 2 pooling layers, and a fully connected layer. The model obtained 82.4% sensitivity and 96.6% specificity with the 5,815 validation images when altered vaginal flora and BV were considered the positive samples, which was better than the rates achieved by top-level technologists and obstetricians in China. The capability of our model for generalization was so strong that it exhibited 75.1% accuracy in three categories of Nugent scores on the independent test set of 1,082 images, which was 6.6% higher than the average of three technologists, who are hold bachelor's degrees in medicine and are qualified to make diagnostic decisions. When three technologists ran one specimen in triplicate, the precision of three categories of Nugent scores was 54.0%. One hundred three samples diagnosed by two technologists on different days showed a repeatability of 90.3%. The CNN model outperformed human health care practitioners in terms of accuracy and stability for three categories of Nugent score diagnosis. The deep learning model may offer translational applications in automating diagnosis of bacterial vaginosis with proper supporting hardware.

A Cyber-Physical Platform for Model Calibration

Synthetic biology has so far made limited use of mathematical models, mostly because their inference has been traditionally perceived as expensive and/or difficult. We have recently demonstrated how in silico simulations and in vitro/vivo experiments can be integrated to develop a cyber-physical platform that automates model calibration and leads to saving 60-80% of the effort. In this book chapter, we illustrate the protocol used to attain such results. By providing a comprehensive list of steps and pointing the reader to the code we use to operate our platform, we aim at providing synthetic biologists with an additional tool to accelerate the pace at which the field progresses toward applications.

Improved efficiency of urine cell image segmentation using droplet microfluidics technology

Recent advances in the recognition of biological samples using machine vision have made this technology increasingly important in research and detection. Image segmentation is an important step in this process. This study focuses on how to reduce the interference factors such as the overlap between different types (or within the same type) of urine cells according to microfluidics and improve the machine vision segmentation accuracy for cell images. In this study, we demonstrate that the platform can realize this hypothesis using urine cell image segmentation as an example application. We first discuss the reported urine cell droplet microfluidic chip system, which can realize the test conditions in which urine cells are encapsulated in the droplet and isolated from salt crystallization and/or bacteria and other urine-formed elements. Then, based on the analysis conditions set in the aforementioned experiment, the proportions of red blood cells, white blood cells, and squamous epithelial cells covered by various formed elements in the total urine cells in the same urine sample are measured. We simultaneously analyze the percentage of urine cells covered by salt crystallization and the incidence of overlapping between urine cells. Finally, the Otsu algorithm is used to segment the urine cell images encapsulated by the droplet and the urine cell images not encapsulated by the droplet, and the Dice, Jaccard, precision, and recall values are calculated. The results suggest that the method of encapsulating single cells based on droplets can improve the image segmentation effect without optimizing the algorithm.

Deep-learning-based three-dimensional label-free tracking and analysis of immunological synapses of CAR-T cells

The immunological synapse (IS) is a cell-cell junction between a T cell and a professional antigen-presenting cell. Since the IS formation is a critical step for the initiation of an antigen-specific immune response, various live-cell imaging techniques, most of which rely on fluorescence microscopy, have been used to study the dynamics of IS. However, the inherent limitations associated with the fluorescence-based imaging, such as photo-bleaching and photo-toxicity, prevent the long-term assessment of dynamic changes of IS with high frequency. Here, we propose and experimentally validate a label-free, volumetric, and automated assessment method for IS dynamics using a combinational approach of optical diffraction tomography and deep learning-based segmentation. The proposed method enables an automatic and quantitative spatiotemporal analysis of IS kinetics of morphological and biochemical parameters associated with IS dynamics, providing a new option for immunological research.

Establishment of a morphological atlas of the Caenorhabditis elegans embryo using deep-learning-based 4D segmentation

The invariant development and transparent body of the nematode Caenorhabditis elegans enables complete delineation of cell lineages throughout development. Despite extensive studies of cell division, cell migration and cell fate differentiation, cell morphology during development has not yet been systematically characterized in any metazoan, including C. elegans. This knowledge gap substantially hampers many studies in both developmental and cell biology. Here we report an automatic pipeline, CShaper, which combines automated segmentation of fluorescently labeled membranes with automated cell lineage tracing. We apply this pipeline to quantify morphological parameters of densely packed cells in 17 developing C. elegans embryos. Consequently, we generate a time-lapse 3D atlas of cell morphology for the C. elegans embryo from the 4- to 350-cell stages, including cell shape, volume, surface area, migration, nucleus position and cell-cell contact with resolved cell identities. We anticipate that CShaper and the morphological atlas will stimulate and enhance further studies in the fields of developmental biology, cell biology and biomechanics.

The systematic characterization of C. elegans morphology during development has yet to be performed. Here, the authors produce a 3D atlas of C. elegans morphology from 17 embryos and 54 developmental stages, using an automated pipeline, CShaper (combining segmentation of fluorescently labeled membranes with automated cell lineage tracing).

Guided filter based image enhancement for focal error compensation in low cost automated histopathology microscopic system

Low-cost automated histopathology microscopy systems usually suffer from optical imperfections, producing images that are slightly Out of Focus (OoF). In this work, a guided filter (GF) based image preprocessing is proposed for compensating focal errors and its efficacy is demonstrated on images of healthy and malaria infected red blood cells (h-RBCs and i-RBCs), and PAP smears. Since contrast enhancement has been widely used as an image preprocessing step for the analysis of histopathology images, a systematic comparison is made with six such prominently used methods, namely Contrast Limited Adaptive Histogram Equalization (CLAHE), RIQMC-based optimal histogram matching (ROHIM), modified L₀, Morphological Varying(MV)-Bitonic filter, unsharp mask filter and joint bilateral filter. The images enhanced using GF approach lead to better segmentation accuracy (upto 50% improvement over native images) and visual quality compared to other approaches, without any change in the color tones. Thus, the proposed GF approach is a viable solution for rectifying the OoF microscopy images without the loss of the valuable diagnostic information presented by the color tone.

Pomegranate: 2D segmentation and 3D reconstruction for fission yeast and other radially symmetric cells

Three-dimensional (3D) segmentation of cells in microscopy images is crucial to accurately capture signals that extend across optical sections. Using brightfield images for segmentation has the advantage of being minimally phototoxic and leaving all other channels available for signals of interest. However, brightfield images only readily provide information for two-dimensional (2D) segmentation. In radially symmetric cells, such as fission yeast and many bacteria, this 2D segmentation can be computationally extruded into the third dimension. However, current methods typically make the simplifying assumption that cells are straight rods. Here, we report Pomegranate, a pipeline that performs the extrusion into 3D using spheres placed along the topological skeletons of the 2D-segmented regions. The diameter of these spheres adapts to the cell diameter at each position. Thus, Pomegranate accurately represents radially symmetric cells in 3D even if cell diameter varies and regardless of whether a cell is straight, bent or curved. We have tested Pomegranate on fission yeast and demonstrate its ability to 3D segment wild-type cells as well as classical size and shape mutants. The pipeline is available as a macro for the open-source image analysis software Fiji/ImageJ. 2D segmentations created within or outside Pomegranate can serve as input, thus making this a valuable extension to the image analysis portfolio already available for fission yeast and other radially symmetric cell types.

A novel automatic segmentation and tracking method to measure cellular dielectrophoretic mobility from individual cell trajectories for high throughput assay

BACKGROUND AND OBJECTIVE

The dielectrophoresis (DEP) technique is increasingly being recognised as a potentially valuable tool for non-contact manipulation of numerous cells as well as for biological single cell analysis with non-invasive characterisation of a cell's electrical properties. Several studies have attempted to track multiple cells to characterise their cellular DEP mobility. However, they encountered difficulties in simultaneously tracking the movement of a large number of individual cells in a bright-field image sequence because of interference from the background electrode pattern. Consequently, this present study aims to develop an automatic system for imaging-based characterisation of cellular DEP mobility, which enables the simultaneous tracking of several hundred of cells inside a microfluidic device.

METHODS

The proposed method for segmentation and tracking of cells consists of two main stages: pre-processing and particle centre localisation. In the pre-processing stage, background subtraction and contrast enhancement were performed to distinguish the cell region from the background image. In the particle centre localisation stage, the unmarked cell was automatically detected via graph-cut algorithm-based K-means clustering.

RESULTS

Our algorithm enabled segmentation and tracking of numerous Michigan Cancer Foundation-7 (MCF-7) cell trajectories while the DEP force was oscillated between positive and negative. The cell tracking accuracy and cell count capability was at least 90% of the total number of cells with the newly developed algorithm. In addition, the cross-over frequency was measured by analysing the segmented and tracked trajectory data of the cellular movements caused by the positive and negative DEP force. The measured cross-over frequency was compared with previous results. The multi-cellular movements investigation based on the measured cross-over frequency was repeated until the viability of cells was unchanged in the same environment as in a microfluidic device. The results were statistically consistent, indicating that the developed algorithm was reliable for the investigation of DEP cellular mobility.

CONCLUSION

This study developed a powerful platform to simultaneously measure the DEP-induced trajectories of numerous cells, and to investigate in a robust, efficient, and accurate manner the DEP properties at both the single cell and cell ensemble level.

Detection and segmentation of morphologically complex eukaryotic cells in fluorescence microscopy images via feature pyramid fusion

Detection and segmentation of macrophage cells in fluorescence microscopy images is a challenging problem, mainly due to crowded cells, variation in shapes, and morphological complexity. We present a new deep learning approach for cell detection and segmentation that incorporates previously learned nucleus features. A novel fusion of feature pyramids for nucleus detection and segmentation with feature pyramids for cell detection and segmentation is used to improve performance on a microscopic image dataset created by us and provided for public use, containing both nucleus and cell signals. Our experimental results indicate that cell detection and segmentation performance significantly benefit from the fusion of previously learned nucleus features. The proposed feature pyramid fusion architecture clearly outperforms a state-of-the-art Mask R-CNN approach for cell detection and segmentation with relative mean average precision improvements of up to 23.88% and 23.17%, respectively.

YeastSpotter: accurate and parameter-free web segmentation for microscopy images of yeast cells

SUMMARY

We introduce YeastSpotter, a web application for the segmentation of yeast microscopy images into single cells. YeastSpotter is user-friendly and generalizable, reducing the computational expertise required for this critical preprocessing step in many image analysis pipelines.

AVAILABILITY AND IMPLEMENTATION

YeastSpotter is available at http://yeastspotter.csb.utoronto.ca/. Code is available at https://github.com/alexxijielu/yeast_segmentation.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Biocompatibility and biodistribution of surface-modified yttrium oxide nanoparticles for potential theranostic applications

The surface of ultrafine yttrium oxide nanoparticles (NPs) with mean size of 7-8 nm was modified with a functional polymer layer to improve their dispersion and impart fluorescent properties for imaging purposes. Surface functionalization was achieved by silanization of yttrium oxide NPs with 3-trimethoxysilylpropyl methacrylate followed by grafting of a co-polymer made of acrylic acid (AA) and ethylene glycol methacrylate phosphate (EGMP). The polymer shell decreases the surface energy of NPs, enhances their polarity, and, as a result, improves their colloidal stability. The synthesized NPs are capable of scavenging free radicals and for this reason have therapeutic potential that warrants further investigations. Furthermore, these stabilized core-shell NPs showed a very low cytotoxicity, confirming that the polymer shell sensibly improves the biocompatibility of bare yttrium oxide NPs, which are otherwise toxic on their own. Poly-EGMP yttrium NPs proved to be safe up to 0.1 mg/g body weight in 1 month old Sprague-Dawley rats, showing also the ability to cross the blood-brain barrier short time after tail injection. The surface modification of yttrium NPs here described allows these NPs to be potentially used in theranostics to reduce neurodegenerative damage due to the heat stress.

Cell-in-the-loop pattern formation with optogenetically emulated cell-to-cell signaling

Designing and implementing synthetic biological pattern formation remains challenging due to underlying theoretical complexity as well as the difficulty of engineering multicellular networks biochemically. Here, we introduce a cell-in-the-loop approach where living cells interact through in silico signaling, establishing a new testbed to interrogate theoretical principles when internal cell dynamics are incorporated rather than modeled. We present an easy-to-use theoretical test to predict the emergence of contrasting patterns in gene expression among laterally inhibiting cells. Guided by the theory, we experimentally demonstrate spontaneous checkerboard patterning in an optogenetic setup, where cell-to-cell signaling is emulated with light inputs calculated in silico from real-time gene expression measurements. The scheme successfully produces spontaneous, persistent checkerboard patterns for systems of sixteen patches, in quantitative agreement with theoretical predictions. Our research highlights how tools from dynamical systems theory may inform our understanding of patterning, and illustrates the potential of cell-in-the-loop for engineering synthetic multicellular systems.

Reprint of "Multi-modal image cytometry approach - From dynamic to whole organ imaging"

Optical imaging is a valuable tool to visualise biological processes in the context of the tissue. Each imaging modality provides the biologist with different types of information - cell dynamics and migration over time can be tracked with time-lapse imaging (e.g. intra-vital imaging); an overview of whole tissues can be acquired using optical clearing in conjunction with light sheet microscopy; finer details such as cellular morphology and fine nerve tortuosity can be imaged at higher resolution using the confocal microscope. Multi-modal imaging combined with image cytometry - a form of quantitative analysis of image datasets - provides an objective basis for comparing between sample groups. Here, we provide an overview of technical aspects to look out for in an image cytometry workflow, and discuss issues related to sample preparation, image post-processing and analysis for intra-vital and whole organ imaging.

Acute ethanol exposure reduces serotonin receptor 1A internalization by increasing ubiquitination and degradation of β-arrestin2

Acute alcohol exposure alters the trafficking and function of many G-protein-coupled receptors (GPCRs) that are associated with aberrant behavioral responses to alcohol. However, the molecular mechanisms underlying alcohol-induced changes in GPCR function remain unclear. β-Arrestin is a key player involved in the regulation of GPCR internalization and thus controls the magnitude and duration of GPCR signaling. Although β-arrestin levels are influenced by various drugs of abuse, the effect of alcohol exposure on β-arrestin expression and β-arrestin-mediated GPCR trafficking is poorly understood. Here, we found that acute ethanol exposure increases β-arrestin2 degradation via its increased ubiquitination in neuroblastoma-2a (N2A) cells and rat prefrontal cortex (PFC). β-Arrestin2 ubiquitination was likely mediated by the E3 ligase MDM2 homolog (MDM2), indicated by an increased coupling between β-arrestin2 and MDM2 in response to acute ethanol exposure in both N2A cells and rat PFC homogenates. Importantly, ethanol-induced β-arrestin2 reduction was reversed by siRNA-mediated MDM2 knockdown or proteasome inhibition in N2A cells, suggesting β-arrestin2 degradation is mediated by MDM2 through the proteasomal pathway. Using serotonin 5-HT1A receptors (5-HT1ARs) as a model receptor system, we found that ethanol dose-dependently inhibits 5-HT1AR internalization and that MDM2 knockdown reverses this effect. Moreover, ethanol both reduced β-arrestin2 levels and delayed agonist-induced β-arrestin2 recruitment to the membrane. We conclude that β-arrestin2 dysregulation by ethanol impairs 5-HT1AR trafficking. Our findings reveal a critical molecular mechanism underlying ethanol-induced alterations in GPCR internalization and implicate β-arrestin as a potential player mediating behavioral responses to acute alcohol exposure.

Exemplar-Based Recursive Instance Segmentation With Application to Plant Image Analysis

Instance segmentation is a challenging computer vision problem which lies at the intersection of object detection and semantic segmentation. Motivated by plant image analysis in the context of plant phenotyping, a recently emerging application field of computer vision, this paper presents the Exemplar-Based Recursive Instance Segmentation (ERIS) framework. A three-layer probabilistic model is firstly introduced to jointly represent hypotheses, voting elements, instance labels and their connections. Afterwards, a recursive optimization algorithm is developed to infer the maximum a posteriori (MAP) solution, which handles one instance at a time by alternating among the three steps of detection, segmentation and update. The proposed ERIS framework departs from previous works mainly in two respects. First, it is exemplar-based and model-free, which can achieve instance-level segmentation of a specific object class given only a handful of (typically less than 10) annotated exemplars. Such a merit enables its use in case that no massive manually-labeled data is available for training strong classification models, as required by most existing methods. Second, instead of attempting to infer the solution in a single shot, which suffers from extremely high computational complexity, our recursive optimization strategy allows for reasonably efficient MAP-inference in full hypothesis space. The ERIS framework is substantialized for the specific application of plant leaf segmentation in this work. Experiments are conducted on public benchmarks to demonstrate the superiority of our method in both effectiveness and efficiency in comparison with the state-of-the-art.

Cell segmentation methods for label-free contrast microscopy: review and comprehensive comparison

BACKGROUND

Because of its non-destructive nature, label-free imaging is an important strategy for studying biological processes. However, routine microscopic techniques like phase contrast or DIC suffer from shadow-cast artifacts making automatic segmentation challenging. The aim of this study was to compare the segmentation efficacy of published steps of segmentation work-flow (image reconstruction, foreground segmentation, cell detection (seed-point extraction) and cell (instance) segmentation) on a dataset of the same cells from multiple contrast microscopic modalities.

RESULTS

We built a collection of routines aimed at image segmentation of viable adherent cells grown on the culture dish acquired by phase contrast, differential interference contrast, Hoffman modulation contrast and quantitative phase imaging, and we performed a comprehensive comparison of available segmentation methods applicable for label-free data. We demonstrated that it is crucial to perform the image reconstruction step, enabling the use of segmentation methods originally not applicable on label-free images. Further we compared foreground segmentation methods (thresholding, feature-extraction, level-set, graph-cut, learning-based), seed-point extraction methods (Laplacian of Gaussians, radial symmetry and distance transform, iterative radial voting, maximally stable extremal region and learning-based) and single cell segmentation methods. We validated suitable set of methods for each microscopy modality and published them online.

CONCLUSIONS

We demonstrate that image reconstruction step allows the use of segmentation methods not originally intended for label-free imaging. In addition to the comprehensive comparison of methods, raw and reconstructed annotated data and Matlab codes are provided.

DSeg: A Dynamic Image Segmentation Program to Extract Backbone Patterns for Filamentous Bacteria and Hyphae Structures

Analysis of numerous filamentous structures in an image is often limited by the ability of algorithms to accurately segment complex structures or structures within a dense population. It is even more problematic if these structures continuously grow when recording a time-series of images. To overcome these issues we present DSeg; an image analysis program designed to process time-series image data, as well as single images, to segment filamentous structures. The program includes a robust binary level-set algorithm modified to use size constraints, edge intensity, and past information. We verify our algorithms using synthetic data, differential interference contrast images of filamentous prokaryotes, and transmission electron microscopy images of bacterial adhesion fimbriae. DSeg includes automatic segmentation, tools for analysis, and drift correction, and outputs statistical data such as persistence length, growth rate, and growth direction. The program is available at Sourceforge.

Quantitative Determination of Cellular-and Neurite Motility Speed in Dense Cell Cultures

Mobility quantification of single cells and cellular processes in dense cultures is a challenge, because single cell tracking is impossible. We developed a software for cell structure segmentation and implemented 2 algorithms to measure motility speed. Complex algorithms were tested to separate cells and cellular components, an important prerequisite for the acquisition of meaningful motility data. Plasma membrane segmentation was performed to measure membrane contraction dynamics and organelle trafficking. The discriminative performance and sensitivity of the algorithms were tested on different cell types and calibrated on computer-simulated cells to obtain absolute values for cellular velocity. Both motility algorithms had advantages in different experimental setups, depending on the complexity of the cellular movement. The correlation algorithm (COPRAMove) performed best under most tested conditions and appeared less sensitive to variable cell densities, brightness and focus changes than the differentiation algorithm (DiffMove). In summary, our software can be used successfully to analyze and quantify cellular and subcellular movements in dense cell cultures.

Segmentation of Heavily Clustered Nuclei from Histopathological Images

Automated cell nucleus segmentation is the key to gain further insight into cell features and functionality which support computer-aided pathology in early diagnosis of diseases such as breast cancer and brain tumour. Despite considerable advances in automated segmentation, it still remains a challenging task to split heavily clustered nuclei due to intensity variations caused by noise and uneven absorption of stains. To address this problem, we propose a novel method applicable to variety of histopathological images stained for different proteins, with high speed, accuracy and level of automation. Our algorithm is initiated by applying a new locally adaptive thresholding method on watershed regions. Followed by a new splitting technique based on multilevel thresholding and the watershed algorithm to separate clustered nuclei. Finalized by a model-based merging step to eliminate oversegmentation and a model-based correction step to improve segmentation results and eliminate small objects. We have applied our method to three image datasets: breast cancer stained for hematoxylin and eosin (H&E), Drosophila Kc167 cells stained for DNA to label nuclei, and mature neurons stained for NeuN. Evaluated results show our method outperforms the state-of-the-art methods in terms of accuracy, precision, F1-measure, and computational time.

An Optogenetic Platform for Real-Time, Single-Cell Interrogation of Stochastic Transcriptional Regulation

Transcription is a highly regulated and inherently stochastic process. The complexity of signal transduction and gene regulation makes it challenging to analyze how the dynamic activity of transcriptional regulators affects stochastic transcription. By combining a fast-acting, photo-regulatable transcription factor with nascent RNA quantification in live cells and an experimental setup for precise spatiotemporal delivery of light inputs, we constructed a platform for the real-time, single-cell interrogation of transcription in Saccharomyces cerevisiae. We show that transcriptional activation and deactivation are fast and memoryless. By analyzing the temporal activity of individual cells, we found that transcription occurs in bursts, whose duration and timing are modulated by transcription factor activity. Using our platform, we regulated transcription via light-driven feedback loops at the single-cell level. Feedback markedly reduced cell-to-cell variability and led to qualitative differences in cellular transcriptional dynamics. Our platform establishes a flexible method for studying transcriptional dynamics in single cells.

A Simple and Flexible Computational Framework for Inferring Sources of Heterogeneity from Single-Cell Dynamics

Single-cell time-lapse data provide the means for disentangling sources of cell-to-cell and intra-cellular variability, a key step for understanding heterogeneity in cell populations. However, single-cell analysis with dynamic models is a challenging open problem: current inference methods address only single-gene expression or neglect parameter correlations. We report on a simple, flexible, and scalable method for estimating cell-specific and population-average parameters of non-linear mixed-effects models of cellular networks, demonstrating its accuracy with a published model and dataset. We also propose sensitivity analysis for identifying which biological sub-processes quantitatively and dynamically contribute to cell-to-cell variability. Our application to endocytosis in yeast demonstrates that dynamic models of realistic size can be developed for the analysis of single-cell data and that shifting the focus from single reactions or parameters to nuanced and time-dependent contributions of sub-processes helps biological interpretation. Generality and simplicity of the approach will facilitate customized extensions for analyzing single-cell dynamics.

A Cell Segmentation/Tracking Tool Based on Machine Learning

The ability to gain quantifiable, single-cell data from time-lapse microscopy images is dependent upon cell segmentation and tracking. Here, we present a detailed protocol for obtaining quality time-lapse movies and introduce a method to identify (segment) and track cells based on machine learning techniques (Fiji's Trainable Weka Segmentation) and custom, open-source Python scripts. To provide a hands-on experience, we provide datasets obtained using the aforementioned protocol.

Contour-Seed Pairs Learning-Based Framework for Simultaneously Detecting and Segmenting Various Overlapping Cells/Nuclei in Microscopy Images

In this paper, we propose a novel contour-seed pairs learning-based framework for robust and automated cell/nucleus segmentation. Automated granular object segmentation in microscopy images has significant clinical importance for pathology grading of the cell carcinoma and gene expression. The focus of the past literature is dominated by either segmenting a certain type of cells/nuclei or simply splitting the clustered objects without contours inference of them. Our method addresses these issues by formulating the detection and segmentation tasks in terms of a unified regression problem, where a cascade sparse regression chain model is trained and then applied to return object locations and entire boundaries of clustered objects. In particular, we first learn a set of online convolutional features in each layer. Then, in the proposed cascade sparse regression chain, with the input from the learned features, we iteratively update the locations and clustered object boundaries until convergence. In this way, the boundary evidences of each individual object can be easily delineated and be further fed to a complete contour inference procedure optimized by the minimum description length principle. For any probe image, our method enables to analyze free-lying and overlapping cells with complex shapes. Experimental results show that the proposed method is very generic and performs well on contour inferences of various cell/nucleus types. Compared with the current segmentation techniques, our approach achieves state-of-the-art performances on four challenging datasets, i.e., the kidney renal cell carcinoma histopathology dataset, Drosophila Kc167 cellular dataset, differential interference contrast red blood cell dataset, and cervical cytology dataset.

Morphologically constrained and data informed cell segmentation of budding yeast

Motivation

Although high-content image cytometry is becoming increasingly routine, processing the large amount of data acquired during time-lapse experiments remains a challenge. The majority of approaches for automated single-cell segmentation focus on flat, uniform fields of view covered with a single layer of cells. In the increasingly popular microfluidic devices that trap individual cells for long term imaging, these conditions are not met. Consequently, most techniques for segmentation perform poorly. Although potentially constraining the generalizability of software, incorporating information about the microfluidic features, flow of media and the morphology of the cells can substantially improve performance.

Results

Here we present DISCO (Data Informed Segmentation of Cell Objects), a framework for using the physical constraints imposed by microfluidic traps, the shape based morphological constraints of budding yeast and temporal information about cell growth and motion to allow tracking and segmentation of cells in microfluidic devices. Using manually curated datasets, we demonstrate substantial improvements in both tracking and segmentation when compared with existing software.

Availability and implementation

The MATLAB code for the algorithm and for measuring performance is available at https://github.com/pswain/segmentation-software and the test images and the curated ground-truth results used for comparing the algorithms are available at http://datashare.is.ed.ac.uk/handle/10283/2002.

Contact

mcrane2@uw.edu.

Supplementary information

Supplementary data are available at Bioinformatics online.

Investigating the Relevance of Graph Cut Parameter on Interactive and Automatic Cell Segmentation

Graph cut segmentation provides a platform to analyze images through a global segmentation strategy, and as a result of this, it has gained a wider acceptability in many interactive and automatic segmentation fields of application, such as the medical field. The graph cut energy function has a parameter that is tuned to ensure that the output is neither oversegmented (shrink bias) nor undersegmented. Models have been proposed in literature towards the improvement of graph cut segmentation, in the context of interactive and automatic cell segmentation. Along this line of research, the graph cut parameter has been leveraged, while in some instances, it has been ignored. Therefore, in this work, the relevance of graph cut parameter on both interactive and automatic cell segmentation is investigated. Statistical analysis, based on F1 score, of three publicly available datasets of cells, suggests that the graph cut parameter plays a significant role in improving the segmentation accuracy of the interactive graph cut than the automatic graph cut.

Identification of individual cells from z-stacks of bright-field microscopy images

Obtaining single cell data from time-lapse microscopy images is critical for quantitative biology, but bottlenecks in cell identification and segmentation must be overcome. We propose a novel, versatile method that uses machine learning classifiers to identify cell morphologies from z-stack bright-field microscopy images. We show that axial information is enough to successfully classify the pixels of an image, without the need to consider in focus morphological features. This fast, robust method can be used to identify different cell morphologies, including the features of E. coli, S. cerevisiae and epithelial cells, even in mixed cultures. Our method demonstrates the potential of acquiring and processing Z-stacks for single-layer, single-cell imaging and segmentation.

Perspective: Differential dynamic microscopy extracts multi-scale activity in complex fluids and biological systems

Differential dynamic microscopy (DDM) is a technique that exploits optical microscopy to obtain local, multi-scale quantitative information about dynamic samples, in most cases without user intervention. It is proving extremely useful in understanding dynamics in liquid suspensions, soft materials, cells, and tissues. In DDM, image sequences are analyzed via a combination of image differences and spatial Fourier transforms to obtain information equivalent to that obtained by means of light scattering techniques. Compared to light scattering, DDM offers obvious advantages, principally (a) simplicity of the setup; (b) possibility of removing static contributions along the optical path; (c) power of simultaneous different microscopy contrast mechanisms; and (d) flexibility of choosing an analysis region, analogous to a scattering volume. For many questions, DDM has also advantages compared to segmentation/tracking approaches and to correlation techniques like particle image velocimetry. The very straightforward DDM approach, originally demonstrated with bright field microscopy of aqueous colloids, has lately been used to probe a variety of other complex fluids and biological systems with many different imaging methods, including dark-field, differential interference contrast, wide-field, light-sheet, and confocal microscopy. The number of adopting groups is rapidly increasing and so are the applications. Here, we briefly recall the working principles of DDM, we highlight its advantages and limitations, we outline recent experimental breakthroughs, and we provide a perspective on future challenges and directions. DDM can become a standard primary tool in every laboratory equipped with a microscope, at the very least as a first bias-free automated evaluation of the dynamics in a system.