CellSegm - a MATLAB toolbox for high-throughput 3D cell segmentation

Engineered Cardiac Microtissue Biomanufacturing Using Human Induced Pluripotent Stem Cell Derived Epicardial Cells

Epicardial cells are a crucial component in constructing in vitro 3D tissue models of the human heart, contributing to the ECM environment and the resident mesenchymal cell population. Studying the human epicardium and its development from the proepicardial organ is difficult, but induced pluripotent stem cells can provide a source of human epicardial cells for developmental modeling and for biomanufacturing heterotypic cardiac tissues. This study shows that a robust population of epicardial cells (approx. 87.7% WT1+) can be obtained by small molecule modulation of the Wnt signaling pathway. The population maintains WT1 expression and characteristic epithelial morphology over successive passaging, but increases in size and decreases in cell number, suggesting a limit to their expandability in vitro. Further, low passage number epicardial cells formed into more robust 3D microtissues compared to their higher passage counterparts, suggesting that the ideal time frame for use of these epicardial cells for tissue engineering and modeling purposes is early on in their differentiated state. Additionally, the differentiated epicardial cells displayed two distinct morphologic sub populations with a subset of larger, more migratory cells which led expansion of the epicardial cells across various extracellular matrix environments. When incorporated into a mixed 3D co-culture with cardiomyocytes, epicardial cells promoted greater remodeling and migration without impairing cardiomyocyte function. This study provides an important characterization of stem cell-derived epicardial cells, identifying key characteristics that influence their ability to fabricate consistent engineered cardiac tissues.

Rapid, biochemical tagging of cellular activity history in vivo

Intracellular calcium (Ca2+) is ubiquitous to cell signaling across all biology. While existing fluorescent sensors and reporters can detect activated cells with elevated Ca2+ levels, these approaches require implants to deliver light to deep tissue, precluding their noninvasive use in freely-behaving animals. Here we engineered an enzyme-catalyzed approach that rapidly and biochemically tags cells with elevated Ca2+ in vivo. Ca2+-activated Split-TurboID (CaST) labels activated cells within 10 minutes with an exogenously-delivered biotin molecule. The enzymatic signal increases with Ca2+ concentration and biotin labeling time, demonstrating that CaST is a time-gated integrator of total Ca2+ activity. Furthermore, the CaST read-out can be performed immediately after activity labeling, in contrast to transcriptional reporters that require hours to produce signal. These capabilities allowed us to apply CaST to tag prefrontal cortex neurons activated by psilocybin, and to correlate the CaST signal with psilocybin-induced head-twitch responses in untethered mice.

All-optical interrogation of brain-wide activity in freely swimming larval zebrafish

We introduce an all-optical technique that enables volumetric imaging of brain-wide calcium activity and targeted optogenetic stimulation of specific brain regions in unrestrained larval zebrafish. The system consists of three main components: a 3D tracking module, a dual-color fluorescence imaging module, and a real-time activity manipulation module. Our approach uses a sensitive genetically encoded calcium indicator in combination with a long Stokes shift red fluorescence protein as a reference channel, allowing the extraction of Ca2+ activity from signals contaminated by motion artifacts. The method also incorporates rapid 3D image reconstruction and registration, facilitating real-time selective optogenetic stimulation of different regions of the brain. By demonstrating that selective light activation of the midbrain regions in larval zebrafish could reliably trigger biased turning behavior and changes of brain-wide neural activity, we present a valuable tool for investigating the causal relationship between distributed neural circuit dynamics and naturalistic behavior.

ShapeMetrics: A 3D Cell Segmentation Pipeline for Single-Cell Spatial Morphometric Analysis

There is a growing need for single-cell level data analysis in correlation with the advancements of microscopy techniques. Morphology-based statistics gathered from individual cells are essential for detection and quantification of even subtle changes within the complex tissues, yet the information available from high-resolution imaging is oftentimes sub-optimally utilized due to the lack of proper computational analysis software. Here we present ShapeMetrics, a 3D cell segmentation pipeline that we have developed to identify, analyze, and quantify single cells in an image. This MATLAB-based script enables users to extract morphological parameters, such as ellipticity, longest axis, cell elongation, or the ratio between cell volume and surface area. We have specifically invested in creating a user-friendly pipeline, aimed for biologists with a limited computational background. Our pipeline is presented with detailed stepwise instructions, starting from the establishment of machine learning-based prediction files of immuno-labeled cell membranes followed by the application of 3D cell segmentation and parameter extraction script, leading to the morphometric analysis and spatial visualization of cell clusters defined by their morphometric features.

Volumetric segmentation of biological cells and subcellular structures for optical diffraction tomography images

Three-dimensional, quantitative imaging of biological cells and their internal structures performed by optical diffraction tomography (ODT) is an important part of biomedical research. However, conducting quantitative analysis of ODT images requires performing 3D segmentation with high accuracy, often unattainable with available segmentation methods. Therefore, in this work, we present a new semi-automatic method, called ODT-SAS, which combines several non-machine-learning techniques to segment cells and 2 types of their organelles: nucleoli and lipid structures (LS). ODT-SAS has been compared with Cellpose and slice-by-slice manual segmentation, respectively, in cell segmentation and organelles segmentation. The comparison shows superiority of ODT-SAS over Cellpose and reveals the potential of our technique in detecting cells, nucleoli and LS.

Brain-wide neuron quantification toolkit reveals strong sexual dimorphism in the evolution of fear memory

Fear responses are functionally adaptive behaviors that are strengthened as memories. Indeed, detailed knowledge of the neural circuitry modulating fear memory could be the turning point for the comprehension of this emotion and its pathological states. A comprehensive understanding of the circuits mediating memory encoding, consolidation, and retrieval presents the fundamental technological challenge of analyzing activity in the entire brain with single-neuron resolution. In this context, we develop the brain-wide neuron quantification toolkit (BRANT) for mapping whole-brain neuronal activation at micron-scale resolution, combining tissue clearing, high-resolution light-sheet microscopy, and automated image analysis. The robustness and scalability of this method allow us to quantify the evolution of activity patterns across multiple phases of memory in mice. This approach highlights a strong sexual dimorphism in recruited circuits, which has no counterpart in the behavior. The methodology presented here paves the way for a comprehensive characterization of the evolution of fear memory.

In vitro laser scanning confocal microscopy and unsupervised segmentation: Quantification of cytosolic calcium and RNA distribution in hypoxic neurons

The mimicry of neurodegenerative diseases in vitro can be observed through the induction of chronic hypoxia, and the impact of this stress is monitored using multiplexed imaging techniques. While laser scanning confocal microscopy (LSCM) is a valuable tool for observing single neurons under degenerative conditions, accurately quantifying RNA distribution and cell size by deep learning tools remains challenging due to the lack of annotated training datasets. To address this, we propose a framework that combines 3D tracking of RNA distribution and cell size identification using unsupervised image segmentation. Additionally, we quantified the calcium level in neurons using fluorescent microscopy using unsupervised image segmentation. First, we performed imaging of neuronal morphology using differential interference contrast (DIC) optics and RNA/calcium level imaging using fluorescent microscopy. Next, we performed k-means clustering-based cell segmentation. The results show that our framework can distinguish between distinct neuronal states under control and chronic hypoxic conditions. The analysis reveals that hypoxia induces a significant increase in cytosolic calcium level, reduction in neuron diameter, and alterations in RNA distribution.Clinical Relevance- The proposed framework is crucial to study the neurodegeneration process and evaluating the efficacy of neuroprotective drugs through image analysis.

On the Variability in Cell and Nucleus Shapes

Cell morphology is an important regulator of cell function. Many abnormalities in cellular behavior can be discerned from changes in the shape of the cell and its organelles, typically the nucleus. Two major challenges for developing such phenotypic assays are reconstructing 3D surfaces of individual cells and nuclei from confocal images and developing characterizations of these surfaces for comparisons. We demonstrate two algorithms - 3D active contours and 3D condensed-attention UNet - to segment cells and nuclei from confocal images. The cell and nuclear surfaces are then converted into vectors using a reversible, spherical transform - i.e., shapes can be recovered from the vectors. Typical methods for characterizing shapes using size, shape, and image parameters such as area, volume, shape factor, solidity, and pixel intensities are not amenable to such reverse transformation. Our vector representation's principal component analysis shows that the significant modes of variability among cell and nucleus shapes are scaling and flattening. We benchmark these modes using a known mechanical model for nucleus morphology. Subsequent modes alter the eccentricity of the nucleus and translate and rotate it with respect to the cell. Our vector-space representation of cell and nucleus shape helps physically interpret the variability sources. It may further help to guide mechanical models and identify molecular mechanisms driving cell and nuclear shape changes.

Spatiotemporal distribution of cellular injury and leukocytes during the progression of ventilator-induced lung injury

Supportive mechanical ventilation is a necessary lifesaving treatment for acute respiratory distress syndrome (ARDS). This intervention often leads to injury exacerbation by ventilator-induced lung injury (VILI). Patterns of injury in ARDS and VILI are recognized to be heterogeneous; however, quantification of these injury distributions remains incomplete. Developing a more detailed understanding of injury heterogeneity, particularly how it varies in space and time, can help elucidate the mechanisms of VILI pathogenesis. Ultimately, this knowledge can be used to develop protective ventilation strategies that slow disease progression. To expand existing knowledge of VILI heterogeneity, we document the spatial evolution of cellular injury distribution and leukocyte infiltration, on the micro- and macroscales, during protective and injurious mechanical ventilation. We ventilated naïve mice using either high inspiratory pressure and zero positive end-expiratory pressure ventilation or low tidal volume with positive end-expiratory pressure. Distributions of cellular injury, identified with propidium iodide staining, were microscopically analyzed at three levels of injury severity. Cellular injury initiated in diffuse, quasi-random patterns, and progressed through expansion of high-density regions of injured cells termed "injury clusters." The density profile of the expanding injury regions suggests that stress shielding occurs, protecting the already injured regions from further damage. Spatial distribution of leukocytes did not correlate with that of cellular injury or ventilation-induced changes in lung function. These results suggest that protective ventilation protocols should protect the interface between healthy and injured regions to stymie injury propagation.

Automated quantification of live articular chondrocyte fluorescent staining using a custom image analysis framework

The goal of this study was to develop, validate, and implement an image analysis framework to automatically analyze chondrocytes in 3D image stacks of cartilage acquired using a fluorescent confocal microscope. Source specimens consist of viable osteochondral tissue co-stained with multiple live-cell dyes. Our framework utilizes a seeded watershed-based algorithm to automatically segment individual chondrocytes in each 2D slice of the confocal image stack. The resulting cell segmentations are colocalized in 3D to eliminate duplicate segmentation of the same cell resulting from the visibility of fluorescence signal in multiple imaging planes, and the 3D cell distribution is used to automatically define the cartilage tissue volume. The algorithm then provides chondrocyte density data, and the associated segmentation can be used as a mask to extract and quantify per cell intensity of a secondary, functional dye co-staining the chondrocytes. The accuracy of the automated chondrocyte segmentation was validated against manual segmentations (average IOU = 0.79). When applied to a cartilage surrogate, this analysis framework estimated chondrocyte density within 10% of the true density and demonstrated a good agreement between framework's counts and manual counts (R²  = 0.99). In a real application, the framework was able to detect the increased dye signal of monochlorobimane (MCB) in chondrocytes treated with N-acetylcysteine (NAC) after mechanical injury, quantifying intracellular biochemical changes in living cells. This new framework allows for fast and accurate quantification of intracellular activities of chondrocytes, and it can be adapted for broader application in many imaging and treatment modalities, including therapeutic OA research.

Large scale, single-cell FRET-based glucose uptake measurements within heterogeneous populations

Fluorescent biosensors are powerful tools allowing the concentration of metabolites and small molecules, and other properties such as pH and molecular crowding to be measured inside live single cells. The technology has been hampered by lack of simple software to identify cells and quantify biosensor signals in single cells. We have developed a new software package, FRETzel, to address this gap and demonstrate its use by measuring insulin-stimulated glucose uptake in individual fat cells of varying sizes for the first time. Our results support the long-standing hypothesis that larger fat cells are less sensitive to insulin than smaller ones, a finding that has important implications for the battle against type 2 diabetes. FRETzel has been optimized using the messy and crowded environment of cultured adipocytes, demonstrating its utility for quantification of FRET biosensors in a wide range of other cell types, including fibroblasts and yeast via a simple user-friendly quantitative interface.

•

FRETzel is a new software package for easy analysis of FRET signals in cells

•

FRETzel is used to quantify glucose uptake in adipocytes of different sizes

•

Reduced glucose uptake suggests that larger adipocytes have lower insulin sensitivity

•

FRETzel is demonstrated on a range of cell types: yeast, fibroblasts, and adipocytes

Probabilistic spatial analysis in quantitative microscopy with uncertainty-aware cell detection using deep Bayesian regression

The investigation of biological systems with three-dimensional microscopy demands automatic cell identification methods that not only are accurate but also can imply the uncertainty in their predictions. The use of deep learning to regress density maps is a popular successful approach for extracting cell coordinates from local peaks in a postprocessing step, which then, however, hinders any meaningful probabilistic output. We propose a framework that can operate on large microscopy images and output probabilistic predictions (i) by integrating deep Bayesian learning for the regression of uncertainty-aware density maps, where peak detection algorithms generate cell proposals, and (ii) by learning a mapping from prediction proposals to a probabilistic space that accurately represents the chances of a successful prediction. Using these calibrated predictions, we propose a probabilistic spatial analysis with Monte Carlo sampling. We demonstrate this in a bone marrow dataset, where our proposed methods reveal spatial patterns that are otherwise undetectable.

Identification of Retinal Ganglion Cells from β-III Stained Fluorescent Microscopic Images

Optic nerve crush in mouse model is widely used for investigating the course following retinal ganglion cell (RGCs) injury. Manual cell counting from β-III tubulin stained microscopic images has been routinely performed to monitor RGCs after an optic nerve crush injury, but is time-consuming and prone to observer variability. This paper describes an automatic technique for RGC identification. We developed and validated (i) a sensitive cell candidate segmentation scheme and (ii) a classifier that removed false positives while retaining true positives. Two major contributions were made in cell candidate segmentation. First, a homomorphic filter was designed to adjust for the inhomogeneous illumination caused by uneven penetration of β-III tubulin antibody. Second, the optimal segmentation parameters for cell detection are highly image-specific. To address this issue, we introduced an offline-online parameter tuning approach. Offline tuning optimized model parameters based on training images and online tuning further optimized the parameters at the testing stage without needing access to the ground truth. In the cell identification stage, 31 geometric, statistical and textural features were extracted from each segmented cell candidate, which was subsequently classified as true or false positives by support vector machine. The homomorphic filter and the online parameter tuning approach together increased cell recall by 28%. The entire pipeline attained a recall, precision and coefficient of determination (r²) of 85.3%, 97.1% and 0.994. The availability of the proposed pipeline will allow efficient, accurate and reproducible RGC quantification required for assessing the death/survival of RGCs in disease models.

Cell segmentation-free inference of cell types from in situ transcriptomics data

Multiplexed fluorescence in situ hybridization techniques have enabled cell-type identification, linking transcriptional heterogeneity with spatial heterogeneity of cells. However, inaccurate cell segmentation reduces the efficacy of cell-type identification and tissue characterization. Here, we present a method called Spot-based Spatial cell-type Analysis by Multidimensional mRNA density estimation (SSAM), a robust cell segmentation-free computational framework for identifying cell-types and tissue domains in 2D and 3D. SSAM is applicable to a variety of in situ transcriptomics techniques and capable of integrating prior knowledge of cell types. We apply SSAM to three mouse brain tissue images: the somatosensory cortex imaged by osmFISH, the hypothalamic preoptic region by MERFISH, and the visual cortex by multiplexed smFISH. Here, we show that SSAM detects regions occupied by known cell types that were previously missed and discovers new cell types.

Segmentation of the Haematoxylin and Eosin Stained Muscle Cell Images—A Comparative Study

The effective detection of muscle cells, the accurate counting of their numbers and the analysis of their morphological features have great importance in biomedical research. At present, the quantification of muscle cell and the computation of their cross-sectional areas (CSA) are still manual or semi-automated, and with the increase of the image number, the manual or semi-automated methods might become intractable. Hence, the automatic methods are very desirable, which motivated the developments of many muscle cell segmentation methods. In this paper, three methods, SDDM, CELLSEGM and SMASH are compared and evaluated with 100 images with over 6000 cells. The Dices computed by SDDM, CELLSEGM and SMASH are 97.38%, 89.85% and 90.08% respectively. The average differences between the calculated cross-sectional areas and the ground truths by SDDM, CELLSEGM and SMASH are 5.14%, 10.76% and 7.97% respectively.

A Molecular Calcium Integrator Reveals a Striatal Cell Type Driving Aversion

The ability to record transient cellular events in the DNA or RNA of cells would enable precise, large-scale analysis, selection, and reprogramming of heterogeneous cell populations. Here, we report a molecular technology for stable genetic tagging of cells that exhibit activity-related increases in intracellular calcium concentration (FLiCRE). We used FLiCRE to transcriptionally label activated neural ensembles in the nucleus accumbens of the mouse brain during brief stimulation of aversive inputs. Using single-cell RNA sequencing, we detected FLiCRE transcripts among the endogenous transcriptome, providing simultaneous readout of both cell-type and calcium activation history. We identified a cell type in the nucleus accumbens activated downstream of long-range excitatory projections. Taking advantage of FLiCRE's modular design, we expressed an optogenetic channel selectively in this cell type and showed that direct recruitment of this otherwise genetically inaccessible population elicits behavioral aversion. The specificity and minute resolution of FLiCRE enables molecularly informed characterization, manipulation, and reprogramming of activated cellular ensembles.

Spatial protein analysis in developing tissues: a sampling-based image processing approach

Advances in fluorescence microscopy approaches have made it relatively easy to generate multi-dimensional image volumes and have highlighted the need for flexible image analysis tools for the extraction of quantitative information from such data. Here we demonstrate that by focusing on simplified feature-based nuclear segmentation and probabilistic cytoplasmic detection we can create a tool that is able to extract geometry-based information from diverse mammalian tissue images. Our open-source image analysis platform, called 'SilentMark', can cope with three-dimensional noisy images and with crowded fields of cells to quantify signal intensity in different cellular compartments. Additionally, it provides tissue geometry related information, which allows one to quantify protein distribution with respect to marked regions of interest. The lightweight SilentMark algorithms have the advantage of not requiring multiple processors, graphics cards or training datasets and can be run even with just several hundred megabytes of memory. This makes it possible to use the method as a Web application, effectively eliminating setup hurdles and compatibility issues with operating systems. We test this platform on mouse pre-implantation embryos, embryonic stem cell-derived embryoid bodies and mouse embryonic heart, and relate protein localization to tissue geometry. This article is part of a discussion meeting issue 'Contemporary morphogenesis'.

Pomegranate: 2D segmentation and 3D reconstruction for fission yeast and other radially symmetric cells

Three-dimensional (3D) segmentation of cells in microscopy images is crucial to accurately capture signals that extend across optical sections. Using brightfield images for segmentation has the advantage of being minimally phototoxic and leaving all other channels available for signals of interest. However, brightfield images only readily provide information for two-dimensional (2D) segmentation. In radially symmetric cells, such as fission yeast and many bacteria, this 2D segmentation can be computationally extruded into the third dimension. However, current methods typically make the simplifying assumption that cells are straight rods. Here, we report Pomegranate, a pipeline that performs the extrusion into 3D using spheres placed along the topological skeletons of the 2D-segmented regions. The diameter of these spheres adapts to the cell diameter at each position. Thus, Pomegranate accurately represents radially symmetric cells in 3D even if cell diameter varies and regardless of whether a cell is straight, bent or curved. We have tested Pomegranate on fission yeast and demonstrate its ability to 3D segment wild-type cells as well as classical size and shape mutants. The pipeline is available as a macro for the open-source image analysis software Fiji/ImageJ. 2D segmentations created within or outside Pomegranate can serve as input, thus making this a valuable extension to the image analysis portfolio already available for fission yeast and other radially symmetric cell types.

dotdotdot: an automated approach to quantify multiplex single molecule fluorescent in situ hybridization (smFISH) images in complex tissues

Multiplex single-molecule fluorescent in situ hybridization (smFISH) is a powerful method for validating RNA sequencing and emerging spatial transcriptomic data, but quantification remains a computational challenge. We present a framework for generating and analyzing smFISH data in complex tissues while overcoming autofluorescence and increasing multiplexing capacity. We developed dotdotdot (https://github.com/LieberInstitute/dotdotdot) as a corresponding software package to quantify RNA transcripts in single nuclei and perform differential expression analysis. We first demonstrate robustness of our platform in single mouse neurons by quantifying differential expression of activity-regulated genes. We then quantify spatial gene expression in human dorsolateral prefrontal cortex (DLPFC) using spectral imaging and dotdotdot to mask lipofuscin autofluorescence. We lastly apply machine learning to predict cell types and perform downstream cell type-specific expression analysis. In summary, we provide experimental workflows, imaging acquisition and analytic strategies for quantification and biological interpretation of smFISH data in complex tissues.

ShapeMetrics: A userfriendly pipeline for 3D cell segmentation and spatial tissue analysis

The demand for single-cell level data is constantly increasing within life sciences. In order to meet this demand, robust cell segmentation methods that can tackle challenging in vivo tissues with complex morphology are required. However, currently available cell segmentation and volumetric analysis methods perform poorly on 3D images. Here, we generated ShapeMetrics, a MATLAB-based script that segments cells in 3D and, by performing unbiased clustering using a heatmap, separates the cells into subgroups according to their volumetric and morphological differences. The cells can be accurately segregated according to different biologically meaningful features such as cell ellipticity, longest axis, cell elongation, or the ratio between cell volume and surface area. Our machine learning based script enables dissection of a large amount of novel data from microscope images in addition to the traditional information based on fluorescent biomarkers. Furthermore, the cells in different subgroups can be spatially mapped back to their original locations in the tissue image to help elucidate their roles in their respective morphological contexts. In order to facilitate the transition from bulk analysis to single-cell level accuracy, we emphasize the user-friendliness of our method by providing detailed step-by-step instructions through the pipeline hence aiming to reach users with less experience in computational biology.

TrkB Signaling Influences Gene Expression in Cortistatin-Expressing Interneurons

Brain-derived neurotrophic factor (BDNF) signals through its cognate receptor tropomyosin receptor kinase B (TrkB) to promote the function of several classes of inhibitory interneurons. We previously reported that loss of BDNF-TrkB signaling in cortistatin (Cort)-expressing interneurons leads to behavioral hyperactivity and spontaneous seizures in mice. We performed bulk RNA sequencing (RNA-seq) from the cortex of mice with disruption of BDNF-TrkB signaling in cortistatin interneurons, and identified differential expression of genes important for excitatory neuron function. Using translating ribosome affinity purification and RNA-seq, we define a molecular profile for Cort-expressing inhibitory neurons and subsequently compare the translatome of normal and TrkB-depleted Cort neurons, revealing alterations in calcium signaling and axon development. Several of the genes enriched in Cort neurons and differentially expressed in TrkB-depleted neurons are also implicated in autism and epilepsy. Our findings highlight TrkB-dependent molecular pathways as critical for the maturation of inhibitory interneurons and support the hypothesis that loss of BDNF signaling in Cort interneurons leads to altered excitatory/inhibitory balance.

Manipulation of a genetically and spatially defined sub-population of BDNF-expressing neurons potentiates learned fear and decreases hippocampal-prefrontal synchrony in mice

Brain-derived neurotrophic factor (BDNF) signaling regulates synaptic plasticity in the hippocampus (HC) and prefrontal cortex (PFC), and has been extensively linked with fear memory expression in rodents. Notably, disrupting BDNF production from promoter IV-derived transcripts enhances fear expression in mice, and decreases fear-associated HC-PFC synchrony, suggesting that Bdnf transcription from promoter IV plays a key role in HC-PFC function during fear memory retrieval. To better understand how promoter IV-derived BDNF controls HC-PFC connectivity and fear expression, we generated a viral construct that selectively targets cells expressing promoter IV-derived Bdnf transcripts ("p4-cells") for tamoxifen-inducible Cre-mediated recombination (AAV8-p4Bdnf-ER^T2CreER^T2-PEST). Using this construct, we found that ventral hippocampal (vHC) p4-cells are recruited during fear expression, and that activation of these cells causes exaggerated fear expression that co-occurs with disrupted vHC-PFC synchrony in mice. Our data highlight how this novel construct can be used to interrogate genetically defined cell types that selectively contribute to BDNF-dependent behaviors.

Deep-Learning-Based Segmentation of Small Extracellular Vesicles in Transmission Electron Microscopy Images

Small extracellular vesicles (sEVs) are cell-derived vesicles of nanoscale size (~30-200 nm) that function as conveyors of information between cells, reflecting the cell of their origin and its physiological condition in their content. Valuable information on the shape and even on the composition of individual sEVs can be recorded using transmission electron microscopy (TEM). Unfortunately, sample preparation for TEM image acquisition is a complex procedure, which often leads to noisy images and renders automatic quantification of sEVs an extremely difficult task. We present a completely deep-learning-based pipeline for the segmentation of sEVs in TEM images. Our method applies a residual convolutional neural network to obtain fine masks and use the Radon transform for splitting clustered sEVs. Using three manually annotated datasets that cover a natural variability typical for sEV studies, we show that the proposed method outperforms two different state-of-the-art approaches in terms of detection and segmentation performance. Furthermore, the diameter and roundness of the segmented vesicles are estimated with an error of less than 10%, which supports the high potential of our method in biological applications.

IA-Lab: A MATLAB framework for efficient microscopy image analysis development, applied to quantifying intracellular transport of internalized peptide-drug conjugate

This work presents a MATLAB-based software package for high-throughput microscopy image analysis development, making such development more accessible for a large user community. The toolbox provides a GUI and a number of analysis workflows, and can serve as a general framework designed to allow for easy extension. For a new application, only a minor part of the object-oriented code needs to be replaced by new components, making development efficient. This makes it possible to quickly develop solutions for analysis not available in existing tools. We show its use in making a tool for quantifying intracellular transport of internalized peptide-drug conjugates.

The code is freely available as open source on GitHub (https://github.com/amcorrigan/ia-lab)

High-resolution imaging reveals how the spindle midzone impacts chromosome movement

Microtubule bundles in the spindle midzone have been reported to either promote or hinder chromosome movement. Pamula et al. examine the assembly dynamics of midzone microtubule bundles during anaphase and how chromosome segregation is impacted by aberrant bundle assembly.

In the spindle midzone, microtubules from opposite half-spindles form bundles between segregating chromosomes. Microtubule bundles can either push or restrict chromosome movement during anaphase in different cellular contexts, but how these activities are achieved remains poorly understood. Here, we use high-resolution live-cell imaging to analyze individual microtubule bundles, growing filaments, and chromosome movement in dividing human cells. Within bundles, filament overlap length marked by the cross-linking protein PRC1 decreases during anaphase as chromosome segregation slows. Filament ends within microtubule bundles appear capped despite dynamic PRC1 turnover and submicrometer proximity to growing microtubules. Chromosome segregation distance and rate are increased in two human cell lines when microtubule bundle assembly is prevented via PRC1 knockdown. Upon expressing a mutant PRC1 with reduced microtubule affinity, bundles assemble but chromosome hypersegregation is still observed. We propose that microtubule overlap length reduction, typically linked to pushing forces generated within filament bundles, is needed to properly restrict spindle elongation and position chromosomes within daughter cells.

Three-dimensional GPU-accelerated active contours for automated localization of cells in large images

Cell segmentation in microscopy is a challenging problem, since cells are often asymmetric and densely packed. Successful cell segmentation algorithms rely identifying seed points, and are highly sensitive to variablility in cell size. In this paper, we present an efficient and highly parallel formulation for symmetric three-dimensional contour evolution that extends previous work on fast two-dimensional snakes. We provide a formulation for optimization on 3D images, as well as a strategy for accelerating computation on consumer graphics hardware. The proposed software takes advantage of Monte-Carlo sampling schemes in order to speed up convergence and reduce thread divergence. Experimental results show that this method provides superior performance for large 2D and 3D cell localization tasks when compared to existing methods on large 3D brain images.

DSeg: A Dynamic Image Segmentation Program to Extract Backbone Patterns for Filamentous Bacteria and Hyphae Structures

Analysis of numerous filamentous structures in an image is often limited by the ability of algorithms to accurately segment complex structures or structures within a dense population. It is even more problematic if these structures continuously grow when recording a time-series of images. To overcome these issues we present DSeg; an image analysis program designed to process time-series image data, as well as single images, to segment filamentous structures. The program includes a robust binary level-set algorithm modified to use size constraints, edge intensity, and past information. We verify our algorithms using synthetic data, differential interference contrast images of filamentous prokaryotes, and transmission electron microscopy images of bacterial adhesion fimbriae. DSeg includes automatic segmentation, tools for analysis, and drift correction, and outputs statistical data such as persistence length, growth rate, and growth direction. The program is available at Sourceforge.

Luciferase-LOV BRET enables versatile and specific transcriptional readout of cellular protein-protein interactions

Technologies that convert transient protein-protein interactions (PPIs) into stable expression of a reporter gene are useful for genetic selections, high-throughput screening, and multiplexing with omics technologies. We previously reported SPARK (Kim et al., 2017), a transcription factor that is activated by the coincidence of blue light and a PPI. Here, we report an improved, second-generation SPARK2 that incorporates a luciferase moiety to control the light-sensitive LOV domain. SPARK2 can be temporally gated by either external light or addition of a small-molecule luciferin, which causes luciferase to open LOV via proximity-dependent BRET. Furthermore, the nested 'AND' gate design of SPARK2-in which both protease recruitment to the membrane-anchored transcription factor and LOV domain opening are regulated by the PPI of interest-yields a lower-background system and improved PPI specificity. We apply SPARK2 to high-throughput screening for GPCR agonists and for the detection of trans-cellular contacts, all with versatile transcriptional readout.

The relationship between metastatic potential and in vitro mechanical properties of osteosarcoma cells

Osteosarcoma is the most frequent primary tumor of bone and is characterized by its high tendency to metastasize in lungs. Although treatment in cases of early diagnosis results in a 5-yr survival rate of nearly 60%, the prognosis for patients with secondary lesions at diagnosis is poor, and their 5-yr survival rate remains below 30%. In the present work, we have used a number of analytical methods to investigate the impact of increased metastatic potential on the biophysical properties and force generation of osteosarcoma cells. With that aim, we used two paired osteosarcoma cell lines, with each one comprising a parental line with low metastatic potential and its experimentally selected, highly metastatic form. Mechanical characterization was performed by means of atomic force microscopy, tensile biaxial deformation, and real-time deformability, and cell traction was measured using two-dimensional and micropost-based traction force microscopy. Our results reveal that the low metastatic osteosarcoma cells display larger spreading sizes and generate higher forces than the experimentally selected, highly malignant variants. In turn, the outcome of cell stiffness measurements strongly depends on the method used and the state of the probed cell, indicating that only a set of phenotyping methods provides the full picture of cell mechanics.

BDNF-TrkB signaling in oxytocin neurons contributes to maternal behavior

Brain-derived neurotrophic factor (Bdnf) transcription is controlled by several promoters, which drive expression of multiple transcripts encoding an identical protein. We previously reported that BDNF derived from promoters I and II is highly expressed in hypothalamus and is critical for regulating aggression in male mice. Here we report that BDNF loss from these promoters causes reduced sexual receptivity and impaired maternal care in female mice, which is concomitant with decreased oxytocin (Oxt) expression during development. We identify a novel link between BDNF signaling, oxytocin, and maternal behavior by demonstrating that ablation of TrkB selectively in OXT neurons partially recapitulates maternal care impairments observed in BDNF-deficient females. Using translating ribosome affinity purification and RNA-sequencing we define a molecular profile for OXT neurons and delineate how BDNF signaling impacts gene pathways critical for structural and functional plasticity. Our findings highlight BDNF as a modulator of sexually-dimorphic hypothalamic circuits that govern female-typical behaviors.

Development of image analysis software for quantification of viable cells in microchips

Over the past few years, image analysis has emerged as a powerful tool for analyzing various cell biology parameters in an unprecedented and highly specific manner. The amount of data that is generated requires automated methods for the processing and analysis of all the resulting information. The software available so far are suitable for the processing of fluorescence and phase contrast images, but often do not provide good results from transmission light microscopy images, due to the intrinsic variation of the acquisition of images technique itself (adjustment of brightness / contrast, for instance) and the variability between image acquisition introduced by operators / equipment. In this contribution, it has been presented an image processing software, Python based image analysis for cell growth (PIACG), that is able to calculate the total area of the well occupied by cells with fusiform and rounded morphology in response to different concentrations of fetal bovine serum in microfluidic chips, from microscopy images in transmission light, in a highly efficient way.

HNF1B controls epithelial organization and cell polarity during ureteric bud branching and collecting duct morphogenesis

Kidney development depends crucially on proper ureteric bud branching giving rise to the entire collecting duct system. The transcription factor HNF1B is required for the early steps of ureteric bud branching, yet the molecular and cellular events regulated by HNF1B are poorly understood. We report that specific removal of Hnf1b from the ureteric bud leads to defective cell-cell contacts and apicobasal polarity during the early branching events. High-resolution ex vivo imaging combined with a membranous fluorescent reporter strategy show decreased mutant cell rearrangements during mitosis-associated cell dispersal and severe epithelial disorganization. Molecular analysis reveals downregulation of Gdnf-Ret pathway components and suggests that HNF1B acts both upstream and downstream of Ret signaling by directly regulating Gfra1 and Etv5 Subsequently, Hnf1b deletion leads to massively mispatterned ureteric tree network, defective collecting duct differentiation and disrupted tissue architecture, which leads to cystogenesis. Consistently, mRNA-seq analysis shows that the most impacted genes encode intrinsic cell-membrane components with transporter activity. Our study uncovers a fundamental and recurring role of HNF1B in epithelial organization during early ureteric bud branching and in further patterning and differentiation of the collecting duct system in mouse.

A deep convolutional neural network for classification of red blood cells in sickle cell anemia

Sickle cell disease (SCD) is a hematological disorder leading to blood vessel occlusion accompanied by painful episodes and even death. Red blood cells (RBCs) of SCD patients have diverse shapes that reveal important biomechanical and bio-rheological characteristics, e.g. their density, fragility, adhesive properties, etc. Hence, having an objective and effective way of RBC shape quantification and classification will lead to better insights and eventual better prognosis of the disease. To this end, we have developed an automated, high-throughput, ex-vivo RBC shape classification framework that consists of three stages. First, we present an automatic hierarchical RBC extraction method to detect the RBC region (ROI) from the background, and then separate touching RBCs in the ROI images by applying an improved random walk method based on automatic seed generation. Second, we apply a mask-based RBC patch-size normalization method to normalize the variant size of segmented single RBC patches into uniform size. Third, we employ deep convolutional neural networks (CNNs) to realize RBC classification; the alternating convolution and pooling operations can deal with non-linear and complex patterns. Furthermore, we investigate the specific shape factor quantification for the classified RBC image data in order to develop a general multiscale shape analysis. We perform several experiments on raw microscopy image datasets from 8 SCD patients (over 7,000 single RBC images) through a 5-fold cross validation method both for oxygenated and deoxygenated RBCs. We demonstrate that the proposed framework can successfully classify sickle shape RBCs in an automated manner with high accuracy, and we also provide the corresponding shape factor analysis, which can be used synergistically with the CNN analysis for more robust predictions. Moreover, the trained deep CNN exhibits good performance even for a deoxygenated dataset and distinguishes the subtle differences in texture alteration inside the oxygenated and deoxygenated RBCs.

A Manual Segmentation Tool for Three-Dimensional Neuron Datasets

To date, automated or semi-automated software and algorithms for segmentation of neurons from three-dimensional imaging datasets have had limited success. The gold standard for neural segmentation is considered to be the manual isolation performed by an expert. To facilitate the manual isolation of complex objects from image stacks, such as neurons in their native arrangement within the brain, a new Manual Segmentation Tool (ManSegTool) has been developed. ManSegTool allows user to load an image stack, scroll down the images and to manually draw the structures of interest stack-by-stack. Users can eliminate unwanted regions or split structures (i.e., branches from different neurons that are too close each other, but, to the experienced eye, clearly belong to a unique cell), to view the object in 3D and save the results obtained. The tool can be used for testing the performance of a single-neuron segmentation algorithm or to extract complex objects, where the available automated methods still fail. Here we describe the software's main features and then show an example of how ManSegTool can be used to segment neuron images acquired using a confocal microscope. In particular, expert neuroscientists were asked to segment different neurons from which morphometric variables were subsequently extracted as a benchmark for precision. In addition, a literature-defined index for evaluating the goodness of segmentation was used as a benchmark for accuracy. Neocortical layer axons from a DIADEM challenge dataset were also segmented with ManSegTool and compared with the manual “gold-standard” generated for the competition.

Generalizing cell segmentation and quantification

Background

In recent years, the microscopy technology for imaging cells has developed greatly and rapidly. The accompanying requirements for automatic segmentation and quantification of the imaged cells are becoming more and more. After studied widely in both scientific research and industrial applications for many decades, cell segmentation has achieved great progress, especially in segmenting some specific types of cells, e.g. muscle cells. However, it lacks a framework to address the cell segmentation problems generally. On the contrary, different segmentation methods were proposed to address the different types of cells, which makes the research work divergent. In addition, most of the popular segmentation and quantification tools usually require a great part of manual work.

Results

To make the cell segmentation work more convergent, we propose a framework that is able to segment different kinds of cells automatically and robustly in this paper. This framework evolves the previously proposed method in segmenting the muscle cells and generalizes it to be suitable for segmenting and quantifying a variety of cell images by adding more union cases. Compared to the previous methods, the segmentation and quantification accuracy of the proposed framework is also improved by three novel procedures: (1) a simplified calibration method is proposed and added for the threshold selection process; (2) a noise blob filter is proposed to get rid of the noise blobs. (3) a boundary smoothing filter is proposed to reduce the false seeds produced by the iterative erosion. As it turned out, the quantification accuracy of the proposed framework increases from 93.4 to 96.8% compared to the previous method. In addition, the accuracy of the proposed framework is also better in quantifying the muscle cells than two available state-of-the-art methods.

Conclusions

The proposed framework is able to automatically segment and quantify more types of cells than state-of-the-art methods.

Electronic supplementary material

The online version of this article (doi:10.1186/s12859-017-1604-1) contains supplementary material, which is available to authorized users.

Semi-automatic 3D morphological reconstruction of neurons with densely branching morphology: Application to retinal AII amacrine cells imaged with multi-photon excitation microscopy

BACKGROUND

Accurate reconstruction of the morphology of single neurons is important for morphometric studies and for developing compartmental models. However, manual morphological reconstruction can be extremely time-consuming and error-prone and algorithms for automatic reconstruction can be challenged when applied to neurons with a high density of extensively branching processes.

NEW METHOD

We present a procedure for semi-automatic reconstruction specifically adapted for densely branching neurons such as the AII amacrine cell found in mammalian retinas. We used whole-cell recording to fill AII amacrine cells in rat retinal slices with fluorescent dyes and acquired digital image stacks with multi-photon excitation microscopy. Our reconstruction algorithm combines elements of existing procedures, with segmentation based on adaptive thresholding and reconstruction based on a minimal spanning tree. We improved this workflow with an algorithm that reconnects neuron segments that are disconnected after adaptive thresholding, using paths extracted from the image stacks with the Fast Marching method.

RESULTS

By reducing the likelihood that disconnected segments were incorrectly connected to neighboring segments, our procedure generated excellent morphological reconstructions of AII amacrine cells.

COMPARISON WITH EXISTING METHODS

Reconstructing an AII amacrine cell required about 2h computing time, compared to 2-4days for manual reconstruction. To evaluate the performance of our method relative to manual reconstruction, we performed detailed analysis using a measure of tree structure similarity (DIADEM score), the degree of projection area overlap (Dice coefficient), and branch statistics.

CONCLUSIONS

We expect our procedure to be generally useful for morphological reconstruction of neurons filled with fluorescent dyes.

ImaEdge: a platform for the quantitative analysis of cortical proteins spatiotemporal dynamics during cell polarization

Cell polarity involves the compartmentalization of the cell cortex. The establishment of cortical compartments arises from the spatial bias in the activity and concentration of cortical proteins. The mechanistic dissection of cell polarity requires the accurate detection of dynamic changes in cortical proteins, but the fluctuations of cell shape and the inhomogeneous distributions of cortical proteins greatly complicate the quantitative extraction of their global and local changes during cell polarization. To address these problems, we introduce an open-source software package, ImaEdge, which automates the segmentation of the cortex from time-lapse movies, and enables quantitative extraction of cortical protein intensities. We demonstrate that ImaEdge enables efficient and rigorous analysis of the dynamic evolution of cortical PAR proteins during C. elegans embryogenesis. It is also capable of accurate tracking of varying levels of transgene expression and discontinuous signals of the actomyosin cytoskeleton during multiple rounds of cell division. ImaEdge provides a unique resource for the quantitative studies of cortical polarization, with the potential for application to many types of polarized cells.

3D Clumped Cell Segmentation Using Curvature Based Seeded Watershed

Image segmentation is an important process that separates objects from the background and also from each other. Applied to cells, the results can be used for cell counting which is very important in medical diagnosis and treatment, and biological research that is often used by scientists and medical practitioners. Segmenting 3D confocal microscopy images containing cells of different shapes and sizes is still challenging as the nuclei are closely packed. The watershed transform provides an efficient tool in segmenting such nuclei provided a reasonable set of markers can be found in the image. In the presence of low-contrast variation or excessive noise in the given image, the watershed transform leads to over-segmentation (a single object is overly split into multiple objects). The traditional watershed uses the local minima of the input image and will characteristically find multiple minima in one object unless they are specified (marker-controlled watershed). An alternative to using the local minima is by a supervised technique called seeded watershed, which supplies single seeds to replace the minima for the objects. Consequently, the accuracy of a seeded watershed algorithm relies on the accuracy of the predefined seeds. In this paper, we present a segmentation approach based on the geometric morphological properties of the ‘landscape’ using curvatures. The curvatures are computed as the eigenvalues of the Shape matrix, producing accurate seeds that also inherit the original shape of their respective cells. We compare with some popular approaches and show the advantage of the proposed method.

Ellipsoid Segmentation Model for Analyzing Light-Attenuated 3D Confocal Image Stacks of Fluorescent Multi-Cellular Spheroids

In oncology, two-dimensional in-vitro culture models are the standard test beds for the discovery and development of cancer treatments, but in the last decades, evidence emerged that such models have low predictive value for clinical efficacy. Therefore they are increasingly complemented by more physiologically relevant 3D models, such as spheroid micro-tumor cultures. If suitable fluorescent labels are applied, confocal 3D image stacks can characterize the structure of such volumetric cultures and, for example, cell proliferation. However, several issues hamper accurate analysis. In particular, signal attenuation within the tissue of the spheroids prevents the acquisition of a complete image for spheroids over 100 micrometers in diameter. And quantitative analysis of large 3D image data sets is challenging, creating a need for methods which can be applied to large-scale experiments and account for impeding factors. We present a robust, computationally inexpensive 2.5D method for the segmentation of spheroid cultures and for counting proliferating cells within them. The spheroids are assumed to be approximately ellipsoid in shape. They are identified from information present in the Maximum Intensity Projection (MIP) and the corresponding height view, also known as Z-buffer. It alerts the user when potential bias-introducing factors cannot be compensated for and includes a compensation for signal attenuation.

Real-time high dynamic range laser scanning microscopy

In conventional confocal/multiphoton fluorescence microscopy, images are typically acquired under ideal settings and after extensive optimization of parameters for a given structure or feature, often resulting in information loss from other image attributes. To overcome the problem of selective data display, we developed a new method that extends the imaging dynamic range in optical microscopy and improves the signal-to-noise ratio. Here we demonstrate how real-time and sequential high dynamic range microscopy facilitates automated three-dimensional neural segmentation. We address reconstruction and segmentation performance on samples with different size, anatomy and complexity. Finally, in vivo real-time high dynamic range imaging is also demonstrated, making the technique particularly relevant for longitudinal imaging in the presence of physiological motion and/or for quantification of in vivo fast tracer kinetics during functional imaging.

Confocal and multiphoton fluorescence microscopy often suffers from low dynamic range. Here the authors develop a high dynamic range, laser scanning fluorescence technique by simultaneously recording different light intensity ranges. The method can be adapted to commercial systems.

PDE Based Algorithms for Smooth Watersheds

Watershed segmentation is useful for a number of image segmentation problems with a wide range of practical applications. Traditionally, the tracking of the immersion front is done by applying a fast sorting algorithm. In this work, we explore a continuous approach based on a geometric description of the immersion front which gives rise to a partial differential equation. The main advantage of using a partial differential equation to track the immersion front is that the method becomes versatile and may easily be stabilized by introducing regularization terms. Coupling the geometric approach with a proper "merging strategy" creates a robust algorithm which minimizes over- and under-segmentation even without predefined markers. Since reliable markers defined prior to segmentation can be difficult to construct automatically for various reasons, being able to treat marker-free situations is a major advantage of the proposed method over earlier watershed formulations. The motivation for the methods developed in this paper is taken from high-throughput screening of cells. A fully automated segmentation of single cells enables the extraction of cell properties from large data sets, which can provide substantial insight into a biological model system. Applying smoothing to the boundaries can improve the accuracy in many image analysis tasks requiring a precise delineation of the plasma membrane of the cell. The proposed segmentation method is applied to real images containing fluorescently labeled cells, and the experimental results show that our implementation is robust and reliable for a variety of challenging segmentation tasks.

Survey statistics of automated segmentations applied to optical imaging of mammalian cells

BACKGROUND

The goal of this survey paper is to overview cellular measurements using optical microscopy imaging followed by automated image segmentation. The cellular measurements of primary interest are taken from mammalian cells and their components. They are denoted as two- or three-dimensional (2D or 3D) image objects of biological interest. In our applications, such cellular measurements are important for understanding cell phenomena, such as cell counts, cell-scaffold interactions, cell colony growth rates, or cell pluripotency stability, as well as for establishing quality metrics for stem cell therapies. In this context, this survey paper is focused on automated segmentation as a software-based measurement leading to quantitative cellular measurements.

METHODS

We define the scope of this survey and a classification schema first. Next, all found and manually filteredpublications are classified according to the main categories: (1) objects of interests (or objects to be segmented), (2) imaging modalities, (3) digital data axes, (4) segmentation algorithms, (5) segmentation evaluations, (6) computational hardware platforms used for segmentation acceleration, and (7) object (cellular) measurements. Finally, all classified papers are converted programmatically into a set of hyperlinked web pages with occurrence and co-occurrence statistics of assigned categories.

RESULTS

The survey paper presents to a reader: (a) the state-of-the-art overview of published papers about automated segmentation applied to optical microscopy imaging of mammalian cells, (b) a classification of segmentation aspects in the context of cell optical imaging, (c) histogram and co-occurrence summary statistics about cellular measurements, segmentations, segmented objects, segmentation evaluations, and the use of computational platforms for accelerating segmentation execution, and (d) open research problems to pursue.

CONCLUSIONS

The novel contributions of this survey paper are: (1) a new type of classification of cellular measurements and automated segmentation, (2) statistics about the published literature, and (3) a web hyperlinked interface to classification statistics of the surveyed papers at https://isg.nist.gov/deepzoomweb/resources/survey/index.html.

Novel microscopy-based screening method reveals regulators of contact-dependent intercellular transfer

Contact-dependent intercellular transfer (codeIT) of cellular constituents can have functional consequences for recipient cells, such as enhanced survival and drug resistance. Pathogenic viruses, prions and bacteria can also utilize this mechanism to spread to adjacent cells and potentially evade immune detection. However, little is known about the molecular mechanism underlying this intercellular transfer process. Here, we present a novel microscopy-based screening method to identify regulators and cargo of codeIT. Single donor cells, carrying fluorescently labelled endocytic organelles or proteins, are co-cultured with excess acceptor cells. CodeIT is quantified by confocal microscopy and image analysis in 3D, preserving spatial information. An siRNA-based screening using this method revealed the involvement of several myosins and small GTPases as codeIT regulators. Our data indicates that cellular protrusions and tubular recycling endosomes are important for codeIT. We automated image acquisition and analysis to facilitate large-scale chemical and genetic screening efforts to identify key regulators of codeIT.