Robust phenotyping of highly multiplexed tissue imaging data using pixel-level clustering

cellPLATO - an unsupervised method for identifying cell behaviour in heterogeneous cell trajectory data

Advances in imaging, segmentation and tracking have led to the routine generation of large and complex microscopy datasets. New tools are required to process this 'phenomics' type data. Here, we present 'Cell PLasticity Analysis Tool' (cellPLATO), a Python-based analysis software designed for measurement and classification of cell behaviours based on clustering features of cell morphology and motility. Used after segmentation and tracking, the tool extracts features from each cell per timepoint, using them to segregate cells into dimensionally reduced behavioural subtypes. Resultant cell tracks describe a 'behavioural ID' at each timepoint, and similarity analysis allows the grouping of behavioural sequences into discrete trajectories with assigned IDs. Here, we use cellPLATO to investigate the role of IL-15 in modulating human natural killer (NK) cell migration on ICAM-1 or VCAM-1. We find eight behavioural subsets of NK cells based on their shape and migration dynamics between single timepoints, and four trajectories based on sequences of these behaviours over time. Therefore, by using cellPLATO, we show that IL-15 increases plasticity between cell migration behaviours and that different integrin ligands induce different forms of NK cell migration.

GammaGateR: semi-automated marker gating for single-cell multiplexed imaging

MOTIVATION

Multiplexed immunofluorescence (mIF) is an emerging assay for multichannel protein imaging that can decipher cell-level spatial features in tissues. However, existing automated cell phenotyping methods, such as clustering, face challenges in achieving consistency across experiments and often require subjective evaluation. As a result, mIF analyses often revert to marker gating based on manual thresholding of raw imaging data.

RESULTS

To address the need for an evaluable semi-automated algorithm, we developed GammaGateR, an R package for interactive marker gating designed specifically for segmented cell-level data from mIF images. Based on a novel closed-form gamma mixture model, GammaGateR provides estimates of marker-positive cell proportions and soft clustering of marker-positive cells. The model incorporates user-specified constraints that provide a consistent but slide-specific model fit. We compared GammaGateR against the newest unsupervised approach for annotating mIF data, employing two colon datasets and one ovarian cancer dataset for the evaluation. We showed that GammaGateR produces highly similar results to a silver standard established through manual annotation. Furthermore, we demonstrated its effectiveness in identifying biological signals, achieved by mapping known spatial interactions between CD68 and MUC5AC cells in the colon and by accurately predicting survival in ovarian cancer patients using the phenotype probabilities as input for machine learning methods. GammaGateR is a highly efficient tool that can improve the replicability of marker gating results, while reducing the time of manual segmentation.

AVAILABILITY AND IMPLEMENTATION

The R package is available at https://github.com/JiangmeiRubyXiong/GammaGateR.

Automated classification of cellular expression in multiplexed imaging data with Nimbus

Multiplexed imaging offers a powerful approach to characterize the spatial topography of tissues in both health and disease. To analyze such data, the specific combination of markers that are present in each cell must be enumerated to enable accurate phenotyping, a process that often relies on unsupervised clustering. We constructed the Pan-Multiplex (Pan-M) dataset containing 197 million distinct annotations of marker expression across 15 different cell types. We used Pan-M to create Nimbus, a deep learning model to predict marker positivity from multiplexed image data. Nimbus is a pre-trained model that uses the underlying images to classify marker expression across distinct cell types, from different tissues, acquired using different microscope platforms, without requiring any retraining. We demonstrate that Nimbus predictions capture the underlying staining patterns of the full diversity of markers present in Pan-M. We then show how Nimbus predictions can be integrated with downstream clustering algorithms to robustly identify cell subtypes in image data. We have open-sourced Nimbus and Pan-M to enable community use at https://github.com/angelolab/Nimbus-Inference.

Cross-domain information fusion for enhanced cell population delineation in single-cell spatial-omics data

Cell population delineation and identification is an essential step in single-cell and spatial-omics studies. Spatial-omics technologies can simultaneously measure information from three complementary domains related to this task: expression levels of a panel of molecular biomarkers at single-cell resolution, relative positions of cells, and images of tissue sections, but existing computational methods for performing this task on single-cell spatial-omics datasets often relinquish information from one or more domains. The additional reliance on the availability of "atlas" training or reference datasets limits cell type discovery to well-defined but limited cell population labels, thus posing major challenges for using these methods in practice. Successful integration of all three domains presents an opportunity for uncovering cell populations that are functionally stratified by their spatial contexts at cellular and tissue levels: the key motivation for employing spatial-omics technologies in the first place. In this work, we introduce Cell Spatio- and Neighborhood-informed Annotation and Patterning (CellSNAP), a self-supervised computational method that learns a representation vector for each cell in tissue samples measured by spatial-omics technologies at the single-cell or finer resolution. The learned representation vector fuses information about the corresponding cell across all three aforementioned domains. By applying CellSNAP to datasets spanning both spatial proteomic and spatial transcriptomic modalities, and across different tissue types and disease settings, we show that CellSNAP markedly enhances de novo discovery of biologically relevant cell populations at fine granularity, beyond current approaches, by fully integrating cells' molecular profiles with cellular neighborhood and tissue image information.

Efficient cytometry analysis with FlowSOM in Python boosts interoperability with other single-cell tools

MOTIVATION

We describe a new Python implementation of FlowSOM, a clustering method for cytometry data.

RESULTS

This implementation is faster than the original version in R, better adapted to work with single-cell omics data including integration with current single-cell data structures and includes all the original visualizations, such as the star and pie plot.

AVAILABILITY AND IMPLEMENTATION

The FlowSOM Python implementation is freely available on GitHub: https://github.com/saeyslab/FlowSOM_Python.

A Spatial Multi-Modal Dissection of Host-Microbiome Interactions within the Colitis Tissue Microenvironment

The intricate and dynamic interactions between the host immune system and its microbiome constituents undergo dynamic shifts in response to perturbations to the intestinal tissue environment. Our ability to study these events on the systems level is significantly limited by in situ approaches capable of generating simultaneous insights from both host and microbial communities. Here, we introduce Microbiome Cartography (MicroCart), a framework for simultaneous in situ probing of host features and its microbiome across multiple spatial modalities. We demonstrate MicroCart by comprehensively investigating the alterations in both gut host and microbiome components in a murine model of colitis by coupling MicroCart with spatial proteomics, transcriptomics, and glycomics platforms. Our findings reveal a global but systematic transformation in tissue immune responses, encompassing tissue-level remodeling in response to host immune and epithelial cell state perturbations, and bacterial population shifts, localized inflammatory responses, and metabolic process alterations during colitis. MicroCart enables a deep investigation of the intricate interplay between the host tissue and its microbiome with spatial multiomics.

Multiplex protein imaging in tumour biology

Tissue imaging has become much more colourful in the past decade. Advances in both experimental and analytical methods now make it possible to image protein markers in tissue samples in high multiplex. The ability to routinely image 40-50 markers simultaneously, at single-cell or subcellular resolution, has opened up new vistas in the study of tumour biology. Cellular phenotypes, interaction, communication and spatial organization have become amenable to molecular-level analysis, and application to patient cohorts has identified clinically relevant cellular and tissue features in several cancer types. Here, we review the use of multiplex protein imaging methods to study tumour biology, discuss ongoing attempts to combine these approaches with other forms of spatial omics, and highlight challenges in the field.

Pseudo-spectral angle mapping for automated pixel-level analysis of highly multiplexed tissue image data

The rapid development of highly multiplexed microscopy systems has enabled the study of cells embedded within their native tissue, which is providing exciting insights into the spatial features of human disease [1]. However, computational methods for analyzing these high-content images are still emerging, and there is a need for more robust and generalizable tools for evaluating the cellular constituents and underlying stroma captured by high-plex imaging [2]. To address this need, we have adapted spectral angle mapping - an algorithm used widely in hyperspectral image analysis - to compress the channel dimension of high-plex immunofluorescence images. As many high-plex immunofluorescence imaging experiments probe unique sets of protein markers, existing cell and pixel classification models do not typically generalize well. Pseudospectral angle mapping (pSAM) uses reference pseudospectra - or pixel vectors - to assign each pixel in an image a similarity score to several cell class reference vectors, which are defined by each unique staining panel. Here, we demonstrate that the class maps provided by pSAM can directly provide insight into the prevalence of each class defined by reference pseudospectra. In a dataset of high-plex images of colon biopsies from patients with gut autoimmune conditions, sixteen pSAM class representation maps were combined with instance segmentation of cells to provide cell class predictions. Finally, pSAM detected a diverse set of structure and immune cells when applied to a novel dataset of kidney biopsies imaged with a 43-marker panel. In summary, pSAM provides a powerful and readily generalizable method for evaluating high-plex immunofluorescence image data.

Spatial modelling of the tumor microenvironment from multiplex immunofluorescence images: methods and applications

Spatial modelling methods have gained prominence with developments in high throughput imaging platforms. Multiplex immunofluorescence (mIF) provides the scope to examine interactions between tumor and immune compartment at single cell resolution using a panel of antibodies that can be chosen based on the cancer type or the clinical interest of the study. The markers can be used to identify the phenotypes and to examine cellular interactions at global and local scales. Several translational studies rely on key understanding of the tumor microenvironment (TME) to identify drivers of immune response in immunotherapy based clinical trials. To improve the success of ongoing trials, a number of retrospective approaches can be adopted to understand differences in response, recurrence and progression by examining the patient's TME from tissue samples obtained at baseline and at various time points along the treatment. The multiplex immunofluorescence (mIF) technique provides insight on patient specific cell populations and their relative spatial distribution as qualitative measures of a favorable treatment outcome. Spatial analysis of these images provides an understanding of the intratumoral heterogeneity and clustering among cell populations in the TME. A number of mathematical models, which establish clustering as a measure of deviation from complete spatial randomness, can be applied to the mIF images represented as spatial point patterns. These mathematical models, developed for landscape ecology and geographic information studies, can be applied to the TME after careful consideration of the tumor type (cold vs. hot) and the tumor immune landscape. The spatial modelling of mIF images can show observable engagement of T cells expressing immune checkpoint molecules and this can then be correlated with single-cell RNA sequencing data.

FICTURE: Scalable segmentation-free analysis of submicron resolution spatial transcriptomics

Spatial transcriptomics (ST) technologies have advanced to enable transcriptome-wide gene expression analysis at submicron resolution over large areas. Analysis of high-resolution ST data relies heavily on image-based cell segmentation or gridding, which often fails in complex tissues due to diversity and irregularity of cell size and shape. Existing segmentation-free analysis methods scale only to small regions and a small number of genes, limiting their utility in high-throughput studies. Here we present FICTURE, a segmentation-free spatial factorization method that can handle transcriptome-wide data labeled with billions of submicron resolution spatial coordinates. FICTURE is orders of magnitude more efficient than existing methods and it is compatible with both sequencing- and imaging-based ST data. FICTURE reveals the microscopic ST architecture for challenging tissues, such as vascular, fibrotic, muscular, and lipid-laden areas in real data where previous methods failed. FICTURE's cross-platform generality, scalability, and precision make it a powerful tool for exploring high-resolution ST.

cellPLATO: an unsupervised method for identifying cell behaviour in heterogeneous cell trajectory data

Advances in imaging, cell segmentation, and cell tracking now routinely produce microscopy datasets of a size and complexity comparable to transcriptomics or proteomics. New tools are required to process this 'phenomics' type data. Cell PLasticity Analysis TOol (cellPLATO) is a Python-based analysis software designed for measurement and classification of diverse cell behaviours based on clustering of parameters of cell morphology and motility. cellPLATO is used after segmentation and tracking of cells from live cell microscopy data. The tool extracts morphological and motility metrics from each cell per timepoint, before being using them to segregate cells into behavioural subtypes with dimensionality reduction. Resultant cell tracks have a 'behavioural ID' for each cell per timepoint corresponding to their changing behaviour over time in a sequence. Similarity analysis allows the grouping of behavioural sequences into discrete trajectories with assigned IDs. Trajectories and underlying behaviours generate a phenotypic fingerprint for each experimental condition, and representative cells are mathematically identified and graphically displayed for human understanding of each subtype. Here, we use cellPLATO to investigate the role of IL-15 in modulating NK cell migration on ICAM-1 or VCAM-1. We find 8 behavioural subsets of NK cells based on their shape and migration dynamics, and 4 trajectories of behaviour. Therefore, using cellPLATO we show that IL-15 increases plasticity between cell migration behaviours and that different integrin ligands induce different forms of NK cell migration.

The impact of similarity metrics on cell-type clustering in highly multiplexed in situ imaging cytometry data

Motivation

The advent of highly multiplexed in situ imaging cytometry assays has revolutionized the study of cellular systems, offering unparalleled detail in observing cellular activities and characteristics. These assays provide comprehensive insights by concurrently profiling the spatial distribution and molecular features of numerous cells. In navigating this complex data landscape, unsupervised machine learning techniques, particularly clustering algorithms, have become essential tools. They enable the identification and categorization of cell types and subsets based on their molecular characteristics. Despite their widespread adoption, most clustering algorithms in use were initially developed for cell suspension technologies, leading to a potential mismatch in application. There is a critical gap in the systematic evaluation of these methods, particularly in determining the properties that make them optimal for in situ imaging assays. Addressing this gap is vital for ensuring accurate, reliable analyses and fostering advancements in cellular biology research.

Results

In our extensive investigation, we evaluated a range of similarity metrics, which are crucial in determining the relationships between cells during the clustering process. Our findings reveal substantial variations in clustering performance, contingent on the similarity metric employed. These variations underscore the importance of selecting appropriate metrics to ensure accurate cell type and subset identification. In response to these challenges, we introduce FuseSOM, a novel ensemble clustering algorithm that integrates hierarchical multiview learning of similarity metrics with self-organizing maps. Through a rigorous stratified subsampling analysis framework, we demonstrate that FuseSOM outperforms existing best-practice clustering methods specifically tailored for in situ imaging cytometry data. Our work not only provides critical insights into the performance of clustering algorithms in this novel context but also offers a robust solution, paving the way for more accurate and reliable in situ imaging cytometry data analysis.

Availability and implementation

The FuseSOM R package is available on Bioconductor and is available under the GPL-3 license. All the codes for the analysis performed can be found at Github.

GammaGateR: semi-automated marker gating for single-cell multiplexed imaging

Motivation

Multiplexed immunofluorescence (mIF) is an emerging assay for multichannel protein imaging that can decipher cell-level spatial features in tissues. However, existing automated cell phenotyping methods, such as clustering, face challenges in achieving consistency across experiments and often require subjective evaluation. As a result, mIF analyses often revert to marker gating based on manual thresholding of raw imaging data.

Results

To address the need for an evaluable semi-automated algorithm, we developed GammaGateR, an R package for interactive marker gating designed specifically for segmented cell-level data from mIF images. Based on a novel closed-form gamma mixture model, GammaGateR provides estimates of marker-positive cell proportions and soft clustering of marker-positive cells. The model incorporates user-specified constraints that provide a consistent but slide-specific model fit. We compared GammaGateR against the newest unsupervised approach for annotating mIF data, employing two colon datasets and one ovarian cancer dataset for the evaluation. We showed that GammaGateR produces highly similar results to a silver standard established through manual annotation. Furthermore, we demonstrated its effectiveness in identifying biological signals, achieved by mapping known spatial interactions between CD68 and MUC5AC cells in the colon and by accurately predicting survival in ovarian cancer patients using the phenotype probabilities as input for machine learning methods. GammaGateR is a highly efficient tool that can improve the replicability of marker gating results, while reducing the time of manual segmentation.

Availability and Implementation

The R package is available at https://github.com/JiangmeiRubyXiong/GammaGateR.