A framework for multiplex imaging optimization and reproducible analysis

Multiplex imaging of localized prostate tumors reveals altered spatial organization of AR-positive cells in the microenvironment

Mapping the spatial interactions of cancer, immune, and stromal cell states presents novel opportunities for patient stratification and for advancing immunotherapy. While single-cell studies revealed significant molecular heterogeneity in prostate cancer cells, the impact of spatial stromal cell heterogeneity remains poorly understood. Here, we used cyclic immunofluorescent imaging on whole-tissue sections to uncover novel spatial associations between cancer and stromal cells in low- and high-grade prostate tumors and tumor-adjacent normal tissues. Our results provide a spatial map of single cells and recurrent cellular neighborhoods in the prostate tumor microenvironment of treatment-naive patients. We report unique populations of mast cells that show distinct spatial associations with M2 macrophages and regulatory T cells. Our results show disease-specific neighborhoods that are primarily driven by androgen receptor-positive (AR+) stromal cells and identify inflammatory gene networks active in AR+ prostate stroma.

Spatially Resolved Single-Cell Omics: Methods, Challenges, and Future Perspectives

Overlaying omics data onto spatial biological dimensions has been a promising technology to provide high-resolution insights into the interactome and cellular heterogeneity relative to the organization of the molecular microenvironment of tissue samples in normal and disease states. Spatial omics can be categorized into three major modalities: (a) next-generation sequencing-based assays, (b) imaging-based spatially resolved transcriptomics approaches including in situ hybridization/in situ sequencing, and (c) imaging-based spatial proteomics. These modalities allow assessment of transcripts and proteins at a cellular level, generating large and computationally challenging datasets. The lack of standardized computational pipelines to analyze and integrate these nonuniform structured data has made it necessary to apply artificial intelligence and machine learning strategies to best visualize and translate their complexity. In this review, we summarize the currently available techniques and computational strategies, highlight their advantages and limitations, and discuss their future prospects in the scientific field.

Computational methods and biomarker discovery strategies for spatial proteomics: a review in immuno-oncology

Advancements in imaging technologies have revolutionized our ability to deeply profile pathological tissue architectures, generating large volumes of imaging data with unparalleled spatial resolution. This type of data collection, namely, spatial proteomics, offers invaluable insights into various human diseases. Simultaneously, computational algorithms have evolved to manage the increasing dimensionality of spatial proteomics inherent in this progress. Numerous imaging-based computational frameworks, such as computational pathology, have been proposed for research and clinical applications. However, the development of these fields demands diverse domain expertise, creating barriers to their integration and further application. This review seeks to bridge this divide by presenting a comprehensive guideline. We consolidate prevailing computational methods and outline a roadmap from image processing to data-driven, statistics-informed biomarker discovery. Additionally, we explore future perspectives as the field moves toward interfacing with other quantitative domains, holding significant promise for precision care in immuno-oncology.

Surface functionalized perovskite nanocrystals: a design strategy for organelle-specific fluorescence lifetime multiplexing

Fluorescent molecules or materials with high photoluminescence quantum yields and stability towards photobleaching are ideally suited for multiplex imaging. Despite complying with such properties, perovskite nanocrystals (Pv-NCs) are rarely used for bioimaging owing to their toxicity and limited stability in aqueous media and towards human physiology. We aim to address these deficiencies by designing core-shell structures with Pv-NCs as the core and surface-engineered silica as the shell (SiO2@Pv-NCs) since silica is recognized as a biologically benign carrier material and is known to be excreted through urine. The post-grafting methodology is adopted for developing [SiO2@Pv-NCs]tpm and [SiO2@Pv-NCs]tsy (tpm: triphenylphosphonium ion, tsy: tosylsulfonamide) for specific imaging of mitochondria and endoplasmic reticulum (ER) of the live HeLa cell, respectively. A subtle difference in their average fluorescence decay times ([SiO2@Pv-NCs]tpm: tpm τ av = 3.1 ns and [SiO2@Pv-NCs]tsy: tsy τ av = 2.1 ns) is used for demonstrating a rare example of perovskite nanocrystals in fluorescence lifetime multiplex imaging.

Quantitative performance assessment of Ultivue multiplex panels in formalin-fixed, paraffin-embedded human and murine tumor specimens

We present a rigorous validation strategy to evaluate the performance of Ultivue multiplex immunofluorescence panels. We have quantified the accuracy and precision of four different multiplex panels (three human and one mouse) in tumor specimens with varying levels of T cell density. Our results show that Ultivue panels are typically accurate wherein the relative difference in cell proportion between a multiplex image and a 1-plex image is less than 20% for a given biomarker. Ultivue panels exhibited relatively high intra-run precision (CV ≤ 25%) and relatively low inter-run precision (CV >> 25%) which can be remedied by using local intensity thresholding to gate biomarker positivity. We also evaluated the reproducibility of cell-cell distance estimates measured from multiplex images which show high intra- and inter-run precision. We introduce a new metric, multiplex labeling efficiency, which can be used to benchmark the overall fidelity of the multiplex data across multiple batch runs. Taken together our results provide a comprehensive characterization of Ultivue panels and offer practical guidelines for analyzing multiplex images.

Semi-automated approaches for interrogating spatial heterogeneity of tissue samples

Tissues are spatially orchestrated ecosystems composed of heterogeneous cell populations and non-cellular elements. Tissue components' interactions shape the biological processes that govern homeostasis and disease, thus comprehensive insights into tissues' composition are crucial for understanding their biology. Recently, advancements in the spatial biology field enabled the in-depth analyses of tissue architecture at single-cell resolution, while preserving the structural context. The increasing number of biomarkers analyzed, together with whole tissue imaging, generate datasets approaching several hundreds of gigabytes in size, which are rich sources of valuable knowledge but require investments in infrastructure and resources for extracting quantitative information. The analysis of multiplex whole-tissue images requires extensive training and experience in data analysis. Here, we showcase how a set of open-source tools can allow semi-automated image data extraction to study the spatial composition of tissues with a focus on tumor microenvironment (TME). With the use of Lunaphore COMET platform, we interrogated lung cancer specimens where we examined the expression of 20 biomarkers. Subsequently, the tissue composition was interrogated using an in-house optimized nuclei detection algorithm followed by a newly developed image artifact exclusion approach. Thereafter, the data was processed using several publicly available tools, highlighting the compatibility of COMET-derived data with currently available image analysis frameworks. In summary, we showcased an innovative semi-automated workflow that highlights the ease of adoption of multiplex imaging to explore TME composition at single-cell resolution using a simple slide in, data out approach. Our workflow is easily transferrable to various cohorts of specimens to provide a toolset for spatial cellular dissection of the tissue composition.

PXPermute reveals staining importance in multichannel imaging flow cytometry

Imaging flow cytometry (IFC) allows rapid acquisition of numerous single-cell images per second, capturing information from multiple fluorescent channels. However, the traditional process of staining cells with fluorescently labeled conjugated antibodies for IFC analysis is time consuming, expensive, and potentially harmful to cell viability. To streamline experimental workflows and reduce costs, it is crucial to identify the most relevant channels for downstream analysis. In this study, we introduce PXPermute, a user-friendly and powerful method for assessing the significance of IFC channels, particularly for cell profiling. Our approach evaluates channel importance by permuting pixel values within each channel and analyzing the resulting impact on machine learning or deep learning models. Through rigorous evaluation of three multichannel IFC image datasets, we demonstrate PXPermute's potential in accurately identifying the most informative channels, aligning with established biological knowledge. PXPermute can assist biologists with systematic channel analysis, experimental design optimization, and biomarker identification.

A perspective on FAIR quality control in multiplexed imaging data processing

Multiplexed imaging approaches are getting increasingly adopted for imaging of large tissue areas, yielding big imaging datasets both in terms of the number of samples and the size of image data per sample. The processing and analysis of these datasets is complex owing to frequent technical artifacts and heterogeneous profiles from a high number of stained targets To streamline the analysis of multiplexed images, automated pipelines making use of state-of-the-art algorithms have been developed. In these pipelines, the output quality of one processing step is typically dependent on the output of the previous step and errors from each step, even when they appear minor, can propagate and confound the results. Thus, rigorous quality control (QC) at each of these different steps of the image processing pipeline is of paramount importance both for the proper analysis and interpretation of the analysis results and for ensuring the reusability of the data. Ideally, QC should become an integral and easily retrievable part of the imaging datasets and the analysis process. Yet, limitations of the currently available frameworks make integration of interactive QC difficult for large multiplexed imaging data. Given the increasing size and complexity of multiplexed imaging datasets, we present the different challenges for integrating QC in image analysis pipelines as well as suggest possible solutions that build on top of recent advances in bioimage analysis.

Harmonizing the Generation and Pre-publication Stewardship of FAIR Image data

Together with the molecular knowledge of genes and proteins, biological images promise to significantly enhance the scientific understanding of complex cellular systems and to advance predictive and personalized therapeutic products for human health. For this potential to be realized, quality-assured image data must be shared among labs at a global scale to be compared, pooled, and reanalyzed, thus unleashing untold potential beyond the original purpose for which the data was generated. There are two broad sets of requirements to enable image data sharing in the life sciences. One set of requirements is articulated in the companion White Paper entitled "Enabling Global Image Data Sharing in the Life Sciences," which is published in parallel and addresses the need to build the cyberinfrastructure for sharing the digital array data (arXiv:2401.13023 [q-bio.OT], https://doi.org/10.48550/arXiv.2401.13023). In this White Paper, we detail a broad set of requirements, which involves collecting, managing, presenting, and propagating contextual information essential to assess the quality, understand the content, interpret the scientific implications, and reuse image data in the context of the experimental details. We start by providing an overview of the main lessons learned to date through international community activities, which have recently made considerable progress toward generating community standard practices for imaging Quality Control (QC) and metadata. We then provide a clear set of recommendations for amplifying this work. The driving goal is to address remaining challenges, and democratize access to common practices and tools for a spectrum of biomedical researchers, regardless of their expertise, access to resources, and geographical location.

An end-to-end workflow for multiplexed image processing and analysis

Multiplexed imaging enables the simultaneous spatial profiling of dozens of biological molecules in tissues at single-cell resolution. Extracting biologically relevant information, such as the spatial distribution of cell phenotypes from multiplexed tissue imaging data, involves a number of computational tasks, including image segmentation, feature extraction and spatially resolved single-cell analysis. Here, we present an end-to-end workflow for multiplexed tissue image processing and analysis that integrates previously developed computational tools to enable these tasks in a user-friendly and customizable fashion. For data quality assessment, we highlight the utility of napari-imc for interactively inspecting raw imaging data and the cytomapper R/Bioconductor package for image visualization in R. Raw data preprocessing, image segmentation and feature extraction are performed using the steinbock toolkit. We showcase two alternative approaches for segmenting cells on the basis of supervised pixel classification and pretrained deep learning models. The extracted single-cell data are then read, processed and analyzed in R. The protocol describes the use of community-established data containers, facilitating the application of R/Bioconductor packages for dimensionality reduction, single-cell visualization and phenotyping. We provide instructions for performing spatially resolved single-cell analysis, including community analysis, cellular neighborhood detection and cell-cell interaction testing using the imcRtools R/Bioconductor package. The workflow has been previously applied to imaging mass cytometry data, but can be easily adapted to other highly multiplexed imaging technologies. This protocol can be implemented by researchers with basic bioinformatics training, and the analysis of the provided dataset can be completed within 5-6 h. An extended version is available at https://bodenmillergroup.github.io/IMCDataAnalysis/ .

MYC Deregulation and PTEN Loss Model Tumor and Stromal Heterogeneity of Aggressive Triple-Negative Breast Cancer

Triple-negative breast cancer (TNBC) patients have a poor prognosis and few treatment options. Mouse models of TNBC are important for development of new therapies, however, few mouse models represent the complexity of TNBC. Here, we develop a female TNBC murine model by mimicking two common TNBC mutations with high co-occurrence: amplification of the oncogene MYC and deletion of the tumor suppressor PTEN. This Myc;Ptenfl model develops heterogeneous triple-negative mammary tumors that display histological and molecular features commonly found in human TNBC. Our research involves deep molecular and spatial analyses on Myc;Ptenfl tumors including bulk and single-cell RNA-sequencing, and multiplex tissue-imaging. Through comparison with human TNBC, we demonstrate that this genetic mouse model develops mammary tumors with differential survival and therapeutic responses that closely resemble the inter- and intra-tumoral and microenvironmental heterogeneity of human TNBC, providing a pre-clinical tool for assessing the spectrum of patient TNBC biology and drug response.

Understanding virus-host interactions in tissues

Although virus-host interactions are usually studied in a single cell type using in vitro assays in immortalized cell lines or isolated cell populations, it is important to remember that what is happening inside one infected cell does not translate to understanding how an infected cell behaves in a tissue, organ or whole organism. Infections occur in complex tissue environments, which contain a host of factors that can alter the course of the infection, including immune cells, non-immune cells and extracellular-matrix components. These factors affect how the host responds to the virus and form the basis of the protective response. To understand virus infection, tools are needed that can profile the tissue environment. This Review highlights methods to study virus-host interactions in the infection microenvironment.

Addressing persistent challenges in digital image analysis of cancerous tissues

The National Cancer Institute (NCI) supports many research programs and consortia, many of which use imaging as a major modality for characterizing cancerous tissue. A trans-consortia Image Analysis Working Group (IAWG) was established in 2019 with a mission to disseminate imaging-related work and foster collaborations. In 2022, the IAWG held a virtual hackathon focused on addressing challenges of analyzing high dimensional datasets from fixed cancerous tissues. Standard image processing techniques have automated feature extraction, but the next generation of imaging data requires more advanced methods to fully utilize the available information. In this perspective, we discuss current limitations of the automated analysis of multiplexed tissue images, the first steps toward deeper understanding of these limitations, what possible solutions have been developed, any new or refined approaches that were developed during the Image Analysis Hackathon 2022, and where further effort is required. The outstanding problems addressed in the hackathon fell into three main themes: 1) challenges to cell type classification and assessment, 2) translation and visual representation of spatial aspects of high dimensional data, and 3) scaling digital image analyses to large (multi-TB) datasets. We describe the rationale for each specific challenge and the progress made toward addressing it during the hackathon. We also suggest areas that would benefit from more focus and offer insight into broader challenges that the community will need to address as new technologies are developed and integrated into the broad range of image-based modalities and analytical resources already in use within the cancer research community.

Flexible Cyclic Immunofluorescence (cyCIF) Using Oligonucleotide Barcoded Antibodies

Advances in our understanding of the complex, multifaceted interactions between tumor epithelia, immune infiltrate, and tumor microenvironmental cells have been driven by highly multiplexed imaging technologies. These techniques are capable of labeling many more biomarkers than conventional immunostaining methods. However, multiplexed imaging techniques suffer from low detection sensitivity, cell loss-particularly in fragile samples-, and challenges with antibody labeling. Herein, we developed and optimized an oligonucleotide antibody barcoding strategy for cyclic immunofluorescence (cyCIF) that can be amplified to increase the detection efficiency of low-abundance antigens. Stained fluorescence signals can be readily removed using ultraviolet light treatment, preserving tissue and fragile cell sample integrity. We also extended the oligonucleotide barcoding strategy to secondary antibodies to enable the inclusion of difficult-to-label primary antibodies in a cyCIF panel. Using both the amplification oligonucleotides to label DNA barcoded antibodies and in situ hybridization of multiple fluorescently labeled oligonucleotides resulted in signal amplification and increased signal-to-background ratios. This procedure was optimized through the examination of staining parameters including staining oligonucleotide concentration, staining temperature, and oligonucleotide sequence design, resulting in a robust amplification technique. As a proof-of-concept, we demonstrate the flexibility of our cyCIF strategy by simultaneously imaging with the original oligonucleotide conjugated antibody (Ab-oligo) cyCIF strategy, the novel Ab-oligo cyCIF amplification strategy, as well as direct and indirect immunofluorescence to generate highly multiplexed images.