Highly multiplexed immunofluorescence images and single-cell data of immune markers in tonsil and lung cancer

Multiomic analysis identifies suppressive myeloid cell populations in human TB granulomas

Tuberculosis (TB) remains a major global health challenge, particularly in the context of multidrug-resistant (MDR) Mycobacterium tuberculosis (Mtb). Host-directed therapies (HDTs) have been proposed as adjunctive therapy to enhance immune control of infection. Recently, one such HDT, pharmacologic modulation of myeloid-derived suppressor cells (MDSCs), has been proposed to treat MDR-TB. While MDSCs have been well characterized in cancer, their role in TB pathogenesis remains unclear. To investigate whether MDSCs or other myeloid suppressor populations contribute to TB granuloma microenvironments (GME), we performed spatial transcriptional profiling and single-cell immunophenotyping on eighty-four granulomas in lung specimens from three individuals with active disease. Granulomas were histologically classified based on H&E staining, and transcriptional signatures were compared across regions of interest (ROIs) at different states of granuloma maturation. Our analysis revealed that immune suppression within granuloma was not primarily driven by classical MDSCs but rather by multiple myeloid cell subsets, including dendritic cells expressing indoleamine 2,3 dioxygenase-1 expressing (IDO1+ DCs). IDO1+ DCs were the most frequently observed suppressive myeloid cells, particularly in cellular regions, and their spatial proximity to activated T cells suggested localized immunosuppression. Importantly, granulomas at different stages contained distinct proportions of suppressor myeloid cells, with necrotic and cellular regions showing different myeloid phenotypes that may influence granuloma progression. Gene set enrichment analysis (GSEA) further indicated that elevated IDO1 expression was associated with a complex immune response that balanced suppressive signaling, immune activation, and cellular metabolism. These findings suggest that classical MDSCs, as defined in tumor microenvironments, likely play a minor role in TB, whereas IDO1+ DCs may be key regulators of immune suppression in granulomas influencing local Mtb control in infected lung. A deeper understanding of the role of IDO1+ suppressive myeloid cells in TB granulomas is essential to assessing their potential as therapeutic targets in TB treatment.

Flexible and robust cell type annotation for highly multiplexed tissue images

Identifying cell types in highly multiplexed images is essential for understanding tissue spatial organization. Current cell type annotation methods often rely on extensive reference images and manual adjustments. In this work, we present a tool, Robust Image-Based Cell Annotator (RIBCA), that enables accurate, automated, unbiased, and fine-grained cell type annotation for images with a wide range of antibody panels, without requiring additional model training or human intervention. Our tool has successfully annotated over 3 million cells, revealing the spatial organization of various cell types across more than 40 different human tissues. It is open-source and features a modular design, allowing for easy extension to additional cell types.

Spatial Morphoproteomic Features Predict Uniqueness of Immune Microarchitectures and Responses in Lymphoid Follicles

Multiplex imaging technologies allow the characterization of single cells in their cellular environments. Understanding the organization of single cells within their microenvironment and quantifying disease-status related biomarkers is essential for multiplex datasets. Here we proposed SNOWFLAKE, a graph neural network framework pipeline for the prediction of disease-status from combined multiplex cell expression and morphology in human B-cell follicles. We applied SNOWFLAKE to a multiplex dataset related to COVID-19 infection in humans and showed better predictive power of the SNOWFLAKE pipeline compared to other machine learning and deep learning methods. Moreover, we combined morphological features inside graph edge features to utilize attribution methods for extracting disease-relevant motifs from single-cell spatial graphs. The underlying subgraphs were further analyzed and associated with disease status across the dataset. We showed that SNOWFLAKE successfully extracted significant low dimensional embedding from subgraphs with a clear separation between disease status and helped characterize unique cellular interactions in the subgraphs. SNOWFLAKE is a generalizable pipeline for the analysis of multiplex imaging data modality by extracting disease-relevant subgraphs guided by graph-level prediction.

Single-cell and spatial analyses reveal a tradeoff between murine mammary proliferation and lineage programs associated with endocrine cues

Although distinct epithelial cell types have been distinguished in glandular tissues such as the mammary gland, the extent of heterogeneity within each cell type and the degree of endocrine control of this diversity across development are incompletely understood. By combining mass cytometry and cyclic immunofluorescence, we define a rich array of murine mammary epithelial cell subtypes associated with puberty, the estrous cycle, and sex. These subtypes are differentially proliferative and spatially segregate distinctly in adult versus pubescent glands. Further, we identify systematic suppression of lineage programs at the protein and RNA levels as a common feature of mammary epithelial expansion during puberty, the estrous cycle, and gestation and uncover a pervasive enrichment of ribosomal protein genes in luminal cells elicited specifically during progesterone-dominant expansionary periods. Collectively, these data expand our knowledge of murine mammary epithelial heterogeneity and connect endocrine-driven epithelial expansion with lineage suppression.

DNA-barcoded signal amplification for imaging mass cytometry enables sensitive and highly multiplexed tissue imaging

Imaging mass cytometry (IMC) is a highly multiplexed, antibody-based imaging method that captures heterogeneous spatial protein expression patterns at subcellular resolution. Here we report the extension of IMC to low-abundance markers through incorporation of the DNA-based signal amplification by exchange reaction, immuno-SABER. We applied SABER-IMC to image the tumor immune microenvironment in human melanoma by simultaneous imaging of 18 markers with immuno-SABER and 20 markers without amplification. SABER-IMC enabled the identification of immune cell phenotypic markers, such as T cell co-receptors and their ligands, that are not detectable with IMC.

IMC-Denoise: a content aware denoising pipeline to enhance Imaging Mass Cytometry

Imaging Mass Cytometry (IMC) is an emerging multiplexed imaging technology for analyzing complex microenvironments using more than 40 molecularly-specific channels. However, this modality has unique data processing requirements, particularly for patient tissue specimens where signal-to-noise ratios for markers can be low, despite optimization, and pixel intensity artifacts can deteriorate image quality and downstream analysis. Here we demonstrate an automated content-aware pipeline, IMC-Denoise, to restore IMC images deploying a differential intensity map-based restoration (DIMR) algorithm for removing hot pixels and a self-supervised deep learning algorithm for shot noise image filtering (DeepSNiF). IMC-Denoise outperforms existing methods for adaptive hot pixel and background noise removal, with significant image quality improvement in modeled data and datasets from multiple pathologies. This includes in technically challenging human bone marrow; we achieve noise level reduction of 87% for a 5.6-fold higher contrast-to-noise ratio, and more accurate background noise removal with approximately 2 × improved F1 score. Our approach enhances manual gating and automated phenotyping with cell-scale downstream analyses. Verified by manual annotations, spatial and density analysis for targeted cell groups reveal subtle but significant differences of cell populations in diseased bone marrow. We anticipate that IMC-Denoise will provide similar benefits across mass cytometric applications to more deeply characterize complex tissue microenvironments.

Topological-Preserving Membrane Skeleton Segmentation in Multiplex Immunofluorescence Imaging

Multiplex immunofluorescence (MxIF) is an emerging imaging technology whose downstream molecular analytics highly rely upon the effectiveness of cell segmentation. In practice, multiple membrane markers (e.g., NaKATPase, PanCK and β-catenin) are employed to stain membranes for different cell types, so as to achieve a more comprehensive cell segmentation since no single marker fits all cell types. However, prevalent watershed-based image processing might yield inferior capability for modeling complicated relationships between markers. For example, some markers can be misleading due to questionable stain quality. In this paper, we propose a deep learning based membrane segmentation method to aggregate complementary information that is uniquely provided by large scale MxIF markers. We aim to segment tubular membrane structure in MxIF data using global (membrane markers z-stack projection image) and local (separate individual markers) information to maximize topology preservation with deep learning. Specifically, we investigate the feasibility of four SOTA 2D deep networks and four volumetric-based loss functions. We conducted a comprehensive ablation study to assess the sensitivity of the proposed method with various combinations of input channels. Beyond using adjusted rand index (ARI) as the evaluation metric, which was inspired by the clDice, we propose a novel volumetric metric that is specific for skeletal structure, denoted as c l D i c e S K E L . In total, 80 membrane MxIF images were manually traced for 5-fold cross-validation. Our model outperforms the baseline with a 20.2% and 41.3% increase in c l D i c e S K E L and ARI performance, which is significant (p<0.05) using the Wilcoxon signed rank test. Our work explores a promising direction for advancing MxIF imaging cell segmentation with deep learning membrane segmentation. Tools are available at https://github.com/MASILab/MxIF_Membrane_Segmentation.

Statistical Analysis of Multiplex Immunofluorescence and Immunohistochemistry Imaging Data

Advances in multiplexed single-cell immunofluorescence (mIF) and multiplex immunohistochemistry (mIHC) imaging technologies have enabled the analysis of cell-to-cell spatial relationships that promise to revolutionize our understanding of tissue-based diseases and autoimmune disorders. Multiplex images are collected as multichannel TIFF files; then denoised, segmented to identify cells and nuclei, normalized across slides with protein markers to correct for batch effects, and phenotyped; and then tissue composition and spatial context at the cellular level are analyzed. This chapter discusses methods and software infrastructure for image processing and statistical analysis of mIF/mIHC data.

Unsupervised discovery of tissue architecture in multiplexed imaging

Multiplexed imaging and spatial transcriptomics enable highly resolved spatial characterization of cellular phenotypes, but still largely depend on laborious manual annotation to understand higher-order patterns of tissue organization. As a result, higher-order patterns of tissue organization are poorly understood and not systematically connected to disease pathology or clinical outcomes. To address this gap, we developed an approach called UTAG to identify and quantify microanatomical tissue structures in multiplexed images without human intervention. Our method combines information on cellular phenotypes with the physical proximity of cells to accurately identify organ-specific microanatomical domains in healthy and diseased tissue. We apply our method to various types of images across healthy and disease states to show that it can consistently detect higher-level architectures in human tissues, quantify structural differences between healthy and diseased tissue, and reveal tissue organization patterns at the organ scale.

Mistic: An open-source multiplexed image t-SNE viewer

Understanding the complex ecology of a tumor tissue and the spatiotemporal relationships between its cellular and microenvironment components is becoming a key component of translational research, especially in immuno-oncology. The generation and analysis of multiplexed images from patient samples is of paramount importance to facilitate this understanding. Here, we present Mistic, an open-source multiplexed image t-SNE viewer that enables the simultaneous viewing of multiple 2D images rendered using multiple layout options to provide an overall visual preview of the entire dataset. In particular, the positions of the images can be t-SNE or UMAP coordinates. This grouped view of all images allows an exploratory understanding of the specific expression pattern of a given biomarker or collection of biomarkers across all images, helps to identify images expressing a particular phenotype, and can help select images for subsequent downstream analysis. Currently, there is no freely available tool to generate such image t-SNEs.

A human breast atlas integrating single-cell proteomics and transcriptomics

The breast is a dynamic organ whose response to physiological and pathophysiological conditions alters its disease susceptibility, yet the specific effects of these clinical variables on cell state remain poorly annotated. We present a unified, high-resolution breast atlas by integrating single-cell RNA-seq, mass cytometry, and cyclic immunofluorescence, encompassing a myriad of states. We define cell subtypes within the alveolar, hormone-sensing, and basal epithelial lineages, delineating associations of several subtypes with cancer risk factors, including age, parity, and BRCA2 germline mutation. Of particular interest is a subset of alveolar cells termed basal-luminal (BL) cells, which exhibit poor transcriptional lineage fidelity, accumulate with age, and carry a gene signature associated with basal-like breast cancer. We further utilize a medium-depletion approach to identify molecular factors regulating cell-subtype proportion in organoids. Together, these data are a rich resource to elucidate diverse mammary cell states.

Narrative online guides for the interpretation of digital-pathology images and tissue-atlas data

Multiplexed tissue imaging facilitates the diagnosis and understanding of complex disease traits. However, the analysis of such digital images heavily relies on the experience of anatomical pathologists for the review, annotation and description of tissue features. In addition, the wider use of data from tissue atlases in basic and translational research and in classrooms would benefit from software that facilitates the easy visualization and sharing of the images and the results of their analyses. In this Perspective, we describe the ecosystem of software available for the analysis of tissue images and discuss the need for interactive online guides that help histopathologists make complex images comprehensible to non-specialists. We illustrate this idea via a software interface (Minerva), accessible via web browsers, that integrates multi-omic and tissue-atlas features. We argue that such interactive narrative guides can effectively disseminate digital histology data and aid their interpretation.

Whole-cell segmentation of tissue images with human-level performance using large-scale data annotation and deep learning

A principal challenge in the analysis of tissue imaging data is cell segmentation-the task of identifying the precise boundary of every cell in an image. To address this problem we constructed TissueNet, a dataset for training segmentation models that contains more than 1 million manually labeled cells, an order of magnitude more than all previously published segmentation training datasets. We used TissueNet to train Mesmer, a deep-learning-enabled segmentation algorithm. We demonstrated that Mesmer is more accurate than previous methods, generalizes to the full diversity of tissue types and imaging platforms in TissueNet, and achieves human-level performance. Mesmer enabled the automated extraction of key cellular features, such as subcellular localization of protein signal, which was challenging with previous approaches. We then adapted Mesmer to harness cell lineage information in highly multiplexed datasets and used this enhanced version to quantify cell morphology changes during human gestation. All code, data and models are released as a community resource.

Improving Common Bacterial Blight Phenotyping by Using Rub Inoculation and Machine Learning: Cheaper, Better, Faster, Stronger

Accurate assessment of plant symptoms plays a key role for measuring the impact of pathogens during plant-pathogen interaction. Common bacterial blight caused by Xanthomonas phaseoli pv. phaseoli and X. citri pv. fuscans is a major threat to common bean. The pathogenicity of these bacteria is variable among strains and depends mainly on a type III secretion system and associated type III effectors such as transcription activator-like effectors. Because the impact of a single gene is often small and difficult to detect, a discriminating methodology is required to distinguish the slight phenotype changes induced during the progression of the disease. Here, we compared two different inoculation and symptom assessment methods for their ability to distinguish two tal mutants from their corresponding wild-type strains. Interestingly, rub inoculation of the first leaves combined with symptom assessment by machine learning-based imaging allowed significant distinction between wild-type and mutant strains. By contrast, dip inoculation of first-trifoliate leaves combined with chlorophyll fluorescence imaging did not differentiate the strains. Furthermore, the new method developed here led to the miniaturization of pathogenicity tests and significant time savings.

Spatial mapping of protein composition and tissue organization: a primer for multiplexed antibody-based imaging

Tissues and organs are composed of distinct cell types that must operate in concert to perform physiological functions. Efforts to create high-dimensional biomarker catalogs of these cells have been largely based on single-cell sequencing approaches, which lack the spatial context required to understand critical cellular communication and correlated structural organization. To probe in situ biology with sufficient depth, several multiplexed protein imaging methods have been recently developed. Though these technologies differ in strategy and mode of immunolabeling and detection tags, they commonly utilize antibodies directed against protein biomarkers to provide detailed spatial and functional maps of complex tissues. As these promising antibody-based multiplexing approaches become more widely adopted, new frameworks and considerations are critical for training future users, generating molecular tools, validating antibody panels, and harmonizing datasets. In this Perspective, we provide essential resources, key considerations for obtaining robust and reproducible imaging data, and specialized knowledge from domain experts and technology developers.

A community-based approach to image analysis of cells, tissues and tumors

Emerging multiplexed imaging platforms provide an unprecedented view of an increasing number of molecular markers at subcellular resolution and the dynamic evolution of tumor cellular composition. As such, they are capable of elucidating cell-to-cell interactions within the tumor microenvironment that impact clinical outcome and therapeutic response. However, the rapid development of these platforms has far outpaced the computational methods for processing and analyzing the data they generate. While being technologically disparate, all imaging assays share many computational requirements for post-collection data processing. As such, our Image Analysis Working Group (IAWG), composed of researchers in the Cancer Systems Biology Consortium (CSBC) and the Physical Sciences - Oncology Network (PS-ON), convened a workshop on "Computational Challenges Shared by Diverse Imaging Platforms" to characterize these common issues and a follow-up hackathon to implement solutions for a selected subset of them. Here, we delineate these areas that reflect major axes of research within the field, including image registration, segmentation of cells and subcellular structures, and identification of cell types from their morphology. We further describe the logistical organization of these events, believing our lessons learned can aid others in uniting the imaging community around self-identified topics of mutual interest, in designing and implementing operational procedures to address those topics and in mitigating issues inherent in image analysis (e.g., sharing exemplar images of large datasets and disseminating baseline solutions to hackathon challenges through open-source code repositories).

Reduction of autofluorescence in whole adult worms of Schistosoma japonicum for immunofluorescence assay

Immunofluorescence assay is one of methods to understand the spatial biology by visualizing localization of biomolecules in cells and tissues. Autofluorescence, as a common phenomenon in organisms, is a background signal interfering the immunolocalization assay of schistosome biomolecules, and may lead to misinterpretation of the biomolecular function. However, applicable method for reducing the autofluorescence in Schistosoma remains unclear. In order to find a suitable method for reducing autofluorescence of schistosomes, different chemical reagents, such as Sudan black B (SBB), trypan blue (TB), copper sulfate (CuSO₄), Tris-glycine (Gly), and ammonia/ethanol (AE), at different concentrations and treatment time were tested, and SBB and CuSO₄ were verified for the effect of blocking autofluorescence in immunofluorescence to localize the target with anti-SjCRT antibody. By comparing the autofluorescence characteristics of different conditions, it was found that SBB, TB and CuSO₄ had a certain degree of reducing autofluorescence effect, and the best effect in females was using 50 mM CuSO₄ for 6 h and in males was 0.5% SBB for 6 h. Furthermore, we have applied the optimized conditions to the immunofluorescence of SjCRT protein, and the results revealed that the immunofluorescence signal of SjCRT was clearly visible without autofluorescence interference. We present an effective method to reduce autofluorescence in male and female worm of Schistosoma japonicum for immunofluorescence assay, which could be helpful to better understand biomolecular functions. Our method provides an idea for immunofluorescence assay in other flukes with autofluoresence.

Artificial Intelligence and Cellular Segmentation in Tissue Microscopy Images

With applications in object detection, image feature extraction, image classification, and image segmentation, artificial intelligence is facilitating high-throughput analysis of image data in a variety of biomedical imaging disciplines, ranging from radiology and pathology to cancer biology and immunology. Specifically, a growth in research on deep learning has led to the widespread application of computer-visualization techniques for analyzing and mining data from biomedical images. The availability of open-source software packages and the development of novel, trainable deep neural network architectures has led to increased accuracy in cell detection and segmentation algorithms. By automating cell segmentation, it is now possible to mine quantifiable cellular and spatio-cellular features from microscopy images, providing insight into the organization of cells in various pathologies. This mini-review provides an overview of the current state of the art in deep learning- and artificial intelligence-based methods of segmentation and data mining of cells in microscopy images of tissue.

Antigen dominance hierarchies shape TCF1+ progenitor CD8 T cell phenotypes in tumors

CD8 T cell responses against different tumor neoantigens occur simultaneously, yet little is known about the interplay between responses and its impact on T cell function and tumor control. In mouse lung adenocarcinoma, we found that immunodominance is established in tumors, wherein CD8 T cell expansion is predominantly driven by the antigen that most stably binds MHC. T cells responding to subdominant antigens were enriched for a TCF1+ progenitor phenotype correlated with response to immune checkpoint blockade (ICB) therapy. However, the subdominant T cell response did not preferentially benefit from ICB due to a dysfunctional subset of TCF1+ cells marked by CCR6 and Tc17 differentiation. Analysis of human samples and sequencing datasets revealed that CCR6+ TCF1+ cells exist across human cancers and are not correlated with ICB response. Vaccination eliminated CCR6+ TCF1+ cells and dramatically improved the subdominant response, highlighting a strategy to optimally engage concurrent neoantigen responses against tumors.

Targeting Pin1 renders pancreatic cancer eradicable by synergizing with immunochemotherapy

Pancreatic ductal adenocarcinoma (PDAC) is characterized by notorious resistance to current therapies attributed to inherent tumor heterogeneity and highly desmoplastic and immunosuppressive tumor microenvironment (TME). Unique proline isomerase Pin1 regulates multiple cancer pathways, but its role in the TME and cancer immunotherapy is unknown. Here, we find that Pin1 is overexpressed both in cancer cells and cancer-associated fibroblasts (CAFs) and correlates with poor survival in PDAC patients. Targeting Pin1 using clinically available drugs induces complete elimination or sustained remissions of aggressive PDAC by synergizing with anti-PD-1 and gemcitabine in diverse model systems. Mechanistically, Pin1 drives the desmoplastic and immunosuppressive TME by acting on CAFs and induces lysosomal degradation of the PD-1 ligand PD-L1 and the gemcitabine transporter ENT1 in cancer cells, besides activating multiple cancer pathways. Thus, Pin1 inhibition simultaneously blocks multiple cancer pathways, disrupts the desmoplastic and immunosuppressive TME, and upregulates PD-L1 and ENT1, rendering PDAC eradicable by immunochemotherapy.

Adjacent Cell Marker Lateral Spillover Compensation and Reinforcement for Multiplexed Images

Multiplex imaging technologies are now routinely capable of measuring more than 40 antibody-labeled parameters in single cells. However, lateral spillage of signals in densely packed tissues presents an obstacle to the assignment of high-dimensional spatial features to individual cells for accurate cell-type annotation. We devised a method to correct for lateral spillage of cell surface markers between adjacent cells termed REinforcement Dynamic Spillover EliminAtion (REDSEA). The use of REDSEA decreased contaminating signals from neighboring cells. It improved the recovery of marker signals across both isotopic (i.e., Multiplexed Ion Beam Imaging) and immunofluorescent (i.e., Cyclic Immunofluorescence) multiplexed images resulting in a marked improvement in cell-type classification.

A Simple Method for Creating a High-Content Microscope for Imaging Multiplexed Tissue Microarrays

High-throughput, high-content imaging technologies and multiplex slide scanning have become widely used. Advantages of these approaches include the ability to archive digital copies of slides, review slides as teams using virtual microscopy software, and standardize analytical approaches. The cost and hardware and software inflexibility of dedicated slide scanning devices can, however, complicate implementation. Here, we describe a simple method that allows any microscope to be used for slide scanning. The only requirements are that the microscope be equipped with a motorized filter turret or wheels (for multi-channel fluorescence) and a motorized xyz stage. This example uses MetaMorph software, but the same principles can be used with any microscope control software that includes a few standard functions and allows programming of simple command routines, or journals. The series of journals that implement the method perform key functions, including assistance in defining an unlimited number of regions of interest (ROI) and imaging parameters. Fully automated acquisition is rapid, taking less than 3 hr to image fifty 2.5-mm ROIs in four channels. Following acquisition, images can be easily stitched and displayed using open-source or commercial image-processing and virtual microscope applications. © 2021 Wiley Periodicals LLC. Basic Protocol 1: Hardware and software configuration Basic Protocol 2: Create a preliminary scan Basic Protocol 3: Select, save, and position ROIs Basic Protocol 4: Determine and set autofocus parameters Basic Protocol 5: Acquire tiled images Basic Protocol 6: Review the scans Basic Protocol 7: Reimage ROIs as needed Basic Protocol 8: Stitch, stack, and assemble images Basic Protocol 9: Repeat scanning for multiplex immunostaining or background subtraction.

Image-based cell phenotyping with deep learning

A cell's phenotype is the culmination of several cellular processes through a complex network of molecular interactions that ultimately result in a unique morphological signature. Visual cell phenotyping is the characterization and quantification of these observable cellular traits in images. Recently, cellular phenotyping has undergone a massive overhaul in terms of scale, resolution, and throughput, which is attributable to advances across electronic, optical, and chemical technologies for imaging cells. Coupled with the rapid acceleration of deep learning-based computational tools, these advances have opened up new avenues for innovation across a wide variety of high-throughput cell biology applications. Here, we review applications wherein deep learning is powering the recognition, profiling, and prediction of visual phenotypes to answer important biological questions. As the complexity and scale of imaging assays increase, deep learning offers computational solutions to elucidate the details of previously unexplored cellular phenotypes.

Multiplex Immunofluorescence Tyramide Signal Amplification for Immune Cell Profiling of Paraffin-Embedded Tumor Tissues

Every day, more evidence is revealed regarding the importance of the relationship between the response to cancer immunotherapy and the cancer immune microenvironment. It is well established that a profound characterization of the immune microenvironment is needed to identify prognostic and predictive immune biomarkers. To this end, we find phenotyping cells by multiplex immunofluorescence (mIF) a powerful and useful tool to identify cell types in biopsy specimens. Here, we describe the use of mIF tyramide signal amplification for labeling up to eight markers on a single slide of formalin-fixed, paraffin-embedded tumor tissue to phenotype immune cells in tumor tissues. Different panels show different markers, and the different panels can be used to characterize immune cells and relevant checkpoint proteins. The panel design depends on the research hypothesis, the cell population of interest, or the treatment under investigation. To phenotype the cells, image analysis software is used to identify individual marker expression or specific co-expression markers, which can differentiate already selected phenotypes. The individual-markers approach identifies a broad number of cell phenotypes, including rare cells, which may be helpful in a tumor microenvironment study. To accurately interpret results, it is important to recognize which receptors are expressed on different cell types and their typical location (i.e., nuclear, membrane, and/or cytoplasm). Furthermore, the amplification system of mIF may allow us to see weak marker signals, such as programmed cell death ligand 1, more easily than they are seen with single-marker immunohistochemistry (IHC) labeling. Finally, mIF technologies are promising resources for discovery of novel cancer immunotherapies and related biomarkers. In contrast with conventional IHC, which permits only the labeling of one single marker per tissue sample, mIF can detect multiple markers from a single tissue sample, and at the same time, deliver extensive information about the cell phenotypes composition and their spatial localization. In this matter, the phenotyping process is critical and must be done accurately by a highly trained personal with knowledge of immune cell protein expression and tumor pathology.

Dive into Single, Seek Out Multiple: Probing Cancer Metastases via Single-Cell Sequencing and Imaging Techniques

Metastasis is the cause of most cancer deaths and continues to be the biggest challenge in clinical practice and laboratory investigation. The challenge is largely due to the intrinsic heterogeneity of primary and metastatic tumor populations and the complex interactions among cancer cells and cells in the tumor microenvironment. Therefore, it is important to determine the genotype and phenotype of individual cells so that the metastasis-driving events can be precisely identified, understood, and targeted in future therapies. Single-cell sequencing techniques have allowed the direct comparison of the genomic and transcriptomic changes among different stages of metastatic samples. Single-cell imaging approaches have enabled the live visualization of the heterogeneous behaviors of malignant and non-malignant cells in the tumor microenvironment. By applying these technologies, we are achieving a spatiotemporal precision understanding of cancer metastases and clinical therapeutic translations.

Next Generation Imaging Techniques to Define Immune Topographies in Solid Tumors

In recent years, cancer immunotherapy experienced remarkable developments and it is nowadays considered a promising therapeutic frontier against many types of cancer, especially hematological malignancies. However, in most types of solid tumors, immunotherapy efficacy is modest, partly because of the limited accessibility of lymphocytes to the tumor core. This immune exclusion is mediated by a variety of physical, functional and dynamic barriers, which play a role in shaping the immune infiltrate in the tumor microenvironment. At present there is no unified and integrated understanding about the role played by different postulated models of immune exclusion in human solid tumors. Systematically mapping immune landscapes or "topographies" in cancers of different histology is of pivotal importance to characterize spatial and temporal distribution of lymphocytes in the tumor microenvironment, providing insights into mechanisms of immune exclusion. Spatially mapping immune cells also provides quantitative information, which could be informative in clinical settings, for example for the discovery of new biomarkers that could guide the design of patient-specific immunotherapies. In this review, we aim to summarize current standard and next generation approaches to define Cancer Immune Topographies based on published studies and propose future perspectives.

Experimental and computational technologies to dissect the kidney at the single-cell level

The field of single-cell technologies, in particular single-cell genomics with transcriptomics and epigenomics, and most recently single-cell proteomics, is rapidly growing and holds promise to advance our understanding of organ homoeostasis and disease, and facilitate the identification of novel therapeutic targets and biomarkers. This review offers an introduction to these technologies. In addition, as the size and complexity of the data require sophisticated computational methods for analysis and interpretation, we will also provide an overview of these methods and summarize the single-cell literature specifically pertaining to the kidney.

Multimodal Imaging Mass Spectrometry: Next Generation Molecular Mapping in Biology and Medicine

Imaging mass spectrometry has become a mature molecular mapping technology that is used for molecular discovery in many medical and biological systems. While powerful by itself, imaging mass spectrometry can be complemented by the addition of other orthogonal, chemically informative imaging technologies to maximize the information gained from a single experiment and enable deeper understanding of biological processes. Within this review, we describe MALDI, SIMS, and DESI imaging mass spectrometric technologies and how these have been integrated with other analytical modalities such as microscopy, transcriptomics, spectroscopy, and electrochemistry in a field termed multimodal imaging. We explore the future of this field and discuss forthcoming developments that will bring new insights to help unravel the molecular complexities of biological systems, from single cells to functional tissue structures and organs.

Interrogating the microenvironmental landscape of tumors with computational image analysis approaches

The tumor microenvironment is an interacting heterogeneous collection of cancer cells, resident as well as infiltrating host cells, secreted factors, and extracellular matrix proteins. With the growing importance of immunotherapies, it has become crucial to be able to characterize the composition and the functional orientation of the microenvironment. The development of novel computational image analysis methodologies may enable the robust quantification and localization of immune and related biomarker-expressing cells within the microenvironment. The aim of the review is to concisely highlight a selection of current and significant contributions pertinent to methodological advances coupled with biomedical or translational applications. A further aim is to concisely present computational advances that, to our knowledge, have currently very limited use for the assessment of the microenvironment but have the potential to enhance image analysis pipelines; on this basis, an example is shown for the detection and segmentation of cells of the microenvironment using a published pipeline and a public dataset. Finally, a general proposal is presented on the conceptual design of automation-optimized computational image analysis workflows in the biomedical and clinical domain.

Overview of multiplex immunohistochemistry/immunofluorescence techniques in the era of cancer immunotherapy

Conventional immunohistochemistry (IHC) is a widely used diagnostic technique in tissue pathology. However, this technique is associated with a number of limitations, including high inter-observer variability and the capacity to label only one marker per tissue section. This review details various highly multiplexed techniques that have emerged to circumvent these constraints, allowing simultaneous detection of multiple markers on a single tissue section and the comprehensive study of cell composition, cellular functional and cell-cell interactions. Among these techniques, multiplex Immunohistochemistry/Immunofluorescence (mIHC/IF) has emerged to be particularly promising. mIHC/IF provides high-throughput multiplex staining and standardized quantitative analysis for highly reproducible, efficient and cost-effective tissue studies. This technique has immediate potential for translational research and clinical practice, particularly in the era of cancer immunotherapy.