Uncovering the spatial landscape of molecular interactions within the tumor microenvironment through latent spaces

Cellular dynamics of tumor microenvironment driving immunotherapy resistance in non-small-cell lung carcinoma

Immune checkpoint inhibitors (ICIs) have profoundly reshaped the treatment paradigm for non-small cell lung cancer (NSCLC). Despite these advancements, primary and secondary resistance to ICIs remain prevalent challenges in managing advanced NSCLC. Recent studies have highlighted the significant role of the tumor microenvironment (TME) in modulating treatment responses. This review aims to comprehensively examine the interactive roles of immune/stromal cells-such as T cells, B cells, neutrophils, macrophages, and CAFs within the TME, elucidating how these diverse cellular interactions contribute to immunotherapy resistance. It focuses on the dynamic interactions among diverse cell types such as the varying states of T cells under the influence of TME constituents like immune cells and cancer-associated fibroblasts (CAFs). By exploring the mechanisms involved in the complex cellular interactions, we highlight novel therapeutic targets and strategies aimed at overcoming resistance, thereby enhancing the efficacy of ICIs in NSCLC. Our synthesis of recent research provides critical insights into the multifaceted mechanisms of resistance and paves the way for the development of more effective, personalized treatment approaches.

The MCIB Model: A Novel Theory for Describing the Spatial Heterogeneity of the Tumor Microenvironment

The tumor microenvironment (TME) can be regarded as a complex and dynamic microecosystem generated by the interactions of tumor cells, interstitial cells, the extracellular matrix, and their products and plays an important role in the occurrence, progression and metastasis of tumors. In a previous study, we constructed an IEO model (prI-, prE-, and pOst-metastatic niche) according to the chronological sequence of TME development. In this paper, to fill the theoretical gap in spatial heterogeneity in the TME, we defined an MCIB model (Metabolic, Circulatory, Immune, and microBial microenvironment). The MCIB model divides the TME into four subtypes that interact with each other in terms of mechanism, corresponding to the four major links of metabolic reprogramming, vascular remodeling, immune response, and microbial action, providing a new way to assess the TME. The combination of the MCIB model and IEO model comprehensively depicts the spatiotemporal evolution of the TME and can provide a theoretical basis for the combination of clinical targeted therapy, immunotherapy, and other comprehensive treatment modalities for tumors according to the combination and crosstalk of different subtypes in the MCIB model and provide a powerful research paradigm for tumor drug-resistance mechanisms and tumor biological behavior.

Spatial multi-omics reveal intratumoral humoral immunity niches associated with tertiary lymphoid structures in pancreatic cancer immunotherapy pathologic responders

Pancreatic adenocarcinoma (PDAC) is a rapidly progressing cancer that responds poorly to immunotherapies. Intratumoral tertiary lymphoid structures (TLS) have been associated with rare long-term PDAC survivors, but the role of TLS in PDAC and their spatial relationships within the context of the broader tumor microenvironment remain unknown. We generated a spatial multi-omics atlas encompassing 26 PDAC tumors from patients treated with combination immunotherapies. Using machine learning-enabled H&E image classification models and unsupervised gene expression matrix factorization methods for spatial transcriptomics, we characterized cellular states within TLS niches spanning across distinct morphologies and immunotherapies. Unsupervised learning generated a TLS-specific spatial gene expression signature that significantly associates with improved survival in PDAC patients. These analyses demonstrate TLS-associated intratumoral B cell maturation in pathological responders, confirmed with spatial proteomics and BCR profiling. Our study also identifies spatial features of pathologic immune responses, revealing TLS maturation colocalizing with IgG/IgA distribution and extracellular matrix remodeling.

GRAPHICAL ABSTRACT

HIGHLIGHTS

Integrated multi-modal spatial profiling of human PDAC tumors from neoadjuvant immunotherapy clinical trials reveal diverse spatial niches enriched in TLS.TLS maturity is influenced by tumor location and the cellular neighborhoods in which TLS immune cells are recruited.Unsupervised machine learning of genome-wide signatures on spatial transcriptomics data characterizes the TLS-enriched TME and associates TLS transcriptomes with survival outcomes in PDAC.Interactions of spatially variable gene expression patterns showed TLS maturation is coupled with immunoglobulin distribution and ECM remodeling in pathologic responders.Intratumoral plasma cell and immunoglobin gene expression spatial dynamics demonstrate trafficking of TLS-driven humoral immunity in the PDAC TME.

Significance

We report a spatial multi-omics atlas of PDAC tumors from a series of immunotherapy neoadjuvant clinical trials. Intratumorally, pathologic responders exhibit mature TLS that propagate plasma cells into malignant niches. Our findings offer insights on the role of TLS-associated humoral immunity and stromal remodeling during immunotherapy treatment.

Image stitching algorithm for super-resolution localization microscopy combined with fluorescence noise prior

Super-resolution panoramic pathological imaging provides a powerful tool for biologists to observe the ultrastructure of samples. Localization data can maintain the essential ultrastructural information of biological samples with a small storage space, and also provides a new opportunity for stitching super-resolution images. However, the existing image stitching methods based on localization data cannot accurately calculate the registration offset of sample regions with no or few structural points and thus lead to registration errors. Here, we proposed a stitching framework called PNanoStitcher. The framework fully utilizes the distribution characteristics of the background fluorescence noise in the stitching region and solves the stitching failure in sample regions with no or few structural points. We verified our method using both simulated and experimental datasets, and compared it with existing stitching methods. PNanoStitcher achieved superior stitching results on biological samples with no structural and few structural regions. The study provides an important driving force for the development of super-resolution digital pathology.

HMGB2 drives tumor progression and shapes the immunosuppressive microenvironment in hepatocellular carcinoma: insights from multi-omics analysis

Background

Hepatocellular carcinoma (HCC) poses a significant health burden globally, with high mortality rates despite various treatment options. Immunotherapy, particularly immune-checkpoint inhibitors (ICIs), has shown promise, but resistance and metastasis remain major challenges. Understanding the intricacies of the tumor microenvironment (TME) is imperative for optimizing HCC management strategies and enhancing patient prognosis.

Methods

This study employed a comprehensive approach integrating multi-omics approaches, including single-cell RNA sequencing (scRNA-seq), bulk RNA sequencing (Bulk RNA-seq), and validation in clinical samples using spatial transcriptomics (ST) and multiplex immunohistochemistry (mIHC). The analysis aimed to identify key factors influencing the immunosuppressive microenvironment associated with HCC metastasis and immunotherapy resistance.

Results

HMGB2 is significantly upregulated in HCCTrans, a transitional subgroup associated with aggressive metastasis. Furthermore, HMGB2 expression positively correlates with an immunosuppressive microenvironment, particularly evident in exhausted T cells. Notably, HMGB2 expression correlated positively with immunosuppressive markers and poor prognosis in HCC patients across multiple cohorts. ST combined with mIHC validated the spatial expression patterns of HMGB2 within the TME, providing additional evidence of its role in HCC progression and immune evasion.

Conclusion

HMGB2 emerges as a critical player of HCC progression, metastasis, and immunosuppression. Its elevated expression correlates with aggressive tumor behavior and poor patient outcomes, suggesting its potential as both a therapeutic target and a prognostic indicator in HCC management.

Integration of Clinical Trial Spatial Multiomics Analysis and Virtual Clinical Trials Enables Immunotherapy Response Prediction and Biomarker Discovery

Due to the lack of treatment options, there remains a need to advance new therapeutics in hepatocellular carcinoma (HCC). The traditional approach moves from initial molecular discovery through animal models to human trials to advance novel systemic therapies that improve treatment outcomes for patients with cancer. Computational methods that simulate tumors mathematically to describe cellular and molecular interactions are emerging as promising tools to simulate the impact of therapy entirely in silico, potentially greatly accelerating delivery of new therapeutics to patients. To facilitate the design of dosing regimens and identification of potential biomarkers for immunotherapy, we developed a new computational model to track tumor progression at the organ scale while capturing the spatial heterogeneity of the tumor in HCC. This computational model of spatial quantitative systems pharmacology was designed to simulate the effects of combination immunotherapy. The model was initiated using literature-derived parameter values and fitted to the specifics of HCC. Model validation was done through comparison with spatial multiomics data from a neoadjuvant HCC clinical trial combining anti-PD1 immunotherapy and a multitargeted tyrosine kinase inhibitor cabozantinib. Validation using spatial proteomics data from imaging mass cytometry demonstrated that closer proximity between CD8 T cells and macrophages correlated with nonresponse. We also compared the model output with Visium spatial transcriptomics profiling of samples from posttreatment tumor resections in the clinical trial and from another independent study of anti-PD1 monotherapy. Spatial transcriptomics data confirmed simulation results, suggesting the importance of spatial patterns of tumor vasculature and TGFβ in tumor and immune cell interactions. Our findings demonstrate that incorporating mathematical modeling and computer simulations with high-throughput spatial multiomics data provides a novel approach for patient outcome prediction and biomarker discovery. Significance: Incorporating mathematical modeling and computer simulations with high-throughput spatial multiomics data provides an effective approach for patient outcome prediction and biomarker discovery.

Computational methods and biomarker discovery strategies for spatial proteomics: a review in immuno-oncology

Advancements in imaging technologies have revolutionized our ability to deeply profile pathological tissue architectures, generating large volumes of imaging data with unparalleled spatial resolution. This type of data collection, namely, spatial proteomics, offers invaluable insights into various human diseases. Simultaneously, computational algorithms have evolved to manage the increasing dimensionality of spatial proteomics inherent in this progress. Numerous imaging-based computational frameworks, such as computational pathology, have been proposed for research and clinical applications. However, the development of these fields demands diverse domain expertise, creating barriers to their integration and further application. This review seeks to bridge this divide by presenting a comprehensive guideline. We consolidate prevailing computational methods and outline a roadmap from image processing to data-driven, statistics-informed biomarker discovery. Additionally, we explore future perspectives as the field moves toward interfacing with other quantitative domains, holding significant promise for precision care in immuno-oncology.

STimage-1K4M: A histopathology image-gene expression dataset for spatial transcriptomics

Recent advances in multi-modal algorithms have driven and been driven by the increasing availability of large image-text datasets, leading to significant strides in various fields, including computational pathology. However, in most existing medical image-text datasets, the text typically provides high-level summaries that may not sufficiently describe sub-tile regions within a large pathology image. For example, an image might cover an extensive tissue area containing cancerous and healthy regions, but the accompanying text might only specify that this image is a cancer slide, lacking the nuanced details needed for in-depth analysis. In this study, we introduce STimage-1K4M, a novel dataset designed to bridge this gap by providing genomic features for sub-tile images. STimage-1K4M contains 1,149 images derived from spatial transcriptomics data, which captures gene expression information at the level of individual spatial spots within a pathology image. Specifically, each image in the dataset is broken down into smaller sub-image tiles, with each tile paired with 15,000 - 30,000 dimensional gene expressions. With 4,293,195 pairs of sub-tile images and gene expressions, STimage-1K4M offers unprecedented granularity, paving the way for a wide range of advanced research in multi-modal data analysis an innovative applications in computational pathology, and beyond.

Differential gene expression analysis of spatial transcriptomic experiments using spatial mixed models

Spatial transcriptomics (ST) assays represent a revolution in how the architecture of tissues is studied by allowing for the exploration of cells in their spatial context. A common element in the analysis is delineating tissue domains or "niches" followed by detecting differentially expressed genes to infer the biological identity of the tissue domains or cell types. However, many studies approach differential expression analysis by using statistical approaches often applied in the analysis of non-spatial scRNA data (e.g., two-sample t-tests, Wilcoxon's rank sum test), hence neglecting the spatial dependency observed in ST data. In this study, we show that applying linear mixed models with spatial correlation structures using spatial random effects effectively accounts for the spatial autocorrelation and reduces inflation of type-I error rate observed in non-spatial based differential expression testing. We also show that spatial linear models with an exponential correlation structure provide a better fit to the ST data as compared to non-spatial models, particularly for spatially resolved technologies that quantify expression at finer scales (i.e., single-cell resolution).

Complementing Cell Taxonomies with a Multicellular Analysis of Tissues

The application of single-cell molecular profiling coupled with spatial technologies has enabled charting of cellular heterogeneity in reference tissues and in disease. This new wave of molecular data has highlighted the expected diversity of single-cell dynamics upon shared external queues and spatial organizations. However, little is known about the relationship between single-cell heterogeneity and the emergence and maintenance of robust multicellular processes in developed tissues and its role in (patho)physiology. Here, we present emerging computational modeling strategies that use increasingly available large-scale cross-condition single-cell and spatial datasets to study multicellular organization in tissues and complement cell taxonomies. This perspective should enable us to better understand how cells within tissues collectively process information and adapt synchronized responses in disease contexts and to bridge the gap between structural changes and functions in tissues.

Leveraging multi-omics data to empower quantitative systems pharmacology in immuno-oncology

Understanding the intricate interactions of cancer cells with the tumor microenvironment (TME) is a pre-requisite for the optimization of immunotherapy. Mechanistic models such as quantitative systems pharmacology (QSP) provide insights into the TME dynamics and predict the efficacy of immunotherapy in virtual patient populations/digital twins but require vast amounts of multimodal data for parameterization. Large-scale datasets characterizing the TME are available due to recent advances in bioinformatics for multi-omics data. Here, we discuss the perspectives of leveraging omics-derived bioinformatics estimates to inform QSP models and circumvent the challenges of model calibration and validation in immuno-oncology.

Magnetic Resonance Imaging-Based Assessment of Pancreatic Fat Strongly Correlates With Histology-Based Assessment of Pancreas Composition

OBJECTIVE

The aim of the study is to assess the relationship between magnetic resonance imaging (MRI)-based estimation of pancreatic fat and histology-based measurement of pancreatic composition.

MATERIALS AND METHODS

In this retrospective study, MRI was used to noninvasively estimate pancreatic fat content in preoperative images from high-risk individuals and disease controls having normal pancreata. A deep learning algorithm was used to label 11 tissue components at micron resolution in subsequent pancreatectomy histology. A linear model was used to determine correlation between histologic tissue composition and MRI fat estimation.

RESULTS

Twenty-seven patients (mean age 64.0 ± 12.0 years [standard deviation], 15 women) were evaluated. The fat content measured by MRI ranged from 0% to 36.9%. Intrapancreatic histologic tissue fat content ranged from 0.8% to 38.3%. MRI pancreatic fat estimation positively correlated with microanatomical composition of fat (r = 0.90, 0.83 to 0.95], P < 0.001); as well as with pancreatic cancer precursor ( r = 0.65, P < 0.001); and collagen ( r = 0.46, P < 0.001) content, and negatively correlated with pancreatic acinar ( r = -0.85, P < 0.001) content.

CONCLUSIONS

Pancreatic fat content, measurable by MRI, correlates to acinar content, stromal content (fibrosis), and presence of neoplastic precursors of cancer.

Systems immunology spanning tumors, lymph nodes, and periphery

The immune system defines a complex network of tissues and cell types that orchestrate responses across the body in a dynamic manner. The local and systemic interactions between immune and cancer cells contribute to disease progression. Lymphocytes are activated in lymph nodes, traffic through the periphery, and impact cancer progression through their interactions with tumor cells. As a result, therapeutic response and resistance are mediated across tissues, and a comprehensive understanding of lymphocyte dynamics requires a systems-level approach. In this review, we highlight experimental and computational methods that can leverage the study of leukocyte trafficking through an immunomics lens and reveal how adaptive immunity shapes cancer.

Mapping the topography of spatial gene expression with interpretable deep learning

Spatially resolved transcriptomics technologies provide high-throughput measurements of gene expression in a tissue slice, but the sparsity of this data complicates the analysis of spatial gene expression patterns such as gene expression gradients. We address these issues by deriving a topographic map of a tissue slice-analogous to a map of elevation in a landscape-using a novel quantity called the isodepth. Contours of constant isodepth enclose spatial domains with distinct cell type composition, while gradients of the isodepth indicate spatial directions of maximum change in gene expression. We develop GASTON, an unsupervised and interpretable deep learning algorithm that simultaneously learns the isodepth, spatial gene expression gradients, and piecewise linear functions of the isodepth that model both continuous gradients and discontinuous spatial variation in the expression of individual genes. We validate GASTON by showing that it accurately identifies spatial domains and marker genes across several biological systems. In SRT data from the brain, GASTON reveals gradients of neuronal differentiation and firing, and in SRT data from a tumor sample, GASTON infers gradients of metabolic activity and epithelial-mesenchymal transition (EMT)-related gene expression in the tumor microenvironment.

Informing virtual clinical trials of hepatocellular carcinoma with spatial multi-omics analysis of a human neoadjuvant immunotherapy clinical trial

Human clinical trials are important tools to advance novel systemic therapies improve treatment outcomes for cancer patients. The few durable treatment options have led to a critical need to advance new therapeutics in hepatocellular carcinoma (HCC). Recent human clinical trials have shown that new combination immunotherapeutic regimens provide unprecedented clinical response in a subset of patients. Computational methods that can simulate tumors from mathematical equations describing cellular and molecular interactions are emerging as promising tools to simulate the impact of therapy entirely in silico. To facilitate designing dosing regimen and identifying potential biomarkers, we developed a new computational model to track tumor progression at organ scale while reflecting the spatial heterogeneity in the tumor at tissue scale in HCC. This computational model is called a spatial quantitative systems pharmacology (spQSP) platform and it is also designed to simulate the effects of combination immunotherapy. We then validate the results from the spQSP system by leveraging real-world spatial multi-omics data from a neoadjuvant HCC clinical trial combining anti-PD-1 immunotherapy and a multitargeted tyrosine kinase inhibitor (TKI) cabozantinib. The model output is compared with spatial data from Imaging Mass Cytometry (IMC). Both IMC data and simulation results suggest closer proximity between CD8 T cell and macrophages among non-responders while the reverse trend was observed for responders. The analyses also imply wider dispersion of immune cells and less scattered cancer cells in responders' samples. We also compared the model output with Visium spatial transcriptomics analyses of samples from post-treatment tumor resections in the original clinical trial. Both spatial transcriptomic data and simulation results identify the role of spatial patterns of tumor vasculature and TGFβ in tumor and immune cell interactions. To our knowledge, this is the first spatial tumor model for virtual clinical trials at a molecular scale that is grounded in high-throughput spatial multi-omics data from a human clinical trial.