CODA: quantitative 3D reconstruction of large tissues at cellular resolution

AI-driven 3D bioprinting for regenerative medicine: From bench to bedside

In recent decades, 3D bioprinting has garnered significant research attention due to its ability to manipulate biomaterials and cells to create complex structures precisely. However, due to technological and cost constraints, the clinical translation of 3D bioprinted products (BPPs) from bench to bedside has been hindered by challenges in terms of personalization of design and scaling up of production. Recently, the emerging applications of artificial intelligence (AI) technologies have significantly improved the performance of 3D bioprinting. However, the existing literature remains deficient in a methodological exploration of AI technologies' potential to overcome these challenges in advancing 3D bioprinting toward clinical application. This paper aims to present a systematic methodology for AI-driven 3D bioprinting, structured within the theoretical framework of Quality by Design (QbD). This paper commences by introducing the QbD theory into 3D bioprinting, followed by summarizing the technology roadmap of AI integration in 3D bioprinting, including multi-scale and multi-modal sensing, data-driven design, and in-line process control. This paper further describes specific AI applications in 3D bioprinting's key elements, including bioink formulation, model structure, printing process, and function regulation. Finally, the paper discusses current prospects and challenges associated with AI technologies to further advance the clinical translation of 3D bioprinting.

Recent advancement in the spatial immuno-oncology

Recent advancements in spatial transcriptomics and spatial proteomics enabled the high-throughput profiling of single or multi-cell types and cell states with spatial information. They transformed our understanding of the higher-order architectures and paired cell-cell interactions within a tumor microenvironment (TME). Within less than a decade, this rapidly emerging field has discovered much crucial fundamental knowledge and significantly improved clinical diagnosis in the field of immuno-oncology. This review summarizes the conceptual frameworks to understand spatial omics data and highlights the updated knowledge of spatial immuno-oncology.

Probing the physical hallmarks of cancer

The physical microenvironment plays a crucial role in tumor development, progression, metastasis and treatment. Recently, we proposed four physical hallmarks of cancer, with distinct origins and consequences, to characterize abnormalities in the physical tumor microenvironment: (1) elevated compressive-tensile solid stresses, (2) elevated interstitial fluid pressure and the resulting interstitial fluid flow, (3) altered material properties (for example, increased tissue stiffness) and (4) altered physical micro-architecture. As this emerging field of physical oncology is being advanced by tumor biologists, cell and developmental biologists, engineers, physicists and oncologists, there is a critical need for model systems and measurement tools to mechanistically probe these physical hallmarks. Here, after briefly defining these physical hallmarks, we discuss the tools and model systems available for probing each hallmark in vitro, ex vivo, in vivo and in clinical settings. We finally review the unmet needs for mechanistic probing of the physical hallmarks of tumors and discuss the challenges and unanswered questions associated with each hallmark.

Applications of Nanotechnology for Spatial Omics: Biological Structures and Functions at Nanoscale Resolution

Spatial omics methods are extensions of traditional histological methods that can illuminate important biomedical mechanisms of physiology and disease by examining the distribution of biomolecules, including nucleic acids, proteins, lipids, and metabolites, at microscale resolution within tissues or individual cells. Since, for some applications, the desired resolution for spatial omics approaches the nanometer scale, classical tools have inherent limitations when applied to spatial omics analyses, and they can measure only a limited number of targets. Nanotechnology applications have been instrumental in overcoming these bottlenecks. When nanometer-level resolution is needed for spatial omics, super resolution microscopy or detection imaging techniques, such as mass spectrometer imaging, are required to generate precise spatial images of target expression. DNA nanostructures are widely used in spatial omics for purposes such as nucleic acid detection, signal amplification, and DNA barcoding for target molecule labeling, underscoring advances in spatial omics. Other properties of nanotechnologies include advanced spatial omics methods, such as microfluidic chips and DNA barcodes. In this review, we describe how nanotechnologies have been applied to the development of spatial transcriptomics, proteomics, metabolomics, epigenomics, and multiomics approaches. We focus on how nanotechnology supports improved resolution and throughput of spatial omics, surpassing traditional techniques. We also summarize future challenges and opportunities for the application of nanotechnology to spatial omics methods.

Phenotypic analysis of complex bioengineered 3D models

With advances in underlying technologies such as complex multicellular systems, synthetic materials, and bioengineering techniques, we can now generate in vitro miniaturized human tissues that recapitulate the organotypic features of normal or diseased tissues. Importantly, these 3D culture models have increasingly provided experimental access to diverse and complex tissues architectures and their morphogenic assembly in vitro. This review presents an analytical toolbox for biological researchers using 3D modeling technologies through which they can find a collation of currently available methods to phenotypically assess their 3D models in their normal state as well as their response to therapeutic or pathological agents.

Optimization of protocols for immunohistochemical assessment of enteric nervous system in formalin fixed human tissue

Gastrointestinal (GI) motility is regulated in a large part by the cells of the enteric nervous system (ENS), suggesting that ENS dysfunctions either associate with, or drive GI dysmotility in patients. However, except for select diseases such as Hirschsprung's Disease or Achalasia that show a significant loss of all neurons or a subset of neurons, our understanding of human ENS histopathology is extremely limited. Recent endoscopic advances allow biopsying patient's full thickness gut tissues, which makes capturing ENS tissues simpler than biopsying other neuronal tissues, such as the brain. Yet, our understanding of ENS aberrations observed in GI dysmotility patients lags behind our understanding of central nervous system aberrations observed in patients with neurological disease. Paucity of optimized methods for histopathological assessment of ENS in pathological specimens represent an important bottleneck in ascertaining how the ENS is altered in diverse GI dysmotility conditions. While recent studies have interrogated ENS structure in surgically resected whole mount human gut, most pathological specimens are banked as formalin fixed paraffin embedded (FFPE) tissue blocks - suggesting that methods to interrogate ENS in FFPE tissue blocks would provide the biggest impetus for ENS histopathology in a clinical setting. In this report, we present optimized methods for immunohistochemical interrogation of the human ENS tissue on the basis of >25 important protein markers that include proteins expressed by all neurons, subset of neurons, hormones, and neurotransmitter receptors. This report provides a resource which will help pathologists and investigators assess ENS aberrations in patients with various GI dysmotility conditions.

Towards accurate and efficient diagnoses in nephropathology: An AI-based approach for assessing kidney transplant rejection

The Banff classification is useful for diagnosing renal transplant rejection. However, it has limitations due to subjectivity and varying concordance in physicians' assessments. Artificial intelligence (AI) can help standardize research, increase objectivity and accurately quantify morphological characteristics, improving reproducibility in clinical practice. This study aims to develop an AI-based solutions for diagnosing acute kidney transplant rejection by introducing automated evaluation of prognostic morphological patterns. The proposed approach aims to help accurately distinguish borderline changes from rejection. We trained a deep-learning model utilizing a fine-tuned Mask R-CNN architecture which achieved a mean Average Precision value of 0.74 for the segmentation of renal tissue structures. A strong positive nonlinear correlation was found between the measured infiltration areas and fibrosis, indicating the model's potential for assessing these parameters in kidney biopsies. The ROC analysis showed a high predictive ability for distinguishing between ci and i scores based on infiltration area and fibrosis area measurements. The AI model demonstrated high precision in predicting clinical scores which makes it a promising AI assisting tool for pathologists. The application of AI in nephropathology has a potential for advancements, including automated morphometric evaluation, 3D histological models and faster processing to enhance diagnostic accuracy and efficiency.

Powerful microscopy technologies decode spatially organized cellular networks that drive response to immunotherapy in humans

In tumors, immune cells organize into networks of different sizes and composition, including complex tertiary lymphoid structures and recently identified networks centered around the chemokines CXCL9/10/11 and CCL19. New commercially available highly multiplexed microscopy using cyclical RNA in situ hybridization and antibody-based approaches have the potential to establish the organization of the immune response in human tissue and serve as a foundation for future immunology research.

Spatial Transcriptomics of IPMN Reveals Divergent Indolent and Malignant Lineages

Purpose

Intraductal papillary mucinous neoplasms (IPMN) occur in 5-10% of the population, but only a small minority progress to pancreatic ductal adenocarcinoma (PDAC). The lack of accurate predictors of high-risk disease leads both to unnecessary operations for indolent neoplasms as well as missed diagnoses of PDAC. Digital spatial RNA profiling (DSP-RNA) provides an opportunity to define and associate transcriptomic states with cancer risk.

Experimental Design

Whole-transcriptome DSP-RNA profiling was performed on 10 IPMN specimens encompassing the spectrum of dysplastic changes from normal duct to cancer. Ductal epithelial regions within each tissue were annotated as normal duct (NL), low-grade dysplasia (LGD), high-grade dysplasia (HGD), or invasive carcinoma (INV). Gene expression count data was generated by Illumina sequencing and analyzed with R/Bioconductor.

Results

Dimension reduction analysis exposed three clusters reflecting IPMN transcriptomic states denoted "normal-like" ( cNL ), "low-risk" ( cLR ) and "high-risk" ( cHR ). In addition to specific marker genes, the three states exhibited significant enrichment for the exocrine, classical, and basal-like programs in PDAC. Specifically, exocrine function diminished in cHR , classical activation distinguished neoplasia from cNL , and basal-like genes were specifically upregulated in cHR . Intriguingly, markers of cHR were detected in NL and LGD regions from specimens with PDAC but not low-grade IPMN.

Conclusions

DSP-RNA of IPMN revealed low-risk (indolent) and high-risk (malignant) expression programs that correlated with the activity of exocrine and basal-like PDAC signatures, respectively, and distinguished pathologically low-grade from malignant specimens. These findings contextualize IPMN pathogenesis and have the potential to transform existing risk stratification models.

Statement of translational relevance

Current consensus guidelines for management of intraductal papillary mucinous neoplasms (IPMN) of the pancreas utilize clinical and radiographic criteria for risk stratification. Unfortunately, the estimated positive predictive value of these criteria for IPMN-associated pancreatic ductal adenocarcinoma (PDAC) is under 50%, indicating that over half of pancreatectomies are performed for benign disease. Moreover, nearly 15% of patients who were deemed "low risk" by the same criteria harbored PDAC. Surgical resection of IPMN has maximal benefit when performed prior to the development of PDAC, as evidence of carcinoma has been associated with a high rate of recurrence and poor overall survival. Thus, the development of molecular diagnostics that improve the accuracy of IPMN risk classification would have immediate relevance for patient care, both in terms of better selecting patients for potentially curative operations, as well as sparing patients with low-risk lesions from invasive procedures.

Ten challenges and opportunities in computational immuno-oncology

Immuno-oncology has transformed the treatment of cancer, with several immunotherapies becoming the standard treatment across histologies. Despite these advancements, the majority of patients do not experience durable clinical benefits, highlighting the imperative for ongoing advancement in immuno-oncology. Computational immuno-oncology emerges as a forefront discipline that draws on biomedical data science and intersects with oncology, immunology, and clinical research, with the overarching goal to accelerate the development of effective and safe immuno-oncology treatments from the laboratory to the clinic. In this review, we outline 10 critical challenges and opportunities in computational immuno-oncology, emphasizing the importance of robust computational strategies and interdisciplinary collaborations amid the constantly evolving interplay between clinical needs and technological innovation.

Skin keratinocyte-derived SIRT1 and BDNF modulate mechanical allodynia in mouse models of diabetic neuropathy

Diabetic neuropathy is a debilitating disorder characterized by spontaneous and mechanical allodynia. The role of skin mechanoreceptors in the development of mechanical allodynia is unclear. We discovered that mice with diabetic neuropathy had decreased sirtuin 1 (SIRT1) deacetylase activity in foot skin, leading to reduced expression of brain-derived neurotrophic factor (BDNF) and subsequent loss of innervation in Meissner corpuscles, a mechanoreceptor expressing the BDNF receptor TrkB. When SIRT1 was depleted from skin, the mechanical allodynia worsened in diabetic neuropathy mice, likely due to retrograde degeneration of the Meissner-corpuscle innervating Aβ axons and aberrant formation of Meissner corpuscles which may have increased the mechanosensitivity. The same phenomenon was also noted in skin-keratinocyte specific BDNF knockout mice. Furthermore, overexpression of SIRT1 in skin induced Meissner corpuscle reinnervation and regeneration, resulting in significant improvement of diabetic mechanical allodynia. Overall, the findings suggested that skin-derived SIRT1 and BDNF function in the same pathway in skin sensory apparatus regeneration and highlighted the potential of developing topical SIRT1-activating compounds as a novel treatment for diabetic mechanical allodynia.

Defining and modeling dynamic spatial heterogeneity within tumor microenvironments

Many solid tumors exhibit significant genetic, cellular, and biophysical heterogeneity which dynamically evolves during disease progression and after treatment. This constant flux in cell composition, phenotype, spatial relationships, and tissue properties poses significant challenges in accurately diagnosing and treating patients. Much of the complexity lies in unraveling the molecular changes in different tumor compartments, how they influence one another in space and time and where vulnerabilities exist that might be appropriate to target therapeutically. Recent advances in spatial profiling tools and technologies are enabling new insight into the underlying biology of complex tumors, creating a greater understanding of the intricate relationship between cell types, states, and the microenvironment. Here we reflect on some recent discoveries in this area, where the key knowledge and technology gaps lie, and the advancements in spatial measurements and in vitro models for the study of spatial intratumoral heterogeneity.

Combined assembloid modeling and 3D whole-organ mapping captures the microanatomy and function of the human fallopian tube

The fallopian tubes play key roles in processes from pregnancy to ovarian cancer where three-dimensional (3D) cellular and extracellular interactions are important to their pathophysiology. Here, we develop a 3D multicompartment assembloid model of the fallopian tube that molecularly, functionally, and architecturally resembles the organ. Global label-free proteomics, innovative assays capturing physiological functions of the fallopian tube (i.e., oocyte transport), and whole-organ single-cell resolution mapping are used to validate these assembloids through a multifaceted platform with direct comparisons to fallopian tube tissue. These techniques converge at a unique combination of assembloid parameters with the highest similarity to the reference fallopian tube. This work establishes (i) an optimized model of the human fallopian tubes for in vitro studies of their pathophysiology and (ii) an iterative platform for customized 3D in vitro models of human organs that are molecularly, functionally, and microanatomically accurate by combining tunable assembloid and tissue mapping methods.

Spatial multi-omics reveal intratumoral humoral immunity niches associated with tertiary lymphoid structures in pancreatic cancer immunotherapy pathologic responders

Pancreatic adenocarcinoma (PDAC) is a rapidly progressing cancer that responds poorly to immunotherapies. Intratumoral tertiary lymphoid structures (TLS) have been associated with rare long-term PDAC survivors, but the role of TLS in PDAC and their spatial relationships within the context of the broader tumor microenvironment remain unknown. We generated a spatial multi-omics atlas encompassing 26 PDAC tumors from patients treated with combination immunotherapies. Using machine learning-enabled H&E image classification models and unsupervised gene expression matrix factorization methods for spatial transcriptomics, we characterized cellular states within TLS niches spanning across distinct morphologies and immunotherapies. Unsupervised learning generated a TLS-specific spatial gene expression signature that significantly associates with improved survival in PDAC patients. These analyses demonstrate TLS-associated intratumoral B cell maturation in pathological responders, confirmed with spatial proteomics and BCR profiling. Our study also identifies spatial features of pathologic immune responses, revealing TLS maturation colocalizing with IgG/IgA distribution and extracellular matrix remodeling.

GRAPHICAL ABSTRACT

HIGHLIGHTS

Integrated multi-modal spatial profiling of human PDAC tumors from neoadjuvant immunotherapy clinical trials reveal diverse spatial niches enriched in TLS.TLS maturity is influenced by tumor location and the cellular neighborhoods in which TLS immune cells are recruited.Unsupervised machine learning of genome-wide signatures on spatial transcriptomics data characterizes the TLS-enriched TME and associates TLS transcriptomes with survival outcomes in PDAC.Interactions of spatially variable gene expression patterns showed TLS maturation is coupled with immunoglobulin distribution and ECM remodeling in pathologic responders.Intratumoral plasma cell and immunoglobin gene expression spatial dynamics demonstrate trafficking of TLS-driven humoral immunity in the PDAC TME.

Significance

We report a spatial multi-omics atlas of PDAC tumors from a series of immunotherapy neoadjuvant clinical trials. Intratumorally, pathologic responders exhibit mature TLS that propagate plasma cells into malignant niches. Our findings offer insights on the role of TLS-associated humoral immunity and stromal remodeling during immunotherapy treatment.

Digital Volumetric Biopsy Cores Improve Gleason Grading of Prostate Cancer Using Deep Learning

Prostate cancer (PCa) was the most frequently diagnosed cancer among American men in 2023 [1]. The histological grading of biopsies is essential for diagnosis, and various deep learning-based solutions have been developed to assist with this task. Existing deep learning frameworks are typically applied to individual 2D cross-sections sliced from 3D biopsy tissue specimens. This process impedes the analysis of complex tissue structures such as glands, which can vary depending on the tissue slice examined. We propose a novel digital pathology data source called a "volumetric core," obtained via the extraction and co-alignment of serially sectioned tissue sections using a novel morphology-preserving alignment framework. We trained an attention-based multiple-instance learning (ABMIL) framework on deep features extracted from volumetric patches to automatically classify the Gleason Grade Group (GGG). To handle volumetric patches, we used a modified video transformer with a deep feature extractor pretrained using self-supervised learning. We ran our morphology preserving alignment framework to construct 10,210 volumetric cores, leaving out 30% for pretraining. The rest of the dataset was used to train ABMIL, which resulted in a 0.958 macro-average AUC, 0.671 F1 score, 0.661 precision, and 0.695 recall averaged across all five GGG significantly outperforming the 2D baselines.

Spatial landscapes of cancers: insights and opportunities

Solid tumours comprise many different cell types organized in spatially structured arrangements, with substantial intratumour and intertumour heterogeneity. Advances in spatial profiling technologies over the past decade hold promise to capture the complexity of these cellular architectures to build a holistic view of the intricate molecular mechanisms that shape the tumour ecosystem. Some of these mechanisms act at the cellular scale and are controlled by cell-autonomous programmes or communication between nearby cells, whereas other mechanisms result from coordinated efforts between large networks of cells and extracellular molecules organized into tissues and organs. In this Review we provide insights into the application of single-cell and spatial profiling tools, with a focus on spatially resolved transcriptomic tools developed to understand the cellular architecture of the tumour microenvironment and identify opportunities to use them to improve clinical management of cancers.

Spatiotemporal omics for biology and medicine

The completion of the Human Genome Project has provided a foundational blueprint for understanding human life. Nonetheless, understanding the intricate mechanisms through which our genetic blueprint is involved in disease or orchestrates development across temporal and spatial dimensions remains a profound scientific challenge. Recent breakthroughs in cellular omics technologies have paved new pathways for understanding the regulation of genomic elements and the relationship between gene expression, cellular functions, and cell fate determination. The advent of spatial omics technologies, encompassing both imaging and sequencing-based methodologies, has enabled a comprehensive understanding of biological processes from a cellular ecosystem perspective. This review offers an updated overview of how spatial omics has advanced our understanding of the translation of genetic information into cellular heterogeneity and tissue structural organization and their dynamic changes over time. It emphasizes the discovery of various biological phenomena, related to organ functionality, embryogenesis, species evolution, and the pathogenesis of diseases.

PanIN and CAF transitions in pancreatic carcinogenesis revealed with spatial data integration

This study introduces a new imaging, spatial transcriptomics (ST), and single-cell RNA-sequencing integration pipeline to characterize neoplastic cell state transitions during tumorigenesis. We applied a semi-supervised analysis pipeline to examine premalignant pancreatic intraepithelial neoplasias (PanINs) that can develop into pancreatic ductal adenocarcinoma (PDAC). Their strict diagnosis on formalin-fixed and paraffin-embedded (FFPE) samples limited the single-cell characterization of human PanINs within their microenvironment. We leverage whole transcriptome FFPE ST to enable the study of a rare cohort of matched low-grade (LG) and high-grade (HG) PanIN lesions to track progression and map cellular phenotypes relative to single-cell PDAC datasets. We demonstrate that cancer-associated fibroblasts (CAFs), including antigen-presenting CAFs, are located close to PanINs. We further observed a transition from CAF-related inflammatory signaling to cellular proliferation during PanIN progression. We validate these findings with single-cell high-dimensional imaging proteomics and transcriptomics technologies. Altogether, our semi-supervised learning framework for spatial multi-omics has broad applicability across cancer types to decipher the spatiotemporal dynamics of carcinogenesis.

3D histology reveals that immune response to pancreatic precancers is heterogeneous and depends on global pancreas structure

Pancreatic ductal adenocarcinoma (PDAC) is a highly lethal cancer for which few effective therapies exist. Immunotherapies specifically are ineffective in pancreatic cancer, in part due to its unique stromal and immune microenvironment. Pancreatic intraepithelial neoplasia, or PanIN, is the main precursor lesion to PDAC. Recently it was discovered that PanINs are remarkably abundant in the grossly normal pancreas, suggesting that the vast majority will never progress to cancer. Here, through construction of 48 samples of cm3-sized human pancreas tissue, we profiled the immune microenvironment of 1,476 PanINs in 3D and at single-cell resolution to better understand the early evolution of the pancreatic tumor microenvironment and to determine how inflammation may play a role in cancer progression. We found that bulk pancreatic inflammation strongly correlates to PanIN cell fraction. We found that the immune response around PanINs is highly heterogeneous, with distinct immune hotspots and cold spots that appear and disappear in a span of tens of microns. Immune hotspots generally mark locations of higher grade of dysplasia or locations near acinar atrophy. The immune composition at these hotspots is dominated by naïve, cytotoxic, and regulatory T cells, cancer associated fibroblasts, and tumor associated macrophages, with little similarity to the immune composition around less-inflamed PanINs. By mapping FOXP3+ cells in 3D, we found that regulatory T cells are present at higher density in larger PanIN lesions compared to smaller PanINs, suggesting that the early initiation of PanINs may not exhibit an immunosuppressive response. This analysis demonstrates that while PanINs are common in the pancreases of most individuals, inflammation may play a pivotal role, both at the bulk and the microscopic scale, in demarcating regions of significance in cancer progression.

Emerging and extensive clonal evolution in the pancreas

Pancreatic cancer is one of the most lethal malignancies, yet much remains to be learned regarding how its precursors develop. In a recent Nature publication, Braxton and Kiemen et al. found that the normal, adult pancreas harbors hundreds to thousands of pancreatic cancer precursors evolving by a variety of routes.

Power-law growth models explain incidences and sizes of pancreatic cancer precursor lesions and confirm spatial genomic findings

Pancreatic ductal adenocarcinoma is a rare but lethal cancer. Recent evidence suggests that pancreatic intraepithelial neoplasia (PanIN), a microscopic precursor lesion that gives rise to pancreatic cancer, is larger and more prevalent than previously believed. Better understanding of the growth-law dynamics of PanINs may improve our ability to understand how a miniscule fraction makes the transition to invasive cancer. Here, using three-dimensional tissue mapping, we analyzed >1000 PanINs and found that lesion size is distributed according to a power law. Our data suggest that in bulk, PanIN size can be predicted by general growth behavior without consideration for the heterogeneity of the pancreatic microenvironment or an individual's age, history, or lifestyle. Our models suggest that intraductal spread and fusing of lesions drive our observed size distribution. This analysis lays the groundwork for future mathematical modeling efforts integrating PanIN incidence, morphology, and molecular features to understand tumorigenesis and demonstrates the utility of combining experimental measurement with dynamic modeling in understanding tumorigenesis.

Computational methods and biomarker discovery strategies for spatial proteomics: a review in immuno-oncology

Advancements in imaging technologies have revolutionized our ability to deeply profile pathological tissue architectures, generating large volumes of imaging data with unparalleled spatial resolution. This type of data collection, namely, spatial proteomics, offers invaluable insights into various human diseases. Simultaneously, computational algorithms have evolved to manage the increasing dimensionality of spatial proteomics inherent in this progress. Numerous imaging-based computational frameworks, such as computational pathology, have been proposed for research and clinical applications. However, the development of these fields demands diverse domain expertise, creating barriers to their integration and further application. This review seeks to bridge this divide by presenting a comprehensive guideline. We consolidate prevailing computational methods and outline a roadmap from image processing to data-driven, statistics-informed biomarker discovery. Additionally, we explore future perspectives as the field moves toward interfacing with other quantitative domains, holding significant promise for precision care in immuno-oncology.

Coexisting mechanisms of luminogenesis in pancreatic cancer-derived organoids

Lumens are crucial features of the tissue architecture in both the healthy exocrine pancreas, where ducts shuttle enzymes from the acini to the intestine, and in the precancerous lesions of the highly lethal pancreatic ductal adenocarcinoma (PDAC), similarly displaying lumens that can further develop into cyst-like structures. Branched pancreatic-cancer derived organoids capture key architectural features of both the healthy and diseased pancreas, including lumens. However, their transition from a solid mass of cells to a hollow tissue remains insufficiently explored. Here, we show that organoids display two orthogonal but complementary lumen formation mechanisms: one relying on fluid intake for multiple microlumen nucleation, swelling and fusion, and the other involving the death of a central cell population, thereby hollowing out cavities. These results shed further light on the processes of luminogenesis, deepening our understanding of the early formation of PDAC precancerous lesions, including cystic neoplasia.

High-motility pro-tumorigenic monocytes drive macrophage enrichment in the tumor microenvironment

Enrichment of tumor-associated macrophages (TAMΦs) in the tumor microenvironment correlates with worse clinical outcomes in triple-negative breast cancer (TNBC) patients, prompting the development of therapies to inhibit TAMΦ infiltration. However, the lackluster efficacy of CCL2-based chemotaxis blockade in clinical trials suggests that a new understanding of monocyte/macrophage infiltration may be necessary. Here we demonstrate that random migration, and not only chemotaxis, drives macrophage tumor infiltration. We identified tumor- associated monocytes (TAMos) that display a dramatically enhanced migration capability, induced rapidly by the tumor microenvironment, that drives effective tumor infiltration, in contrast to low-motility differentiated macrophages. TAMo, not TAMΦ, promotes cancer cell proliferation through activation of the MAPK pathway. IL-6 secreted both by cancer cells and TAMo themselves enhances TAMo migration by increasing dendritic protrusion dynamics and myosin- based contractility via the JAK2/STAT3 signaling pathway. Independent from CCL2 mediated chemotaxis, IL-6 driven enhanced migration and pro-proliferative effect of TAMo were validated in a syngeneic TNBC mouse model. Depletion of IL-6 in cancer cells significantly attenuated monocyte infiltration and reversed TAMo-induced cancer cell proliferation. This work reveals the critical role random migration plays in monocyte driven TAMΦ enrichment in a tumor and pinpoints IL-6 as a potential therapeutic target in combination with CCL2 to ameliorate current strategies against TAMΦ infiltration.

Research on Artificial-Intelligence-Assisted Medicine: A Survey on Medical Artificial Intelligence

With the improvement of economic conditions and the increase in living standards, people's attention in regard to health is also continuously increasing. They are beginning to place their hopes on machines, expecting artificial intelligence (AI) to provide a more humanized medical environment and personalized services, thus greatly expanding the supply and bridging the gap between resource supply and demand. With the development of IoT technology, the arrival of the 5G and 6G communication era, and the enhancement of computing capabilities in particular, the development and application of AI-assisted healthcare have been further promoted. Currently, research on and the application of artificial intelligence in the field of medical assistance are continuously deepening and expanding. AI holds immense economic value and has many potential applications in regard to medical institutions, patients, and healthcare professionals. It has the ability to enhance medical efficiency, reduce healthcare costs, improve the quality of healthcare services, and provide a more intelligent and humanized service experience for healthcare professionals and patients. This study elaborates on AI development history and development timelines in the medical field, types of AI technologies in healthcare informatics, the application of AI in the medical field, and opportunities and challenges of AI in the field of medicine. The combination of healthcare and artificial intelligence has a profound impact on human life, improving human health levels and quality of life and changing human lifestyles.

PanIN or IPMN? Redefining Lesion Size in 3 Dimensions

Pancreatic ductal adenocarcinoma (PDAC) develops from 2 known precursor lesions: a majority (∼85%) develops from pancreatic intraepithelial neoplasia (PanIN), and a minority develops from intraductal papillary mucinous neoplasms (IPMNs). Clinical classification of PanIN and IPMN relies on a combination of low-resolution, 3-dimensional (D) imaging (computed tomography, CT), and high-resolution, 2D imaging (histology). The definitions of PanIN and IPMN currently rely heavily on size. IPMNs are defined as macroscopic: generally >1.0 cm and visible in CT, and PanINs are defined as microscopic: generally <0.5 cm and not identifiable in CT. As 2D evaluation fails to take into account 3D structures, we hypothesized that this classification would fail in evaluation of high-resolution, 3D images. To characterize the size and prevalence of PanINs in 3D, 47 thick slabs of pancreas were harvested from grossly normal areas of pancreatic resections, excluding samples from individuals with a diagnosis of an IPMN. All patients but one underwent preoperative CT scans. Through construction of cellular resolution 3D maps, we identified >1400 ductal precursor lesions that met the 2D histologic size criteria of PanINs. We show that, when 3D space is considered, 25 of these lesions can be digitally sectioned to meet the 2D histologic size criterion of IPMN. Re-evaluation of the preoperative CT images of individuals found to possess these large precursor lesions showed that nearly half are visible on imaging. These findings demonstrate that the clinical classification of PanIN and IPMN fails in evaluation of high-resolution, 3D images, emphasizing the need for re-evaluation of classification guidelines that place significant weight on 2D assessment of 3D structures.

Perspective on quantitative phase imaging to improve precision cancer medicine

Significance

Quantitative phase imaging (QPI) offers a label-free approach to non-invasively characterize cellular processes by exploiting their refractive index based intrinsic contrast. QPI captures this contrast by translating refractive index associated phase shifts into intensity-based quantifiable data with nanoscale sensitivity. It holds significant potential for advancing precision cancer medicine by providing quantitative characterization of the biophysical properties of cells and tissue in their natural states.

Aim

This perspective aims to discuss the potential of QPI to increase our understanding of cancer development and its response to therapeutics. It also explores new developments in QPI methods towards advancing personalized cancer therapy and early detection.

Approach

We begin by detailing the technical advancements of QPI, examining its implementations across transmission and reflection geometries and phase retrieval methods, both interferometric and non-interferometric. The focus then shifts to QPI's applications in cancer research, including dynamic cell mass imaging for drug response assessment, cancer risk stratification, and in-vivo tissue imaging.

Results

QPI has emerged as a crucial tool in precision cancer medicine, offering insights into tumor biology and treatment efficacy. Its sensitivity to detecting nanoscale changes holds promise for enhancing cancer diagnostics, risk assessment, and prognostication. The future of QPI is envisioned in its integration with artificial intelligence, morpho-dynamics, and spatial biology, broadening its impact in cancer research.

Conclusions

QPI presents significant potential in advancing precision cancer medicine and redefining our approach to cancer diagnosis, monitoring, and treatment. Future directions include harnessing high-throughput dynamic imaging, 3D QPI for realistic tumor models, and combining artificial intelligence with multi-omics data to extend QPI's capabilities. As a result, QPI stands at the forefront of cancer research and clinical application in cancer care.

Analysis of 3D pathology samples using weakly supervised AI

Human tissue, which is inherently three-dimensional (3D), is traditionally examined through standard-of-care histopathology as limited two-dimensional (2D) cross-sections that can insufficiently represent the tissue due to sampling bias. To holistically characterize histomorphology, 3D imaging modalities have been developed, but clinical translation is hampered by complex manual evaluation and lack of computational platforms to distill clinical insights from large, high-resolution datasets. We present TriPath, a deep-learning platform for processing tissue volumes and efficiently predicting clinical outcomes based on 3D morphological features. Recurrence risk-stratification models were trained on prostate cancer specimens imaged with open-top light-sheet microscopy or microcomputed tomography. By comprehensively capturing 3D morphologies, 3D volume-based prognostication achieves superior performance to traditional 2D slice-based approaches, including clinical/histopathological baselines from six certified genitourinary pathologists. Incorporating greater tissue volume improves prognostic performance and mitigates risk prediction variability from sampling bias, further emphasizing the value of capturing larger extents of heterogeneous morphology.

3D genomic mapping reveals multifocality of human pancreatic precancers

Pancreatic intraepithelial neoplasias (PanINs) are the most common precursors of pancreatic cancer, but their small size and inaccessibility in humans make them challenging to study1. Critically, the number, dimensions and connectivity of human PanINs remain largely unknown, precluding important insights into early cancer development. Here, we provide a microanatomical survey of human PanINs by analysing 46 large samples of grossly normal human pancreas with a machine-learning pipeline for quantitative 3D histological reconstruction at single-cell resolution. To elucidate genetic relationships between and within PanINs, we developed a workflow in which 3D modelling guides multi-region microdissection and targeted and whole-exome sequencing. From these samples, we calculated a mean burden of 13 PanINs per cm3 and extrapolated that the normal intact adult pancreas harbours hundreds of PanINs, almost all with oncogenic KRAS hotspot mutations. We found that most PanINs originate as independent clones with distinct somatic mutation profiles. Some spatially continuous PanINs were found to contain multiple KRAS mutations; computational and in situ analyses demonstrated that different KRAS mutations localize to distinct cell subpopulations within these neoplasms, indicating their polyclonal origins. The extensive multifocality and genetic heterogeneity of PanINs raises important questions about mechanisms that drive precancer initiation and confer differential progression risk in the human pancreas. This detailed 3D genomic mapping of molecular alterations in human PanINs provides an empirical foundation for early detection and rational interception of pancreatic cancer.

Tissue and cellular spatiotemporal dynamics in colon aging

Tissue structure and molecular circuitry in the colon can be profoundly impacted by systemic age-related effects, but many of the underlying molecular cues remain unclear. Here, we built a cellular and spatial atlas of the colon across three anatomical regions and 11 age groups, encompassing ~1,500 mouse gut tissues profiled by spatial transcriptomics and ~400,000 single nucleus RNA-seq profiles. We developed a new computational framework, cSplotch, which learns a hierarchical Bayesian model of spatially resolved cellular expression associated with age, tissue region, and sex, by leveraging histological features to share information across tissue samples and data modalities. Using this model, we identified cellular and molecular gradients along the adult colonic tract and across the main crypt axis, and multicellular programs associated with aging in the large intestine. Our multi-modal framework for the investigation of cell and tissue organization can aid in the understanding of cellular roles in tissue-level pathology.

The 3D Revolution in Cancer Discovery

SUMMARY

The transition from 2D to 3D spatial profiling marks a revolutionary era in cancer research, offering unprecedented potential to enhance cancer diagnosis and treatment. This commentary outlines the experimental and computational advancements and challenges in 3D spatial molecular profiling, underscoring the innovation needed in imaging tools, software, artificial intelligence, and machine learning to overcome implementation hurdles and harness the full potential of 3D analysis in the field.

Three-dimensional reconstruction of fetal rhesus macaque kidneys at single-cell resolution reveals complex inter-relation of structures

Kidneys are among the most structurally complex organs in the body. Their architecture is critical to ensure proper function and is often impacted by diseases such as diabetes and hypertension. Understanding the spatial interplay between the different structures of the nephron and renal vasculature is crucial. Recent efforts have demonstrated the value of three-dimensional (3D) imaging in revealing new insights into the various components of the kidney; however, these studies used antibodies or autofluorescence to detect structures and so were limited in their ability to compare the many subtle structures of the kidney at once. Here, through 3D reconstruction of fetal rhesus macaque kidneys at cellular resolution, we demonstrate the power of deep learning in exhaustively labelling seventeen microstructures of the kidney. Using these tissue maps, we interrogate the spatial distribution and spatial correlation of the glomeruli, renal arteries, and the nephron. This work demonstrates the power of deep learning applied to 3D tissue images to improve our ability to compare many microanatomical structures at once, paving the way for further works investigating renal pathologies.

Spatial landmark detection and tissue registration with deep learning

Spatial landmarks are crucial in describing histological features between samples or sites, tracking regions of interest in microscopy, and registering tissue samples within a common coordinate framework. Although other studies have explored unsupervised landmark detection, existing methods are not well-suited for histological image data as they often require a large number of images to converge, are unable to handle nonlinear deformations between tissue sections and are ineffective for z-stack alignment, other modalities beyond image data or multimodal data. We address these challenges by introducing effortless landmark detection, a new unsupervised landmark detection and registration method using neural-network-guided thin-plate splines. Our proposed method is evaluated on a diverse range of datasets including histology and spatially resolved transcriptomics, demonstrating superior performance in both accuracy and stability compared to existing approaches.

Blueprints from plane to space: outlook of next-generation three-dimensional histopathology

Here, we summarize the literature relevant to recent advances in three-dimensional (3D) histopathology in relation to clinical oncology, highlighting serial sectioning, tissue clearing, light-sheet microscopy, and digital image analysis with artificial intelligence. We look forward to a future where 3D histopathology expands our understanding of human pathophysiology and improves patient care through cross-disciplinary collaboration and innovation.

Embracing cancer complexity: Hallmarks of systemic disease

The last 50 years have witnessed extraordinary developments in understanding mechanisms of carcinogenesis, synthesized as the hallmarks of cancer. Despite this logical framework, our understanding of the molecular basis of systemic manifestations and the underlying causes of cancer-related death remains incomplete. Looking forward, elucidating how tumors interact with distant organs and how multifaceted environmental and physiological parameters impinge on tumors and their hosts will be crucial for advances in preventing and more effectively treating human cancers. In this perspective, we discuss complexities of cancer as a systemic disease, including tumor initiation and promotion, tumor micro- and immune macro-environments, aging, metabolism and obesity, cancer cachexia, circadian rhythms, nervous system interactions, tumor-related thrombosis, and the microbiome. Model systems incorporating human genetic variation will be essential to decipher the mechanistic basis of these phenomena and unravel gene-environment interactions, providing a modern synthesis of molecular oncology that is primed to prevent cancers and improve patient quality of life and cancer outcomes.

Generative interpolation and restoration of images using deep learning for improved 3D tissue mapping

The development of novel imaging platforms has improved our ability to collect and analyze large three-dimensional (3D) biological imaging datasets. Advances in computing have led to an ability to extract complex spatial information from these data, such as the composition, morphology, and interactions of multi-cellular structures, rare events, and integration of multi-modal features combining anatomical, molecular, and transcriptomic (among other) information. Yet, the accuracy of these quantitative results is intrinsically limited by the quality of the input images, which can contain missing or damaged regions, or can be of poor resolution due to mechanical, temporal, or financial constraints. In applications ranging from intact imaging (e.g. light-sheet microscopy and magnetic resonance imaging) to sectioning based platforms (e.g. serial histology and serial section transmission electron microscopy), the quality and resolution of imaging data has become paramount. Here, we address these challenges by leveraging frame interpolation for large image motion (FILM), a generative AI model originally developed for temporal interpolation, for spatial interpolation of a range of 3D image types. Comparative analysis demonstrates the superiority of FILM over traditional linear interpolation to produce functional synthetic images, due to its ability to better preserve biological information including microanatomical features and cell counts, as well as image quality, such as contrast, variance, and luminance. FILM repairs tissue damages in images and reduces stitching artifacts. We show that FILM can decrease imaging time by synthesizing skipped images. We demonstrate the versatility of our method with a wide range of imaging modalities (histology, tissue-clearing/light-sheet microscopy, magnetic resonance imaging, serial section transmission electron microscopy), species (human, mouse), healthy and diseased tissues (pancreas, lung, brain), staining techniques (IHC, H&E), and pixel resolutions (8 nm, 2 μm, 1mm). Overall, we demonstrate the potential of generative AI in improving the resolution, throughput, and quality of biological image datasets, enabling improved 3D imaging.

Mapping cell-to-tissue graphs across human placenta histology whole slide images using deep learning with HAPPY

Accurate placenta pathology assessment is essential for managing maternal and newborn health, but the placenta's heterogeneity and temporal variability pose challenges for histology analysis. To address this issue, we developed the 'Histology Analysis Pipeline.PY' (HAPPY), a deep learning hierarchical method for quantifying the variability of cells and micro-anatomical tissue structures across placenta histology whole slide images. HAPPY differs from patch-based features or segmentation approaches by following an interpretable biological hierarchy, representing cells and cellular communities within tissues at a single-cell resolution across whole slide images. We present a set of quantitative metrics from healthy term placentas as a baseline for future assessments of placenta health and we show how these metrics deviate in placentas with clinically significant placental infarction. HAPPY's cell and tissue predictions closely replicate those from independent clinical experts and placental biology literature.

Three-dimensional assessments are necessary to determine the true, spatially-resolved composition of tissues

Methods for spatially resolved cellular profiling using thinly cut sections have enabled in-depth quantitative tissue mapping to study inter-sample and intra-sample differences in normal human anatomy and disease onset and progression. These methods often profile extremely limited regions, which may impact the evaluation of heterogeneity due to tissue sub-sampling. Here, we applied CODA, a deep learning-based tissue mapping platform, to reconstruct the three-dimensional (3D) microanatomy of grossly normal and cancer-containing human pancreas biospecimens obtained from individuals who underwent pancreatic resection. To compare inter- and intra-sample heterogeneity, we assessed bulk and spatially resolved tissue composition in a cohort of two-dimensional (2D) whole slide images (WSIs) and a cohort of thick slabs of pancreas tissue that were digitally reconstructed in 3D from serial sections. To demonstrate the marked under sampling of 2D assessments, we simulated the number of WSIs and tissue microarrays (TMAs) necessary to represent the compositional heterogeneity of 3D data within 10% error to reveal that tens of WSIs and hundreds of TMA cores are sometimes needed. We show that spatial correlation of different pancreatic structures decay significantly within a span of microns, demonstrating that 2D histological sections may not be representative of their neighboring tissues. In sum, we demonstrate that 3D assessments are necessary to accurately assess tissue composition in normal and abnormal specimens and in order to accurately determine neoplastic content. These results emphasize the importance of intra-sample heterogeneity in tissue mapping efforts.

Three-dimensional model of normal human dermal tissue using serial tissue sections

Background: This study aims to construct a three-dimensional model of skin dermis utilizing continuous tissue sections, with the primary objective of obtaining anatomical structure data for normal human dermal tissues. Methods: Normal skin tissue specimens were acquired, paraffin-embedded, and subjected to HE staining. Panoramic images of skin sections were captured using a microscope. Tissue section images were aligned using the SIFT and StackReg image alignment methods, with analysis conducted using the OpenCV module. Mimics17 software facilitated the reconstruction of the skin dermal 3D model, enabling the calculation of dermal porosity and the void diameter. Results: Panoramic skin slices exhibited high-resolution differentiation of dermal fibers and cellular structures. Both SIFT and StackReg image alignment methods yielded similar results, although the SIFT method demonstrated greater robustness. Successful reconstruction of the three-dimensional dermal structure was achieved. Quantitative analysis revealed a dermal porosity of 18.96 ± 4.41% and an average pore diameter of 219.29 ± 34.27 μm. Interestingly, the porosity of the dermis exhibited a gradual increase from the papillary layer to the fourth layer, followed by a transient decrease and then a gradual increase. The distribution of the mean pore diameter mirrored the pattern observed in porosity distribution. Conclusion: Utilizing the continuous skin tissue slice reconstruction technique, this study successfully reconstructed a high-precision three-dimensional tissue structure of the skin. The quantitative analysis of dermal tissue porosity and average pore diameter provides a standardized dataset for the development of biomimetic tissue-engineered skin.

A disrupted compartment boundary underlies abnormal cardiac patterning and congenital heart defects

Failure of septation of the interventricular septum (IVS) is the most common congenital heart defect (CHD), but mechanisms for patterning the IVS are largely unknown. We show that a Tbx5+/Mef2cAHF+ progenitor lineage forms a compartment boundary bisecting the IVS. This coordinated population originates at a first- and second heart field interface, subsequently forming a morphogenetic nexus. Ablation of Tbx5+/Mef2cAHF+ progenitors cause IVS disorganization, right ventricular hypoplasia and mixing of IVS lineages. Reduced dosage of the CHD transcription factor TBX5 disrupts boundary position and integrity, resulting in ventricular septation defects (VSDs) and patterning defects, including Slit2 and Ntn1 misexpression. Reducing NTN1 dosage partly rescues cardiac defects in Tbx5 mutant embryos. Loss of Slit2 or Ntn1 causes VSDs and perturbed septal lineage distributions. Thus, we identify essential cues that direct progenitors to pattern a compartment boundary for proper cardiac septation, revealing new mechanisms for cardiac birth defects.

Magnetic Resonance Imaging-Based Assessment of Pancreatic Fat Strongly Correlates With Histology-Based Assessment of Pancreas Composition

OBJECTIVE

The aim of the study is to assess the relationship between magnetic resonance imaging (MRI)-based estimation of pancreatic fat and histology-based measurement of pancreatic composition.

MATERIALS AND METHODS

In this retrospective study, MRI was used to noninvasively estimate pancreatic fat content in preoperative images from high-risk individuals and disease controls having normal pancreata. A deep learning algorithm was used to label 11 tissue components at micron resolution in subsequent pancreatectomy histology. A linear model was used to determine correlation between histologic tissue composition and MRI fat estimation.

RESULTS

Twenty-seven patients (mean age 64.0 ± 12.0 years [standard deviation], 15 women) were evaluated. The fat content measured by MRI ranged from 0% to 36.9%. Intrapancreatic histologic tissue fat content ranged from 0.8% to 38.3%. MRI pancreatic fat estimation positively correlated with microanatomical composition of fat (r = 0.90, 0.83 to 0.95], P < 0.001); as well as with pancreatic cancer precursor ( r = 0.65, P < 0.001); and collagen ( r = 0.46, P < 0.001) content, and negatively correlated with pancreatic acinar ( r = -0.85, P < 0.001) content.

CONCLUSIONS

Pancreatic fat content, measurable by MRI, correlates to acinar content, stromal content (fibrosis), and presence of neoplastic precursors of cancer.

A Weakly Supervised Segmentation Network Embedding Cross-Scale Attention Guidance and Noise-Sensitive Constraint for Detecting Tertiary Lymphoid Structures of Pancreatic Tumors

The presence of tertiary lymphoid structures (TLSs) on pancreatic pathological images is an important prognostic indicator of pancreatic tumors. Therefore, TLSs detection on pancreatic pathological images plays a crucial role in diagnosis and treatment for patients with pancreatic tumors. However, fully supervised detection algorithms based on deep learning usually require a large number of manual annotations, which is time-consuming and labor-intensive. In this paper, we aim to detect the TLSs in a manner of few-shot learning by proposing a weakly supervised segmentation network. We firstly obtain the lymphocyte density maps by combining a pretrained model for nuclei segmentation and a domain adversarial network for lymphocyte nuclei recognition. Then, we establish a cross-scale attention guidance mechanism by jointly learning the coarse-scale features from the original histopathology images and fine-scale features from our designed lymphocyte density attention. A noise-sensitive constraint is introduced by an embedding signed distance function loss in the training procedure to reduce tiny prediction errors. Experimental results on two collected datasets demonstrate that our proposed method significantly outperforms the state-of-the-art segmentation-based algorithms in terms of TLSs detection accuracy. Additionally, we apply our method to study the congruent relationship between the density of TLSs and peripancreatic vascular invasion and obtain some clinically statistical results.

Deep learning-based automated pipeline for blood vessel detection and distribution analysis in multiplexed prostate cancer images

Introduction: Prostate cancer is a highly heterogeneous disease, presenting varying levels of aggressiveness and response to treatment. Angiogenesis is one of the hallmarks of cancer, providing oxygen and nutrient supply to tumors. Micro vessel density has previously been correlated with higher Gleason score and poor prognosis. Manual segmentation of blood vessels (BVs) In microscopy images is challenging, time consuming and may be prone to inter-rater variabilities. In this study, an automated pipeline is presented for BV detection and distribution analysis in multiplexed prostate cancer images. Methods: A deep learning model was trained to segment BVs by combining CD31, CD34 and collagen IV images. In addition, the trained model was used to analyze the size and distribution patterns of BVs in relation to disease progression in a cohort of prostate cancer patients (N = 215). Results: The model was capable of accurately detecting and segmenting BVs, as compared to ground truth annotations provided by two reviewers. The precision (P), recall (R) and dice similarity coefficient (DSC) were equal to 0.93 (SD 0.04), 0.97 (SD 0.02) and 0.71 (SD 0.07) with respect to reviewer 1, and 0.95 (SD 0.05), 0.94 (SD 0.07) and 0.70 (SD 0.08) with respect to reviewer 2, respectively. BV count was significantly associated with 5-year recurrence (adjusted p = 0.0042), while both count and area of blood vessel were significantly associated with Gleason grade (adjusted p = 0.032 and 0.003 respectively). Discussion: The proposed methodology is anticipated to streamline and standardize BV analysis, offering additional insights into the biology of prostate cancer, with broad applicability to other cancers.

Exploring chronic and transient tumor hypoxia for predicting the efficacy of hypoxia-activated pro-drugs

Hypoxia, a low level of oxygen in the tissue, arises due to an imbalance between the vascular oxygen supply and oxygen demand by the surrounding cells. Typically, hypoxia is viewed as a negative marker of patients' survival, because of its implication in the development of aggressive tumors and tumor resistance. Several drugs that specifically target the hypoxic cells have been developed, providing an opportunity for exploiting hypoxia to improve cancer treatment. Here, we consider combinations of hypoxia-activated pro-drugs (HAPs) and two compounds that transiently increase intratumoral hypoxia: a vasodilator and a metabolic sensitizer. To effectively design treatment protocols with multiple compounds we used mathematical micro-pharmacology modeling and determined treatment schedules that take advantage of heterogeneous and dynamically changing oxygenation in tumor tissue. Our model was based on data from murine pancreatic cancers treated with evofosfamide (as a HAP) and either hydralazine (as a vasodilator), or pyruvate (as a metabolic sensitizer). Subsequently, this model was used to identify optimal schedules for different treatment combinations. Our simulations showed that schedules of HAPs with the vasodilator had a bimodal distribution, while HAPs with the sensitizer showed an elongated plateau. All schedules were more successful than HAP monotherapy. The three-compound combination had three local optima, depending on the HAPs clearance from the tissue interstitium, each two-fold more effective than baseline HAP treatment. Our study indicates that the three-compound therapy administered in the defined order will improve cancer response and that designing complex schedules could benefit from the use of mathematical modeling.

Intraoperative margin assessment for basal cell carcinoma with deep learning and histologic tumor mapping to surgical site

Successful treatment of solid cancers relies on complete surgical excision of the tumor either for definitive treatment or before adjuvant therapy. Intraoperative and postoperative radial sectioning, the most common form of margin assessment, can lead to incomplete excision and increase the risk of recurrence and repeat procedures. Mohs Micrographic Surgery is associated with complete removal of basal cell and squamous cell carcinoma through real-time margin assessment of 100% of the peripheral and deep margins. Real-time assessment in many tumor types is constrained by tissue size, complexity, and specimen processing / assessment time during general anesthesia. We developed an artificial intelligence platform to reduce the tissue preprocessing and histological assessment time through automated grossing recommendations, mapping and orientation of tumor to the surgical specimen. Using basal cell carcinoma as a model system, results demonstrate that this approach can address surgical laboratory efficiency bottlenecks for rapid and complete intraoperative margin assessment.

Engineering the future of 3D pathology

In recent years, technological advances in tissue preparation, high-throughput volumetric microscopy, and computational infrastructure have enabled rapid developments in nondestructive 3D pathology, in which high-resolution histologic datasets are obtained from thick tissue specimens, such as whole biopsies, without the need for physical sectioning onto glass slides. While 3D pathology generates massive datasets that are attractive for automated computational analysis, there is also a desire to use 3D pathology to improve the visual assessment of tissue histology. In this perspective, we discuss and provide examples of potential advantages of 3D pathology for the visual assessment of clinical specimens and the challenges of dealing with large 3D datasets (of individual or multiple specimens) that pathologists have not been trained to interpret. We discuss the need for artificial intelligence triaging algorithms and explainable analysis methods to assist pathologists or other domain experts in the interpretation of these novel, often complex, large datasets.

STalign: Alignment of spatial transcriptomics data using diffeomorphic metric mapping

Spatial transcriptomics (ST) technologies enable high throughput gene expression characterization within thin tissue sections. However, comparing spatial observations across sections, samples, and technologies remains challenging. To address this challenge, we develop STalign to align ST datasets in a manner that accounts for partially matched tissue sections and other local non-linear distortions using diffeomorphic metric mapping. We apply STalign to align ST datasets within and across technologies as well as to align ST datasets to a 3D common coordinate framework. We show that STalign achieves high gene expression and cell-type correspondence across matched spatial locations that is significantly improved over landmark-based affine alignments. Applying STalign to align ST datasets of the mouse brain to the 3D common coordinate framework from the Allen Brain Atlas, we highlight how STalign can be used to lift over brain region annotations and enable the interrogation of compositional heterogeneity across anatomical structures. STalign is available as an open-source Python toolkit at https://github.com/JEFworks-Lab/STalign and as Supplementary Software with additional documentation and tutorials available at https://jef.works/STalign .

Power-law growth models explain incidences and sizes of pancreatic cancer precursor lesions and confirm spatial genomic findings

Pancreatic ductal adenocarcinoma is a rare but lethal cancer. Recent evidence reveals that pancreatic intraepithelial neoplasms (PanINs), the microscopic precursor lesions in the pancreatic ducts that can give rise to invasive pancreatic cancer, are significantly larger and more prevalent than previously believed. Better understanding of the growth law dynamics of PanINs may improve our ability to understand how a miniscule fraction of these lesions makes the transition to invasive cancer. Here, using artificial intelligence (AI)-based three-dimensional (3D) tissue mapping method, we measured the volumes of >1,000 PanIN and found that lesion size is distributed according to a power law with a fitted exponent of -1.7 over > 3 orders of magnitude. Our data also suggest that PanIN growth is not very sensitive to the pancreatic microenvironment or an individual's age, family history, and lifestyle, and is rather shaped by general growth behavior. We analyze several models of PanIN growth and fit the predicted size distributions to the observed data. The best fitting models suggest that both intraductal spread of PanIN lesions and fusing of multiple lesions into large, highly branched structures drive PanIN growth patterns. This work lays the groundwork for future mathematical modeling efforts integrating PanIN incidence, morphology, genomic, and transcriptomic features to understand pancreas tumorigenesis, and demonstrates the utility of combining experimental measurement of human tissues with dynamic modeling for understanding cancer tumorigenesis.

Decoding the tumor microenvironment with spatial technologies

Visualization of the cellular heterogeneity and spatial architecture of the tumor microenvironment (TME) is becoming increasingly important to understand mechanisms of disease progression and therapeutic response. This is particularly relevant in the era of cancer immunotherapy, in which the contexture of immune cell positioning within the tumor landscape has been proven to affect efficacy. Although single-cell technologies have mostly replaced conventional approaches to analyze specific cellular subsets within tumors, those that integrate a spatial dimension are now on the rise. In this Review, we assess the strengths and limitations of emerging spatial technologies with a focus on their applications in tumor immunology, as well as forthcoming opportunities for artificial intelligence (AI) and the value of integrating multiomics datasets to achieve a holistic picture of the TME.