Integrative spatial analysis of cell morphologies and transcriptional states with MUSE

Long-term mesoscale imaging of 3D intercellular dynamics across a mammalian organ

A comprehensive understanding of physio-pathological processes necessitates non-invasive intravital three-dimensional (3D) imaging over varying spatial and temporal scales. However, huge data throughput, optical heterogeneity, surface irregularity, and phototoxicity pose great challenges, leading to an inevitable trade-off between volume size, resolution, speed, sample health, and system complexity. Here, we introduce a compact real-time, ultra-large-scale, high-resolution 3D mesoscope (RUSH3D), achieving uniform resolutions of 2.6 × 2.6 × 6 μm3 across a volume of 8,000 × 6,000 × 400 μm3 at 20 Hz with low phototoxicity. Through the integration of multiple computational imaging techniques, RUSH3D facilitates a 13-fold improvement in data throughput and an orders-of-magnitude reduction in system size and cost. With these advantages, we observed premovement neural activity and cross-day visual representational drift across the mouse cortex, the formation and progression of multiple germinal centers in mouse inguinal lymph nodes, and heterogeneous immune responses following traumatic brain injury-all at single-cell resolution, opening up a horizon for intravital mesoscale study of large-scale intercellular interactions at the organ level.

Multi-modal contrastive learning of subcellular organization using DICE

The data deluge in biology calls for computational approaches that can integrate multiple datasets of different types to build a holistic view of biological processes or structures of interest. An emerging paradigm in this domain is the unsupervised learning of data embeddings that can be used for downstream clustering and classification tasks. While such approaches for integrating data of similar types are becoming common, there is scarcer work on consolidating different data modalities such as network and image information. Here, we introduce DICE (Data Integration through Contrastive Embedding), a contrastive learning model for multi-modal data integration. We apply this model to study the subcellular organization of proteins by integrating protein-protein interaction data and protein image data measured in HEK293 cells. We demonstrate the advantage of data integration over any single modality and show that our framework outperforms previous integration approaches. Availability: https://github.com/raminass/protein-contrastive Contact: raminass@gmail.com.

Targeting therapy-persistent residual disease

Disease relapse driven by acquired drug resistance limits the effectiveness of most systemic anti-cancer agents. Targeting persistent cancer cells in residual disease before relapse has emerged as a potential strategy for enhancing the efficacy and the durability of current therapies. However, barriers remain to implementing persister-directed approaches in the clinic. This Perspective discusses current preclinical and clinical complexities and outlines key steps toward the development of clinical strategies that target therapy-persistent residual disease.

STIE: Single-cell level deconvolution, convolution, and clustering in in situ capturing-based spatial transcriptomics

In in situ capturing-based spatial transcriptomics, spots of the same size and printed at fixed locations cannot precisely capture the randomly-located single cells, therefore inherently failing to profile transcriptome at the single-cell level. To this end, we present STIE, an Expectation Maximization algorithm that aligns the spatial transcriptome to its matched histology image-based nuclear morphology and recovers missing cells from ~70% gap area, thereby achieving the real single-cell level and whole-slide scale deconvolution, convolution, and clustering for both low- and high-resolution spots. STIE characterizes cell-type-specific gene expression and demonstrates outperforming concordance with true cell-type-specific transcriptomic signatures than the other spot- and subspot-level methods. Furthermore, STIE reveals the single-cell level insights, for instance, lower actual spot resolution than its reported spot size, unbiased evaluation of cell type colocalization, superior power of high-resolution spot in distinguishing nuanced cell types, and spatial cell-cell interactions at the single-cell level other than spot level.

Graph Fourier transform for spatial omics representation and analyses of complex organs

Spatial omics technologies decipher functional components of complex organs at cellular and subcellular resolutions. We introduce Spatial Graph Fourier Transform (SpaGFT) and apply graph signal processing to a wide range of spatial omics profiling platforms to generate their interpretable representations. This representation supports spatially variable gene identification and improves gene expression imputation, outperforming existing tools in analyzing human and mouse spatial transcriptomics data. SpaGFT can identify immunological regions for B cell maturation in human lymph nodes Visium data and characterize variations in secondary follicles using in-house human tonsil CODEX data. Furthermore, it can be integrated seamlessly into other machine learning frameworks, enhancing accuracy in spatial domain identification, cell type annotation, and subcellular feature inference by up to 40%. Notably, SpaGFT detects rare subcellular organelles, such as Cajal bodies and Set1/COMPASS complexes, in high-resolution spatial proteomics data. This approach provides an explainable graph representation method for exploring tissue biology and function.

METI: deep profiling of tumor ecosystems by integrating cell morphology and spatial transcriptomics

Recent advances in spatial transcriptomics (ST) techniques provide valuable insights into cellular interactions within the tumor microenvironment (TME). However, most analytical tools lack consideration of histological features and rely on matched single-cell RNA sequencing data, limiting their effectiveness in TME studies. To address this, we introduce the Morphology-Enhanced Spatial Transcriptome Analysis Integrator (METI), an end-to-end framework that maps cancer cells and TME components, stratifies cell types and states, and analyzes cell co-localization. By integrating spatial transcriptomics, cell morphology, and curated gene signatures, METI enhances our understanding of the molecular landscape and cellular interactions within the tissue. We evaluate the performance of METI on ST data generated from various tumor tissues, including gastric, lung, and bladder cancers, as well as premalignant tissues. We also conduct a quantitative comparison of METI with existing clustering and cell deconvolution tools, demonstrating METI's robust and consistent performance.

Tissue characterization at an enhanced resolution across spatial omics platforms with deep generative model

Recent advances in spatial omics have expanded the spectrum of profiled molecular categories beyond transcriptomics. However, many of these technologies are constrained by limited spatial resolution, hindering our ability to deeply characterize intricate tissue architectures. Existing computational methods primarily focus on the resolution enhancement of transcriptomics data, lacking the adaptability to address the emerging spatial omics technologies that profile various omics types. Here, we introduce soScope, a unified generative framework designed to enhance data quality and spatial resolution for molecular profiles obtained from diverse spatial technologies. soScope aggregates multimodal tissue information from omics, spatial relations and images, and jointly infers omics profiles at enhanced resolutions with omics-specific modeling through distribution priors. With comprehensive evaluations on diverse spatial omics platforms, including Visium, Xenium, spatial-CUT&Tag, and slide-DNA/RNA-seq, soScope improves performances in identifying biologically meaningful intestine and kidney architectures, revealing embryonic heart structure that cannot be resolved at the original resolution and correcting sample and technical biases arising from sequencing and sample processing. Furthermore, soScope extends to spatial multiomics technology spatial-CITE-seq and spatial ATAC-RNA-seq, leveraging cross-omics reference for simultaneous multiomics enhancement. soScope provides a versatile tool to improve the utilization of continually expanding spatial omics technologies and resources.

Mapping the Multiscale Proteomic Organization of Cellular and Disease Phenotypes

While the primary sequences of human proteins have been cataloged for over a decade, determining how these are organized into a dynamic collection of multiprotein assemblies, with structures and functions spanning biological scales, is an ongoing venture. Systematic and data-driven analyses of these higher-order structures are emerging, facilitating the discovery and understanding of cellular phenotypes. At present, knowledge of protein localization and function has been primarily derived from manual annotation and curation in resources such as the Gene Ontology, which are biased toward richly annotated genes in the literature. Here, we envision a future powered by data-driven mapping of protein assemblies. These maps can capture and decode cellular functions through the integration of protein expression, localization, and interaction data across length scales and timescales. In this review, we focus on progress toward constructing integrated cell maps that accelerate the life sciences and translational research.

Multi-omics integration for both single-cell and spatially resolved data based on dual-path graph attention auto-encoder

Single-cell multi-omics integration enables joint analysis at the single-cell level of resolution to provide more accurate understanding of complex biological systems, while spatial multi-omics integration is benefit to the exploration of cell spatial heterogeneity to facilitate more comprehensive downstream analyses. Existing methods are mainly designed for single-cell multi-omics data with little consideration of spatial information and still have room for performance improvement. A reliable multi-omics integration method designed for both single-cell and spatially resolved data is necessary and significant. We propose a multi-omics integration method based on dual-path graph attention auto-encoder (SSGATE). It can construct the neighborhood graphs based on single-cell expression profiles or spatial coordinates, enabling it to process single-cell data and utilize spatial information from spatially resolved data. It can also perform self-supervised learning for integration through the graph attention auto-encoders from two paths. SSGATE is applied to integration of transcriptomics and proteomics, including single-cell and spatially resolved data of various tissues from different sequencing technologies. SSGATE shows better performance and stronger robustness than competitive methods and facilitates downstream analysis.

Single-cell omics: experimental workflow, data analyses and applications

Cells are the fundamental units of biological systems and exhibit unique development trajectories and molecular features. Our exploration of how the genomes orchestrate the formation and maintenance of each cell, and control the cellular phenotypes of various organismsis, is both captivating and intricate. Since the inception of the first single-cell RNA technology, technologies related to single-cell sequencing have experienced rapid advancements in recent years. These technologies have expanded horizontally to include single-cell genome, epigenome, proteome, and metabolome, while vertically, they have progressed to integrate multiple omics data and incorporate additional information such as spatial scRNA-seq and CRISPR screening. Single-cell omics represent a groundbreaking advancement in the biomedical field, offering profound insights into the understanding of complex diseases, including cancers. Here, we comprehensively summarize recent advances in single-cell omics technologies, with a specific focus on the methodology section. This overview aims to guide researchers in selecting appropriate methods for single-cell sequencing and related data analysis.

Synthetic DNA barcodes identify singlets in scRNA-seq datasets and evaluate doublet algorithms

Single-cell RNA sequencing (scRNA-seq) datasets contain true single cells, or singlets, in addition to cells that coalesce during the protocol, or doublets. Identifying singlets with high fidelity in scRNA-seq is necessary to avoid false negative and false positive discoveries. Although several methodologies have been proposed, they are typically tested on highly heterogeneous datasets and lack a priori knowledge of true singlets. Here, we leveraged datasets with synthetically introduced DNA barcodes for a hitherto unexplored application: to extract ground-truth singlets. We demonstrated the feasibility of our framework, "singletCode," to evaluate existing doublet detection methods across a range of contexts. We also leveraged our ground-truth singlets to train a proof-of-concept machine learning classifier, which outperformed other doublet detection algorithms. Our integrative framework can identify ground-truth singlets and enable robust doublet detection in non-barcoded datasets.

Multi-scale brain attributes contribute to the distribution of diffuse glioma subtypes

Gliomas are primary brain tumors and are among the most malignant types. Adult-type diffuse gliomas can be classified based on their histological and molecular signatures as IDH-wildtype glioblastoma, IDH-mutant astrocytoma, and IDH-mutant and 1p/19q-codeleted oligodendroglioma. Recent studies have shown that each subtype of glioma has its own specific distribution pattern. However, the mechanisms underlying the specific distributions of glioma subtypes are not entirely clear despite partial explanations such as cell origin. To investigate the impact of multi-scale brain attributes on glioma distribution, we constructed cumulative frequency maps for diffuse glioma subtypes based on T1w structural images and evaluated the spatial correlation between tumor frequency and diverse brain attributes, including postmortem gene expression, functional connectivity metrics, cerebral perfusion, glucose metabolism, and neurotransmitter signaling. Regression models were constructed to evaluate the contribution of these factors to the anatomic distribution of different glioma subtypes. Our findings revealed that the three different subtypes of gliomas had distinct distribution patterns, showing spatial preferences toward different brain environmental attributes. Glioblastomas were especially likely to occur in regions enriched with synapse-related pathways and diverse neurotransmitter receptors. Astrocytomas and oligodendrogliomas preferentially occurred in areas enriched with genes associated with neutrophil-mediated immune responses. The functional network characteristics and neurotransmitter distribution also contributed to oligodendroglioma distribution. Our results suggest that different brain transcriptomic, neurotransmitter, and connectomic attributes are the factors that determine the specific distributions of glioma subtypes. These findings highlight the importance of bridging diverse scales of biological organization when studying neurological dysfunction.

iIMPACT: integrating image and molecular profiles for spatial transcriptomics analysis

Current clustering analysis of spatial transcriptomics data primarily relies on molecular information and fails to fully exploit the morphological features present in histology images, leading to compromised accuracy and interpretability. To overcome these limitations, we have developed a multi-stage statistical method called iIMPACT. It identifies and defines histology-based spatial domains based on AI-reconstructed histology images and spatial context of gene expression measurements, and detects domain-specific differentially expressed genes. Through multiple case studies, we demonstrate iIMPACT outperforms existing methods in accuracy and interpretability and provides insights into the cellular spatial organization and landscape of functional genes within spatial transcriptomics data.

Cell Maps for Artificial Intelligence: AI-Ready Maps of Human Cell Architecture from Disease-Relevant Cell Lines

This article describes the Cell Maps for Artificial Intelligence (CM4AI) project and its goals, methods, standards, current datasets, software tools , status, and future directions. CM4AI is the Functional Genomics Data Generation Project in the U.S. National Institute of Health's (NIH) Bridge2AI program. Its overarching mission is to produce ethical, AI-ready datasets of cell architecture, inferred from multimodal data collected for human cell lines, to enable transformative biomedical AI research.

Cross-domain information fusion for enhanced cell population delineation in single-cell spatial-omics data

Cell population delineation and identification is an essential step in single-cell and spatial-omics studies. Spatial-omics technologies can simultaneously measure information from three complementary domains related to this task: expression levels of a panel of molecular biomarkers at single-cell resolution, relative positions of cells, and images of tissue sections, but existing computational methods for performing this task on single-cell spatial-omics datasets often relinquish information from one or more domains. The additional reliance on the availability of "atlas" training or reference datasets limits cell type discovery to well-defined but limited cell population labels, thus posing major challenges for using these methods in practice. Successful integration of all three domains presents an opportunity for uncovering cell populations that are functionally stratified by their spatial contexts at cellular and tissue levels: the key motivation for employing spatial-omics technologies in the first place. In this work, we introduce Cell Spatio- and Neighborhood-informed Annotation and Patterning (CellSNAP), a self-supervised computational method that learns a representation vector for each cell in tissue samples measured by spatial-omics technologies at the single-cell or finer resolution. The learned representation vector fuses information about the corresponding cell across all three aforementioned domains. By applying CellSNAP to datasets spanning both spatial proteomic and spatial transcriptomic modalities, and across different tissue types and disease settings, we show that CellSNAP markedly enhances de novo discovery of biologically relevant cell populations at fine granularity, beyond current approaches, by fully integrating cells' molecular profiles with cellular neighborhood and tissue image information.

Integrating single-cell transcriptomics with cellular phenotypes: cell morphology, Ca2+ imaging and electrophysiology

I review recent technological advancements in coupling single-cell transcriptomics with cellular phenotypes including morphology, calcium signaling, and electrophysiology. Single-cell RNA sequencing (scRNAseq) has revolutionized cell type classifications by capturing the transcriptional diversity of cells. A new wave of methods to integrate scRNAseq and biophysical measurements is facilitating the linkage of transcriptomic data to cellular function, which provides physiological insight into cellular states. I briefly discuss critical factors of these phenotypical characterizations such as timescales, information content, and analytical tools. Dedicated sections focus on the integration with cell morphology, calcium imaging, and electrophysiology (patch-seq), emphasizing their complementary roles. I discuss their application in elucidating cellular states, refining cell type classifications, and uncovering functional differences in cell subtypes. To illustrate the practical applications and benefits of these methods, I highlight their use in tissues with excitable cell-types such as the brain, pancreatic islets, and the retina. The potential of combining functional phenotyping with spatial transcriptomics for a detailed mapping of cell phenotypes in situ is explored. Finally, I discuss open questions and future perspectives, emphasizing the need for a shift towards broader accessibility through increased throughput.

BiGATAE: a bipartite graph attention auto-encoder enhancing spatial domain identification from single-slice to multi-slices

Recent advancements in spatial transcriptomics technology have revolutionized our ability to comprehensively characterize gene expression patterns within the tissue microenvironment, enabling us to grasp their functional significance in a spatial context. One key field of research in spatial transcriptomics is the identification of spatial domains, which refers to distinct regions within the tissue where specific gene expression patterns are observed. Diverse methodologies have been proposed, each with its unique characteristics. As the availability of spatial transcriptomics data continues to expand, there is a growing need for methods that can integrate information from multiple slices to discover spatial domains. To extend the applicability of existing single-slice analysis methods to multi-slice clustering, we introduce BiGATAE (Bipartite Graph Attention Auto Encoder) that leverages gene expression information from adjacent tissue slices to enhance spatial transcriptomics data. BiGATAE comprises two steps: aligning slices to generate an adjacency matrix for different spots in consecutive slices and constructing a bipartite graph. Subsequently, it utilizes a graph attention network to integrate information across different slices. Then it can seamlessly integrate with pre-existing techniques. To evaluate the performance of BiGATAE, we conducted benchmarking analyses on three different datasets. The experimental results demonstrate that for existing single-slice clustering methods, the integration of BiGATAE significantly enhances their performance. Moreover, single-slice clustering methods integrated with BiGATAE outperform methods specifically designed for multi-slice integration. These results underscore the proficiency of BiGATAE in facilitating information transfer across multiple slices and its capacity to broaden the applicability and sustainability of pre-existing methods.

Microsnoop: A generalist tool for microscopy image representation

Accurate profiling of microscopy images from small scale to high throughput is an essential procedure in basic and applied biological research. Here, we present Microsnoop, a novel deep learning-based representation tool trained on large-scale microscopy images using masked self-supervised learning. Microsnoop can process various complex and heterogeneous images, and we classified images into three categories: single-cell, full-field, and batch-experiment images. Our benchmark study on 10 high-quality evaluation datasets, containing over 2,230,000 images, demonstrated Microsnoop's robust and state-of-the-art microscopy image representation ability, surpassing existing generalist and even several custom algorithms. Microsnoop can be integrated with other pipelines to perform tasks such as superresolution histopathology image and multimodal analysis. Furthermore, Microsnoop can be adapted to various hardware and can be easily deployed on local or cloud computing platforms. We will regularly retrain and reevaluate the model using community-contributed data to consistently improve Microsnoop.

Single-cell level deconvolution, convolution, and clustering in spatial transcriptomics by aligning spot level transcriptome to nuclear morphology

In spot-based spatial transcriptomics, spots that are of the same size and printed at the fixed location cannot precisely capture the actual randomly located single cells, therefore failing to profile the transcriptome at the single-cell level. The current studies primarily focused on enhancing the spot resolution in size via computational imputation or technical improvement, however, they largely overlooked that single-cell resolution, i.e., resolution in cellular or even smaller size, does not equal single-cell level. Using both real and simulated spatial transcriptomics data, we demonstrated that even the high-resolution spatial transcriptomics still has a large number of spots partially covering multiple cells simultaneously, revealing the intrinsic non-single-cell level of spot-based spatial transcriptomics regardless of spot size. To this end, we present STIE, an EM algorithm that aligns the spatial transcriptome to its matched histology image-based nuclear morphology and recovers missing cells from up to ~70% gap area between spots via the nuclear morphological similarity and neighborhood information, thereby achieving the real single-cell level and whole-slide scale deconvolution/convolution and clustering for both low- and high-resolution spots. On both real and simulation spatial transcriptomics data, STIE characterizes the cell-type specific gene expression variation and demonstrates the outperforming concordance with the single-cell RNAseq-derived cell type transcriptomic signatures compared to the other spot- and subspot-level methods. Furthermore, STIE enabled us to gain novel insights that failed to be revealed by the existing methods due to the lack of single-cell level, for instance, lower actual spot resolution than its reported spot size, the additional contribution of cellular morphology to cell typing beyond transcriptome, unbiased evaluation of cell type colocalization, superior power of high-resolution spot in distinguishing nuanced cell types, and spatially resolved cell-cell interactions at the single-cell level other than spot level. The STIE code is publicly available as an R package at https://github.com/zhushijia/STIE.

VistoSeg: Processing utilities for high-resolution images for spatially resolved transcriptomics data

Spatially resolved transcriptomics (SRT) is a growing field that links gene expression to anatomical context. SRT approaches that use next-generation sequencing (NGS) combine RNA sequencing with histological or fluorescent imaging to generate spatial maps of gene expression in intact tissue sections. These technologies directly couple gene expression measurements with high-resolution histological or immunofluorescent images that contain rich morphological information about the tissue under study. While broad access to NGS-based spatial transcriptomic technology is now commercially available through the Visium platform from the vendor 10× Genomics, computational tools for extracting image-derived metrics for integration with gene expression data remain limited. We developed VistoSeg as a MATLAB pipeline to process, analyze and interactively visualize the high-resolution images generated in the Visium platform. VistoSeg outputs can be easily integrated with accompanying transcriptomic data to facilitate downstream analyses in common programing languages including R and Python. VistoSeg provides user-friendly tools for integrating image-derived metrics from histological and immunofluorescent images with spatially resolved gene expression data. Integration of this data enhances the ability to understand the transcriptional landscape within tissue architecture. VistoSeg is freely available at http://research.libd.org/VistoSeg/.

Single-cell morphological and topological atlas reveals the ecosystem diversity of human breast cancer

Digital pathology allows computerized analysis of tumor ecosystem using whole slide images (WSIs). Here, we present single-cell morphological and topological profiling (sc-MTOP) to characterize tumor ecosystem by extracting the features of nuclear morphology and intercellular spatial relationship for individual cells. We construct a single-cell atlas comprising 410 million cells from 637 breast cancer WSIs and dissect the phenotypic diversity within tumor, inflammatory and stroma cells respectively. Spatially-resolved analysis identifies recurrent micro-ecological modules representing locoregional multicellular structures and reveals four breast cancer ecotypes correlating with distinct molecular features and patient prognosis. Further analysis with multiomics data uncovers clinically relevant ecosystem features. High abundance of locally-aggregated inflammatory cells indicates immune-activated tumor microenvironment and favorable immunotherapy response in triple-negative breast cancers. Morphological intratumor heterogeneity of tumor nuclei correlates with cell cycle pathway activation and CDK inhibitors responsiveness in hormone receptor-positive cases. sc-MTOP enables using WSIs to characterize tumor ecosystems at the single-cell level.

SPIRAL: integrating and aligning spatially resolved transcriptomics data across different experiments, conditions, and technologies

Properly integrating spatially resolved transcriptomics (SRT) generated from different batches into a unified gene-spatial coordinate system could enable the construction of a comprehensive spatial transcriptome atlas. Here, we propose SPIRAL, consisting of two consecutive modules: SPIRAL-integration, with graph domain adaptation-based data integration, and SPIRAL-alignment, with cluster-aware optimal transport-based coordination alignment. We verify SPIRAL with both synthetic and real SRT datasets. By encoding spatial correlations to gene expressions, SPIRAL-integration surpasses state-of-the-art methods in both batch effect removal and joint spatial domain identification. By aligning spots cluster-wise, SPIRAL-alignment achieves more accurate coordinate alignments than existing methods.

Spatial atlas of the mouse central nervous system at molecular resolution

Spatially charting molecular cell types at single-cell resolution across the 3D volume is critical for illustrating the molecular basis of brain anatomy and functions. Single-cell RNA sequencing has profiled molecular cell types in the mouse brain1,2, but cannot capture their spatial organization. Here we used an in situ sequencing method, STARmap PLUS3,4, to profile 1,022 genes in 3D at a voxel size of 194 × 194 × 345 nm3, mapping 1.09 million high-quality cells across the adult mouse brain and spinal cord. We developed computational pipelines to segment, cluster and annotate 230 molecular cell types by single-cell gene expression and 106 molecular tissue regions by spatial niche gene expression. Joint analysis of molecular cell types and molecular tissue regions enabled a systematic molecular spatial cell-type nomenclature and identification of tissue architectures that were undefined in established brain anatomy. To create a transcriptome-wide spatial atlas, we integrated STARmap PLUS measurements with a published single-cell RNA-sequencing atlas1, imputing single-cell expression profiles of 11,844 genes. Finally, we delineated viral tropisms of a brain-wide transgene delivery tool, AAV-PHP.eB5,6. Together, this annotated dataset provides a single-cell resource that integrates the molecular spatial atlas, brain anatomy and the accessibility to genetic manipulation of the mammalian central nervous system.

SiGra: single-cell spatial elucidation through an image-augmented graph transformer

Recent advances in high-throughput molecular imaging have pushed spatial transcriptomics technologies to subcellular resolution, which surpasses the limitations of both single-cell RNA-seq and array-based spatial profiling. The multichannel immunohistochemistry images in such data provide rich information on the cell types, functions, and morphologies of cellular compartments. In this work, we developed a method, single-cell spatial elucidation through image-augmented Graph transformer (SiGra), to leverage such imaging information for revealing spatial domains and enhancing substantially sparse and noisy transcriptomics data. SiGra applies hybrid graph transformers over a single-cell spatial graph. SiGra outperforms state-of-the-art methods on both single-cell and spot-level spatial transcriptomics data from complex tissues. The inclusion of immunohistochemistry images improves the model performance by 37% (95% CI: 27-50%). SiGra improves the characterization of intratumor heterogeneity and intercellular communication and recovers the known microscopic anatomy. Overall, SiGra effectively integrates different spatial modality data to gain deep insights into spatial cellular ecosystems.

Integrating multi-modal information to detect spatial domains of spatial transcriptomics by graph attention network

Recent advances in spatially resolved transcriptomic technologies have enabled unprecedented opportunities to elucidate tissue architecture and function in situ. Spatial transcriptomics can provide multimodal and complementary information simultaneously, including gene expression profiles, spatial locations, and histology images. However, most existing methods have limitations in efficiently utilizing spatial information and matched high-resolution histology images. To fully leverage the multi-modal information, we propose a SPAtially embedded Deep Attentional graph Clustering (SpaDAC) method to identify spatial domains while reconstructing denoised gene expression profiles. This method can efficiently learn the low-dimensional embeddings for spatial transcriptomics data by constructing multi-view graph modules to capture both spatial location connectives and morphological connectives. Benchmark results demonstrate that SpaDAC outperforms other algorithms on several recent spatial transcriptomics datasets. SpaDAC is a valuable tool for spatial domain detection, facilitating the comprehension of tissue architecture and cellular microenvironment. The source code of SpaDAC is freely available at Github (https://github.com/huoyuying/SpaDAC.git).

Methods and applications for single-cell and spatial multi-omics

The joint analysis of the genome, epigenome, transcriptome, proteome and/or metabolome from single cells is transforming our understanding of cell biology in health and disease. In less than a decade, the field has seen tremendous technological revolutions that enable crucial new insights into the interplay between intracellular and intercellular molecular mechanisms that govern development, physiology and pathogenesis. In this Review, we highlight advances in the fast-developing field of single-cell and spatial multi-omics technologies (also known as multimodal omics approaches), and the computational strategies needed to integrate information across these molecular layers. We demonstrate their impact on fundamental cell biology and translational research, discuss current challenges and provide an outlook to the future.

Integrative multi-omics and systems bioinformatics in translational neuroscience: A data mining perspective

Bioinformatic analysis of large and complex omics datasets has become increasingly useful in modern day biology by providing a great depth of information, with its application to neuroscience termed neuroinformatics. Data mining of omics datasets has enabled the generation of new hypotheses based on differentially regulated biological molecules associated with disease mechanisms, which can be tested experimentally for improved diagnostic and therapeutic targeting of neurodegenerative diseases. Importantly, integrating multi-omics data using a systems bioinformatics approach will advance the understanding of the layered and interactive network of biological regulation that exchanges systemic knowledge to facilitate the development of a comprehensive human brain profile. In this review, we first summarize data mining studies utilizing datasets from the individual type of omics analysis, including epigenetics/epigenomics, transcriptomics, proteomics, metabolomics, lipidomics, and spatial omics, pertaining to Alzheimer's disease, Parkinson's disease, and multiple sclerosis. We then discuss multi-omics integration approaches, including independent biological integration and unsupervised integration methods, for more intuitive and informative interpretation of the biological data obtained across different omics layers. We further assess studies that integrate multi-omics in data mining which provide convoluted biological insights and offer proof-of-concept proposition towards systems bioinformatics in the reconstruction of brain networks. Finally, we recommend a combination of high dimensional bioinformatics analysis with experimental validation to achieve translational neuroscience applications including biomarker discovery, therapeutic development, and elucidation of disease mechanisms. We conclude by providing future perspectives and opportunities in applying integrative multi-omics and systems bioinformatics to achieve precision phenotyping of neurodegenerative diseases and towards personalized medicine.

Diversity of cells and signals in the cardiovascular system

This white paper is the outcome of the seventh UC Davis Cardiovascular Research Symposium on Systems Approach to Understanding Cardiovascular Disease and Arrhythmia. This biannual meeting aims to bring together leading experts in subfields of cardiovascular biomedicine to focus on topics of importance to the field. The theme of the 2022 Symposium was 'Cell Diversity in the Cardiovascular System, cell-autonomous and cell-cell signalling'. Experts in the field contributed their experimental and mathematical modelling perspectives and discussed emerging questions, controversies, and challenges in examining cell and signal diversity, co-ordination and interrelationships involved in cardiovascular function. This paper originates from the topics of formal presentations and informal discussions from the Symposium, which aimed to develop a holistic view of how the multiple cell types in the cardiovascular system integrate to influence cardiovascular function, disease progression and therapeutic strategies. The first section describes the major cell types (e.g. cardiomyocytes, vascular smooth muscle and endothelial cells, fibroblasts, neurons, immune cells, etc.) and the signals involved in cardiovascular function. The second section emphasizes the complexity at the subcellular, cellular and system levels in the context of cardiovascular development, ageing and disease. Finally, the third section surveys the technological innovations that allow the interrogation of this diversity and advancing our understanding of the integrated cardiovascular function and dysfunction.

Emerging maps of allosteric regulation in cellular networks

Allosteric regulation is classically defined as action at a distance, where a perturbation outside of a protein active site affects function. While this definition has motivated many studies of allosteric mechanisms at the level of protein structure, translating these insights to the allosteric regulation of entire cellular processes - and their crosstalk - has received less attention, despite the broad importance of allostery for cellular regulation foreseen by Jacob and Monod. Here, we revisit an evolutionary model for the widespread emergence of allosteric regulation in colocalized proteins, describe supporting evidence, and discuss emerging advances in mapping allostery in cellular networks that link precise and often allosteric perturbations at the molecular level to functional changes at the pathway and systems levels.

Two-photon synthetic aperture microscopy for minimally invasive fast 3D imaging of native subcellular behaviors in deep tissue

Holistic understanding of physio-pathological processes requires noninvasive 3D imaging in deep tissue across multiple spatial and temporal scales to link diverse transient subcellular behaviors with long-term physiogenesis. Despite broad applications of two-photon microscopy (TPM), there remains an inevitable tradeoff among spatiotemporal resolution, imaging volumes, and durations due to the point-scanning scheme, accumulated phototoxicity, and optical aberrations. Here, we harnessed the concept of synthetic aperture radar in TPM to achieve aberration-corrected 3D imaging of subcellular dynamics at a millisecond scale for over 100,000 large volumes in deep tissue, with three orders of magnitude reduction in photobleaching. With its advantages, we identified direct intercellular communications through migrasome generation following traumatic brain injury, visualized the formation process of germinal center in the mouse lymph node, and characterized heterogeneous cellular states in the mouse visual cortex, opening up a horizon for intravital imaging to understand the organizations and functions of biological systems at a holistic level.

Explainable multi-task learning for multi-modality biological data analysis

Current biotechnologies can simultaneously measure multiple high-dimensional modalities (e.g., RNA, DNA accessibility, and protein) from the same cells. A combination of different analytical tasks (e.g., multi-modal integration and cross-modal analysis) is required to comprehensively understand such data, inferring how gene regulation drives biological diversity and functions. However, current analytical methods are designed to perform a single task, only providing a partial picture of the multi-modal data. Here, we present UnitedNet, an explainable multi-task deep neural network capable of integrating different tasks to analyze single-cell multi-modality data. Applied to various multi-modality datasets (e.g., Patch-seq, multiome ATAC + gene expression, and spatial transcriptomics), UnitedNet demonstrates similar or better accuracy in multi-modal integration and cross-modal prediction compared with state-of-the-art methods. Moreover, by dissecting the trained UnitedNet with the explainable machine learning algorithm, we can directly quantify the relationship between gene expression and other modalities with cell-type specificity. UnitedNet is a comprehensive end-to-end framework that could be broadly applicable to single-cell multi-modality biology. This framework has the potential to facilitate the discovery of cell-type-specific regulation kinetics across transcriptomics and other modalities.

Unraveling non-genetic heterogeneity in cancer with dynamical models and computational tools

Individual cells within an otherwise genetically homogenous population constantly undergo fluctuations in their molecular state, giving rise to non-genetic heterogeneity. Such diversity is being increasingly implicated in cancer therapy resistance and metastasis. Identifying the origins of non-genetic heterogeneity is therefore crucial for making clinical breakthroughs. We discuss with examples how dynamical models and computational tools have provided critical multiscale insights into the nature and consequences of non-genetic heterogeneity in cancer. We demonstrate how mechanistic modeling has been pivotal in establishing key concepts underlying non-genetic diversity at various biological scales, from population dynamics to gene regulatory networks. We discuss advances in single-cell longitudinal profiling techniques to reveal patterns of non-genetic heterogeneity, highlighting the ongoing efforts and challenges in statistical frameworks to robustly interpret such multimodal datasets. Moving forward, we stress the need for data-driven statistical and mechanistically motivated dynamical frameworks to come together to develop predictive cancer models and inform therapeutic strategies.

Application of spatial transcriptome technologies to neurological diseases

Spatial transcriptome technology acquires gene expression profiles while retaining spatial location information, it displays the gene expression properties of cells in situ. Through the investigation of cell heterogeneity, microenvironment, function, and cellular interactions, spatial transcriptome technology can deeply explore the pathogenic mechanisms of cell-type-specific responses and spatial localization in neurological diseases. The present article overviews spatial transcriptome technologies based on microdissection, in situ hybridization, in situ sequencing, in situ capture, and live cell labeling. Each technology is described along with its methods, detection throughput, spatial resolution, benefits, and drawbacks. Furthermore, their applications in neurodegenerative disease, neuropsychiatric illness, stroke and epilepsy are outlined. This information can be used to understand disease mechanisms, pick therapeutic targets, and establish biomarkers.

Spatial omics technologies at multimodal and single cell/subcellular level

Spatial omics technologies enable a deeper understanding of cellular organizations and interactions within a tissue of interest. These assays can identify specific compartments or regions in a tissue with differential transcript or protein abundance, delineate their interactions, and complement other methods in defining cellular phenotypes. A variety of spatial methodologies are being developed and commercialized; however, these techniques differ in spatial resolution, multiplexing capability, scale/throughput, and coverage. Here, we review the current and prospective landscape of single cell to subcellular resolution spatial omics technologies and analysis tools to provide a comprehensive picture for both research and clinical applications.

Graph-based autoencoder integrates spatial transcriptomics with chromatin images and identifies joint biomarkers for Alzheimer's disease

Tissue development and disease lead to changes in cellular organization, nuclear morphology, and gene expression, which can be jointly measured by spatial transcriptomic technologies. However, methods for jointly analyzing the different spatial data modalities in 3D are still lacking. We present a computational framework to integrate Spatial Transcriptomic data using over-parameterized graph-based Autoencoders with Chromatin Imaging data (STACI) to identify molecular and functional alterations in tissues. STACI incorporates multiple modalities in a single representation for downstream tasks, enables the prediction of spatial transcriptomic data from nuclear images in unseen tissue sections, and provides built-in batch correction of gene expression and tissue morphology through over-parameterization. We apply STACI to analyze the spatio-temporal progression of Alzheimer's disease and identify the associated nuclear morphometric and coupled gene expression features. Collectively, we demonstrate the importance of characterizing disease progression by integrating multiple data modalities and its potential for the discovery of disease biomarkers.

Integrative Serum Metabolic Fingerprints Based Multi-Modal Platforms for Lung Adenocarcinoma Early Detection and Pulmonary Nodule Classification

Identification of novel non-invasive biomarkers is critical for the early diagnosis of lung adenocarcinoma (LUAD), especially for the accurate classification of pulmonary nodule. Here, a multiplexed assay is developed on an optimized nanoparticle-based laser desorption/ionization mass spectrometry platform for the sensitive and selective detection of serum metabolic fingerprints (SMFs). Integrative SMFs based multi-modal platforms are constructed for the early detection of LUAD and the classification of pulmonary nodule. The dual modal model, metabolic fingerprints with protein tumor marker neural network (MP-NN), integrating SMFs with protein tumor marker carcinoembryonic antigen (CEA) via deep learning, shows superior performance compared with the single modal model Met-NN (p < 0.001). Based on MP-NN, the tri modal model MPI-RF integrating SMFs, tumor marker CEA, and image features via random forest demonstrates significantly higher performance than the clinical models (Mayo Clinic and Veterans Affairs) and the image artificial intelligence in pulmonary nodule classification (p < 0.001). The developed platforms would be promising tools for LUAD screening and pulmonary nodule management, paving the conceptual and practical foundation for the clinical application of omics tools.

Improving and evaluating deep learning models of cellular organization

MOTIVATION

Cells contain dozens of major organelles and thousands of other structures, many of which vary extensively in their number, size, shape and spatial distribution. This complexity and variation dramatically complicates the use of both traditional and deep learning methods to build accurate models of cell organization. Most cellular organelles are distinct objects with defined boundaries that do not overlap, while the pixel resolution of most imaging methods is n sufficient to resolve these boundaries. Thus while cell organization is conceptually object-based, most current methods are pixel-based. Using extensive image collections in which particular organelles were fluorescently labeled, deep learning methods can be used to build conditional autoencoder models for particular organelles. A major advance occurred with the use of a U-net approach to make multiple models all conditional upon a common reference, unlabeled image, allowing the relationships between different organelles to be at least partially inferred.

RESULTS

We have developed improved Generative Adversarial Networks-based approaches for learning these models and have also developed novel criteria for evaluating how well synthetic cell images reflect the properties of real images. The first set of criteria measure how well models preserve the expected property that organelles do not overlap. We also developed a modified loss function that allows retraining of the models to minimize that overlap. The second set of criteria uses object-based modeling to compare object shape and spatial distribution between synthetic and real images. Our work provides the first demonstration that, at least for some organelles, deep learning models can capture object-level properties of cell images.

AVAILABILITY AND IMPLEMENTATION

http://murphylab.cbd.cmu.edu/Software/2022_insilico.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Computational Approaches and Challenges in Spatial Transcriptomics

The development of spatial transcriptomics (ST) technologies has transformed genetic research from a single-cell data level to a two-dimensional spatial coordinate system and facilitated the study of the composition and function of various cell subsets in different environments and organs. The large-scale data generated by these ST technologies, which contain spatial gene expression information, have elicited the need for spatially resolved approaches to meet the requirements of computational and biological data interpretation. These requirements include dealing with the explosive growth of data to determine the cell-level and gene-level expression, correcting the inner batch effect and loss of expression to improve the data quality, conducting efficient interpretation and in-depth knowledge mining both at the single-cell and tissue-wide levels, and conducting multi-omics integration analysis to provide an extensible framework toward the in-depth understanding of biological processes. However, algorithms designed specifically for ST technologies to meet these requirements are still in their infancy. Here, we review computational approaches to these problems in light of corresponding issues and challenges, and present forward-looking insights into algorithm development.