Consistent cross-modal identification of cortical neurons with coupled autoencoders

Spatiotemporal multi-omics: exploring molecular landscapes in aging and regenerative medicine

Aging and regeneration represent complex biological phenomena that have long captivated the scientific community. To fully comprehend these processes, it is essential to investigate molecular dynamics through a lens that encompasses both spatial and temporal dimensions. Conventional omics methodologies, such as genomics and transcriptomics, have been instrumental in identifying critical molecular facets of aging and regeneration. However, these methods are somewhat limited, constrained by their spatial resolution and their lack of capacity to dynamically represent tissue alterations. The advent of emerging spatiotemporal multi-omics approaches, encompassing transcriptomics, proteomics, metabolomics, and epigenomics, furnishes comprehensive insights into these intricate molecular dynamics. These sophisticated techniques facilitate accurate delineation of molecular patterns across an array of cells, tissues, and organs, thereby offering an in-depth understanding of the fundamental mechanisms at play. This review meticulously examines the significance of spatiotemporal multi-omics in the realms of aging and regeneration research. It underscores how these methodologies augment our comprehension of molecular dynamics, cellular interactions, and signaling pathways. Initially, the review delineates the foundational principles underpinning these methods, followed by an evaluation of their recent applications within the field. The review ultimately concludes by addressing the prevailing challenges and projecting future advancements in the field. Indubitably, spatiotemporal multi-omics are instrumental in deciphering the complexities inherent in aging and regeneration, thus charting a course toward potential therapeutic innovations.

Joint inference of discrete cell types and continuous type-specific variability in single-cell datasets with MMIDAS

Reproducible definition and identification of cell types is essential to enable investigations into their biological function, and understanding their relevance in the context of development, disease and evolution. Current approaches model variability in data as continuous latent factors, followed by clustering as a separate step, or immediately apply clustering on the data. We show that such approaches can suffer from qualitative mistakes in identifying cell types robustly, particularly when the number of such cell types is in the hundreds or even thousands. Here, we propose an unsupervised method, MMIDAS, which combines a generalized mixture model with a multi-armed deep neural network, to jointly infer the discrete type and continuous type-specific variability. Using four recent datasets of brain cells spanning different technologies, species, and conditions, we demonstrate that MMIDAS can identify reproducible cell types and infer cell type-dependent continuous variability in both uni-modal and multi-modal datasets.

Platform motion estimation in multi-band synthetic aperture sonar with coupled variational autoencoders

Coherent processing in synthetic aperture sonar (SAS) requires platform motion estimation and compensation with sub-wavelength accuracy for high-resolution imaging. Micronavigation, i.e., through-the-sensor platform motion estimation, is essential when positioning information from navigational instruments is absent or inadequately accurate. A machine learning method based on variational Bayesian inference has been proposed for unsupervised data-driven micronavigation. Herein, the multiple-input multiple-output arrangement of a multi-band SAS system is exploited and combined with a hierarchical variational inference scheme, which self-supervises the learning of platform motion and results in improved micronavigation accuracy.

Connecting single-cell transcriptomes to projectomes in mouse visual cortex

The mammalian brain is composed of diverse neuron types that play different functional roles. Recent single-cell RNA sequencing approaches have led to a whole brain taxonomy of transcriptomically-defined cell types, yet cell type definitions that include multiple cellular properties can offer additional insights into a neuron's role in brain circuits. While the Patch-seq method can investigate how transcriptomic properties relate to the local morphological and electrophysiological properties of cell types, linking transcriptomic identities to long-range projections is a major unresolved challenge. To address this, we collected coordinated Patch-seq and whole brain morphology data sets of excitatory neurons in mouse visual cortex. From the Patch-seq data, we defined 16 integrated morpho-electric-transcriptomic (MET)-types; in parallel, we reconstructed the complete morphologies of 300 neurons. We unified the two data sets with a multi-step classifier, to integrate cell type assignments and interrogate cross-modality relationships. We find that transcriptomic variations within and across MET-types correspond with morphological and electrophysiological phenotypes. In addition, this variation, along with the anatomical location of the cell, can be used to predict the projection targets of individual neurons. We also shed new light on infragranular cell types and circuits, including cell-type-specific, interhemispheric projections. With this approach, we establish a comprehensive, integrated taxonomy of excitatory neuron types in mouse visual cortex and create a system for integrated, high-dimensional cell type classification that can be extended to the whole brain and potentially across species.

MANGEM: A web app for multimodal analysis of neuronal gene expression, electrophysiology, and morphology

Single-cell techniques like Patch-seq have enabled the acquisition of multimodal data from individual neuronal cells, offering systematic insights into neuronal functions. However, these data can be heterogeneous and noisy. To address this, machine learning methods have been used to align cells from different modalities onto a low-dimensional latent space, revealing multimodal cell clusters. The use of those methods can be challenging without computational expertise or suitable computing infrastructure for computationally expensive methods. To address this, we developed a cloud-based web application, MANGEM (multimodal analysis of neuronal gene expression, electrophysiology, and morphology). MANGEM provides a step-by-step accessible and user-friendly interface to machine learning alignment methods of neuronal multimodal data. It can run asynchronously for large-scale data alignment, provide users with various downstream analyses of aligned cells, and visualize the analytic results. We demonstrated the usage of MANGEM by aligning multimodal data of neuronal cells in the mouse visual cortex.

CMOT: Cross-Modality Optimal Transport for multimodal inference

Multimodal measurements of single-cell sequencing technologies facilitate a comprehensive understanding of specific cellular and molecular mechanisms. However, simultaneous profiling of multiple modalities of single cells is challenging, and data integration remains elusive due to missing modalities and cell-cell correspondences. To address this, we developed a computational approach, Cross-Modality Optimal Transport (CMOT), which aligns cells within available multi-modal data (source) onto a common latent space and infers missing modalities for cells from another modality (target) of mapped source cells. CMOT outperforms existing methods in various applications from developing brain, cancers to immunology, and provides biological interpretations improving cell-type or cancer classifications.

Explainable multi-task learning for multi-modality biological data analysis

Current biotechnologies can simultaneously measure multiple high-dimensional modalities (e.g., RNA, DNA accessibility, and protein) from the same cells. A combination of different analytical tasks (e.g., multi-modal integration and cross-modal analysis) is required to comprehensively understand such data, inferring how gene regulation drives biological diversity and functions. However, current analytical methods are designed to perform a single task, only providing a partial picture of the multi-modal data. Here, we present UnitedNet, an explainable multi-task deep neural network capable of integrating different tasks to analyze single-cell multi-modality data. Applied to various multi-modality datasets (e.g., Patch-seq, multiome ATAC + gene expression, and spatial transcriptomics), UnitedNet demonstrates similar or better accuracy in multi-modal integration and cross-modal prediction compared with state-of-the-art methods. Moreover, by dissecting the trained UnitedNet with the explainable machine learning algorithm, we can directly quantify the relationship between gene expression and other modalities with cell-type specificity. UnitedNet is a comprehensive end-to-end framework that could be broadly applicable to single-cell multi-modality biology. This framework has the potential to facilitate the discovery of cell-type-specific regulation kinetics across transcriptomics and other modalities.

Multimodal charting of molecular and functional cell states via in situ electro-sequencing

Paired mapping of single-cell gene expression and electrophysiology is essential to understand gene-to-function relationships in electrogenic tissues. Here, we developed in situ electro-sequencing (electro-seq) that combines flexible bioelectronics with in situ RNA sequencing to stably map millisecond-timescale electrical activity and profile single-cell gene expression from the same cells across intact biological networks, including cardiac and neural patches. When applied to human-induced pluripotent stem-cell-derived cardiomyocyte patches, in situ electro-seq enabled multimodal in situ analysis of cardiomyocyte electrophysiology and gene expression at the cellular level, jointly defining cell states and developmental trajectories. Using machine-learning-based cross-modal analysis, in situ electro-seq identified gene-to-electrophysiology relationships throughout cardiomyocyte development and accurately reconstructed the evolution of gene expression profiles based on long-term stable electrical measurements. In situ electro-seq could be applicable to create spatiotemporal multimodal maps in electrogenic tissues, potentiating the discovery of cell types and gene programs responsible for electrophysiological function and dysfunction.

Predictive and robust gene selection for spatial transcriptomics

A prominent trend in single-cell transcriptomics is providing spatial context alongside a characterization of each cell's molecular state. This typically requires targeting an a priori selection of genes, often covering less than 1% of the genome, and a key question is how to optimally determine the small gene panel. We address this challenge by introducing a flexible deep learning framework, PERSIST, to identify informative gene targets for spatial transcriptomics studies by leveraging reference scRNA-seq data. Using datasets spanning different brain regions, species, and scRNA-seq technologies, we show that PERSIST reliably identifies panels that provide more accurate prediction of the genome-wide expression profile, thereby capturing more information with fewer genes. PERSIST can be adapted to specific biological goals, and we demonstrate that PERSIST's binarization of gene expression levels enables models trained on scRNA-seq data to generalize with to spatial transcriptomics data, despite the complex shift between these technologies.

A Molecular Landscape of Mouse Hippocampal Neuromodulation

Adaptive neuronal circuit function requires a continual adjustment of synaptic network parameters known as “neuromodulation.” This process is now understood to be based primarily on the binding of myriad secreted “modulatory” ligands such as dopamine, serotonin and the neuropeptides to G protein-coupled receptors (GPCRs) that, in turn, regulate the function of the ion channels that establish synaptic weights and membrane excitability. Many of the basic molecular mechanisms of neuromodulation are now known, but the organization of neuromodulation at a network level is still an enigma. New single-cell RNA sequencing data and transcriptomic neurotaxonomies now offer bright new lights to shine on this critical “dark matter” of neuroscience. Here we leverage these advances to explore the cell-type-specific expression of genes encoding GPCRs, modulatory ligands, ion channels and intervening signal transduction molecules in mouse hippocampus area CA1, with the goal of revealing broad outlines of this well-studied brain structure’s neuromodulatory network architecture.

A multi-encoder variational autoencoder controls multiple transformational features in single-cell image analysis

Image-based cell phenotyping relies on quantitative measurements as encoded representations of cells; however, defining suitable representations that capture complex imaging features is challenged by the lack of robust methods to segment cells, identify subcellular compartments, and extract relevant features. Variational autoencoder (VAE) approaches produce encouraging results by mapping an image to a representative descriptor, and outperform classical hand-crafted features for morphology, intensity, and texture at differentiating data. Although VAEs show promising results for capturing morphological and organizational features in tissue, single cell image analyses based on VAEs often fail to identify biologically informative features due to uninformative technical variation. Here we propose a multi-encoder VAE (ME-VAE) in single cell image analysis using transformed images as a self-supervised signal to extract transform-invariant biologically meaningful features, including emergent features not obvious from prior knowledge. We show that the proposed architecture improves analysis by making distinct cell populations more separable compared to traditional and recent extensions of VAE architectures and intensity measurements by enhancing phenotypic differences between cells and by improving correlations to other analytic modalities. Better feature extraction and image analysis methods enabled by the ME-VAE will advance our understanding of complex cell biology and enable discoveries previously hidden behind image complexity ultimately improving medical outcomes and drug discovery.

The Multi-Encoder Variational AutoEncoder (ME-VAE) is a computational model that can control for multiple transformational features in single-cell imaging data, enabling researchers to extract meaningful single-cell information and better separate heterogeneous cell types.

Learning Cortical Parcellations Using Graph Neural Networks

Deep learning has been applied to magnetic resonance imaging (MRI) for a variety of purposes, ranging from the acceleration of image acquisition and image denoising to tissue segmentation and disease diagnosis. Convolutional neural networks have been particularly useful for analyzing MRI data due to the regularly sampled spatial and temporal nature of the data. However, advances in the field of brain imaging have led to network- and surface-based analyses that are often better represented in the graph domain. In this analysis, we propose a general purpose cortical segmentation method that, given resting-state connectivity features readily computed during conventional MRI pre-processing and a set of corresponding training labels, can generate cortical parcellations for new MRI data. We applied recent advances in the field of graph neural networks to the problem of cortical surface segmentation, using resting-state connectivity to learn discrete maps of the human neocortex. We found that graph neural networks accurately learn low-dimensional representations of functional brain connectivity that can be naturally extended to map the cortices of new datasets. After optimizing over algorithm type, network architecture, and training features, our approach yielded mean classification accuracies of 79.91% relative to a previously published parcellation. We describe how some hyperparameter choices including training and testing data duration, network architecture, and algorithm choice affect model performance.

Manifold learning analysis suggests strategies to align single-cell multimodal data of neuronal electrophysiology and transcriptomics

Recent single-cell multimodal data reveal multi-scale characteristics of single cells, such as transcriptomics, morphology, and electrophysiology. However, integrating and analyzing such multimodal data to deeper understand functional genomics and gene regulation in various cellular characteristics remains elusive. To address this, we applied and benchmarked multiple machine learning methods to align gene expression and electrophysiological data of single neuronal cells in the mouse brain from the Brain Initiative. We found that nonlinear manifold learning outperforms other methods. After manifold alignment, the cells form clusters highly corresponding to transcriptomic and morphological cell types, suggesting a strong nonlinear relationship between gene expression and electrophysiology at the cell-type level. Also, the electrophysiological features are highly predictable by gene expression on the latent space from manifold alignment. The aligned cells further show continuous changes of electrophysiological features, implying cross-cluster gene expression transitions. Functional enrichment and gene regulatory network analyses for those cell clusters revealed potential genome functions and molecular mechanisms from gene expression to neuronal electrophysiology.

Transcriptomic evidence for dense peptidergic networks within forebrains of four widely divergent tetrapods

The primary function common to every neuron is communication with other neurons. Such cell-cell signaling can take numerous forms, including fast synaptic transmission and slower neuromodulation via secreted messengers, such as neuropeptides, dopamine, and many other diffusible small molecules. Individual neurons are quite diverse, however, in all particulars of both synaptic and neuromodulatory communication. Neuron classification schemes have therefore proven very useful in exploring the emergence of network function, behavior, and cognition from the communication functions of individual neurons. Recently published single-cell mRNA sequencing data and corresponding transcriptomic neuron classifications from turtle, songbird, mouse, and human provide evidence for a long evolutionary history and adaptive significance of localized peptidergic signaling. Across all four species, sets of at least twenty orthologous cognate pairs of neuropeptide precursor protein and receptor genes are expressed in individually sparse but heavily overlapping patterns suggesting that all forebrain neuron types are densely interconnected by local peptidergic signals.