DeepCell Kiosk: scaling deep learning-enabled cellular image analysis with Kubernetes

MyoFInDer: An AI-Based Tool for Myotube Fusion Index Determination

The fusion index is a key indicator for quantifying the differentiation of a myoblast population, which is often calculated manually. In addition to being time-consuming, manual quantification is also error prone and subjective. Several software tools have been proposed for addressing these limitations but suffer from various drawbacks, including unintuitive interfaces and limited performance. In this study, we describe MyoFInDer, a Python-based program for the automated computation of the fusion index of skeletal muscle. At the core of MyoFInDer is a powerful artificial intelligence-based image segmentation model. MyoFInDer also determines the total nuclei count and the percentage of stained area and allows for manual verification and correction. MyoFInDer can reliably determine the fusion index, with a high correlation to manual counting. Compared with other tools, MyoFInDer stands out as it minimizes the interoperator variability, minimizes process time and displays the best correlation to manual counting. Therefore, it is a suitable choice for calculating fusion index in an automated way, and gives researchers access to the high performance and flexibility of a modern artificial intelligence model. As a free and open-source project, MyoFInDer can be modified or extended to meet specific needs.

Accelerating drug discovery, development, and clinical trials by artificial intelligence

Artificial intelligence (AI) has profoundly advanced the field of biomedical research, which also demonstrates transformative capacity for innovation in drug development. This paper aims to deliver a comprehensive analysis of the progress in AI-assisted drug development, particularly focusing on small molecules, RNA, and antibodies. Moreover, this paper elucidates the current integration of AI methodologies within the industrial drug development framework. This encompasses a detailed examination of the industry-standard drug development process, supplemented by a review of medications presently undergoing clinical trials. Conclusively, the paper tackles a predominant obstacle within the AI pharmaceutical sector: the absence of AI-conceived drugs receiving approval. This paper also advocates for the adoption of large language models and diffusion models as a viable strategy to surmount this challenge. This review not only underscores the significant potential of AI in drug discovery but also deliberates on the challenges and prospects within this dynamically progressing field.

Neoadjuvant PARPi or chemotherapy in ovarian cancer informs targeting effector Treg cells for homologous-recombination-deficient tumors

Homologous recombination deficiency (HRD) is prevalent in cancer, sensitizing tumor cells to poly (ADP-ribose) polymerase (PARP) inhibition. However, the impact of HRD and related therapies on the tumor microenvironment (TME) remains elusive. Our study generates single-cell gene expression and T cell receptor profiles, along with validatory multimodal datasets from >100 high-grade serous ovarian cancer (HGSOC) samples, primarily from a phase II clinical trial (NCT04507841). Neoadjuvant monotherapy with the PARP inhibitor (PARPi) niraparib achieves impressive 62.5% and 73.6% response rates per RECIST v.1.1 and GCIG CA125, respectively. We identify effector regulatory T cells (eTregs) as key responders to HRD and neoadjuvant therapies, co-occurring with other tumor-reactive T cells, particularly terminally exhausted CD8+ T cells (Tex). TME-wide interferon signaling correlates with cancer cells upregulating MHC class II and co-inhibitory ligands, potentially driving Treg and Tex fates. Depleting eTregs in HRD mouse models, with or without PARP inhibition, significantly suppresses tumor growth without observable toxicities, underscoring the potential of eTreg-focused therapeutics for HGSOC and other HRD-related tumors.

Spatiotemporal omics for biology and medicine

The completion of the Human Genome Project has provided a foundational blueprint for understanding human life. Nonetheless, understanding the intricate mechanisms through which our genetic blueprint is involved in disease or orchestrates development across temporal and spatial dimensions remains a profound scientific challenge. Recent breakthroughs in cellular omics technologies have paved new pathways for understanding the regulation of genomic elements and the relationship between gene expression, cellular functions, and cell fate determination. The advent of spatial omics technologies, encompassing both imaging and sequencing-based methodologies, has enabled a comprehensive understanding of biological processes from a cellular ecosystem perspective. This review offers an updated overview of how spatial omics has advanced our understanding of the translation of genetic information into cellular heterogeneity and tissue structural organization and their dynamic changes over time. It emphasizes the discovery of various biological phenomena, related to organ functionality, embryogenesis, species evolution, and the pathogenesis of diseases.

Purinergic Ca2+ Signaling as a Novel Mechanism of Drug Tolerance in BRAF-Mutant Melanoma

Drug tolerance is a major cause of relapse after cancer treatment. Despite intensive efforts, its molecular basis remains poorly understood, hampering actionable intervention. We report a previously unrecognized signaling mechanism supporting drug tolerance in BRAF-mutant melanoma treated with BRAF inhibitors that could be of general relevance to other cancers. Its key features are cell-intrinsic intracellular Ca2+ signaling initiated by P2X7 receptors (purinergic ligand-gated cation channels) and an enhanced ability for these Ca2+ signals to reactivate ERK1/2 in the drug-tolerant state. Extracellular ATP, virtually ubiquitous in living systems, is the ligand that can initiate Ca2+ spikes via P2X7 channels. ATP is abundant in the tumor microenvironment and is released by dying cells, ironically implicating treatment-initiated cancer cell death as a source of trophic stimuli that leads to ERK reactivation and drug tolerance. Such a mechanism immediately offers an explanation of the inevitable relapse after BRAFi treatment in BRAF-mutant melanoma and points to actionable strategies to overcome it.

Vascularized organoid-on-a-chip: design, imaging, and analysis

Vascularized organoid-on-a-chip (VOoC) models achieve substance exchange in deep layers of organoids and provide a more physiologically relevant system in vitro. Common designs for VOoC primarily involve two categories: self-assembly of endothelial cells (ECs) to form microvessels and pre-patterned vessel lumens, both of which include the hydrogel region for EC growth and allow for controlled fluid perfusion on the chip. Characterizing the vasculature of VOoC often relies on high-resolution microscopic imaging. However, the high scattering of turbid tissues can limit optical imaging depth. To overcome this limitation, tissue optical clearing (TOC) techniques have emerged, allowing for 3D visualization of VOoC in conjunction with optical imaging techniques. The acquisition of large-scale imaging data, coupled with high-resolution imaging in whole-mount preparations, necessitates the development of highly efficient analysis methods. In this review, we provide an overview of the chip designs and culturing strategies employed for VOoC, as well as the applicable optical imaging and TOC methods. Furthermore, we summarize the vascular analysis techniques employed in VOoC, including deep learning. Finally, we discuss the existing challenges in VOoC and vascular analysis methods and provide an outlook for future development.

DLgram cloud service for deep-learning analysis of microscopy images

To analyze images in various fields of science and technology, it is often necessary to count observed objects and determine their parameters. This can be quite labor-intensive and time-consuming. This article presents DLgram, a universal, user-friendly cloud service that is developed for this purpose. It is based on deep learning technologies and does not require programming skills. The user labels several objects in the image and uploads it to the cloud where the neural network is trained to recognize the objects being studied. The user receives recognition results, which if necessary, can be corrected, errors removed, or missing objects added. In addition, it is possible to carry out mathematical processing of the data obtained to get information about the sizes, areas, and coordinates of the observed objects. The article describes the service features and discusses examples of its application. The DLgram service allows to reduce significantly the time spent on quantitative image analysis, reduce subjective factor influence, and increase the accuracy of analysis. RESEARCH HIGHLIGHTS: DLgram automatically recognizes and counts the number of objects in images and their parameters. DLgram is a universal service, which was created on the basis of the latest deep learning developments and does not require programming skills.

Multimodal mass spectrometry imaging identifies cell-type-specific metabolic and lipidomic variation in the mammalian liver

Spatial single-cell omics provides a readout of biochemical processes. It is challenging to capture the transient lipidome/metabolome from cells in a native tissue environment. We employed water gas cluster ion beam secondary ion mass spectrometry imaging ([H2O]n>28K-GCIB-SIMS) at ≤3 μm resolution using a cryogenic imaging workflow. This allowed multiple biomolecular imaging modes on the near-native-state liver at single-cell resolution. Our workflow utilizes desorption electrospray ionization (DESI) to build a reference map of metabolic heterogeneity and zonation across liver functional units at tissue level. Cryogenic dual-SIMS integrated metabolomics, lipidomics, and proteomics in the same liver lobules at single-cell level, characterizing the cellular landscape and metabolic states in different cell types. Lipids and metabolites classified liver metabolic zones, cell types and subtypes, highlighting the power of spatial multi-omics at high spatial resolution for understanding celluar and biomolecular organizations in the mammalian liver.

Multi-omic profiling of follicular lymphoma reveals changes in tissue architecture and enhanced stromal remodeling in high-risk patients

Follicular lymphoma (FL) is a generally incurable malignancy that evolves from developmentally blocked germinal center (GC) B cells. To promote survival and immune escape, tumor B cells undergo significant genetic changes and extensively remodel the lymphoid microenvironment. Dynamic interactions between tumor B cells and the tumor microenvironment (TME) are hypothesized to contribute to the broad spectrum of clinical behaviors observed among FL patients. Despite the urgent need, existing clinical tools do not reliably predict disease behavior. Using a multi-modal strategy, we examined cell-intrinsic and -extrinsic factors governing progression and therapeutic outcomes in FL patients enrolled onto a prospective clinical trial. By leveraging the strengths of each platform, we identify several tumor-specific features and microenvironmental patterns enriched in individuals who experience early relapse, the most high-risk FL patients. These features include stromal desmoplasia and changes to the follicular growth pattern present 20 months before first progression and first relapse.

Software Tools for 2D Cell Segmentation

Cell segmentation is an important task in the field of image processing, widely used in the life sciences and medical fields. Traditional methods are mainly based on pixel intensity and spatial relationships, but have limitations. In recent years, machine learning and deep learning methods have been widely used, providing more-accurate and efficient solutions for cell segmentation. The effort to develop efficient and accurate segmentation software tools has been one of the major focal points in the field of cell segmentation for years. However, each software tool has unique characteristics and adaptations, and no universal cell-segmentation software can achieve perfect results. In this review, we used three publicly available datasets containing multiple 2D cell-imaging modalities. Common segmentation metrics were used to evaluate the performance of eight segmentation tools to compare their generality and, thus, find the best-performing tool.

Nucleus subtype classification using inter-modality learning

Understanding the way cells communicate, co-locate, and interrelate is essential to understanding human physiology. Hematoxylin and eosin (H&E) staining is ubiquitously available both for clinical studies and research. The Colon Nucleus Identification and Classification (CoNIC) Challenge has recently innovated on robust artificial intelligence labeling of six cell types on H&E stains of the colon. However, this is a very small fraction of the number of potential cell classification types. Specifically, the CoNIC Challenge is unable to classify epithelial subtypes (progenitor, endocrine, goblet), lymphocyte subtypes (B, helper T, cytotoxic T), or connective subtypes (fibroblasts, stromal). In this paper, we propose to use inter-modality learning to label previously un-labelable cell types on virtual H&E. We leveraged multiplexed immunofluorescence (MxIF) histology imaging to identify 14 subclasses of cell types. We performed style transfer to synthesize virtual H&E from MxIF and transferred the higher density labels from MxIF to these virtual H&E images. We then evaluated the efficacy of learning in this approach. We identified helper T and progenitor nuclei with positive predictive values of 0.34 ± 0.15 (prevalence 0.03 ± 0.01) and 0.47 ± 0.1 (prevalence 0.07 ± 0.02) respectively on virtual H&E. This approach represents a promising step towards automating annotation in digital pathology.

Defining the boundaries: challenges and advances in identifying cells in microscopy images

Segmentation, or the outlining of objects within images, is a critical step in the measurement and analysis of cells within microscopy images. While improvements continue to be made in tools that rely on classical methods for segmentation, deep learning-based tools increasingly dominate advances in the technology. Specialist models such as Cellpose continue to improve in accuracy and user-friendliness, and segmentation challenges such as the Multi-Modality Cell Segmentation Challenge continue to push innovation in accuracy across widely varying test data as well as efficiency and usability. Increased attention on documentation, sharing, and evaluation standards is leading to increased user-friendliness and acceleration toward the goal of a truly universal method.

MAARS Software for Automatic and Quantitative Analysis of Mitotic Progression

In this chapter, we describe a software called MAARS (Mitotic Analysis And Recording System) that enables automatic and quantitative analysis of mitotic progression on an open-source platform. This computer-assisted analysis of cell division allows the unbiased acquisition of multiple parameters such as cell shape or size, metaphase or anaphase delays, as well as various mitotic abnormalities. This chapter describes the power of such an expert system to highlight the complexity of the mechanisms required to prevent mitotic chromosome segregation errors, leading to aneuploidy.

Alleviating tiling effect by random walk sliding window in high-resolution histological whole slide image synthesis

Multiplex immunofluorescence (MxIF) is an advanced molecular imaging technique that can simultaneously provide biologists with multiple (i.e., more than 20) molecular markers on a single histological tissue section. Unfortunately, due to imaging restrictions, the more routinely used hematoxylin and eosin (H&E) stain is typically unavailable with MxIF on the same tissue section. As biological H&E staining is not feasible, previous efforts have been made to obtain H&E whole slide image (WSI) from MxIF via deep learning empowered virtual staining. However, the tiling effect is a long-lasting problem in high-resolution WSI-wise synthesis. The MxIF to H&E synthesis is no exception. Limited by computational resources, the cross-stain image synthesis is typically performed at the patch-level. Thus, discontinuous intensities might be visually identified along with the patch boundaries assembling all individual patches back to a WSI. In this work, we propose a deep learning based unpaired high-resolution image synthesis method to obtain virtual H&E WSIs from MxIF WSIs (each with 27 markers/stains) with reduced tiling effects. Briefly, we first extend the CycleGAN framework by adding simultaneous nuclei and mucin segmentation supervision as spatial constraints. Then, we introduce a random walk sliding window shifting strategy during the optimized inference stage, to alleviate the tiling effects. The validation results show that our spatially constrained synthesis method achieves a 56% performance gain for the downstream cell segmentation task. The proposed inference method reduces the tiling effects by using 50% fewer computation resources without compromising performance. The proposed random sliding window inference method is a plug-and-play module, which can be generalized for other high-resolution WSI image synthesis applications. The source code with our proposed model are available at https://github.com/MASILab/RandomWalkSlidingWindow.git.

Cell Cycle Mapping Using Multiplexed Immunofluorescence

The development of technologies that allow measurement of the cell cycle at the single-cell level has revealed novel insights into the mechanisms that regulate cell cycle commitment and progression through DNA replication and cell division. These studies have also provided evidence of heterogeneity in cell cycle regulation among individual cells, even within a genetically identical population. Cell cycle mapping combines highly multiplexed imaging with manifold learning to visualize the diversity of "paths" that cells can take through the proliferative cell cycle or into various states of cell cycle arrest. In this chapter, we describe a general protocol of the experimental and computational components of cell cycle mapping. We also provide a comprehensive guide for the design and analysis of experiments, discussing key considerations in detail (e.g., antibody library preparation, analysis strategies, etc.) that may vary depending on the research question being addressed.

Decoding the tumor microenvironment with spatial technologies

Visualization of the cellular heterogeneity and spatial architecture of the tumor microenvironment (TME) is becoming increasingly important to understand mechanisms of disease progression and therapeutic response. This is particularly relevant in the era of cancer immunotherapy, in which the contexture of immune cell positioning within the tumor landscape has been proven to affect efficacy. Although single-cell technologies have mostly replaced conventional approaches to analyze specific cellular subsets within tumors, those that integrate a spatial dimension are now on the rise. In this Review, we assess the strengths and limitations of emerging spatial technologies with a focus on their applications in tumor immunology, as well as forthcoming opportunities for artificial intelligence (AI) and the value of integrating multiomics datasets to achieve a holistic picture of the TME.

Live-cell imaging in the deep learning era

Live imaging is a powerful tool, enabling scientists to observe living organisms in real time. In particular, when combined with fluorescence microscopy, live imaging allows the monitoring of cellular components with high sensitivity and specificity. Yet, due to critical challenges (i.e., drift, phototoxicity, dataset size), implementing live imaging and analyzing the resulting datasets is rarely straightforward. Over the past years, the development of bioimage analysis tools, including deep learning, is changing how we perform live imaging. Here we briefly cover important computational methods aiding live imaging and carrying out key tasks such as drift correction, denoising, super-resolution imaging, artificial labeling, tracking, and time series analysis. We also cover recent advances in self-driving microscopy.

Integrating spatial and single-cell transcriptomics data using deep generative models with SpatialScope

The rapid emergence of spatial transcriptomics (ST) technologies is revolutionizing our understanding of tissue spatial architecture and biology. Although current ST methods, whether based on next-generation sequencing (seq-based approaches) or fluorescence in situ hybridization (image-based approaches), offer valuable insights, they face limitations either in cellular resolution or transcriptome-wide profiling. To address these limitations, we present SpatialScope, a unified approach integrating scRNA-seq reference data and ST data using deep generative models. With innovation in model and algorithm designs, SpatialScope not only enhances seq-based ST data to achieve single-cell resolution, but also accurately infers transcriptome-wide expression levels for image-based ST data. We demonstrate SpatialScope's utility through simulation studies and real data analysis from both seq-based and image-based ST approaches. SpatialScope provides spatial characterization of tissue structures at transcriptome-wide single-cell resolution, facilitating downstream analysis, including detecting cellular communication through ligand-receptor interactions, localizing cellular subtypes, and identifying spatially differentially expressed genes.

SPACEL: deep learning-based characterization of spatial transcriptome architectures

Spatial transcriptomics (ST) technologies detect mRNA expression in single cells/spots while preserving their two-dimensional (2D) spatial coordinates, allowing researchers to study the spatial distribution of the transcriptome in tissues; however, joint analysis of multiple ST slices and aligning them to construct a three-dimensional (3D) stack of the tissue still remain a challenge. Here, we introduce spatial architecture characterization by deep learning (SPACEL) for ST data analysis. SPACEL comprises three modules: Spoint embeds a multiple-layer perceptron with a probabilistic model to deconvolute cell type composition for each spot in a single ST slice; Splane employs a graph convolutional network approach and an adversarial learning algorithm to identify spatial domains that are transcriptomically and spatially coherent across multiple ST slices; and Scube automatically transforms the spatial coordinate systems of consecutive slices and stacks them together to construct a 3D architecture of the tissue. Comparisons against 19 state-of-the-art methods using both simulated and real ST datasets from various tissues and ST technologies demonstrate that SPACEL outperforms the others for cell type deconvolution, for spatial domain identification, and for 3D alignment, thus showcasing SPACEL as a valuable integrated toolkit for ST data processing and analysis.

Deep learning-based image analysis identifies a DAT-negative subpopulation of dopaminergic neurons in the lateral Substantia nigra

Here we present a deep learning-based image analysis platform (DLAP), tailored to autonomously quantify cell numbers, and fluorescence signals within cellular compartments, derived from RNAscope or immunohistochemistry. We utilised DLAP to analyse subtypes of tyrosine hydroxylase (TH)-positive dopaminergic midbrain neurons in mouse and human brain-sections. These neurons modulate complex behaviour, and are differentially affected in Parkinson's and other diseases. DLAP allows the analysis of large cell numbers, and facilitates the identification of small cellular subpopulations. Using DLAP, we identified a small subpopulation of TH-positive neurons (~5%), mainly located in the very lateral Substantia nigra (SN), that was immunofluorescence-negative for the plasmalemmal dopamine transporter (DAT), with ~40% smaller cell bodies. These neurons were negative for aldehyde dehydrogenase 1A1, with a lower co-expression rate for dopamine-D2-autoreceptors, but a ~7-fold higher likelihood of calbindin-d28k co-expression (~70%). These results have important implications, as DAT is crucial for dopamine signalling, and is commonly used as a marker for dopaminergic SN neurons.

Disrupting cellular memory to overcome drug resistance

Gene expression states persist for varying lengths of time at the single-cell level, a phenomenon known as gene expression memory. When cells switch states, losing memory of their prior state, this transition can occur in the absence of genetic changes. However, we lack robust methods to find regulators of memory or track state switching. Here, we develop a lineage tracing-based technique to quantify memory and identify cells that switch states. Applied to melanoma cells without therapy, we quantify long-lived fluctuations in gene expression that are predictive of later resistance to targeted therapy. We also identify the PI3K and TGF-β pathways as state switching modulators. We propose a pretreatment model, first applying a PI3K inhibitor to modulate gene expression states, then applying targeted therapy, which leads to less resistance than targeted therapy alone. Together, we present a method for finding modulators of gene expression memory and their associated cell fates.

A robust platform for integrative spatial multi-omics analysis to map immune responses to SARS-CoV-2 infection in lung tissues

The SARS-CoV-2 (COVID-19) virus has caused a devastating global pandemic of respiratory illness. To understand viral pathogenesis, methods are available for studying dissociated cells in blood, nasal samples, bronchoalveolar lavage fluid and similar, but a robust platform for deep tissue characterization of molecular and cellular responses to virus infection in the lungs is still lacking. We developed an innovative spatial multi-omics platform to investigate COVID-19-infected lung tissues. Five tissue-profiling technologies were combined by a novel computational mapping methodology to comprehensively characterize and compare the transcriptome and targeted proteome of virus infected and uninfected tissues. By integrating spatial transcriptomics data (Visium, GeoMx and RNAScope) and proteomics data (CODEX and PhenoImager HT) at different cellular resolutions across lung tissues, we found strong evidence for macrophage infiltration and defined the broader microenvironment surrounding these cells. By comparing infected and uninfected samples, we found an increase in cytokine signalling and interferon responses at different sites in the lung and showed spatial heterogeneity in the expression level of these pathways. These data demonstrate that integrative spatial multi-omics platforms can be broadly applied to gain a deeper understanding of viral effects on cellular environments at the site of infection and to increase our understanding of the impact of SARS-CoV-2 on the lungs.

LOCATOR: feature extraction and spatial analysis of the cancer tissue microenvironment using mass cytometry imaging technologies

Motivation

Recent advances in highly multiplexed imaging have provided unprecedented insights into the complex cellular organization of tissues, with many applications in translational medicine. However, downstream analyses of multiplexed imaging data face several technical limitations, and although some computational methods and bioinformatics tools are available, deciphering the complex spatial organization of cellular ecosystems remains a challenging problem.

Results

To mitigate this problem, we develop a novel computational tool, LOCATOR (anaLysis Of CAncer Tissue micrOenviRonment), for spatial analysis of cancer tissue microenvironments using data acquired from mass cytometry imaging technologies. LOCATOR introduces a graph-based representation of tissue images to describe features of the cellular organization and deploys downstream analysis and visualization utilities that can be used for data-driven patient-risk stratification. Our case studies using mass cytometry imaging data from two well-annotated breast cancer cohorts re-confirmed that the spatial organization of the tumour-immune microenvironment is strongly associated with the clinical outcome in breast cancer. In addition, we report interesting potential associations between the spatial organization of macrophages and patients' survival. Our work introduces an automated and versatile analysis tool for mass cytometry imaging data with many applications in future cancer research projects.

Availability and implementation

Datasets and codes of LOCATOR are publicly available at https://github.com/RezvanEhsani/LOCATOR.

Harnessing computational spatial omics to explore the spatial biology intricacies

Spatially resolved transcriptomics (SRT) has unlocked new dimensions in our understanding of intricate tissue architectures. However, this rapidly expanding field produces a wealth of diverse and voluminous data, necessitating the evolution of sophisticated computational strategies to unravel inherent patterns. Two distinct methodologies, gene spatial pattern recognition (GSPR) and tissue spatial pattern recognition (TSPR), have emerged as vital tools in this process. GSPR methodologies are designed to identify and classify genes exhibiting noteworthy spatial patterns, while TSPR strategies aim to understand intercellular interactions and recognize tissue domains with molecular and spatial coherence. In this review, we provide a comprehensive exploration of SRT, highlighting crucial data modalities and resources that are instrumental for the development of methods and biological insights. We address the complexities and challenges posed by the use of heterogeneous data in developing GSPR and TSPR methodologies and propose an optimal workflow for both. We delve into the latest advancements in GSPR and TSPR, examining their interrelationships. Lastly, we peer into the future, envisaging the potential directions and perspectives in this dynamic field.

Machine learning for cross-scale microscopy of viruses

Despite advances in virological sciences and antiviral research, viruses continue to emerge, circulate, and threaten public health. We still lack a comprehensive understanding of how cells and individuals remain susceptible to infectious agents. This deficiency is in part due to the complexity of viruses, including the cell states controlling virus-host interactions. Microscopy samples distinct cellular infection stages in a multi-parametric, time-resolved manner at molecular resolution and is increasingly enhanced by machine learning and deep learning. Here we discuss how state-of-the-art artificial intelligence (AI) augments light and electron microscopy and advances virological research of cells. We describe current procedures for image denoising, object segmentation, tracking, classification, and super-resolution and showcase examples of how AI has improved the acquisition and analyses of microscopy data. The power of AI-enhanced microscopy will continue to help unravel virus infection mechanisms, develop antiviral agents, and improve viral vectors.

Chitosan and its derivatives in 3D/4D (bio) printing for tissue engineering and drug delivery applications

Tissue engineering research has undergone to a revolutionary improvement, thanks to technological advancements, such as the introduction of bioprinting technologies. The ability to develop suitable customized biomaterial inks/bioinks, with excellent printability and ability to promote cell proliferation and function, has a deep impact on such improvements. In this context, printing inks based on chitosan and its derivatives have been instrumental. Thus, the current review aims at providing a comprehensive overview on chitosan-based materials as suitable inks for 3D/4D (bio)printing and their applicability in creating advanced drug delivery platforms and tissue engineered constructs. Furthermore, relevant strategies to improve the mechanical and biological performances of this biomaterial are also highlighted.

SCS: cell segmentation for high-resolution spatial transcriptomics

Spatial transcriptomics promises to greatly improve our understanding of tissue organization and cell-cell interactions. While most current platforms for spatial transcriptomics only offer multi-cellular resolution, with 10-15 cells per spot, recent technologies provide a much denser spot placement leading to subcellular resolution. A key challenge for these newer methods is cell segmentation and the assignment of spots to cells. Traditional image-based segmentation methods are limited and do not make full use of the information profiled by spatial transcriptomics. Here we present subcellular spatial transcriptomics cell segmentation (SCS), which combines imaging data with sequencing data to improve cell segmentation accuracy. SCS assigns spots to cells by adaptively learning the position of each spot relative to the center of its cell using a transformer neural network. SCS was tested on two new subcellular spatial transcriptomics technologies and outperformed traditional image-based segmentation methods. SCS achieved better accuracy, identified more cells and provided more realistic cell size estimation. Subcellular analysis of RNAs using SCS spot assignments provides information on RNA localization and further supports the segmentation results.

Promise of spatially resolved omics for tumor research

Tumors are spatially heterogeneous tissues that comprise numerous cell types with intricate structures. By interacting with the microenvironment, tumor cells undergo dynamic changes in gene expression and metabolism, resulting in spatiotemporal variations in their capacity for proliferation and metastasis. In recent years, the rapid development of histological techniques has enabled efficient and high-throughput biomolecule analysis. By preserving location information while obtaining a large number of gene and molecular data, spatially resolved metabolomics (SRM) and spatially resolved transcriptomics (SRT) approaches can offer new ideas and reliable tools for the in-depth study of tumors. This review provides a comprehensive introduction and summary of the fundamental principles and research methods used for SRM and SRT techniques, as well as a review of their applications in cancer-related fields.

Moving beyond the desktop: prospects for practical bioimage analysis via the web

As biological imaging continues to rapidly advance, it results in increasingly complex image data, necessitating a reevaluation of conventional bioimage analysis methods and their accessibility. This perspective underscores our belief that a transition from desktop-based tools to web-based bioimage analysis could unlock immense opportunities for improved accessibility, enhanced collaboration, and streamlined workflows. We outline the potential benefits, such as reduced local computational demands and solutions to common challenges, including software installation issues and limited reproducibility. Furthermore, we explore the present state of web-based tools, hurdles in implementation, and the significance of collective involvement from the scientific community in driving this transition. In acknowledging the potential roadblocks and complexity of data management, we suggest a combined approach of selective prototyping and large-scale workflow application for optimal usage. Embracing web-based bioimage analysis could pave the way for the life sciences community to accelerate biological research, offering a robust platform for a more collaborative, efficient, and democratized science.

MIA is an open-source standalone deep learning application for microscopic image analysis

In recent years, the amount of data generated by imaging techniques has grown rapidly, along with increasing computational power and the development of deep learning algorithms. To address the need for powerful automated image analysis tools for a broad range of applications in the biomedical sciences, the Microscopic Image Analyzer (MIA) was developed. MIA combines a graphical user interface that obviates the need for programming skills with state-of-the-art deep-learning algorithms for segmentation, object detection, and classification. It runs as a standalone, platform-independent application and uses open data formats, which are compatible with commonly used open-source software packages. The software provides a unified interface for easy image labeling, model training, and inference. Furthermore, the software was evaluated in a public competition and performed among the top three for all tested datasets.

Spatial mapping of cellular senescence: emerging challenges and opportunities

Cellular senescence is a well-established driver of aging and age-related diseases. There are many challenges to mapping senescent cells in tissues such as the absence of specific markers and their relatively low abundance and vast heterogeneity. Single-cell technologies have allowed unprecedented characterization of senescence; however, many methodologies fail to provide spatial insights. The spatial component is essential, as senescent cells communicate with neighboring cells, impacting their function and the composition of extracellular space. The Cellular Senescence Network (SenNet), a National Institutes of Health (NIH) Common Fund initiative, aims to map senescent cells across the lifespan of humans and mice. Here, we provide a comprehensive review of the existing and emerging methodologies for spatial imaging and their application toward mapping senescent cells. Moreover, we discuss the limitations and challenges inherent to each technology. We argue that the development of spatially resolved methods is essential toward the goal of attaining an atlas of senescent cells.

SCS: cell segmentation for high-resolution spatial transcriptomics

Spatial transcriptomics promises to greatly improve our understanding of tissue organization and cell-cell interactions. While most current platforms for spatial transcriptomics only offer multi-cellular resolution, with 10-15 cells per spot, recent technologies provide a much denser spot placement leading to sub-cellular resolution. A key challenge for these newer methods is cell segmentation and the assignment of spots to cells. Traditional image-based segmentation methods are limited and do not make full use of the information profiled by spatial transcrip-tomics. Here we present SCS, which combines imaging data with sequencing data to improve cell segmentation accuracy. SCS assigns spots to cells by adaptively learning the position of each spot relative to the center of its cell using a transformer neural network. SCS was tested on two new sub-cellular spatial transcriptomics technologies and outperformed traditional image-based segmentation methods. SCS achieved better accuracy, identified more cells, and provided more realistic cell size estimation. Sub-cellular analysis of RNAs using SCS spots assignments provides information on RNA localization and further supports the segmentation results.

Tools of the Trade: Image Analysis Programs for Confocal Laser-Scanning Microscopy Studies of Biofilms and Considerations for Their Use by Experimental Researchers

Confocal laser-scanning microscopy (CLSM) is the bedrock of the microscopic visualization of biofilms. Previous applications of CLSM in biofilm studies have largely focused on observations of bacterial or fungal elements of biofilms, often seen as aggregates or mats of cells. However, the field of biofilm research is moving beyond qualitative observations alone, toward the quantitative analysis of the structural and functional features of biofilms, across clinical, environmental, and laboratory conditions. In recent times, several image analysis programs have been developed to extract and quantify biofilm properties from confocal micrographs. These tools not only vary in their scope and relevance to the specific biofilm features under study but also with respect to the user interface, compatibility with operating systems, and raw image requirements. Understanding these considerations is important when selecting tools for quantitative biofilm analysis, including at the initial experimental stages of image acquisition. In this review, we provide an overview of image analysis programs for confocal micrographs of biofilms, with a focus on tool selection and image acquisition parameters that are relevant for experimental researchers to ensure reliability and compatibility with downstream image processing.

Different approaches to Imaging Mass Cytometry data analysis

Imaging Mass Cytometry (IMC) is a novel, high multiplexing imaging platform capable of simultaneously detecting and visualizing up to 40 different protein targets. It is a strong asset available for in-depth study of histology and pathophysiology of the tissues. Bearing in mind the robustness of this technique and the high spatial context of the data it gives, it is especially valuable in studying the biology of cancer and tumor microenvironment. IMC-derived data are not classical micrographic images, and due to the characteristics of the data obtained using IMC, the image analysis approach, in this case, can diverge to a certain degree from the classical image analysis pipelines. As the number of publications based on the IMC is on the rise, this trend is also followed by an increase in the number of available methodologies designated solely to IMC-derived data analysis. This review has for an aim to give a systematic synopsis of all the available classical image analysis tools and pipelines useful to be employed for IMC data analysis and give an overview of tools intentionally developed solely for this purpose, easing the choice to researchers of selecting the most suitable methodologies for a specific type of analysis desired.

Mycobacterial nucleoid-associated protein Lsr2 is required for productive mycobacteriophage infection

Mycobacteriophages are a diverse group of viruses infecting Mycobacterium with substantial therapeutic potential. However, as this potential becomes realized, the molecular details of phage infection and mechanisms of resistance remain ill-defined. Here we use live-cell fluorescence microscopy to visualize the spatiotemporal dynamics of mycobacteriophage infection in single cells and populations, showing that infection is dependent on the host nucleoid-associated Lsr2 protein. Mycobacteriophages preferentially adsorb at Mycobacterium smegmatis sites of new cell wall synthesis and following DNA injection, Lsr2 reorganizes away from host replication foci to establish zones of phage DNA replication (ZOPR). Cells lacking Lsr2 proceed through to cell lysis when infected but fail to generate consecutive phage bursts that trigger epidemic spread of phage particles to neighbouring cells. Many mycobacteriophages code for their own Lsr2-related proteins, and although their roles are unknown, they do not rescue the loss of host Lsr2.

Deep learning-enabled segmentation of ambiguous bioimages with deepflash2

Bioimages frequently exhibit low signal-to-noise ratios due to experimental conditions, specimen characteristics, and imaging trade-offs. Reliable segmentation of such ambiguous images is difficult and laborious. Here we introduce deepflash2, a deep learning-enabled segmentation tool for bioimage analysis. The tool addresses typical challenges that may arise during the training, evaluation, and application of deep learning models on ambiguous data. The tool's training and evaluation pipeline uses multiple expert annotations and deep model ensembles to achieve accurate results. The application pipeline supports various use-cases for expert annotations and includes a quality assurance mechanism in the form of uncertainty measures. Benchmarked against other tools, deepflash2 offers both high predictive accuracy and efficient computational resource usage. The tool is built upon established deep learning libraries and enables sharing of trained model ensembles with the research community. deepflash2 aims to simplify the integration of deep learning into bioimage analysis projects while improving accuracy and reliability.

Multiplex Immunofluorescence Image Quality Checking Using DAPI Channel-referenced Evaluation

Multiplex immunofluorescence (MxIF) images provide detailed information of cell composition and spatial context for biomedical research. However, compromised data quality could lead to research biases. Comprehensive image quality checking (QC) is essential for reliable downstream analysis. As a reliable and specific staining of cell nuclei, 4',6-diamidino-2-phenylindole (DAPI) signals were used as references for tissue localization and auto-focusing across MxIF staining-scanning-bleaching iterations and could potentially be reused for QC. To confirm the feasibility of using DAPI as QC reference, pixel-level DAPI values were extracted to calculate signal fluctuations and tissue content similarities in staining-scanning-bleaching iterations for identifying quality issues. Concordance between automatic quantification and human experts' annotations were evaluated on a data set consisting of 348 fields of view (FOVs) with 45 immune and tumor cell markers. Cell distribution differences between subsets of QC-pass vs QC-failed FOVs were compared to investigate the downstream effects. Results showed that 87.3% FOVs with tissue damage and 73.4% of artifacts were identified. QC-failed FOVs showed elevated regional gathering in cellular feature space compared with the QC-pass FOVs. Our results supported that DAPI signals could be used as references for MxIF image QC, and low-quality FOVs identified by our method must be cautiously considered for downstream analyses.

SEG: Segmentation Evaluation in absence of Ground truth labels

Identifying individual cells or nuclei is often the first step in the analysis of multiplex tissue imaging (MTI) data. Recent efforts to produce plug-and-play, end-to-end MTI analysis tools such as MCMICRO1- though groundbreaking in their usability and extensibility - are often unable to provide users guidance regarding the most appropriate models for their segmentation task among an endless proliferation of novel segmentation methods. Unfortunately, evaluating segmentation results on a user's dataset without ground truth labels is either purely subjective or eventually amounts to the task of performing the original, time-intensive annotation. As a consequence, researchers rely on models pre-trained on other large datasets for their unique tasks. Here, we propose a methodological approach for evaluating MTI nuclei segmentation methods in absence of ground truth labels by scoring relatively to a larger ensemble of segmentations. To avoid potential sensitivity to collective bias from the ensemble approach, we refine the ensemble via weighted average across segmentation methods, which we derive from a systematic model ablation study. First, we demonstrate a proof-of-concept and the feasibility of the proposed approach to evaluate segmentation performance in a small dataset with ground truth annotation. To validate the ensemble and demonstrate the importance of our method-specific weighting, we compare the ensemble's detection and pixel-level predictions - derived without supervision - with the data's ground truth labels. Second, we apply the methodology to an unlabeled larger tissue microarray (TMA) dataset, which includes a diverse set of breast cancer phenotypes, and provides decision guidelines for the general user to more easily choose the most suitable segmentation methods for their own dataset by systematically evaluating the performance of individual segmentation approaches in the entire dataset.

Application of Machine Learning in Spatial Proteomics

Spatial proteomics is an interdisciplinary field that investigates the localization and dynamics of proteins, and it has gained extensive attention in recent years, especially the subcellular proteomics. Numerous evidence indicate that the subcellular localization of proteins is associated with various cellular processes and disease progression. Mass spectrometry (MS)-based and imaging-based experimental approaches have been developed to acquire large-scale spatial proteomic data. To allow the reliable analysis of increasingly complex spatial proteomics data, machine learning (ML) methods have been widely used in both MS-based and imaging-based spatial proteomic data analysis pipelines. Here, we comprehensively survey the applications of ML in spatial proteomics from following aspects: (1) data resources for spatial proteome are comprehensively introduced; (2) the roles of different ML algorithms in data analysis pipelines are elaborated; (3) successful applications of spatial proteomics and several analytical tools integrating ML methods are presented; (4) challenges existing in modern ML-based spatial proteomics studies are discussed. This review provides guidelines for researchers seeking to apply ML methods to analyze spatial proteomic data and can facilitate insightful understanding of cell biology as well as the future research in medical and drug discovery communities.

Persistent alveolar type 2 dysfunction and lung structural derangement in post-acute COVID-19

SARS-CoV-2 infection can manifest as a wide range of respiratory and systemic symptoms well after the acute phase of infection in over 50% of patients. Key questions remain on the long-term effects of infection on tissue pathology in recovered COVID-19 patients. To address these questions we performed multiplexed imaging of post-mortem lung tissue from 12 individuals who died post-acute COVID-19 (PC) and compare them to lung tissue from patients who died during the acute phase of COVID-19, or patients who died with idiopathic pulmonary fibrosis (IPF), and otherwise healthy lung tissue. We find evidence of viral presence in the lung up to 359 days after the acute phase of disease, including in patients with negative nasopharyngeal swab tests. The lung of PC patients are characterized by the accumulation of senescent alveolar type 2 cells, fibrosis with hypervascularization of peribronchial areas and alveolar septa, as the most pronounced pathophysiological features. At the cellular level, lung disease of PC patients, while distinct, shares pathological features with the chronic pulmonary disease of IPF. which may help rationalize interventions for PC patients. Altogether, this study provides an important foundation for the understanding of the long-term effects of SARS-CoV-2 pulmonary infection at the microanatomical, cellular, and molecular level.

Omnipose: a high-precision morphology-independent solution for bacterial cell segmentation

Advances in microscopy hold great promise for allowing quantitative and precise measurement of morphological and molecular phenomena at the single-cell level in bacteria; however, the potential of this approach is ultimately limited by the availability of methods to faithfully segment cells independent of their morphological or optical characteristics. Here, we present Omnipose, a deep neural network image-segmentation algorithm. Unique network outputs such as the gradient of the distance field allow Omnipose to accurately segment cells on which current algorithms, including its predecessor, Cellpose, produce errors. We show that Omnipose achieves unprecedented segmentation performance on mixed bacterial cultures, antibiotic-treated cells and cells of elongated or branched morphology. Furthermore, the benefits of Omnipose extend to non-bacterial subjects, varied imaging modalities and three-dimensional objects. Finally, we demonstrate the utility of Omnipose in the characterization of extreme morphological phenotypes that arise during interbacterial antagonism. Our results distinguish Omnipose as a powerful tool for characterizing diverse and arbitrarily shaped cell types from imaging data.

Adaptive tracking algorithm for trajectory analysis of cells and layer-by-layer assessment of motility dynamics

Tracking biological objects such as cells or subcellular components imaged with time-lapse microscopy enables us to understand the molecular principles about the dynamics of cell behaviors. However, automatic object detection, segmentation and extracting trajectories remain as a rate-limiting step due to intrinsic challenges of video processing. This paper presents an adaptive tracking algorithm (Adtari) that automatically finds the optimum search radius and cell linkages to determine trajectories in consecutive frames. A critical assumption in most tracking studies is that displacement remains unchanged throughout the movie and cells in a few frames are usually analyzed to determine its magnitude. Tracking errors and inaccurate association of cells may occur if the user does not correctly evaluate the value or prior knowledge is not present on cell movement. The key novelty of our method is that minimum intercellular distance and maximum displacement of cells between frames are dynamically computed and used to determine the threshold distance. Since the space between cells is highly variable in a given frame, our software recursively alters the magnitude to determine all plausible matches in the trajectory analysis. Our method therefore eliminates a major preprocessing step where a constant distance was used to determine the neighbor cells in tracking methods. Cells having multiple overlaps and splitting events were further evaluated by using the shape attributes including perimeter, area, ellipticity and distance. The features were applied to determine the closest matches by minimizing the difference in their magnitudes. Finally, reporting section of our software were used to generate instant maps by overlaying cell features and trajectories. Adtari was validated by using videos with variable signal-to-noise, contrast ratio and cell density. We compared the adaptive tracking with constant distance and other methods to evaluate performance and its efficiency. Our algorithm yields reduced mismatch ratio, increased ratio of whole cell track, higher frame tracking efficiency and allows layer-by-layer assessment of motility to characterize single-cells. Adaptive tracking provides a reliable, accurate, time efficient and user-friendly open source software that is well suited for analysis of 2D fluorescence microscopy video datasets.

Recent advances in microfluidics-based cell migration research

Cell migration is crucial for many biological processes, including normal development, immune response, and tissue homeostasis and many pathological processes such as cancer metastasis and wound healing. Microfluidics has revolutionized the research in cell migration since its inception as it reduces the cost of studies and allows precise manipulation of different parameters that affect cell migratory response. Over the past decade, the field has made great strides in many directions, such as techniques for better control of the cellular microenvironment, application-oriented physiological-like models, and machine-assisted cell image analysis methods. Here we review recent developments in the field of microfluidic cell migration through the following aspects: 1) the co-culture models for studying host-pathogen interactions at single-cell resolution; 2) the spatiotemporal manipulation of the chemical gradients guiding cell migration; 3) the organ-on-chip models to study cell transmigration; and 4) the deep learning image processing strategies for cell migration data analysis. We further discuss the challenges, possible improvement and future perspectives of using microfluidic techniques to study cell migration.

Segmentation, tracking and cell cycle analysis of live-cell imaging data with Cell-ACDC

BACKGROUND

High-throughput live-cell imaging is a powerful tool to study dynamic cellular processes in single cells but creates a bottleneck at the stage of data analysis, due to the large amount of data generated and limitations of analytical pipelines. Recent progress on deep learning dramatically improved cell segmentation and tracking. Nevertheless, manual data validation and correction is typically still required and tools spanning the complete range of image analysis are still needed.

RESULTS

We present Cell-ACDC, an open-source user-friendly GUI-based framework written in Python, for segmentation, tracking and cell cycle annotations. We included state-of-the-art deep learning models for single-cell segmentation of mammalian and yeast cells alongside cell tracking methods and an intuitive, semi-automated workflow for cell cycle annotation of single cells. Using Cell-ACDC, we found that mTOR activity in hematopoietic stem cells is largely independent of cell volume. By contrast, smaller cells exhibit higher p38 activity, consistent with a role of p38 in regulation of cell size. Additionally, we show that, in S. cerevisiae, histone Htb1 concentrations decrease with replicative age.

CONCLUSIONS

Cell-ACDC provides a framework for the application of state-of-the-art deep learning models to the analysis of live cell imaging data without programming knowledge. Furthermore, it allows for visualization and correction of segmentation and tracking errors as well as annotation of cell cycle stages. We embedded several smart algorithms that make the correction and annotation process fast and intuitive. Finally, the open-source and modularized nature of Cell-ACDC will enable simple and fast integration of new deep learning-based and traditional methods for cell segmentation, tracking, and downstream image analysis. Source code: https://github.com/SchmollerLab/Cell_ACDC.

TNIK Inhibition Has Dual Synergistic Effects on Tumor and Associated Immune Cells

Treatment with checkpoint inhibitors can be extraordinarily effective in a fraction of patients, particularly those whose tumors are pre-infiltrated by T cells. In others, efficacy is considerably lower, which has led to interest in developing strategies for sensitization to immunotherapy. Using various colorectal cancer mouse models, it is shown that the use of Traf2 and Nck-interacting protein kinase inhibitors (TNIKi) unexpectedly increases tumor infiltration by PD-1⁺ CD8⁺ T cells, thus contributing to tumor control. This appears to happen by two independent mechanisms, by inducing immunogenic cell death and separately by directly activating CD8. The use of TNIKi achieves complete tumor control in 50% of mice when combined with checkpoint inhibitor targeting PD-1. These findings reveal immunogenic properties of TNIKi and indicate that the proportion of colorectal cancers responding to checkpoint therapy can be increased by combining it with immunogenic kinase inhibitors.

DeepBacs for multi-task bacterial image analysis using open-source deep learning approaches

This work demonstrates and guides how to use a range of state-of-the-art artificial neural-networks to analyse bacterial microscopy images using the recently developed ZeroCostDL4Mic platform. We generated a database of image datasets used to train networks for various image analysis tasks and present strategies for data acquisition and curation, as well as model training. We showcase different deep learning (DL) approaches for segmenting bright field and fluorescence images of different bacterial species, use object detection to classify different growth stages in time-lapse imaging data, and carry out DL-assisted phenotypic profiling of antibiotic-treated cells. To also demonstrate the ability of DL to enhance low-phototoxicity live-cell microscopy, we showcase how image denoising can allow researchers to attain high-fidelity data in faster and longer imaging. Finally, artificial labelling of cell membranes and predictions of super-resolution images allow for accurate mapping of cell shape and intracellular targets. Our purposefully-built database of training and testing data aids in novice users' training, enabling them to quickly explore how to analyse their data through DL. We hope this lays a fertile ground for the efficient application of DL in microbiology and fosters the creation of tools for bacterial cell biology and antibiotic research.

Integrated Analytical System for Clinical Single-Cell Analysis

High-dimensional analyses of cancers can potentially be used to better define cancer subtypes, analyze the complex tumor microenvironment, and perform cancer cell pathway analyses for drug trials. Unfortunately, integrated systems that allow such analyses in serial fine needle aspirates within a day or at point-of-care currently do not exist. To achieve this, an integrated immunofluorescence single-cell analyzer (i2SCAN) for deep profiling of directly harvested cells is developed. By combining a novel cellular imaging system, highly cyclable bioorthogonal FAST antibody panels, and integrated computational analysis, it is shown that same-day analysis is possible in thousands of harvested cells. It is demonstrated that the i2SCAN approach allows comprehensive analysis of breast cancer samples obtained by fine needle aspiration or core tissues. The method is a rapid, robust, and low-cost solution to high-dimensional analysis of scant clinical specimens.

Live-cell microscopy or fluorescence anisotropy with budded baculoviruses-which way to go with measuring ligand binding to M4 muscarinic receptors?

M4 muscarinic acetylcholine receptor is a G protein-coupled receptor (GPCR) that has been associated with alcohol and cocaine abuse, Alzheimer's disease, and schizophrenia which makes it an interesting drug target. For many GPCRs, the high-affinity fluorescence ligands have expanded the options for high-throughput screening of drug candidates and serve as useful tools in fundamental receptor research. Here, we explored two TAMRA-labelled fluorescence ligands, UR-MK342 and UR-CG072, for development of assays for studying ligand-binding properties to M4 receptor. Using budded baculovirus particles as M4 receptor preparation and fluorescence anisotropy method, we measured the affinities and binding kinetics of both fluorescence ligands. Using the fluorescence ligands as reporter probes, the binding affinities of unlabelled ligands could be determined. Based on these results, we took a step towards a more natural system and developed a method using live CHO-K1-hM4R cells and automated fluorescence microscopy suitable for the routine determination of unlabelled ligand affinities. For quantitative image analysis, we developed random forest and deep learning-based pipelines for cell segmentation. The pipelines were integrated into the user-friendly open-source Aparecium software. Both image analysis methods were suitable for measuring fluorescence ligand saturation binding and kinetics as well as for screening binding affinities of unlabelled ligands.

Membrane marker selection for segmenting single cell spatial proteomics data

The ability to profile spatial proteomics at the single cell level enables the study of cell types, their spatial distribution, and interactions in several tissues and conditions. Current methods for cell segmentation in such studies rely on known membrane or cell boundary markers. However, for many tissues, an optimal set of markers is not known, and even within a tissue, different cell types may express different markers. Here we present RAMCES, a method that uses a convolutional neural network to learn the optimal markers for a new sample and outputs a weighted combination of the selected markers for segmentation. Testing RAMCES on several existing datasets indicates that it correctly identifies cell boundary markers, improving on methods that rely on a single marker or those that extend nuclei segmentations. Application to new spatial proteomics data demonstrates its usefulness for accurately assigning cell types based on the proteins expressed in segmented cells.

Cell segmentation of single-cell spatial proteomics data remains a challenge and often relies on the selection of a membrane marker, which is not always known. Here, the authors introduce RAMCES, a method that selects the optimal membrane markers to use for more accurate cell segmentation.