Integrated intracellular organization and its variations in human iPS cells

How crosstalk between mitochondria, lysosomes, and other organelles can prevent or promote dry age-related macular degeneration

Organelles such as mitochondria, lysosomes, peroxisomes, and the endoplasmic reticulum form highly dynamic cellular networks and exchange information through sites of physical contact. While each organelle performs unique functions, this inter-organelle crosstalk helps maintain cell homeostasis. Age-related macular degeneration (AMD) is a devastating blinding disease strongly associated with mitochondrial dysfunction, oxidative stress, and decreased clearance of cellular debris in the retinal pigment epithelium (RPE). However, how these occur, and how they relate to organelle function both with the RPE and potentially the photoreceptors are fundamental, unresolved questions in AMD biology. Here, we report the discussions of the "Mitochondria, Lysosomes, and other Organelle Interactions" task group of the 2024 Ryan Initiative for Macular Research (RIMR). Our group focused on understanding the interplay between cellular organelles in maintaining homeostasis in the RPE and photoreceptors, how this could be derailed to promote AMD, and identifying where these pathways could potentially be targeted therapeutically.

Deep-learning-based image compression for microscopy images: An empirical study

With the fast development of modern microscopes and bioimaging techniques, an unprecedentedly large amount of imaging data is being generated, stored, analyzed, and shared through networks. The size of the data poses great challenges for current data infrastructure. One common way to reduce the data size is by image compression. This study analyzes multiple classic and deep-learning-based image compression methods, as well as an empirical study on their impact on downstream deep-learning-based image processing models. We used deep-learning-based label-free prediction models (i.e., predicting fluorescent images from bright-field images) as an example downstream task for the comparison and analysis of the impact of image compression. Different compression techniques are compared in compression ratio, image similarity, and, most importantly, the prediction accuracy of label-free models on original and compressed images. We found that artificial intelligence (AI)-based compression techniques largely outperform the classic ones with minimal influence on the downstream 2D label-free tasks. In the end, we hope this study could shed light on the potential of deep-learning-based image compression and raise the awareness of the potential impacts of image compression on downstream deep-learning models for analysis.

Emergent microenvironments of nucleoli

In higher eukaryotes, the nucleolus harbors at least three sub-phases that facilitate multiple functionalities including ribosome biogenesis. The three prominent coexisting sub-phases are the fibrillar center (FC), the dense fibrillar component (DFC), and the granular component (GC). Here, we review recent efforts in profiling sub-phase compositions that shed light on the types of physicochemical properties that emerge from compositional biases and territorial organization of specific types of macromolecules. We highlight roles played by molecular grammars which refers to protein sequence features including the substrate binding domains, the sequence features of intrinsically disordered regions, and the multivalence of these distinct types of domains / regions. We introduce the concept of a barcode of emergent physicochemical properties of nucleoli. Although our knowledge of the full barcode remains incomplete, we hope that the concept prompts investigations into undiscovered emergent properties and engenders an appreciation for how and why unique microenvironments control biochemical reactions.

Quantitative determination of the spatial distribution of components in single cells with CellDetail

The distribution of biomolecules within cells changes upon aging and diseases. To quantitatively determine the spatial distribution of components inside cells, we built the user-friendly open-source 3D-cell-image analysis platform Cell Detection and Analysis of Intensity Lounge (CellDetail). The algorithm within CellDetail is based on the concept of the dipole moment. CellDetail provides quantitative values for the distribution of the polarity proteins Cdc42 and Tubulin in young and aged hematopoietic stem cells (HSCs). Septin proteins form networks within cells that are critical for cell compartmentalization. We uncover a reduced level of organization of the Septin network within aged HSCs and within senescent human fibroblasts. Changes in the Septin network structure might therefore be a common feature of aging. The level of organization of the network of Septin proteins in aged HSCs can be restored to a youthful level by pharmacological attenuation of the activity of the small RhoGTPase Cdc42.

Automated segmentation of soft X-ray tomography: native cellular structure with sub-micron resolution at high throughput for whole-cell quantitative imaging in yeast

Soft X-ray tomography (SXT) is an invaluable tool for quantitatively analyzing cellular structures at sub-optical isotropic resolution. However, it has traditionally depended on manual segmentation, limiting its scalability for large datasets. Here, we leverage a deep learning-based auto-segmentation pipeline to segment and label cellular structures in hundreds of cells across three Saccharomyces cerevisiae strains. This task-based pipeline employs manual iterative refinement to improve segmentation accuracy for key structures, including the cell body, nucleus, vacuole, and lipid droplets, enabling high-throughput and precise phenotypic analysis. Using this approach, we quantitatively compared the 3D whole-cell morphometric characteristics of wild-type, VPH1-GFP, and vac14 strains, uncovering detailed strain-specific cell and organelle size and shape variations. We show the utility of SXT data for precise 3D curvature analysis of entire organelles and cells and detection of fine morphological features using surface meshes. Our approach facilitates comparative analyses with high spatial precision and statistical throughput, uncovering subtle morphological features at the single cell and population level. This workflow significantly enhances our ability to characterize cell anatomy and supports scalable studies on the mesoscale, with applications in investigating cellular architecture, organelle biology, and genetic research across diverse biological contexts.

Significance Statement

Soft X-ray tomography offers many powerful features for whole-cell multi-organelle imaging, but, like other high resolution volumetric imaging modalities, is typically limited by low throughput due to laborious segmentation.Auto-segmentation for soft X-ray tomography overcomes this limitation, enabling statistical 3D morphometric analysis of multiple organelles in whole cells across cell populations. The combination of high 3D resolution of SXT data with statistically useful throughput represents an avenue for more thorough characterizations of cells in toto and opens new mesoscale biological questions and statistical whole-cell modeling of organelle and cell morphology, interactions, and responses to perturbations.

3DCellComposer - A Versatile Pipeline Utilizing 2D Cell Segmentation Methods for 3D Cell Segmentation

Background

Cell segmentation is crucial in bioimage informatics, as its accuracy directly impacts conclusions drawn from cellular analyses. While many approaches to 2D cell segmentation have been described, 3D cell segmentation has received much less attention. 3D segmentation faces significant challenges, including limited training data availability due to the difficulty of the task for human annotators, and inherent three-dimensional complexity. As a result, existing 3D cell segmentation methods often lack broad applicability across different imaging modalities.

Results

To address this, we developed a generalizable approach for using 2D cell segmentation methods to produce accurate 3D cell segmentations. We implemented this approach in 3DCellComposer, a versatile, open-source package that allows users to choose any existing 2D segmentation model appropriate for their tissue or cell type(s) without requiring any additional training. Importantly, we have enhanced our open source CellSegmentationEvaluator quality evaluation tool to support 3D images. It provides metrics that allow selection of the best approach for a given imaging source and modality, without the need for human annotations to assess performance. Using these metrics, we demonstrated that our approach produced high-quality 3D segmentations of tissue images, and that it could outperform an existing 3D segmentation method on the cell culture images with which it was trained.

Conclusions

3DCellComposer, when paired with well-trained 2D segmentation models, provides an important alternative to acquiring human-annotated 3D images for new sample types or imaging modalities and then training 3D segmentation models using them. It is expected to be of significant value for large scale projects such as the Human BioMolecular Atlas Program.

Where physics and biology meet

As part of this special issue on physics and biology, we invited several leading experts that bridge these disciplines to provide their views on the reciprocal contributions of each field and the benefits and challenges of working across physics and biology: introduction provided by Wallace Marshall.

Mantis: High-throughput 4D imaging and analysis of the molecular and physical architecture of cells

High-throughput dynamic imaging of cells and organelles is essential for understanding complex cellular responses. We report Mantis, a high-throughput 4D microscope that integrates two complementary, gentle, live-cell imaging technologies: remote-refocus label-free microscopy and oblique light-sheet fluorescence microscopy. Additionally, we report shrimPy (Smart High-throughput Robust Imaging and Measurement in Python), an open-source software for high-throughput imaging, deconvolution, and single-cell phenotyping of 4D data. Using Mantis and shrimPy, we achieved high-content correlative imaging of molecular dynamics and the physical architecture of 20 cell lines every 15 min over 7.5 h. This platform also facilitated detailed measurements of the impacts of viral infection on the architecture of host cells and host proteins. The Mantis platform can enable high-throughput profiling of intracellular dynamics, long-term imaging and analysis of cellular responses to perturbations, and live-cell optical screens to dissect gene regulatory networks.

Organelle landscape analysis using a multiparametric particle-based method

Organelles have unique structures and molecular compositions for their functions and have been classified accordingly. However, many organelles are heterogeneous and in the process of maturation and differentiation. Because traditional methods have a limited number of parameters and spatial resolution, they struggle to capture the heterogeneous landscapes of organelles. Here, we present a method for multiparametric particle-based analysis of organelles. After disrupting cells, fluorescence microscopy images of organelle particles labeled with 6 to 8 different organelle markers were obtained, and their multidimensional data were represented in two-dimensional uniform manifold approximation and projection (UMAP) spaces. This method enabled visualization of landscapes of 7 major organelles as well as the transitional states of endocytic organelles directed to the recycling and degradation pathways. Furthermore, endoplasmic reticulum-mitochondria contact sites were detected in these maps. Our proposed method successfully detects a wide array of organelles simultaneously, enabling the analysis of heterogeneous organelle landscapes.

Harmonizing the Generation and Pre-publication Stewardship of FAIR bioimage data

Together with the molecular knowledge of genes and proteins, biological images promise to significantly enhance the scientific understanding of complex cellular systems and to advance predictive and personalized therapeutic products for human health. For this potential to be realized, quality-assured bioimage data must be shared among labs at a global scale to be compared, pooled, and reanalyzed, thus unleashing untold potential beyond the original purpose for which the data was generated. There are two broad sets of requirements to enable bioimage data sharing in the life sciences. One set of requirements is articulated in the companion White Paper entitled "Enabling Global Image Data Sharing in the Life Sciences," which is published in parallel and addresses the need to build the cyberinfrastructure for sharing bioimage data (arXiv:2401.13023 [q-bio.OT], https://doi.org/10.48550/arXiv.2401.13023). Here, we detail a broad set of requirements, which involves collecting, managing, presenting, and propagating contextual information essential to assess the quality, understand the content, interpret the scientific implications, and reuse bioimage data in the context of the experimental details. We start by providing an overview of the main lessons learned to date through international community activities, which have recently made generating community standard practices for imaging Quality Control (QC) and metadata (Faklaris et al., 2022; Hammer et al., 2021; Huisman et al., 2021; Microscopy Australia, 2016; Montero Llopis et al., 2021; Rigano et al., 2021; Sarkans et al., 2021). We then provide a clear set of recommendations for amplifying this work. The driving goal is to address remaining challenges and democratize access to common practices and tools for a spectrum of biomedical researchers, regardless of their expertise, access to resources, and geographical location.

Interpretable representation learning for 3D multi-piece intracellular structures using point clouds

A key challenge in understanding subcellular organization is quantifying interpretable measurements of intracellular structures with complex multi-piece morphologies in an objective, robust and generalizable manner. Here we introduce a morphology-appropriate representation learning framework that uses 3D rotation invariant autoencoders and point clouds. This framework is used to learn representations of complex multi-piece morphologies that are independent of orientation, compact, and easy to interpret. We apply our framework to intracellular structures with punctate morphologies (e.g. DNA replication foci) and polymorphic morphologies (e.g. nucleoli). We systematically compare our framework to image-based autoencoders across several intracellular structure datasets, including a synthetic dataset with pre-defined rules of organization. We explore the trade-offs in the performance of different models by performing multi-metric benchmarking across efficiency, generative capability, and representation expressivity metrics. We find that our framework, which embraces the underlying morphology of multi-piece structures, facilitates the unsupervised discovery of sub-clusters for each structure. We show how our approach can also be applied to phenotypic profiling using a dataset of nucleolar images following drug perturbations. We implement and provide all representation learning models using CytoDL, a python package for flexible and configurable deep learning experiments.

Recent Advancements in Subcellular Proteomics: Growing Impact of Organellar Protein Niches on the Understanding of Cell Biology

The mammalian cell is a complex entity, with membrane-bound and membrane-less organelles playing vital roles in regulating cellular homeostasis. Organellar protein niches drive discrete biological processes and cell functions, thus maintaining cell equilibrium. Cellular processes such as signaling, growth, proliferation, motility, and programmed cell death require dynamic protein movements between cell compartments. Aberrant protein localization is associated with a wide range of diseases. Therefore, analyzing the subcellular proteome of the cell can provide a comprehensive overview of cellular biology. With recent advancements in mass spectrometry, imaging technology, computational tools, and deep machine learning algorithms, studies pertaining to subcellular protein localization and their dynamic distributions are gaining momentum. These studies reveal changing interaction networks because of "moonlighting proteins" and serve as a discovery tool for disease network mechanisms. Consequently, this review aims to provide a comprehensive repository for recent advancements in subcellular proteomics subcontexting methods, challenges, and future perspectives for method developers. In summary, subcellular proteomics is crucial to the understanding of the fundamental cellular mechanisms and the associated diseases.

In silico labeling in cell biology: Potential and limitations

In silico labeling is the computational cross-modality image translation where the output modality is a subcellular marker that is not specifically encoded in the input image, for example, in silico localization of organelles from transmitted light images. In principle, in silico labeling has the potential to facilitate rapid live imaging of multiple organelles with reduced photobleaching and phototoxicity, a technology enabling a major leap toward understanding the cell as an integrated complex system. However, five years have passed since feasibility was attained, without any demonstration of using in silico labeling to uncover new biological insight. In here, we discuss the current state of in silico labeling, the limitations preventing it from becoming a practical tool, and how we can overcome these limitations to reach its full potential.

Constant surface area-to-volume ratio during cell growth as a design principle in mammalian cells

All cells are subject to geometric constraints, such as surface area-to-volume (SA/V) ratio, that impact cell functions and force biological adaptations. Like the SA/V ratio of a sphere, it is generally assumed that the SA/V ratio of cells decreases as cell size increases. Here, we investigate this in near-spherical mammalian cells using single-cell measurements of cell mass and surface proteins, as well as imaging of plasma membrane morphology. We find that the SA/V ratio remains surprisingly constant as cells grow larger. This observation is largely independent of the cell cycle and the amount of cell growth. Consequently, cell growth results in increased plasma membrane folding, which simplifies cellular design by ensuring sufficient membrane area for cell division, nutrient uptake and deformation at all cell sizes.

Colony context and size-dependent compensation mechanisms give rise to variations in nuclear growth trajectories

To investigate the fundamental question of how cellular variations arise across spatiotemporal scales in a population of identical healthy cells, we focused on nuclear growth in hiPS cell colonies as a model system. We generated a 3D timelapse dataset of thousands of nuclei over multiple days, and developed open-source tools for image and data analysis and an interactive timelapse viewer for exploring quantitative features of nuclear size and shape. We performed a data-driven analysis of nuclear growth variations across timescales. We found that individual nuclear volume growth trajectories arise from short timescale variations attributable to their spatiotemporal context within the colony. We identified a strikingly time-invariant volume compensation relationship between nuclear growth duration and starting volume across the population. Notably, we discovered that inheritance plays a crucial role in determining these two key nuclear growth features while other growth features are determined by their spatiotemporal context and are not inherited.

Mantis: high-throughput 4D imaging and analysis of the molecular and physical architecture of cells

High-throughput dynamic imaging of cells and organelles is essential for understanding complex cellular responses. We report Mantis, a high-throughput 4D microscope that integrates two complementary, gentle, live-cell imaging technologies: remote-refocus label-free microscopy and oblique light-sheet fluorescence microscopy. Additionally, we report shrimPy, an open-source software for high-throughput imaging, deconvolution, and single-cell phenotyping of 4D data. Using Mantis and shrimPy, we achieved high-content correlative imaging of molecular dynamics and the physical architecture of 20 cell lines every 15 minutes over 7.5 hours. This platform also facilitated detailed measurements of the impacts of viral infection on the architecture of host cells and host proteins. The Mantis platform can enable high-throughput profiling of intracellular dynamics, long-term imaging and analysis of cellular responses to perturbations, and live-cell optical screens to dissect gene regulatory networks.

Cellular architecture shapes the naïve T cell response

After antigen stimulation, naïve T cells display reproducible population-level responses, which arise from individual T cells pursuing specific differentiation trajectories. However, cell-intrinsic predeterminants controlling these single-cell decisions remain enigmatic. We found that the subcellular architectures of naïve CD8 T cells, defined by the presence (TØ) or absence (TO) of nuclear envelope invaginations, changed with maturation, activation, and differentiation. Upon T cell receptor (TCR) stimulation, naïve TØ cells displayed increased expression of the early-response gene Nr4a1, dependent upon heightened calcium entry. Subsequently, in vitro differentiation revealed that TØ cells generated effector-like cells more so compared with TO cells, which proliferated less and preferentially adopted a memory-precursor phenotype. These data suggest that cellular architecture may be a predeterminant of naïve CD8 T cell fate.

Anomaly detection for high-content image-based phenotypic cell profiling

High-content image-based phenotypic profiling combines automated microscopy and analysis to identify phenotypic alterations in cell morphology and provide insight into the cell's physiological state. Classical representations of the phenotypic profile can not capture the full underlying complexity in cell organization, while recent weakly machine-learning based representation-learning methods are hard to biologically interpret. We used the abundance of control wells to learn the in-distribution of control experiments and use it to formulate a self-supervised reconstruction anomaly-based representation that encodes the intricate morphological inter-feature dependencies while preserving the representation interpretability. The performance of our anomaly-based representations was evaluated for downstream tasks with respect to two classical representations across four public Cell Painting datasets. Anomaly-based representations improved reproducibility, Mechanism of Action classification, and complemented classical representations. Unsupervised explainability of autoencoder-based anomalies identified specific inter-feature dependencies causing anomalies. The general concept of anomaly-based representations can be adapted to other applications in cell biology.

Characterizing intracellular mechanics via optical tweezers-based microrheology

Intracellular organization is a highly regulated homeostatic state maintained to ensure eukaryotic cells' correct and efficient functioning. Thanks to decades of research, vast knowledge of the proteins involved in intracellular transport and organization has been acquired. However, how these influence and potentially regulate the intracellular mechanical properties of the cell is largely unknown. There is a deep knowledge gap between the understanding of cortical mechanics, which is accessible by a series of experimental tools, and the intracellular situation that has been largely neglected due to the difficulty of performing intracellular mechanics measurements. Recently, tools required for such quantitative and localized analysis of intracellular mechanics have been introduced. Here, we review how these approaches and the resulting viscoelastic models lead the way to a full mechanical description of the cytoplasm, which is instrumental for a quantitative characterization of the intracellular life of cells.

The nexus of nuclear envelope dynamics, circular economy and cancer cell pathophysiology

The nuclear envelope (NE) is a critical component in maintaining the function and structure of the eukaryotic nucleus. The NE and lamina are disassembled during each cell cycle to enable an open mitosis. Nuclear architecture construction and deconstruction is a prime example of a circular economy, as it fulfills a highly efficient recycling program bound to continuous assessment of the quality and functionality of the building blocks. Alterations in the nuclear dynamics and lamina structure have emerged as important contributors to both oncogenic transformation and cancer progression. However, the knowledge of the NE breakdown and reassembly is still limited to a fraction of participating proteins and complexes. As cancer cells contain highly diverse nuclei in terms of DNA content, but also in terms of nuclear number, size, and shape, it is of great interest to understand the intricate relationship between these nuclear features in cancer cell pathophysiology. In this review, we provide insights into how those NE dynamics are regulated, and how lamina destabilization processes may alter the NE circular economy. Moreover, we expand the knowledge of the lamina-associated domain region by using strategic algorithms, including Artificial Intelligence, to infer protein associations, assess their function and location, and predict cancer-type specificity with implications for the future of cancer diagnosis, prognosis and treatment. Using this approach we identified NUP98 and MECP2 as potential proteins that exhibit upregulation in Acute Myeloid Leukemia (LAML) patients with implications for early diagnosis.

Establishing a conceptual framework for holistic cell states and state transitions

Cell states were traditionally defined by how they looked, where they were located, and what functions they performed. In this post-genomic era, the field is largely focused on a molecular view of cell state. Moving forward, we anticipate that the observables used to define cell states will evolve again as single-cell imaging and analytics are advancing at a breakneck pace via the collection of large-scale, systematic cell image datasets and the application of quantitative image-based data science methods. This is, therefore, a key moment in the arc of cell biological research to develop approaches that integrate the spatiotemporal observables of the physical structure and organization of the cell with molecular observables toward the concept of a holistic cell state. In this perspective, we propose a conceptual framework for holistic cell states and state transitions that is data-driven, practical, and useful to enable integrative analyses and modeling across many data types.

Endogenous tagging using split mNeonGreen in human iPSCs for live imaging studies

Endogenous tags have become invaluable tools to visualize and study native proteins in live cells. However, generating human cell lines carrying endogenous tags is difficult due to the low efficiency of homology-directed repair. Recently, an engineered split mNeonGreen protein was used to generate a large-scale endogenous tag library in HEK293 cells. Using split mNeonGreen for large-scale endogenous tagging in human iPSCs would open the door to studying protein function in healthy cells and across differentiated cell types. We engineered an iPS cell line to express the large fragment of the split mNeonGreen protein (mNG21-10) and showed that it enables fast and efficient endogenous tagging of proteins with the short fragment (mNG211). We also demonstrate that neural network-based image restoration enables live imaging studies of highly dynamic cellular processes such as cytokinesis in iPSCs. This work represents the first step towards a genome-wide endogenous tag library in human stem cells.

Modeling the mechanochemical feedback for membrane-protein interactions using a continuum mesh model

The Helfrich free energy is widely used to model the generation of membrane curvature due to different physical and chemical components. The governing equations resulting from the energy minimization procedure are a system of coupled higher order partial differential equations. Simulations of membrane deformation for obtaining quantitative comparisons against experimental observations require computational schemes that will allow us to solve these equations without restrictions to axisymmetric coordinates. Here, we describe one such tool that we developed in our group based on discrete differential geometry to solve these equations along with examples.

Multiplexed 3D Analysis of Immune States and Niches in Human Tissue

Tissue homeostasis and the emergence of disease are controlled by changes in the proportions of resident and recruited cells, their organization into cellular neighbourhoods, and their interactions with acellular tissue components. Highly multiplexed tissue profiling (spatial omics)1 makes it possible to study this microenvironment in situ, usually in 4-5 micron thick sections (the standard histopathology format)2. Microscopy-based tissue profiling is commonly performed at a resolution sufficient to determine cell types but not to detect subtle morphological features associated with cytoskeletal reorganisation, juxtracrine signalling, or membrane trafficking3. Here we describe a high-resolution 3D imaging approach able to characterize a wide variety of organelles and structures at sub-micron scale while simultaneously quantifying millimetre-scale spatial features. This approach combines cyclic immunofluorescence (CyCIF) imaging4 of over 50 markers with confocal microscopy of archival human tissue thick enough (30-40 microns) to fully encompass two or more layers of intact cells. 3D imaging of entire cell volumes substantially improves the accuracy of cell phenotyping and allows cell proximity to be scored using plasma membrane apposition, not just nuclear position. In pre-invasive melanoma in situ5, precise phenotyping shows that adjacent melanocytic cells are plastic in state and participate in tightly localised niches of interferon signalling near sites of initial invasion into the underlying dermis. In this and metastatic melanoma, mature and precursor T cells engage in an unexpectedly diverse array of juxtracrine and membrane-membrane interactions as well as looser "neighbourhood" associations6 whose morphologies reveal functional states. These data provide new insight into the transitions occurring during early tumour formation and immunoediting and demonstrate the potential for phenotyping of tissues at a level of detail previously restricted to cultured cells and organoids.

BetaBuddy: An automated end-to-end computer vision pipeline for analysis of calcium fluorescence dynamics in β-cells

Insulin secretion from pancreatic β-cells is integral in maintaining the delicate equilibrium of blood glucose levels. Calcium is known to be a key regulator and triggers the release of insulin. This sub-cellular process can be monitored and tracked through live-cell imaging and subsequent cell segmentation, registration, tracking, and analysis of the calcium level in each cell. Current methods of analysis typically require the manual outlining of β-cells, involve multiple software packages, and necessitate multiple researchers-all of which tend to introduce biases. Utilizing deep learning algorithms, we have therefore created a pipeline to automatically segment and track thousands of cells, which greatly reduces the time required to gather and analyze a large number of sub-cellular images and improve accuracy. Tracking cells over a time-series image stack also allows researchers to isolate specific calcium spiking patterns and spatially identify those of interest, creating an efficient and user-friendly analysis tool. Using our automated pipeline, a previous dataset used to evaluate changes in calcium spiking activity in β-cells post-electric field stimulation was reanalyzed. Changes in spiking activity were found to be underestimated previously with manual segmentation. Moreover, the machine learning pipeline provides a powerful and rapid computational approach to examine, for example, how calcium signaling is regulated by intracellular interactions.

Orientation-invariant autoencoders learn robust representations for shape profiling of cells and organelles

Cell and organelle shape are driven by diverse genetic and environmental factors and thus accurate quantification of cellular morphology is essential to experimental cell biology. Autoencoders are a popular tool for unsupervised biological image analysis because they learn a low-dimensional representation that maps images to feature vectors to generate a semantically meaningful embedding space of morphological variation. The learned feature vectors can also be used for clustering, dimensionality reduction, outlier detection, and supervised learning problems. Shape properties do not change with orientation, and thus we argue that representation learning methods should encode this orientation invariance. We show that conventional autoencoders are sensitive to orientation, which can lead to suboptimal performance on downstream tasks. To address this, we develop O2-variational autoencoder (O2-VAE), an unsupervised method that learns robust, orientation-invariant representations. We use O2-VAE to discover morphology subgroups in segmented cells and mitochondria, detect outlier cells, and rapidly characterise cellular shape and texture in large datasets, including in a newly generated synthetic benchmark.

Understanding metric-related pitfalls in image analysis validation

Validation metrics are key for tracking scientific progress and bridging the current chasm between artificial intelligence research and its translation into practice. However, increasing evidence shows that, particularly in image analysis, metrics are often chosen inadequately. Although taking into account the individual strengths, weaknesses and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multistage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides a reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Although focused on biomedical image analysis, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. The work serves to enhance global comprehension of a key topic in image analysis validation.

Computational methods for analysing multiscale 3D genome organization

Recent progress in whole-genome mapping and imaging technologies has enabled the characterization of the spatial organization and folding of the genome in the nucleus. In parallel, advanced computational methods have been developed to leverage these mapping data to reveal multiscale three-dimensional (3D) genome features and to provide a more complete view of genome structure and its connections to genome functions such as transcription. Here, we discuss how recently developed computational tools, including machine-learning-based methods and integrative structure-modelling frameworks, have led to a systematic, multiscale delineation of the connections among different scales of 3D genome organization, genomic and epigenomic features, functional nuclear components and genome function. However, approaches that more comprehensively integrate a wide variety of genomic and imaging datasets are still needed to uncover the functional role of 3D genome structure in defining cellular phenotypes in health and disease.

Automated human induced pluripotent stem cell culture and sample preparation for 3D live-cell microscopy

To produce abundant cell culture samples to generate large, standardized image datasets of human induced pluripotent stem (hiPS) cells, we developed an automated workflow on a Hamilton STAR liquid handler system. This was developed specifically for culturing hiPS cell lines expressing fluorescently tagged proteins, which we have used to study the principles by which cells establish and maintain robust dynamic localization of cellular structures. This protocol includes all details for the maintenance, passage and seeding of cells, as well as Matrigel coating of 6-well plastic plates and 96-well optical-grade, glass plates. We also developed an automated image-based hiPS cell colony segmentation and feature extraction pipeline to streamline the process of predicting cell count and selecting wells with consistent morphology for high-resolution three-dimensional (3D) microscopy. The imaging samples produced with this protocol have been used to study the integrated intracellular organization and cell-to-cell variability of hiPS cells to train and develop deep learning-based label-free predictions from transmitted-light microscopy images and to develop deep learning-based generative models of single-cell organization. This protocol requires some experience with robotic equipment. However, we provide details and source code to facilitate implementation by biologists less experienced with robotics. The protocol is completed in less than 10 h with minimal human interaction. Overall, automation of our cell culture procedures increased our imaging samples' standardization, reproducibility, scalability and consistency. It also reduced the need for stringent culturist training and eliminated culturist-to-culturist variability, both of which were previous pain points of our original manual pipeline workflow.

Machine learning interpretable models of cell mechanics from protein images

Cellular form and function emerge from complex mechanochemical systems within the cytoplasm. Currently, no systematic strategy exists to infer large-scale physical properties of a cell from its molecular components. This is an obstacle to understanding processes such as cell adhesion and migration. Here, we develop a data-driven modeling pipeline to learn the mechanical behavior of adherent cells. We first train neural networks to predict cellular forces from images of cytoskeletal proteins. Strikingly, experimental images of a single focal adhesion (FA) protein, such as zyxin, are sufficient to predict forces and can generalize to unseen biological regimes. Using this observation, we develop two approaches-one constrained by physics and the other agnostic-to construct data-driven continuum models of cellular forces. Both reveal how cellular forces are encoded by two distinct length scales. Beyond adherent cell mechanics, our work serves as a case study for integrating neural networks into predictive models for cell biology.

Spherical harmonics analysis reveals cell shape-fate relationships in zebrafish lateral line neuromasts

Cell shape is a powerful readout of cell state, fate and function. We describe a custom workflow to perform semi-automated, 3D cell and nucleus segmentation, and spherical harmonics and principal components analysis to distill cell and nuclear shape variation into discrete biologically meaningful parameters. We apply these methods to analyze shape in the neuromast cells of the zebrafish lateral line system, finding that shapes vary with cell location and identity. The distinction between hair cells and support cells accounted for much of the variation, which allowed us to train classifiers to predict cell identity from shape features. Using transgenic markers for support cell subpopulations, we found that subtypes had different shapes from each other. To investigate how loss of a neuromast cell type altered cell shape distributions, we examined atoh1a mutants that lack hair cells. We found that mutant neuromasts lacked the cell shape phenotype associated with hair cells, but did not exhibit a mutant-specific cell shape. Our results demonstrate the utility of using 3D cell shape features to characterize, compare and classify cells in a living developing organism.

MMV_Im2Im: an open-source microscopy machine vision toolbox for image-to-image transformation

Over the past decade, deep learning (DL) research in computer vision has been growing rapidly, with many advances in DL-based image analysis methods for biomedical problems. In this work, we introduce MMV_Im2Im, a new open-source Python package for image-to-image transformation in bioimaging applications. MMV_Im2Im is designed with a generic image-to-image transformation framework that can be used for a wide range of tasks, including semantic segmentation, instance segmentation, image restoration, image generation, and so on. Our implementation takes advantage of state-of-the-art machine learning engineering techniques, allowing researchers to focus on their research without worrying about engineering details. We demonstrate the effectiveness of MMV_Im2Im on more than 10 different biomedical problems, showcasing its general potentials and applicabilities. For computational biomedical researchers, MMV_Im2Im provides a starting point for developing new biomedical image analysis or machine learning algorithms, where they can either reuse the code in this package or fork and extend this package to facilitate the development of new methods. Experimental biomedical researchers can benefit from this work by gaining a comprehensive view of the image-to-image transformation concept through diversified examples and use cases. We hope this work can give the community inspirations on how DL-based image-to-image transformation can be integrated into the assay development process, enabling new biomedical studies that cannot be done only with traditional experimental assays. To help researchers get started, we have provided source code, documentation, and tutorials for MMV_Im2Im at [https://github.com/MMV-Lab/mmv_im2im] under MIT license.

Organelle-specific phase contrast microscopy (OS-PCM) enables facile correlation study of organelles and proteins

Current methods for studying organelle and protein interactions and correlations depend on multiplex fluorescent labeling, which is experimentally complex and harmful to cells. Here we propose to solve this challenge via OS-PCM, where organelles are imaged and segmented without labels, and combined with standard fluorescence microscopy of protein distributions. In this work, we develop new neural networks to obtain unlabeled organelle, nucleus and membrane predictions from a single 2D image. Automated analysis is also implemented to obtain quantitative information regarding the spatial distribution and co-localization of both protein and organelle, as well as their relationship to the landmark structures of nucleus and membrane. Using mitochondria and DRP1 protein as a proof-of-concept, we conducted a correlation study where only DRP1 is labeled, with results consistent with prior reports utilizing multiplex labeling. Thus our work demonstrates that OS-PCM simplifies the correlation study of organelles and proteins.

Physical forces modulate interphase nuclear size

The eukaryotic nucleus exhibits remarkable plasticity in size, adjusting dynamically to changes in cellular conditions such as during development and differentiation, and across species. Traditionally, the supply of structural constituents to the nuclear envelope has been proposed as the principal determinant of nuclear size. However, recent experimental and theoretical analyses have provided an alternative perspective, which emphasizes the crucial role of physical forces such as osmotic pressure and chromatin repulsion forces in regulating nuclear size. These forces can be modulated by the molecular profiles that traverse the nuclear envelope and assemble in the macromolecular complex. This leads to a new paradigm wherein multiple nuclear macromolecules that are not limited to only the structural constituents of the nuclear envelope, are involved in the control of nuclear size and related functions.

Enablers and challenges of spatial omics, a melting pot of technologies

Spatial omics has emerged as a rapidly growing and fruitful field with hundreds of publications presenting novel methods for obtaining spatially resolved information for any omics data type on spatial scales ranging from subcellular to organismal. From a technology development perspective, spatial omics is a highly interdisciplinary field that integrates imaging and omics, spatial and molecular analyses, sequencing and mass spectrometry, and image analysis and bioinformatics. The emergence of this field has not only opened a window into spatial biology, but also created multiple novel opportunities, questions, and challenges for method developers. Here, we provide the perspective of technology developers on what makes the spatial omics field unique. After providing a brief overview of the state of the art, we discuss technological enablers and challenges and present our vision about the future applications and impact of this melting pot.

Facilitating cell segmentation with the projection-enhancement network

Contemporary approaches to instance segmentation in cell science use 2D or 3D convolutional networks depending on the experiment and data structures. However, limitations in microscopy systems or efforts to prevent phototoxicity commonly require recording sub-optimally sampled data that greatly reduces the utility of such 3D data, especially in crowded sample space with significant axial overlap between objects. In such regimes, 2D segmentations are both more reliable for cell morphology and easier to annotate. In this work, we propose the projection enhancement network (PEN), a novel convolutional module which processes the sub-sampled 3D data and produces a 2D RGB semantic compression, and is trained in conjunction with an instance segmentation network of choice to produce 2D segmentations. Our approach combines augmentation to increase cell density using a low-density cell image dataset to train PEN, and curated datasets to evaluate PEN. We show that with PEN, the learned semantic representation in CellPose encodes depth and greatly improves segmentation performance in comparison to maximum intensity projection images as input, but does not similarly aid segmentation in region-based networks like Mask-RCNN. Finally, we dissect the segmentation strength against cell density of PEN with CellPose on disseminated cells from side-by-side spheroids. We present PEN as a data-driven solution to form compressed representations of 3D data that improve 2D segmentations from instance segmentation networks.

Building the next generation of virtual cells to understand cellular biology

Cell science has made significant progress by focusing on understanding individual cellular processes through reductionist approaches. However, the sheer volume of knowledge collected presents challenges in integrating this information across different scales of space and time to comprehend cellular behaviors, as well as making the data and methods more accessible for the community to tackle complex biological questions. This perspective proposes the creation of next-generation virtual cells, which are dynamic 3D models that integrate information from diverse sources, including simulations, biophysical models, image-based models, and evidence-based knowledge graphs. These virtual cells would provide statistically accurate and holistic views of real cells, bridging the gap between theoretical concepts and experimental data, and facilitating productive new collaborations among researchers across related fields.

Cellular harmonics for the morphology-invariant analysis of molecular organization at the cell surface

The spatiotemporal organization of membrane-associated molecules is central to the regulation of cellular signals. Powerful new microscopy techniques enable the three-dimensional visualization of localization and activation of these molecules; however, the quantitative interpretation and comparison of molecular organization on the three-dimensional cell surface remains challenging because cells themselves vary greatly in morphology. Here we introduce u-signal3D, a framework to assess the spatial scales of molecular organization at the cell surface in a cell-morphology-invariant manner. We validated the framework by analyzing synthetic signaling patterns painted onto observed cell morphologies, as well as measured distributions of cytoskeletal and signaling molecules. To demonstrate the framework's versatility, we further compared the spatial organization of cell surface signals both within, and between, cell populations, and powered an upstream machine-learning-based analysis of signaling motifs.

Evaluating the role of the nuclear microenvironment in gene function by population-based modeling

The nuclear folding of chromosomes relative to nuclear bodies is an integral part of gene function. Here, we demonstrate that population-based modeling-from ensemble Hi-C data-provides a detailed description of the nuclear microenvironment of genes and its role in gene function. We define the microenvironment by the subnuclear positions of genomic regions with respect to nuclear bodies, local chromatin compaction, and preferences in chromatin compartmentalization. These structural descriptors are determined in single-cell models, thereby revealing the structural variability between cells. We demonstrate that the microenvironment of a genomic region is linked to its functional potential in gene transcription, replication, and chromatin compartmentalization. Some chromatin regions feature a strong preference for a single microenvironment, due to association with specific nuclear bodies in most cells. Other chromatin shows high structural variability, which is a strong indicator of functional heterogeneity. Moreover, we identify specialized nuclear microenvironments, which distinguish chromatin in different functional states and reveal a key role of nuclear speckles in chromosome organization. We demonstrate that our method produces highly predictive three-dimensional genome structures, which accurately reproduce data from a variety of orthogonal experiments, thus considerably expanding the range of Hi-C data analysis.

Transformative Materials to Create 3D Functional Human Tissue Models In Vitro in a Reproducible Manner

Recreating human tissues and organs in the petri dish to establish models as tools in biomedical sciences has gained momentum. These models can provide insight into mechanisms of human physiology, disease onset, and progression, and improve drug target validation, as well as the development of new medical therapeutics. Transformative materials play an important role in this evolution, as they can be programmed to direct cell behavior and fate by controlling the activity of bioactive molecules and material properties. Using nature as an inspiration, scientists are creating materials that incorporate specific biological processes observed during human organogenesis and tissue regeneration. This article presents the reader with state-of-the-art developments in the field of in vitro tissue engineering and the challenges related to the design, production, and translation of these transformative materials. Advances regarding (stem) cell sources, expansion, and differentiation, and how novel responsive materials, automated and large-scale fabrication processes, culture conditions, in situ monitoring systems, and computer simulations are required to create functional human tissue models that are relevant and efficient for drug discovery, are described. This paper illustrates how these different technologies need to converge to generate in vitro life-like human tissue models that provide a platform to answer health-based scientific questions.

Machine learning enhanced cell tracking

Quantifying cell biology in space and time requires computational methods to detect cells, measure their properties, and assemble these into meaningful trajectories. In this aspect, machine learning (ML) is having a transformational effect on bioimage analysis, now enabling robust cell detection in multidimensional image data. However, the task of cell tracking, or constructing accurate multi-generational lineages from imaging data, remains an open challenge. Most cell tracking algorithms are largely based on our prior knowledge of cell behaviors, and as such, are difficult to generalize to new and unseen cell types or datasets. Here, we propose that ML provides the framework to learn aspects of cell behavior using cell tracking as the task to be learned. We suggest that advances in representation learning, cell tracking datasets, metrics, and methods for constructing and evaluating tracking solutions can all form part of an end-to-end ML-enhanced pipeline. These developments will lead the way to new computational methods that can be used to understand complex, time-evolving biological systems.

Neural cell state shifts and fate loss in ageing and age-related diseases

Most age-related neurodegenerative diseases remain incurable owing to an incomplete understanding of the disease mechanisms. Several environmental and genetic factors contribute to disease onset, with human biological ageing being the primary risk factor. In response to acute cellular damage and external stimuli, somatic cells undergo state shifts characterized by temporal changes in their structure and function that increase their resilience, repair cellular damage, and lead to their mobilization to counteract the pathology. This basic cell biological principle also applies to human brain cells, including mature neurons that upregulate developmental features such as cell cycle markers or glycolytic reprogramming in response to stress. Although such temporary state shifts are required to sustain the function and resilience of the young human brain, excessive state shifts in the aged brain might result in terminal fate loss of neurons and glia, characterized by a permanent change in cell identity. Here, we offer a new perspective on the roles of cell states in sustaining health and counteracting disease, and we examine how cellular ageing might set the stage for pathological fate loss and neurodegeneration. A better understanding of neuronal state and fate shifts might provide the means for a controlled manipulation of cell fate to promote brain resilience and repair.

Unbiased single-cell morphology with self-supervised vision transformers

Accurately quantifying cellular morphology at scale could substantially empower existing single-cell approaches. However, measuring cell morphology remains an active field of research, which has inspired multiple computer vision algorithms over the years. Here, we show that DINO, a vision-transformer based, self-supervised algorithm, has a remarkable ability for learning rich representations of cellular morphology without manual annotations or any other type of supervision. We evaluate DINO on a wide variety of tasks across three publicly available imaging datasets of diverse specifications and biological focus. We find that DINO encodes meaningful features of cellular morphology at multiple scales, from subcellular and single-cell resolution, to multi-cellular and aggregated experimental groups. Importantly, DINO successfully uncovers a hierarchy of biological and technical factors of variation in imaging datasets. The results show that DINO can support the study of unknown biological variation, including single-cell heterogeneity and relationships between samples, making it an excellent tool for image-based biological discovery.

Multisite assessment of reproducibility in high-content cell migration imaging data

High-content image-based cell phenotyping provides fundamental insights into a broad variety of life science disciplines. Striving for accurate conclusions and meaningful impact demands high reproducibility standards, with particular relevance for high-quality open-access data sharing and meta-analysis. However, the sources and degree of biological and technical variability, and thus the reproducibility and usefulness of meta-analysis of results from live-cell microscopy, have not been systematically investigated. Here, using high-content data describing features of cell migration and morphology, we determine the sources of variability across different scales, including between laboratories, persons, experiments, technical repeats, cells, and time points. Significant technical variability occurred between laboratories and, to lesser extent, between persons, providing low value to direct meta-analysis on the data from different laboratories. However, batch effect removal markedly improved the possibility to combine image-based datasets of perturbation experiments. Thus, reproducible quantitative high-content cell image analysis of perturbation effects and meta-analysis depend on standardized procedures combined with batch correction.

Recent breakthroughs in computational structural biology harnessing the power of sequences and structures

Recent advances in computational approaches and their integration into structural biology enable tackling increasingly complex questions. Here, we discuss several key areas, highlighting breakthroughs and remaining challenges. Theoretical modeling has provided tools to accurately predict and design protein structures on a scale currently difficult to achieve using experimental approaches. Molecular Dynamics simulations have become faster and more precise, delivering actionable information inaccessible by current experimental methods. Virtual screening workflows allow a high-throughput approach to discover ligands that bind and modulate protein function, while Machine Learning methods enable the design of proteins with new functionalities. Integrative structural biology combines several of these approaches, pushing the frontiers of structural and functional characterization to ever larger systems, advancing towards a complete understanding of the living cell. These breakthroughs will accelerate and significantly impact diverse areas of science.

Systemic changes in cell size throughout the body of Drosophila melanogaster associated with mutations in molecular cell cycle regulators

Along with different life strategies, organisms have evolved dramatic cellular composition differences. Understanding the molecular basis and fitness effects of these differences is key to elucidating the fundamental characteristics of life. TOR/insulin pathways are key regulators of cell size, but whether their activity determines cell size in a systemic or tissue-specific manner awaits exploration. To that end, we measured cells in four tissues in genetically modified Drosophila melanogaster (rictor^Δ2 and Mnt¹) and corresponding controls. While rictor^Δ2 flies lacked the Rictor protein in TOR complex 2, downregulating the functions of this element in TOR/insulin pathways, Mnt¹ flies lacked the transcriptional regulator protein Mnt, weakening the suppression of downstream signalling from TOR/insulin pathways. rictor^Δ2 flies had smaller epidermal (leg and wing) and ommatidial cells and Mnt¹ flies had larger cells in these tissues than the controls. Females had consistently larger cells than males in the three tissue types. In contrast, dorsal longitudinal flight muscle cells (measured only in males) were not altered by mutations. We suggest that mutations in cell cycle control pathways drive the evolution of systemic changes in cell size throughout the body, but additional mechanisms shape the cellular composition of some tissues independent of these mutations.

Spatial subcellular organelle networks in single cells

Organelles play important roles in human health and disease, such as maintaining homeostasis, regulating growth and aging, and generating energy. Organelle diversity in cells not only exists between cell types but also between individual cells. Therefore, studying the distribution of organelles at the single-cell level is important to understand cellular function. Mesenchymal stem cells are multipotent cells that have been explored as a therapeutic method for treating a variety of diseases. Studying how organelles are structured in these cells can answer questions about their characteristics and potential. Herein, rapid multiplexed immunofluorescence (RapMIF) was performed to understand the spatial organization of 10 organelle proteins and the interactions between them in the bone marrow (BM) and umbilical cord (UC) mesenchymal stem cells (MSCs). Spatial correlations, colocalization, clustering, statistical tests, texture, and morphological analyses were conducted at the single cell level, shedding light onto the interrelations between the organelles and comparisons of the two MSC subtypes. Such analytics toolsets indicated that UC MSCs exhibited higher organelle expression and spatially spread distribution of mitochondria accompanied by several other organelles compared to BM MSCs. This data-driven single-cell approach provided by rapid subcellular proteomic imaging enables personalized stem cell therapeutics.