Data-analysis strategies for image-based cell profiling

Systematic data analysis pipeline for quantitative morphological cell phenotyping

Quantitative morphological phenotyping (QMP) is an image-based method used to capture morphological features at both the cellular and population level. Its interdisciplinary nature, spanning from data collection to result analysis and interpretation, can lead to uncertainties, particularly among those new to this actively growing field. High analytical specificity for a typical QMP is achieved through sophisticated approaches that can leverage subtle cellular morphological changes. Here, we outline a systematic workflow to refine the QMP methodology. For a practical review, we describe the main steps of a typical QMP; in each step, we discuss the available methods, their applications, advantages, and disadvantages, along with the R functions and packages for easy implementation. This review does not cover theoretical backgrounds, but provides several references for interested researchers. It aims to broaden the horizons for future phenome studies and demonstrate how to exploit years of endeavors to achieve more with less.

Decoding phenotypic screening: A comparative analysis of image representations

Biomedical imaging techniques such as high content screening (HCS) are valuable for drug discovery, but high costs limit their use to pharmaceutical companies. To address this issue, The JUMP-CP consortium released a massive open image dataset of chemical and genetic perturbations, providing a valuable resource for deep learning research. In this work, we aim to utilize the JUMP-CP dataset to develop a universal representation model for HCS data, mainly data generated using U2OS cells and CellPainting protocol, using supervised and self-supervised learning approaches. We propose an evaluation protocol that assesses their performance on mode of action and property prediction tasks using a popular phenotypic screening dataset. Results show that the self-supervised approach that uses data from multiple consortium partners provides representation that is more robust to batch effects whilst simultaneously achieving performance on par with standard approaches. Together with other conclusions, it provides recommendations on the training strategy of a representation model for HCS images.

Single-detector multiplex imaging flow cytometry for cancer cell classification with deep learning

Imaging flow cytometry, which combines the advantages of flow cytometry and microscopy, has emerged as a powerful tool for cell analysis in various biomedical fields such as cancer detection. In this study, we develop multiplex imaging flow cytometry (mIFC) by employing a spatial wavelength division multiplexing technique. Our mIFC can simultaneously obtain brightfield and multi-color fluorescence images of individual cells in flow, which are excited by a metal halide lamp and measured by a single detector. Statistical analysis results of multiplex imaging experiments with resolution test lens, magnification test lens, and fluorescent microspheres validate the operation of the mIFC with good imaging channel consistency and micron-scale differentiation capabilities. A deep learning method is designed for multiplex image processing that consists of three deep learning networks (U-net, very deep super resolution, and visual geometry group 19). It is demonstrated that the cluster of differentiation 24 (CD24) imaging channel is more sensitive than the brightfield, nucleus, or cancer antigen 125 (CA125) imaging channel in classifying the three types of ovarian cell lines (IOSE80 normal cell, A2780, and OVCAR3 cancer cells). An average accuracy rate of 97.1% is achieved for the classification of these three types of cells by deep learning analysis when all four imaging channels are considered. Our single-detector mIFC is promising for the development of future imaging flow cytometers and for the automatic single-cell analysis with deep learning in various biomedical fields.

Evaluating batch correction methods for image-based cell profiling

High-throughput image-based profiling platforms are powerful technologies capable of collecting data from billions of cells exposed to thousands of perturbations in a time- and cost-effective manner. Therefore, image-based profiling data has been increasingly used for diverse biological applications, such as predicting drug mechanism of action or gene function. However, batch effects severely limit community-wide efforts to integrate and interpret image-based profiling data collected across different laboratories and equipment. To address this problem, we benchmark ten high-performing single-cell RNA sequencing (scRNA-seq) batch correction techniques, representing diverse approaches, using a newly released Cell Painting dataset, JUMP. We focus on five scenarios with varying complexity, ranging from batches prepared in a single lab over time to batches imaged using different microscopes in multiple labs. We find that Harmony and Seurat RPCA are noteworthy, consistently ranking among the top three methods for all tested scenarios while maintaining computational efficiency. Our proposed framework, benchmark, and metrics can be used to assess new batch correction methods in the future. This work paves the way for improvements that enable the community to make the best use of public Cell Painting data for scientific discovery.

Information-Distilled Generative Label-Free Morphological Profiling Encodes Cellular Heterogeneity

Image-based cytometry faces challenges due to technical variations arising from different experimental batches and conditions, such as differences in instrument configurations or image acquisition protocols, impeding genuine biological interpretation of cell morphology. Existing solutions, often necessitating extensive pre-existing data knowledge or control samples across batches, have proved limited, especially with complex cell image data. To overcome this, "Cyto-Morphology Adversarial Distillation" (CytoMAD), a self-supervised multi-task learning strategy that distills biologically relevant cellular morphological information from batch variations, is introduced to enable integrated analysis across multiple data batches without complex data assumptions or extensive manual annotation. Unique to CytoMAD is its "morphology distillation", symbiotically paired with deep-learning image-contrast translation-offering additional interpretable insights into label-free cell morphology. The versatile efficacy of CytoMAD is demonstrated in augmenting the power of biophysical imaging cytometry. It allows integrated label-free classification of human lung cancer cell types and accurately recapitulates their progressive drug responses, even when trained without the drug concentration information. CytoMAD  also allows joint analysis of tumor biophysical cellular heterogeneity, linked to epithelial-mesenchymal plasticity, that standard fluorescence markers overlook. CytoMAD can substantiate the wide adoption of biophysical cytometry for cost-effective diagnosis and screening.

Artificial intelligence for high content imaging in drug discovery

Artificial intelligence (AI) and high-content imaging (HCI) are contributing to advancements in drug discovery, propelled by the recent progress in deep neural networks. This review highlights AI's role in analysis of HCI data from fixed and live-cell imaging, enabling novel label-free and multi-channel fluorescent screening methods, and improving compound profiling. HCI experiments are rapid and cost-effective, facilitating large data set accumulation for AI model training. However, the success of AI in drug discovery also depends on high-quality data, reproducible experiments, and robust validation to ensure model performance. Despite challenges like the need for annotated compounds and managing vast image data, AI's potential in phenotypic screening and drug profiling is significant. Future improvements in AI, including increased interpretability and integration of multiple modalities, are expected to solidify AI and HCI's role in drug discovery.

A Saturation Artifacts Inpainting Method Based on Two-Stage GAN for Fluorescence Microscope Images

Fluorescence microscopic images of cells contain a large number of morphological features that are used as an unbiased source of quantitative information about cell status, through which researchers can extract quantitative information about cells and study the biological phenomena of cells through statistical and analytical analysis. As an important research object of phenotypic analysis, images have a great influence on the research results. Saturation artifacts present in the image result in a loss of grayscale information that does not reveal the true value of fluorescence intensity. From the perspective of data post-processing, we propose a two-stage cell image recovery model based on a generative adversarial network to solve the problem of phenotypic feature loss caused by saturation artifacts. The model is capable of restoring large areas of missing phenotypic features. In the experiment, we adopt the strategy of progressive restoration to improve the robustness of the training effect and add the contextual attention structure to enhance the stability of the restoration effect. We hope to use deep learning methods to mitigate the effects of saturation artifacts to reveal how chemical, genetic, and environmental factors affect cell state, providing an effective tool for studying the field of biological variability and improving image quality in analysis.

Pancreatic cancer organoid-screening captures personalized sensitivity and chemoresistance suppression upon cytochrome P450 3A5-targeted inhibition

Cytochrome P450 3A5 (CYP3A5) has been proposed as a predictor of therapy response in subtypes of pancreatic ductal adenocarcinoma cancer (PDAC). To validate CYP3A5 as a therapeutic target, we developed a high-content image organoid-based screen to quantify the phenotypic responses to the selective inhibition of CYP3A5 enzymatic activity by clobetasol propionate (CBZ), using a cohort of PDAC-derived organoids (PDACOs). The chemoresistance of PDACOs to a panel of standard-of-care drugs, alone or in combination with CBZ, was investigated. PDACO pharmaco-profiling revealed CBZ to have anti-cancer activity that was dependent on the CYP3A5 level. In addition, CBZ restored chemo-vulnerability to cisplatin in a subset of PDACOs. A correlative proteomic analysis established that CBZ caused the suppression of multiple cancer pathways sustained by or associated with a mutant form of p53. Limiting the active pool of CYP3A5 enables targeted and personalized therapy to suppress pro-oncogenic mechanisms that fuel chemoresistance in some PDAC tumors.

Unleashing the potential of cell painting assays for compound activities and hazards prediction

The cell painting (CP) assay has emerged as a potent imaging-based high-throughput phenotypic profiling (HTPP) tool that provides comprehensive input data for in silico prediction of compound activities and potential hazards in drug discovery and toxicology. CP enables the rapid, multiplexed investigation of various molecular mechanisms for thousands of compounds at the single-cell level. The resulting large volumes of image data provide great opportunities but also pose challenges to image and data analysis routines as well as property prediction models. This review addresses the integration of CP-based phenotypic data together with or in substitute of structural information from compounds into machine (ML) and deep learning (DL) models to predict compound activities for various human-relevant disease endpoints and to identify the underlying modes-of-action (MoA) while avoiding unnecessary animal testing. The successful application of CP in combination with powerful ML/DL models promises further advances in understanding compound responses of cells guiding therapeutic development and risk assessment. Therefore, this review highlights the importance of unlocking the potential of CP assays when combined with molecular fingerprints for compound evaluation and discusses the current challenges that are associated with this approach.

Distinct profile of antiviral drugs effects in aortic and pulmonary endothelial cells revealed by high-content microscopy and cell painting assays

Antiretroviral therapy have significantly improved the treatment of viral infections and reduced the associated mortality and morbidity rates. However, highly effective antiretroviral therapy (HAART) may lead to an increased risk of cardiovascular diseases, which could be related to endothelial toxicity. Here, seven antiviral drugs (remdesivir, PF-00835231, ritonavir, lopinavir, efavirenz, zidovudine and abacavir) were characterized against aortic (HAEC) and pulmonary (hLMVEC) endothelial cells, using high-content microscopy. The colourimetric study (MTS test) revealed similar toxicity profiles of all antiviral drugs tested in the concentration range of 1 nM-50 μM in aortic and pulmonary endothelial cells. Conversely, the drugs' effects on morphological parameters were more pronounced in HAECs as compared with hLMVECs. Based on the antiviral drugs' effects on the cytoplasmic and nuclei architecture (analyzed by multiple pre-defined parameters including SER texture and STAR morphology), the studied compounds were classified into five distinct morphological subgroups, each linked to a specific cellular response profile. In relation to morphological subgroup classification, antiviral drugs induced a loss of mitochondrial membrane potential, elevated ROS, changed lipid droplets/lysosomal content, decreased von Willebrand factor expression and micronuclei formation or dysregulated cellular autophagy. In conclusion, based on specific changes in endothelial cytoplasm, nuclei and subcellular morphology, the distinct endothelial response was identified for remdesivir, ritonavir, lopinavir, efavirenz, zidovudine and abacavir treatments. The effects detected in aortic endothelial cells were not detected in pulmonary endothelial cells. Taken together, high-content microscopy has proven to be a robust and informative method for endothelial drug profiling that may prove useful in predicting the organ-specific endothelial toxicity of various drugs.

Spatial Dissection of the Immune Landscape of Solid Tumors to Advance Precision Medicine

Chemotherapeutics, radiation, targeted therapeutics, and immunotherapeutics each demonstrate clinical benefits for a small subset of patients with solid malignancies. Immune cells infiltrating the tumor and the surrounding stroma play a critical role in shaping cancer progression and modulating therapy response. They do this by interacting with the other cellular and molecular components of the tumor microenvironment. Spatial multi-omics technologies are rapidly evolving. Currently, such technologies allow high-throughput RNA and protein profiling and retain geographical information about the tumor microenvironment cellular architecture and the functional phenotype of tumor, immune, and stromal cells. An in-depth spatial characterization of the heterogeneous tumor immune landscape can improve not only the prognosis but also the prediction of therapy response, directing cancer patients to more tailored and efficacious treatments. This review highlights recent advancements in spatial transcriptomics and proteomics profiling technologies and the ways these technologies are being applied for the dissection of the immune cell composition in solid malignancies in order to further both basic research in oncology and the implementation of precision treatments in the clinic.

Reproducible image-based profiling with Pycytominer

Advances in high-throughput microscopy have enabled the rapid acquisition of large numbers of high-content microscopy images. Whether by deep learning or classical algorithms, image analysis pipelines then produce single-cell features. To process these single-cells for downstream applications, we present Pycytominer, a user-friendly, open-source python package that implements the bioinformatics steps, known as "image-based profiling". We demonstrate Pycytominer's usefulness in a machine learning project to predict nuisance compounds that cause undesirable cell injuries.

Mesoscale standing wave imaging

Standing wave (SW) microscopy is a method that uses an interference pattern to excite fluorescence from labelled cellular structures and produces high-resolution images of three-dimensional objects in a two-dimensional dataset. SW microscopy is performed with high-magnification, high-numerical aperture objective lenses, and while this results in high-resolution images, the field of view is very small. Here we report upscaling of this interference imaging method from the microscale to the mesoscale using the Mesolens, which has the unusual combination of a low-magnification and high-numerical aperture. With this method, we produce SW images within a field of view of 4.4 mm × 3.0 mm that can readily accommodate over 16,000 cells in a single dataset. We demonstrate the method using both single-wavelength excitation and the multi-wavelength SW method TartanSW. We show application of the method for imaging of fixed and living cells specimens, with the first application of SW imaging to study cells under flow conditions.

Made to measure: An introduction to quantifying microscopy data in the life sciences

Images are at the core of most modern biological experiments and are used as a major source of quantitative information. Numerous algorithms are available to process images and make them more amenable to be measured. Yet the nature of the quantitative output that is useful for a given biological experiment is uniquely dependent upon the question being investigated. Here, we discuss the 3 main types of information that can be extracted from microscopy data: intensity, morphology, and object counts or categorical labels. For each, we describe where they come from, how they can be measured, and what may affect the relevance of these measurements in downstream data analysis. Acknowledging that what makes a measurement 'good' is ultimately down to the biological question being investigated, this review aims at providing readers with a toolkit to challenge how they quantify their own data and be critical of conclusions drawn from quantitative bioimage analysis experiments.

Connecting metabolome and phenotype: recent advances in functional metabolomics tools for the identification of bioactive natural products

Covering: 1995 to 2023Advances in bioanalytical methods, particularly mass spectrometry, have provided valuable molecular insights into the mechanisms of life. Non-targeted metabolomics aims to detect and (relatively) quantify all observable small molecules present in a biological system. By comparing small molecule abundances between different conditions or timepoints in a biological system, researchers can generate new hypotheses and begin to understand causes of observed phenotypes. Functional metabolomics aims to investigate the functional roles of metabolites at the scale of the metabolome. However, most functional metabolomics studies rely on indirect measurements and correlation analyses, which leads to ambiguity in the precise definition of functional metabolomics. In contrast, the field of natural products has a history of identifying the structures and bioactivities of primary and specialized metabolites. Here, we propose to expand and reframe functional metabolomics by integrating concepts from the fields of natural products and chemical biology. We highlight emerging functional metabolomics approaches that shift the focus from correlation to physical interactions, and we discuss how this allows researchers to uncover causal relationships between molecules and phenotypes.

How scanning probe microscopy can be supported by artificial intelligence and quantum computing?

The impact of Artificial Intelligence (AI) is rapidly expanding, revolutionizing both science and society. It is applied to practically all areas of life, science, and technology, including materials science, which continuously requires novel tools for effective materials characterization. One of the widely used techniques is scanning probe microscopy (SPM). SPM has fundamentally changed materials engineering, biology, and chemistry by providing tools for atomic-precision surface mapping. Despite its many advantages, it also has some drawbacks, such as long scanning times or the possibility of damaging soft-surface materials. In this paper, we focus on the potential for supporting SPM-based measurements, with an emphasis on the application of AI-based algorithms, especially Machine Learning-based algorithms, as well as quantum computing (QC). It has been found that AI can be helpful in automating experimental processes in routine operations, algorithmically searching for optimal sample regions, and elucidating structure-property relationships. Thus, it contributes to increasing the efficiency and accuracy of optical nanoscopy scanning probes. Moreover, the combination of AI-based algorithms and QC may have enormous potential to enhance the practical application of SPM. The limitations of the AI-QC-based approach were also discussed. Finally, we outline a research path for improving AI-QC-powered SPM. RESEARCH HIGHLIGHTS: Artificial intelligence and quantum computing as support for scanning probe microscopy. The analysis indicates a research gap in the field of scanning probe microscopy. The research aims to shed light into ai-qc-powered scanning probe microscopy.

Anomaly detection for high-content image-based phenotypic cell profiling

High-content image-based phenotypic profiling combines automated microscopy and analysis to identify phenotypic alterations in cell morphology and provide insight into the cell's physiological state. Classical representations of the phenotypic profile can not capture the full underlying complexity in cell organization, while recent weakly machine-learning based representation-learning methods are hard to biologically interpret. We used the abundance of control wells to learn the in-distribution of control experiments and use it to formulate a self-supervised reconstruction anomaly-based representation that encodes the intricate morphological inter-feature dependencies while preserving the representation interpretability. The performance of our anomaly-based representations was evaluated for downstream tasks with respect to two classical representations across four public Cell Painting datasets. Anomaly-based representations improved reproducibility, Mechanism of Action classification, and complemented classical representations. Unsupervised explainability of autoencoder-based anomalies identified specific inter-feature dependencies causing anomalies. The general concept of anomaly-based representations can be adapted to other applications in cell biology.

Three million images and morphological profiles of cells treated with matched chemical and genetic perturbations

The identification of genetic and chemical perturbations with similar impacts on cell morphology can elucidate compounds' mechanisms of action or novel regulators of genetic pathways. Research on methods for identifying such similarities has lagged due to a lack of carefully designed and well-annotated image sets of cells treated with chemical and genetic perturbations. Here we create such a Resource dataset, CPJUMP1, in which each perturbed gene's product is a known target of at least two chemical compounds in the dataset. We systematically explore the directionality of correlations among perturbations that target the same protein encoded by a given gene, and we find that identifying matches between chemical and genetic perturbations is a challenging task. Our dataset and baseline analyses provide a benchmark for evaluating methods that measure perturbation similarities and impact, and more generally, learn effective representations of cellular state from microscopy images. Such advancements would accelerate the applications of image-based profiling of cellular states, such as uncovering drug mode of action or probing functional genomics.

A spatial architecture-embedding HLA signature to predict clinical response to immunotherapy in renal cell carcinoma

An important challenge in the real-world management of patients with advanced clear-cell renal cell carcinoma (aRCC) is determining who might benefit from immune checkpoint blockade (ICB). Here we performed a comprehensive multiomics mapping of aRCC in the context of ICB treatment, involving discovery analyses in a real-world data cohort followed by validation in independent cohorts. We cross-connected bulk-tumor transcriptomes across >1,000 patients with validations at single-cell and spatial resolutions, revealing a patient-specific crosstalk between proinflammatory tumor-associated macrophages and (pre-)exhausted CD8+ T cells that was distinguished by a human leukocyte antigen repertoire with higher preference for tumoral neoantigens. A cross-omics machine learning pipeline helped derive a new tumor transcriptomic footprint of neoantigen-favoring human leukocyte antigen alleles. This machine learning signature correlated with positive outcome following ICB treatment in both real-world data and independent clinical cohorts. In experiments using the RENCA-tumor mouse model, CD40 agonism combined with PD1 blockade potentiated both proinflammatory tumor-associated macrophages and CD8+ T cells, thereby achieving maximal antitumor efficacy relative to other tested regimens. Thus, we present a new multiomics and spatial map of the immune-community architecture that drives ICB response in patients with aRCC.

Advancing materials science through next-generation machine learning

For over a decade, machine learning (ML) models have been making strides in computer vision and natural language processing (NLP), demonstrating high proficiency in specialized tasks. The emergence of large-scale language and generative image models, such as ChatGPT and Stable Diffusion, has significantly broadened the accessibility and application scope of these technologies. Traditional predictive models are typically constrained to mapping input data to numerical values or predefined categories, limiting their usefulness beyond their designated tasks. In contrast, contemporary models employ representation learning and generative modeling, enabling them to extract and encode key insights from a wide variety of data sources and decode them to create novel responses for desired goals. They can interpret queries phrased in natural language to deduce the intended output. In parallel, the application of ML techniques in materials science has advanced considerably, particularly in areas like inverse design, material prediction, and atomic modeling. Despite these advancements, the current models are overly specialized, hindering their potential to supplant established industrial processes. Materials science, therefore, necessitates the creation of a comprehensive, versatile model capable of interpreting human-readable inputs, intuiting a wide range of possible search directions, and delivering precise solutions. To realize such a model, the field must adopt cutting-edge representation, generative, and foundation model techniques tailored to materials science. A pivotal component in this endeavor is the establishment of an extensive, centralized dataset encompassing a broad spectrum of research topics. This dataset could be assembled by crowdsourcing global research contributions and developing models to extract data from existing literature and represent them in a homogenous format. A massive dataset can be used to train a central model that learns the underlying physics of the target areas, which can then be connected to a variety of specialized downstream tasks. Ultimately, the envisioned model would empower users to intuitively pose queries for a wide array of desired outcomes. It would facilitate the search for existing data that closely matches the sought-after solutions and leverage its understanding of physics and material-behavior relationships to innovate new solutions when pre-existing ones fall short.

Morphological profiling for drug discovery in the era of deep learning

Morphological profiling is a valuable tool in phenotypic drug discovery. The advent of high-throughput automated imaging has enabled the capturing of a wide range of morphological features of cells or organisms in response to perturbations at the single-cell resolution. Concurrently, significant advances in machine learning and deep learning, especially in computer vision, have led to substantial improvements in analyzing large-scale high-content images at high throughput. These efforts have facilitated understanding of compound mechanism of action, drug repurposing, characterization of cell morphodynamics under perturbation, and ultimately contributing to the development of novel therapeutics. In this review, we provide a comprehensive overview of the recent advances in the field of morphological profiling. We summarize the image profiling analysis workflow, survey a broad spectrum of analysis strategies encompassing feature engineering- and deep learning-based approaches, and introduce publicly available benchmark datasets. We place a particular emphasis on the application of deep learning in this pipeline, covering cell segmentation, image representation learning, and multimodal learning. Additionally, we illuminate the application of morphological profiling in phenotypic drug discovery and highlight potential challenges and opportunities in this field.

Nucleus-forming jumbophage PhiKZ therapeutically outcompetes non-nucleus-forming jumbophage Callisto

With the recent resurgence of phage therapy in modern medicine, jumbophages are currently under the spotlight due to their numerous advantages as anti-infective agents. However, most significant discoveries to date have primarily focused on nucleus-forming jumbophages, not their non-nucleus-forming counterparts. In this study, we compare the biological characteristics exhibited by two genetically diverse jumbophages: 1) the well-studied nucleus-forming jumbophage, PhiKZ; and 2) the newly discovered non-nucleus-forming jumbophage, Callisto. Single-cell infection studies further show that Callisto possesses different replication machinery, resulting in a delay in phage maturation compared to that of PhiKZ. The therapeutic potency of both phages was examined in vitro and in vivo, demonstrating that PhiKZ holds certain superior characteristics over Callisto. This research sheds light on the importance of the subcellular infection machinery and the organized progeny maturation process, which could potentially provide valuable insight in the future development of jumbophage-based therapeutics.

Genome-scale requirements for dynein-based transport revealed by a high-content arrayed CRISPR screen

The microtubule motor dynein plays a key role in cellular organization. However, little is known about how dynein's biosynthesis, assembly, and functional diversity are orchestrated. To address this issue, we have conducted an arrayed CRISPR loss-of-function screen in human cells using the distribution of dynein-tethered peroxisomes and early endosomes as readouts. From a genome-wide gRNA library, 195 validated hits were recovered and parsed into those impacting multiple dynein cargoes and those whose effects are restricted to a subset of cargoes. Clustering of high-dimensional phenotypic fingerprints revealed co-functional proteins involved in many cellular processes, including several candidate novel regulators of core dynein functions. Further analysis of one of these factors, the RNA-binding protein SUGP1, indicates that it promotes cargo trafficking by sustaining functional expression of the dynein activator LIS1. Our data represent a rich source of new hypotheses for investigating microtubule-based transport, as well as several other aspects of cellular organization captured by our high-content imaging.

Applying Cell Painting in Non-Tumorigenic Breast Cells to Understand Impacts of Common Chemical Exposures

There are a substantial number of chemicals to which individuals in the general population are exposed which have putative, but still poorly understood, links to breast cancer. Cell Painting is a high-content imaging-based in vitro assay that allows for rapid and unbiased measurements of the concentration-dependent effects of chemical exposures on cellular morphology. We optimized the Cell Painting assay and measured the effect of exposure to 16 human exposure relevant chemicals, along with 21 small molecules with known mechanisms of action, for 48 hours in non-tumorigenic mammary epithelial cells, the MCF10A cell line. Through unbiased imaging analyses using CellProfiler, we quantified 3042 morphological features across approximately 1.2 million cells. We used benchmark concentration modeling to quantify significance and dose-dependent directionality to identify morphological features conserved across chemicals and find features that differentiate the effects of toxicants from one another. Benchmark concentrations were compared to chemical exposure biomarker concentration measurements from the National Health and Nutrition Examination Survey to assess which chemicals induce morphological alterations at human-relevant concentrations. Morphometric fingerprint analysis revealed similar phenotypes between small molecules and prioritized NHANES-toxicants guiding further investigation. A comparison of feature fingerprints via hypergeometric analysis revealed significant feature overlaps between chemicals when stratified by compartment and stain. One such example was the similarities between a metabolite of the organochlorine pesticide DDT (p,p'-DDE) and an activator of canonical Wnt signaling CHIR99201. As CHIR99201 is a known Wnt pathway activator and its role in β-catenin translocation is well studied, we studied the translocation of β-catenin following p'-p' DDE exposure in an orthogonal high-content imaging assay. Consistent with activation of Wnt signaling, low dose p',p'-DDE (25nM) significantly enhances the nuclear translocation of β-catenin. Overall, these findings highlight the ability of Cell Painting to enhance mode-of-action studies for toxicants which are common exposures in our environment but have previously been incompletely characterized with respect to breast cancer risk.

Machine learning aided single cell image analysis improves understanding of morphometric heterogeneity of human mesenchymal stem cells

The multipotent stem cells of our body have been largely harnessed in biotherapeutics. However, as they are derived from multiple anatomical sources, from different tissues, human mesenchymal stem cells (hMSCs) are a heterogeneous population showing ambiguity in their in vitro behavior. Intra-clonal population heterogeneity has also been identified and pre-clinical mechanistic studies suggest that these cumulatively depreciate the therapeutic effects of hMSC transplantation. Although various biomarkers identify these specific stem cell populations, recent artificial intelligence-based methods have capitalized on the cellular morphologies of hMSCs, opening a new approach to understand their attributes. A robust and rapid platform is required to accommodate and eliminate the heterogeneity observed in the cell population, to standardize the quality of hMSC therapeutics globally. Here, we report our primary findings of morphological heterogeneity observed within and across two sources of hMSCs namely, stem cells from human exfoliated deciduous teeth (SHEDs) and human Wharton jelly mesenchymal stem cells (hWJ MSCs), using real-time single-cell images generated on immunophenotyping by imaging flow cytometry (IFC). We used the ImageJ software for identification and comparison between the two types of hMSCs using statistically significant morphometric descriptors that are biologically relevant. To expand on these insights, we have further applied deep learning methods and successfully report the development of a Convolutional Neural Network-based image classifier. In our research, we introduced a machine learning methodology to streamline the entire procedure, utilizing convolutional neural networks and transfer learning for binary classification, achieving an accuracy rate of 97.54%. We have also critically discussed the challenges, comparisons between solutions and future directions of machine learning in hMSC classification in biotherapeutics.

Image-based profiling and deep learning reveal morphological heterogeneity of colorectal cancer organoids

Patient-derived organoids have proven to be a highly relevant model for evaluating of disease mechanisms and drug efficacies, as they closely recapitulate in vivo physiology. Colorectal cancer organoids, specifically, exhibit a diverse range of morphologies, which have been analyzed with image-based profiling. However, the relationship between morphological subtypes and functional parameters of the organoids remains underexplored. Here, we identified two distinct morphological subtypes ("cystic" and "solid") across 31360 bright field images using image-based profiling, which correlated differently with viability and apoptosis level of colorectal cancer organoids. Leveraging object detection neural networks, we were able to categorize single organoids achieving higher viability scores as "cystic" than "solid" subtype. Furthermore, a deep generative model was proposed to predict apoptosis intensity based on a apoptosis-featured dataset encompassing over 17000 bright field and matched fluorescent images. Notably, a significant correlation of 0.91 between the predicted value and ground truth was achived, underscoring the feasibility of this generative model as a potential means for assessing organoid functional parameters. The underlying cellular heterogeneity of the organoids, i.e., conserved colonic cell types and rare immune components, was also verified with scRNA sequencing, implying a compromised tumor microenvironment. Additionally, the "cystic" subtype was identified as a relapse phenotype featuring intestinal stem cell signatures, suggesting that this visually discernible relapse phenotype shows potential as a novel biomarker for colorectal cancer diagnosis and prognosis. In summary, our findings demonstrate that the morphological heterogeneity of colorectal cancer organoids explicitly recapitulate the association of phenotypic features and exogenous perturbations through the image-based profiling, providing new insights into disease mechanisms.

Development of an Automated Morphometric Approach to Assess Vascular Outcomes following Exposure to Environmental Chemicals in Zebrafish

BACKGROUND

Disruptions in vascular formation attributable to chemical insults is a pivotal risk factor or potential etiology of developmental defects and various disease settings. Among the thousands of chemicals threatening human health, the highly concerning groups prevalent in the environment and detected in biological monitoring in the general population ought to be prioritized because of their high exposure risks. However, the impacts of a large number of environmental chemicals on vasculature are far from understood. The angioarchitecture complexity and technical limitations make it challenging to analyze the entire vasculature efficiently and identify subtle changes through a high-throughput in vivo assay.

OBJECTIVES

We aimed to develop an automated morphometric approach for the vascular profile and assess the vascular morphology of health-concerning environmental chemicals.

METHODS

High-resolution images of the entire vasculature in Tg(fli1a:eGFP) zebrafish were collected using a high-content imaging platform. We established a deep learning-based quantitative framework, ECA-ResXUnet, combined with MATLAB to segment the vascular networks and extract features. Vessel scores based on the rates of morphological changes were calculated to rank vascular toxicity. Potential biomarkers were identified by vessel-endothelium-gene-disease integrative analysis.

RESULTS

Whole-trunk blood vessels and the cerebral vasculature in larvae exposed to 150 representative chemicals were automatically segmented as comparable to human-level accuracy, with sensitivity and specificity of 95.56% and 95.81%, respectively. Chemical treatments led to heterogeneous vascular patterns manifested by 31 architecture indexes, and the common cardinal vein (CCV) was the most affected vessel. The antipsychotic medicine haloperidol, flame retardant 2,2-bis(chloromethyl)trimethylenebis[bis(2-chloroethyl) phosphate], and tert-butylphenyl diphenyl phosphate ranked as the top three in vessel scores. Pesticides accounted for the largest group, with a vessel score of ≥ 1 , characterized by a remarkable inhibition of subintestinal venous plexus and delayed development of CCV. Multiple-concentration evaluation of nine per- and polyfluoroalkyl substances (PFAS) indicated a low-concentration effect on vascular impairment and a positive association between carbon chain length and benchmark concentration. Target vessel-directed single-cell RNA sequencing of f l i 1 a + cells from larvae treated with λ -cyhalothrin , perfluorohexanesulfonic acid, or benzylbutyl phthalate, along with vessel-endothelium-gene-disease integrative analysis, uncovered potential associations with vascular disorders and identified biomarker candidates.

DISCUSSION

This study provides a novel paradigm for phenotype-driven screenings of vascular-disrupting chemicals by converging morphological and transcriptomic profiles at a high-resolution level, serving as a powerful tool for large-scale toxicity tests. Our approach and the high-quality morphometric data facilitate the precise evaluation of vascular effects caused by environmental chemicals. https://doi.org/10.1289/EHP13214.

CLANet: A comprehensive framework for cross-batch cell line identification using brightfield images

Cell line authentication plays a crucial role in the biomedical field, ensuring researchers work with accurately identified cells. Supervised deep learning has made remarkable strides in cell line identification by studying cell morphological features through cell imaging. However, biological batch (bio-batch) effects, a significant issue stemming from the different times at which data is generated, lead to substantial shifts in the underlying data distribution, thus complicating reliable differentiation between cell lines from distinct batch cultures. To address this challenge, we introduce CLANet, a pioneering framework for cross-batch cell line identification using brightfield images, specifically designed to tackle three distinct bio-batch effects. We propose a cell cluster-level selection method to efficiently capture cell density variations, and a self-supervised learning strategy to manage image quality variations, thus producing reliable patch representations. Additionally, we adopt multiple instance learning(MIL) for effective aggregation of instance-level features for cell line identification. Our innovative time-series segment sampling module further enhances MIL's feature-learning capabilities, mitigating biases from varying incubation times across batches. We validate CLANet using data from 32 cell lines across 93 experimental bio-batches from the AstraZeneca Global Cell Bank. Our results show that CLANet outperforms related approaches (e.g. domain adaptation, MIL), demonstrating its effectiveness in addressing bio-batch effects in cell line identification.

PI3K/mTOR inhibition induces tumour microenvironment remodelling and sensitises pS6high uterine leiomyosarcoma to PD-1 blockade

BACKGROUND

Uterine leiomyosarcomas (uLMS) are aggressive tumours with poor prognosis and limited treatment options. Although immune checkpoint blockade (ICB) has proven effective in some 'challenging-to-treat' cancers, clinical trials showed that uLMS do not respond to ICB. Emerging evidence suggests that aberrant PI3K/mTOR signalling can drive resistance to ICB. We therefore explored the relevance of the PI3K/mTOR pathway for ICB treatment in uLMS and explored pharmacological inhibition of this pathway to sensitise these tumours to ICB.

METHODS

We performed an integrated multiomics analysis based on TCGA data to explore the correlation between PI3K/mTOR dysregulation and immune infiltration in 101 LMS. We assessed response to PI3K/mTOR inhibitors in immunodeficient and humanized uLMS patient-derived xenografts (PDXs) by evaluating tumour microenvironment modulation using multiplex immunofluorescence. We explored response to single-agent and a combination of PI3K/mTOR inhibitors with PD-1 blockade in humanized uLMS PDXs. We mapped intratumoural dynamics using single-cell RNA/TCR sequencing of serially collected biopsies.

RESULTS

PI3K/mTOR over-activation (pS6high) associated with lymphocyte depletion and wound healing immune landscapes in (u)LMS, suggesting it contributes to immune evasion. In contrast, PI3K/mTOR inhibition induced profound tumour microenvironment remodelling in an ICB-resistant humanized uLMS PDX model, fostering adaptive anti-tumour immune responses. Indeed, PI3K/mTOR inhibition induced macrophage repolarisation towards an anti-tumourigenic phenotype and increased antigen presentation on dendritic and tumour cells, but also promoted infiltration of PD-1+ T cells displaying an exhausted phenotype. When combined with anti-PD-1, PI3K/mTOR inhibition led to partial or complete tumour responses, whereas no response to single-agent anti-PD-1 was observed. Combination therapy reinvigorated exhausted T cells and induced clonal hyper-expansion of a cytotoxic CD8+ T-cell population supported by a CD4+ Th1 niche.

CONCLUSIONS

Our findings indicate that aberrant PI3K/mTOR pathway activation contributes to immune escape in uLMS and provides a rationale for combining PI3K/mTOR inhibition with ICB for the treatment of this patient population.

An autophagy program that promotes T cell egress from the lymph node controls responses to immune checkpoint blockade

Lymphatic endothelial cells (LECs) of the lymph node (LN) parenchyma orchestrate leukocyte trafficking and peripheral T cell dynamics. T cell responses to immunotherapy largely rely on peripheral T cell recruitment in tumors. Yet, a systematic and molecular understanding of how LECs within the LNs control T cell dynamics under steady-state and tumor-bearing conditions is lacking. Intravital imaging combined with immune phenotyping shows that LEC-specific deletion of the essential autophagy gene Atg5 alters intranodal positioning of lymphocytes and accrues their persistence in the LNs by increasing the availability of the main egress signal sphingosine-1-phosphate. Single-cell RNA sequencing of tumor-draining LNs shows that loss of ATG5 remodels niche-specific LEC phenotypes involved in molecular pathways regulating lymphocyte trafficking and LEC-T cell interactions. Functionally, loss of LEC autophagy prevents recruitment of tumor-infiltrating T and natural killer cells and abrogates response to immunotherapy. Thus, an LEC-autophagy program boosts immune-checkpoint responses by guiding systemic T cell dynamics.

Enhancing the Small-Scale Screenable Biological Space beyond Known Chemogenomics Libraries with Gray Chemical Matter─Compounds with Novel Mechanisms from High-Throughput Screening Profiles

Phenotypic assays have become an established approach to drug discovery. Greater disease relevance is often achieved through cellular models with increased complexity and more detailed readouts, such as gene expression or advanced imaging. However, the intricate nature and cost of these assays impose limitations on their screening capacity, often restricting screens to well-characterized small compound sets such as chemogenomics libraries. Here, we outline a cheminformatics approach to identify a small set of compounds with likely novel mechanisms of action (MoAs), expanding the MoA search space for throughput limited phenotypic assays. Our approach is based on mining existing large-scale, phenotypic high-throughput screening (HTS) data. It enables the identification of chemotypes that exhibit selectivity across multiple cell-based assays, which are characterized by persistent and broad structure activity relationships (SAR). We validate the effectiveness of our approach in broad cellular profiling assays (Cell Painting, DRUG-seq, and Promotor Signature Profiling) and chemical proteomics experiments. These experiments revealed that the compounds behave similarly to known chemogenetic libraries, but with a notable bias toward novel protein targets. To foster collaboration and advance research in this area, we have curated a public set of such compounds based on the PubChem BioAssay dataset and made it available for use by the scientific community.

High throughput functional profiling of genes at intraocular pressure loci reveals distinct networks for glaucoma

INTRODUCTION

Primary open angle glaucoma (POAG) is a leading cause of blindness globally. Characterized by progressive retinal ganglion cell degeneration, the precise pathogenesis remains unknown. Genome-wide association studies (GWAS) have uncovered many genetic variants associated with elevated intraocular pressure (IOP), one of the key risk factors for POAG. We aimed to identify genetic and morphological variation that can be attributed to trabecular meshwork cell (TMC) dysfunction and raised IOP in POAG.

METHODS

62 genes across 55 loci were knocked-out in a primary human TMC line. Each knockout group, including five non-targeting control groups, underwent single-cell RNA-sequencing (scRNA-seq) for differentially-expressed gene (DEG) analysis. Multiplexed fluorescence coupled with CellProfiler image analysis allowed for single-cell morphological profiling.

RESULTS

Many gene knockouts invoked DEGs relating to matrix metalloproteinases and interferon-induced proteins. We have prioritized genes at four loci of interest to identify gene knockouts that may contribute to the pathogenesis of POAG, including ANGPTL2, LMX1B, CAV1, and KREMEN1. Three genetic networks of gene knockouts with similar transcriptomic profiles were identified, suggesting a synergistic function in trabecular meshwork cell physiology. TEK knockout caused significant upregulation of nuclear granularity on morphological analysis, while knockout of TRIOBP, TMCO1 and PLEKHA7 increased granularity and intensity of actin and the cell-membrane.

CONCLUSION

High-throughput analysis of cellular structure and function through multiplex fluorescent single-cell analysis and scRNA-seq assays enabled the direct study of genetic perturbations at the single-cell resolution. This work provides a framework for investigating the role of genes in the pathogenesis of glaucoma and heterogenous diseases with a strong genetic basis.

da_Tracker: Automated workflow for high throughput single cell and single phagosome tracking in infected cells

Time-lapse microscopy has emerged as a crucial tool in cell biology, facilitating a deeper understanding of dynamic cellular processes. While existing tracking tools have proven effective in detecting and monitoring objects over time, the quantification of signals within these tracked objects often faces implementation constraints. In the context of infectious diseases, the quantification of signals at localized compartments within the cell and around intracellular pathogens can provide even deeper insight into the interactions between the pathogen and host cell organelles. Existing quantitative analysis at a single-phagosome level remains limited and dependent on manual tracking methods. We developed a near-fully automated workflow that performs with limited bias, high-throughput cell segmentation and quantitative tracking of both single cell and single bacterium/phagosome within multi-channel, z-stack, time-lapse confocal microscopy videos. We took advantage of the PyImageJ library to bring Fiji functionality into a Python environment and combined deep-learning-based segmentation from Cellpose with tracking algorithms from Trackmate. Our workflow provides a versatile toolkit of functions for measuring relevant signal parameters at the single-cell level (such as velocity or bacterial burden) and at the single-phagosome level (i.e. assessment of phagosome maturation over time). It's capabilities in both single-cell and single-phagosome quantification, its flexibility and open-source nature should assist studies that aim to decipher for example the pathogenicity of bacteria and the mechanism of virulence factors that could pave the way for the development of innovative therapeutic approaches.

A versatile information retrieval framework for evaluating profile strength and similarity

In profiling assays, thousands of biological properties are measured in a single test, yielding biological discoveries by capturing the state of a cell population, often at the single-cell level. However, for profiling datasets, it has been challenging to evaluate the phenotypic activity of a sample and the phenotypic consistency among samples, due to profiles' high dimensionality, heterogeneous nature, and non-linear properties. Existing methods leave researchers uncertain where to draw boundaries between meaningful biological response and technical noise. Here, we developed a statistical framework that uses the well-established mean average precision (mAP) as a single, data-driven metric to bridge this gap. We validated the mAP framework against established metrics through simulations and real-world data applications, revealing its ability to capture subtle and meaningful biological differences in cell state. Specifically, we used mAP to assess both phenotypic activity for a given perturbation (or a sample) as well as consistency within groups of perturbations (or samples) across diverse high-dimensional datasets. We evaluated the framework on different profile types (image, protein, and mRNA profiles), perturbation types (CRISPR gene editing, gene overexpression, and small molecules), and profile resolutions (single-cell and bulk). Our open-source software allows this framework to be applied to identify interesting biological phenomena and promising therapeutics from large-scale profiling data.

SPACe (Swift Phenotypic Analysis of Cells): an open-source, single cell analysis of Cell Painting data

Phenotypic profiling by high throughput microscopy has become one of the leading tools for screening large sets of perturbations in cellular models. Of the numerous methods used over the years, the flexible and economical Cell Painting (CP) assay has been central in the field, allowing for large screening campaigns leading to a vast number of data-rich images. Currently, to analyze data of this scale, available open-source software ( i.e. , CellProfiler) requires computational resources that are not available to most laboratories worldwide. In addition, the image-embedded cell-to-cell variation of responses within a population, while collected and analyzed, is usually averaged and unused. Here we introduce SPACe ( S wift P henotypic A nalysis of Ce lls), an open source, Python-based platform for the analysis of single cell image-based morphological profiles produced by CP experiments. SPACe can process a typical dataset approximately ten times faster than CellProfiler on common desktop computers without loss in mechanism of action (MOA) recognition accuracy. It also computes directional distribution-based distances (Earth Mover's Distance - EMD) of morphological features for quality control and hit calling. We highlight several advantages of SPACe analysis on CP assays, including reproducibility across multiple biological replicates, easy applicability to multiple (∼20) cell lines, sensitivity to variable cell-to-cell responses, and biological interpretability to explain image-based features. We ultimately illustrate the advantages of SPACe in a screening campaign of cell metabolism small molecule inhibitors which we performed in seven cell lines to highlight the importance of testing perturbations across models.

PhagoStat a scalable and interpretable end to end framework for efficient quantification of cell phagocytosis in neurodegenerative disease studies

Quantifying the phagocytosis of dynamic, unstained cells is essential for evaluating neurodegenerative diseases. However, measuring rapid cell interactions and distinguishing cells from background make this task very challenging when processing time-lapse phase-contrast video microscopy. In this study, we introduce an end-to-end, scalable, and versatile real-time framework for quantifying and analyzing phagocytic activity. Our proposed pipeline is able to process large data-sets and includes a data quality verification module to counteract potential perturbations such as microscope movements and frame blurring. We also propose an explainable cell segmentation module to improve the interpretability of deep learning methods compared to black-box algorithms. This includes two interpretable deep learning capabilities: visual explanation and model simplification. We demonstrate that interpretability in deep learning is not the opposite of high performance, by additionally providing essential deep learning algorithm optimization insights and solutions. Besides, incorporating interpretable modules results in an efficient architecture design and optimized execution time. We apply this pipeline to quantify and analyze microglial cell phagocytosis in frontotemporal dementia (FTD) and obtain statistically reliable results showing that FTD mutant cells are larger and more aggressive than control cells. The method has been tested and validated on several public benchmarks by generating state-of-the art performances. To stimulate translational approaches and future studies, we release an open-source end-to-end pipeline and a unique microglial cells phagocytosis dataset for immune system characterization in neurodegenerative diseases research. This pipeline and the associated dataset will consistently crystallize future advances in this field, promoting the development of efficient and effective interpretable algorithms dedicated to the critical domain of neurodegenerative diseases' characterization. https://github.com/ounissimehdi/PhagoStat .

High-content analysis identified synergistic drug interactions between INK128, an mTOR inhibitor, and HDAC inhibitors in a non-small cell lung cancer cell line

BACKGROUND

The development of drug resistance is a major cause of cancer therapy failures. To inhibit drug resistance, multiple drugs are often treated together as a combinatorial therapy. In particular, synergistic drug combinations, which kill cancer cells at a lower concentration, guarantee a better prognosis and fewer side effects in cancer patients. Many studies have sought out synergistic combinations by small-scale function-based targeted growth assays or large-scale nontargeted growth assays, but their discoveries are always challenging due to technical problems such as a large number of possible test combinations.

METHODS

To address this issue, we carried out a medium-scale optical drug synergy screening in a non-small cell lung cancer cell line and further investigated individual drug interactions in combination drug responses by high-content image analysis. Optical high-content analysis of cellular responses has recently attracted much interest in the field of drug discovery, functional genomics, and toxicology. Here, we adopted a similar approach to study combinatorial drug responses.

RESULTS

By examining all possible combinations of 12 drug compounds in 6 different drug classes, such as mTOR inhibitors, HDAC inhibitors, HSP90 inhibitors, MT inhibitors, DNA inhibitors, and proteasome inhibitors, we successfully identified synergism between INK128, an mTOR inhibitor, and HDAC inhibitors, which has also been reported elsewhere. Our high-content analysis further showed that HDAC inhibitors, HSP90 inhibitors, and proteasome inhibitors played a dominant role in combinatorial drug responses when they were mixed with MT inhibitors, DNA inhibitors, or mTOR inhibitors, suggesting that recessive drugs could be less prioritized as components of multidrug cocktails.

CONCLUSIONS

In conclusion, our optical drug screening platform efficiently identified synergistic drug combinations in a non-small cell lung cancer cell line, and our high-content analysis further revealed how individual drugs in the drug mix interact with each other to generate combinatorial drug response.

Cross-Species Extrapolation of Biological Data to Guide the Environmental Safety Assessment of Pharmaceuticals-The State of the Art and Future Priorities

The extrapolation of biological data across species is a key aspect of biomedical research and drug development. In this context, comparative biology considerations are applied with the goal of understanding human disease and guiding the development of effective and safe medicines. However, the widespread occurrence of pharmaceuticals in the environment and the need to assess the risk posed to wildlife have prompted a renewed interest in the extrapolation of pharmacological and toxicological data across the entire tree of life. To address this challenge, a biological "read-across" approach, based on the use of mammalian data to inform toxicity predictions in wildlife species, has been proposed as an effective way to streamline the environmental safety assessment of pharmaceuticals. Yet, how effective has this approach been, and are we any closer to being able to accurately predict environmental risk based on known human risk? We discuss the main theoretical and experimental advancements achieved in the last 10 years of research in this field. We propose that a better understanding of the functional conservation of drug targets across species and of the quantitative relationship between target modulation and adverse effects should be considered as future research priorities. This pharmacodynamic focus should be complemented with the application of higher-throughput experimental and computational approaches to accelerate the prediction of internal exposure dynamics. The translation of comparative (eco)toxicology research into real-world applications, however, relies on the (limited) availability of experts with the skill set needed to navigate the complexity of the problem; hence, we also call for synergistic multistakeholder efforts to support and strengthen comparative toxicology research and education at a global level. Environ Toxicol Chem 2024;43:513-525. © 2023 The Authors. Environmental Toxicology and Chemistry published by Wiley Periodicals LLC on behalf of SETAC.

Cooperative polarization of MCAM/CD146 and ERM family proteins in melanoma

The WRAMP structure is a protein network associated with tail-end actomyosin contractility, membrane retraction, and directional persistence during cell migration. A marker of WRAMP structures is melanoma cell adhesion molecule (MCAM) which dynamically polarizes to the cell rear. However, factors that mediate MCAM polarization are still unknown. In this study, BioID using MCAM as bait identifies the ERM family proteins, moesin, ezrin, and radixin, as WRAMP structure components. We also present a novel image analysis pipeline, Protein Polarity by Percentile ("3P"), which classifies protein polarization using machine learning and facilitates quantitative analysis. Using 3P, we find that depletion of moesin, and to a lesser extent ezrin, decreases the proportion of cells with polarized MCAM. Furthermore, although copolarized MCAM and ERM proteins show high spatial overlap, 3P identifies subpopulations with ERM proteins closer to the cell periphery. Live-cell imaging confirms that MCAM and ERM protein polarization is tightly coordinated, but ERM proteins enrich at the cell edge first. Finally, deletion of a juxtamembrane segment in MCAM previously shown to promote ERM protein interactions impedes MCAM polarization. Our findings highlight the requirement for ERM proteins in recruitment of MCAM to WRAMP structures and an advanced computational tool to characterize protein polarization.

AI-organoid integrated systems for biomedical studies and applications

In this review, we explore the growing role of artificial intelligence (AI) in advancing the biomedical applications of human pluripotent stem cell (hPSC)-derived organoids. Stem cell-derived organoids, these miniature organ replicas, have become essential tools for disease modeling, drug discovery, and regenerative medicine. However, analyzing the vast and intricate datasets generated from these organoids can be inefficient and error-prone. AI techniques offer a promising solution to efficiently extract insights and make predictions from diverse data types generated from microscopy images, transcriptomics, metabolomics, and proteomics. This review offers a brief overview of organoid characterization and fundamental concepts in AI while focusing on a comprehensive exploration of AI applications in organoid-based disease modeling and drug evaluation. It provides insights into the future possibilities of AI in enhancing the quality control of organoid fabrication, label-free organoid recognition, and three-dimensional image reconstruction of complex organoid structures. This review presents the challenges and potential solutions in AI-organoid integration, focusing on the establishment of reliable AI model decision-making processes and the standardization of organoid research.

Evaluating batch correction methods for image-based cell profiling

High-throughput image-based profiling platforms are powerful technologies capable of collecting data from billions of cells exposed to thousands of perturbations in a time- and cost-effective manner. Therefore, image-based profiling data has been increasingly used for diverse biological applications, such as predicting drug mechanism of action or gene function. However, batch effects pose severe limitations to community-wide efforts to integrate and interpret image-based profiling data collected across different laboratories and equipment. To address this problem, we benchmarked seven high-performing scRNA-seq batch correction techniques, representing diverse approaches, using a newly released Cell Painting dataset, the largest publicly accessible image-based dataset. We focused on five different scenarios with varying complexity, and we found that Harmony, a mixture-model based method, consistently outperformed the other tested methods. Our proposed framework, benchmark, and metrics can additionally be used to assess new batch correction methods in the future. Overall, this work paves the way for improvements that allow the community to make best use of public Cell Painting data for scientific discovery.

SEMORE: SEgmentation and MORphological fingErprinting by machine learning automates super-resolution data analysis

The morphology of protein assemblies impacts their behaviour and contributes to beneficial and aberrant cellular responses. While single-molecule localization microscopy provides the required spatial resolution to investigate these assemblies, the lack of universal robust analytical tools to extract and quantify underlying structures limits this powerful technique. Here we present SEMORE, a semi-automatic machine learning framework for universal, system- and input-dependent, analysis of super-resolution data. SEMORE implements a multi-layered density-based clustering module to dissect biological assemblies and a morphology fingerprinting module for quantification by multiple geometric and kinetics-based descriptors. We demonstrate SEMORE on simulations and diverse raw super-resolution data: time-resolved insulin aggregates, and published data of dSTORM imaging of nuclear pore complexes, fibroblast growth receptor 1, sptPALM of Syntaxin 1a and dynamic live-cell PALM of ryanodine receptors. SEMORE extracts and quantifies all protein assemblies, their temporal morphology evolution and provides quantitative insights, e.g. classification of heterogeneous insulin aggregation pathways and NPC geometry in minutes. SEMORE is a general analysis platform for super-resolution data, and being a time-aware framework can also support the rise of 4D super-resolution data.

Learning representations for image-based profiling of perturbations

Measuring the phenotypic effect of treatments on cells through imaging assays is an efficient and powerful way of studying cell biology, and requires computational methods for transforming images into quantitative data. Here, we present an improved strategy for learning representations of treatment effects from high-throughput imaging, following a causal interpretation. We use weakly supervised learning for modeling associations between images and treatments, and show that it encodes both confounding factors and phenotypic features in the learned representation. To facilitate their separation, we constructed a large training dataset with images from five different studies to maximize experimental diversity, following insights from our causal analysis. Training a model with this dataset successfully improves downstream performance, and produces a reusable convolutional network for image-based profiling, which we call Cell Painting CNN. We evaluated our strategy on three publicly available Cell Painting datasets, and observed that the Cell Painting CNN improves performance in downstream analysis up to 30% with respect to classical features, while also being more computationally efficient.

Machine learning-assisted high-content imaging analysis of 3D MCF7 microtissues for estrogenic effect prediction

Endocrine-disrupting chemicals (EDCs) pose a significant threat to human well-being and the ecosystem. However, in managing the many thousands of uncharacterized chemical entities, the high-throughput screening of EDCs using relevant biological endpoints remains challenging. Three-dimensional (3D) culture technology enables the development of more physiologically relevant systems in more realistic biochemical microenvironments. The high-content and quantitative imaging techniques enable quantifying endpoints associated with cell morphology, cell-cell interaction, and microtissue organization. In the present study, 3D microtissues formed by MCF-7 breast cancer cells were exposed to the model EDCs estradiol (E2) and propyl pyrazole triol (PPT). A 3D imaging and image analysis pipeline was established to extract quantitative image features from estrogen-exposed microtissues. Moreover, a machine-learning classification model was built using estrogenic-associated differential imaging features. Based on 140 common differential image features found between the E2 and PPT group, the classification model predicted E2 and PPT exposure with AUC-ROC at 0.9528 and 0.9513, respectively. Deep learning-assisted analysis software was developed to characterize microtissue gland lumen formation. The fully automated tool can accurately characterize the number of identified lumens and the total luminal volume of each microtissue. Overall, the current study established an integrated approach by combining non-supervised image feature profiling and supervised luminal volume characterization, which reflected the complexity of functional ER signaling and highlighted a promising conceptual framework for estrogenic EDC risk assessment.

Orientation-invariant autoencoders learn robust representations for shape profiling of cells and organelles

Cell and organelle shape are driven by diverse genetic and environmental factors and thus accurate quantification of cellular morphology is essential to experimental cell biology. Autoencoders are a popular tool for unsupervised biological image analysis because they learn a low-dimensional representation that maps images to feature vectors to generate a semantically meaningful embedding space of morphological variation. The learned feature vectors can also be used for clustering, dimensionality reduction, outlier detection, and supervised learning problems. Shape properties do not change with orientation, and thus we argue that representation learning methods should encode this orientation invariance. We show that conventional autoencoders are sensitive to orientation, which can lead to suboptimal performance on downstream tasks. To address this, we develop O2-variational autoencoder (O2-VAE), an unsupervised method that learns robust, orientation-invariant representations. We use O2-VAE to discover morphology subgroups in segmented cells and mitochondria, detect outlier cells, and rapidly characterise cellular shape and texture in large datasets, including in a newly generated synthetic benchmark.

Harnessing artificial intelligence to reduce phototoxicity in live imaging

Fluorescence microscopy is essential for studying living cells, tissues and organisms. However, the fluorescent light that switches on fluorescent molecules also harms the samples, jeopardizing the validity of results - particularly in techniques such as super-resolution microscopy, which demands extended illumination. Artificial intelligence (AI)-enabled software capable of denoising, image restoration, temporal interpolation or cross-modal style transfer has great potential to rescue live imaging data and limit photodamage. Yet we believe the focus should be on maintaining light-induced damage at levels that preserve natural cell behaviour. In this Opinion piece, we argue that a shift in role for AIs is needed - AI should be used to extract rich insights from gentle imaging rather than recover compromised data from harsh illumination. Although AI can enhance imaging, our ultimate goal should be to uncover biological truths, not just retrieve data. It is essential to prioritize minimizing photodamage over merely pushing technical limits. Our approach is aimed towards gentle acquisition and observation of undisturbed living systems, aligning with the essence of live-cell fluorescence microscopy.

From pixels to insights: Machine learning and deep learning for bioimage analysis

Bioimage analysis plays a critical role in extracting information from biological images, enabling deeper insights into cellular structures and processes. The integration of machine learning and deep learning techniques has revolutionized the field, enabling the automated, reproducible, and accurate analysis of biological images. Here, we provide an overview of the history and principles of machine learning and deep learning in the context of bioimage analysis. We discuss the essential steps of the bioimage analysis workflow, emphasizing how machine learning and deep learning have improved preprocessing, segmentation, feature extraction, object tracking, and classification. We provide examples that showcase the application of machine learning and deep learning in bioimage analysis. We examine user-friendly software and tools that enable biologists to leverage these techniques without extensive computational expertise. This review is a resource for researchers seeking to incorporate machine learning and deep learning in their bioimage analysis workflows and enhance their research in this rapidly evolving field.

Integrating single-cell transcriptomics with cellular phenotypes: cell morphology, Ca2+ imaging and electrophysiology

I review recent technological advancements in coupling single-cell transcriptomics with cellular phenotypes including morphology, calcium signaling, and electrophysiology. Single-cell RNA sequencing (scRNAseq) has revolutionized cell type classifications by capturing the transcriptional diversity of cells. A new wave of methods to integrate scRNAseq and biophysical measurements is facilitating the linkage of transcriptomic data to cellular function, which provides physiological insight into cellular states. I briefly discuss critical factors of these phenotypical characterizations such as timescales, information content, and analytical tools. Dedicated sections focus on the integration with cell morphology, calcium imaging, and electrophysiology (patch-seq), emphasizing their complementary roles. I discuss their application in elucidating cellular states, refining cell type classifications, and uncovering functional differences in cell subtypes. To illustrate the practical applications and benefits of these methods, I highlight their use in tissues with excitable cell-types such as the brain, pancreatic islets, and the retina. The potential of combining functional phenotyping with spatial transcriptomics for a detailed mapping of cell phenotypes in situ is explored. Finally, I discuss open questions and future perspectives, emphasizing the need for a shift towards broader accessibility through increased throughput.

Anticancer Drug Discovery Based on Natural Products: From Computational Approaches to Clinical Studies

Globally, malignancies cause one out of six mortalities, which is a serious health problem. Cancer therapy has always been challenging, apart from major advances in immunotherapies, stem cell transplantation, targeted therapies, hormonal therapies, precision medicine, and palliative care, and traditional therapies such as surgery, radiation therapy, and chemotherapy. Natural products are integral to the development of innovative anticancer drugs in cancer research, offering the scientific community the possibility of exploring novel natural compounds against cancers. The role of natural products like Vincristine and Vinblastine has been thoroughly implicated in the management of leukemia and Hodgkin's disease. The computational method is the initial key approach in drug discovery, among various approaches. This review investigates the synergy between natural products and computational techniques, and highlights their significance in the drug discovery process. The transition from computational to experimental validation has been highlighted through in vitro and in vivo studies, with examples such as betulinic acid and withaferin A. The path toward therapeutic applications have been demonstrated through clinical studies of compounds such as silvestrol and artemisinin, from preclinical investigations to clinical trials. This article also addresses the challenges and limitations in the development of natural products as potential anti-cancer drugs. Moreover, the integration of deep learning and artificial intelligence with traditional computational drug discovery methods may be useful for enhancing the anticancer potential of natural products.

Generative modeling of biological shapes and images using a probabilistic α-shape sampler

Understanding morphological variation is an important task in many areas of computational biology. Recent studies have focused on developing computational tools for the task of sub-image selection which aims at identifying structural features that best describe the variation between classes of shapes. A major part in assessing the utility of these approaches is to demonstrate their performance on both simulated and real datasets. However, when creating a model for shape statistics, real data can be difficult to access and the sample sizes for these data are often small due to them being expensive to collect. Meanwhile, the current landscape of generative models for shapes has been mostly limited to approaches that use black-box inference-making it difficult to systematically assess the power and calibration of sub-image models. In this paper, we introduce the α -shape sampler: a probabilistic framework for generating realistic 2D and 3D shapes based on probability distributions which can be learned from real data. We demonstrate our framework using proof-of-concept examples and in two real applications in biology where we generate (i) 2D images of healthy and septic neutrophils and (ii) 3D computed tomography (CT) scans of primate mandibular molars. The α -shape sampler R package is open-source and can be downloaded at https://github.com/lcrawlab/ashapesampler.