Workflows for microscopy image analysis and cellular phenotyping

Quantitative Analysis of Whole-Mount Fluorescence-Stained Tumor Spheroids in Phenotypic Drug Screens

Three-dimensional cell cultures, such as spheroids or organoids, serve as important models for drug screening purposes. Optical tissue clearing (OTC) enhances the visualization of fluorescence stainings and enables in toto microscopy of 3D cell culture models. Furthermore, subsequent automated image analysis tools convert qualitative confocal image sets into quantitative data. In this chapter, we describe a detailed protocol for preparation of HT29 cancer spheroids, 3D in toto immunostaining, glycerol-based OTC, whole-mount imaging, and semi-automated downstream image processing and segmentation for nuclear image analysis using open-source software.

High throughput microscopy and single cell phenotypic image-based analysis in toxicology and drug discovery

Measuring single cell responses to the universe of chemicals (drugs, natural products, environmental toxicants etc.) is of paramount importance to human health as phenotypic variability in sensing stimuli is a hallmark of biology that is considered during high throughput screening. One of the ways to approach this problem is via high throughput, microscopy-based assays coupled with multi-dimensional single cell analysis methods. Here, we will summarize some of the efforts in this vast and growing field, focusing on phenotypic screens (e.g., Cell Painting), single cell analytics and quality control, with particular attention to environmental toxicology and drug screening. We will discuss advantages and limitations of high throughput assays with various end points and levels of complexity.

MNPmApp: An image analysis tool to quantify mononuclear phagocyte distribution in mucosal tissues

Mononuclear phagocytes (MNPs) such as dendritic cells and macrophages perform key sentinel functions in mucosal tissues and are responsible for inducing and maintaining adaptive immune responses to mucosal pathogens. Positioning of MNPs at the epithelial interface facilitates their access to luminally-derived antigens and regulates MNP function through soluble mediators or surface receptor interactions. Therefore, accurately quantifying the distribution of MNPs within mucosal tissues as well as their spatial relationship with other cells is important to infer functional cellular interactions in health and disease. In this study, we developed and validated a MATLAB-based tissue cytometry platform, termed "MNP mapping application" (MNPmApp), that performs high throughput analyses of MNP density and distribution in the gastrointestinal mucosa based on digital multicolor fluorescence microscopy images and that integrates a Monte Carlo modeling feature to assess randomness of MNP distribution. MNPmApp identified MNPs in tissue sections of the human gastric mucosa with 98 ± 2% specificity and 76 ± 15% sensitivity for HLA-DR+ MNPs and 98 ± 1% specificity and 85 ± 12% sensitivity for CD11c+ MNPs. Monte Carlo modeling revealed that mean MNP-MNP distances for both HLA-DR+ and CD11c+ MNPs were significantly lower than anticipated based on random cell placement, whereas MNP-epithelial distances were similar to randomly placed cells. Surprisingly, H. pylori infection had no significant impact on the number of HLA-DR and CD11c MNPs or their distribution within the gastric lamina propria. However, our study demonstrated that MNPmApp is a reliable and user-friendly tool for unbiased quantitation of MNPs and their distribution at mucosal sites.

A Temporal Evolution Perspective of Lipase Production by Yarrowia lipolytica in Solid-State Fermentation

Lipases are enzymes that, in aqueous or non-aqueous media, act on water-insoluble substrates, mainly catalyzing reactions on carboxyl ester bonds, such as hydrolysis, aminolysis, and (trans)esterification. Yarrowia lipolytica is a non-conventional yeast known for secreting lipases and other bioproducts; therefore, it is of great interest in various industrial fields. The production of lipases can be carried on solid-state fermentation (SSF) that utilizes solid substrates in the absence, or near absence, of free water and presents minimal problems with microbial contamination due to the low water contents in the medium. Moreover, SSF offers high volumetric productivity, targets concentrated compounds, high substrate concentration tolerance, and has less wastewater generation. In this sense, the present work provides a temporal evolution perspective regarding the main aspects of lipase production in SSF by Y. lipolytica, focusing on the most relevant aspects and presenting the potential of such an approach.

Neural network fast-classifies biological images through features selecting to power automated microscopy

Artificial intelligence is nowadays used for cell detection and classification in optical microscopy during post-acquisition analysis. The microscopes are now fully automated and next expected to be smart by making acquisition decisions based on the images. It calls for analysing them on the fly. Biology further imposes training on a reduced data set due to cost and time to prepare the samples and have the data sets annotated by experts. We propose a real-time image processing compliant with these specifications by balancing accurate detection and execution performance. We characterised the images using a generic, high-dimensional feature extractor. We then classified the images using machine learning to understand the contribution of each feature in decision and execution time. We found that the non-linear-classifier random forests outperformed Fisher's linear discriminant. More importantly, the most discriminant and time-consuming features could be excluded without significant accuracy loss, offering a substantial gain in execution time. It suggests a feature-group redundancy likely related to the biology of the observed cells. We offer a method to select fast and discriminant features. In our assay, a 79.6 ± 2.4% accurate classification of a cell took 68.7 ± 3.5 ms (mean ± SD, 5-fold cross-validation nested in 10 bootstrap repeats), corresponding to 14 cells per second, dispatched into eight phases of the cell cycle, using 12 feature groups and operating a consumer market ARM-based embedded system. A simple neural network offered similar performances paving the way to faster training and classification, using parallel execution on a general-purpose graphic processing unit. Finally, this strategy is also usable for deep neural networks paving the way to optimizing these algorithms for smart microscopy.

Bioimage analysis workflows: community resources to navigate through a complex ecosystem

Workflows are the keystone of bioimage analysis, and the NEUBIAS (Network of European BioImage AnalystS) community is trying to gather the actors of this field and organize the information around them.  One of its most recent outputs is the opening of the F1000Research NEUBIAS gateway, whose main objective is to offer a channel of publication for bioimage analysis workflows and associated resources. In this paper we want to express some personal opinions and recommendations related to finding, handling and developing bioimage analysis workflows.  The emergence of "big data" in bioimaging and resource-intensive analysis algorithms make local data storage and computing solutions a limiting factor. At the same time, the need for data sharing with collaborators and a general shift towards remote work, have created new challenges and avenues for the execution and sharing of bioimage analysis workflows. These challenges are to reproducibly run workflows in remote environments, in particular when their components come from different software packages, but also to document them and link their parameters and results by following the FAIR principles (Findable, Accessible, Interoperable, Reusable) to foster open and reproducible science. In this opinion paper, we focus on giving some directions to the reader to tackle these challenges and navigate through this complex ecosystem, in order to find and use workflows, and to compare workflows addressing the same problem. We also discuss tools to run workflows in the cloud and on High Performance Computing resources, and suggest ways to make these workflows FAIR.

Zeta-Potential Read-Across Model Utilizing Nanodescriptors Extracted via the NanoXtract Image Analysis Tool Available on the Enalos Nanoinformatics Cloud Platform

Zeta potential is one of the most critical properties of nanomaterials (NMs) which provides an estimation of the surface charge, and therefore electrostatic stability in medium and, in practical terms, influences the NM's tendency to form agglomerates and to interact with cellular membranes. This paper describes a robust and accurate read-across model to predict NM zeta potential utilizing as the input data a set of image descriptors derived from transmission electron microscopy (TEM) images of the NMs. The image descriptors are calculated using NanoXtract (http://enaloscloud.novamechanics.com/EnalosWebApps/NanoXtract/), a unique online tool that generates 18 image descriptors from the TEM images, which can then be explored by modeling to identify those most predictive of NM behavior and biological effects. NM TEM images are used to develop a model for prediction of zeta potential based on grouping of the NMs according to their nearest neighbors. The model provides interesting insights regarding the most important similarity features between NMs-in addition to core composition the main elongation emerged, which links to key drivers of NM toxicity such as aspect ratio. Both the NanoXtract image analysis tool and the validated model for zeta potential (http://enaloscloud.novamechanics.com/EnalosWebApps/ZetaPotential/) are freely available online through the Enalos Nanoinformatics platform.

Integration of the ImageJ Ecosystem in the KNIME Analytics Platform

Open-source software tools are often used for analysis of scientific image data due to their flexibility and transparency in dealing with rapidly evolving imaging technologies. The complex nature of image analysis problems frequently requires many tools to be used in conjunction, including image processing and analysis, data processing, machine learning and deep learning, statistical analysis of the results, visualization, correlation to heterogeneous but related data, and more. However, the development, and therefore application, of these computational tools is impeded by a lack of integration across platforms. Integration of tools goes beyond convenience, as it is impractical for one tool to anticipate and accommodate the current and future needs of every user. This problem is emphasized in the field of bioimage analysis, where various rapidly emerging methods are quickly being adopted by researchers. ImageJ is a popular open-source image analysis platform, with contributions from a global community resulting in hundreds of specialized routines for a wide array of scientific tasks. ImageJ's strength lies in its accessibility and extensibility, allowing researchers to easily improve the software to solve their image analysis tasks. However, ImageJ is not designed for development of complex end-to-end image analysis workflows. Scientists are often forced to create highly specialized and hard-to-reproduce scripts to orchestrate individual software fragments and cover the entire life-cycle of an analysis of an image dataset. KNIME Analytics Platform, a user-friendly data integration, analysis, and exploration workflow system, was designed to handle huge amounts of heterogeneous data in a platform-agnostic, computing environment and has been successful in meeting complex end-to-end demands in several communities, such as cheminformatics and mass spectrometry. Similar needs within the bioimage analysis community led to the creation of the KNIME Image Processing extension which integrates ImageJ into KNIME Analytics Platform, enabling researchers to develop reproducible and scalable workflows, integrating a diverse range of analysis tools. Here we present how users and developers alike can leverage the ImageJ ecosystem via the KNIME Image Processing extension to provide robust and extensible image analysis within KNIME workflows. We illustrate the benefits of this integration with examples, as well as representative scientific use cases.

Accessible and reproducible mass spectrometry imaging data analysis in Galaxy

BACKGROUND

Mass spectrometry imaging is increasingly used in biological and translational research because it has the ability to determine the spatial distribution of hundreds of analytes in a sample. Being at the interface of proteomics/metabolomics and imaging, the acquired datasets are large and complex and often analyzed with proprietary software or in-house scripts, which hinders reproducibility. Open source software solutions that enable reproducible data analysis often require programming skills and are therefore not accessible to many mass spectrometry imaging (MSI) researchers.

FINDINGS

We have integrated 18 dedicated mass spectrometry imaging tools into the Galaxy framework to allow accessible, reproducible, and transparent data analysis. Our tools are based on Cardinal, MALDIquant, and scikit-image and enable all major MSI analysis steps such as quality control, visualization, preprocessing, statistical analysis, and image co-registration. Furthermore, we created hands-on training material for use cases in proteomics and metabolomics. To demonstrate the utility of our tools, we re-analyzed a publicly available N-linked glycan imaging dataset. By providing the entire analysis history online, we highlight how the Galaxy framework fosters transparent and reproducible research.

CONCLUSION

The Galaxy framework has emerged as a powerful analysis platform for the analysis of MSI data with ease of use and access, together with high levels of reproducibility and transparency.

The de.NBI / ELIXIR-DE training platform - Bioinformatics training in Germany and across Europe within ELIXIR

The German Network for Bioinformatics Infrastructure (de.NBI) is a national and academic infrastructure funded by the German Federal Ministry of Education and Research (BMBF). The de.NBI provides (i) service, (ii) training, and (iii) cloud computing to users in life sciences research and biomedicine in Germany and Europe and (iv) fosters the cooperation of the German bioinformatics community with international network structures. The de.NBI members also run the German node (ELIXIR-DE) within the European ELIXIR infrastructure. The de.NBI / ELIXIR-DE training platform, also known as special interest group 3 (SIG 3) ‘Training & Education’, coordinates the bioinformatics training of de.NBI and the German ELIXIR node. The network provides a high-quality, coherent, timely, and impactful training program across its eight service centers. Life scientists learn how to handle and analyze biological big data more effectively by applying tools, standards and compute services provided by de.NBI. Since 2015, more than 300 training courses were carried out with about 6,000 participants and these courses received recommendation rates of almost 90% (status as of July 2020). In addition to face-to-face training courses, online training was introduced on the de.NBI website in 2016 and guidelines for the preparation of e-learning material were established in 2018. In 2016, ELIXIR-DE joined the ELIXIR training platform. Here, the de.NBI / ELIXIR-DE training platform collaborates with ELIXIR in training activities, advertising training courses via TeSS and discussions on the exchange of data for training events essential for quality assessment on both the technical and administrative levels. The de.NBI training program trained thousands of scientists from Germany and beyond in many different areas of bioinformatics.

Digging deeper: methodologies for high-content phenotyping in Caenorhabditis elegans

Deep phenotyping is an emerging conceptual paradigm and experimental approach aimed at measuring and linking many aspects of a phenotype to understand its underlying biology. To date, deep phenotyping has been applied mostly in cultured cells and used less in multicellular organisms. However, in the past decade, it has increasingly been recognized that deep phenotyping could lead to a better understanding of how genetics, environment and stochasticity affect the development, physiology and behavior of an organism. The nematode Caenorhabditis elegans is an invaluable model system for studying how genes affect a phenotypic trait, and new technologies have taken advantage of the worm's physical attributes to increase the throughput and informational content of experiments. Coupling of these technical advancements with computational and analytical tools has enabled a boom in deep-phenotyping studies of C. elegans. In this Review, we highlight how these new technologies and tools are digging into the biological origins of complex, multidimensional phenotypes.

Hyperparameter optimization for image analysis: application to prostate tissue images and live cell data of virus-infected cells

PURPOSE

Automated analysis of microscopy image data typically requires complex pipelines that involve multiple methods for different image analysis tasks. To achieve best results of the analysis pipelines, method-dependent hyperparameters need to be optimized. However, complex pipelines often suffer from the fact that calculation of the gradient of the loss function is analytically or computationally infeasible. Therefore, first- or higher-order optimization methods cannot be applied.

METHODS

We developed a new framework for zero-order black-box hyperparameter optimization called HyperHyper, which has a modular architecture that separates hyperparameter sampling and optimization. We also developed a visualization of the loss function based on infimum projection to obtain further insights into the optimization problem.

RESULTS

We applied HyperHyper in three different experiments with different imaging modalities, and evaluated in total more than 400.000 hyperparameter combinations. HyperHyper was used for optimizing two pipelines for cell nuclei segmentation in prostate tissue microscopy images and two pipelines for detection of hepatitis C virus proteins in live cell microscopy data. We evaluated the impact of separating the sampling and optimization strategy using different optimizers and employed an infimum projection for visualizing the hyperparameter space.

CONCLUSIONS

The separation of sampling and optimization strategy of the proposed HyperHyper optimization framework improves the result of the investigated image analysis pipelines. Visualization of the loss function based on infimum projection enables gaining further insights on the optimization process.

Communicating Genome Architecture: Biovisualization of the Genome, from Data Analysis and Hypothesis Generation to Communication and Learning

Genome discoveries at the core of biology are made by visual description and exploration of the cell, from microscopic sketches and biochemical mapping to computational analysis and spatial modeling. We outline the experimental and visualization techniques that have been developed recently which capture the three-dimensional interactions regulating how genes are expressed. We detail the challenges faced in integration of the data to portray the components and organization and their dynamic landscape. The goal is more than a single data-driven representation as interactive visualization for de novo research is paramount to decipher insights on genome organization in space.