An Overview of data science uses in bioimage informatics

A practical guide to bioimaging research data management in core facilities

Bioimage data are generated in diverse research fields throughout the life and biomedical sciences. Its potential for advancing scientific progress via modern, data-driven discovery approaches reaches beyond disciplinary borders. To fully exploit this potential, it is necessary to make bioimaging data, in general, multidimensional microscopy images and image series, FAIR, that is, findable, accessible, interoperable and reusable. These FAIR principles for research data management are now widely accepted in the scientific community and have been adopted by funding agencies, policymakers and publishers. To remain competitive and at the forefront of research, implementing the FAIR principles into daily routines is an essential but challenging task for researchers and research infrastructures. Imaging core facilities, well-established providers of access to imaging equipment and expertise, are in an excellent position to lead this transformation in bioimaging research data management. They are positioned at the intersection of research groups, IT infrastructure providers, the institution´s administration, and microscope vendors. In the frame of German BioImaging - Society for Microscopy and Image Analysis (GerBI-GMB), cross-institutional working groups and third-party funded projects were initiated in recent years to advance the bioimaging community's capability and capacity for FAIR bioimage data management. Here, we provide an imaging-core-facility-centric perspective outlining the experience and current strategies in Germany to facilitate the practical adoption of the FAIR principles closely aligned with the international bioimaging community. We highlight which tools and services are ready to be implemented and what the future directions for FAIR bioimage data have to offer.

Quantifying Simulated Contamination Deposition on Healthcare Providers Using Image Analysis

INTRODUCTION

Simulation-based research has played an important role in improving care for communicable diseases. Unfortunately, few studies have attempted to quantify the level of contamination in these simulation activities. We aim to assess the feasibility and provide validity evidence for using integrated density values and area of contamination (AOC) to differentiate various levels of simulated contamination.

METHODS

An increasing number of simulated contamination spots using fluorescent marker were applied on a manikin chest to simulate a contaminated healthcare provider. An ultraviolet light was used to illuminate the manikin to highlight the simulated contamination. Images of increasing contamination levels were captured using a camera with different exposure settings. Image processing software was used to measure 2 outcomes: (1) natural logarithm of integrated density; and (2) AOC. Mixed-effects linear regression models were used to assess the effect of contamination levels and exposure settings on both outcome measures. A standardized "proof-of-concept" exercise was set up to calibrate and formalize the process for human subjects.

RESULTS

A total of 140 images were included in the analyses. Dose-response relationships were observed between contamination levels and both outcome measures. For each increment in the number of contaminated simulation spots (ie, simulated contaminated area increased by 38.5 mm 2 ), on average, log-integrated density increased by 0.009 (95% confidence interval, 0.006-0.012; P < 0.001) and measured AOC increased by 37.8 mm 2 (95% confidence interval, 36.7-38.8 mm 2 ; P < 0.001), which is very close to actual value (38.5 mm 2 ). The "proof-of-concept" demonstration further verified results.

CONCLUSIONS

Integrated density and AOC measured by image processing can differentiate various levels of simulated, fluorescent contamination. The AOC measured highly agrees with the actual value. This method should be optimized and used in the future research to detect simulated contamination deposited on healthcare providers.

Applications of Neural Networks in Biomedical Data Analysis

Neural networks for deep-learning applications, also called artificial neural networks, are important tools in science and industry. While their widespread use was limited because of inadequate hardware in the past, their popularity increased dramatically starting in the early 2000s when it became possible to train increasingly large and complex networks. Today, deep learning is widely used in biomedicine from image analysis to diagnostics. This also includes special topics, such as forensics. In this review, we discuss the latest networks and how they work, with a focus on the analysis of biomedical data, particularly biomarkers in bioimage data. We provide a summary on numerous technical aspects, such as activation functions and frameworks. We also present a data analysis of publications about neural networks to provide a quantitative insight into the use of network types and the number of journals per year to determine the usage in different scientific fields.

Quantitative Evaluation of Cardiac Cell Interactions and Responses to Cyclic Strain

The heart has a dynamic mechanical environment contributed by its unique cellular composition and the resultant complex tissue structure. In pathological heart tissue, both the mechanics and cell composition can change and influence each other. As a result, the interplay between the cell phenotype and mechanical stimulation needs to be considered to understand the biophysical cell interactions and organization in healthy and diseased myocardium. In this work, we hypothesized that the overall tissue organization is controlled by varying densities of cardiomyocytes and fibroblasts in the heart. In order to test this hypothesis, we utilized a combination of mechanical strain, co-cultures of different cell types, and inhibitory drugs that block intercellular junction formation. To accomplish this, an image analysis pipeline was developed to automatically measure cell type-specific organization relative to the stretch direction. The results indicated that cardiac cell type-specific densities influence the overall organization of heart tissue such that it is possible to model healthy and fibrotic heart tissue in vitro. This study provides insight into how to mimic the dynamic mechanical environment of the heart in engineered tissue as well as providing valuable information about the process of cardiac remodeling and repair in diseased hearts.

Mesmerize is a dynamically adaptable user-friendly analysis platform for 2D and 3D calcium imaging data

Calcium imaging is an increasingly valuable technique for understanding neural circuits, neuroethology, and cellular mechanisms. The analysis of calcium imaging data presents challenges in image processing, data organization, analysis, and accessibility. Tools have been created to address these problems independently, however a comprehensive user-friendly package does not exist. Here we present Mesmerize, an efficient, expandable and user-friendly analysis platform, which uses a Findable, Accessible, Interoperable and Reproducible (FAIR) system to encapsulate the entire analysis process, from raw data to interactive visualizations for publication. Mesmerize provides a user-friendly graphical interface to state-of-the-art analysis methods for signal extraction & downstream analysis. We demonstrate the broad scientific scope of Mesmerize's applications by analyzing neuronal datasets from mouse and a volumetric zebrafish dataset. We also applied contemporary time-series analysis techniques to analyze a novel dataset comprising neuronal, epidermal, and migratory mesenchymal cells of the protochordate Ciona intestinalis.

PartSeg: a tool for quantitative feature extraction from 3D microscopy images for dummies

BACKGROUND

Bioimaging techniques offer a robust tool for studying molecular pathways and morphological phenotypes of cell populations subjected to various conditions. As modern high-resolution 3D microscopy provides access to an ever-increasing amount of high-quality images, there arises a need for their analysis in an automated, unbiased, and simple way. Segmentation of structures within the cell nucleus, which is the focus of this paper, presents a new layer of complexity in the form of dense packing and significant signal overlap. At the same time, the available segmentation tools provide a steep learning curve for new users with a limited technical background. This is especially apparent in the bulk processing of image sets, which requires the use of some form of programming notation.

RESULTS

In this paper, we present PartSeg, a tool for segmentation and reconstruction of 3D microscopy images, optimised for the study of the cell nucleus. PartSeg integrates refined versions of several state-of-the-art algorithms, including a new multi-scale approach for segmentation and quantitative analysis of 3D microscopy images. The features and user-friendly interface of PartSeg were carefully planned with biologists in mind, based on analysis of multiple use cases and difficulties encountered with other tools, to offer an ergonomic interface with a minimal entry barrier. Bulk processing in an ad-hoc manner is possible without the need for programmer support. As the size of datasets of interest grows, such bulk processing solutions become essential for proper statistical analysis of results. Advanced users can use PartSeg components as a library within Python data processing and visualisation pipelines, for example within Jupyter notebooks. The tool is extensible so that new functionality and algorithms can be added by the use of plugins. For biologists, the utility of PartSeg is presented in several scenarios, showing the quantitative analysis of nuclear structures.

CONCLUSIONS

In this paper, we have presented PartSeg which is a tool for precise and verifiable segmentation and reconstruction of 3D microscopy images. PartSeg is optimised for cell nucleus analysis and offers multi-scale segmentation algorithms best-suited for this task. PartSeg can also be used for the bulk processing of multiple images and its components can be reused in other systems or computational experiments.

Tumor-on-a-chip platforms to study cancer-immune system crosstalk in the era of immunotherapy

Immunotherapy is a powerful therapeutic approach able to re-educate the immune system to fight cancer. A key player in this process is the tumor microenvironment (TME), which is a dynamic entity characterized by a complex array of tumor and stromal cells as well as immune cell populations trafficking to the tumor site through the endothelial barrier. Recapitulating these multifaceted dynamics is critical for studying the intimate interactions between cancer and the immune system and to assess the efficacy of emerging immunotherapies, such as immune checkpoint inhibitors (ICIs) and adoptive cell-based products. Microfluidic devices offer a unique technological approach to build tumor-on-a-chip reproducing the multiple layers of complexity of cancer-immune system crosstalk. Here, we seek to review the most important biological and engineering developments of microfluidic platforms for studying cancer-immune system interactions, in both solid and hematological tumors, highlighting the role of the vascular component in immune trafficking. Emphasis is given to image processing and related algorithms for real-time monitoring and quantitative evaluation of the cellular response to microenvironmental dynamic changes. The described approaches represent a valuable tool for preclinical evaluation of immunotherapeutic strategies.

Data Science and Analytics: An Overview from Data-Driven Smart Computing, Decision-Making and Applications Perspective

The digital world has a wealth of data, such as internet of things (IoT) data, business data, health data, mobile data, urban data, security data, and many more, in the current age of the Fourth Industrial Revolution (Industry 4.0 or 4IR). Extracting knowledge or useful insights from these data can be used for smart decision-making in various applications domains. In the area of data science, advanced analytics methods including machine learning modeling can provide actionable insights or deeper knowledge about data, which makes the computing process automatic and smart. In this paper, we present a comprehensive view on "Data Science" including various types of advanced analytics methods that can be applied to enhance the intelligence and capabilities of an application through smart decision-making in different scenarios. We also discuss and summarize ten potential real-world application domains including business, healthcare, cybersecurity, urban and rural data science, and so on by taking into account data-driven smart computing and decision making. Based on this, we finally highlight the challenges and potential research directions within the scope of our study. Overall, this paper aims to serve as a reference point on data science and advanced analytics to the researchers and decision-makers as well as application developers, particularly from the data-driven solution point of view for real-world problems.

Machine Learning Representation of Loss of Eye Regularity in a Drosophila Neurodegenerative Model

The fruit fly compound eye is a premier experimental system for modeling human neurodegenerative diseases. The disruption of the retinal geometry has been historically assessed using time-consuming and poorly reliable techniques such as histology or pseudopupil manual counting. Recent semiautomated quantification approaches rely either on manual region-of-interest delimitation or engineered features to estimate the extent of degeneration. This work presents a fully automated classification pipeline of bright-field images based on orientated gradient descriptors and machine learning techniques. An initial region-of-interest extraction is performed, applying morphological kernels and Euclidean distance-to-centroid thresholding. Image classification algorithms are trained on these regions (support vector machine, decision trees, random forest, and convolutional neural network), and their performance is evaluated on independent, unseen datasets. The combinations of oriented gradient + gaussian kernel Support Vector Machine [0.97 accuracy and 0.98 area under the curve (AUC)] and fine-tuned pre-trained convolutional neural network (0.98 accuracy and 0.99 AUC) yielded the best results overall. The proposed method provides a robust quantification framework that can be generalized to address the loss of regularity in biological patterns similar to the Drosophila eye surface and speeds up the processing of large sample batches.

Fundamentals of Microscopy

The light (or optical) microscope is the icon of science. The aphorism "seeing is believing" is often quoted in scientific papers involving microscopy. Unlike many scientific instruments, the light microscope will deliver an image however badly it is set up. Fluorescence microscopy is a widely used research tool across all disciplines of biological and biomedical science. Most universities and research institutions have microscopes, including confocal microscopes. This introductory paper in a series detailing advanced light microscopy techniques explains the foundations of both electron and light microscopy for biologists and life scientists working with the mouse. An explanation is given of how an image is formed. A description is given of how to set up a light microscope, whether it be a brightfield light microscope on the laboratory bench, a widefield fluorescence microscope, or a confocal microscope. These explanations are accompanied by operational protocols. A full explanation on how to set up and adjust a microscope according to the principles of Köhler illumination is given. The importance of Nyquist sampling is discussed. Guidelines are given on how to choose the best microscope to image the particular sample or slide preparation that you are working with. These are the basic principles of microscopy that a researcher must have an understanding of when operating core bioimaging facility instruments, in order to collect high-quality images. © 2020 The Authors. Basic Protocol 1: Setting up Köhler illumination for a brightfield microscope Basic Protocol 2: Aligning the fluorescence bulb and setting up Köhler illumination for a widefield fluorescence microscope Basic Protocol 3: Generic protocol for operating a confocal microscope.

Interacting adipose-derived stem cells and microvascular endothelial cells provide a beneficial milieu for soft tissue healing

There is growing evidence suggesting that healing of chronic soft tissue wounds profits from the presence of adipose-derived stem cells (ADSC). Among the large spectrum of mechanisms by which ADSC might act, especially the interaction with the microvascular endothelial cell, a main player during angiogenesis, is of special interest. In the present 2D model on the basis of endothelial cell ADSC co-cultures, we focused on the identification of characteristics of both cell types in response to a typical condition in acute and chronic wounds: hypoxia. Parameters like proliferation capacity, migration, myofibroblastoid differentiation of ADSC and the quantification of important paracrine factors related to angiogenesis and inflammation were used to correlate our experimental model with the in vivo situation of soft tissue healing. ADSC were not negatively affected by hypoxia in terms of proliferation, referring to their excellent hypoxia tolerance. Myofibroblastoid differentiation among ADSC was enhanced by hypoxia in mono- but not in co-culture. Furthermore, co-cultures were able to migrate under hypoxia. These effects might be caused to some extent by the distinct milieu created by interacting ADSC and endothelial cells, which was characterized by modulated levels of interleukin-6, interleukin-8, monocyte chemoattractant protein-1 and vascular endothelial growth factor. The identification of these cell characteristics in the present 2D in vitro model provide new insights into the process of human soft tissue healing, and underpin a beneficial role of ADSC by regulating inflammation and angiogenesis.

From observing to predicting single-cell structure and function with high-throughput/high-content microscopy

In the past 15 years, cell-based microscopy has evolved its focus from observing cell function to aiming to predict it. In particular-powered by breakthroughs in computer vision, large-scale image analysis and machine learning-high-throughput and high-content microscopy imaging have enabled to uniquely harness single-cell information to systematically discover and annotate genes and regulatory pathways, uncover systems-level interactions and causal links between cellular processes, and begin to clarify and predict causal cellular behaviour and decision making. Here we review these developments, discuss emerging trends in the field, and describe how single-cell 'omics and single-cell microscopy are imminently in an intersecting trajectory. The marriage of these two fields will make possible an unprecedented understanding of cell and tissue behaviour and function.

IMACEL: A cloud-based bioimage analysis platform for morphological analysis and image classification

Automated quantitative image analysis is essential for all fields of life science research. Although several software programs and algorithms have been developed for bioimage processing, an advanced knowledge of image processing techniques and high-performance computing resources are required to use them. Hence, we developed a cloud-based image analysis platform called IMACEL, which comprises morphological analysis and machine learning-based image classification. The unique click-based user interface of IMACEL’s morphological analysis platform enables researchers with limited resources to evaluate particles rapidly and quantitatively without prior knowledge of image processing. Because all the image processing and machine learning algorithms are performed on high-performance virtual machines, users can access the same analytical environment from anywhere. A validation study of the morphological analysis and image classification of IMACEL was performed. The results indicate that this platform is an accessible and potentially powerful tool for the quantitative evaluation of bioimages that will lower the barriers to life science research.

Arrayed functional genetic screenings in pluripotency reprogramming and differentiation

Thoroughly understanding the molecular mechanisms responsible for the biological properties of pluripotent stem cells, as well as for the processes involved in reprograming, differentiation, and transition between Naïve and Primed pluripotent states, is of great interest in basic and applied research. Although pluripotent cells have been extensively characterized in terms of their transcriptome and miRNome, a comprehensive understanding of how these gene products specifically impact their biology, depends on gain- or loss-of-function experimental approaches capable to systematically interrogate their function. We review all studies carried up to date that used arrayed screening approaches to explore the function of these genetic elements on those biological contexts, using focused or genome-wide genetic libraries. We further discuss the limitations and advantages of approaches based on assays with population-level primary readouts, derived from single-parameter plate readers, or cell-level primary readouts, obtained using multiparametric flow cytometry or quantitative fluorescence microscopy (i.e., high-content screening). Finally, we discuss technical limitation and future perspectives, highlighting how the integration of screening data may lead to major advances in the field of stem cell research and therapy.

Learning Generative Models of Tissue Organization with Supervised GANs

A key step in understanding the spatial organization of cells and tissues is the ability to construct generative models that accurately reflect that organization. In this paper, we focus on building generative models of electron microscope (EM) images in which the positions of cell membranes and mitochondria have been densely annotated, and propose a two-stage procedure that produces realistic images using Generative Adversarial Networks (or GANs) in a supervised way. In the first stage, we synthesize a label "image" given a noise "image" as input, which then provides supervision for EM image synthesis in the second stage. The full model naturally generates label-image pairs. We show that accurate synthetic EM images are produced using assessment via (1) shape features and global statistics, (2) segmentation accuracies, and (3) user studies. We also demonstrate further improvements by enforcing a reconstruction loss on intermediate synthetic labels and thus unifying the two stages into one single end-to-end framework.

Identification of SPPL2a Inhibitors by Multiparametric Analysis of a High-Content Ultra-High-Throughput Screen

The intramembrane protease signal peptide peptidase-like 2a (SPPL2a) is a potential drug target for the treatment of autoimmune diseases due to an essential role in B cells and dendritic cells. To screen a library of 1.4 million compounds for inhibitors of SPPL2a, we developed an imaging assay detecting nuclear translocation of the proteolytically released cytosolic substrate fragment. The state-of-the-art hit calling approach based on nuclear translocation resulted in numerous false-positive hits, mainly interrupting intracellular protein trafficking. To filter the false positives, we extracted 340 image-based readouts and developed a novel multiparametric analysis method that successfully triaged the primary hit list. The identified scaffolds were validated by demonstrating activity on endogenous SPPL2a and substrate CD74/p8 in B cells. The multiparametric analysis discovered diverse cellular phenotypes and provided profiles for the whole library. The principle of the presented imaging assay, the screening strategy, and multiparametric analysis are potentially applicable in future screening campaigns.