Identification and correction of spatial bias are essential for obtaining quality data in high-throughput screening technologies

Virtual plates: Getting the best out of high content screens

High content screening (HCS) is becoming widely adopted as a high throughput screening modality, using hundred-of-thousands compounds library. The use of machine learning and artificial intelligence in image analysis is amplifying this trend. Another factor is the recognition that diverse cell phenotypes can be associated with changes in biological pathways relevant to disease processes. There are numerous challenges in HCS campaigns. These include limited ability to support replicates, low availability of precious and unique cells or reagents, high number of experimental batches, lengthy preparation of cells for imaging, image acquisition time (45-60 min per plate) and image processing time, deterioration of image quality with time post cell fixation and variability within wells and batches. To take advantage of the data in HCS, cell population based rather than well-based analyses are required. Historically, statistical analysis and hypothesis testing played only a limited role in non-high content high throughput campaigns. Thus, only a limited number of standard statistical criteria for hit selection in HCS have been developed so far. In addition to complex biological content in HCS campaigns, additional variability is impacted by cell and reagent handling and by instruments which may malfunction or perform unevenly. Together these can cause a significant number of wells or plates to fail. Here we describe an automated approach for hit analysis and detection in HCS. Our approach automates HCS hit detection using a methodology that is based on a documented statistical framework. We introduce the Virtual Plate concept in which selected wells from different plates are collated into a new, virtual plate. This allows the rescue and analysis of compound wells which have failed due to technical issues as well as to collect hit wells into one plate, allowing the user easier access to the hit data.

A 384-Well Microtiter Plate Model for Candida Biofilm Formation and Its Application to High-Throughput Screening

Candidiasis, infections caused by Candida spp., represents one of the most common nosocomial infections afflicting an expanding number of compromised patients. Antifungal therapeutic options are few and show limited efficacy. Moreover, biofilm formation is frequently associated with different manifestations of candidiasis and further complicates therapy. Thus, there is an urgent need for new effective therapeutic agents, particularly those with anti-biofilm activity. Here we describe the development of a novel, simple, fast, economical, and highly reproducible 384-well microtiter plate model for the formation of both Candida albicans and Candida auris biofilms and its application in high-throughput screening (HTS) techniques.

DUNEScan: a web server for uncertainty estimation in skin cancer detection with deep neural networks

Recent years have seen a steep rise in the number of skin cancer detection applications. While modern advances in deep learning made possible reaching new heights in terms of classification accuracy, no publicly available skin cancer detection software provide confidence estimates for these predictions. We present DUNEScan (Deep Uncertainty Estimation for Skin Cancer), a web server that performs an intuitive in-depth analysis of uncertainty in commonly used skin cancer classification models based on convolutional neural networks (CNNs). DUNEScan allows users to upload a skin lesion image, and quickly compares the mean and the variance estimates provided by a number of new and traditional CNN models. Moreover, our web server uses the Grad-CAM and UMAP algorithms to visualize the classification manifold for the user’s input, hence providing crucial information about its closeness to skin lesion images  from the popular ISIC database. DUNEScan is freely available at: https://www.dunescan.org.

Organoids in image-based phenotypic chemical screens

Image-based phenotypic screening relies on the extraction of multivariate information from cells cultured under a large variety of conditions. Technical advances in high-throughput microscopy enable screening in increasingly complex and biologically relevant model systems. To this end, organoids hold great potential for high-content screening because they recapitulate many aspects of parent tissues and can be derived from patient material. However, screening is substantially more difficult in organoids than in classical cell lines from both technical and analytical standpoints. In this review, we present an overview of studies employing organoids for screening applications. We discuss the promises and challenges of small-molecule treatments in organoids and give practical advice on designing, running, and analyzing high-content organoid-based phenotypic screens.

Spatial Bias in Antibody Microarrays May Be an Underappreciated Source of Variability

Antibody microarrays enable multiplexed protein detection with minimal reagent consumption, but they continue to be plagued by lack of reproducibility. Chemically functionalized glass slides are used as substrates, yet antibody binding spatial inhomogeneity across the slide has not been analyzed in antibody microarrays. Here, we characterize spatial bias across five commercial slides patterned with nine overlapping dense arrays (by combining three buffers and three different antibodies), and we measure signal variation for both antibody immobilization and the assay signal, generating 270 heatmaps. Spatial bias varied across models, and the coefficient of variation ranged from 4.6 to 50%, which was unexpectedly large. Next, we evaluated three layouts of spot replicates-local, random, and structured random-for their capacity to predict assay variation. Local replicates are widely used but systematically underestimate the whole-slide variation by up to seven times; structured random replicates gave the most accurate estimation. Our results highlight the risk and consequences of using local replicates: the underappreciation of spatial bias as a source of variability, poor assay reproducibility, and possible overconfidence in assay results. We recommend the detailed characterization of spatial bias for antibody microarrays and the description and use of distributed positive replicates for research and clinical applications.

Dose-response modeling in high-throughput cancer drug screenings: an end-to-end approach

Personalized cancer treatments based on the molecular profile of a patient's tumor are an emerging and exciting class of treatments in oncology. As genomic tumor profiling is becoming more common, targeted treatments for specific molecular alterations are gaining traction. To discover new potential therapeutics that may apply to broad classes of tumors matching some molecular pattern, experimentalists and pharmacologists rely on high-throughput, in vitro screens of many compounds against many different cell lines. We propose a hierarchical Bayesian model of how cancer cell lines respond to drugs in these experiments and develop a method for fitting the model to real-world high-throughput screening data. Through a case study, the model is shown to capture nontrivial associations between molecular features and drug response, such as requiring both wild type TP53 and overexpression of MDM2 to be sensitive to Nutlin-3(a). In quantitative benchmarks, the model outperforms a standard approach in biology, with $\approx20\%$ lower predictive error on held out data. When combined with a conditional randomization testing procedure, the model discovers markers of therapeutic response that recapitulate known biology and suggest new avenues for investigation. All code for the article is publicly available at https://github.com/tansey/deep-dose-response.

Statistical models for identifying frequent hitters in high throughput screening

High throughput screening (HTS) interrogates compound libraries to find those that are “active” in an assay. To better understand compound behavior in HTS, we assessed an existing binomial survivor function (BSF) model of “frequent hitters” using 872 publicly available HTS data sets. We found large numbers of “infrequent hitters” using this model leading us to reject the BSF for identifying “frequent hitters.” As alternatives, we investigated generalized logistic, gamma, and negative binomial distributions as models for compound behavior. The gamma model reduced the proportion of both frequent and infrequent hitters relative to the BSF. Within this data set, conclusions about individual compound behavior were limited by the number of times individual compounds were tested (1–1613 times) and disproportionate testing of some compounds. Specifically, most tests (78%) were on a 309,847-compound subset (17.6% of compounds) each tested ≥ 300 times. We concluded that the disproportionate retesting of some compounds represents compound repurposing at scale rather than drug discovery. The approach to drug discovery represented by these 872 data sets characterizes the assays well by challenging them with many compounds while each compound is characterized poorly with a single assay. Aggregating the testing information from each compound across the multiple screens yielded a continuum with no clear boundary between normal and frequent hitting compounds.

Probe-target hybridization depends on spatial uniformity of initial concentration condition across large-format chips

Diverse assays spanning from immunohistochemistry (IHC), to microarrays (protein, DNA), to high-throughput screens rely on probe-target hybridization to detect analytes. These large-format 'chips' array numerous hybridization sites across centimeter-scale areas. However, the reactions are prone to intra-assay spatial variation in hybridization efficiency. The mechanism of spatial bias in hybridization efficiency is poorly understood, particularly in IHC and in-gel immunoassays, where immobilized targets are heterogeneously distributed throughout a tissue or hydrogel network. In these systems, antibody probe hybridization to a target protein antigen depends on the interplay of dilution, thermodynamic partitioning, diffusion, and reaction. Here, we investigate parameters governing antibody probe transport and reaction (i.e., immunoprobing) in a large-format hydrogel immunoassay. Using transport and bimolecular binding theory, we identify a regime in which immunoprobing efficiency (η) is sensitive to the local concentration of applied antibody probe solution, despite the antibody probe being in excess compared to antigen. Sandwiching antibody probe solution against the hydrogel surface yields spatially nonuniform dilution. Using photopatterned fluorescent protein targets and a single-cell immunoassay, we identify regimes in which nonuniformly distributed antibody probe solution causes intra-assay variation in background and η. Understanding the physicochemical factors affecting probe-target hybridization reduces technical variation in large-format chips, improving measurement precision.

A Multi-center Study on the Reproducibility of Drug-Response Assays in Mammalian Cell Lines

Evidence that some high-impact biomedical results cannot be repeated has stimulated interest in practices that generate findable, accessible, interoperable, and reusable (FAIR) data. Multiple papers have identified specific examples of irreproducibility, but practical ways to make data more reproducible have not been widely studied. Here, five research centers in the NIH LINCS Program Consortium investigate the reproducibility of a prototypical perturbational assay: quantifying the responsiveness of cultured cells to anti-cancer drugs. Such assays are important for drug development, studying cellular networks, and patient stratification. While many experimental and computational factors impact intra- and inter-center reproducibility, the factors most difficult to identify and control are those with a strong dependency on biological context. These factors often vary in magnitude with the drug being analyzed and with growth conditions. We provide ways to identify such context-sensitive factors, thereby improving both the theory and practice of reproducible cell-based assays.

Factors that impact the reproducibility of experimental data are poorly understood. Five NIH-LINCS centers performed the same set of drug-response measurements and compared results. Technical and biological variables that impact precision and reproducibility and are also sensitive to biological context were the most problematic.

The Distribution of Standard Deviations Applied to High Throughput Screening

High throughput screening (HTS) assesses compound libraries for “activity” using target assays. A subset of HTS data contains a large number of sample measurements replicated a small number of times providing an opportunity to introduce the distribution of standard deviations (DSD). Applying the DSD to some HTS data sets revealed signs of bias in some of the data and discovered a sub-population of compounds exhibiting high variability which may be difficult to screen. In the data examined, 21% of 1189 such compounds were pan-assay interference compounds. This proportion reached 57% for the most closely related compounds within the sub-population. Using the DSD, large HTS data sets can be modelled in many cases as two distributions: a large group of nearly normally distributed “inactive” compounds and a residual distribution of “active” compounds. The latter were not normally distributed, overlapped inactive distributions – on both sides –, and were larger than typically assumed. As such, a large number of compounds are being misclassified as “inactive” or are invisible to current methods which could become the next generation of drugs. Although applied here to HTS, it is applicable to data sets with a large number of samples measured a small number of times.

Identification and Correction of Additive and Multiplicative Spatial Biases in Experimental High-Throughput Screening

Data generated by high-throughput screening (HTS) technologies are prone to spatial bias. Traditionally, bias correction methods used in HTS assume either a simple additive or, more recently, a simple multiplicative spatial bias model. These models do not, however, always provide an accurate correction of measurements in wells located at the intersection of rows and columns affected by spatial bias. The measurements in these wells depend on the nature of interaction between the involved biases. Here, we propose two novel additive and two novel multiplicative spatial bias models accounting for different types of bias interactions. We describe a statistical procedure that allows for detecting and removing different types of additive and multiplicative spatial biases from multiwell plates. We show how this procedure can be applied by analyzing data generated by the four HTS technologies (homogeneous, microorganism, cell-based, and gene expression HTS), the three high-content screening (HCS) technologies (area, intensity, and cell-count HCS), and the only small-molecule microarray technology available in the ChemBank small-molecule screening database. The proposed methods are included in the AssayCorrector program, implemented in R, and available on CRAN.