A Comparison of In Vitro Points of Departure with Human Blood Levels for Per- and Polyfluoroalkyl Substances (PFAS)

Per- and polyfluoroalkyl substances (PFAS) are widely used, and their fluorinated state contributes to unique uses and stability but also long half-lives in the environment and humans. PFAS have been shown to be toxic, leading to immunosuppression, cancer, and other adverse health outcomes. Only a small fraction of the PFAS in commerce have been evaluated for toxicity using in vivo tests, which leads to a need to prioritize which compounds to examine further. Here, we demonstrate a prioritization approach that combines human biomonitoring data (blood concentrations) with bioactivity data (concentrations at which bioactivity is observed in vitro) for 31 PFAS. The in vitro data are taken from a battery of cell-based assays, mostly run on human cells. The result is a Bioactive Concentration to Blood Concentration Ratio (BCBCR), similar to a margin of exposure (MoE). Chemicals with low BCBCR values could then be prioritized for further risk assessment. Using this method, two of the PFAS, PFOA (Perfluorooctanoic Acid) and PFOS (Perfluorooctane Sulfonic Acid), have BCBCR values < 1 for some populations. An additional 9 PFAS have BCBCR values < 100 for some populations. This study shows a promising approach to screening level risk assessments of compounds such as PFAS that are long-lived in humans and other species.

Exploring the effects of experimental parameters and data modeling approaches on in vitro transcriptomic point-of-departure estimates

Multiple new approach methods (NAMs) are being developed to rapidly screen large numbers of chemicals to aid in hazard evaluation and risk assessments. High-throughput transcriptomics (HTTr) in human cell lines has been proposed as a first-tier screening approach for determining the types of bioactivity a chemical can cause (activation of specific targets vs. generalized cell stress) and for calculating transcriptional points of departure (tPODs) based on changes in gene expression. In the present study, we examine a range of computational methods to calculate tPODs from HTTr data, using six data sets in which MCF7 cells cultured in two different media formulations were treated with a panel of 44 chemicals for 3 different exposure durations (6, 12, 24 hr). The tPOD calculation methods use data at the level of individual genes and gene set signatures, and compare data processed using the ToxCast Pipeline 2 (tcplfit2), BMDExpress and PLIER (Pathway Level Information ExtractoR). Methods were evaluated by comparing to in vitro PODs from a validated set of high-throughput screening (HTS) assays for a set of estrogenic compounds. Key findings include: (1) for a given chemical and set of experimental conditions, tPODs calculated by different methods can vary by several orders of magnitude; (2) tPODs are at least as sensitive to computational methods as to experimental conditions; (3) in comparison to an external reference set of PODs, some methods give generally higher values, principally PLIER and BMDExpress; and (4) the tPODs from HTTr in this one cell type are mostly higher than the overall PODs from a broad battery of targeted in vitro ToxCast assays, reflecting the need to test chemicals in multiple cell types and readout technologies for in vitro hazard screening.

Reproducibility of organ-level effects in repeat dose animal studies

This work estimates benchmarks for new approach method (NAM) performance in predicting organ-level effects in repeat dose studies of adult animals based on variability in replicate animal studies. Treatment-related effect values from the Toxicity Reference database (v2.1) for weight, gross, or histopathological changes in the adrenal gland, liver, kidney, spleen, stomach, and thyroid were used. Rates of chemical concordance among organ-level findings in replicate studies, defined by repeated chemical only, chemical and species, or chemical and study type, were calculated. Concordance was 39 - 88%, depending on organ, and was highest within species. Variance in treatment-related effect values, including lowest effect level (LEL) values and benchmark dose (BMD) values when available, was calculated by organ. Multilinear regression modeling, using study descriptors of organ-level effect values as covariates, was used to estimate total variance, mean square error (MSE), and root residual mean square error (RMSE). MSE values, interpreted as estimates of unexplained variance, suggest study descriptors accounted for 52-69% of total variance in organ-level LELs. RMSE ranged from 0.41 - 0.68 log10-mg/kg/day. Differences between organ-level effects from chronic (CHR) and subchronic (SUB) dosing regimens were also quantified. Odds ratios indicated CHR organ effects were unlikely if the SUB study was negative. Mean differences of CHR - SUB organ-level LELs ranged from -0.38 to -0.19 log10 mg/kg/day; the magnitudes of these mean differences were less than RMSE for replicate studies. Finally, in vitro to in vivo extrapolation (IVIVE) was employed to compare bioactive concentrations from in vitro NAMs for kidney and liver to LELs. The observed mean difference between LELs and mean IVIVE dose predictions approached 0.5 log10-mg/kg/day, but differences by chemical ranged widely. Overall, variability in repeat dose organ-level effects suggests expectations for quantitative accuracy of NAM prediction of LELs should be at least ± 1 log10-mg/kg/day, with qualitative accuracy not exceeding 70%.

A Machine Learning Model to Estimate Toxicokinetic Half-Lives of Per- and Polyfluoro-Alkyl Substances (PFAS) in Multiple Species

Per- and polyfluoroalkyl substances (PFAS) are a diverse group of man-made chemicals that are commonly found in body tissues. The toxicokinetics of most PFAS are currently uncharacterized, but long half-lives (t_½) have been observed in some cases. Knowledge of chemical-specific t_½ is necessary for exposure reconstruction and extrapolation from toxicological studies. We used an ensemble machine learning method, random forest, to model the existing in vivo measured t_½ across four species (human, monkey, rat, mouse) and eleven PFAS. Mechanistically motivated descriptors were examined, including two types of surrogates for renal transporters: (1) physiological descriptors, including kidney geometry, for renal transporter expression and (2) structural similarity of defluorinated PFAS to endogenous chemicals for transporter affinity. We developed a classification model for t_½ (Bin 1: <12 h; Bin 2: <1 week; Bin 3: <2 months; Bin 4: >2 months). The model had an accuracy of 86.1% in contrast to 32.2% for a y-randomized null model. A total of 3890 compounds were within domain of the model, and t_½ was predicted using the bin medians: 4.9 h, 2.2 days, 33 days, and 3.3 years. For human t_½, 56% of PFAS were classified in Bin 4, 7% were classified in Bin 3, and 37% were classified in Bin 2. This model synthesizes the limited available data to allow tentative extrapolation and prioritization.

Navigating Transcriptomic Connectivity Mapping Workflows to Link Chemicals with Bioactivities

Screening new compounds for potential bioactivities against cellular targets is vital for drug discovery and chemical safety. Transcriptomics offers an efficient approach for assessing global gene expression changes, but interpreting chemical mechanisms from these data is often challenging. Connectivity mapping is a potential data-driven avenue for linking chemicals to mechanisms based on the observation that many biological processes are associated with unique gene expression signatures (gene signatures). However, mining the effects of a chemical on gene signatures for biological mechanisms is challenging because transcriptomic data contain thousands of noisy genes. New connectivity mapping approaches seeking to distinguish signal from noise continue to be developed, spurred by the promise of discovering chemical mechanisms, new drugs, and disease targets from burgeoning transcriptomic data. Here, we analyze these approaches in terms of diverse transcriptomic technologies, public databases, gene signatures, pattern-matching algorithms, and statistical evaluation criteria. To navigate the complexity of connectivity mapping, we propose a harmonized scheme to coherently organize and compare published workflows. We first standardize concepts underlying transcriptomic profiles and gene signatures based on various transcriptomic technologies such as microarrays, RNA-Seq, and L1000 and discuss the widely used data sources such as Gene Expression Omnibus, ArrayExpress, and MSigDB. Next, we generalize connectivity mapping as a pattern-matching task for finding similarity between a query (e.g., transcriptomic profile for new chemical) and a reference (e.g., gene signature of known target). Published pattern-matching approaches fall into two main categories: vector-based use metrics like correlation, Jaccard index, etc., and aggregation-based use parametric and nonparametric statistics (e.g., gene set enrichment analysis). The statistical methods for evaluating the performance of different approaches are described, along with comparisons reported in the literature on benchmark transcriptomic data sets. Lastly, we review connectivity mapping applications in toxicology and offer guidance on evaluating chemical-induced toxicity with concentration-response transcriptomic data. In addition to serving as a high-level guide and tutorial for understanding and implementing connectivity mapping workflows, we hope this review will stimulate new algorithms for evaluating chemical safety and drug discovery using transcriptomic data.

Towards reproducible structure-based chemical categories for PFAS to inform and evaluate toxicity and toxicokinetic testing

Per- and Polyfluoroalkyl substances (PFAS) are a class of synthetic chemicals that are in widespread use and present concerns for persistence, bioaccumulation and toxicity. Whilst a handful of PFAS have been characterised for their hazard profiles, the vast majority of PFAS have not been studied. The US Environmental Protection Agency (EPA) undertook a research project to screen ~150 PFAS through an array of different in vitro high throughput toxicity and toxicokinetic tests in order to inform chemical category and read-across approaches. A previous publication described the rationale behind the selection of an initial set of 75 PFAS, whereas herein, we describe how various category approaches were applied and extended to inform the selection of a second set of 75 PFAS from our library of approximately 430 commercially procured PFAS. In particular, we focus on the challenges in grouping PFAS for prospective analysis and how we have sought to develop and apply objective structure-based categories to profile the testing library and other PFAS inventories. We additionally illustrate how these categories can be enriched with other information to facilitate read-across inferences once experimental data become available. The availability of flexible, objective, reproducible and chemically intuitive categories to explore PFAS constitutes an important step forward in prioritising PFAS for further testing and assessment.

Evaluating structure-based activity in a high-throughput assay for steroid biosynthesis

Data from a high-throughput human adrenocortical carcinoma assay (HT-H295R) for steroid hormone biosynthesis are available for >2000 chemicals in single concentration and 654 chemicals in multi-concentration (mc). Previously, a metric describing the effect size of a chemical on the biosynthesis of 11 hormones was derived using mc data referred to as the maximum mean Mahalanobis distance (maxmMd). However, mc HT-H295R assay data remain unavailable for many chemicals. This work leverages existing HT-H295R assay data by constructing structure-activity relationships to make predictions for data-poor chemicals, including: (1) identification of individual structural descriptors, known as ToxPrint chemotypes, associated with increased odds of affecting estrogen or androgen synthesis; (2) a random forest (RF) classifier using physicochemical property descriptors to predict HT-H295R maxmMd binary (positive or negative) outcomes; and, (3) a local approach to predict maxmMd binary outcomes using nearest neighbors (NNs) based on two types of chemical fingerprints (chemotype or Morgan). Individual chemotypes demonstrated high specificity (85-98%) for modulators of estrogen and androgen synthesis but with low sensitivity. The best RF model for maxmMd classification included 13 predicted physicochemical descriptors, yielding a balanced accuracy (BA) of 71% with only modest improvement when hundreds of structural features were added. The best two NN models for binary maxmMd prediction demonstrated BAs of 85 and 81% using chemotype and Morgan fingerprints, respectively. Using an external test set of 6302 chemicals (lacking HT-H295R data), 1241 were identified as putative estrogen and androgen modulators. Combined results across the three classification models (global RF model and two local NN models) predict that 1033 of the 6302 chemicals would be more likely to affect HT-H295R bioactivity. Together, these in silico approaches can efficiently prioritize thousands of untested chemicals for screening to further evaluate their effects on steroid biosynthesis.

Evaluation of a rapid, generic human gestational dose model

Chemical risk assessment considers potentially susceptible populations including pregnant women and developing fetuses. Humans encounter thousands of chemicals in their environments, few of which have been fully characterized. Toxicokinetic (TK) information is needed to relate chemical exposure to potentially bioactive tissue concentrations. Observational data describing human gestational exposures are unavailable for most chemicals, but physiologically based TK (PBTK) models estimate such exposures. Development of chemical-specific PBTK models requires considerable time and resources. As an alternative, generic PBTK approaches describe a standardized physiology and characterize chemicals with a set of standard physical and TK descriptors - primarily plasma protein binding and hepatic clearance. Here we report and evaluate a generic PBTK model of a human mother and developing fetus. We used a published set of formulas describing the major anatomical and physiological changes that occur during pregnancy to augment the High-Throughput Toxicokinetics (httk) software package. We simulated the ratio of concentrations in maternal and fetal plasma and compared to literature in vivo measurements. We evaluated the model with literature in vivo time-course measurements of maternal plasma concentrations in pregnant and non-pregnant women. Finally, we prioritized chemicals measured in maternal serum based on predicted fetal brain concentrations. This new model can be used for TK simulations of 859 chemicals with existing human-specific in vitro TK data as well as any new chemicals for which such data become available. This gestational model may allow for in vitro to in vivo extrapolation of point of departure doses relevant to reproductive and developmental toxicity.

Integrating publicly available information to screen potential candidates for chemical prioritization under the Toxic Substances Control Act: A proof of concept case study using genotoxicity and carcinogenicity

The Toxic Substances Control Act (TSCA) became law in the U.S. in 1976 and was amended in 2016. The amended law requires the U.S. EPA to perform risk-based evaluations of existing chemicals. Here, we developed a tiered approach to screen potential candidates based on their genotoxicity and carcinogenicity information to inform the selection of candidate chemicals for prioritization under TSCA. The approach was underpinned by a large database of carcinogenicity and genotoxicity information that had been compiled from various public sources. Carcinogenicity data included weight-of-evidence human carcinogenicity evaluations and animal cancer data. Genotoxicity data included bacterial gene mutation data from the Salmonella (Ames) and Escherichia coli WP2 assays and chromosomal mutation (clastogenicity) data. Additionally, Ames and clastogenicity outcomes were predicted using the alert schemes within the OECD QSAR Toolbox and the Toxicity Estimation Software Tool (TEST). The evaluation workflows for carcinogenicity and genotoxicity were developed along with associated scoring schemes to make an overall outcome determination. For this case study, two sets of chemicals, the TSCA Active Inventory non-confidential portion list available on the EPA CompTox Chemicals Dashboard (33,364 chemicals, 'TSCA Active List') and a representative proof-of-concept (POC) set of 238 chemicals were profiled through the two workflows to make determinations of carcinogenicity and genotoxicity potential. Of the 33,364 substances on the 'TSCA Active List', overall calls could be made for 20,371 substances. Here 46.67%% (9507) of substances were non-genotoxic, 0.5% (103) were scored as inconclusive, 43.93% (8949) were predicted genotoxic and 8.9% (1812) were genotoxic. Overall calls for genotoxicity could be made for 225 of the 238 POC chemicals. Of these, 40.44% (91) were non-genotoxic, 2.67% (6) were inconclusive, 6.22% (14) were predicted genotoxic, and 50.67% (114) genotoxic. The approach shows promise as a means to identify potential candidates for prioritization from a genotoxicity and carcinogenicity perspective.

Profiling the ToxCast Library With a Pluripotent Human (H9) Stem Cell Line-Based Biomarker Assay for Developmental Toxicity

The Stemina devTOX quickPredict platform is a human pluripotent stem cell-based assay that predicts the developmental toxicity potential based on changes in cellular metabolism following chemical exposure [Palmer, J. A., Smith, A. M., Egnash, L. A., Conard, K. R., West, P. R., Burrier, R. E., Donley, E. L. R., and Kirchner, F. R. (2013). Establishment and assessment of a new human embryonic stem cell-based biomarker assay for developmental toxicity screening. Birth Defects Res. B Dev. Reprod. Toxicol. 98, 343-363]. Using this assay, we screened 1065 ToxCast phase I and II chemicals in single-concentration or concentration-response for the targeted biomarker (ratio of ornithine to cystine secreted or consumed from the media). The dataset from the Stemina (STM) assay is annotated in the ToxCast portfolio as STM. Major findings from the analysis of ToxCast_STM dataset include (1) 19% of 1065 chemicals yielded a prediction of developmental toxicity, (2) assay performance reached 79%-82% accuracy with high specificity (> 84%) but modest sensitivity (< 67%) when compared with in vivo animal models of human prenatal developmental toxicity, (3) sensitivity improved as more stringent weights of evidence requirements were applied to the animal studies, and (4) statistical analysis of the most potent chemical hits on specific biochemical targets in ToxCast revealed positive and negative associations with the STM response, providing insights into the mechanistic underpinnings of the targeted endpoint and its biological domain. The results of this study will be useful to improving our ability to predict in vivo developmental toxicants based on in vitro data and in silico models.

High-Throughput Transcriptomics Platform for Screening Environmental Chemicals

New approach methodologies (NAMs) that efficiently provide information about chemical hazard without using whole animals are needed to accelerate the pace of chemical risk assessments. Technological advancements in gene expression assays have made in vitro high-throughput transcriptomics (HTTr) a feasible option for NAMs-based hazard characterization of environmental chemicals. In this study, we evaluated the Templated Oligo with Sequencing Readout (TempO-Seq) assay for HTTr concentration-response screening of a small set of chemicals in the human-derived MCF7 cell model. Our experimental design included a variety of reference samples and reference chemical treatments in order to objectively evaluate TempO-Seq assay performance. To facilitate analysis of these data, we developed a robust and scalable bioinformatics pipeline using open-source tools. We also developed a novel gene expression signature-based concentration-response modeling approach and compared the results to a previously implemented workflow for concentration-response analysis of transcriptomics data using BMDExpress. Analysis of reference samples and reference chemical treatments demonstrated highly reproducible differential gene expression signatures. In addition, we found that aggregating signals from individual genes into gene signatures prior to concentration-response modeling yielded in vitro transcriptional biological pathway altering concentrations (BPACs) that were closely aligned with previous ToxCast high-throughput screening assays. Often these identified signatures were associated with the known molecular target of the chemicals in our test set as the most sensitive components of the overall transcriptional response. This work has resulted in a novel and scalable in vitro HTTr workflow that is suitable for high-throughput hazard evaluation of environmental chemicals.

The Tox21 10K Compound Library: Collaborative Chemistry Advancing Toxicology

Since 2009, the Tox21 project has screened ∼8500 chemicals in more than 70 high-throughput assays, generating upward of 100 million data points, with all data publicly available through partner websites at the United States Environmental Protection Agency (EPA), National Center for Advancing Translational Sciences (NCATS), and National Toxicology Program (NTP). Underpinning this public effort is the largest compound library ever constructed specifically for improving understanding of the chemical basis of toxicity across research and regulatory domains. Each Tox21 federal partner brought specialized resources and capabilities to the partnership, including three approximately equal-sized compound libraries. All Tox21 data generated to date have resulted from a confluence of ideas, technologies, and expertise used to design, screen, and analyze the Tox21 10K library. The different programmatic objectives of the partners led to three distinct, overlapping compound libraries that, when combined, not only covered a diversity of chemical structures, use-categories, and properties but also incorporated many types of compound replicates. The history of development of the Tox21 "10K" chemical library and data workflows implemented to ensure quality chemical annotations and allow for various reproducibility assessments are described. Cheminformatics profiling demonstrates how the three partner libraries complement one another to expand the reach of each individual library, as reflected in coverage of regulatory lists, predicted toxicity end points, and physicochemical properties. ToxPrint chemotypes (CTs) and enrichment approaches further demonstrate how the combined partner libraries amplify structure-activity patterns that would otherwise not be detected. Finally, CT enrichments are used to probe global patterns of activity in combined ToxCast and Tox21 activity data sets relative to test-set size and chemical versus biological end point diversity, illustrating the power of CT approaches to discern patterns in chemical-activity data sets. These results support a central premise of the Tox21 program: A collaborative merging of programmatically distinct compound libraries would yield greater rewards than could be achieved separately.

The Tox21 10K Compound Library: Collaborative Chemistry Advancing Toxicology

Since 2009, the Tox21 project has screened ∼8500 chemicals in more than 70 high-throughput assays, generating upward of 100 million data points, with all data publicly available through partner websites at the United States Environmental Protection Agency (EPA), National Center for Advancing Translational Sciences (NCATS), and National Toxicology Program (NTP). Underpinning this public effort is the largest compound library ever constructed specifically for improving understanding of the chemical basis of toxicity across research and regulatory domains. Each Tox21 federal partner brought specialized resources and capabilities to the partnership, including three approximately equal-sized compound libraries. All Tox21 data generated to date have resulted from a confluence of ideas, technologies, and expertise used to design, screen, and analyze the Tox21 10K library. The different programmatic objectives of the partners led to three distinct, overlapping compound libraries that, when combined, not only covered a diversity of chemical structures, use-categories, and properties but also incorporated many types of compound replicates. The history of development of the Tox21 "10K" chemical library and data workflows implemented to ensure quality chemical annotations and allow for various reproducibility assessments are described. Cheminformatics profiling demonstrates how the three partner libraries complement one another to expand the reach of each individual library, as reflected in coverage of regulatory lists, predicted toxicity end points, and physicochemical properties. ToxPrint chemotypes (CTs) and enrichment approaches further demonstrate how the combined partner libraries amplify structure-activity patterns that would otherwise not be detected. Finally, CT enrichments are used to probe global patterns of activity in combined ToxCast and Tox21 activity data sets relative to test-set size and chemical versus biological end point diversity, illustrating the power of CT approaches to discern patterns in chemical-activity data sets. These results support a central premise of the Tox21 program: A collaborative merging of programmatically distinct compound libraries would yield greater rewards than could be achieved separately.

CoMPARA: Collaborative Modeling Project for Androgen Receptor Activity

BACKGROUND

Endocrine disrupting chemicals (EDCs) are xenobiotics that mimic the interaction of natural hormones and alter synthesis, transport, or metabolic pathways. The prospect of EDCs causing adverse health effects in humans and wildlife has led to the development of scientific and regulatory approaches for evaluating bioactivity. This need is being addressed using high-throughput screening (HTS) in vitro approaches and computational modeling.

OBJECTIVES

In support of the Endocrine Disruptor Screening Program, the U.S. Environmental Protection Agency (EPA) led two worldwide consortiums to virtually screen chemicals for their potential estrogenic and androgenic activities. Here, we describe the Collaborative Modeling Project for Androgen Receptor Activity (CoMPARA) efforts, which follows the steps of the Collaborative Estrogen Receptor Activity Prediction Project (CERAPP).

METHODS

The CoMPARA list of screened chemicals built on CERAPP's list of 32,464 chemicals to include additional chemicals of interest, as well as simulated ToxCast™ metabolites, totaling 55,450 chemical structures. Computational toxicology scientists from 25 international groups contributed 91 predictive models for binding, agonist, and antagonist activity predictions. Models were underpinned by a common training set of 1,746 chemicals compiled from a combined data set of 11 ToxCast™/Tox21 HTS in vitro assays.

RESULTS

The resulting models were evaluated using curated literature data extracted from different sources. To overcome the limitations of single-model approaches, CoMPARA predictions were combined into consensus models that provided averaged predictive accuracy of approximately 80% for the evaluation set.

DISCUSSION

The strengths and limitations of the consensus predictions were discussed with example chemicals; then, the models were implemented into the free and open-source OPERA application to enable screening of new chemicals with a defined applicability domain and accuracy assessment. This implementation was used to screen the entire EPA DSSTox database of ∼875,000 chemicals, and their predicted AR activities have been made available on the EPA CompTox Chemicals dashboard and National Toxicology Program's Integrated Chemical Environment. https://doi.org/10.1289/EHP5580.

CoMPARA: Collaborative Modeling Project for Androgen Receptor Activity

BACKGROUND

Endocrine disrupting chemicals (EDCs) are xenobiotics that mimic the interaction of natural hormones and alter synthesis, transport, or metabolic pathways. The prospect of EDCs causing adverse health effects in humans and wildlife has led to the development of scientific and regulatory approaches for evaluating bioactivity. This need is being addressed using high-throughput screening (HTS) in vitro approaches and computational modeling.

OBJECTIVES

In support of the Endocrine Disruptor Screening Program, the U.S. Environmental Protection Agency (EPA) led two worldwide consortiums to virtually screen chemicals for their potential estrogenic and androgenic activities. Here, we describe the Collaborative Modeling Project for Androgen Receptor Activity (CoMPARA) efforts, which follows the steps of the Collaborative Estrogen Receptor Activity Prediction Project (CERAPP).

METHODS

The CoMPARA list of screened chemicals built on CERAPP's list of 32,464 chemicals to include additional chemicals of interest, as well as simulated ToxCast™ metabolites, totaling 55,450 chemical structures. Computational toxicology scientists from 25 international groups contributed 91 predictive models for binding, agonist, and antagonist activity predictions. Models were underpinned by a common training set of 1,746 chemicals compiled from a combined data set of 11 ToxCast™/Tox21 HTS in vitro assays.

RESULTS

The resulting models were evaluated using curated literature data extracted from different sources. To overcome the limitations of single-model approaches, CoMPARA predictions were combined into consensus models that provided averaged predictive accuracy of approximately 80% for the evaluation set.

DISCUSSION

The strengths and limitations of the consensus predictions were discussed with example chemicals; then, the models were implemented into the free and open-source OPERA application to enable screening of new chemicals with a defined applicability domain and accuracy assessment. This implementation was used to screen the entire EPA DSSTox database of ∼ 875,000 chemicals, and their predicted AR activities have been made available on the EPA CompTox Chemicals dashboard and National Toxicology Program's Integrated Chemical Environment. https://doi.org/10.1289/EHP5580.

Ensemble QSAR Modeling to Predict Multispecies Fish Toxicity Lethal Concentrations and Points of Departure

QSAR modeling can be used to aid testing prioritization of the thousands of chemical substances for which no ecological toxicity data are available. We drew on the U.S. Environmental Protection Agency's ECOTOX database with additional data from ECHA to build a large data set containing in vivo test data on fish for thousands of chemical substances. This was used to create QSAR models to predict two types of end points: acute LC50 (median lethal concentration) and points of departure similar to the NOEC (no observed effect concentration) for any duration (named the "LC50" and "NOEC" models, respectively). These models used study covariates, such as species and exposure route, as features to facilitate the simultaneous use of varied data types. A novel method of substituting taxonomy groups for species dummy variables was introduced to maximize generalizability to different species. A stacked ensemble of three machine learning methods-random forest, gradient boosted trees, and support vector regression-was implemented to best make use of a large data set with many descriptors. The LC50 and NOEC models predicted end points within 1 order of magnitude 81% and 76% of the time, respectively, and had RMSEs of roughly 0.83 and 0.98 log10(mg/L), respectively. Benchmarks against the existing TEST and ECOSAR tools suggest improved prediction accuracy.

Progress in data interoperability to support computational toxicology and chemical safety evaluation

New approach methodologies (NAMs) in chemical safety evaluation are being explored to address the current public health implications of human environmental exposures to chemicals with limited or no data for assessment. For over a decade since a push toward "Toxicity Testing in the 21st Century," the field has focused on massive data generation efforts to inform computational approaches for preliminary hazard identification, adverse outcome pathways that link molecular initiating events and key events to apical outcomes, and high-throughput approaches to risk-based ratios of bioactivity and exposure to inform relative priority and safety assessment. Projects like the interagency Tox21 program and the US EPA ToxCast program have generated dose-response information on thousands of chemicals, identified and aggregated information from legacy systems, and created tools for access and analysis. The resulting information has been used to develop computational models as viable options for regulatory applications. This progress has introduced challenges in data management that are new, but not unique, to toxicology. Some of the key questions require critical thinking and solutions to promote semantic interoperability, including: (1) identification of bioactivity information from NAMs that might be related to a biological process; (2) identification of legacy hazard information that might be related to a key event or apical outcomes of interest; and, (3) integration of these NAM and traditional data for computational modeling and prediction of complex apical outcomes such as carcinogenesis. This work reviews a number of toxicology-related efforts specifically related to bioactivity and toxicological data interoperability based on the goals established by Findable, Accessible, Interoperable, and Reusable (FAIR) Data Principles. These efforts are essential to enable better integration of NAM and traditional toxicology information to support data-driven toxicology applications.

Characterizing cleft palate toxicants using ToxCast data, chemical structure, and the biomedical literature

Cleft palate has been linked to both genetic and environmental factors that perturb key events during palatal morphogenesis. As a developmental outcome, it presents a challenging, mechanistically complex endpoint for predictive modeling. A data set of 500 chemicals evaluated for their ability to induce cleft palate in animal prenatal developmental studies was compiled from Toxicity Reference Database and the biomedical literature, which included 63 cleft palate active and 437 inactive chemicals. To characterize the potential molecular targets for chemical-induced cleft palate, we mined the ToxCast high-throughput screening database for patterns and linkages in bioactivity profiles and chemical structural descriptors. ToxCast assay results were filtered for cytotoxicity and grouped by target gene activity to produce a "gene score." Following unsuccessful attempts to derive a global prediction model using structural and gene score descriptors, hierarchical clustering was applied to the set of 63 cleft palate positives to extract local structure-bioactivity clusters for follow-up study. Patterns of enrichment were confirmed on the complete data set, that is, including cleft palate inactives, and putative molecular initiating events identified. The clusters corresponded to ToxCast assays for cytochrome P450s, G-protein coupled receptors, retinoic acid receptors, the glucocorticoid receptor, and tyrosine kinases/phosphatases. These patterns and linkages were organized into preliminary decision trees and the resulting inferences were mapped to a putative adverse outcome pathway framework for cleft palate supported by literature evidence of current mechanistic understanding. This general data-driven approach offers a promising avenue for mining chemical-bioassay drivers of complex developmental endpoints where data are often limited.

The Next Generation Blueprint of Computational Toxicology at the U.S. Environmental Protection Agency

The U.S. Environmental Protection Agency (EPA) is faced with the challenge of efficiently and credibly evaluating chemical safety often with limited or no available toxicity data. The expanding number of chemicals found in commerce and the environment, coupled with time and resource requirements for traditional toxicity testing and exposure characterization, continue to underscore the need for new approaches. In 2005, EPA charted a new course to address this challenge by embracing computational toxicology (CompTox) and investing in the technologies and capabilities to push the field forward. The return on this investment has been demonstrated through results and applications across a range of human and environmental health problems, as well as initial application to regulatory decision-making within programs such as the EPA's Endocrine Disruptor Screening Program. The CompTox initiative at EPA is more than a decade old. This manuscript presents a blueprint to guide the strategic and operational direction over the next 5 years. The primary goal is to obtain broader acceptance of the CompTox approaches for application to higher tier regulatory decisions, such as chemical assessments. To achieve this goal, the blueprint expands and refines the use of high-throughput and computational modeling approaches to transform the components in chemical risk assessment, while systematically addressing key challenges that have hindered progress. In addition, the blueprint outlines additional investments in cross-cutting efforts to characterize uncertainty and variability, develop software and information technology tools, provide outreach and training, and establish scientific confidence for application to different public health and environmental regulatory decisions.

Predicting estrogen receptor activation by a group of substituted phenols: An integrated approach to testing and assessment case study

Traditional approaches for chemical risk assessment cannot keep pace with the number of substances requiring assessment. Thus, in a global effort to expedite and modernize chemical risk assessment, New Approach Methodologies (NAMs) are being explored and developed. Included in this effort is the OECD Integrated Approaches for Testing and Assessment (IATA) program, which provides a forum for OECD member countries to develop and present case studies illustrating the application of NAM in various risk assessment contexts. Here, we present an IATA case study for the prediction of estrogenic potential of three target phenols: 4-tert-butylphenol, 2,4-di-tert-butylphenol and octabenzone. Key features of this IATA include the use of two computational approaches for analogue selection for read-across, data collected from traditional and NAM sources, and a workflow to generate predictions regarding the targets' ability to bind the estrogen receptor (ER). Endocrine disruption can occur when a chemical substance mimics the activity of natural estrogen by binding to the ER and, if potency and exposure are sufficient, alters the function of the endocrine system to cause adverse effects. The data indicated that of the three target substances that were considered herein, 4-tert-butylphenol is a potential endocrine disruptor. Further, this IATA illustrates that the NAM approach explored is health protective when compared to in vivo endpoints traditionally used for human health risk assessment.

Empirical models for anatomical and physiological changes in a human mother and fetus during pregnancy and gestation

Many parameters treated as constants in traditional physiologically based pharmacokinetic models must be formulated as time-varying quantities when modeling pregnancy and gestation due to the dramatic physiological and anatomical changes that occur during this period. While several collections of empirical models for such parameters have been published, each has shortcomings. We sought to create a repository of empirical models for tissue volumes, blood flow rates, and other quantities that undergo substantial changes in a human mother and her fetus during the time between conception and birth, and to address deficiencies with similar, previously published repositories. We used maximum likelihood estimation to calibrate various models for the time-varying quantities of interest, and then used the Akaike information criterion to select an optimal model for each quantity. For quantities of interest for which time-course data were not available, we constructed composite models using percentages and/or models describing related quantities. In this way, we developed a comprehensive collection of formulae describing parameters essential for constructing a PBPK model of a human mother and her fetus throughout the approximately 40 weeks of pregnancy and gestation. We included models describing blood flow rates through various fetal blood routes that have no counterparts in adults. Our repository of mathematical models for anatomical and physiological quantities of interest provides a basis for PBPK models of human pregnancy and gestation, and as such, it can ultimately be used to support decision-making with respect to optimal pharmacological dosing and risk assessment for pregnant women and their developing fetuses. The views expressed in this article are those of the authors and do not necessarily represent the views or policies of the U.S. Environmental Protection Agency.

Development, validation and integration of in silico models to identify androgen active chemicals

Humans are exposed to large numbers of environmental chemicals, some of which potentially interfere with the endocrine system. The identification of potential endocrine disrupting chemicals (EDCs) has gained increasing priority in the assessment of environmental hazards. The U.S. Environmental Protection Agency (U.S. EPA) has developed the Endocrine Disruptor Screening Program (EDSP) which aims to prioritize and screen potential EDCs. The Toxicity Forecaster (ToxCast) program has generated data using in vitro high-throughput screening (HTS) assays measuring activity of chemicals at multiple points along the androgen receptor (AR) activity pathway. In the present study, using a large and diverse data set of 1667 chemicals provided by the U.S. EPA from the combined ToxCast AR assays in the framework of the Collaborative Modeling Project for Androgen Receptor Activity (CoMPARA). Two models were built using ADMET Predictor™; one is based on Artificial Neural Networks (ANNs) technology and the other uses a Support Vector Machine (SVM) algorithm; one model is a Decision Tree (DT) developed in R; and two models make use of differently combined sets of structural alerts (SAs) automatically extracted by SARpy. We used two strategies to integrate predictions from single models; one is based on a majority vote approach and the other on prediction convergence. These strategies led to enhanced statistical performance in most cases. Moreover, the majority vote approach improved prediction coverage when one or more single models were not able to provide any estimations. This study integrates multiple in silico approaches as a virtual screening tool for use in risk assessment of endocrine disrupting chemicals.

Workflow for defining reference chemicals for assessing performance of in vitro assays

Instilling confidence in use of in vitro assays for predictive toxicology requires evaluation of assay performance. Performance is typically assessed using reference chemicals--compounds with defined activity against the test system target. However, developing reference chemical lists has historically been very resource-intensive. We developed a semi-automated process for selecting and annotating reference chemicals across many targets in a standardized format and demonstrate the workflow here. A series of required fields defines the potential reference chemical: the in vitro molecular target, pathway, or phenotype affected; and the chemical's mode (e.g. agonist, antagonist, inhibitor). Activity information was computationally extracted into a database from multiple public sources including non-curated scientific literature and curated chemical-biological databases, resulting in the identification of chemical activity in 2995 biological targets. Sample data from literature sources covering 54 molecular targets ranging from data-poor to data-rich was manually checked for accuracy. Precision rates were 82.7% from curated data sources and 39.5% from automated literature extraction. We applied the final reference chemical lists to evaluating performance of EPA's ToxCast program in vitro bioassays. The level of support, i.e. the number of independent reports in the database linking a chemical to a target, was found to strongly correlate with likelihood of positive results in the ToxCast assays, although individual assay performance had considerable variation. This overall approach allows rapid development of candidate reference chemical lists for a wide variety of targets that can facilitate performance evaluation of in vitro assays as a critical step in imparting confidence in alternative approaches.

A Mechanistic Framework for Integrating Chemical Structure and High-Throughput Screening Results to Improve Toxicity Predictions

Adverse Outcome Pathways (AOPs) establish a connection between a molecular initiating event (MIE) and an adverse outcome. Detailed understanding of the MIE provides the ideal data for determining chemical properties required to elicit the MIE. This study utilized high-throughput screening data from the ToxCast program, coupled with chemical structural information, to generate chemical clusters using three similarity methods pertaining to nine MIEs within an AOP network for hepatic steatosis. Three case studies demonstrate the utility of the mechanistic information held by the MIE for integrating biological and chemical data. Evaluation of the chemical clusters activating the glucocorticoid receptor identified activity differences in chemicals within a cluster. Comparison of the estrogen receptor results with previous work showed that bioactivity data and structural alerts can be combined to improve predictions in a customizable way where bioactivity data are limited. The aryl hydrocarbon receptor (AHR) highlighted that while structural data can be used to offset limited data for new screening efforts, not all ToxCast targets have sufficient data to define robust chemical clusters. In this context, an alternative to additional receptor assays is proposed where assays for proximal key events downstream of AHR activation could be used to enhance confidence in active calls. These case studies illustrate how the AOP framework can support an iterative process whereby in vitro toxicity testing and chemical structure can be combined to improve toxicity predictions. In vitro assays can inform the development of structural alerts linking chemical structure to toxicity. Consequently, structurally related chemical groups can facilitate identification of assays that would be informative for a specific MIE. Together, these activities form a virtuous cycle where the mechanistic basis for the in vitro results and the breadth of the structural alerts continually improve over time to better predict activity of chemicals for which limited toxicity data exist.

Exploring non-linear distance metrics in the structure-activity space: QSAR models for human estrogen receptor

Background

Quantitative structure-activity relationship (QSAR) models are important tools used in discovering new drug candidates and identifying potentially harmful environmental chemicals. These models often face two fundamental challenges: limited amount of available biological activity data and noise or uncertainty in the activity data themselves. To address these challenges, we introduce and explore a QSAR model based on custom distance metrics in the structure-activity space.

Methods

The model is built on top of the k-nearest neighbor model, incorporating non-linearity not only in the chemical structure space, but also in the biological activity space. The model is tuned and evaluated using activity data for human estrogen receptor from the US EPA ToxCast and Tox21 databases.

Results

The model closely trails the CERAPP consensus model (built on top of 48 individual human estrogen receptor activity models) in agonist activity predictions and consistently outperforms the CERAPP consensus model in antagonist activity predictions.

Discussion

We suggest that incorporating non-linear distance metrics may significantly improve QSAR model performance when the available biological activity data are limited.

Electronic supplementary material

The online version of this article (10.1186/s13321-018-0300-0) contains supplementary material, which is available to authorized users.

Assessing bioactivity-exposure profiles of fruit and vegetable extracts in the BioMAP profiling system

The ToxCast program has generated in vitro screening data on over a thousand chemicals to assess potential disruption of important biological processes and assist in hazard identification and chemical testing prioritization. Few results have been reported for complex mixtures. To extend these ToxCast efforts to mixtures, we tested extracts from 30 organically grown fruits and vegetables in concentration-response in the BioMAP® assays. BioMAP systems use human primary cells primed with endogenous pathway activators to identify phenotypic perturbations related to proliferation, inflammation, immunomodulation, and tissue remodeling. Clustering of bioactivity profiles revealed separation of these produce extracts and ToxCast chemicals. Produce extracts elicited 87 assay endpoint responses per item compared to 20 per item for ToxCast chemicals. On a molar basis, the produce extracts were 10 to 50-fold less potent and when constrained to the maximum testing concentration of the ToxCast chemicals, the produce extracts did not show activity in as many assay endpoints. Using intake adjusted measures of dose, the bioactivity potential was higher for produce extracts than for agrichemicals, as expected based on the comparatively small amounts of agrichemical residues present on conventionally grown produce. The evaluation of BioMAP readouts and the dose responses for produce extracts showed qualitative and quantitative differences from results with single chemicals, highlighting challenges in the interpretation of bioactivity data and dose-response from complex mixtures.

Uncertainty quantification in ToxCast high throughput screening

High throughput screening (HTS) projects like the U.S. Environmental Protection Agency's ToxCast program are required to address the large and rapidly increasing number of chemicals for which we have little to no toxicity measurements. Concentration-response parameters such as potency and efficacy are extracted from HTS data using nonlinear regression, and models and analyses built from these parameters are used to predict in vivo and in vitro toxicity of thousands of chemicals. How these predictions are impacted by uncertainties that stem from parameter estimation and propagated through the models and analyses has not been well explored. While data size and complexity makes uncertainty quantification computationally expensive for HTS datasets, continued advancements in computational resources have allowed these computational challenges to be met. This study uses nonparametric bootstrap resampling to calculate uncertainties in concentration-response parameters from a variety of HTS assays. Using the ToxCast estrogen receptor model for bioactivity as a case study, we highlight how these uncertainties can be propagated through models to quantify the uncertainty in model outputs. Uncertainty quantification in model outputs is used to identify potential false positives and false negatives and to determine the distribution of model values around semi-arbitrary activity cutoffs, increasing confidence in model predictions. At the individual chemical-assay level, curves with high variability are flagged for manual inspection or retesting, focusing subject-matter-expert time on results that need further input. This work improves the confidence of predictions made using HTS data, increasing the ability to use this data in risk assessment.

High-Throughput H295R Steroidogenesis Assay: Utility as an Alternative and a Statistical Approach to Characterize Effects on Steroidogenesis

The U.S. Environmental Protection Agency Endocrine Disruptor Screening Program and the Organization for Economic Co-operation and Development (OECD) have used the human adrenocarcinoma (H295R) cell-based assay to predict chemical perturbation of androgen and estrogen production. Recently, a high-throughput H295R (HT-H295R) assay was developed as part of the ToxCast program that includes measurement of 11 hormones, including progestagens, corticosteroids, androgens, and estrogens. To date, 2012 chemicals have been screened at 1 concentration; of these, 656 chemicals have been screened in concentration-response. The objectives of this work were to: (1) develop an integrated analysis of chemical-mediated effects on steroidogenesis in the HT-H295R assay and (2) evaluate whether the HT-H295R assay predicts estrogen and androgen production specifically via comparison with the OECD-validated H295R assay. To support application of HT-H295R assay data to weight-of-evidence and prioritization tasks, a single numeric value based on Mahalanobis distances was computed for 654 chemicals to indicate the magnitude of effects on the synthesis of 11 hormones. The maximum mean Mahalanobis distance (maxmMd) values were high for strong modulators (prochloraz, mifepristone) and lower for moderate modulators (atrazine, molinate). Twenty-five of 28 reference chemicals used for OECD validation were screened in the HT-H295R assay, and produced qualitatively similar results, with accuracies of 0.90/0.75 and 0.81/0.91 for increased/decreased testosterone and estradiol production, respectively. The HT-H295R assay provides robust information regarding estrogen and androgen production, as well as additional hormones. The maxmMd from this integrated analysis may provide a data-driven approach to prioritizing lists of chemicals for putative effects on steroidogenesis.

OPERA models for predicting physicochemical properties and environmental fate endpoints

The collection of chemical structure information and associated experimental data for quantitative structure–activity/property relationship (QSAR/QSPR) modeling is facilitated by an increasing number of public databases containing large amounts of useful data. However, the performance of QSAR models highly depends on the quality of the data and modeling methodology used. This study aims to develop robust QSAR/QSPR models for chemical properties of environmental interest that can be used for regulatory purposes. This study primarily uses data from the publicly available PHYSPROP database consisting of a set of 13 common physicochemical and environmental fate properties. These datasets have undergone extensive curation using an automated workflow to select only high-quality data, and the chemical structures were standardized prior to calculation of the molecular descriptors. The modeling procedure was developed based on the five Organization for Economic Cooperation and Development (OECD) principles for QSAR models. A weighted k-nearest neighbor approach was adopted using a minimum number of required descriptors calculated using PaDEL, an open-source software. The genetic algorithms selected only the most pertinent and mechanistically interpretable descriptors (2–15, with an average of 11 descriptors). The sizes of the modeled datasets varied from 150 chemicals for biodegradability half-life to 14,050 chemicals for logP, with an average of 3222 chemicals across all endpoints. The optimal models were built on randomly selected training sets (75%) and validated using fivefold cross-validation (CV) and test sets (25%). The CV Q² of the models varied from 0.72 to 0.95, with an average of 0.86 and an R² test value from 0.71 to 0.96, with an average of 0.82. Modeling and performance details are described in QSAR model reporting format and were validated by the European Commission’s Joint Research Center to be OECD compliant. All models are freely available as an open-source, command-line application called OPEn structure–activity/property Relationship App (OPERA). OPERA models were applied to more than 750,000 chemicals to produce freely available predicted data on the U.S. Environmental Protection Agency’s CompTox Chemistry Dashboard.

tcpl: the ToxCast pipeline for high-throughput screening data

Motivation

Large high-throughput screening (HTS) efforts are widely used in drug development and chemical toxicity screening. Wide use and integration of these data can benefit from an efficient, transparent and reproducible data pipeline. Summary: The tcpl R package and its associated MySQL database provide a generalized platform for efficiently storing, normalizing and dose-response modeling of large high-throughput and high-content chemical screening data. The novel dose-response modeling algorithm has been tested against millions of diverse dose-response series, and robustly fits data with outliers and cytotoxicity-related signal loss.

Availability and Implementation

tcpl is freely available on the Comprehensive R Archive Network under the GPL-2 license.

Contact

martin.matt@epa.gov.

The CompTox Chemistry Dashboard: a community data resource for environmental chemistry

Despite an abundance of online databases providing access to chemical data, there is increasing demand for high-quality, structure-curated, open data to meet the various needs of the environmental sciences and computational toxicology communities. The U.S. Environmental Protection Agency's (EPA) web-based CompTox Chemistry Dashboard is addressing these needs by integrating diverse types of relevant domain data through a cheminformatics layer, built upon a database of curated substances linked to chemical structures. These data include physicochemical, environmental fate and transport, exposure, usage, in vivo toxicity, and in vitro bioassay data, surfaced through an integration hub with link-outs to additional EPA data and public domain online resources. Batch searching allows for direct chemical identifier (ID) mapping and downloading of multiple data streams in several different formats. This facilitates fast access to available structure, property, toxicity, and bioassay data for collections of chemicals (hundreds to thousands at a time). Advanced search capabilities are available to support, for example, non-targeted analysis and identification of chemicals using mass spectrometry. The contents of the chemistry database, presently containing ~ 760,000 substances, are available as public domain data for download. The chemistry content underpinning the Dashboard has been aggregated over the past 15 years by both manual and auto-curation techniques within EPA's DSSTox project. DSSTox chemical content is subject to strict quality controls to enforce consistency among chemical substance-structure identifiers, as well as list curation review to ensure accurate linkages of DSSTox substances to chemical lists and associated data. The Dashboard, publicly launched in April 2016, has expanded considerably in content and user traffic over the past year. It is continuously evolving with the growth of DSSTox into high-interest or data-rich domains of interest to EPA, such as chemicals on the Toxic Substances Control Act listing, while providing the user community with a flexible and dynamic web-based platform for integration, processing, visualization and delivery of data and resources. The Dashboard provides support for a broad array of research and regulatory programs across the worldwide community of toxicologists and environmental scientists.

On selecting a minimal set of in vitro assays to reliably determine estrogen agonist activity

The US EPA is charged with screening chemicals for their ability to be endocrine disruptors through interaction with the estrogen, androgen and thyroid axes. The agency is exploring the use of high-throughput in vitro assays to use in the Endocrine Disruptor Screening Program (EDSP), potentially as replacements for lower-throughput in vitro and in vivo tests. The first replacement is an integrated computational and experimental model for estrogen receptor (ER) activity, to be used as an alternative to the EDSP Tier 1 in vitro ER binding and transactivation assays and the in vivo uterotrophic bioassay. The ER agonist model uses a set of 16 in vitro assays that incorporate multiple technologies and cell lines and probe multiple points in the ER pathway. Here, we demonstrate that subsets of assays with as few as 4 assays can predict the activity of all 1811 chemicals tested with accuracy equivalent to that of the full 16-assay model. The prediction accuracy against reference chemicals is higher than that of the full chemical set, partly because the larger set contains many chemicals that can cause a variety of types of assay interference There are multiple accurate assay subsets, allowing flexibility in the construction of a multiplexed assay battery. We also discuss the issue of challenging chemicals, i.e. those that can give false positive results in certain assays, and could hence be more problematic when only a few assays are used.

Identifying environmental chemicals as agonists of the androgen receptor by using a quantitative high-throughput screening platform

The androgen receptor (AR, NR3C4) is a nuclear receptor whose main function is acting as a transcription factor regulating gene expression for male sexual development and maintaining accessory sexual organ function. It is also a necessary component of female fertility by affecting the functionality of ovarian follicles and ovulation. Pathological processes involving AR include Kennedy's disease and Klinefelter's syndrome, as well as prostate, ovarian, and testicular cancer. Strict regulation of sex hormone signaling is required for normal reproductive organ development and function. Therefore, testing small molecules for their ability to modulate AR is a first step in identifying potential endocrine disruptors. We screened the Tox21 10K compound library in a quantitative high-throughput format to identify activators of AR using two reporter gene cell lines, AR β-lactamase (AR-bla) and AR-luciferase (AR-luc). Seventy-five compounds identified through the primary assay were characterized as potential agonists or inactives through confirmation screens and secondary assays. Biochemical binding and AR nuclear translocation assays were performed to confirm direct binding and activation of AR from these compounds. The top seventeen compounds identified were found to bind to AR, and sixteen of them translocated AR from the cytoplasm into the nucleus. Five potentially novel or not well-characterized AR agonists were discovered through primary and follow-up studies. We have identified multiple AR activators, including known AR agonists such as testosterone, as well as novel/not well-known compounds such as prulifloxacin. The information gained from the current study can be directly used to prioritize compounds for further in-depth toxicological evaluations, as well as their potential to disrupt the endocrine system via AR activation.

Editor's Highlight: Genetic Targets of Acute Toluene Inhalation in Drosophila melanogaster

Interpretation and use of data from high-throughput assays for chemical toxicity require links between effects at molecular targets and adverse outcomes in whole animals. The well-characterized genome of Drosophila melanogaster provides a potential model system by which phenotypic responses to chemicals can be mapped to genes associated with those responses, which may in turn suggest adverse outcome pathways associated with those genes. To determine the utility of this approach, we used the Drosophila Genetics Reference Panel (DGRP), a collection of ∼200 homozygous lines of fruit flies whose genomes have been sequenced. We quantified toluene-induced suppression of motor activity in 123 lines of these flies during exposure to toluene, a volatile organic compound known to induce narcosis in mammals via its effects on neuronal ion channels. We then applied genome-wide association analyses on this effect of toluene using the DGRP web portal (http://dgrp2.gnets.ncsu.edu), which identified polymorphisms in candidate genes associated with the variation in response to toluene exposure. We tested ∼2 million variants and found 82 polymorphisms located in or near 66 candidate genes that were associated with phenotypic variation for sensitivity to toluene at P < 5 × 10-5, and human orthologs for 52 of these candidate Drosophila genes. None of these orthologs are known to be involved in canonical pathways for mammalian neuronal ion channels, including GABA, glutamate, dopamine, glycine, serotonin, and voltage sensitive calcium channels. Thus this analysis did not reveal a genetic signature consistent with processes previously shown to be involved in toluene-induced narcosis in mammals. The list of the human orthologs included Gene Ontology terms associated with signaling, nervous system development and embryonic morphogenesis; these orthologs may provide insight into potential new pathways that could mediate the narcotic effects of toluene.

Retrospective mining of toxicology data to discover multispecies and chemical class effects: Anemia as a case study

Predictive toxicity models rely on large amounts of accurate in vivo data. Here, we analyze the quality of in vivo data from the U.S. EPA Toxicity Reference Database (ToxRefDB), using chemical-induced anemia as an example. Considerations include variation in experimental conditions, changes in terminology over time, distinguishing negative from missing results, observer and diagnostic bias, and data transcription errors. Within ToxRefDB, we use hematological data on 658 chemicals tested in one or more of 1738 studies (subchronic rat or chronic rat, mouse, or dog). Anemia was reported most frequently in the rat subchronic studies, followed by chronic studies in dog, rat, and then mouse. Concordance between studies for a positive finding of anemia (same chemical, different laboratories) ranged from 90% (rat subchronic predicting rat chronic) to 40% (mouse chronic predicting rat chronic). Concordance increased with manual curation by 20% on average. We identified 49 chemicals that showed an anemia phenotype in at least two species. These included 14 aniline moiety-containing compounds that were further analyzed for their potential to be metabolically transformed into substituted anilines, which are known anemia-causing chemicals. This analysis should help inform future use of in vivo databases for model development.

tcpl: the ToxCast pipeline for high-throughput screening data

MOTIVATION

Large high-throughput screening (HTS) efforts are widely used in drug development and chemical toxicity screening. Wide use and integration of these data can benefit from an efficient, transparent and reproducible data pipeline. Summary: The tcpl R package and its associated MySQL database provide a generalized platform for efficiently storing, normalizing and dose-response modeling of large high-throughput and high-content chemical screening data. The novel dose-response modeling algorithm has been tested against millions of diverse dose-response series, and robustly fits data with outliers and cytotoxicity-related signal loss.

AVAILABILITY AND IMPLEMENTATION

tcpl is freely available on the Comprehensive R Archive Network under the GPL-2 license.

CONTACT

martin.matt@epa.gov.

In Silico Prediction of Physicochemical Properties of Environmental Chemicals Using Molecular Fingerprints and Machine Learning

There are little available toxicity data on the vast majority of chemicals in commerce. High-throughput screening (HTS) studies, such as those being carried out by the U.S. Environmental Protection Agency (EPA) ToxCast program in partnership with the federal Tox21 research program, can generate biological data to inform models for predicting potential toxicity. However, physicochemical properties are also needed to model environmental fate and transport, as well as exposure potential. The purpose of the present study was to generate an open-source quantitative structure-property relationship (QSPR) workflow to predict a variety of physicochemical properties that would have cross-platform compatibility to integrate into existing cheminformatics workflows. In this effort, decades-old experimental property data sets available within the EPA EPI Suite were reanalyzed using modern cheminformatics workflows to develop updated QSPR models capable of supplying computationally efficient, open, and transparent HTS property predictions in support of environmental modeling efforts. Models were built using updated EPI Suite data sets for the prediction of six physicochemical properties: octanol-water partition coefficient (logP), water solubility (logS), boiling point (BP), melting point (MP), vapor pressure (logVP), and bioconcentration factor (logBCF). The coefficient of determination (R2) between the estimated values and experimental data for the six predicted properties ranged from 0.826 (MP) to 0.965 (BP), with model performance for five of the six properties exceeding those from the original EPI Suite models. The newly derived models can be employed for rapid estimation of physicochemical properties within an open-source HTS workflow to inform fate and toxicity prediction models of environmental chemicals.

The Next Generation of Risk Assessment Multi-Year Study-Highlights of Findings, Applications to Risk Assessment, and Future Directions

BACKGROUND

The Next Generation (NexGen) of Risk Assessment effort is a multi-year collaboration among several organizations evaluating new, potentially more efficient molecular, computational, and systems biology approaches to risk assessment. This article summarizes our findings, suggests applications to risk assessment, and identifies strategic research directions.

OBJECTIVE

Our specific objectives were to test whether advanced biological data and methods could better inform our understanding of public health risks posed by environmental exposures.

METHODS

New data and methods were applied and evaluated for use in hazard identification and dose-response assessment. Biomarkers of exposure and effect, and risk characterization were also examined. Consideration was given to various decision contexts with increasing regulatory and public health impacts. Data types included transcriptomics, genomics, and proteomics. Methods included molecular epidemiology and clinical studies, bioinformatic knowledge mining, pathway and network analyses, short-duration in vivo and in vitro bioassays, and quantitative structure activity relationship modeling.

DISCUSSION

NexGen has advanced our ability to apply new science by more rapidly identifying chemicals and exposures of potential concern, helping characterize mechanisms of action that influence conclusions about causality, exposure-response relationships, susceptibility and cumulative risk, and by elucidating new biomarkers of exposure and effects. Additionally, NexGen has fostered extensive discussion among risk scientists and managers and improved confidence in interpreting and applying new data streams.

CONCLUSIONS

While considerable uncertainties remain, thoughtful application of new knowledge to risk assessment appears reasonable for augmenting major scope assessments, forming the basis for or augmenting limited scope assessments, and for prioritization and screening of very data limited chemicals. Citation: Cote I, Andersen ME, Ankley GT, Barone S, Birnbaum LS, Boekelheide K, Bois FY, Burgoon LD, Chiu WA, Crawford-Brown D, Crofton KM, DeVito M, Devlin RB, Edwards SW, Guyton KZ, Hattis D, Judson RS, Knight D, Krewski D, Lambert J, Maull EA, Mendrick D, Paoli GM, Patel CJ, Perkins EJ, Poje G, Portier CJ, Rusyn I, Schulte PA, Simeonov A, Smith MT, Thayer KA, Thomas RS, Thomas R, Tice RR, Vandenberg JJ, Villeneuve DL, Wesselkamper S, Whelan M, Whittaker C, White R, Xia M, Yauk C, Zeise L, Zhao J, DeWoskin RS. 2016. The Next Generation of Risk Assessment multiyear study-highlights of findings, applications to risk assessment, and future directions. Environ Health Perspect 124:1671-1682; http://dx.doi.org/10.1289/EHP233.

An automated curation procedure for addressing chemical errors and inconsistencies in public datasets used in QSAR modelling

The increasing availability of large collections of chemical structures and associated experimental data provides an opportunity to build robust QSAR models for applications in different fields. One common concern is the quality of both the chemical structure information and associated experimental data. Here we describe the development of an automated KNIME workflow to curate and correct errors in the structure and identity of chemicals using the publicly available PHYSPROP physicochemical properties and environmental fate datasets. The workflow first assembles structure-identity pairs using up to four provided chemical identifiers, including chemical name, CASRNs, SMILES, and MolBlock. Problems detected included errors and mismatches in chemical structure formats, identifiers and various structure validation issues, including hypervalency and stereochemistry descriptions. Subsequently, a machine learning procedure was applied to evaluate the impact of this curation process. The performance of QSAR models built on only the highest-quality subset of the original dataset was compared with the larger curated and corrected dataset. The latter showed statistically improved predictive performance. The final workflow was used to curate the full list of PHYSPROP datasets, and is being made publicly available for further usage and integration by the scientific community.

ToxCast Chemical Landscape: Paving the Road to 21st Century Toxicology

The U.S. Environmental Protection Agency's (EPA) ToxCast program is testing a large library of Agency-relevant chemicals using in vitro high-throughput screening (HTS) approaches to support the development of improved toxicity prediction models. Launched in 2007, Phase I of the program screened 310 chemicals, mostly pesticides, across hundreds of ToxCast assay end points. In Phase II, the ToxCast library was expanded to 1878 chemicals, culminating in the public release of screening data at the end of 2013. Subsequent expansion in Phase III has resulted in more than 3800 chemicals actively undergoing ToxCast screening, 96% of which are also being screened in the multi-Agency Tox21 project. The chemical library unpinning these efforts plays a central role in defining the scope and potential application of ToxCast HTS results. The history of the phased construction of EPA's ToxCast library is reviewed, followed by a survey of the library contents from several different vantage points. CAS Registry Numbers are used to assess ToxCast library coverage of important toxicity, regulatory, and exposure inventories. Structure-based representations of ToxCast chemicals are then used to compute physicochemical properties, substructural features, and structural alerts for toxicity and biotransformation. Cheminformatics approaches using these varied representations are applied to defining the boundaries of HTS testability, evaluating chemical diversity, and comparing the ToxCast library to potential target application inventories, such as used in EPA's Endocrine Disruption Screening Program (EDSP). Through several examples, the ToxCast chemical library is demonstrated to provide comprehensive coverage of the knowledge domains and target inventories of potential interest to EPA. Furthermore, the varied representations and approaches presented here define local chemistry domains potentially worthy of further investigation (e.g., not currently covered in the testing library or defined by toxicity "alerts") to strategically support data mining and predictive toxicology modeling moving forward.

CERAPP: Collaborative Estrogen Receptor Activity Prediction Project

BACKGROUND

Humans are exposed to thousands of man-made chemicals in the environment. Some chemicals mimic natural endocrine hormones and, thus, have the potential to be endocrine disruptors. Most of these chemicals have never been tested for their ability to interact with the estrogen receptor (ER). Risk assessors need tools to prioritize chemicals for evaluation in costly in vivo tests, for instance, within the U.S. EPA Endocrine Disruptor Screening Program.

OBJECTIVES

We describe a large-scale modeling project called CERAPP (Collaborative Estrogen Receptor Activity Prediction Project) and demonstrate the efficacy of using predictive computational models trained on high-throughput screening data to evaluate thousands of chemicals for ER-related activity and prioritize them for further testing.

METHODS

CERAPP combined multiple models developed in collaboration with 17 groups in the United States and Europe to predict ER activity of a common set of 32,464 chemical structures. Quantitative structure-activity relationship models and docking approaches were employed, mostly using a common training set of 1,677 chemical structures provided by the U.S. EPA, to build a total of 40 categorical and 8 continuous models for binding, agonist, and antagonist ER activity. All predictions were evaluated on a set of 7,522 chemicals curated from the literature. To overcome the limitations of single models, a consensus was built by weighting models on scores based on their evaluated accuracies.

RESULTS

Individual model scores ranged from 0.69 to 0.85, showing high prediction reliabilities. Out of the 32,464 chemicals, the consensus model predicted 4,001 chemicals (12.3%) as high priority actives and 6,742 potential actives (20.8%) to be considered for further testing.

CONCLUSION

This project demonstrated the possibility to screen large libraries of chemicals using a consensus of different in silico approaches. This concept will be applied in future projects related to other end points.

CITATION

Mansouri K, Abdelaziz A, Rybacka A, Roncaglioni A, Tropsha A, Varnek A, Zakharov A, Worth A, Richard AM, Grulke CM, Trisciuzzi D, Fourches D, Horvath D, Benfenati E, Muratov E, Wedebye EB, Grisoni F, Mangiatordi GF, Incisivo GM, Hong H, Ng HW, Tetko IV, Balabin I, Kancherla J, Shen J, Burton J, Nicklaus M, Cassotti M, Nikolov NG, Nicolotti O, Andersson PL, Zang Q, Politi R, Beger RD, Todeschini R, Huang R, Farag S, Rosenberg SA, Slavov S, Hu X, Judson RS. 2016.

CERAPP

Collaborative Estrogen Receptor Activity Prediction Project. Environ Health Perspect 124:1023-1033; http://dx.doi.org/10.1289/ehp.1510267.

Systems Toxicology of Male Reproductive Development: Profiling 774 Chemicals for Molecular Targets and Adverse Outcomes

BACKGROUND

Trends in male reproductive health have been reported for increased rates of testicular germ cell tumors, low semen quality, cryptorchidism, and hypospadias, which have been associated with prenatal environmental chemical exposure based on human and animal studies.

OBJECTIVE

In the present study we aimed to identify significant correlations between environmental chemicals, molecular targets, and adverse outcomes across a broad chemical landscape with emphasis on developmental toxicity of the male reproductive system.

METHODS

We used U.S. EPA's animal study database (ToxRefDB) and a comprehensive literature analysis to identify 774 chemicals that have been evaluated for adverse effects on male reproductive parameters, and then used U.S. EPA's in vitro high-throughput screening (HTS) database (ToxCastDB) to profile their bioactivity across approximately 800 molecular and cellular features.

RESULTS

A phenotypic hierarchy of testicular atrophy, sperm effects, tumors, and malformations, a composite resembling the human testicular dysgenesis syndrome (TDS) hypothesis, was observed in 281 chemicals. A subset of 54 chemicals with male developmental consequences had in vitro bioactivity on molecular targets that could be condensed into 156 gene annotations in a bipartite network.

CONCLUSION

Computational modeling of available in vivo and in vitro data for chemicals that produce adverse effects on male reproductive end points revealed a phenotypic hierarchy across animal studies consistent with the human TDS hypothesis. We confirmed the known role of estrogen and androgen signaling pathways in rodent TDS, and importantly, broadened the list of molecular targets to include retinoic acid signaling, vascular remodeling proteins, G-protein coupled receptors (GPCRs), and cytochrome P450s.

CITATION

Leung MC, Phuong J, Baker NC, Sipes NS, Klinefelter GR, Martin MT, McLaurin KW, Setzer RW, Darney SP, Judson RS, Knudsen TB. 2016. Systems toxicology of male reproductive development: profiling 774 chemicals for molecular targets and adverse outcomes. Environ Health Perspect 124:1050-1061; http://dx.doi.org/10.1289/ehp.1510385.

Using ToxCast™ Data to Reconstruct Dynamic Cell State Trajectories and Estimate Toxicological Points of Departure

BACKGROUND

High-content imaging (HCI) allows simultaneous measurement of multiple cellular phenotypic changes and is an important tool for evaluating the biological activity of chemicals.

OBJECTIVES

Our goal was to analyze dynamic cellular changes using HCI to identify the "tipping point" at which the cells did not show recovery towards a normal phenotypic state.

METHODS

HCI was used to evaluate the effects of 967 chemicals (in concentrations ranging from 0.4 to 200 μM) on HepG2 cells over a 72-hr exposure period. The HCI end points included p53, c-Jun, histone H2A.x, α-tubulin, histone H3, alpha tubulin, mitochondrial membrane potential, mitochondrial mass, cell cycle arrest, nuclear size, and cell number. A computational model was developed to interpret HCI responses as cell-state trajectories.

RESULTS

Analysis of cell-state trajectories showed that 336 chemicals produced tipping points and that HepG2 cells were resilient to the effects of 334 chemicals up to the highest concentration (200 μM) and duration (72 hr) tested. Tipping points were identified as concentration-dependent transitions in system recovery, and the corresponding critical concentrations were generally between 5 and 15 times (25th and 75th percentiles, respectively) lower than the concentration that produced any significant effect on HepG2 cells. The remaining 297 chemicals require more data before they can be placed in either of these categories.

CONCLUSIONS

These findings show the utility of HCI data for reconstructing cell state trajectories and provide insight into the adaptation and resilience of in vitro cellular systems based on tipping points. Cellular tipping points could be used to define a point of departure for risk-based prioritization of environmental chemicals.

CITATION

Shah I, Setzer RW, Jack J, Houck KA, Judson RS, Knudsen TB, Liu J, Martin MT, Reif DM, Richard AM, Thomas RS, Crofton KM, Dix DJ, Kavlock RJ. 2016. Using ToxCast™ data to reconstruct dynamic cell state trajectories and estimate toxicological points of departure. Environ Health Perspect 124:910-919; http://dx.doi.org/10.1289/ehp.1409029.