An integrated chemical environment with tools for chemical safety testing

Community-Engaged Research and the Use of Open Access ToxVal/ToxRef In Vivo Databases and New Approach Methodologies (NAM) to Address Human Health Risks From Environmental Contaminants

BACKGROUND

The paper analyzes opportunities for integrating Open access resources (Abstract Sifter, US EPA and NTP Toxicity Value and Toxicity Reference [ToxVal/ToxRefDB]) and New Approach Methodologies (NAM) integration into Community Engaged Research (CEnR).

METHODS

CompTox Chemicals Dashboard and Integrated Chemical Environment with in vivo ToxVal/ToxRef and NAMs (in vitro) databases are presented in three case studies to show how these resources could be used in Pilot Projects involving Community Engaged Research (CEnR) from the University of California, Davis, Environmental Health Sciences Center.

RESULTS

Case #1 developed a novel assay methodology for testing pesticide toxicity. Case #2 involved detection of water contaminants from wildfire ash and Case #3 involved contaminants on Tribal Lands. Abstract Sifter/ToxVal/ToxRefDB regulatory data and NAMs could be used to screen/prioritize risks from exposure to metals, PAHs and PFAS from wildfire ash leached into water and to investigate activities of environmental toxins (e.g., pesticides) on Tribal lands. Open access NAMs and computational tools can apply to detection of sensitive biological activities in potential or known adverse outcome pathways to predict points of departure (POD) for comparison with regulatory values for hazard identification. Open access Systematic Empirical Evaluation of Models or biomonitoring exposures are available for human subpopulations and can be used to determine bioactivity (POD) to exposure ratio to facilitate mitigation.

CONCLUSIONS

These resources help prioritize chemical toxicity and facilitate regulatory decisions and health protective policies that can aid stakeholders in deciding on needed research. Insights into exposure risks can aid environmental justice and health equity advocates.

Combined Exposures and Mixtures Research: An Enduring NIEHS Priority

BACKGROUND

The National Institute of Environmental Health Sciences (NIEHS) continues to prioritize research to better understand the health effects resulting from exposure to mixtures of chemical and nonchemical stressors. Mixtures research activities over the last decade were informed by expert input during the development and deliberations of the 2011 NIEHS Workshop "Advancing Research on Mixtures: New Perspectives and Approaches for Predicting Adverse Human Health Effects." NIEHS mixtures research efforts since then have focused on key themes including a) prioritizing mixtures for study, b) translating mixtures data from in vitro and in vivo studies, c) developing cross-disciplinary collaborations, d) informing component-based and whole-mixture assessment approaches, e) developing sufficient similarity methods to compare across complex mixtures, f) using systems-based approaches to evaluate mixtures, and g) focusing on management and integration of mixtures-related data.

OBJECTIVES

We aimed to describe NIEHS driven research on mixtures and combined exposures over the last decade and present areas for future attention.

RESULTS

Intramural and extramural mixtures research projects have incorporated a diverse array of chemicals (e.g., polycyclic aromatic hydrocarbons, botanicals, personal care products, wildfire emissions) and nonchemical stressors (e.g., socioeconomic factors, social adversity) and have focused on many diseases (e.g., breast cancer, atherosclerosis, immune disruption). We have made significant progress in certain areas, such as developing statistical methods for evaluating multiple chemical associations in epidemiology and building translational mixtures projects that include both in vitro and in vivo models.

DISCUSSION

Moving forward, additional work is needed to improve mixtures data integration, elucidate interactions between chemical and nonchemical stressors, and resolve the geospatial and temporal nature of mixture exposures. Continued mixtures research will be critical to informing cumulative impact assessments and addressing complex challenges, such as environmental justice and climate change. https://doi.org/10.1289/EHP14340.

Integrated Approach for Testing and Assessment for Developmental Neurotoxicity (DNT) to Prioritize Aromatic Organophosphorus Flame Retardants

Organophosphorus flame retardants (OPFRs) are abundant and persistent in the environment but have limited toxicity information. Their similarity in structure to organophosphate pesticides presents great concern for developmental neurotoxicity (DNT). However, current in vivo testing is not suitable to provide DNT information on the amount of OPFRs that lack data. Over the past decade, an in vitro battery was developed to enhance DNT assessment, consisting of assays that evaluate cellular processes in neurodevelopment and function. In this study, behavioral data of small model organisms were also included. To assess if these assays provide sufficient mechanistic coverage to prioritize chemicals for further testing and/or identify hazards, an integrated approach to testing and assessment (IATA) was developed with additional information from the Integrated Chemical Environment (ICE) and the literature. Human biomonitoring and exposure data were identified and physiologically-based toxicokinetic models were applied to relate in vitro toxicity data to human exposure based on maximum plasma concentration. Eight OPFRs were evaluated, including aromatic OPFRs (triphenyl phosphate (TPHP), isopropylated phenyl phosphate (IPP), 2-ethylhexyl diphenyl phosphate (EHDP), tricresyl phosphate (TMPP), isodecyl diphenyl phosphate (IDDP), tert-butylphenyl diphenyl phosphate (BPDP)) and halogenated FRs ((Tris(1,3-dichloro-2-propyl) phosphate (TDCIPP), tris(2-chloroethyl) phosphate (TCEP)). Two representative brominated flame retardants (BFRs) (2,2'4,4'-tetrabromodiphenyl ether (BDE-47) and 3,3',5,5'-tetrabromobisphenol A (TBBPA)) with known DNT potential were selected for toxicity benchmarking. Data from the DNT battery indicate that the aromatic OPFRs have activity at similar concentrations as the BFRs and should therefore be evaluated further. However, these assays provide limited information on the mechanism of the compounds. By integrating information from ICE and the literature, endocrine disruption was identified as a potential mechanism. This IATA case study indicates that human exposure to some OPFRs could lead to a plasma concentration similar to those exerting in vitro activities, indicating potential concern for human health.

Screening and characterization of 133 physiologically-relevant environmental chemicals for reproductive toxicity

Reproduction is a functional outcome that relies on complex cellular, tissue, and organ interactions that span the developmental period to adulthood. Thus, the assessment of its disruption by environmental chemicals would benefit significantly from scalable and innovative approaches to testing using functionally comparable reproductive models such as the nematode C. elegans. We adapted a previously described low-throughput in vivo chromosome segregation assay using C. elegans predictive of reproductive toxicity and leveraged available public data sources (ToxCast, ICE) to screen and characterize 133 physiologically-relevant chemicals in a high-throughput manner. The screening outcome was further validated in a second, independent in vivo assay assessing embryonic viability. In total, 13 chemicals were classified as reproductive toxicants with the two most active chemicals belonging to the large family of Quaternary Ammonium Compounds (QACs) commonly used as disinfectants but with limited available reproductive toxicity data. We compared the results from the C. elegans assay with ToxCast in vitro data compiled from 700+ cell response assays and 300+ signaling pathways-based assays. We did not observe a difference in the bioactivity or in the average potency (AC50) between the top and bottom chemicals. However, the intended target categories were significantly different between the classified chemicals with, in particular, an over-representation of steroid hormone targets for the high Z-score chemicals. Taken together, these results point to the value of in vivo models that scale to high-throughput level for reproductive toxicity assessment and to the need to prioritize the assessment of QACs impacts on reproduction.

Recent advances and current challenges of new approach methodologies in developmental and adult neurotoxicity testing

Adult neurotoxicity (ANT) and developmental neurotoxicity (DNT) assessments aim to understand the adverse effects and underlying mechanisms of toxicants on the human nervous system. In recent years, there has been an increasing focus on the so-called new approach methodologies (NAMs). The Organization for Economic Co-operation and Development (OECD), together with European and American regulatory agencies, promote the use of validated alternative test systems, but to date, guidelines for regulatory DNT and ANT assessment rely primarily on classical animal testing. Alternative methods include both non-animal approaches and test systems on non-vertebrates (e.g., nematodes) or non-mammals (e.g., fish). Therefore, this review summarizes the recent advances of NAMs focusing on ANT and DNT and highlights the potential and current critical issues for the full implementation of these methods in the future. The status of the DNT in vitro battery (DNT IVB) is also reviewed as a first step of NAMs for the assessment of neurotoxicity in the regulatory context. Critical issues such as (i) the need for test batteries and method integration (from in silico and in vitro to in vivo alternatives, e.g., zebrafish, C. elegans) requiring interdisciplinarity to manage complexity, (ii) interlaboratory transferability, and (iii) the urgent need for method validation are discussed.

Screening and characterization of 133 physiologically-relevant environmental chemicals for reproductive toxicity

Reproduction is a functional outcome that relies on complex cellular, tissue, and organ interactions that span the developmental period to adulthood. Thus, the assessment of its disruption by environmental chemicals is remarkably painstaking in conventional toxicological animal models and does not scale up to the number of chemicals present in our environment and requiring testing. We adapted a previously described low-throughput in vivo chromosome segregation assay using C. elegans predictive of reproductive toxicity and leveraged available public data sources (ToxCast, ICE) to screen and characterize 133 physiologically-relevant chemicals in a high-throughput manner. The screening outcome was further validated in a second, independent in vivo assay assessing embryonic viability. In total, 13 chemicals were classified as reproductive toxicants with the two most active chemicals belonging to the large family of Quaternary Ammonium Compounds (QACs) commonly used as disinfectants but with limited available reproductive toxicity data. We compared the results from the C. elegans assay with ToxCast in vitro data compiled from 700+ cell response assays and 300+ signaling pathways-based assays. We did not observe a difference in the bioactivity or in average potency (AC50) between the top and bottom chemicals. However, the intended target categories were significantly different between the classified chemicals with, in particular, an over-representation of steroid hormone targets for the high Z-score chemicals. Taken together, these results point to the value of in vivo models that scale to high-throughput level for reproductive toxicity assessment and to the need to prioritize the assessment of QACs impacts on reproduction.

Free and open-source QSAR-ready workflow for automated standardization of chemical structures in support of QSAR modeling

The rapid increase of publicly available chemical structures and associated experimental data presents a valuable opportunity to build robust QSAR models for applications in different fields. However, the common concern is the quality of both the chemical structure information and associated experimental data. This is especially true when those data are collected from multiple sources as chemical substance mappings can contain many duplicate structures and molecular inconsistencies. Such issues can impact the resulting molecular descriptors and their mappings to experimental data and, subsequently, the quality of the derived models in terms of accuracy, repeatability, and reliability. Herein we describe the development of an automated workflow to standardize chemical structures according to a set of standard rules and generate two and/or three-dimensional "QSAR-ready" forms prior to the calculation of molecular descriptors. The workflow was designed in the KNIME workflow environment and consists of three high-level steps. First, a structure encoding is read, and then the resulting in-memory representation is cross-referenced with any existing identifiers for consistency. Finally, the structure is standardized using a series of operations including desalting, stripping of stereochemistry (for two-dimensional structures), standardization of tautomers and nitro groups, valence correction, neutralization when possible, and then removal of duplicates. This workflow was initially developed to support collaborative modeling QSAR projects to ensure consistency of the results from the different participants. It was then updated and generalized for other modeling applications. This included modification of the "QSAR-ready" workflow to generate "MS-ready structures" to support the generation of substance mappings and searches for software applications related to non-targeted analysis mass spectrometry. Both QSAR and MS-ready workflows are freely available in KNIME, via standalone versions on GitHub, and as docker container resources for the scientific community. Scientific contribution: This work pioneers an automated workflow in KNIME, systematically standardizing chemical structures to ensure their readiness for QSAR modeling and broader scientific applications. By addressing data quality concerns through desalting, stereochemistry stripping, and normalization, it optimizes molecular descriptors' accuracy and reliability. The freely available resources in KNIME, GitHub, and docker containers democratize access, benefiting collaborative research and advancing diverse modeling endeavors in chemistry and mass spectrometry.

Investigating open access new approach methods (NAM) to assess biological points of departure: A case study with 4 neurotoxic pesticides

Open access new approach methods (NAM) in the US EPA ToxCast program and NTP Integrated Chemical Environment (ICE) were used to investigate activities of four neurotoxic pesticides: endosulfan, fipronil, propyzamide and carbaryl. Concordance of in vivo regulatory points of departure (POD) adjusted for interspecies extrapolation (AdjPOD) to modelled human Administered Equivalent Dose (AEDHuman) was assessed using 3-compartment or Adult/Fetal PBTK in vitro to in vivo extrapolation. Model inputs were from Tier 1 (High throughput transcriptomics: HTTr, high throughput phenotypic profiling: HTPP) and Tier 2 (single target: ToxCast) assays. HTTr identified gene expression signatures associated with potential neurotoxicity for endosulfan, propyzamide and carbaryl in non-neuronal MCF-7 and HepaRG cells. The HTPP assay in U-2 OS cells detected potent effects on DNA endpoints for endosulfan and carbaryl, and mitochondria with fipronil (propyzamide was inactive). The most potent ToxCast assays were concordant with specific components of each chemical mode of action (MOA). Predictive adult IVIVE models produced fold differences (FD) < 10 between the AEDHuman and the measured in vivo AdjPOD. The 3-compartment model was concordant (i.e., smallest FD) for endosulfan, fipronil and carbaryl, and PBTK was concordant for propyzamide. The most potent AEDHuman predictions for each chemical showed HTTr, HTPP and ToxCast were mainly concordant with in vivo AdjPODs but assays were less concordant with MOAs. This was likely due to the cell types used for testing and/or lack of metabolic capabilities and pathways available in vivo. The Fetal PBTK model had larger FDs than adult models and was less predictive overall.

An integrated in vitro approach to identifying chemically induced oxidative stress and toxicity in mitochondria

Growing concerns exist about increasing chemical usage and the potential health risks. Developing an efficient strategy to evaluate or predict the toxicity of chemicals is necessary. The mitochondria are essential organelles for cell maintenance and survival but also serve as one of the main targets of toxic chemicals. Mitochondria play an important role in the pathology of respiratory disease, and many environmental chemicals may induce impairment of the respiratory system through mitochondrial damage. This study aimed to develop integrated in vitro approaches to identify chemicals that could induce adverse health effects by increasing mitochondria-mediated oxidative stress using the H441 cells, which have a club-cell-like phenotype. Twenty-six environmental toxicants (biocides, phthalates, bisphenols, and particles) were tested, and each parameter was compared with eleven reference compounds. The inhibitory concentrations (IC20 and IC50) and benchmark doses (BMD) of the tested compounds were estimated from three in vitro assays, and the toxic concentration was determined. At the lowest IC20, the effects of compounds on mitochondrial reactive oxygen species (ROS) production and mitochondrial membrane potential (MMP) were compared. Principal component analysis and k-mean clustering were performed to cluster the chemicals that had comparable effects on the cells. Chemicals that induce mitochondrial damage at different concentrations were used for an in-depth high-tier assessment and classification as electron transport system (ETS) uncoupling or inhibiting agents. Additionally, using in vitro to in vivo extrapolation (IVIVE) tools, equivalent administration doses and maximum plasma concentrations of tested compounds in human were estimated. This study suggests an in vitro approach to identifying mitochondrial damage by integrating several in vitro toxicity tests and calculation modeling.

Advancing Computational Toxicology by Interpretable Machine Learning

Chemical toxicity evaluations for drugs, consumer products, and environmental chemicals have a critical impact on human health. Traditional animal models to evaluate chemical toxicity are expensive, time-consuming, and often fail to detect toxicants in humans. Computational toxicology is a promising alternative approach that utilizes machine learning (ML) and deep learning (DL) techniques to predict the toxicity potentials of chemicals. Although the applications of ML- and DL-based computational models in chemical toxicity predictions are attractive, many toxicity models are "black boxes" in nature and difficult to interpret by toxicologists, which hampers the chemical risk assessments using these models. The recent progress of interpretable ML (IML) in the computer science field meets this urgent need to unveil the underlying toxicity mechanisms and elucidate the domain knowledge of toxicity models. In this review, we focused on the applications of IML in computational toxicology, including toxicity feature data, model interpretation methods, use of knowledge base frameworks in IML development, and recent applications. The challenges and future directions of IML modeling in toxicology are also discussed. We hope this review can encourage efforts in developing interpretable models with new IML algorithms that can assist new chemical assessments by illustrating toxicity mechanisms in humans.

Descriptor-Free Deep Learning QSAR Model for the Fraction Unbound in Human Plasma

Chemical-specific parameters are either measured in vitro or estimated using quantitative structure-activity relationship (QSAR) models. The existing body of QSAR work relies on extracting a set of descriptors or fingerprints, subset selection, and training a machine learning model. In this work, we used a state-of-the-art natural language processing model, Bidirectional Encoder Representations from Transformers, which allowed us to circumvent the need for calculation of these chemical descriptors. In this approach, simplified molecular-input line-entry system (SMILES) strings were embedded in a high-dimensional space using a two-stage training approach. The model was first pre-trained on a masked SMILES token task and then fine-tuned on a QSAR prediction task. The pre-training task learned meaningful high-dimensional embeddings based upon the relationships between the chemical tokens in the SMILES strings derived from the "in-stock" portion of the ZINC 15 dataset─a large dataset of commercially available chemicals. The fine-tuning task then perturbed the pre-trained embeddings to facilitate prediction of a specific QSAR endpoint of interest. The power of this model stems from the ability to reuse the pre-trained model for multiple different fine-tuning tasks, reducing the computational burden of developing multiple models for different endpoints. We used our framework to develop a predictive model for fraction unbound in human plasma (fu,p). This approach is flexible, requires minimum domain expertise, and can be generalized for other parameters of interest for rapid and accurate estimation of absorption, distribution, metabolism, excretion, and toxicity.

The Good, The Bad, and The Perplexing: Structural Alerts and Read-Across for Predicting Skin Sensitization Using Human Data

In our earlier work (Golden et al., 2021), we showed 70-80% accuracies for several skin sensitization computational tools using human data. Here, we expanded the data set using the NICEATM human skin sensitization database to create a final data set of 1355 discrete chemicals (largely negative, ∼70%). Using this expanded data set, we analyzed model performance and evaluated mispredictions using Toxtree (v 3.1.0), OECD QSAR Toolbox (v 4.5), VEGA's (1.2.0 BETA) CAESAR (v 2.1.7), and a k-nearest-neighbor (kNN) classification approach. We show that the accuracy on this data set was lower than previous estimates, with balanced accuracies being 63% and 65% for Toxtree and OECD QSAR Toolbox, respectively, 46% for VEGA, and 59% for a kNN approach, with the lower accuracy likely due to the higher percentage of nonsensitizing chemicals. Two hundred eighty seven chemicals were mispredicted by both Toxtree and OECD QSAR Toolbox, which was approximately 20% of the entire data set, and 84% of these were false positives. The absence or presence of metabolic simulation in OECD QSAR Toolbox made no overall difference. While Toxtree is known for overpredicting, 60% of the chemicals in the data set had no alert for skin sensitization, and a substantial number of these chemicals were in fact sensitizers, pointing to sensitization mechanisms not recognized by Toxtree. Interestingly, we observed that chemicals with more than one Toxtree alert were more likely to be nonsensitizers. Finally, a kNN approach tended to mispredict different chemicals than either OECD QSAR Toolbox or Toxtree, suggesting that there was additional information to be garnered from a kNN approach. Overall, the results demonstrate that while there is merit in structural alerts as well as QSAR or read-across approaches (perhaps even more so in their combination), additional improvement will require a more nuanced understanding of mechanisms of skin sensitization.

Use of computational toxicology models to predict toxicological points of departure: A case study with triazine herbicides

BACKGROUND

Atrazine simazine and propazine, widely used triazine herbicides on food crops and in residential areas, disrupt the neuroendocrine system raising human health concerns. USEPA developed a PBPK model based on triazine common Mode of Action (MOA)-suppression of luteinizing hormone surge in female rats-to generate human regulatory points of departure (POD: mg/kg/day). We compared triazine Human Administered Equivalent Dose (AED_Human mg/kg/day) predictions from open access computational tools to the PBPK PODs to assess concordance.

METHODS

Computational tools were the following: ToxCast/Tox21 in vitro assays; Toxicogenomic databases to assess concordance with ToxCast/Tox21 targets; integrated chemical environment (ICE) models with ToxCast/Tox21 inputs to predict AED_Human PODs and population-based age-refined high throughput toxicokinetics (HTTK-Pop) to compare to age-related PBPK PODs.

RESULTS

ToxCast/Tox21 assays identified critical targets in the triazine common MOA and gene databases; ICE AED_Human predictions were mainly concordant with the USEPA PBPK PODs quantitatively. Low fold-differences between PBPK POD and ICE AED_Human predictions indicated that the ICE models are health-protective. HTTK-Pop age-refinements were within 10-fold of the USEPA PBPK PODs.

CONCLUSIONS

CompTox tools were used to identify assay targets in the MOA and identify potential molecular initiating targets in the adverse outcome pathway for potential use in risk assessment.

Three perspectives on the prediction of chemical effects in ecosystems

The increasing production, use and emission of synthetic chemicals into the environment represents a major driver of global change. The large number of synthetic chemicals, limited knowledge on exposure patterns and effects in organisms and their interaction with other global change drivers hamper the prediction of effects in ecosystems. However, recent advances in biomolecular and computational methods are promising to improve our capacity for prediction. We delineate three idealised perspectives for the prediction of chemical effects: the suborganismal, organismal and ecological perspective, which are currently largely separated. Each of the outlined perspectives includes essential and complementary theories and tools for prediction but captures only part of the phenomenon of chemical effects. Links between the perspectives may foster predictive modelling of chemical effects in ecosystems and extrapolation between species. A major challenge for the linkage is the lack of data sets simultaneously covering different levels of biological organisation (here referred to as biological levels) as well as varying temporal and spatial scales. Synthesising the three perspectives, some central aspects and associated types of data seem particularly necessary to improve prediction. First, suborganism- and organism-level responses to chemicals need to be recorded and tested for relationships with chemical groups and organism traits. Second, metrics that are measurable at many biological levels, such as energy, need to be scrutinised for their potential to integrate across levels. Third, experimental data on the simultaneous response over multiple biological levels and spatiotemporal scales are required. These could be collected in nested and interconnected micro- and mesocosm experiments. Lastly, prioritisation of processes involved in the prediction framework needs to find a balance between simplification and capturing the essential complexity of a system. For example, in some cases, eco-evolutionary dynamics and interactions may need stronger consideration. Prediction needs to move from a static to a real-world eco-evolutionary view.

Advancing New Approach Methodologies (NAMs) for Tobacco Harm Reduction: Synopsis from the 2021 CORESTA SSPT-NAMs Symposium

New approach methodologies (NAMs) are emerging chemical safety assessment tools consisting of in vitro and in silico (computational) methodologies intended to reduce, refine, or replace (3R) various in vivo animal testing methods traditionally used for risk assessment. Significant progress has been made toward the adoption of NAMs for human health and environmental toxicity assessment. However, additional efforts are needed to expand their development and their use in regulatory decision making. A virtual symposium was held during the 2021 Cooperation Centre for Scientific Research Relative to Tobacco (CORESTA) Smoke Science and Product Technology (SSPT) conference (titled "Advancing New Alternative Methods for Tobacco Harm Reduction"), with the goals of introducing the concepts and potential application of NAMs in the evaluation of potentially reduced-risk (PRR) tobacco products. At the symposium, experts from regulatory agencies, research organizations, and NGOs shared insights on the status of available tools, strengths, limitations, and opportunities in the application of NAMs using case examples from safety assessments of chemicals and tobacco products. Following seven presentations providing background and application of NAMs, a discussion was held where the presenters and audience discussed the outlook for extending the NAMs toxicological applications for tobacco products. The symposium, endorsed by the CORESTA In Vitro Tox Subgroup, Biomarker Subgroup, and NextG Tox Task Force, illustrated common ground and interest in science-based engagement across the scientific community and stakeholders in support of tobacco regulatory science. Highlights of the symposium are summarized in this paper.

Data curation to support toxicity assessments using the Integrated Chemical Environment

Humans are exposed to large numbers of chemicals during their daily activities. To assess and understand potential health impacts of chemical exposure, investigators and regulators need access to reliable toxicity data. In particular, reliable toxicity data for a wide range of chemistries are needed to support development of new approach methodologies (NAMs) such as computational models, which offer increased throughput relative to traditional approaches and reduce or replace animal use. NAMs development and evaluation require chemically diverse data sets that are typically constructed by incorporating results from multiple studies into a single, integrated view; however, integrating data is not always a straightforward task. Primary study sources often vary in the way data are organized and reported. Metadata and information needed to support interoperability and provide context are often lacking, which necessitates literature research on the assay prior to attempting data integration. The Integrated Chemical Environment (ICE) was developed to support the development, evaluation, and application of NAMs. ICE provides curated toxicity data and computational tools to integrate and explore available information, thus facilitating knowledge discovery and interoperability. This paper describes the data curation workflow for integrating data into ICE. Data destined for ICE undergo rigorous harmonization, standardization, and formatting processes using both automated and manual expert-driven approaches. These processes improve the utility of the data for diverse analyses and facilitate application within ICE or a user's external workflow while preserving data integrity and context. ICE data curation provides the structure, reliability, and accessibility needed for data to support chemical assessments.

Impact of High-Throughput Model Parameterization and Data Uncertainty on Thyroid-Based Toxicological Estimates for Pesticide Chemicals

Chemical-induced alteration of maternal thyroid hormone levels may increase the risk of adverse neurodevelopmental outcomes in offspring. US federal risk assessments rely almost exclusively on apical endpoints in animal models for deriving points of departure (PODs). New approach methodologies (NAMs) such as high-throughput screening (HTS) and mechanistically informative in vitro human cell-based systems, combined with in vitro to in vivo extrapolation (IVIVE), supplement in vivo studies and provide an alternative approach to calculate/determine PODs. We examine how parameterization of IVIVE models impacts the comparison between IVIVE-derived equivalent administered doses (EADs) from thyroid-relevant in vitro assays and the POD values that serve as the basis for risk assessments. Pesticide chemicals with thyroid-based in vitro bioactivity data from the US Tox21 HTS program were included (n = 45). Depending on the model structure used for IVIVE analysis, up to 35 chemicals produced EAD values lower than the POD. A total of 10 chemicals produced EAD values higher than the POD regardless of the model structure. The relationship between IVIVE-derived EAD values and the in vivo-derived POD values is highly dependent on model parameterization. Here, we derive a range of potentially thyroid-relevant doses that incorporate uncertainty in modeling choices and in vitro assay data.

IVIVE: Facilitating the Use of In Vitro Toxicity Data in Risk Assessment and Decision Making

During the past few decades, the science of toxicology has been undergoing a transformation from observational to predictive science. New approach methodologies (NAMs), including in vitro assays, in silico models, read-across, and in vitro to in vivo extrapolation (IVIVE), are being developed to reduce, refine, or replace whole animal testing, encouraging the judicious use of time and resources. Some of these methods have advanced past the exploratory research stage and are beginning to gain acceptance for the risk assessment of chemicals. A review of the recent literature reveals a burst of IVIVE publications over the past decade. In this review, we propose operational definitions for IVIVE, present literature examples for several common toxicity endpoints, and highlight their implications in decision-making processes across various federal agencies, as well as international organizations, including those in the European Union (EU). The current challenges and future needs are also summarized for IVIVE. In addition to refining and reducing the number of animals in traditional toxicity testing protocols and being used for prioritizing chemical testing, the goal to use IVIVE to facilitate the replacement of animal models can be achieved through their continued evolution and development, including a strategic plan to qualify IVIVE methods for regulatory acceptance.

Application of an Accessible Interface for Pharmacokinetic Modeling and In Vitro to In Vivo Extrapolation

Regulatory toxicology testing has traditionally relied on in vivo methods to inform decision-making. However, scientific, practical, and ethical considerations have led to an increased interest in the use of in vitro and in silico methods to fill data gaps. While in vitro experiments have the advantage of rapid application across large chemical sets, interpretation of data coming from these non-animal methods can be challenging due to the mechanistic nature of many assays. In vitro to in vivo extrapolation (IVIVE) has emerged as a computational tool to help facilitate this task. Specifically, IVIVE uses physiologically based pharmacokinetic (PBPK) models to estimate tissue-level chemical concentrations based on various dosing parameters. This approach is used to estimate the administered dose needed to achieve in vitro bioactivity concentrations within the body. IVIVE results can be useful to inform on metrics such as margin of exposure or to prioritize potential chemicals of concern, but the PBPK models used in this approach have extensive data requirements. Thus, access to input parameters, as well as the technical requirements of applying and interpreting models, has limited the use of IVIVE as a routine part of in vitro testing. As interest in using non-animal methods for regulatory and research contexts continues to grow, our perspective is that access to computational support tools for PBPK modeling and IVIVE will be essential for facilitating broader application and acceptance of these techniques, as well as for encouraging the most scientifically sound interpretation of in vitro results. We highlight recent developments in two open-access computational support tools for PBPK modeling and IVIVE accessible via the Integrated Chemical Environment (https://ice.ntp.niehs.nih.gov/), demonstrate the types of insights these tools can provide, and discuss how these analyses may inform in vitro-based decision making.

Evaluation of Inhalation Exposures and Potential Health Impacts of Ingredient Mixtures Using in vitro to in vivo Extrapolation

In vitro methods offer opportunities to provide mechanistic insight into bioactivity as well as human-relevant toxicological assessments compared to animal testing. One of the challenges for this task is putting in vitro bioactivity data in an in vivo exposure context, for which in vitro to in vivo extrapolation (IVIVE) translates in vitro bioactivity to clinically relevant exposure metrics using reverse dosimetry. This study applies an IVIVE approach to the toxicity assessment of ingredients and their mixtures in e-cigarette (EC) aerosols as a case study. Reported in vitro cytotoxicity data of EC aerosols, as well as in vitro high-throughput screening (HTS) data for individual ingredients in EC liquids (e-liquids) are used. Open-source physiologically based pharmacokinetic (PBPK) models are used to calculate the plasma concentrations of individual ingredients, followed by reverse dosimetry to estimate the human equivalent administered doses (EADs) needed to obtain these plasma concentrations for the total e-liquids. Three approaches (single actor approach, additive effect approach, and outcome-oriented ingredient integration approach) are used to predict EADs of e-liquids considering differential contributions to the bioactivity from the ingredients (humectant carriers [propylene glycol and glycerol], flavors, benzoic acid, and nicotine). The results identified critical factors for the EAD estimation, including the ingredients of the mixture considered to be bioactive, in vitro assay selection, and the data integration approach for mixtures. Further, we introduced the outcome-oriented ingredient integration approach to consider e-liquid ingredients that may lead to a common toxicity outcome (e.g., cytotoxicity), facilitating a quantitative evaluation of in vitro toxicity data in support of human risk assessment.

Quantitative high-throughput phenotypic screening for environmental estrogens using the E-Morph Screening Assay in combination with in silico predictions

BACKGROUND

Exposure to environmental chemicals that interfere with normal estrogen function can lead to adverse health effects, including cancer. High-throughput screening (HTS) approaches facilitate the efficient identification and characterization of such substances.

OBJECTIVES

We recently described the development of the E-Morph Assay, which measures changes at adherens junctions as a clinically-relevant phenotypic readout for estrogen receptor (ER) alpha signaling activity. Here, we describe its further development and application for automated robotic HTS.

METHODS

Using the advanced E-Morph Screening Assay, we screened a substance library comprising 430 toxicologically-relevant industrial chemicals, biocides, and plant protection products to identify novel substances with estrogenic activities. Based on the primary screening data and the publicly available ToxCast dataset, we performed an insilico similarity search to identify further substances with potential estrogenic activity for follow-up hit expansion screening, and built seven insilico ER models using the conformal prediction (CP) framework to evaluate the HTS results.

RESULTS

The primary and hit confirmation screens identified 27 'known' estrogenic substances with potencies correlating very well with the published ToxCast ER Agonist Score (r=+0.95). We additionally detected potential 'novel' estrogenic activities for 10 primary hit substances and for another nine out of 20 structurally similar substances from insilico predictions and follow-up hit expansion screening. The concordance of the E-Morph Screening Assay with the ToxCast ER reference data and the generated CP ER models was 71% and 73%, respectively, with a high predictivity for ER active substances of up to 87%, which is particularly important for regulatory purposes.

DISCUSSION

These data provide a proof-of-concept for the combination of in vitro HTS approaches with insilico methods (similarity search, CP models) for efficient analysis of large substance libraries in order to prioritize substances with potential estrogenic activity for subsequent testing against higher tier human endpoints.

High-throughput PBTK models for in vitro to in vivo extrapolation

INTRODUCTION

Toxicity data are unavailable for many thousands of chemicals in commerce and the environment. Therefore, risk assessors need to rapidly screen these chemicals for potential risk to public health. High-throughput screening (HTS) for in vitro bioactivity, when used with high-throughput toxicokinetic (HTTK) data and models, allows characterization of these thousands of chemicals.

AREAS COVERED

This review covers generic physiologically based toxicokinetic (PBTK) models and high-throughput PBTK modeling for in vitro-in vivo extrapolation (IVIVE) of HTS data. We focus on 'httk', a public, open-source set of computational modeling tools and in vitro toxicokinetic (TK) data.

EXPERT OPINION

HTTK benefits chemical risk assessors with its ability to support rapid chemical screening/prioritization, perform IVIVE, and provide provisional TK modeling for large numbers of chemicals using only limited chemical-specific data. Although generic TK model design can increase prediction uncertainty, these models provide offsetting benefits by increasing model implementation accuracy. Also, public distribution of the models and data enhances reproducibility. For the httk package, the modular and open-source design can enable the tool to be used and continuously improved by a broad user community in support of the critical need for high-throughput chemical prioritization and rapid dose estimation to facilitate rapid hazard assessments.

The potential of mechanistic information organised within the AOP framework to increase regulatory uptake of the developmental neurotoxicity (DNT) in vitro battery of assays

•

Current in vivo DNT testing for regulatory purposes is not effective.

•

In vitro assays anchored to key neurodevelopmental processes are available.

•

Development of Adverse Outcome Pathways is required to increase mechanistic understanding of DNT effects.

•

DNT Integrated Approaches to Testing and Assessment for various regulatory purposes should be developed.

•

The OECD Guidance Document on use of in vitro DNT battery of assays is currently under development.

A major challenge in regulatory developmental neurotoxicity (DNT) assessment is lack of toxicological information for many compounds. Therefore, the Test Guidelines programme of the Organisation for Economic Cooperation and Development (OECD) took the initiative to coordinate an international collaboration between diverse stakeholders to consider integration of alternative approaches towards improving the current chemical DNT testing. During the past few years, a series of workshops was organized during which a consensus was reached that incorporation of a DNT testing battery that relies on in vitro assays anchored to key neurodevelopmental processes should be developed. These key developmental processes include neural progenitor cell proliferation, neuronal and oligodendrocyte differentiation, neural cell migration, neurite outgrowth, synaptogenesis and neuronal network formation, as well key events identified in the existing Adverse Outcome Pathways (AOPs). AOPs deliver mechanistic information on the causal links between molecular initiating event, intermediate key events and an adverse outcome of regulatory concern, providing the biological context to facilitate development of Integrated Approaches to Testing and Assessment (IATA) for various regulatory purposes. Developing IATA case studies, using mechanistic information derived from AOPs, is expected to increase scientific confidence for the use of in vitro methods within an IATA, thereby facilitating regulatory uptake. This manuscript summarizes the current state of international efforts to enhance DNT testing by using an in vitro battery of assays focusing on the role of AOPs in informing the development of IATA for different regulatory purposes, aiming to deliver an OECD guidance document on use of in vitro DNT battery of assays that include in vitro data interpretation.

Quantitative in Vitro-to-in Vivo Extrapolation for Mixtures: A Case Study of Superfund Priority List Pesticides

In vitro cell-based toxicity testing methods generate large amounts of data informative for risk-based evaluations. To allow extrapolation of the quantitative outputs from cell-based tests to the equivalent exposure levels in humans, reverse toxicokinetic (RTK) modeling is used to conduct in vitro-to-in vivo extrapolation (IVIVE) from in vitro effective concentrations to in vivo oral dose equivalents. IVIVE modeling approaches for individual chemicals are well-established; however, the potential implications of chemical-to-chemical interactions in mixture settings on IVIVE remains largely unexplored. We hypothesized that chemical co-exposures could modulate both protein binding efficiency and hepatocyte clearance of the chemicals in a mixture, which would in turn affect the quantitative IVIVE toxicokinetic parameters. To test this hypothesis, we used 20 pesticides from the Agency for Toxic Substances and Disease Registry (ATSDR) Substance Priority List, both individually and as equimolar mixtures, and investigated the concentration-dependent effects of chemical interactions on in vitro toxicokinetic parameters. Plasma protein binding efficiency was determined by using ultracentrifugation, and hepatocyte clearance was estimated in suspensions of cryopreserved primary human hepatocytes. We found that for single chemicals, the protein binding efficiencies were similar at different test concentrations. In a mixture, however, both protein binding efficiency and hepatocyte clearance were affected. When IVIVE was conducted using mixture-derived toxicokinetic data, more conservative estimates of Activity-to-Exposure Ratios (AERs) were produced as compared to using data from single chemical experiments. Because humans are exposed to mixtures of chemicals, this study is significant as it demonstrates the importance of incorporating mixture-derived parameters into IVIVE for in vitro bioactivity data in order to accurately prioritize risks and facilitate science-based decision-making.

Curated Data In - Trustworthy In Silico Models Out: The Impact of Data Quality on the Reliability of Artificial Intelligence Models as Alternatives to Animal Testing

New Approach Methodologies (NAMs) that employ artificial intelligence (AI) for predicting adverse effects of chemicals have generated optimistic expectations as alternatives to animal testing. However, the major underappreciated challenge in developing robust and predictive AI models is the impact of the quality of the input data on the model accuracy. Indeed, poor data reproducibility and quality have been frequently cited as factors contributing to the crisis in biomedical research, as well as similar shortcomings in the fields of toxicology and chemistry. In this article, we review the most recent efforts to improve confidence in the robustness of toxicological data and investigate the impact that data curation has on the confidence in model predictions. We also present two case studies demonstrating the effect of data curation on the performance of AI models for predicting skin sensitisation and skin irritation. We show that, whereas models generated with uncurated data had a 7-24% higher correct classification rate (CCR), the perceived performance was, in fact, inflated owing to the high number of duplicates in the training set. We assert that data curation is a critical step in building computational models, to help ensure that reliable predictions of chemical toxicity are achieved through use of the models.

Investigating Molecular Mechanisms of Immunotoxicity and the Utility of ToxCast for Immunotoxicity Screening of Chemicals Added to Food

The development of high-throughput screening methodologies may decrease the need for laboratory animals for toxicity testing. Here, we investigate the potential of assessing immunotoxicity with high-throughput screening data from the U.S. Environmental Protection Agency ToxCast program. As case studies, we analyzed the most common chemicals added to food as well as per- and polyfluoroalkyl substances (PFAS) shown to migrate to food from packaging materials or processing equipment. The antioxidant preservative tert-butylhydroquinone (TBHQ) showed activity both in ToxCast assays and in classical immunological assays, suggesting that it may affect the immune response in people. From the PFAS group, we identified eight substances that can migrate from food contact materials and have ToxCast data. In epidemiological and toxicological studies, PFAS suppress the immune system and decrease the response to vaccination. However, most PFAS show weak or no activity in immune-related ToxCast assays. This lack of concordance between toxicological and high-throughput data for common PFAS indicates the current limitations of in vitro screening for analyzing immunotoxicity. High-throughput in vitro assays show promise for providing mechanistic data relevant for immune risk assessment. In contrast, the lack of immune-specific activity in the existing high-throughput assays cannot validate the safety of a chemical for the immune system.

Analysis of variability in the rabbit skin irritation assay

The in vivo rabbit test is the benchmark against which new approach methodologies for skin irritation are usually compared. No alternative method offers a complete replacement of animal use for this endpoint for all regulatory applications. Variability in the animal reference data may be a limiting factor in identifying a replacement. We established a curated data set of 2624 test records, representing 990 substances, each tested at least twice, to characterize the reproducibility of the in vivo assay. Methodological deviations from guidelines were noted, and multiple data sets with differing tolerances for deviations were created. Conditional probabilities were used to evaluate the reproducibility of the in vivo method in identification of U.S. Environmental Protection Agency or Globally Harmonized System hazard categories. Chemicals classified as moderate irritants at least once were classified as mild or non-irritants at least 40% of the time when tested repeatedly. Variability was greatest between mild and moderate irritants, which both had less than a 50% likelihood of being replicated. Increased reproducibility was observed when a binary categorization between corrosives/moderate irritants and mild/non-irritants was used. This analysis indicates that variability present in the rabbit skin irritation test should be considered when evaluating nonanimal alternative methods as potential replacements.

Exploring in vitro to in vivo extrapolation for exposure and health impacts of e-cigarette flavor mixtures

In vitro to in vivo extrapolation (IVIVE) leverages in vitro biological activities to predict corresponding in vivo exposures, therefore potentially reducing the need for animal safety testing that are traditionally performed to support the hazard and risk assessment. Interpretation of IVIVE predictions are affected by various factors including the model type, exposure route and kinetic assumptions for the test article, and choice of in vitro assay(s) that are relevant to clinical outcomes. Exposure scenarios are further complicated for mixtures where the in vitro activity may stem from one or more components in the mixture. In this study, we used electronic cigarette (EC) aerosols, a complex mixture, to explore impacts of these factors on the use of IVIVE in hazard identification, using open-source pharmacokinetic models of varying complexity and publicly available data. Results suggest in vitro assay selection has a greater impact on exposure estimates than modeling approaches. Using cytotoxicity assays, high exposure estimates (>1000 EC cartridges (pods) or > 700 mL EC liquid per day) would be needed to obtain the in vivo plasma levels that are corresponding to in vitro assay data, suggesting acute toxicity would be unlikely in typical usage scenarios. When mechanistic (Tox21) assays were used, the exposure estimates were much lower for the low end, but the range of exposure estimate became wider across modeling approaches. These proof-of-concept results highlight challenges and complexities in IVIVE for mixtures.

High-Throughput Screening to Identify Chemical Cardiotoxic Potential

Cardiovascular (CV) disease is one of the most prevalent public health concerns, and mounting evidence supports the contribution of environmental chemicals to CV disease burden. In this study, we performed cardiotoxicity profiling for the Tox21 chemical library by focusing on high-throughput screening (HTS) assays whose targets are associated with adverse events related to CV failure modes. Our objective was to develop new hypotheses around environmental chemicals of potential interest for adverse CV outcomes using Tox21/ToxCast HTS data. Molecular and cellular events linked to six failure modes of CV toxicity were cross-referenced with 1399 Tox21/ToxCast assays to identify cardio-relevant bioactivity signatures. The resulting 40 targets, measured in 314 assays, were integrated via a ToxPi visualization tool and ranking system to prioritize 1138 chemicals based upon formal integration across multiple domains of information. Filtering was performed based on cytotoxicity and generalized cell stress endpoints to try and isolate chemicals with effects specific to CV biology, and bioactivity- and structure-based clustering identified subgroups of chemicals preferentially affecting targets such as ion channels and vascular tissue biology. Our approach identified drugs with known cardiotoxic effects, such as estrogenic modulators like clomiphene and raloxifene, anti-arrhythmic drugs like amiodarone and haloperidol, and antipsychotic drugs like chlorpromazine. Several classes of environmental chemicals such as organotins, bisphenol-like chemicals, pesticides, and quaternary ammonium compounds demonstrated strong bioactivity against CV targets; these were compared to existing data in the literature (e.g., from cardiomyocytes, animal data, or human epidemiological studies) and prioritized for further testing.

In Silico Assessment of Acute Oral Toxicity for Mixtures

While exposure of humans to environmental hazards often occurs with complex chemical mixtures, the majority of existing toxicity data are for single compounds. The Globally Harmonized System of chemical classification (GHS) developed by the Organization for Economic Cooperation and Development uses the additivity formula for acute oral toxicity classification of mixtures, which is based on the acute toxicity estimate of individual ingredients. We evaluated the prediction of GHS category classifications for mixtures using toxicological data collected in the Integrated Chemical Environment (ICE) developed by the National Toxicology Program (United States Department of Health and Human Services). The ICE database contains in vivo acute oral toxicity data for ∼10,000 chemicals and for 582 mixtures with one or multiple active ingredients. By using the available experimental data for individual ingredients, we were able to calculate a GHS category for only half of the mixtures. To expand a set of components with acute oral toxicity data, we used the Collaborative Acute Toxicity Modeling Suite (CATMoS) implemented in the Open Structure-Activity/Property Relationship App to make predictions for active ingredients without available experimental data. As a result, we were able to make predictions for 503 mixtures/formulations with 72% accuracy for the GHS classification. For 186 mixtures with two or more active ingredients, the accuracy rate was 76%. The structure-based analysis of the misclassified mixtures did not reveal any specific structural features associated with the mispredictions. Our results demonstrate that CATMoS together with an additivity formula can be used to predict the GHS category for chemical mixtures.