1
|
Di Stefano M, Galati S, Piazza L, Granchi C, Mancini S, Fratini F, Macchia M, Poli G, Tuccinardi T. VenomPred 2.0: A Novel In Silico Platform for an Extended and Human Interpretable Toxicological Profiling of Small Molecules. J Chem Inf Model 2024; 64:2275-2289. [PMID: 37676238 PMCID: PMC11005041 DOI: 10.1021/acs.jcim.3c00692] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Indexed: 09/08/2023]
Abstract
The application of artificial intelligence and machine learning (ML) methods is becoming increasingly popular in computational toxicology and drug design; it is considered as a promising solution for assessing the safety profile of compounds, particularly in lead optimization and ADMET studies, and to meet the principles of the 3Rs, which calls for the replacement, reduction, and refinement of animal testing. In this context, we herein present the development of VenomPred 2.0 (http://www.mmvsl.it/wp/venompred2/), the new and improved version of our free of charge web tool for toxicological predictions, which now represents a powerful web-based platform for multifaceted and human-interpretable in silico toxicity profiling of chemicals. VenomPred 2.0 presents an extended set of toxicity endpoints (androgenicity, skin irritation, eye irritation, and acute oral toxicity, in addition to the already available carcinogenicity, mutagenicity, hepatotoxicity, and estrogenicity) that can be evaluated through an exhaustive consensus prediction strategy based on multiple ML models. Moreover, we also implemented a new utility based on the Shapley Additive exPlanations (SHAP) method that allows human interpretable toxicological profiling of small molecules, highlighting the features that strongly contribute to the toxicological predictions in order to derive structural toxicophores.
Collapse
Affiliation(s)
- Miriana Di Stefano
- Department
of Pharmacy, University of Pisa, Via Bonanno 6, 56126 Pisa, Italy
- Department
of Life Sciences, University of Siena, 53100 Siena, Italy
| | - Salvatore Galati
- Department
of Pharmacy, University of Pisa, Via Bonanno 6, 56126 Pisa, Italy
| | - Lisa Piazza
- Department
of Pharmacy, University of Pisa, Via Bonanno 6, 56126 Pisa, Italy
| | - Carlotta Granchi
- Department
of Pharmacy, University of Pisa, Via Bonanno 6, 56126 Pisa, Italy
| | - Simone Mancini
- Department
of Veterinary Sciences, University of Pisa, Viale Delle Piagge 2, 56124 Pisa, Italy
| | - Filippo Fratini
- Department
of Veterinary Sciences, University of Pisa, Viale Delle Piagge 2, 56124 Pisa, Italy
| | - Marco Macchia
- Department
of Pharmacy, University of Pisa, Via Bonanno 6, 56126 Pisa, Italy
| | - Giulio Poli
- Department
of Pharmacy, University of Pisa, Via Bonanno 6, 56126 Pisa, Italy
| | - Tiziano Tuccinardi
- Department
of Pharmacy, University of Pisa, Via Bonanno 6, 56126 Pisa, Italy
| |
Collapse
|
2
|
Sabotič J, Bayram E, Ezra D, Gaudêncio SP, Haznedaroğlu BZ, Janež N, Ktari L, Luganini A, Mandalakis M, Safarik I, Simes D, Strode E, Toruńska-Sitarz A, Varamogianni-Mamatsi D, Varese GC, Vasquez MI. A guide to the use of bioassays in exploration of natural resources. Biotechnol Adv 2024; 71:108307. [PMID: 38185432 DOI: 10.1016/j.biotechadv.2024.108307] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 12/05/2023] [Accepted: 01/01/2024] [Indexed: 01/09/2024]
Abstract
Bioassays are the main tool to decipher bioactivities from natural resources thus their selection and quality are critical for optimal bioprospecting. They are used both in the early stages of compounds isolation/purification/identification, and in later stages to evaluate their safety and efficacy. In this review, we provide a comprehensive overview of the most common bioassays used in the discovery and development of new bioactive compounds with a focus on marine bioresources. We present a comprehensive list of practical considerations for selecting appropriate bioassays and discuss in detail the bioassays typically used to explore antimicrobial, antibiofilm, cytotoxic, antiviral, antioxidant, and anti-ageing potential. The concept of quality control and bioassay validation are introduced, followed by safety considerations, which are critical to advancing bioactive compounds to a higher stage of development. We conclude by providing an application-oriented view focused on the development of pharmaceuticals, food supplements, and cosmetics, the industrial pipelines where currently known marine natural products hold most potential. We highlight the importance of gaining reliable bioassay results, as these serve as a starting point for application-based development and further testing, as well as for consideration by regulatory authorities.
Collapse
Affiliation(s)
- Jerica Sabotič
- Department of Biotechnology, Jožef Stefan Institute, 1000 Ljubljana, Slovenia.
| | - Engin Bayram
- Institute of Environmental Sciences, Bogazici University, Bebek, Istanbul 34342, Turkey
| | - David Ezra
- Department of Plant Pathology and Weed Research, ARO, The Volcani Institute, P.O.Box 15159, Rishon LeZion 7528809, Israel
| | - Susana P Gaudêncio
- Associate Laboratory i4HB - Institute for Health and Bioeconomy, NOVA School of Science and Technology, NOVA University Lisbon, 2819-516 Caparica, Portugal; UCIBIO - Applied Biomolecular Sciences Unit, Department of Chemistry, Blue Biotechnology & Biomedicine Lab, NOVA School of Science and Technology, NOVA University of Lisbon, 2819-516 Caparica, Portugal
| | - Berat Z Haznedaroğlu
- Institute of Environmental Sciences, Bogazici University, Bebek, Istanbul 34342, Turkey
| | - Nika Janež
- Department of Biotechnology, Jožef Stefan Institute, 1000 Ljubljana, Slovenia
| | - Leila Ktari
- B3Aqua Laboratory, National Institute of Marine Sciences and Technologies, Carthage University, Tunis, Tunisia
| | - Anna Luganini
- Department of Life Sciences and Systems Biology, University of Turin, 10123 Turin, Italy
| | - Manolis Mandalakis
- Institute of Marine Biology, Biotechnology and Aquaculture, Hellenic Centre for Marine Research, 71500 Heraklion, Greece
| | - Ivo Safarik
- Department of Nanobiotechnology, Biology Centre, ISBB, CAS, Na Sadkach 7, 370 05 Ceske Budejovice, Czech Republic; Regional Centre of Advanced Technologies and Materials, Czech Advanced Technology and Research Institute, Palacky University, Slechtitelu 27, 783 71 Olomouc, Czech Republic
| | - Dina Simes
- Centre of Marine Sciences (CCMAR), Universidade do Algarve, 8005-139 Faro, Portugal; 2GenoGla Diagnostics, Centre of Marine Sciences (CCMAR), Universidade do Algarve, Faro, Portugal
| | - Evita Strode
- Latvian Institute of Aquatic Ecology, Agency of Daugavpils University, Riga LV-1007, Latvia
| | - Anna Toruńska-Sitarz
- Department of Marine Biology and Biotechnology, Faculty of Oceanography and Geography, University of Gdańsk, 81-378 Gdynia, Poland
| | - Despoina Varamogianni-Mamatsi
- Institute of Marine Biology, Biotechnology and Aquaculture, Hellenic Centre for Marine Research, 71500 Heraklion, Greece
| | | | - Marlen I Vasquez
- Department of Chemical Engineering, Cyprus University of Technology, 3036 Limassol, Cyprus
| |
Collapse
|
3
|
Kleinstreuer N, Hartung T. Artificial intelligence (AI)-it's the end of the tox as we know it (and I feel fine). Arch Toxicol 2024; 98:735-754. [PMID: 38244040 PMCID: PMC10861653 DOI: 10.1007/s00204-023-03666-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Accepted: 12/12/2023] [Indexed: 01/22/2024]
Abstract
The rapid progress of AI impacts diverse scientific disciplines, including toxicology, and has the potential to transform chemical safety evaluation. Toxicology has evolved from an empirical science focused on observing apical outcomes of chemical exposure, to a data-rich field ripe for AI integration. The volume, variety and velocity of toxicological data from legacy studies, literature, high-throughput assays, sensor technologies and omics approaches create opportunities but also complexities that AI can help address. In particular, machine learning is well suited to handle and integrate large, heterogeneous datasets that are both structured and unstructured-a key challenge in modern toxicology. AI methods like deep neural networks, large language models, and natural language processing have successfully predicted toxicity endpoints, analyzed high-throughput data, extracted facts from literature, and generated synthetic data. Beyond automating data capture, analysis, and prediction, AI techniques show promise for accelerating quantitative risk assessment by providing probabilistic outputs to capture uncertainties. AI also enables explanation methods to unravel mechanisms and increase trust in modeled predictions. However, issues like model interpretability, data biases, and transparency currently limit regulatory endorsement of AI. Multidisciplinary collaboration is needed to ensure development of interpretable, robust, and human-centered AI systems. Rather than just automating human tasks at scale, transformative AI can catalyze innovation in how evidence is gathered, data are generated, hypotheses are formed and tested, and tasks are performed to usher new paradigms in chemical safety assessment. Used judiciously, AI has immense potential to advance toxicology into a more predictive, mechanism-based, and evidence-integrated scientific discipline to better safeguard human and environmental wellbeing across diverse populations.
Collapse
Affiliation(s)
| | - Thomas Hartung
- Bloomberg School of Public Health, Doerenkamp-Zbinden Chair for Evidence-Based Toxicology, Center for Alternatives to Animal Testing (CAAT), Johns Hopkins University, Baltimore, MD, USA.
- CAAT-Europe, University of Konstanz, Constance, Germany.
| |
Collapse
|
4
|
Mansouri K, Moreira-Filho JT, Lowe CN, Charest N, Martin T, Tkachenko V, Judson R, Conway M, Kleinstreuer NC, Williams AJ. Free and open-source QSAR-ready workflow for automated standardization of chemical structures in support of QSAR modeling. J Cheminform 2024; 16:19. [PMID: 38378618 PMCID: PMC10880251 DOI: 10.1186/s13321-024-00814-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2023] [Accepted: 02/10/2024] [Indexed: 02/22/2024] Open
Abstract
The rapid increase of publicly available chemical structures and associated experimental data presents a valuable opportunity to build robust QSAR models for applications in different fields. However, the common concern is the quality of both the chemical structure information and associated experimental data. This is especially true when those data are collected from multiple sources as chemical substance mappings can contain many duplicate structures and molecular inconsistencies. Such issues can impact the resulting molecular descriptors and their mappings to experimental data and, subsequently, the quality of the derived models in terms of accuracy, repeatability, and reliability. Herein we describe the development of an automated workflow to standardize chemical structures according to a set of standard rules and generate two and/or three-dimensional "QSAR-ready" forms prior to the calculation of molecular descriptors. The workflow was designed in the KNIME workflow environment and consists of three high-level steps. First, a structure encoding is read, and then the resulting in-memory representation is cross-referenced with any existing identifiers for consistency. Finally, the structure is standardized using a series of operations including desalting, stripping of stereochemistry (for two-dimensional structures), standardization of tautomers and nitro groups, valence correction, neutralization when possible, and then removal of duplicates. This workflow was initially developed to support collaborative modeling QSAR projects to ensure consistency of the results from the different participants. It was then updated and generalized for other modeling applications. This included modification of the "QSAR-ready" workflow to generate "MS-ready structures" to support the generation of substance mappings and searches for software applications related to non-targeted analysis mass spectrometry. Both QSAR and MS-ready workflows are freely available in KNIME, via standalone versions on GitHub, and as docker container resources for the scientific community. Scientific contribution: This work pioneers an automated workflow in KNIME, systematically standardizing chemical structures to ensure their readiness for QSAR modeling and broader scientific applications. By addressing data quality concerns through desalting, stereochemistry stripping, and normalization, it optimizes molecular descriptors' accuracy and reliability. The freely available resources in KNIME, GitHub, and docker containers democratize access, benefiting collaborative research and advancing diverse modeling endeavors in chemistry and mass spectrometry.
Collapse
Affiliation(s)
- Kamel Mansouri
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, National Institute of Environmental Health Sciences, Research Triangle Park, NC, 27709, USA.
| | - José T Moreira-Filho
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, National Institute of Environmental Health Sciences, Research Triangle Park, NC, 27709, USA
| | - Charles N Lowe
- Center for Computational Toxicology and Exposure, Office of Research and Development, U.S. Environmental Protection Agency, Research Triangle Park, NC, 27711, USA
| | - Nathaniel Charest
- Center for Computational Toxicology and Exposure, Office of Research and Development, U.S. Environmental Protection Agency, Research Triangle Park, NC, 27711, USA
| | - Todd Martin
- Center for Computational Toxicology and Exposure, Office of Research and Development, U.S. Environmental Protection Agency, Research Triangle Park, NC, 27711, USA
| | | | - Richard Judson
- Center for Computational Toxicology and Exposure, Office of Research and Development, U.S. Environmental Protection Agency, Research Triangle Park, NC, 27711, USA
| | - Mike Conway
- National Institute of Environmental Health Sciences, Research Triangle Park, NC, 27709, USA
| | - Nicole C Kleinstreuer
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, National Institute of Environmental Health Sciences, Research Triangle Park, NC, 27709, USA
| | - Antony J Williams
- Center for Computational Toxicology and Exposure, Office of Research and Development, U.S. Environmental Protection Agency, Research Triangle Park, NC, 27711, USA
| |
Collapse
|
5
|
Moudgal C, Anger LT, Muster W, Nguyen R, Melnikov F, Siramshetty VB, Graham J. The application of acute oral toxicity computational models in dangerous goods classification. Toxicol Ind Health 2023; 39:687-699. [PMID: 37860984 DOI: 10.1177/07482337231209091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2023]
Abstract
Acute oral toxicity (AOT) data inform the acute toxicity potential of a compound and guides occupational safety and transportation practices. AOT data enable the categorization of a chemical into the appropriate AOT Globally Harmonized System (GHS) category based on the severity of the hazard. AOT data are also utilized to identify compounds that are Dangerous Goods (DGs) and subsequent transportation guidance for shipping of these hazardous materials. Proper identification of DGs is challenging for novel compounds that lack data. It is not feasible to err on the side of caution for all compounds lacking AOT data and to designate them as DGs, as shipping a compound as a DG has cost, resource, and time implications. With the wealth of available historical AOT data, AOT testing approaches are evolving, and in silico AOT models are emerging as tools that can be utilized with confidence to assess the acute toxicity potential of de novo molecules. Such approaches align with the 3R principles, offering a reduction or even replacement of traditional in vivo testing methods and can also be leveraged for product stewardship purposes. Utilizing proprietary historical in vivo AOT data for 210 pharmaceutical compounds (PCs), we evaluated the performance of two established in silico AOT programs: the Leadscope AOT Model Suite and the Collaborative Acute Toxicity Modeling Suite. These models accurately identified 94% and 97% compounds that were not DGs (GHS categories 4, 5, and not classified (NC)) suggesting that the models are fit-for-purpose in identifying PCs with low acute oral toxicity potential (LD50 >300 mg/kg). Utilization of these models to identify compounds that are not DGs can enable them to be de-prioritized for in vivo testing. This manuscript provides a detailed evaluation and assessment of the two models and recommends the most suitable applications of such models.
Collapse
Affiliation(s)
| | - Lennart T Anger
- Safety Assessment, Genentech Inc, South San Francisco, CA, USA
| | | | - Ruthi Nguyen
- EHS, Genentech Inc, South San Francisco, CA, USA
| | - Fjodor Melnikov
- Safety Assessment, Genentech Inc, South San Francisco, CA, USA
| | | | - Jessica Graham
- Safety Assessment, Genentech Inc, South San Francisco, CA, USA
| |
Collapse
|
6
|
Viljanen M, Minnema J, Wassenaar PNH, Rorije E, Peijnenburg W. What is the ecotoxicity of a given chemical for a given aquatic species? Predicting interactions between species and chemicals using recommender system techniques. SAR AND QSAR IN ENVIRONMENTAL RESEARCH 2023; 34:765-788. [PMID: 37670728 DOI: 10.1080/1062936x.2023.2254225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Accepted: 08/27/2023] [Indexed: 09/07/2023]
Abstract
Ecotoxicological safety assessment of chemicals requires toxicity data on multiple species, despite the general desire of minimizing animal testing. Predictive models, specifically machine learning (ML) methods, are one of the tools capable of solving this apparent contradiction as they allow to generalize toxicity patterns across chemicals and species. However, despite the availability of large public toxicity datasets, the data is highly sparse, complicating model development. The aim of this study is to provide insights into how ML can predict toxicity using a large but sparse dataset. We developed models to predict LC50-values, based on experimental LC50-data covering 2431 organic chemicals and 1506 aquatic species from the ECOTOX-database. Several well-known ML techniques were evaluated and a new ML model was developed, inspired by recommender systems. This new model involves a simple linear model that learns low-rank interactions between species and chemicals using factorization machines. We evaluated the predictive performances of the developed models based on two validation settings: 1) predicting unseen chemical-species pairs, and 2) predicting unseen chemicals. The results of this study show that ML models can accurately predict LC50-values in both validation settings. Moreover, we show that the novel factorization machine approach can match well-tuned, complex, ML approaches.
Collapse
Affiliation(s)
- M Viljanen
- Department of Statistics, Data Science and Modelling, National Institute of Public Health and the Environment, Bilthoven, The Netherlands
| | - J Minnema
- Center for Safety of Substances and Products, National Institute of Public Health and the Environment, Bilthoven, The Netherlands
| | - P N H Wassenaar
- Center for Safety of Substances and Products, National Institute of Public Health and the Environment, Bilthoven, The Netherlands
| | - E Rorije
- Center for Safety of Substances and Products, National Institute of Public Health and the Environment, Bilthoven, The Netherlands
| | - W Peijnenburg
- Center for Safety of Substances and Products, National Institute of Public Health and the Environment, Bilthoven, The Netherlands
- Institute of Environmental Sciences (CML), Leiden University, Leiden, The Netherlands
| |
Collapse
|
7
|
Strickland J, Haugabrooks E, Allen DG, Balottin LB, Hirabayashi Y, Kleinstreuer NC, Kojima H, Nishizawa C, Prieto P, Ratzlaff DE, Jeong J, Lee J, Yang Y, Lin P, Sullivan K, Casey W. International regulatory uses of acute systemic toxicity data and integration of new approach methodologies. Crit Rev Toxicol 2023; 53:385-411. [PMID: 37646804 PMCID: PMC10592330 DOI: 10.1080/10408444.2023.2240852] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 07/17/2023] [Accepted: 07/17/2023] [Indexed: 09/01/2023]
Abstract
Chemical regulatory authorities around the world require systemic toxicity data from acute exposures via the oral, dermal, and inhalation routes for human health risk assessment. To identify opportunities for regulatory uses of non-animal replacements for these tests, we reviewed acute systemic toxicity testing requirements for jurisdictions that participate in the International Cooperation on Alternative Test Methods (ICATM): Brazil, Canada, China, the European Union, Japan, South Korea, Taiwan, and the USA. The chemical sectors included in our review of each jurisdiction were cosmetics, consumer products, industrial chemicals, pharmaceuticals, medical devices, and pesticides. We found acute systemic toxicity data were most often required for hazard assessment, classification, and labeling, and to a lesser extent quantitative risk assessment. Where animal methods were required, animal reduction methods were typically recommended. For many jurisdictions and chemical sectors, non-animal alternatives are not accepted, but several jurisdictions provide guidance to support the use of test waivers to reduce animal use for specific applications. An understanding of international regulatory requirements for acute systemic toxicity testing will inform ICATM's strategy for the development, acceptance, and implementation of non-animal alternatives to assess the health hazards and risks associated with acute toxicity.
Collapse
Affiliation(s)
- Judy Strickland
- Inotiv, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA
| | - Esther Haugabrooks
- Physicians Committee for Responsible Medicine, 5100 Wisconsin Ave., NW, Suite 400, Washington, DC 20016, USA
| | - David G. Allen
- Inotiv, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA
| | - Luciene B. Balottin
- National Institute of Metrology, Quality and Technology (INMETRO), Av. Nossa Senhora das Graças, no. 50, 22250-020, Duque de Caxias, RJ, Brazil
| | - Yoko Hirabayashi
- Center for Biological Safety and Research, National Institute of Health Sciences, 3-25-26 Tonomachi, Kawasaki-ku, Kawasaki 210-9501, Japan
| | - Nicole C. Kleinstreuer
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, Division of Translational Toxicology, National Institute of Environmental Health Sciences, P.O. Box 12233, Research Triangle Park, NC 27709, USA
| | - Hajime Kojima
- Japanese Center for the Validation of Alternative Methods, National Institute of Health Sciences, 3-25-26 Tonomachi, Kawasaki-ku, Kawasaki 210-9501, Japan
| | - Claudio Nishizawa
- Brazilian Health Regulatory Agency (ANVISA), Setor de Indústria e Abastecimento (SIA) - Trecho 5, Área Especial 57, Lote 200, 71205-050 - Brasilia /DF, Brazil
| | - Pilar Prieto
- European Commission, Joint Research Centre (JRC), Ispra, Italy
| | - Deborah E. Ratzlaff
- New Substances Assessment and Control Bureau, Healthy Environments and Consumer Safety Branch, Health Canada, Ottawa, ON, K1A 0K9 Canada
| | - Jayoung Jeong
- Toxicological Evaluation and Research Department, National Institute of Food and Drug Safety Evaluation, 187 Osongsaengmyeong 2(i)-ro, Osong-eup, Heungdoek-gu, Cheongju-si, Chungcheongbuk-do, 28159, Korea
| | - JinHee Lee
- Toxicological Evaluation and Research Department, National Institute of Food and Drug Safety Evaluation, 187 Osongsaengmyeong 2(i)-ro, Osong-eup, Heungdoek-gu, Cheongju-si, Chungcheongbuk-do, 28159, Korea
| | - Ying Yang
- Guangdong Provincial Center for Disease Control and Prevention, Qunxian Road 160, Panyu strict, Guangzhou, China 510430
| | - Pinpin Lin
- National Health Research Institutes, No. 35, Keyan Road, Zhunan Town, Miaoli County 350, Taiwan
| | - Kristie Sullivan
- Physicians Committee for Responsible Medicine, 5100 Wisconsin Ave., NW, Suite 400, Washington, DC 20016, USA
| | - Warren Casey
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, Division of Translational Toxicology, National Institute of Environmental Health Sciences, P.O. Box 12233, Research Triangle Park, NC 27709, USA
| |
Collapse
|
8
|
Huang L, Zhang Z, Xing H, Luo Y, Yang J, Sui X, Wang Y. Risk assessment based on dose-responsive and time-responsive genes to build PLS-DA models for exogenously induced lung injury. ECOTOXICOLOGY AND ENVIRONMENTAL SAFETY 2023; 256:114891. [PMID: 37054470 DOI: 10.1016/j.ecoenv.2023.114891] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/26/2022] [Revised: 02/28/2023] [Accepted: 04/08/2023] [Indexed: 06/19/2023]
Abstract
Xenobiotics can easily harm human lungs owing to the openness of the respiratory system. Identifying pulmonary toxicity remains challenging owing to several reasons: 1) no biomarkers for pulmonary toxicity are available that might help to detect lung injury; 2) traditional animal experiments are time-consuming; 3) traditional detection methods solely focus on poisoning accidents; 4) analytical chemistry methods hardly achieve universal detection. An in vitro testing system able to identify the pulmonary toxicity of contaminants from food, the environment, and drugs is urgently needed. Compounds are virtually infinite, whereas toxicological mechanisms are countable. Therefore, universal methods to identify and predict the risks of contaminants can be designed based on these well-known toxicity mechanisms. In this study, we established a dataset based on transcriptome sequencing of A549 cells upon treatment with different compounds. The representativeness of our dataset was analyzed using bioinformatics methods. Artificial intelligence methods, namely partial least squares discriminant analysis (PLS-DA) models, were employed for toxicity prediction and toxicant identification. The developed model predicted the pulmonary toxicity of compounds with a 92 % accuracy. These models were submitted to an external validation using highly heterogeneous compounds, which supported the accuracy and robustness of our developed methodology. This assay exhibits universal potential applications for water quality monitoring, crop pollution detection, food and drug safety evaluation, as well as chemical warfare agent detection.
Collapse
Affiliation(s)
- Lijuan Huang
- State Key Laboratory of Toxicology and Medical Countermeasures, Institute of Pharmacology and Toxicology, Academy of Military Medical Sciences, Beijing, China
| | - Zinan Zhang
- State Key Laboratory of Toxicology and Medical Countermeasures, Institute of Pharmacology and Toxicology, Academy of Military Medical Sciences, Beijing, China
| | - Huanchun Xing
- State Key Laboratory of Toxicology and Medical Countermeasures, Institute of Pharmacology and Toxicology, Academy of Military Medical Sciences, Beijing, China
| | - Yuan Luo
- State Key Laboratory of Toxicology and Medical Countermeasures, Institute of Pharmacology and Toxicology, Academy of Military Medical Sciences, Beijing, China
| | - Jun Yang
- State Key Laboratory of Toxicology and Medical Countermeasures, Institute of Pharmacology and Toxicology, Academy of Military Medical Sciences, Beijing, China
| | - Xin Sui
- State Key Laboratory of Toxicology and Medical Countermeasures, Institute of Pharmacology and Toxicology, Academy of Military Medical Sciences, Beijing, China.
| | - Yongan Wang
- State Key Laboratory of Toxicology and Medical Countermeasures, Institute of Pharmacology and Toxicology, Academy of Military Medical Sciences, Beijing, China.
| |
Collapse
|
9
|
Tran TTV, Surya Wibowo A, Tayara H, Chong KT. Artificial Intelligence in Drug Toxicity Prediction: Recent Advances, Challenges, and Future Perspectives. J Chem Inf Model 2023; 63:2628-2643. [PMID: 37125780 DOI: 10.1021/acs.jcim.3c00200] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
Toxicity prediction is a critical step in the drug discovery process that helps identify and prioritize compounds with the greatest potential for safe and effective use in humans, while also reducing the risk of costly late-stage failures. It is estimated that over 30% of drug candidates are discarded owing to toxicity. Recently, artificial intelligence (AI) has been used to improve drug toxicity prediction as it provides more accurate and efficient methods for identifying the potentially toxic effects of new compounds before they are tested in human clinical trials, thus saving time and money. In this review, we present an overview of recent advances in AI-based drug toxicity prediction, including the use of various machine learning algorithms and deep learning architectures, of six major toxicity properties and Tox21 assay end points. Additionally, we provide a list of public data sources and useful toxicity prediction tools for the research community and highlight the challenges that must be addressed to enhance model performance. Finally, we discuss future perspectives for AI-based drug toxicity prediction. This review can aid researchers in understanding toxicity prediction and pave the way for new methods of drug discovery.
Collapse
Affiliation(s)
- Thi Tuyet Van Tran
- Department of Electronics and Information Engineering, Jeonbuk National University, Jeonju 54896, Republic of Korea
- Faculty of Information Technology, An Giang University, Long Xuyen 880000, Vietnam
- Vietnam National University - Ho Chi Minh City, Ho Chi Minh 700000, Vietnam
| | - Agung Surya Wibowo
- Department of Electronics and Information Engineering, Jeonbuk National University, Jeonju 54896, Republic of Korea
- Department of Electrical Engineering, Telkom University, Bandung 40257, Indonesia
| | - Hilal Tayara
- School of International Engineering and Science, Jeonbuk National University, Jeonju 54896, Republic of Korea
| | - Kil To Chong
- Advances Electronics and Information Research Center, Jeonbuk National University, Jeonju 54896, Republic of Korea
| |
Collapse
|
10
|
Mukherjee G, Braka A, Wu S. Quantifying Functional-Group-like Structural Fragments in Molecules and Its Applications in Drug Design. J Chem Inf Model 2023; 63:2073-2083. [PMID: 36881497 DOI: 10.1021/acs.jcim.3c00050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/08/2023]
Abstract
A functional group in a molecule is a structural fragment consisting of a few atoms or a single atom that imparts reactivity to a molecule. Hence, defining functional groups is crucial in chemistry to predict the properties and reactivities of molecules. However, there is no established method in the literature for defining functional groups based on reactivity parameters. In this work, we addressed this issue by designing a set of predefined structural fragments along with reactivity parameters like electron conjugation and ring strain. This approach uses bond orders and atom connectivities to quantify the presence of these fragments within an organic molecule based on a given input molecular coordinate. To assess the effectiveness of this approach, we performed a case study to show the benefits of using these newly designed structural fragments instead of traditional fingerprint-based methods for grouping potential COX1/COX2 inhibitors by screening an approved drug library against aspirin molecule. The structural fragment-based model for ternary classification of rat oral LD50 of chemicals showed performance similar to the fingerprint-based models. In evaluating the regression model performance for aqueous solubility, log(S), predictions, our approach outperformed the fingerprint-based model.
Collapse
Affiliation(s)
- Goutam Mukherjee
- R&D Center, PharmCADD Co. Ltd., 12F, 331, Jungang-daero, Dong-gu, Busan 48792, Republic of Korea
| | - Abdennour Braka
- R&D Center, PharmCADD Co. Ltd., 12F, 331, Jungang-daero, Dong-gu, Busan 48792, Republic of Korea
| | - Sangwook Wu
- R&D Center, PharmCADD Co. Ltd., 12F, 331, Jungang-daero, Dong-gu, Busan 48792, Republic of Korea.,Department of Physics, Pukyong National University, Busan 48513, Republic of Korea
| |
Collapse
|
11
|
Lane TR, Harris J, Urbina F, Ekins S. Comparing LD 50/LC 50 Machine Learning Models for Multiple Species. ACS CHEMICAL HEALTH & SAFETY 2023. [DOI: 10.1021/acs.chas.2c00088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/25/2023]
Affiliation(s)
- Thomas R. Lane
- Collaborations Pharmaceuticals, Inc., 840 Main Campus Drive, Lab 3510, Raleigh, North Carolina 27606, United States
| | - Joshua Harris
- Collaborations Pharmaceuticals, Inc., 840 Main Campus Drive, Lab 3510, Raleigh, North Carolina 27606, United States
| | - Fabio Urbina
- Collaborations Pharmaceuticals, Inc., 840 Main Campus Drive, Lab 3510, Raleigh, North Carolina 27606, United States
| | - Sean Ekins
- Collaborations Pharmaceuticals, Inc., 840 Main Campus Drive, Lab 3510, Raleigh, North Carolina 27606, United States
| |
Collapse
|
12
|
Xiao L, Deng J, Yang L, Huang X, Yu X. Random forest algorithm-based accurate prediction of rat acute oral toxicity. Mol Phys 2022. [DOI: 10.1080/00268976.2022.2140083] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Affiliation(s)
- Linrong Xiao
- Hunan Provincial Key Laboratory of Environmental Catalysis & Waste Regeneration, College of Materials and Chemical Engineering, Hunan Institute of Engineering, Xiangtan, People’s Republic of China
| | - Jiyong Deng
- Hunan Provincial Key Laboratory of Environmental Catalysis & Waste Regeneration, College of Materials and Chemical Engineering, Hunan Institute of Engineering, Xiangtan, People’s Republic of China
| | - Liping Yang
- Shenzhen Expressway Environment Co., Ltd., Shenzhen, People’s Republic of China
| | - Xianwei Huang
- Hunan Provincial Key Laboratory of Environmental Catalysis & Waste Regeneration, College of Materials and Chemical Engineering, Hunan Institute of Engineering, Xiangtan, People’s Republic of China
| | - Xinliang Yu
- Hunan Provincial Key Laboratory of Environmental Catalysis & Waste Regeneration, College of Materials and Chemical Engineering, Hunan Institute of Engineering, Xiangtan, People’s Republic of China
| |
Collapse
|
13
|
Limbu S, Zakka C, Dakshanamurthy S. Predicting Dose-Range Chemical Toxicity using Novel Hybrid Deep Machine-Learning Method. TOXICS 2022; 10:706. [PMID: 36422913 PMCID: PMC9692315 DOI: 10.3390/toxics10110706] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2022] [Revised: 11/15/2022] [Accepted: 11/17/2022] [Indexed: 06/16/2023]
Abstract
Humans are exposed to thousands of chemicals, including environmental chemicals. Unfortunately, little is known about their potential toxicity, as determining the toxicity remains challenging due to the substantial resources required to assess a chemical in vivo. Here, we present a novel hybrid neural network (HNN) deep learning method, called HNN-Tox, to predict chemical toxicity at different doses. To develop a hybrid HNN-Tox method, we combined two neural network frameworks, the Convolutional Neural Network (CNN) and the multilayer perceptron (MLP)-type feed-forward neural network (FFNN). Combining the CNN and FCNN in the field of environmental chemical toxicity prediction is a novel approach. We developed several binary and multiclass classification models to assess dose-range chemical toxicity that is trained based on thousands of chemicals with known toxicity. The performance of the HNN-Tox was compared with other machine-learning methods, including Random Forest (RF), Bootstrap Aggregation (Bagging), and Adaptive Boosting (AdaBoost). We also analyzed the model performance dependency on varying features, descriptors, dataset size, route of exposure, and toxic dose. The HNN-Tox model, trained on 59,373 chemicals annotated with known LD50 and routes of exposure, maintained its predictive ability with an accuracy of 84.9% and 84.1%, even after reducing the descriptor size from 318 to 51, and the area under the ROC curve (AUC) was 0.89 and 0.88, respectively. Further, we validated the HNN-Tox with several external toxic chemical datasets on a large scale. The HNN-Tox performed optimally or better than the other machine-learning methods for diverse chemicals. This study is the first to report a large-scale prediction of dose-range chemical toxicity with varying features. The HNN-Tox has broad applicability in predicting toxicity for diverse chemicals and could serve as an alternative methodology approach to animal-based toxicity assessment.
Collapse
Affiliation(s)
- Sarita Limbu
- Lombardi Comprehensive Cancer Center, Georgetown University Medical Center, Washington, DC 20057, USA
| | - Cyril Zakka
- Faculty of Medicine, American University of Beirut Medical Center, Beirut 1107 2020, Lebanon
| | - Sivanesan Dakshanamurthy
- Lombardi Comprehensive Cancer Center, Georgetown University Medical Center, Washington, DC 20057, USA
| |
Collapse
|
14
|
Zwickl CM, Graham J, Jolly R, Bassan A, Ahlberg E, Amberg A, Anger LT, Barton-Maclaren T, Beilke L, Bellion P, Brigo A, Cronin MT, Custer L, Devlin A, Burleigh-Flayers H, Fish T, Glover K, Glowienke S, Gromek K, Jones D, Karmaus A, Kemper R, Piparo EL, Madia F, Martin M, Masuda-Herrera M, McAtee B, Mestre J, Milchak L, Moudgal C, Mumtaz M, Muster W, Neilson L, Patlewicz G, Paulino A, Roncaglioni A, Ruiz P, Suarez D, Szabo DT, Valentin JP, Vardakou I, Woolley D, Myatt G. Principles and Procedures for Assessment of Acute Toxicity Incorporating In Silico Methods. COMPUTATIONAL TOXICOLOGY (AMSTERDAM, NETHERLANDS) 2022; 24:100237. [PMID: 36818760 PMCID: PMC9934006 DOI: 10.1016/j.comtox.2022.100237] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Acute toxicity in silico models are being used to support an increasing number of application areas including (1) product research and development, (2) product approval and registration as well as (3) the transport, storage and handling of chemicals. The adoption of such models is being hindered, in part, because of a lack of guidance describing how to perform and document an in silico analysis. To address this issue, a framework for an acute toxicity hazard assessment is proposed. This framework combines results from different sources including in silico methods and in vitro or in vivo experiments. In silico methods that can assist the prediction of in vivo outcomes (i.e., LD50) are analyzed concluding that predictions obtained using in silico approaches are now well-suited for reliably supporting assessment of LD50-based acute toxicity for the purpose of GHS classification. A general overview is provided of the endpoints from in vitro studies commonly evaluated for predicting acute toxicity (e.g., cytotoxicity/cytolethality as well as assays targeting specific mechanisms). The increased understanding of pathways and key triggering mechanisms underlying toxicity and the increased availability of in vitro data allow for a shift away from assessments solely based on endpoints such as LD50, to mechanism-based endpoints that can be accurately assessed in vitro or by using in silico prediction models. This paper also highlights the importance of an expert review of all available information using weight-of-evidence considerations and illustrates, using a series of diverse practical use cases, how in silico approaches support the assessment of acute toxicity.
Collapse
Affiliation(s)
| | - Jessica Graham
- Genentech, Inc., 1 DNA Way, South San Francisco, CA 94080, USA
| | - Robert Jolly
- Eli Lilly and Company, Indianapolis, IN 46285, USA
| | - Arianna Bassan
- Innovatune srl, Via Giulio Zanon 130/D, 35129 Padova, Italy
| | - Ernst Ahlberg
- Universal Prediction AB, Gothenburg, Sweden
- Department of Pharmaceutical Biosciences, Uppsala University, Uppsala, Sweden
| | - Alexander Amberg
- Sanofi, R&D Preclinical Safety Frankfurt, Industriepark Hoechst, D-65926 Frankfurt am Main, Germany
| | | | - Tara Barton-Maclaren
- Healthy Environments and Consumer Safety Branch, Health Canada / Government of Canada
| | - Lisa Beilke
- Toxicology Solutions, Inc., 10531 4S Commons Dr. #594, San Diego, CA 92127, USA
| | - Phillip Bellion
- Boehringer Ingelheim Animal Health, Binger Str. 128, 55216 Ingelheim am Rhein, Germany
| | - Alessandro Brigo
- Roche Pharmaceutical Research & Early Development, Roche Innovation Center Basel, Grenzacherstrasse 124, 4070, Basel, Switzerland
| | | | | | - Amy Devlin
- FDA Center for Drug Evaluation and Research, Silver Spring, MD 20993, USA
| | | | - Trevor Fish
- Nelson Laboratories, Salt Lake City, Utah, USA
| | | | | | | | - David Jones
- MHRA, 10 South Colonnade, Canary Wharf, London E14 4PU
| | - Agnes Karmaus
- Integrated Laboratory Systems, LLC, Morrisville, NC, USA
| | | | - Elena Lo Piparo
- Chemical Food Safety Group, Nestlé Research, Lausanne, Switzerland
| | - Federica Madia
- European Commission, Joint Research Centre (JRC), Ispra, Italy
| | | | | | | | - Jordi Mestre
- IMIM Institut Hospital Del Mar d’Investigacions Mèdiques and Universitat Pompeu Fabra, Doctor Aiguader 88, Parc de Recerca Biomèdica, 08003 Barcelona, Spain
- Chemotargets SL, Baldiri Reixac 4, Parc Científic de Barcelona, 08028 Barcelona, Spain
| | | | | | - Moiz Mumtaz
- Office of the Associate Director for Science, Agency for Toxic Substances and Disease Registry, Centers for Disease Control and Prevention, Atlanta, GA 30333, USA
| | - Wolfgang Muster
- Roche Pharmaceutical Research & Early Development, Roche Innovation Center Basel, Grenzacherstrasse 124, 4070, Basel, Switzerland
| | | | - Grace Patlewicz
- Centre for Computational Toxicology and Exposure (CCTE), US Environmental Protection Agency, Research Triangle Park, NC, USA
| | | | - Alessandra Roncaglioni
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Milan, Italy
| | - Patricia Ruiz
- Centers for Disease Control and Prevention (CDC), Atlanta, GA 30341, USA
| | - Diana Suarez
- FSTox Consulting LTD, 2 Brooks Road Raunds Wellingborough NN9 6NS
| | | | - Jean-Pierre Valentin
- UCB-Biopharma SRL, Development Science, Avenue de l’industrie, Braine l’Alleud, Wallonia, Belgium
| | - Ioanna Vardakou
- British American Tobacco (Investments) Ltd., R&D Centre, Southampton, Hampshire SO15 8TL, UK
| | | | - Glenn Myatt
- Instem, 1393 Dublin Rd, Columbus, OH 43215, USA
| |
Collapse
|
15
|
Edwards SW, Nelms M, Hench VK, Ponder J, Sullivan K. Mapping Mechanistic Pathways of Acute Oral Systemic Toxicity Using Chemical Structure and Bioactivity Measurements. FRONTIERS IN TOXICOLOGY 2022; 4:824094. [PMID: 35295211 PMCID: PMC8915918 DOI: 10.3389/ftox.2022.824094] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2021] [Accepted: 01/31/2022] [Indexed: 12/16/2022] Open
Abstract
Regulatory agencies around the world have committed to reducing or eliminating animal testing for establishing chemical safety. Adverse outcome pathways can facilitate replacement by providing a mechanistic framework for identifying the appropriate non-animal methods and connecting them to apical adverse outcomes. This study separated 11,992 chemicals with curated rat oral acute toxicity information into clusters of structurally similar compounds. Each cluster was then assigned one or more ToxCast/Tox21 assays by looking for the minimum number of assays required to record at least one positive hit call below cytotoxicity for all acutely toxic chemicals in the cluster. When structural information is used to select assays for testing, none of the chemicals required more than four assays and 98% required two assays or less. Both the structure-based clusters and activity from the associated assays were significantly associated with the GHS toxicity classification of the chemicals, which suggests that a combination of bioactivity and structural information could be as reproducible as traditional in vivo studies. Predictivity is improved when the in vitro assay directly corresponds to the mechanism of toxicity, but many indirect assays showed promise as well. Given the lower cost of in vitro testing, a small assay battery including both general cytotoxicity assays and two or more orthogonal assays targeting the toxicological mechanism could be used to improve performance further. This approach illustrates the promise of combining existing in silico approaches, such as the Collaborative Acute Toxicity Modeling Suite (CATMoS), with structure-based bioactivity information as part of an efficient tiered testing strategy that can reduce or eliminate animal testing for acute oral toxicity.
Collapse
Affiliation(s)
- Stephen W. Edwards
- GenOmics, Bioinformatics, and Translational Research Center, RTI International, Research Triangle Park, Durham, NC, United States
- *Correspondence: Stephen W. Edwards, ; Kristie Sullivan,
| | - Mark Nelms
- GenOmics, Bioinformatics, and Translational Research Center, RTI International, Research Triangle Park, Durham, NC, United States
| | - Virginia K. Hench
- GenOmics, Bioinformatics, and Translational Research Center, RTI International, Research Triangle Park, Durham, NC, United States
| | - Jessica Ponder
- Physicians Committee for Responsible Medicine, Washington, DC, United States
| | - Kristie Sullivan
- Physicians Committee for Responsible Medicine, Washington, DC, United States
- *Correspondence: Stephen W. Edwards, ; Kristie Sullivan,
| |
Collapse
|
16
|
Borba JV, Alves VM, Braga RC, Korn DR, Overdahl K, Silva AC, Hall SU, Overdahl E, Kleinstreuer N, Strickland J, Allen D, Andrade CH, Muratov EN, Tropsha A. STopTox: An in Silico Alternative to Animal Testing for Acute Systemic and Topical Toxicity. ENVIRONMENTAL HEALTH PERSPECTIVES 2022; 130:27012. [PMID: 35192406 PMCID: PMC8863177 DOI: 10.1289/ehp9341] [Citation(s) in RCA: 30] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/17/2021] [Revised: 01/21/2022] [Accepted: 01/24/2022] [Indexed: 05/22/2023]
Abstract
BACKGROUND Modern chemical toxicology is facing a growing need to Reduce, Refine, and Replace animal tests (Russell 1959) for hazard identification. The most common type of animal assays for acute toxicity assessment of chemicals used as pesticides, pharmaceuticals, or in cosmetic products is known as a "6-pack" battery of tests, including three topical (skin sensitization, skin irritation and corrosion, and eye irritation and corrosion) and three systemic (acute oral toxicity, acute inhalation toxicity, and acute dermal toxicity) end points. METHODS We compiled, curated, and integrated, to the best of our knowledge, the largest publicly available data sets and developed an ensemble of quantitative structure-activity relationship (QSAR) models for all six end points. All models were validated according to the Organisation for Economic Co-operation and Development (OECD) QSAR principles, using data on compounds not included in the training sets. RESULTS In addition to high internal accuracy assessed by cross-validation, all models demonstrated an external correct classification rate ranging from 70% to 77%. We established a publicly accessible Systemic and Topical chemical Toxicity (STopTox) web portal (https://stoptox.mml.unc.edu/) integrating all developed models for 6-pack assays. CONCLUSIONS We developed STopTox, a comprehensive collection of computational models that can be used as an alternative to in vivo 6-pack tests for predicting the toxicity hazard of small organic molecules. Models were established following the best practices for the development and validation of QSAR models. Scientists and regulators can use the STopTox portal to identify putative toxicants or nontoxicants in chemical libraries of interest. https://doi.org/10.1289/EHP9341.
Collapse
Affiliation(s)
- Joyce V.B. Borba
- Laboratory for Molecular Modeling, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
- Laboratory for Molecular Modeling and Drug Design, Federal University of Goias, Goiania, Goias, Brazil
| | - Vinicius M. Alves
- Laboratory for Molecular Modeling, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
| | | | - Daniel R. Korn
- Laboratory for Molecular Modeling, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
| | - Kirsten Overdahl
- Nicholas School of the Environment, Duke University, Durham, North Carolina, USA
| | - Arthur C. Silva
- Laboratory for Molecular Modeling and Drug Design, Federal University of Goias, Goiania, Goias, Brazil
| | - Steven U.S. Hall
- Laboratory for Molecular Modeling and Drug Design, Federal University of Goias, Goiania, Goias, Brazil
| | - Erik Overdahl
- Laboratory for Molecular Modeling, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
| | - Nicole Kleinstreuer
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM), National Institute of Environmental Health Sciences, Research Triangle Park, North Carolina, USA
| | - Judy Strickland
- Integrated Laboratory Systems, LLC, Research Triangle Park, North Carolina, USA
| | - David Allen
- Integrated Laboratory Systems, LLC, Research Triangle Park, North Carolina, USA
| | - Carolina Horta Andrade
- Laboratory for Molecular Modeling and Drug Design, Federal University of Goias, Goiania, Goias, Brazil
| | - Eugene N. Muratov
- Laboratory for Molecular Modeling, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
- Department of Pharmaceutical Sciences, Federal University of Paraiba, Joao Pessoa, Paraiba, Brazil
| | - Alexander Tropsha
- Laboratory for Molecular Modeling, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
| |
Collapse
|
17
|
The use of Bayesian methodology in the development and validation of a tiered assessment approach towards prediction of rat acute oral toxicity. Arch Toxicol 2022; 96:817-830. [PMID: 35034154 PMCID: PMC8850222 DOI: 10.1007/s00204-021-03205-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2021] [Accepted: 12/09/2021] [Indexed: 11/16/2022]
Abstract
There exists consensus that the traditional means by which safety of chemicals is assessed—namely through reliance upon apical outcomes obtained following in vivo testing—is increasingly unfit for purpose. Whilst efforts in development of suitable alternatives continue, few have achieved levels of robustness required for regulatory acceptance. An array of “new approach methodologies” (NAM) for determining toxic effect, spanning in vitro and in silico spheres, have by now emerged. It has been suggested, intuitively, that combining data obtained from across these sources might serve to enhance overall confidence in derived judgment. This concept may be formalised in the “tiered assessment” approach, whereby evidence gathered through a sequential NAM testing strategy is exploited so to infer the properties of a compound of interest. Our intention has been to provide an illustration of how such a scheme might be developed and applied within a practical setting—adopting for this purpose the endpoint of rat acute oral lethality. Bayesian statistical inference is drawn upon to enable quantification of degree of confidence that a substance might ultimately belong to one of five LD50-associated toxicity categories. Informing this is evidence acquired both from existing in silico and in vitro resources, alongside a purposely-constructed random forest model and structural alert set. Results indicate that the combination of in silico methodologies provides moderately conservative estimations of hazard, conducive for application in safety assessment, and for which levels of certainty are defined. Accordingly, scope for potential extension of approach to further toxicological endpoints is demonstrated.
Collapse
|
18
|
Abstract
In this chapter, we give a brief overview of the regulatory requirements for acute systemic toxicity information in the European Union, and we review structure-based computational models that are available and potentially useful in the assessment of acute systemic toxicity. Emphasis is placed on quantitative structure-activity relationship (QSAR) models implemented by means of a range of software tools. The most recently published literature models for acute systemic toxicity are also discussed, and perspectives for future developments in this field are offered.
Collapse
Affiliation(s)
- Ivanka Tsakovska
- Institute of Biophysics and Biomedical Engineering, Bulgarian Academy of Sciences, Sofia, Bulgaria.
| | - Antonia Diukendjieva
- Institute of Biophysics and Biomedical Engineering, Bulgarian Academy of Sciences, Sofia, Bulgaria
| | - Andrew P Worth
- European Commission, Joint Research Centre (JRC), Ispra, Italy
| |
Collapse
|
19
|
Gromek K, Hawkins W, Dunn Z, Gawlik M, Ballabio D. Evaluation of the predictivity of Acute Oral Toxicity (AOT) structure-activity relationship models. Regul Toxicol Pharmacol 2021; 129:105109. [PMID: 34968630 DOI: 10.1016/j.yrtph.2021.105109] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 12/10/2021] [Accepted: 12/22/2021] [Indexed: 11/17/2022]
Abstract
Several public efforts are aimed at discovering patterns or classifiers in the high-dimensional bioactivity space that predict tissue, organ or whole animal toxicological endpoints. The current study sought to assess and compare the predictions of the Globally Harmonized System (GHS) categories and Dangerous Goods (DG) classifications based on Lethal Dose (LD50) from several available tools (ACD/Labs, Leadscope, T.E.S.T., CATMoS, CaseUltra). External validation was done using dataset of 375 substances to demonstrate their predictive capacity. All models showed very good performance for identifying non-toxic compounds, which would be useful for DG classification, developing or triaging new chemicals, prioritizing existing chemicals for more detailed and rigorous toxicity assessments, and assessing non-active pharmaceutical intermediates. This would ultimately reduce animal use and improve risk assessments. Category-to-category prediction was not optimal, mainly due to the tendency to overpredict the outcome and the general limitations of acute oral toxicity (AOT) in vivo studies. Overprediction does not specifically pose a risk to human health, it can impact transport and material packaging requirements. Performance for compounds with LD50 ≤ 300 mg/kg (approx. 5% of the dataset) was the poorest among all groups and could be potentially improved by including expert review and read-across to similar substances.
Collapse
Affiliation(s)
- Kamila Gromek
- GlaxoSmithKline, Gunnels Wood Road Stevenage Herts SG1 2NY, United Kingdom.
| | - William Hawkins
- GlaxoSmithKline, Gunnels Wood Road Stevenage Herts SG1 2NY, United Kingdom.
| | - Zoe Dunn
- GlaxoSmithKline, Gunnels Wood Road Stevenage Herts SG1 2NY, United Kingdom.
| | - Maciej Gawlik
- Department of Medicinal Chemistry, Medical University of Lublin, Poland.
| | - Davide Ballabio
- Chemometrics and QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Italy.
| |
Collapse
|
20
|
Feinstein J, Sivaraman G, Picel K, Peters B, Vázquez-Mayagoitia Á, Ramanathan A, MacDonell M, Foster I, Yan E. Uncertainty-Informed Deep Transfer Learning of Perfluoroalkyl and Polyfluoroalkyl Substance Toxicity. J Chem Inf Model 2021; 61:5793-5803. [PMID: 34905348 DOI: 10.1021/acs.jcim.1c01204] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Perfluoroalkyl and polyfluoroalkyl substances (PFAS) pose a significant hazard because of their widespread industrial uses, environmental persistence, and bioaccumulation. A growing, increasingly diverse inventory of PFAS, including 8163 chemicals, has recently been updated by the U.S. Environmental Protection Agency. However, with the exception of a handful of well-studied examples, little is known about their human toxicity potential because of the substantial resources required for in vivo toxicity experiments. We tackle the problem of expensive in vivo experiments by evaluating multiple machine learning (ML) methods, including random forests, deep neural networks (DNN), graph convolutional networks, and Gaussian processes, for predicting acute toxicity (e.g., median lethal dose, or LD50) of PFAS compounds. To address the scarcity of toxicity information for PFAS, publicly available datasets of oral rat LD50 for all organic compounds are aggregated and used to develop state-of-the-art ML source models for transfer learning. A total of 519 fluorinated compounds containing two or more C-F bonds with known toxicity are used for knowledge transfer to ensembles of the best-performing source model, DNN, to generate the target models for the PFAS domain with access to uncertainty. This study predicts toxicity for PFAS with a defined chemical structure. To further inform prediction confidence, the transfer-learned model is embedded within a SelectiveNet architecture, where the model is allowed to identify regions of prediction with greater confidence and abstain from those with high uncertainty using a calibrated cutoff rate.
Collapse
Affiliation(s)
- Jeremy Feinstein
- Environmental Science Division, Argonne National Laboratory, Lemont, Illinois 60439, United States
| | - Ganesh Sivaraman
- Data Science and Learning Division, Argonne National Laboratory, Lemont, Illinois 60439, United States
| | - Kurt Picel
- Environmental Science Division, Argonne National Laboratory, Lemont, Illinois 60439, United States
| | - Brian Peters
- Environmental Science Division, Argonne National Laboratory, Lemont, Illinois 60439, United States
| | | | - Arvind Ramanathan
- Data Science and Learning Division, Argonne National Laboratory, Lemont, Illinois 60439, United States
| | - Margaret MacDonell
- Environmental Science Division, Argonne National Laboratory, Lemont, Illinois 60439, United States
| | - Ian Foster
- Data Science and Learning Division, Argonne National Laboratory, Lemont, Illinois 60439, United States
| | - Eugene Yan
- Environmental Science Division, Argonne National Laboratory, Lemont, Illinois 60439, United States
| |
Collapse
|
21
|
Ciallella HL, Russo DP, Aleksunes LM, Grimm FA, Zhu H. Revealing Adverse Outcome Pathways from Public High-Throughput Screening Data to Evaluate New Toxicants by a Knowledge-Based Deep Neural Network Approach. ENVIRONMENTAL SCIENCE & TECHNOLOGY 2021; 55:10875-10887. [PMID: 34304572 PMCID: PMC8713073 DOI: 10.1021/acs.est.1c02656] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Traditional experimental testing to identify endocrine disruptors that enhance estrogenic signaling relies on expensive and labor-intensive experiments. We sought to design a knowledge-based deep neural network (k-DNN) approach to reveal and organize public high-throughput screening data for compounds with nuclear estrogen receptor α and β (ERα and ERβ) binding potentials. The target activity was rodent uterotrophic bioactivity driven by ERα/ERβ activations. After training, the resultant network successfully inferred critical relationships among ERα/ERβ target bioassays, shown as weights of 6521 edges between 1071 neurons. The resultant network uses an adverse outcome pathway (AOP) framework to mimic the signaling pathway initiated by ERα and identify compounds that mimic endogenous estrogens (i.e., estrogen mimetics). The k-DNN can predict estrogen mimetics by activating neurons representing several events in the ERα/ERβ signaling pathway. Therefore, this virtual pathway model, starting from a compound's chemistry initiating ERα activation and ending with rodent uterotrophic bioactivity, can efficiently and accurately prioritize new estrogen mimetics (AUC = 0.864-0.927). This k-DNN method is a potential universal computational toxicology strategy to utilize public high-throughput screening data to characterize hazards and prioritize potentially toxic compounds.
Collapse
Affiliation(s)
- Heather L Ciallella
- Center for Computational and Integrative Biology, Rutgers University Camden, Camden, New Jersey 08103, United States
| | - Daniel P Russo
- Center for Computational and Integrative Biology, Rutgers University Camden, Camden, New Jersey 08103, United States
- Department of Chemistry, Rutgers University Camden, Camden, New Jersey 08102, United States
| | - Lauren M Aleksunes
- Department of Pharmacology and Toxicology, Ernest Mario School of Pharmacy, Rutgers University, Piscataway, New Jersey 08854, United States
| | - Fabian A Grimm
- ExxonMobil Biomedical Sciences, Inc., Annandale, New Jersey 08801, United States
| | - Hao Zhu
- Center for Computational and Integrative Biology, Rutgers University Camden, Camden, New Jersey 08103, United States
- Department of Chemistry, Rutgers University Camden, Camden, New Jersey 08102, United States
| |
Collapse
|
22
|
Mansouri K, Karmaus AL, Fitzpatrick J, Patlewicz G, Pradeep P, Alberga D, Alepee N, Allen TE, Allen D, Alves VM, Andrade CH, Auernhammer TR, Ballabio D, Bell S, Benfenati E, Bhattacharya S, Bastos JV, Boyd S, Brown J, Capuzzi SJ, Chushak Y, Ciallella H, Clark AM, Consonni V, Daga PR, Ekins S, Farag S, Fedorov M, Fourches D, Gadaleta D, Gao F, Gearhart JM, Goh G, Goodman JM, Grisoni F, Grulke CM, Hartung T, Hirn M, Karpov P, Korotcov A, Lavado GJ, Lawless M, Li X, Luechtefeld T, Lunghini F, Mangiatordi GF, Marcou G, Marsh D, Martin T, Mauri A, Muratov EN, Myatt GJ, Nguyen DT, Nicolotti O, Note R, Pande P, Parks AK, Peryea T, Polash AH, Rallo R, Roncaglioni A, Rowlands C, Ruiz P, Russo DP, Sayed A, Sayre R, Sheils T, Siegel C, Silva AC, Simeonov A, Sosnin S, Southall N, Strickland J, Tang Y, Teppen B, Tetko IV, Thomas D, Tkachenko V, Todeschini R, Toma C, Tripodi I, Trisciuzzi D, Tropsha A, Varnek A, Vukovic K, Wang Z, Wang L, Waters KM, Wedlake AJ, Wijeyesakere SJ, Wilson D, Xiao Z, Yang H, Zahoranszky-Kohalmi G, Zakharov AV, Zhang FF, Zhang Z, Zhao T, Zhu H, Zorn KM, Casey W, Kleinstreuer NC. CATMoS: Collaborative Acute Toxicity Modeling Suite. ENVIRONMENTAL HEALTH PERSPECTIVES 2021; 129:47013. [PMID: 33929906 PMCID: PMC8086800 DOI: 10.1289/ehp8495] [Citation(s) in RCA: 51] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
BACKGROUND Humans are exposed to tens of thousands of chemical substances that need to be assessed for their potential toxicity. Acute systemic toxicity testing serves as the basis for regulatory hazard classification, labeling, and risk management. However, it is cost- and time-prohibitive to evaluate all new and existing chemicals using traditional rodent acute toxicity tests. In silico models built using existing data facilitate rapid acute toxicity predictions without using animals. OBJECTIVES The U.S. Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM) Acute Toxicity Workgroup organized an international collaboration to develop in silico models for predicting acute oral toxicity based on five different end points: Lethal Dose 50 (LD50 value, U.S. Environmental Protection Agency hazard (four) categories, Globally Harmonized System for Classification and Labeling hazard (five) categories, very toxic chemicals [LD50 (LD50≤50mg/kg)], and nontoxic chemicals (LD50>2,000mg/kg). METHODS An acute oral toxicity data inventory for 11,992 chemicals was compiled, split into training and evaluation sets, and made available to 35 participating international research groups that submitted a total of 139 predictive models. Predictions that fell within the applicability domains of the submitted models were evaluated using external validation sets. These were then combined into consensus models to leverage strengths of individual approaches. RESULTS The resulting consensus predictions, which leverage the collective strengths of each individual model, form the Collaborative Acute Toxicity Modeling Suite (CATMoS). CATMoS demonstrated high performance in terms of accuracy and robustness when compared with in vivo results. DISCUSSION CATMoS is being evaluated by regulatory agencies for its utility and applicability as a potential replacement for in vivo rat acute oral toxicity studies. CATMoS predictions for more than 800,000 chemicals have been made available via the National Toxicology Program's Integrated Chemical Environment tools and data sets (ice.ntp.niehs.nih.gov). The models are also implemented in a free, standalone, open-source tool, OPERA, which allows predictions of new and untested chemicals to be made. https://doi.org/10.1289/EHP8495.
Collapse
Affiliation(s)
- Kamel Mansouri
- Integrated Laboratory Systems, LLC, Morrisville, North Carolina, USA
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, Research Triangle Park, North Carolina, USA
| | - Agnes L. Karmaus
- Integrated Laboratory Systems, LLC, Morrisville, North Carolina, USA
| | | | - Grace Patlewicz
- Center for Computational Toxicology and Exposure, U.S. Environmental Protection Agency, Research Triangle Park, North Carolina, USA
| | - Prachi Pradeep
- Center for Computational Toxicology and Exposure, U.S. Environmental Protection Agency, Research Triangle Park, North Carolina, USA
- Oak Ridge Institute for Science and Education (ORISE) Research Participation Program, U.S. Environmental Protection Agency, Research Triangle Park, North Carolina, USA
| | - Domenico Alberga
- Dipartimento di Farmacia-Scienze del Farmaco, Università degli Studi di Bari “Aldo Moro”, Bari, Italy
| | | | - Timothy E.H. Allen
- Centre for Molecular Informatics, Department of Chemistry, University of Cambridge, Cambridge, UK
| | - Dave Allen
- Integrated Laboratory Systems, LLC, Morrisville, North Carolina, USA
| | - Vinicius M. Alves
- Laboratory for Molecular Modeling, Division of Chemical Biology and Medicinal Chemistry, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
- Laboratory for Molecular Modeling and Design, Faculty of Pharmacy, Federal University of Goiás, Goiania, Brazil
| | - Carolina H. Andrade
- Laboratory for Molecular Modeling and Design, Faculty of Pharmacy, Federal University of Goiás, Goiania, Brazil
| | | | - Davide Ballabio
- Milano Chemometrics & QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Shannon Bell
- Integrated Laboratory Systems, LLC, Morrisville, North Carolina, USA
| | - Emilio Benfenati
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Milan, Italy
| | - Sudin Bhattacharya
- Institute for Quantitative Health Science and Engineering, Department of Biomedical Engineering, Michigan State University, East Lansing, Michigan, USA
| | - Joyce V. Bastos
- Laboratory for Molecular Modeling and Design, Faculty of Pharmacy, Federal University of Goiás, Goiania, Brazil
| | - Stephen Boyd
- Department of Plant, Soil, and Microbial Sciences, Michigan State University, East Lansing, Michigan, USA
| | - J.B. Brown
- Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Stephen J. Capuzzi
- Laboratory for Molecular Modeling, Division of Chemical Biology and Medicinal Chemistry, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
| | - Yaroslav Chushak
- Aeromedical Research Department, Force Health Protection, USAFSAM, Dayton, Ohio, USA
- Henry M Jackson Foundation for the Advancement of Military Medicine, Dayton, Ohio, USA
| | - Heather Ciallella
- Center for Computational and Integrative Biology, Rutgers University, Camden, New Jersey, USA
| | - Alex M. Clark
- Collaborations Pharmaceuticals, Inc., Raleigh, North Carolina, USA
| | - Viviana Consonni
- Milano Chemometrics & QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | | | - Sean Ekins
- Collaborations Pharmaceuticals, Inc., Raleigh, North Carolina, USA
| | - Sherif Farag
- Laboratory for Molecular Modeling, Division of Chemical Biology and Medicinal Chemistry, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
| | - Maxim Fedorov
- Skoltech, Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Denis Fourches
- Department of Chemistry, North Carolina State University, Raleigh, North Carolina, USA
- Bioinformatics Research Center, North Carolina State University, Raleigh, North Carolina, USA
| | - Domenico Gadaleta
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Milan, Italy
| | - Feng Gao
- Department of Plant, Soil, and Microbial Sciences, Michigan State University, East Lansing, Michigan, USA
| | - Jeffery M. Gearhart
- Aeromedical Research Department, Force Health Protection, USAFSAM, Dayton, Ohio, USA
- Henry M Jackson Foundation for the Advancement of Military Medicine, Dayton, Ohio, USA
| | - Garett Goh
- Pacific Northwest National Laboratory, Richland, Washington, USA
| | - Jonathan M. Goodman
- Centre for Molecular Informatics, Department of Chemistry, University of Cambridge, Cambridge, UK
| | - Francesca Grisoni
- Milano Chemometrics & QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Christopher M. Grulke
- Center for Computational Toxicology and Exposure, U.S. Environmental Protection Agency, Research Triangle Park, North Carolina, USA
| | | | - Matthew Hirn
- Department of Computational Mathematics, Science & Engineering, Department of Mathematics, Michigan State University, East Lansing, Michigan, USA
| | - Pavel Karpov
- Institute of Structural Biology, Helmholtz Zentrum München (GmbH), Neuherberg, Germany
| | | | - Giovanna J. Lavado
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Milan, Italy
| | | | - Xinhao Li
- Department of Chemistry, North Carolina State University, Raleigh, North Carolina, USA
| | | | - Filippo Lunghini
- Laboratoire de Chemoinformatique, URM7140, Université de Strasbourg, Strasbourg, France
| | - Giuseppe F. Mangiatordi
- Dipartimento di Farmacia-Scienze del Farmaco, Università degli Studi di Bari “Aldo Moro”, Bari, Italy
| | - Gilles Marcou
- Laboratoire de Chemoinformatique, URM7140, Université de Strasbourg, Strasbourg, France
| | - Dan Marsh
- Underwriters Laboratories, Northbrook, Illinois, USA
| | - Todd Martin
- Center for Computational Toxicology and Exposure, U.S. Environmental Protection Agency, Cincinnati, Ohio, USA
| | | | - Eugene N. Muratov
- Laboratory for Molecular Modeling, Division of Chemical Biology and Medicinal Chemistry, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
- Laboratory for Molecular Modeling and Design, Faculty of Pharmacy, Federal University of Goiás, Goiania, Brazil
| | | | - Dac-Trung Nguyen
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Orazio Nicolotti
- Dipartimento di Farmacia-Scienze del Farmaco, Università degli Studi di Bari “Aldo Moro”, Bari, Italy
| | - Reine Note
- L’Oréal Research & Innovation, Aulnay-sous-Bois, France
| | - Paritosh Pande
- Pacific Northwest National Laboratory, Richland, Washington, USA
| | | | - Tyler Peryea
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | | | - Robert Rallo
- Pacific Northwest National Laboratory, Richland, Washington, USA
| | - Alessandra Roncaglioni
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Milan, Italy
| | | | - Patricia Ruiz
- Office of Innovation and Analytics, Agency for Toxic Substances and Disease Registry, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| | - Daniel P. Russo
- Center for Computational and Integrative Biology, Rutgers University, Camden, New Jersey, USA
| | - Ahmed Sayed
- Rosettastein Consulting UG, Freising, Germany
| | - Risa Sayre
- Center for Computational Toxicology and Exposure, U.S. Environmental Protection Agency, Research Triangle Park, North Carolina, USA
- Oak Ridge Institute for Science and Education (ORISE) Research Participation Program, U.S. Environmental Protection Agency, Research Triangle Park, North Carolina, USA
| | - Timothy Sheils
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Charles Siegel
- Pacific Northwest National Laboratory, Richland, Washington, USA
| | - Arthur C. Silva
- Laboratory for Molecular Modeling and Design, Faculty of Pharmacy, Federal University of Goiás, Goiania, Brazil
| | - Anton Simeonov
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Sergey Sosnin
- Skoltech, Skolkovo Institute of Science and Technology, Moscow, Russia
| | - Noel Southall
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Judy Strickland
- Integrated Laboratory Systems, LLC, Morrisville, North Carolina, USA
| | - Yun Tang
- Shanghai Key Laboratory of New Drug Design, School of Pharmacy, East China University of Science and Technology, Shanghai, China
| | - Brian Teppen
- Department of Plant, Soil, and Microbial Sciences, Michigan State University, East Lansing, Michigan, USA
| | - Igor V. Tetko
- Institute of Structural Biology, Helmholtz Zentrum München (GmbH), Neuherberg, Germany
- BIGCHEM GmbH, Unterschleissheim, Germany
| | - Dennis Thomas
- Pacific Northwest National Laboratory, Richland, Washington, USA
| | | | - Roberto Todeschini
- Milano Chemometrics & QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Cosimo Toma
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Milan, Italy
| | - Ignacio Tripodi
- Computer Science/Interdisciplinary Quantitative Biology, University of Colorado, Boulder, Colorado, USA
| | - Daniela Trisciuzzi
- Dipartimento di Farmacia-Scienze del Farmaco, Università degli Studi di Bari “Aldo Moro”, Bari, Italy
| | - Alexander Tropsha
- Laboratory for Molecular Modeling, Division of Chemical Biology and Medicinal Chemistry, UNC Eshelman School of Pharmacy, University of North Carolina, Chapel Hill, North Carolina, USA
| | - Alexandre Varnek
- Laboratoire de Chemoinformatique, URM7140, Université de Strasbourg, Strasbourg, France
| | - Kristijan Vukovic
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Milan, Italy
| | - Zhongyu Wang
- School of Environmental Sciences and Technology, Dalian University of Technology; Dalian, Liaoning, China
| | - Liguo Wang
- School of Environmental Sciences and Technology, Dalian University of Technology; Dalian, Liaoning, China
| | | | - Andrew J. Wedlake
- Centre for Molecular Informatics, Department of Chemistry, University of Cambridge, Cambridge, UK
| | | | - Dan Wilson
- The Dow Chemical Company, Midland, Michigan, USA
| | - Zijun Xiao
- School of Environmental Sciences and Technology, Dalian University of Technology; Dalian, Liaoning, China
| | - Hongbin Yang
- Shanghai Key Laboratory of New Drug Design, School of Pharmacy, East China University of Science and Technology, Shanghai, China
| | - Gergely Zahoranszky-Kohalmi
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Alexey V. Zakharov
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | | | - Zhen Zhang
- Dow Agrosciences, Indianapolis, Indiana, USA
| | - Tongan Zhao
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Hao Zhu
- Center for Computational and Integrative Biology, Rutgers University, Camden, New Jersey, USA
| | | | - Warren Casey
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, Research Triangle Park, North Carolina, USA
| | - Nicole C. Kleinstreuer
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, Research Triangle Park, North Carolina, USA
| |
Collapse
|
23
|
Kleinstreuer NC, Tetko IV, Tong W. Introduction to Special Issue: Computational Toxicology. Chem Res Toxicol 2021; 34:171-175. [PMID: 33583184 DOI: 10.1021/acs.chemrestox.1c00032] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
24
|
Jain S, Siramshetty VB, Alves VM, Muratov EN, Kleinstreuer N, Tropsha A, Nicklaus MC, Simeonov A, Zakharov AV. Large-Scale Modeling of Multispecies Acute Toxicity End Points Using Consensus of Multitask Deep Learning Methods. J Chem Inf Model 2021; 61:653-663. [PMID: 33533614 DOI: 10.1021/acs.jcim.0c01164] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
Computational methods to predict molecular properties regarding safety and toxicology represent alternative approaches to expedite drug development, screen environmental chemicals, and thus significantly reduce associated time and costs. There is a strong need and interest in the development of computational methods that yield reliable predictions of toxicity, and many approaches, including the recently introduced deep neural networks, have been leveraged towards this goal. Herein, we report on the collection, curation, and integration of data from the public data sets that were the source of the ChemIDplus database for systemic acute toxicity. These efforts generated the largest publicly available such data set comprising > 80,000 compounds measured against a total of 59 acute systemic toxicity end points. This data was used for developing multiple single- and multitask models utilizing random forest, deep neural networks, convolutional, and graph convolutional neural network approaches. For the first time, we also reported the consensus models based on different multitask approaches. To the best of our knowledge, prediction models for 36 of the 59 end points have never been published before. Furthermore, our results demonstrated a significantly better performance of the consensus model obtained from three multitask learning approaches that particularly predicted the 29 smaller tasks (less than 300 compounds) better than other models developed in the study. The curated data set and the developed models have been made publicly available at https://github.com/ncats/ld50-multitask, https://predictor.ncats.io/, and https://cactus.nci.nih.gov/download/acute-toxicity-db (data set only) to support regulatory and research applications.
Collapse
Affiliation(s)
- Sankalp Jain
- National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, 9800 Medical Center Drive, Rockville, Maryland 20850, United States
| | - Vishal B Siramshetty
- National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, 9800 Medical Center Drive, Rockville, Maryland 20850, United States
| | - Vinicius M Alves
- UNC Eshelman School of Pharmacy, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina 27599, United States
| | - Eugene N Muratov
- UNC Eshelman School of Pharmacy, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina 27599, United States
| | - Nicole Kleinstreuer
- Division of Intramural Research, Biostatistics and Computational Biology Branch, National Institute of Environmental Health Sciences, 111 T.W. Alexander Drive, Durham, North Carolina 27709, United States.,National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, National Institute of Environmental Health Sciences, 111 T.W. Alexander Drive, Durham, North Carolina 27709, United States
| | - Alexander Tropsha
- UNC Eshelman School of Pharmacy, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina 27599, United States
| | - Marc C Nicklaus
- Computer-Aided Drug Design (CADD) Group, Chemical Biology Laboratory, Center for Cancer Research, National Cancer Institute, National Institutes of Health, DHHS, NCI-Frederick, 376 Boyles Street, Frederick, Maryland 21702, United States
| | - Anton Simeonov
- National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, 9800 Medical Center Drive, Rockville, Maryland 20850, United States
| | - Alexey V Zakharov
- National Center for Advancing Translational Sciences (NCATS), National Institutes of Health, 9800 Medical Center Drive, Rockville, Maryland 20850, United States
| |
Collapse
|
25
|
Sedykh AY, Shah RR, Kleinstreuer NC, Auerbach SS, Gombar VK. Saagar-A New, Extensible Set of Molecular Substructures for QSAR/QSPR and Read-Across Predictions. Chem Res Toxicol 2020; 34:634-640. [PMID: 33356152 DOI: 10.1021/acs.chemrestox.0c00464] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Molecular structure-based predictive models provide a proven alternative to costly and inefficient animal testing. However, due to a lack of interpretability of predictive models built with abstract molecular descriptors they have earned the notoriety of being black boxes. Interpretable models require interpretable descriptors to provide chemistry-backed predictive reasoning and facilitate intelligent molecular design. We developed a novel set of extensible chemistry-aware substructures, Saagar, to support interpretable predictive models and read-across protocols. Performance of Saagar in chemical characterization and search for structurally similar actives for read-across applications was compared with four publicly available fingerprint sets (MACCS (166), PubChem (881), ECFP4 (1024), ToxPrint (729)) in three benchmark sets (MUV, ULS, and Tox21) spanning ∼145 000 compounds and 78 molecular targets at 1%, 2%, 5%, and 10% false discovery rates. In 18 of the 20 comparisons, interpretable Saagar features performed better than the publicly available, but less interpretable and fixed-bit length, fingerprints. Examples are provided to show the enhanced capability of Saagar in extracting compounds with higher scaffold similarity. Saagar features are interpretable and efficiently characterize diverse chemical collections, thus making them a better choice for building interpretable predictive in silico models and read-across protocols.
Collapse
Affiliation(s)
| | - Ruchir R Shah
- Sciome LLC, Research Triangle Park, North Carolina 27709, United States
| | - Nicole C Kleinstreuer
- National Institute of Environmental Health Sciences (NIEHS), National Toxicology Program (NTP), Research Triangle Park, North Carolina 27709, United States
| | - Scott S Auerbach
- National Institute of Environmental Health Sciences (NIEHS), National Toxicology Program (NTP), Research Triangle Park, North Carolina 27709, United States
| | - Vijay K Gombar
- Sciome LLC, Research Triangle Park, North Carolina 27709, United States
| |
Collapse
|
26
|
Bercu J, Masuda-Herrera MJ, Trejo-Martin A, Hasselgren C, Lord J, Graham J, Schmitz M, Milchak L, Owens C, Lal SH, Robinson RM, Whalley S, Bellion P, Vuorinen A, Gromek K, Hawkins WA, van de Gevel I, Vriens K, Kemper R, Naven R, Ferrer P, Myatt GJ. A cross-industry collaboration to assess if acute oral toxicity (Q)SAR models are fit-for-purpose for GHS classification and labelling. Regul Toxicol Pharmacol 2020; 120:104843. [PMID: 33340644 DOI: 10.1016/j.yrtph.2020.104843] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2020] [Revised: 11/19/2020] [Accepted: 12/14/2020] [Indexed: 11/25/2022]
Abstract
This study assesses whether currently available acute oral toxicity (AOT) in silico models, provided by the widely employed Leadscope software, are fit-for-purpose for categorization and labelling of chemicals. As part of this study, a large data set of proprietary and marketed compounds from multiple companies (pharmaceutical, plant protection products, and other chemical industries) was assembled to assess the models' performance. The absolute percentage of correct or more conservative predictions, based on a comparison of experimental and predicted GHS categories, was approximately 95%, after excluding a small percentage of inconclusive (indeterminate or out of domain) predictions. Since the frequency distribution across the experimental categories is skewed towards low toxicity chemicals, a balanced assessment was also performed. Across all compounds which could be assigned to a well-defined experimental category, the average percentage of correct or more conservative predictions was around 80%. These results indicate the potential for reliable and broad application of these models across different industrial sectors. This manuscript describes the evaluation of these models, highlights the importance of an expert review, and provides guidance on the use of AOT models to fulfill testing requirements, GHS classification/labelling, and transportation needs.
Collapse
Affiliation(s)
- Joel Bercu
- Gilead Sciences, 333 Lakeside Drive, Foster City, CA, USA
| | | | | | | | - Jean Lord
- Ultragenyx, 60 Leveroni Court, Novato, CA, 94949, USA
| | - Jessica Graham
- Bristol Myers Squibb, 1 Squibb Dr, New Brunswick, NJ, 08903, USA
| | | | | | - Colin Owens
- 3M Company, 3M Center, St. Paul, MN, 55144-1000, USA
| | - Surya Hari Lal
- Syngenta Crop Protection, Product Safety Department, Jealott's Hill International Research Centre, Bracknell, Berkshire, RG42 6EY, UK(1)
| | - Richard Marchese Robinson
- Syngenta Crop Protection, Product Safety Department, Jealott's Hill International Research Centre, Bracknell, Berkshire, RG42 6EY, UK(1)
| | - Sarah Whalley
- Syngenta Crop Protection, Product Safety Department, Jealott's Hill International Research Centre, Bracknell, Berkshire, RG42 6EY, UK(1)
| | | | | | - Kamila Gromek
- Galapagos SASU, 102 Avenue Gaston Roussel, 93230, Romainville, France
| | - William A Hawkins
- GlaxoSmithKline, Park Road, Ware, Hertfordshire, SG12 0DP, United Kingdom
| | - Iris van de Gevel
- Janssen Pharmaceutical Companies of Johnson & Johnson, 2340, Beerse, Belgium
| | - Kathleen Vriens
- Janssen Pharmaceutical Companies of Johnson & Johnson, 2340, Beerse, Belgium
| | - Raymond Kemper
- Vertex Pharmaceuticals Inc., Discovery and Investigative Toxicology, 50 Northern Ave, Boston, MA, USA
| | - Russell Naven
- Vertex Pharmaceuticals Inc., Discovery and Investigative Toxicology, 50 Northern Ave, Boston, MA, USA
| | - Pierre Ferrer
- Department of Veterinary Physiology and Pharmacology, Interdisciplinary Faculty of Toxicology Program, Texas A&M University, 4466 TAMU, College Station, TX, 77843-4466, USA
| | - Glenn J Myatt
- Leadscope (an Instem company), 1393 Dublin Rd, Columbus, OH, 43215, USA.
| |
Collapse
|
27
|
Chushak Y, Gearhart JM, Ott D. In Silico Assessment of Acute Oral Toxicity for Mixtures. Chem Res Toxicol 2020; 34:345-354. [PMID: 33206501 DOI: 10.1021/acs.chemrestox.0c00256] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
While exposure of humans to environmental hazards often occurs with complex chemical mixtures, the majority of existing toxicity data are for single compounds. The Globally Harmonized System of chemical classification (GHS) developed by the Organization for Economic Cooperation and Development uses the additivity formula for acute oral toxicity classification of mixtures, which is based on the acute toxicity estimate of individual ingredients. We evaluated the prediction of GHS category classifications for mixtures using toxicological data collected in the Integrated Chemical Environment (ICE) developed by the National Toxicology Program (United States Department of Health and Human Services). The ICE database contains in vivo acute oral toxicity data for ∼10,000 chemicals and for 582 mixtures with one or multiple active ingredients. By using the available experimental data for individual ingredients, we were able to calculate a GHS category for only half of the mixtures. To expand a set of components with acute oral toxicity data, we used the Collaborative Acute Toxicity Modeling Suite (CATMoS) implemented in the Open Structure-Activity/Property Relationship App to make predictions for active ingredients without available experimental data. As a result, we were able to make predictions for 503 mixtures/formulations with 72% accuracy for the GHS classification. For 186 mixtures with two or more active ingredients, the accuracy rate was 76%. The structure-based analysis of the misclassified mixtures did not reveal any specific structural features associated with the mispredictions. Our results demonstrate that CATMoS together with an additivity formula can be used to predict the GHS category for chemical mixtures.
Collapse
Affiliation(s)
- Yaroslav Chushak
- Henry M. Jackson Foundation for the Advancement of Military Medicine, Wright-Patterson Air Force Base, Dayton, Ohio 45433, United States
| | - Jeffery M Gearhart
- Henry M. Jackson Foundation for the Advancement of Military Medicine, Wright-Patterson Air Force Base, Dayton, Ohio 45433, United States
| | - Darrin Ott
- Warfighter Medical Optimization Division, 711 Human Performance Wing, Air Force Research Laboratory, Wright-Patterson Air Force Base, Dayton, Ohio 45433, United States
| |
Collapse
|
28
|
The performance, reliability and potential application of in silico models for predicting the acute oral toxicity of pharmaceutical compounds. Regul Toxicol Pharmacol 2020; 119:104816. [PMID: 33166621 DOI: 10.1016/j.yrtph.2020.104816] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2020] [Revised: 10/13/2020] [Accepted: 10/30/2020] [Indexed: 11/24/2022]
Abstract
Acute oral toxicity (AOT) information is utilized to categorize compounds according to the severity of their hazard and used to inform risk assessments for human health and the environment. Given the wealth of historical AOT information and technological advances, in silico models are being created and evaluated as potential tools to predict the AOT of compounds and reduce reliance on animal testing. Utilizing a historical database of AOT data on 371 Bristol Myers Squibb pharmaceutical compounds (PCs) (195 pharmaceutical intermediates and 176 active pharmaceutical ingredients), we evaluated two pioneering in silico AOT programs: the Leadscope Acute Oral Toxicity Model Suite and the Collaborative Acute Toxicity Modeling Suite. These models demonstrated a high degree of agreement with the in vivo results as well as a high level of sensitivity. We found that these models can be effectively utilized to identify PCs which are of low acute oral toxicity (LD50 > 2000 mg/kg), PCs which should not be classified as Dangerous Goods (LD50 > 300 mg/kg), and can assist in identifying a starting dose for in vivo AOT studies. This manuscript provides an evaluation of the performance of these in silico models and proposes use cases where these in silico models can be most confidently and effectively employed.
Collapse
|
29
|
Nelms MD, Karmaus AL, Patlewicz G. An evaluation of the performance of selected (Q)SARs/expert systems for predicting acute oral toxicity. COMPUTATIONAL TOXICOLOGY (AMSTERDAM, NETHERLANDS) 2020; 16:100135. [PMID: 33163737 PMCID: PMC7641510 DOI: 10.1016/j.comtox.2020.100135] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Abstract
Multiple US agencies use acute oral toxicity data in a variety of regulatory contexts. One of the ad-hoc groups that the US Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM) established to implement the ICCVAM Strategic Roadmap was the Acute Toxicity Workgroup (ATWG) to support the development, acceptance, and actualisation of new approach methodologies (NAMs). One of the ATWG charges was to evaluate in vitro and in silico methods for predicting rat acute systemic toxicity. Collaboratively, the NTP Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM) and the US Environmental Protection Agency (US EPA) collected a large body of rat oral acute toxicity data (~16,713 studies for 11,992 substances) to serve as a reference set to evaluate the performance and coverage of new and existing models as well as build understanding of the inherent variability of the animal data. Here, we focus on evaluating in silico models for predicting the Lethal Dose (LD50) as implemented within two expert systems, TIMES and TEST. The performance and coverage were evaluated against the reference dataset. The performance of both models were similar, but TEST was able to make predictions for more chemicals than TIMES. The subset of the data with multiple (>3) LD50 values was used to evaluate the variability in data and served as a benchmark to compare model performance. Enrichment analysis was conducted using ToxPrint chemical fingerprints to identify the types of chemicals where predictions lay outside the upper 95% confidence interval. Overall, TEST and TIMES models performed similarly but had different chemical features associated with low accuracy predictions, reaffirming that these models are complementary and both worth evaluation when seeking to predict rat LD50 values.
Collapse
Affiliation(s)
- Mark D. Nelms
- Oak Ridge Institute for Science and Education, Oak Ridge, TN, 37830, USA
- Center for Computational Toxicology & Exposure (CCTE), U.S. Environmental Protection Agency, Research Triangle Park, Durham, NC, 27709, USA
| | | | - Grace Patlewicz
- Center for Computational Toxicology & Exposure (CCTE), U.S. Environmental Protection Agency, Research Triangle Park, Durham, NC, 27709, USA
| |
Collapse
|
30
|
Bell S, Abedini J, Ceger P, Chang X, Cook B, Karmaus AL, Lea I, Mansouri K, Phillips J, McAfee E, Rai R, Rooney J, Sprankle C, Tandon A, Allen D, Casey W, Kleinstreuer N. An integrated chemical environment with tools for chemical safety testing. Toxicol In Vitro 2020; 67:104916. [PMID: 32553663 PMCID: PMC7393692 DOI: 10.1016/j.tiv.2020.104916] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2020] [Revised: 05/29/2020] [Accepted: 06/10/2020] [Indexed: 12/27/2022]
Abstract
Moving toward species-relevant chemical safety assessments and away from animal testing requires access to reliable data to develop and build confidence in new approaches. The Integrated Chemical Environment (ICE) provides tools and curated data centered around chemical safety assessment. This article describes updates to ICE, including improved accessibility and interpretability of in vitro data via mechanistic target mapping and enhanced interactive tools for in vitro to in vivo extrapolation (IVIVE). Mapping of in vitro assay targets to toxicity endpoints of regulatory importance uses literature-based mode-of-action information and controlled terminology from existing knowledge organization systems to support data interoperability with external resources. The most recent ICE update includes Tox21 high-throughput screening data curated using analytical chemistry data and assay-specific parameters to eliminate potential artifacts or unreliable activity. Also included are physicochemical/ADME parameters for over 800,000 chemicals predicted by quantitative structure-activity relationship models. These parameters are used by the new ICE IVIVE tool in combination with the U.S. Environmental Protection Agency's httk R package to estimate in vivo exposures corresponding to in vitro bioactivity concentrations from stored or user-defined assay data. These new ICE features allow users to explore the applications of an expanded data space and facilitate building confidence in non-animal approaches.
Collapse
Affiliation(s)
- Shannon Bell
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - Jaleh Abedini
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - Patricia Ceger
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - Xiaoqing Chang
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - Bethany Cook
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - Agnes L Karmaus
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - Isabel Lea
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - Kamel Mansouri
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA
| | - Jason Phillips
- Sciome LLC, 2 Davis Dr., Research Triangle Park, NC 27709, USA.
| | - Eric McAfee
- Sciome LLC, 2 Davis Dr., Research Triangle Park, NC 27709, USA.
| | - Ruhi Rai
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - John Rooney
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - Catherine Sprankle
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - Arpit Tandon
- Sciome LLC, 2 Davis Dr., Research Triangle Park, NC 27709, USA.
| | - David Allen
- Integrated Laboratory Systems, Inc., P.O. Box 13501, Research Triangle Park, NC 27709, USA.
| | - Warren Casey
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, National Institute of Environmental Health Sciences, P.O. Box 12233, Research Triangle Park, NC 27709, USA.
| | - Nicole Kleinstreuer
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, National Institute of Environmental Health Sciences, P.O. Box 12233, Research Triangle Park, NC 27709, USA.
| |
Collapse
|
31
|
Active learning efficiently converges on rational limits of toxicity prediction and identifies patterns for molecule design. ACTA ACUST UNITED AC 2020. [DOI: 10.1016/j.comtox.2020.100129] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
|
32
|
Manuppello J, Sullivan K, Baker E. Acute toxicity “six-pack” studies supporting approved new drug applications in the U.S., 2015–2018. Regul Toxicol Pharmacol 2020; 114:104666. [DOI: 10.1016/j.yrtph.2020.104666] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2020] [Revised: 04/13/2020] [Accepted: 04/17/2020] [Indexed: 10/24/2022]
|
33
|
Patlewicz G. Navigating the Minefield of Computational Toxicology and Informatics: Looking Back and Charting a New Horizon. FRONTIERS IN TOXICOLOGY 2020; 2:2. [PMID: 35296116 PMCID: PMC8915910 DOI: 10.3389/ftox.2020.00002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2020] [Accepted: 05/20/2020] [Indexed: 01/07/2023] Open
|
34
|
Comess S, Akbay A, Vasiliou M, Hines RN, Joppa L, Vasiliou V, Kleinstreuer N. Bringing Big Data to Bear in Environmental Public Health: Challenges and Recommendations. Front Artif Intell 2020; 3. [PMID: 33184612 PMCID: PMC7654840 DOI: 10.3389/frai.2020.00031] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023] Open
Abstract
Understanding the role that the environment plays in influencing public health often involves collecting and studying large, complex data sets. There have been a number of private and public efforts to gather sufficient information and confront significant unknowns in the field of environmental public health, yet there is a persistent and largely unmet need for findable, accessible, interoperable, and reusable (FAIR) data. Even when data are readily available, the ability to create, analyze, and draw conclusions from these data using emerging computational tools, such as augmented and artificial inteligence (AI) and machine learning, requires technical skills not currently implemented on a programmatic level across research hubs and academic institutions. We argue that collaborative efforts in data curation and storage, scientific computing, and training are of paramount importance to empower researchers within environmental sciences and the broader public health community to apply AI approaches and fully realize their potential. Leaders in the field were asked to prioritize challenges in incorporating big data in environmental public health research: inconsistent implementation of FAIR principles in data collection and sharing, a lack of skilled data scientists and appropriate cyber-infrastructures, and limited understanding of possibilities and communication of benefits were among those identified. These issues are discussed, and actionable recommendations are provided.
Collapse
Affiliation(s)
- Saskia Comess
- Department of Environmental Health Sciences, Yale School of Public Health, New Haven, CT, United States.,Department of Statistics and Data Science, Yale University, New Haven, CT, United States
| | - Alexia Akbay
- Department of Environmental Health Sciences, Yale School of Public Health, New Haven, CT, United States.,Symbrosia Inc, Kailua-Kona, HI, United States
| | - Melpomene Vasiliou
- Department of Environmental Health Sciences, Yale School of Public Health, New Haven, CT, United States
| | - Ronald N Hines
- US Environmental Protection Agency, Center for Public Health and Environmental Assessment, Research Triangle Park, NC, United States
| | - Lucas Joppa
- Microsoft Corporation, AI for Earth, Redmond, WA, United States
| | - Vasilis Vasiliou
- Department of Environmental Health Sciences, Yale School of Public Health, New Haven, CT, United States
| | - Nicole Kleinstreuer
- Department of Environmental Health Sciences, Yale School of Public Health, New Haven, CT, United States.,National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, National Institute of Environmental Health Sciences, Research Triangle Park, NC, United States
| |
Collapse
|
35
|
Parish ST, Aschner M, Casey W, Corvaro M, Embry MR, Fitzpatrick S, Kidd D, Kleinstreuer NC, Lima BS, Settivari RS, Wolf DC, Yamazaki D, Boobis A. An evaluation framework for new approach methodologies (NAMs) for human health safety assessment. Regul Toxicol Pharmacol 2020; 112:104592. [DOI: 10.1016/j.yrtph.2020.104592] [Citation(s) in RCA: 48] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2019] [Revised: 01/15/2020] [Accepted: 01/27/2020] [Indexed: 10/25/2022]
|
36
|
Mansouri K, Kleinstreuer N, Abdelaziz AM, Alberga D, Alves VM, Andersson PL, Andrade CH, Bai F, Balabin I, Ballabio D, Benfenati E, Bhhatarai B, Boyer S, Chen J, Consonni V, Farag S, Fourches D, García-Sosa AT, Gramatica P, Grisoni F, Grulke CM, Hong H, Horvath D, Hu X, Huang R, Jeliazkova N, Li J, Li X, Liu H, Manganelli S, Mangiatordi GF, Maran U, Marcou G, Martin T, Muratov E, Nguyen DT, Nicolotti O, Nikolov NG, Norinder U, Papa E, Petitjean M, Piir G, Pogodin P, Poroikov V, Qiao X, Richard AM, Roncaglioni A, Ruiz P, Rupakheti C, Sakkiah S, Sangion A, Schramm KW, Selvaraj C, Shah I, Sild S, Sun L, Taboureau O, Tang Y, Tetko IV, Todeschini R, Tong W, Trisciuzzi D, Tropsha A, Van Den Driessche G, Varnek A, Wang Z, Wedebye EB, Williams AJ, Xie H, Zakharov AV, Zheng Z, Judson RS. CoMPARA: Collaborative Modeling Project for Androgen Receptor Activity. ENVIRONMENTAL HEALTH PERSPECTIVES 2020; 128:27002. [PMID: 32074470 DOI: 10.23645/epacomptox.5176876] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
BACKGROUND Endocrine disrupting chemicals (EDCs) are xenobiotics that mimic the interaction of natural hormones and alter synthesis, transport, or metabolic pathways. The prospect of EDCs causing adverse health effects in humans and wildlife has led to the development of scientific and regulatory approaches for evaluating bioactivity. This need is being addressed using high-throughput screening (HTS) in vitro approaches and computational modeling. OBJECTIVES In support of the Endocrine Disruptor Screening Program, the U.S. Environmental Protection Agency (EPA) led two worldwide consortiums to virtually screen chemicals for their potential estrogenic and androgenic activities. Here, we describe the Collaborative Modeling Project for Androgen Receptor Activity (CoMPARA) efforts, which follows the steps of the Collaborative Estrogen Receptor Activity Prediction Project (CERAPP). METHODS The CoMPARA list of screened chemicals built on CERAPP's list of 32,464 chemicals to include additional chemicals of interest, as well as simulated ToxCast™ metabolites, totaling 55,450 chemical structures. Computational toxicology scientists from 25 international groups contributed 91 predictive models for binding, agonist, and antagonist activity predictions. Models were underpinned by a common training set of 1,746 chemicals compiled from a combined data set of 11 ToxCast™/Tox21 HTS in vitro assays. RESULTS The resulting models were evaluated using curated literature data extracted from different sources. To overcome the limitations of single-model approaches, CoMPARA predictions were combined into consensus models that provided averaged predictive accuracy of approximately 80% for the evaluation set. DISCUSSION The strengths and limitations of the consensus predictions were discussed with example chemicals; then, the models were implemented into the free and open-source OPERA application to enable screening of new chemicals with a defined applicability domain and accuracy assessment. This implementation was used to screen the entire EPA DSSTox database of ∼875,000 chemicals, and their predicted AR activities have been made available on the EPA CompTox Chemicals dashboard and National Toxicology Program's Integrated Chemical Environment. https://doi.org/10.1289/EHP5580.
Collapse
Affiliation(s)
- Kamel Mansouri
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
- ScitoVation LLC, Research Triangle Park, North Carolina, USA
- Integrated Laboratory Systems, Inc., Morrisville, North Carolina, USA
| | - Nicole Kleinstreuer
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM), National Institute of Environmental Health Sciences, Research Triangle Park, North Carolina, USA
| | - Ahmed M Abdelaziz
- Technische Universität München, Wissenschaftszentrum Weihenstephan für Ernährung, Landnutzung und Umwelt, Department für Biowissenschaftliche Grundlagen, Weihenstephaner Steig 23, 85350 Freising, Germany
| | - Domenico Alberga
- Department of Pharmacy-Drug Sciences, University of Bari, Bari, Italy
| | - Vinicius M Alves
- Laboratory for Molecular Modeling and Drug Design, Faculty of Pharmacy, Federal University of Goiás, Goiânia, Brazil
- Laboratory for Molecular Modeling, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | | | - Carolina H Andrade
- Laboratory for Molecular Modeling and Drug Design, Faculty of Pharmacy, Federal University of Goiás, Goiânia, Brazil
| | - Fang Bai
- School of Pharmacy, Lanzhou University, China
| | - Ilya Balabin
- Information Systems & Global Solutions (IS&GS), Lockheed Martin, USA
| | - Davide Ballabio
- Milano Chemometrics and QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Emilio Benfenati
- Istituto di Ricerche Farmacologiche "Mario Negri", IRCCS, Milan, Italy
| | - Barun Bhhatarai
- QSAR Research Unit in Environmental Chemistry and Ecotoxicology, Department of Theoretical and Applied Sciences, University of Insubria, Varese, Italy
| | - Scott Boyer
- Swedish Toxicology Sciences Research Center, Karolinska Institutet, Södertälje, Sweden
| | - Jingwen Chen
- School of Environmental Science and Technology, Dalian University of Technology, Dalian, China
| | - Viviana Consonni
- Milano Chemometrics and QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Sherif Farag
- Laboratory for Molecular Modeling, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Denis Fourches
- Department of Chemistry, Bioinformatics Research Center, North Carolina State University, Raleigh, North Carolina, USA
| | | | - Paola Gramatica
- QSAR Research Unit in Environmental Chemistry and Ecotoxicology, Department of Theoretical and Applied Sciences, University of Insubria, Varese, Italy
| | - Francesca Grisoni
- Milano Chemometrics and QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Chris M Grulke
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
| | - Huixiao Hong
- Division of Bioinformatics and Biostatistics, National Center for Toxicology Research, U.S. Food and Drug Administration, Jefferson, Arkansas, USA
| | - Dragos Horvath
- Laboratoire de Chémoinformatique-UMR7140, University of Strasbourg/CNRS, Strasbourg, France
| | - Xin Hu
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Ruili Huang
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | | | - Jiazhong Li
- School of Pharmacy, Lanzhou University, China
| | - Xuehua Li
- School of Environmental Science and Technology, Dalian University of Technology, Dalian, China
| | | | - Serena Manganelli
- Istituto di Ricerche Farmacologiche "Mario Negri", IRCCS, Milan, Italy
| | | | - Uko Maran
- Institute of Chemistry, University of Tartu, Tartu, Estonia
| | - Gilles Marcou
- Laboratoire de Chémoinformatique-UMR7140, University of Strasbourg/CNRS, Strasbourg, France
| | - Todd Martin
- National Risk Management Research Laboratory, U.S. EPA, Cincinnati, Ohio, USA
| | - Eugene Muratov
- Laboratory for Molecular Modeling, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Dac-Trung Nguyen
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Orazio Nicolotti
- Department of Pharmacy-Drug Sciences, University of Bari, Bari, Italy
| | - Nikolai G Nikolov
- Division of Risk Assessment and Nutrition, National Food Institute, Technical University of Denmark, Copenhagen, Denmark
| | - Ulf Norinder
- Swedish Toxicology Sciences Research Center, Karolinska Institutet, Södertälje, Sweden
| | - Ester Papa
- QSAR Research Unit in Environmental Chemistry and Ecotoxicology, Department of Theoretical and Applied Sciences, University of Insubria, Varese, Italy
| | - Michel Petitjean
- Computational Modeling of Protein-Ligand Interactions (CMPLI)-INSERM UMR 8251, INSERM ERL U1133, Functional and Adaptative Biology (BFA), Universite de Paris, Paris, France
| | - Geven Piir
- Institute of Chemistry, University of Tartu, Tartu, Estonia
| | - Pavel Pogodin
- Institute of Biomedical Chemistry IBMC, 10 Building 8, Pogodinskaya st., Moscow 119121, Russia
| | - Vladimir Poroikov
- Institute of Biomedical Chemistry IBMC, 10 Building 8, Pogodinskaya st., Moscow 119121, Russia
| | - Xianliang Qiao
- School of Environmental Science and Technology, Dalian University of Technology, Dalian, China
| | - Ann M Richard
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
| | | | - Patricia Ruiz
- Computational Toxicology and Methods Development Laboratory, Division of Toxicology and Human Health Sciences, Agency for Toxic Substances and Disease Registry, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| | - Chetan Rupakheti
- National Risk Management Research Laboratory, U.S. EPA, Cincinnati, Ohio, USA
- Department of Biochemistry and Molecular Biophysics, University of Chicago, Chicago, Illinois, USA
| | - Sugunadevi Sakkiah
- Division of Bioinformatics and Biostatistics, National Center for Toxicology Research, U.S. Food and Drug Administration, Jefferson, Arkansas, USA
| | - Alessandro Sangion
- QSAR Research Unit in Environmental Chemistry and Ecotoxicology, Department of Theoretical and Applied Sciences, University of Insubria, Varese, Italy
| | - Karl-Werner Schramm
- Technische Universität München, Wissenschaftszentrum Weihenstephan für Ernährung, Landnutzung und Umwelt, Department für Biowissenschaftliche Grundlagen, Weihenstephaner Steig 23, 85350 Freising, Germany
| | - Chandrabose Selvaraj
- Division of Bioinformatics and Biostatistics, National Center for Toxicology Research, U.S. Food and Drug Administration, Jefferson, Arkansas, USA
| | - Imran Shah
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
| | - Sulev Sild
- Institute of Chemistry, University of Tartu, Tartu, Estonia
| | - Lixia Sun
- Department of Pharmaceutical Sciences, School of Pharmacy, East China University of Science and Technology, Shanghai, China
| | - Olivier Taboureau
- Computational Modeling of Protein-Ligand Interactions (CMPLI)-INSERM UMR 8251, INSERM ERL U1133, Functional and Adaptative Biology (BFA), Universite de Paris, Paris, France
| | - Yun Tang
- Department of Pharmaceutical Sciences, School of Pharmacy, East China University of Science and Technology, Shanghai, China
| | - Igor V Tetko
- BIGCHEM GmbH, Neuherberg, Germany
- Helmholtz Zentrum Muenchen - German Research Center for Environmental Health (GmbH), Neuherberg, Germany
| | - Roberto Todeschini
- Milano Chemometrics and QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Weida Tong
- Division of Bioinformatics and Biostatistics, National Center for Toxicology Research, U.S. Food and Drug Administration, Jefferson, Arkansas, USA
| | | | - Alexander Tropsha
- Laboratory for Molecular Modeling, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - George Van Den Driessche
- Department of Chemistry, Bioinformatics Research Center, North Carolina State University, Raleigh, North Carolina, USA
| | - Alexandre Varnek
- Laboratoire de Chémoinformatique-UMR7140, University of Strasbourg/CNRS, Strasbourg, France
| | - Zhongyu Wang
- School of Environmental Science and Technology, Dalian University of Technology, Dalian, China
| | - Eva B Wedebye
- Division of Risk Assessment and Nutrition, National Food Institute, Technical University of Denmark, Copenhagen, Denmark
| | - Antony J Williams
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
| | - Hongbin Xie
- School of Environmental Science and Technology, Dalian University of Technology, Dalian, China
| | - Alexey V Zakharov
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Ziye Zheng
- Chemistry Department, Umeå University, Umeå, Sweden
| | - Richard S Judson
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
| |
Collapse
|
37
|
Regulatory drivers in the last 20 years towards the use of in silico techniques as replacements to animal testing for cosmetic-related substances. ACTA ACUST UNITED AC 2020. [DOI: 10.1016/j.comtox.2019.100112] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
38
|
Mansouri K, Kleinstreuer N, Abdelaziz AM, Alberga D, Alves VM, Andersson PL, Andrade CH, Bai F, Balabin I, Ballabio D, Benfenati E, Bhhatarai B, Boyer S, Chen J, Consonni V, Farag S, Fourches D, García-Sosa AT, Gramatica P, Grisoni F, Grulke CM, Hong H, Horvath D, Hu X, Huang R, Jeliazkova N, Li J, Li X, Liu H, Manganelli S, Mangiatordi GF, Maran U, Marcou G, Martin T, Muratov E, Nguyen DT, Nicolotti O, Nikolov NG, Norinder U, Papa E, Petitjean M, Piir G, Pogodin P, Poroikov V, Qiao X, Richard AM, Roncaglioni A, Ruiz P, Rupakheti C, Sakkiah S, Sangion A, Schramm KW, Selvaraj C, Shah I, Sild S, Sun L, Taboureau O, Tang Y, Tetko IV, Todeschini R, Tong W, Trisciuzzi D, Tropsha A, Van Den Driessche G, Varnek A, Wang Z, Wedebye EB, Williams AJ, Xie H, Zakharov AV, Zheng Z, Judson RS. CoMPARA: Collaborative Modeling Project for Androgen Receptor Activity. ENVIRONMENTAL HEALTH PERSPECTIVES 2020; 128:27002. [PMID: 32074470 PMCID: PMC7064318 DOI: 10.1289/ehp5580] [Citation(s) in RCA: 96] [Impact Index Per Article: 24.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/06/2019] [Revised: 11/27/2019] [Accepted: 12/05/2019] [Indexed: 05/04/2023]
Abstract
BACKGROUND Endocrine disrupting chemicals (EDCs) are xenobiotics that mimic the interaction of natural hormones and alter synthesis, transport, or metabolic pathways. The prospect of EDCs causing adverse health effects in humans and wildlife has led to the development of scientific and regulatory approaches for evaluating bioactivity. This need is being addressed using high-throughput screening (HTS) in vitro approaches and computational modeling. OBJECTIVES In support of the Endocrine Disruptor Screening Program, the U.S. Environmental Protection Agency (EPA) led two worldwide consortiums to virtually screen chemicals for their potential estrogenic and androgenic activities. Here, we describe the Collaborative Modeling Project for Androgen Receptor Activity (CoMPARA) efforts, which follows the steps of the Collaborative Estrogen Receptor Activity Prediction Project (CERAPP). METHODS The CoMPARA list of screened chemicals built on CERAPP's list of 32,464 chemicals to include additional chemicals of interest, as well as simulated ToxCast™ metabolites, totaling 55,450 chemical structures. Computational toxicology scientists from 25 international groups contributed 91 predictive models for binding, agonist, and antagonist activity predictions. Models were underpinned by a common training set of 1,746 chemicals compiled from a combined data set of 11 ToxCast™/Tox21 HTS in vitro assays. RESULTS The resulting models were evaluated using curated literature data extracted from different sources. To overcome the limitations of single-model approaches, CoMPARA predictions were combined into consensus models that provided averaged predictive accuracy of approximately 80% for the evaluation set. DISCUSSION The strengths and limitations of the consensus predictions were discussed with example chemicals; then, the models were implemented into the free and open-source OPERA application to enable screening of new chemicals with a defined applicability domain and accuracy assessment. This implementation was used to screen the entire EPA DSSTox database of ∼ 875,000 chemicals, and their predicted AR activities have been made available on the EPA CompTox Chemicals dashboard and National Toxicology Program's Integrated Chemical Environment. https://doi.org/10.1289/EHP5580.
Collapse
Affiliation(s)
- Kamel Mansouri
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
- ScitoVation LLC, Research Triangle Park, North Carolina, USA
- Integrated Laboratory Systems, Inc., Morrisville, North Carolina, USA
| | - Nicole Kleinstreuer
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods (NICEATM), National Institute of Environmental Health Sciences, Research Triangle Park, North Carolina, USA
| | - Ahmed M. Abdelaziz
- Technische Universität München, Wissenschaftszentrum Weihenstephan für Ernährung, Landnutzung und Umwelt, Department für Biowissenschaftliche Grundlagen, Weihenstephaner Steig 23, 85350 Freising, Germany
| | - Domenico Alberga
- Department of Pharmacy-Drug Sciences, University of Bari, Bari, Italy
| | - Vinicius M. Alves
- Laboratory for Molecular Modeling and Drug Design, Faculty of Pharmacy, Federal University of Goiás, Goiânia, Brazil
- Laboratory for Molecular Modeling, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | | | - Carolina H. Andrade
- Laboratory for Molecular Modeling and Drug Design, Faculty of Pharmacy, Federal University of Goiás, Goiânia, Brazil
| | - Fang Bai
- School of Pharmacy, Lanzhou University, China
| | - Ilya Balabin
- Information Systems & Global Solutions (IS&GS), Lockheed Martin, USA
| | - Davide Ballabio
- Milano Chemometrics and QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Emilio Benfenati
- Istituto di Ricerche Farmacologiche “Mario Negri”, IRCCS, Milan, Italy
| | - Barun Bhhatarai
- QSAR Research Unit in Environmental Chemistry and Ecotoxicology, Department of Theoretical and Applied Sciences, University of Insubria, Varese, Italy
| | - Scott Boyer
- Swedish Toxicology Sciences Research Center, Karolinska Institutet, Södertälje, Sweden
| | - Jingwen Chen
- School of Environmental Science and Technology, Dalian University of Technology, Dalian, China
| | - Viviana Consonni
- Milano Chemometrics and QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Sherif Farag
- Laboratory for Molecular Modeling, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Denis Fourches
- Department of Chemistry, Bioinformatics Research Center, North Carolina State University, Raleigh, North Carolina, USA
| | | | - Paola Gramatica
- QSAR Research Unit in Environmental Chemistry and Ecotoxicology, Department of Theoretical and Applied Sciences, University of Insubria, Varese, Italy
| | - Francesca Grisoni
- Milano Chemometrics and QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Chris M. Grulke
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
| | - Huixiao Hong
- Division of Bioinformatics and Biostatistics, National Center for Toxicology Research, U.S. Food and Drug Administration, Jefferson, Arkansas, USA
| | - Dragos Horvath
- Laboratoire de Chémoinformatique—UMR7140, University of Strasbourg/CNRS, Strasbourg, France
| | - Xin Hu
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Ruili Huang
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | | | - Jiazhong Li
- School of Pharmacy, Lanzhou University, China
| | - Xuehua Li
- School of Environmental Science and Technology, Dalian University of Technology, Dalian, China
| | | | - Serena Manganelli
- Istituto di Ricerche Farmacologiche “Mario Negri”, IRCCS, Milan, Italy
| | | | - Uko Maran
- Institute of Chemistry, University of Tartu, Tartu, Estonia
| | - Gilles Marcou
- Laboratoire de Chémoinformatique—UMR7140, University of Strasbourg/CNRS, Strasbourg, France
| | - Todd Martin
- National Risk Management Research Laboratory, U.S. EPA, Cincinnati, Ohio, USA
| | - Eugene Muratov
- Laboratory for Molecular Modeling, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Dac-Trung Nguyen
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Orazio Nicolotti
- Department of Pharmacy-Drug Sciences, University of Bari, Bari, Italy
| | - Nikolai G. Nikolov
- Division of Risk Assessment and Nutrition, National Food Institute, Technical University of Denmark, Copenhagen, Denmark
| | - Ulf Norinder
- Swedish Toxicology Sciences Research Center, Karolinska Institutet, Södertälje, Sweden
| | - Ester Papa
- QSAR Research Unit in Environmental Chemistry and Ecotoxicology, Department of Theoretical and Applied Sciences, University of Insubria, Varese, Italy
| | - Michel Petitjean
- Computational Modeling of Protein-Ligand Interactions (CMPLI)–INSERM UMR 8251, INSERM ERL U1133, Functional and Adaptative Biology (BFA), Universite de Paris, Paris, France
| | - Geven Piir
- Institute of Chemistry, University of Tartu, Tartu, Estonia
| | - Pavel Pogodin
- Institute of Biomedical Chemistry IBMC, 10 Building 8, Pogodinskaya st., Moscow 119121, Russia
| | - Vladimir Poroikov
- Institute of Biomedical Chemistry IBMC, 10 Building 8, Pogodinskaya st., Moscow 119121, Russia
| | - Xianliang Qiao
- School of Environmental Science and Technology, Dalian University of Technology, Dalian, China
| | - Ann M. Richard
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
| | | | - Patricia Ruiz
- Computational Toxicology and Methods Development Laboratory, Division of Toxicology and Human Health Sciences, Agency for Toxic Substances and Disease Registry, Centers for Disease Control and Prevention, Atlanta, Georgia, USA
| | - Chetan Rupakheti
- National Risk Management Research Laboratory, U.S. EPA, Cincinnati, Ohio, USA
- Department of Biochemistry and Molecular Biophysics, University of Chicago, Chicago, Illinois, USA
| | - Sugunadevi Sakkiah
- Division of Bioinformatics and Biostatistics, National Center for Toxicology Research, U.S. Food and Drug Administration, Jefferson, Arkansas, USA
| | - Alessandro Sangion
- QSAR Research Unit in Environmental Chemistry and Ecotoxicology, Department of Theoretical and Applied Sciences, University of Insubria, Varese, Italy
| | - Karl-Werner Schramm
- Technische Universität München, Wissenschaftszentrum Weihenstephan für Ernährung, Landnutzung und Umwelt, Department für Biowissenschaftliche Grundlagen, Weihenstephaner Steig 23, 85350 Freising, Germany
| | - Chandrabose Selvaraj
- Division of Bioinformatics and Biostatistics, National Center for Toxicology Research, U.S. Food and Drug Administration, Jefferson, Arkansas, USA
| | - Imran Shah
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
| | - Sulev Sild
- Institute of Chemistry, University of Tartu, Tartu, Estonia
| | - Lixia Sun
- Department of Pharmaceutical Sciences, School of Pharmacy, East China University of Science and Technology, Shanghai, China
| | - Olivier Taboureau
- Computational Modeling of Protein-Ligand Interactions (CMPLI)–INSERM UMR 8251, INSERM ERL U1133, Functional and Adaptative Biology (BFA), Universite de Paris, Paris, France
| | - Yun Tang
- Department of Pharmaceutical Sciences, School of Pharmacy, East China University of Science and Technology, Shanghai, China
| | - Igor V. Tetko
- BIGCHEM GmbH, Neuherberg, Germany
- Helmholtz Zentrum Muenchen – German Research Center for Environmental Health (GmbH), Neuherberg, Germany
| | - Roberto Todeschini
- Milano Chemometrics and QSAR Research Group, Department of Earth and Environmental Sciences, University of Milano-Bicocca, Milan, Italy
| | - Weida Tong
- Division of Bioinformatics and Biostatistics, National Center for Toxicology Research, U.S. Food and Drug Administration, Jefferson, Arkansas, USA
| | | | - Alexander Tropsha
- Laboratory for Molecular Modeling, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - George Van Den Driessche
- Department of Chemistry, Bioinformatics Research Center, North Carolina State University, Raleigh, North Carolina, USA
| | - Alexandre Varnek
- Laboratoire de Chémoinformatique—UMR7140, University of Strasbourg/CNRS, Strasbourg, France
| | - Zhongyu Wang
- School of Environmental Science and Technology, Dalian University of Technology, Dalian, China
| | - Eva B. Wedebye
- Division of Risk Assessment and Nutrition, National Food Institute, Technical University of Denmark, Copenhagen, Denmark
| | - Antony J. Williams
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
| | - Hongbin Xie
- School of Environmental Science and Technology, Dalian University of Technology, Dalian, China
| | - Alexey V. Zakharov
- National Center for Advancing Translational Sciences, National Institutes of Health, Rockville, Maryland, USA
| | - Ziye Zheng
- Chemistry Department, Umeå University, Umeå, Sweden
| | - Richard S. Judson
- National Center for Computational Toxicology, Office of Research and Development, U.S. Environmental Protection Agency (U.S. EPA), Research Triangle Park, North Carolina, USA
| |
Collapse
|
39
|
Li X, Kleinstreuer NC, Fourches D. Hierarchical Quantitative Structure–Activity Relationship Modeling Approach for Integrating Binary, Multiclass, and Regression Models of Acute Oral Systemic Toxicity. Chem Res Toxicol 2020; 33:353-366. [DOI: 10.1021/acs.chemrestox.9b00259] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Affiliation(s)
- Xinhao Li
- Department of Chemistry, Bioinformatics Research Center, North Carolina State University, Raleigh, North Carolina 27695, United States
| | - Nicole C. Kleinstreuer
- Division of Intramural Research/Biostatistics and Computational Biology Branch, NIEHS, Research Triangle
Park, Durham, North Carolina 27709, United States
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, NIEHS, Research Triangle Park, Durham, North Carolina 27709, United States
| | - Denis Fourches
- Department of Chemistry, Bioinformatics Research Center, North Carolina State University, Raleigh, North Carolina 27695, United States
| |
Collapse
|
40
|
Alberga D, Trisciuzzi D, Mansouri K, Mangiatordi GF, Nicolotti O. Prediction of Acute Oral Systemic Toxicity Using a Multifingerprint Similarity Approach. Toxicol Sci 2020; 167:484-495. [PMID: 30371864 DOI: 10.1093/toxsci/kfy255] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
The implementation of nonanimal approaches is of particular importance to regulatory agencies for the prediction of potential hazards associated with acute exposures to chemicals. This work was carried out in the framework of an international modeling initiative organized by the Acute Toxicity Workgroup (ATWG) of the Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM) with the participation of 32 international groups across government, industry, and academia. Our contribution was to develop a multifingerprints similarity approach for predicting five relevant toxicology endpoints related to the acute oral systemic toxicity that are: the median lethal dose (LD50) point prediction, the "nontoxic" (LD50 > 2000 mg/kg) and "very toxic" (LD50<50 mg/kg) binary classification, and the multiclass categorization of chemicals based on the United States Environmental Protection Agency and Globally Harmonized System of Classification and Labeling of Chemicals schemes. Provided by the ICCVAM's ATWG, the training set used to develop the models consisted of 8944 chemicals having high-quality rat acute oral lethality data. The proposed approach integrates the results coming from a similarity search based on 19 different fingerprint definitions to return a consensus prediction value. Moreover, the herein described algorithm is tailored to properly tackling the so-called toxicity cliffs alerting that a large gap in LD50 values exists despite a high structural similarity for a given molecular pair. An external validation set made available by ICCVAM and consisting in 2896 chemicals was employed to further evaluate the selected models. This work returned high-accuracy predictions based on the evaluations conducted by ICCVAM's ATWG.
Collapse
Affiliation(s)
- Domenico Alberga
- Dipartimento di Farmacia-Scienze del Farmaco, Università degli Studi di Bari "Aldo Moro," I-70126 Bari, Italy
| | - Daniela Trisciuzzi
- Dipartimento di Farmacia-Scienze del Farmaco, Università degli Studi di Bari "Aldo Moro," I-70126 Bari, Italy
| | - Kamel Mansouri
- ScitoVation LLC, Research Triangle Park, North Carolina 27709.,Integrated Laboratory Systems, Morrisville, NC 27560
| | - Giuseppe Felice Mangiatordi
- Dipartimento di Farmacia-Scienze del Farmaco, Università degli Studi di Bari "Aldo Moro," I-70126 Bari, Italy.,Istituto Tumori IRCCS Giovanni Paolo II, 70124 Bari, Italy
| | - Orazio Nicolotti
- Dipartimento di Farmacia-Scienze del Farmaco, Università degli Studi di Bari "Aldo Moro," I-70126 Bari, Italy
| |
Collapse
|
41
|
Helman G, Shah I, Patlewicz G. Transitioning the Generalised Read-Across approach (GenRA) to quantitative predictions: A case study using acute oral toxicity data. ACTA ACUST UNITED AC 2019; 12. [PMID: 33623834 DOI: 10.1016/j.comtox.2019.100097] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
Read-across approaches continue to evolve as does their utility in the field of risk assessment. Previously we presented our generalised read-across (GenRA) approach (Shah et al., 2016), which utilises chemical descriptor and/or in vitro bioactivity data to make read-across predictions on the basis of the similarity weighted average of nearest neighbours. The current public version of GenRA predicts 574 apical outcomes as a binary call from repeat dose toxicity studies available in ToxRefDB (Helman et al., 2019). Here we investigated the application of GenRA to quantitative values, specifically using a large dataset of rat oral acute LD50 toxicity data (LD50 values for 7011 discrete chemicals) that had been collected under the auspices of the ICCVAM acute toxicity workgroup (ATWG). GenRA LD50 predictions were made based on the following criteria - chemicals were characterised by Morgan chemical fingerprints with a minimum similarity threshold of 0.5 and a maximum of 10 nearest neighbours over the entire dataset. An R2 value of 0.61 and RMSE of 0.58 was achieved based on these parameters. Monte Carlo cross validation was then used to estimate confidence in the R2. Cross validated R2 values were found to fall in the range of 0.47 to 0.62. However, when evaluating GenRA locally to clusters of mechanistically or structurally-similar chemicals, average R2 values improved up to 0.91. GenRA can be extended to make reasonable quantitative predictions of acute oral rodent toxicity with improved performance exhibited for specific local domains.
Collapse
Affiliation(s)
- George Helman
- Oak Ridge Institute for Science and Education (ORISE), Oak Ridge, Tennessee, USA.,National Center for Computational Toxicology (NCCT), Office of Research and Development, US Environmental Protection Agency, 109 TW Alexander Dr, Research Triangle Park (RTP), NC 27711, USA
| | - Imran Shah
- National Center for Computational Toxicology (NCCT), Office of Research and Development, US Environmental Protection Agency, 109 TW Alexander Dr, Research Triangle Park (RTP), NC 27711, USA
| | - Grace Patlewicz
- National Center for Computational Toxicology (NCCT), Office of Research and Development, US Environmental Protection Agency, 109 TW Alexander Dr, Research Triangle Park (RTP), NC 27711, USA
| |
Collapse
|
42
|
Gadaleta D, Vuković K, Toma C, Lavado GJ, Karmaus AL, Mansouri K, Kleinstreuer NC, Benfenati E, Roncaglioni A. SAR and QSAR modeling of a large collection of LD 50 rat acute oral toxicity data. J Cheminform 2019; 11:58. [PMID: 33430989 PMCID: PMC6717335 DOI: 10.1186/s13321-019-0383-2] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2019] [Accepted: 08/13/2019] [Indexed: 11/10/2022] Open
Abstract
The median lethal dose for rodent oral acute toxicity (LD50) is a standard piece of information required to categorize chemicals in terms of the potential hazard posed to human health after acute exposure. The exclusive use of in vivo testing is limited by the time and costs required for performing experiments and by the need to sacrifice a number of animals. (Quantitative) structure-activity relationships [(Q)SAR] proved a valid alternative to reduce and assist in vivo assays for assessing acute toxicological hazard. In the framework of a new international collaborative project, the NTP Interagency Center for the Evaluation of Alternative Toxicological Methods and the U.S. Environmental Protection Agency's National Center for Computational Toxicology compiled a large database of rat acute oral LD50 data, with the aim of supporting the development of new computational models for predicting five regulatory relevant acute toxicity endpoints. In this article, a series of regression and classification computational models were developed by employing different statistical and knowledge-based methodologies. External validation was performed to demonstrate the real-life predictability of models. Integrated modeling was then applied to improve performance of single models. Statistical results confirmed the relevance of developed models in regulatory frameworks, and confirmed the effectiveness of integrated modeling. The best integrated strategies reached RMSEs lower than 0.50 and the best classification models reached balanced accuracies over 0.70 for multi-class and over 0.80 for binary endpoints. Computed predictions will be hosted on the EPA's Chemistry Dashboard and made freely available to the scientific community.
Collapse
Affiliation(s)
- Domenico Gadaleta
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Via Mario Negri 2, 20156, Milan, Italy.
| | - Kristijan Vuković
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Via Mario Negri 2, 20156, Milan, Italy
| | - Cosimo Toma
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Via Mario Negri 2, 20156, Milan, Italy
- Institute for Risk Assessment Sciences, Utrecht University, PO Box 80177, 3508 TD, Utrecht, The Netherlands
| | - Giovanna J Lavado
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Via Mario Negri 2, 20156, Milan, Italy
| | - Agnes L Karmaus
- Integrated Laboratory Systems, Research Triangle Park, NC, 27560, USA
| | - Kamel Mansouri
- Integrated Laboratory Systems, Research Triangle Park, NC, 27560, USA
| | - Nicole C Kleinstreuer
- NTP Interagency Center for the Evaluation of Alternative Toxicological Methods, National Institute of Environmental Health Sciences, Research Triangle Park, NC, 27560, USA
| | - Emilio Benfenati
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Via Mario Negri 2, 20156, Milan, Italy
| | - Alessandra Roncaglioni
- Laboratory of Environmental Chemistry and Toxicology, Department of Environmental Health Sciences, Istituto di Ricerche Farmacologiche Mario Negri IRCCS, Via Mario Negri 2, 20156, Milan, Italy
| |
Collapse
|
43
|
Patlewicz G, Lizarraga LE, Rua D, Allen DG, Daniel AB, Fitzpatrick SC, Garcia-Reyero N, Gordon J, Hakkinen P, Howard AS, Karmaus A, Matheson J, Mumtaz M, Richarz AN, Ruiz P, Scarano L, Yamada T, Kleinstreuer N. Exploring current read-across applications and needs among selected U.S. Federal Agencies. Regul Toxicol Pharmacol 2019; 106:197-209. [PMID: 31078681 PMCID: PMC6814248 DOI: 10.1016/j.yrtph.2019.05.011] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2019] [Revised: 04/27/2019] [Accepted: 05/08/2019] [Indexed: 10/26/2022]
Abstract
Read-across is a well-established data gap-filling technique applied for regulatory purposes. In US Environmental Protection Agency's New Chemicals Program under TSCA, read-across has been used extensively for decades, however the extent of application and acceptance of read-across among U.S. federal agencies is less clear. In an effort to build read-across capacity, raise awareness of the state of the science, and work towards a harmonization of read-across approaches across U.S. agencies, a new read-across workgroup was established under the Interagency Coordinating Committee on the Validation of Alternative Methods (ICCVAM). This is one of several ad hoc groups ICCVAM has convened to implement the ICCVAM Strategic Roadmap. In this article, we outline the charge and scope of the workgroup and summarize the current applications, tools used, and needs of the agencies represented on the workgroup for read-across. Of the agencies surveyed, the Environmental Protection Agency had the greatest experience in using read-across whereas other agencies indicated that they would benefit from gaining a perspective of the landscape of the tools and available guidance. Two practical case studies are also described to illustrate how the read-across approaches applied by two agencies vary on account of decision context.
Collapse
Affiliation(s)
- Grace Patlewicz
- (a)National Center for Computational Toxicology, U.S. Environmental Protection Agency, 109 TW Alexander Dr, Research Triangle Park, NC, 27709, USA.
| | - Lucina E Lizarraga
- (b)National Center for Environmental Assessment, U.S. Environmental Protection Agency, 26 West Martin Luther King Drive, Cincinnati, OH, 45268, USA
| | - Diego Rua
- Center for Devices and Radiological Health, U.S. Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, MD, 20993, USA
| | - David G Allen
- ILS, P.O. Box 13501, Research Triangle Park, NC, 27709, USA
| | - Amber B Daniel
- ILS, P.O. Box 13501, Research Triangle Park, NC, 27709, USA
| | - Suzanne C Fitzpatrick
- Center for Food Safety and Applied Nutrition, U.S. Food and Drug Administration, 5100 Paint Branch Parkway, College Park, MD, 20740, USA
| | - Natàlia Garcia-Reyero
- Environmental Laboratory, U.S. Army Engineer Research and Developmental Center, 3909 Halls Ferry Rd., Vicksburg, MS, 39180, USA
| | - John Gordon
- U.S. Consumer Product Safety Commission, 5 Research Place, Rockville, MD, 20850, USA
| | - Pertti Hakkinen
- National Library of Medicine, 6707 Democracy Blvd., Bethesda, MD, 20892, USA
| | | | - Agnes Karmaus
- ILS, P.O. Box 13501, Research Triangle Park, NC, 27709, USA
| | - Joanna Matheson
- U.S. Consumer Product Safety Commission, 5 Research Place, Rockville, MD, 20850, USA
| | - Moiz Mumtaz
- Agency for Toxic Substances and Disease Registry, 1600 Clifton Rd., Chamblee, GA, 30341, USA
| | | | - Patricia Ruiz
- Agency for Toxic Substances and Disease Registry, 1600 Clifton Rd., Chamblee, GA, 30341, USA
| | - Louis Scarano
- Office of Pollution Prevention and Toxics, U.S. Environmental Protection Agency, 1200 Pennsylvania Ave. NW, Washington, DC, 20460, USA
| | - Takashi Yamada
- Division of Risk Assessment, Biological Safety Research Center, National Institute of Health Sciences, 3-25-26, Tonomachi, Kawasaki-ku, Kawasaki, Kanagawa, 210-9501, Japan
| | - Nicole Kleinstreuer
- National Toxicology Program Interagency Center for the Evaluation of Alternative Toxicological Methods, National Institute of Environmental Health Sciences, P.O. Box 12233, Research Triangle Park, NC, 27709, USA
| |
Collapse
|
44
|
Vukovic K, Gadaleta D, Benfenati E. Methodology of aiQSAR: a group-specific approach to QSAR modelling. J Cheminform 2019; 11:27. [PMID: 30945010 PMCID: PMC6446381 DOI: 10.1186/s13321-019-0350-y] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2019] [Accepted: 03/25/2019] [Indexed: 12/26/2022] Open
Abstract
Background Several QSAR methodology developments have shown promise in recent years. These include the consensus approach to generate the final prediction of a model, utilizing new, advanced machine learning algorithms and streamlining, standardization and automation of various QSAR steps. One approach that seems under-explored is at-the-runtime generation of local models specific to individual compounds. This approach was quite likely limited by the computational requirements, but with current increases in processing power and the widespread availability of cluster-computing infrastructure, this limitation is no longer that severe. Results We propose a new QSAR methodology: aiQSAR, whose aim is to generate endpoint predictions directly from the input dataset by building an array of local models generated at-the-runtime and specific for each compound in the dataset. The local group of each compound is selected on the basis of fingerprint similarities and the final prediction is calculated by integrating the results of a number of autonomous mathematical models. The method is applicable to regression, binary classification and multi-class classification and was tested on one dataset for each endpoint type: bioconcentration factor (BCF) for regression, Ames test for binary classification and Environmental Protection Agency (EPA) acute rat oral toxicity ranking for multi-class classification. As part of this method, the applicability domain of each prediction is assessed through the applicability domain measure, calculated on the basis of the fingerprint similarities in each local group of compounds. Conclusions We outline the methodology for a new QSAR-based predictive tool whose advantages are automation, group-specific approach to modelling and simplicity of execution. Our aim now will be to develop this method into a stand-alone software tool. We hope that eventual adoption of our tool would make QSAR modelling more accessible and transparent. Our methodology could be used as an initial modelling step, to predict new compounds by simply loading the training dataset as an input. Predictions could then be further evaluated and refined either by other tools or through optimization of aiQSAR parameters. Electronic supplementary material The online version of this article (10.1186/s13321-019-0350-y) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Kristijan Vukovic
- Istituto di Ricerche Farmacologiche Mario Negri-IRCCS, Via Mario Negri 2, 20156, Milan, Italy. .,Jozef Stefan International Postgraduate School, Jamova cesta 39, 1000, Ljubljana, Slovenia.
| | - Domenico Gadaleta
- Istituto di Ricerche Farmacologiche Mario Negri-IRCCS, Via Mario Negri 2, 20156, Milan, Italy
| | - Emilio Benfenati
- Istituto di Ricerche Farmacologiche Mario Negri-IRCCS, Via Mario Negri 2, 20156, Milan, Italy
| |
Collapse
|
45
|
Ciallella HL, Zhu H. Advancing Computational Toxicology in the Big Data Era by Artificial Intelligence: Data-Driven and Mechanism-Driven Modeling for Chemical Toxicity. Chem Res Toxicol 2019; 32:536-547. [PMID: 30907586 DOI: 10.1021/acs.chemrestox.8b00393] [Citation(s) in RCA: 67] [Impact Index Per Article: 13.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
In 2016, the Frank R. Lautenberg Chemical Safety for the 21st Century Act became the first US legislation to advance chemical safety evaluations by utilizing novel testing approaches that reduce the testing of vertebrate animals. Central to this mission is the advancement of computational toxicology and artificial intelligence approaches to implementing innovative testing methods. In the current big data era, the terms volume (amount of data), velocity (growth of data), and variety (the diversity of sources) have been used to characterize the currently available chemical, in vitro, and in vivo data for toxicity modeling purposes. Furthermore, as suggested by various scientists, the variability (internal consistency or lack thereof) of publicly available data pools, such as PubChem, also presents significant computational challenges. The development of novel artificial intelligence approaches based on public massive toxicity data is urgently needed to generate new predictive models for chemical toxicity evaluations and make the developed models applicable as alternatives for evaluating untested compounds. In this procedure, traditional approaches (e.g., QSAR) purely based on chemical structures have been replaced by newly designed data-driven and mechanism-driven modeling. The resulting models realize the concept of adverse outcome pathway (AOP), which can not only directly evaluate toxicity potentials of new compounds, but also illustrate relevant toxicity mechanisms. The recent advancement of computational toxicology in the big data era has paved the road to future toxicity testing, which will significantly impact on the public health.
Collapse
|
46
|
Villeneuve DL, Coady K, Escher BI, Mihaich E, Murphy CA, Schlekat T, Garcia-Reyero N. High-throughput screening and environmental risk assessment: State of the science and emerging applications. ENVIRONMENTAL TOXICOLOGY AND CHEMISTRY 2019; 38:12-26. [PMID: 30570782 PMCID: PMC6698360 DOI: 10.1002/etc.4315] [Citation(s) in RCA: 51] [Impact Index Per Article: 10.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/25/2018] [Revised: 08/26/2018] [Accepted: 11/09/2018] [Indexed: 05/20/2023]
Abstract
In 2007 the United States National Research Council (NRC) published a vision for toxicity testing in the 21st century that emphasized the use of in vitro high-throughput screening (HTS) methods and predictive models as an alternative to in vivo animal testing. In the present study we examine the state of the science of HTS and the progress that has been made in implementing and expanding on the NRC vision, as well as challenges to implementation that remain. Overall, significant progress has been made with regard to the availability of HTS data, aggregation of chemical property and toxicity information into online databases, and the development of various models and frameworks to support extrapolation of HTS data. However, HTS data and associated predictive models have not yet been widely applied in risk assessment. Major barriers include the disconnect between the endpoints measured in HTS assays and the assessment endpoints considered in risk assessments as well as the rapid pace at which new tools and models are evolving in contrast with the slow pace at which regulatory structures change. Nonetheless, there are opportunities for environmental scientists and policymakers alike to take an impactful role in the ongoing development and implementation of the NRC vision. Six specific areas for scientific coordination and/or policy engagement are identified. Environ Toxicol Chem 2019;38:12-26. Published 2018 Wiley Periodicals Inc. on behalf of SETAC. This article is a US government work and, as such, is in the public domain in the United States of America.
Collapse
Affiliation(s)
- Daniel L. Villeneuve
- U.S. Environmental Protection Agency, Mid-Continent Ecology Division, Duluth, MN, USA
- Address correspondence to: Daniel L. Villeneuve, US EPA Mid-Continent Ecology Division, 6201 Congdon Blvd, Duluth, MN, 55804, T: 218-529-5217, F: 218-529-5003,
| | - Katie Coady
- Toxicology and Environmental Research and Consulting, The Dow Chemical Company, Midland, MI, USA
| | - Beate I. Escher
- Hemholtz Centre for Environmental Research – UFZ, Leipzig, Germany
| | - Ellen Mihaich
- Environmental and Regulatory Resources (ER), Durham, NC, USA
| | - Cheryl A. Murphy
- Michigan State University, Fisheries and Wildlife, Lymann Briggs College, East Lansing, MI, USA
| | - Tamar Schlekat
- Society of Environmental Toxicology and Chemistry, Durham, NC, USA
| | - Natàlia Garcia-Reyero
- Environmental Laboratory, US Army Engineer Research and Development Center, Vicksburg, MS, USA
| |
Collapse
|
47
|
Ballabio D, Grisoni F, Consonni V, Todeschini R. Integrated QSAR Models to Predict Acute Oral Systemic Toxicity. Mol Inform 2018; 38:e1800124. [PMID: 30549437 DOI: 10.1002/minf.201800124] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2018] [Accepted: 11/26/2018] [Indexed: 11/07/2022]
Abstract
The ICCVAM Acute Toxicity Workgroup (U.S. Department of Health and Human Services), in collaboration with the U.S. Environmental Protection Agency (U.S. EPA, National Center for Computational Toxicology), coordinated the "Predictive Models for Acute Oral Systemic Toxicity" collaborative project to develop in silico models to predict acute oral systemic toxicity for filling regulatory needs. In this framework, new Quantitative Structure-Activity Relationship (QSAR) models for the prediction of very toxic (LD50 lower than 50 mg/kg) and nontoxic (LD50 greater than or equal to 2,000 mg/kg) endpoints were developed, as described in this study. Models were developed on a large set of chemicals (8992), provided by the project coordinators, considering the five OCED principles for QSAR applicability to regulatory endpoints. A Bayesian consensus approach integrating three different classification QSAR algorithms was applied as modelling method. For both the considered endpoints, the proposed approach demonstrated to be robust and predictive, as determined by a blind validation on a set of external molecules provided in a later stage by the coordinators of the collaborative project. Finally, the integration of predictions obtained for the very toxic and nontoxic endpoints allowed the identification of compounds associated to medium toxicity, as well as the analysis of consistency between the predictions obtained for the two endpoints on the same molecules. Predictions of the proposed consensus approach will be integrated with those originated from models proposed by the participants of the collaborative project to facilitate the regulatory acceptance of in-silico predictions and thus reduce or replace experimental tests for acute toxicity.
Collapse
Affiliation(s)
- Davide Ballabio
- Department of Earth and Environmental Sciences, University of Milano-Bicocca, P.za della Scienza 1, 20126, Milano, Italy
| | - Francesca Grisoni
- Department of Earth and Environmental Sciences, University of Milano-Bicocca, P.za della Scienza 1, 20126, Milano, Italy
| | - Viviana Consonni
- Department of Earth and Environmental Sciences, University of Milano-Bicocca, P.za della Scienza 1, 20126, Milano, Italy
| | - Roberto Todeschini
- Department of Earth and Environmental Sciences, University of Milano-Bicocca, P.za della Scienza 1, 20126, Milano, Italy
| |
Collapse
|