Adaptation of the Systematic Review Framework to the Assessment of Toxicological Test Methods: Challenges and Lessons Learned with the Zebrafish Embryotoxicity Test

Inconsistencies in variable reporting and methods in larval zebrafish behavioral assays

New approaches in developmental neurotoxicity (DNT) screening are needed due to the tens of thousands of chemicals requiring hazard assessments. Zebrafish (Danio rerio) are an alternative vertebrate model for DNT testing, but without a standardized protocol for larval behavioral assays, comparison of results among laboratories is challenging. To evaluate the congruence of protocols across laboratories, we conducted a literature review of DNT studies focusing on larval zebrafish behavior assays and cataloged experimental design consistencies. Our review focused on 51 unique method variables in publications where chemical exposure occurred in early development and subsequent larval locomotor evaluation focused on assays that included a light/dark photoperiod transition. We initially identified 94 publications, but only 31 exclusively met our inclusion criteria which focused on parameters that are important to an assay employed by our laboratory. No publication reported 100% of the targeted variables; only 51 to 86% of those variables were reported in the reviewed publications, with some aspects of the experimental design consistent among laboratories. However, no protocol was exactly the same for any two publications. Many of these variables had more than one parameter/design reported, highlighting the inconsistencies among methods. Overall, there is not only a strong need for the development of a standardized testing protocol for larval zebrafish locomotor assays, but there is also a need for a standardized protocol for reporting experimental variables in the literature. Here we include an extensive guideline checklist for conducting larval zebrafish developmental behavior assays.

The ECOTOXicology Knowledgebase: A Curated Database of Ecologically Relevant Toxicity Tests to Support Environmental Research and Risk Assessment

The need for assembled existing and new toxicity data has accelerated as the amount of chemicals introduced into commerce continues to grow and regulatory mandates require safety assessments for a greater number of chemicals. To address this evolving need, the ECOTOXicology Knowledgebase (ECOTOX) was developed starting in the 1980s and is currently the world's largest compilation of curated ecotoxicity data, providing support for assessments of chemical safety and ecological research through systematic and transparent literature review procedures. The recently released version of ECOTOX (Ver 5, www.epa.gov/ecotox) provides single-chemical ecotoxicity data for over 12,000 chemicals and ecological species with over one million test results from over 50,000 references. Presented is an overview of ECOTOX, detailing the literature review and data curation processes within the context of current systematic review practices and discussing how recent updates improve the accessibility and reusability of data to support the assessment, management, and research of environmental chemicals. Relevant and acceptable toxicity results are identified from studies in the scientific literature, with pertinent methodological details and results extracted following well-established controlled vocabularies and newly extracted toxicity data added quarterly to the public website. Release of ECOTOX, Ver 5, included an entirely redesigned user interface with enhanced data queries and retrieval options, visualizations to aid in data exploration, customizable outputs for export and use in external applications, and interoperability with chemical and toxicity databases and tools. This is a reliable source of curated ecological toxicity data for chemical assessments and research and continues to evolve with accessible and transparent state-of-the-art practices in literature data curation and increased interoperability to other relevant resources. Environ Toxicol Chem 2022;41:1520-1539. © 2022 SETAC. This article has been contributed to by US Government employees and their work is in the public domain in the USA.

Pluripotent stem cell assays: Modalities and applications for predictive developmental toxicity

This manuscript provides a review focused on embryonic stem cell-based models and their place within the landscape of alternative developmental toxicity assays. Against the background of the principles of developmental toxicology, the wide diversity of alternative methods using pluripotent stem cells developed in this area over the past half century is reviewed. In order to provide an overview of available models, a systematic scoping review was conducted following a published protocol with inclusion criteria, which were applied to select the assays. Critical aspects including biological domain, readout endpoint, availability of standardized protocols, chemical domain, reproducibility and predictive power of each assay are described in detail, in order to review the applicability and limitations of the platform in general and progress moving forward to implementation. The horizon of innovative routes of promoting regulatory implementation of alternative methods is scanned, and recommendations for further work are given.

A Systematic Review to Compare Chemical Hazard Predictions of the Zebrafish Embryotoxicity Test With Mammalian Prenatal Developmental Toxicity

Originally developed to inform the acute toxicity of chemicals on fish, the zebrafish embryotoxicity test (ZET) has also been proposed for assessing the prenatal developmental toxicity of chemicals, potentially replacing mammalian studies. Although extensively evaluated in primary studies, a comprehensive review summarizing the available evidence for the ZET's capacity is lacking. Therefore, we conducted a systematic review of how well the presence or absence of exposure-related findings in the ZET predicts prenatal development toxicity in studies with rats and rabbits. A two-tiered systematic review of the developmental toxicity literature was performed, a review of the ZET literature was followed by one of the mammalian literature. Data were extracted using DistillerSR, and study validity was assessed with an amended SYRCLE's risk-of-bias tool. Extracted data were analyzed for each species and substance, which provided the basis for comparing the 2 test methods. Although limited by the number of 24 included chemicals, our results suggest that the ZET has potential to identify chemicals that are mammalian prenatal developmental toxicants, with a tendency for overprediction. Furthermore, our analysis confirmed the need for further standardization of the ZET. In addition, we identified contextual and methodological challenges in the application of systematic review approaches to toxicological questions. One key to overcoming these challenges is a transition to more comprehensive and transparent planning, conduct and reporting of toxicological studies. The first step toward bringing about this change is to create broad awareness in the toxicological community of the need for and benefits of more evidence-based approaches.

Avoiding Regrettable Substitutions: Green Toxicology for Sustainable Chemistry

Green chemistry seeks to design less hazardous chemicals, but many of the efforts to replace chemicals have resulted in so-called "Regrettable Substitutions", when a chemical with an unknown or unforeseen hazard is used to replace a chemical identified as problematic. Here, we discuss the literature on regrettable substitution and focus on an oft-mentioned case, Bisphenol A, which was replaced with Bisphenol S-and the lessons that can be learned from this history. In particular, we focus on how Green Toxicology can offer a way to make better substitutions.

The EU-ToxRisk method documentation, data processing and chemical testing pipeline for the regulatory use of new approach methods

Hazard assessment, based on new approach methods (NAM), requires the use of batteries of assays, where individual tests may be contributed by different laboratories. A unified strategy for such collaborative testing is presented. It details all procedures required to allow test information to be usable for integrated hazard assessment, strategic project decisions and/or for regulatory purposes. The EU-ToxRisk project developed a strategy to provide regulatorily valid data, and exemplified this using a panel of > 20 assays (with > 50 individual endpoints), each exposed to 19 well-known test compounds (e.g. rotenone, colchicine, mercury, paracetamol, rifampicine, paraquat, taxol). Examples of strategy implementation are provided for all aspects required to ensure data validity: (i) documentation of test methods in a publicly accessible database; (ii) deposition of standard operating procedures (SOP) at the European Union DB-ALM repository; (iii) test readiness scoring accoding to defined criteria; (iv) disclosure of the pipeline for data processing; (v) link of uncertainty measures and metadata to the data; (vi) definition of test chemicals, their handling and their behavior in test media; (vii) specification of the test purpose and overall evaluation plans. Moreover, data generation was exemplified by providing results from 25 reporter assays. A complete evaluation of the entire test battery will be described elsewhere. A major learning from the retrospective analysis of this large testing project was the need for thorough definitions of the above strategy aspects, ideally in form of a study pre-registration, to allow adequate interpretation of the data and to ensure overall scientific/toxicological validity.