Stepwise Information-Filtering Tool (SIFT): A method for using risk assessment metadata in a nontraditional way

ECOTOXr: An R package for reproducible and transparent retrieval of data from EPA's ECOTOX database

The US EPA ECOTOX database provides key ecotoxicological data that are crucial in environmental risk assessment. It can be used for computational predictions of toxicity or indications of hazard in a wide range of situations. There is no standardised or formalised method for extracting and subsetting data from the database for these purposes. Consequently, results in such meta-analyses are difficult to reproduce. The present study introduces the software package ECOTOXr, which provides the means to formalise data retrieval from the ECOTOX database in the R scripting language. Three cases are presented to evaluate the performance of the package in relation to earlier data extractions and searches on the website. These cases demonstrate that the package can reproduce data sets relatively well. Furthermore, they illustrate how future studies can further improve traceability and reproducibility by applying the package and adhering to some simple guidelines. This contributes to the FAIR principles, credibility and acceptance of research that uses data from the ECOTOX database.

Handling concentration data below the analytical limit in environmental mixture risk assessment: A case-study on pesticide river monitoring

Aquatic organisms are exposed to ever-changing complex mixtures of chemicals throughout their lifetime. Component-Based Mixture Risk Assessment (CBMRA) is a well-established methodology for water contaminant-mixture management, the use of which is growing due to improved access to reference ecotoxicity data and extensive monitoring datasets. It enables the translation of measured exposure concentrations of chemicals into biological effect values, and thus to quantitatively estimate the risk of the whole water sample (i.e., as a mixture). However, many factors can bias the final risk decision by impacting the risk metric components; thus, a careful design of the CBMRA is needed, taking into primary consideration the specific features of the dataset and mixture risk assessment assignments. This study systematically addressed the effects of the most common approaches used for handling the concentrations of chemicals below the limit of detection/quantification (LOD/LOQ) in CBMRA. The main results included: i) an informed CBMRA procedure that enables the tracking of the risk decisions triggered by substances below LOD/LOQ, ii) a conceptual map and guidance criteria to support the selection of the most suitable approach for specific scenarios and related interpretation; iii) a guided implementation of the informed CBMRA on dataset of pesticide concentrations in Italian rivers in 2020 (702,097 records).

Can Chemical Toxicity in Saltwater Be Predicted from Toxicity in Freshwater? A Comprehensive Evaluation Using Species Sensitivity Distributions

Species sensitivity distributions (SSDs) play an important role in ecological risk assessment. Estimating SSDs requires toxicity data for many species, but reports on saltwater species are often limited compared to freshwater species. This limitation can constrain informed management of saltwater quality for the protection of marine ecosystems. We investigated the relationships between the parameters (i.e., mean and standard deviation [SD]) of freshwater and saltwater log-normal SSDs to determine how accurately saltwater toxicity could be estimated from freshwater toxicity test data. We estimated freshwater and saltwater SSDs for 104 chemicals with reported acute toxicity data for five or more species and compared their means, SDs, and hazardous concentrations for 5% of the species (HC5) derived from the acute SSDs. Standard major axis regression analyses generally showed that log-log relationships between freshwater and saltwater SSD means, SDs, and HC5 values were nearly 1:1. In addition, the ratios of freshwater-to-saltwater SSD means and HC5 values for most of the 104 chemicals fell within the range 0.1-10. Although such a strong correlation was not observed for SSD SDs (r²  < 0.5), differences between freshwater and saltwater SSD SDs were relatively small. These results indicate that saltwater acute SSDs can be reasonably estimated using freshwater acute SSDs. Because the differences of the means and SDs between freshwater and saltwater SSDs were larger when the number of test species used for SSD estimation was lower (i.e., five to seven species in the present study), obtaining toxicity data for an adequate number of species will be key to better approximation of a saltwater acute SSD from a freshwater acute SSD for a given chemical. Environ Toxicol Chem 2022;41:2021-2027. © 2022 The Authors. Environmental Toxicology and Chemistry published by Wiley Periodicals LLC on behalf of SETAC.

Ecological Thresholds of Toxicological Concern: A Review

The ecological threshold of toxicological concern (ecoTTC) is analogous to traditional human health-based TTCs but with derivation and application to ecological species. An ecoTTC is computed from the probability distribution of predicted no effect concentrations (PNECs) derived from either chronic or extrapolated acute toxicity data for toxicologically or chemically similar groups of chemicals. There has been increasing interest in using ecoTTCs in screening level environmental risk assessments and a computational platform has been developed for derivation with aquatic species toxicity data (https://envirotoxdatabase.org/). Current research and development areas include assessing mode of action-based chemical groupings, conservatism in estimated PNECs and ecoTTCs compared to existing regulatory values, and the influence of taxa (e.g., algae, invertebrates, and fish) composition in the distribution of PNEC values. The ecoTTC continues to develop as a valuable alternative strategy within the toolbox of traditional and new approach methods for ecological chemical assessment. This brief review article describes the ecoTTC concept and potential applications in ecological risk assessment, provides an overview of the ecoTTC workflow and how the values can be derived, and highlights recent developments and ongoing research. Future applications of ecoTTC concept in different disciplines are discussed along with opportunities for its use.

Screening and prioritization of nano- and microplastic particle toxicity studies for evaluating human health risks - development and application of a toxicity study assessment tool

Concern regarding the human health implications that exposure to nano- and microplastic particles (NMPs) potentially represents is increasing. While there have been several years of research reporting on the ecotoxicological effects of NMPs, human health toxicology studies have only recently emerged. The available human health hazard data are thus limited, with potential concern regarding the relevance and reliability for understanding the potential human health implications. In this study we develop and apply a NMP toxicity screening assessment tool (NMP-TSAT) for evaluating human health effects studies against a suite of quality assurance and quality control (QA/QC) criteria for both in vivo and in vitro studies. A total of 74 studies representing either inhalation or oral exposure pathways were identified and evaluated. Assessment categories include particle characterization, experimental design, and applicability for risk assessment; with critical and non-critical criteria organized to allow screening and prioritization. It is observed that the majority of studies evaluated using the NMP-TSAT have been performed on monodisperse particles, predominately spheres (≈60%), consisting of polystyrene (≈46%). The majority of studies have tested particles < 5 μm, with a minimal particle size of 10 nm and a maximum particle size of about 200 μm. The total assessment score (TAS) possible for in vivo studies is 52, whereas for in vitro studies it is 46, which is based on receiving a maximum score of 2 against 26 and 23 criteria, respectively. The evaluated TAS ranged from between 12 and 44 and 16-34, for in vivo and in vitro studies, respectively. Given the challenges associated with prioritizing studies based on ranking them according to their TAS we propose a Tiered approach, whereby studies are initially screened based on how they score against various critical criteria, which have been defined for their relevance for assessing the hazards and risks for human health. In this instance, studies that score a minimum of '1' against each of the critical criteria, regardless of how they rank according to their TAS, are prioritized as part of a Tier 1 screening and prioritization phase, which would then be followed by an expert evaluation, representing a Tier 2 level of assessment. Using this approach we identify 10 oral ingestion and 2 inhalation studies that score at least 1 against all critical criteria. Lastly, several key observations for strengthening future effects studies are identified, these include a need for the generation and access to standard reference materials representative of human exposure to NMPs for use in toxicity test systems and/or the improved characterization and verification of test particle characteristics, and the adoption of study design guidance, such as recommended by OECD, when conducting either in vivo inhalation or oral ingestion toxicity tests.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1186/s43591-021-00023-x.

Coral Ecotoxicological Data Evaluation for the Environmental Safety Assessment of Ultraviolet Filters

There is growing interest in the environmental safety of ultraviolet (UV) filters found in cosmetic and personal care products (CPCPs). The CPCP industry is assessing appropriate environmental risk assessment (ERA) methods to conduct robust environmental safety assessments for these ingredients. Relevant and reliable data are needed for ERA, particularly when the assessment is supporting regulatory decision-making. In the present study, we apply a data evaluation approach to incorporate nonstandard toxicity data into the ERA process through an expanded range of reliability scores over commonly used approaches (e.g., Klimisch scores). The method employs an upfront screening followed by a data quality assessment based largely on the Criteria for Reporting and Evaluating Ecotoxicity Data (CRED) approach. The method was applied in a coral case study in which UV filter toxicity data was evaluated to identify data points potentially suitable for higher tier and/or regulatory ERA. This is an optimal case study because there are no standard coral toxicity test methods, and UV filter bans are being enacted based on findings reported in the current peer-reviewed data set. Eight studies comprising nine assays were identified; four of the assays did not pass the initial screening assessment. None of the remaining five assays received a high enough reliability score (R_n ) to be considered of decision-making quality (i.e., R1 or R2). Four assays were suitable for a preliminary ERA (i.e., R3 or R4), and one assay was not reliable (i.e., R6). These results highlight a need for higher quality coral toxicity studies, potentially through the development of standard test protocols, to generate reliable toxicity endpoints. These data can then be used for ERA to inform environmental protection and sustainability decision-making. Environ Toxicol Chem 2021;40:3441-3464. © 2021 Personal Care Products Council. Environmental Toxicology and Chemistry published by Wiley Periodicals LLC on behalf of SETAC.

Open Science in regulatory environmental risk assessment

A possible way to alleviate the public skepticism toward regulatory science is to increase transparency by making all data and value judgments used in regulatory decision making accessible for public interpretation, ideally early on in the process, and following the concepts of Open Science. This paper discusses the opportunities and challenges in strengthening Open Science initiatives in regulatory environmental risk assessment (ERA). In this discussion paper, we argue that the benefits associated with Open Science in regulatory ERA far outweigh its perceived risks. All stakeholders involved in regulatory ERA (e.g., governmental regulatory authorities, private sector, academia, and nongovernmental organizations), as well as professional organizations like the Society of Environmental Toxicology and Chemistry, can play a key role in supporting the Open Science initiative, by promoting the use of recommended reporting criteria for reliability and relevance of data and tools used in ERA, and by developing a communication strategy for both professionals and nonprofessionals to transparently explain the socioeconomic value judgments and scientific principles underlying regulatory ERA. Integr Environ Assess Manag 2021;17:1229-1242. © 2021 The Authors. Integrated Environmental Assessment and Management published by Wiley Periodicals LLC on behalf of Society of Environmental Toxicology & Chemistry (SETAC).

Modeling Regulatory Threshold Levels for Pesticides in Surface Waters from Effect Databases

Regulatory threshold levels (RTL) represent robust benchmarks for assessing risks of pesticides, e.g., in surface waters. However, comprehensive scientific risk evaluations comparing RTL to measured environmental concentrations (MEC) of pesticides in surface waters were yet restricted to a low number of pesticides, as RTL are only available after extensive review of regulatory documents. Thus, the aim of the present study was to model RTL equivalents (RTLe) for aquatic organisms from publicly accessible ecotoxicological effect databases. We developed a model that applies validity criteria in accordance with official US EPA review guidelines and validated the model against a set of manually retrieved RTL (n = 49). Model application yielded 1283 RTLe (n = 676 for pesticides, plus 607 additional RTLe for other use types). In a case study, the usability of RTLe was demonstrated for a set of 27 insecticides by comparing RTLe and RTL exceedance rates for 3001 MEC from US surface waters. The provided dataset enables thorough risk assessments of surface water exposure data for a comprehensive number of substances. Especially regions without established pesticide regulations may benefit from this dataset by using it as a baseline information for pesticide risk assessment and for the identification of priority substances or potential high-risk regions.

Strength of methods assessment for aquatic primary producer toxicity data: A critical review of atrazine studies from the peer-reviewed literature

Improving the quality of pesticide toxicity studies is a shared goal in ecotoxicology and a priority for risk assessors. Using the herbicide atrazine and testing on primary producers as a case study, we developed and applied a transparent scoring system for assessing the quality of peer-reviewed studies. The exercise also highlights where data gaps exist for planning future work. We determined that, while a large number of studies (147) present experimental data fitting basic inclusion criteria, only a small proportion provide sufficient information on the test substance, test organism, and test results to be considered of sufficient quality (i.e., a minimum score of >8 out of 16, meaning no critical study weaknesses identified) that would allow recommendation for their use in decision-making. Optimal studies for use in first tier risk assessment were further identified for each taxonomic group as the highest-scoring study scoring >8, that also used the technical grade active ingredient, reported an EC50 for a population-level endpoint (e.g. cell density, dry weight), and an exposure period in line with standard tests (≤96-h for algae, ≤14-d for macrophytes). Ultimately, 22 freshwater studies (four periphyton, ten macrophytes, and eight phytoplankton) achieved scores >8. Only one study with marine phytoplankton scored >8, and no studies met the risk assessment inclusion criteria for marine/estuarine periphyton or macrophytes. This indicates a potential research need with respect to toxicity data for salt-water species. Finally, registrant studies were evaluated, and in many cases, were the most appropriate for risk assessment, with the greatest scores observed for their respective species relative to those reported in the peer-reviewed literature. This exercise highlights the importance of defining and identifying well-performed toxicity tests, illuminating knowledge gaps, and reporting high quality data in support of the risk assessment process outside of the standard regulatory framework.

Mode of Action Classifications in the EnviroTox Database: Development and Implementation of a Consensus MOA Classification

Multiple mode of action (MOA) frameworks have been developed in aquatic ecotoxicology, mainly based on fish toxicity. These frameworks provide information on a key determinant of chemical toxicity, but the MOA categories and level of specificity remain unique to each of the classification schemes. The present study aimed to develop a consensus MOA assignment within EnviroTox, a curated in vivo aquatic toxicity database, based on the following MOA classification schemes: Verhaar (modified) framework, Assessment Tool for Evaluating Risk, Toxicity Estimation Software Tool, and OASIS. The MOA classifications from each scheme were first collapsed into one of 3 categories: non-specifically acting (i.e., narcosis), specifically acting, or nonclassifiable. Consensus rules were developed based on the degree of concordance among the 4 individual MOA classifications to attribute a consensus MOA to each chemical. A confidence rank was also assigned to the consensus MOA classification based on the degree of consensus. Overall, 40% of the chemicals were classified as narcotics, 17% as specifically acting, and 43% as unclassified. Sixty percent of chemicals had a medium to high consensus MOA assignment. When compared to empirical acute toxicity data, the general trend of specifically acting chemicals being more toxic is clearly observed for both fish and invertebrates but not for algae. EnviroTox is the first approach to establishing a high-level consensus across 4 computationally and structurally distinct MOA classification schemes. This consensus MOA classification provides both a transparent understanding of the variation between MOA classification schemes and an added certainty of the MOA assignment. In terms of regulatory relevance, a reliable understanding of MOA can provide information that can be useful for the prioritization (ranking) and risk assessment of chemicals. Environ Toxicol Chem 2019;38:2294-2304. © 2019 The Authors. Environmental Toxicology and Chemistry published by Wiley Periodicals, Inc. on behalf of SETAC.

Creation of a Curated Aquatic Toxicology Database: EnviroTox

Flexible, rapid, and predictive approaches that do not require the use of large numbers of vertebrate test animals are needed because the chemical universe remains largely untested for potential hazards. Development of robust new approach methodologies and nontesting approaches requires the use of existing information via curated, integrated data sets. The ecological threshold of toxicological concern (ecoTTC) represents one such new approach methodology that can predict a conservative de minimis toxicity value for chemicals with little or no information available. For the creation of an ecoTTC tool, a large, diverse environmental data set was developed from multiple sources, with harmonization, characterization, and information quality assessment steps to ensure that the information could be effectively organized and mined. The resulting EnviroTox database contains 91 217 aquatic toxicity records representing 1563 species and 4016 unique Chemical Abstracts Service numbers and is a robust, curated database containing high-quality aquatic toxicity studies that are traceable to the original information source. Chemical-specific information is also linked to each record and includes physico-chemical information, chemical descriptors, and mode of action classifications. Toxicity data are associated with the physico-chemical data, mode of action classifications, and curated taxonomic information for the organisms tested. The EnviroTox platform also includes 3 analysis tools: a predicted-no-effect concentration calculator, an ecoTTC distribution tool, and a chemical toxicity distribution tool. Although the EnviroTox database and tools were originally developed to support ecoTTC analysis and development, they have broader applicability to the field of ecological risk assessment. Environ Toxicol Chem 2019;9999:1-12. © 2019 The Authors. Environmental Toxicology and Chemistry published by Wiley Periodicals, Inc. on behalf of SETAC.

Mode of Action (MOA) Assignment Classifications for Ecotoxicology: An Evaluation of Approaches

The mode of toxic action (MOA) is recognized as a key determinant of chemical toxicity and as an alternative to chemical class-based predictive toxicity modeling. However, MOA classification has never been standardized in ecotoxicology, and a comprehensive comparison of classification tools and approaches has never been reported. Here we critically evaluate three MOA classification methodologies using an aquatic toxicity data set of 3448 chemicals, compare the approaches, and assess utility and limitations in screening and early tier assessments. The comparisons focused on three commonly used tools: Verhaar prediction of toxicity MOA, the U.S. Environmental Protection Agency (EPA) ASsessment Tool for Evaluating Risk (ASTER) QSAR (quantitative structure activity relationship) application, and the EPA Mode of Action and Toxicity (MOAtox) database. Of the 3448 MOAs predicted using the Verhaar scheme, 1165 were classified by ASTER, and 802 were available in MOAtox. Of the subset of 432 chemicals with MOA assignments for each of the three schemes, 42% had complete concordance in MOA classification, and there was no agreement for 7% of the chemicals. The research shows the potential for large differences in MOA classification between the five broad groups of the Verhaar scheme and the more mechanism-based assignments of ASTER and MOAtox. Harmonization of classification schemes is needed to use MOA classification in chemical hazard and risk assessment more broadly.

Assessing the reliability of ecotoxicological studies: An overview of current needs and approaches

In general, reliable studies are well designed and well performed, and enough details on study design and performance are reported to assess the study. For hazard and risk assessment in various legal frameworks, many different types of ecotoxicity studies need to be evaluated for reliability. These studies vary in study design, methodology, quality, and level of detail reported (e.g., reviews, peer-reviewed research papers, or industry-sponsored studies documented under Good Laboratory Practice [GLP] guidelines). Regulators have the responsibility to make sound and verifiable decisions and should evaluate each study for reliability in accordance with scientific principles regardless of whether they were conducted in accordance with GLP and/or standardized methods. Thus, a systematic and transparent approach is needed to evaluate studies for reliability. In this paper, 8 different methods for reliability assessment were compared using a number of attributes: categorical versus numerical scoring methods, use of exclusion and critical criteria, weighting of criteria, whether methods are tested with case studies, domain of applicability, bias toward GLP studies, incorporation of standard guidelines in the evaluation method, number of criteria used, type of criteria considered, and availability of guidance material. Finally, some considerations are given on how to choose a suitable method for assessing reliability of ecotoxicity studies. Integr Environ Assess Manag 2017;13:640-651. © 2016 The Authors. Integrated Environmental Assessment and Management published by Wiley Periodicals, Inc. on behalf of Society of Environmental Toxicology & Chemistry (SETAC).

Evaluation and comparison of the relationship between NOEC and EC10 or EC20 values in chronic Daphnia toxicity testing

Hypothesis-based no-effect-concentration (NOEC) and regression-based x% effect concentration (ECx) values are common statistical approaches used to summarize ecotoxicological effects. Controversy over the NOEC model has prompted a movement toward discontinuation of the NOEC in favor of ECx, but the best x% effect surrogate for NOEC has not yet been determined. Historically, 10% and 20% effect concentrations (EC10 and EC20) have been treated as NOEC analogs. Given these measurements' importance to ecotoxicology, further understanding of the relationships between NOEC and EC10 or EC20 is crucial. In the present study, a metadataset of daphnid chronic toxicity tests was compiled to analyze the strength and significance of NOEC:EC10 and NOEC:EC20 relationships. The impact of endpoint (e.g., mortality, reproduction) and test condition parameters (e.g., pH, temperature) on NOEC:EC10 and NOEC:EC20 was evaluated. Mortality endpoints were most sensitive 51% of the time, with growth and reproductive endpoints constituting the remainder, underscoring the value of using multiple endpoints to evaluate toxic effects rather than relying on reproduction as the a priori most sensitive endpoint. When test condition parameters were less restricted (e.g., pH, hardness), the NOEC:EC20 association was more robust, suggesting that variability introduced by test implementation increased variability in ECx calculation. The analysis revealed that, overall, EC10 was a more suitable analog than EC20 for NOEC. Recommendations include refinement and reporting of the test parameters pH and hardness to minimize variability in ECx calculation.