Applying a modified systematic review and integrated assessment framework (SYRINA) - a case study on triphenyl phosphate

This work presents a case study in applying a systematic review framework (SYRINA) to the identification of chemicals as endocrine disruptors. The suitability and performance of the framework is tested with regard to the widely accepted World Health Organization definition of an endocrine disruptor (ED). The endocrine disrupting potential of triphenyl phosphate (TPP), a well-studied flame retardant reported to exhibit various endocrine related effects was assessed. We followed the 7 steps of the SYRINA framework, articulating the research objective via Populations, Exposures, Comparators, Outcomes (PECO) statements, performed literature search and screening, conducted study evaluation, performed data extraction and summarized and integrated the evidence. Overall, 66 studies, consisting of in vivo, in vitro and epidemiological data, were included. We concluded that triphenyl phosphate could be identified as an ED based on metabolic disruption and reproductive function. We found that the tools used in this case study and the optimizations performed on the framework were suitable to assess properties of EDs. A number of challenges and areas for methodological development in systematic appraisal of evidence relating to endocrine disrupting potential were identified; significant time and effort were needed for the analysis of in vitro mechanistic data in this case study, thus increasing the workload and time needed to perform the systematic review process. Further research and development of this framework with regards to grey literature (non-peer-reviewed literature) search, harmonization of study evaluation methods, more consistent evidence integration approaches and a pre-defined method to assess links between adverse effect and endocrine activity are recommended. It would also be advantageous to conduct more case studies for a chemical with less data than TPP.

Development and application of a systematic and quantitative weighting framework to evaluate the quality and relevance of relative potency estimates for dioxin-like compounds (DLCs) for human health risk assessment

The toxic equivalency factors (TEFs) approach for dioxin-like chemicals (DLCs) is currently based on a qualitative assessment of a heterogeneous data set of relative estimates of potency (REPs) spanning several orders of magnitude with highly variable study quality and relevance. An effort was undertaken to develop a weighting framework to systematically evaluate and quantitatively integrate the quality and relevance for development of more robust TEFs. Six main-study characteristics were identified as most important in characterizing the quality and relevance of an individual REP for human health risk assessment: study type, study model, pharmacokinetics, REP derivation method, REP derivation quality, and endpoint. Subsequently, a computational approach for quantitatively integrating the weighting framework parameters was developed and applied to the REP2004 database. This was accomplished using a machine learning approach which infers a weighted TEF distribution for each congener. The resulting database, weighted for quality and relevance, provides REP distributions from >600 data sets (including in vivo and in vitro studies, a range of endpoints, etc.). This weighted database provides a flexible platform for systematically and objectively characterizing TEFs for use in risk assessment, as well as providing information to characterize uncertainty and variability. Collectively, this information provides risk managers with information for decision making.

SciRAPnano: a pragmatic and harmonized approach for quality evaluation of in vitro toxicity data to support risk assessment of nanomaterials

Large amounts of nanotoxicity data from alternative non-animal (in vitro) test methods have been generated, but there is a lack of harmonized quality evaluation approaches for these types of data. Tools for scientifically sound and structured evaluation of the reliability and relevance of in vitro toxicity data to effectively inform regulatory hazard assessment of nanomaterials (NMs), are needed. Here, we present the development of a pragmatic approach to facilitate such evaluation. The tool was developed based on the Science in Risk Assessment and Policy (SciRAP) tool currently applicable to quality evaluation of chemical toxicity studies. The approach taken to develop the tool, referred to as SciRAPnano, included refinement of the original SciRAP in vitro tool through implementation of identified NM-relevant criteria, and further refined based on a set of case studies involving evaluation of 11 studies investigating in vitro toxicity of nano-sized titanium dioxide. Parameters considered cover key physicochemical properties as well as assay-specific aspects that impact NM toxicity, including NM interference with test methods and NM transformation. The final SciRAPnano tool contains 38 criteria for reporting quality, 19 criteria for methodological quality, and 4 guidance items to evaluate relevance. The approach covers essential parameters for pragmatic and harmonized evaluation of NM in vitro toxicity studies and allows for structured use of in vitro data in regulatory hazard assessment of NMs, including transparency on data quality.

Updated systematic assessment of human, animal and mechanistic evidence demonstrates lack of human carcinogenicity with consumption of aspartame

Aspartame has been studied extensively and evaluated for its safety in foods and beverages yet concerns for its potential carcinogenicity have persisted, driven primarily by animal studies conducted at the Ramazzini Institute (RI). To address this controversy, an updated systematic review of available human, animal, and mechanistic data was conducted leveraging critical assessment tools to consider the quality and reliability of data. The evidence base includes 12 animal studies and >40 epidemiological studies reviewed by the World Health Organization which collectively demonstrate a lack of carcinogenic effect. Assessment of >1360 mechanistic endpoints, including many guideline-based genotoxicity studies, demonstrate a lack of activity associated with endpoints grouped to key characteristics of carcinogens. Other non-specific mechanistic data (e.g., mixed findings of oxidative stress across study models, tissues, and species) do not provide evidence of a biologically plausible carcinogenic pathway associated with aspartame. Taken together, available evidence supports that aspartame consumption is not carcinogenic in humans and that the inconsistent findings of the RI studies may be explained by flaws in study design and conduct (despite additional analyses to address study limitations), as acknowledged by authoritative bodies.

Application of AOPs to assist regulatory assessment of chemical risks - Case studies, needs and recommendations

While human regulatory risk assessment (RA) still largely relies on animal studies, new approach methodologies (NAMs) based on in vitro, in silico or non-mammalian alternative models are increasingly used to evaluate chemical hazards. Moreover, human epidemiological studies with biomarkers of effect (BoE) also play an invaluable role in identifying health effects associated with chemical exposures. To move towards the next generation risk assessment (NGRA), it is therefore crucial to establish bridges between NAMs and standard approaches, and to establish processes for increasing mechanistically-based biological plausibility in human studies. The Adverse Outcome Pathway (AOP) framework constitutes an important tool to address these needs but, despite a significant increase in knowledge and awareness, the use of AOPs in chemical RA remains limited. The objective of this paper is to address issues related to using AOPs in a regulatory context from various perspectives as it was discussed in a workshop organized within the European Union partnerships HBM4EU and PARC in spring 2022. The paper presents examples where the AOP framework has been proven useful for the human RA process, particularly in hazard prioritization and characterization, in integrated approaches to testing and assessment (IATA), and in the identification and validation of BoE in epidemiological studies. Nevertheless, several limitations were identified that hinder the optimal usability and acceptance of AOPs by the regulatory community including the lack of quantitative information on response-response relationships and of efficient ways to map chemical data (exposure and toxicity) onto AOPs. The paper summarizes suggestions, ongoing initiatives and third-party tools that may help to overcome these obstacles and thus assure better implementation of AOPs in the NGRA.

Inflammatory biomarkers on an LPS-induced RAW 264.7 cell model: a systematic review and meta-analysis

INTRODUCTION

Several experimental models have been designed to promote the development of new anti-inflammatory drugs. The in vitro model using RAW 264.7 cells has been widely used. However, there is still no consensus on which inflammatory mediators should initially be measured to screen for possible anti-inflammatory effects. To determine the rationality of measuring inflammatory mediators together with NO, such as the levels of tumor necrosis factor (TNF)-α, and interleukins (IL) 1β and 6, we carried out this systematic review (SR) and meta-analysis (MA).

METHODOLOGY

We conducted this SR and MA in accordance with the Preferred Reporting of Systematic Reviews and Meta-Analysis and the Cochrane Handbook for Systematic Reviews of Intervention. This review was registered in the Open Science Framework ( https://doi.org/10.17605/OSF.IO/8C3HT ).

RESULTS

LPS-induced cells produced high NO levels compared to non-LPS induced, and this production was not related to cell density. TNF-α, IL-1β, and IL-6, also showed high levels after cells had been stimulated with LPS. Though with some restrictions, all studies were reliable, as the risk of bias was detected in the test compounds and systems.

CONCLUSION

Measurement of NO levels may be sufficient to screen for possible anti-inflammatory action in the context of LPS-induced RAW 264.7 cells.

New aspects in deriving health-based guidance values for bromate in swimming pool water

Bromate, classified as a EU CLP 1B carcinogen, is a typical by-product of the disinfection of drinking and swimming pool water. The aim of this study was (a) to provide data on the occurrence of bromate in pool water, (b) to re-evaluate the carcinogenic MOA of bromate in the light of existing data, (c) to assess the possible exposure to bromate via swimming pool water and (d) to inform the derivation of cancer risk-related bromate concentrations in swimming pool water. Measurements from monitoring analysis of 229 samples showed bromate concentrations in seawater pools up to 34 mg/L. A comprehensive non-systematic literature search was done and the quality of the studies on genotoxicity and carcinogenicity was assessed by Klimisch criteria (Klimisch et al., Regul Toxicol Pharmacol 25:1–5, 1997) and SciRAP tool (Beronius et al., J Appl Toxicol, 38:1460–1470, 2018) respectively. Benchmark dose (BMD) modeling was performed using the modeling average mode in BMDS 3.1 and PROAST 66.40, 67 and 69 (human cancer BMDL₁₀; EFSA 2017). For exposure assessment, data from a wide range of sources were evaluated for their reliability. Different target groups (infants/toddlers, children and adults) and exposure scenarios (recreational, sport-active swimmers, top athletes) were considered for oral, inhalation and dermal exposure. Exposure was calculated according to the frequency of swimming events and duration in water. For illustration, cancer risk-related bromate concentrations in pool water were calculated for different target groups, taking into account their exposure using the hBMDL₁₀ and a cancer risk of 1 in 100,000. Convincing evidence was obtained from a multitude of studies that bromate induces oxidative DNA damage and acts as a clastogen in vitro and in vivo. Since statistical modeling of the available genotoxicity data is compatible with both linear as well as non-linear dose–response relationships, bromate should be conservatively considered to be a non-threshold carcinogen. BMD modeling with model averaging for renal cancer studies (Kurokawa et al., J Natl. Cancer Inst, 1983 and 1986a; DeAngelo et al., Toxicol Pathol 26:587–594, 1998) resulted in a median hBMDL₁₀ of 0.65 mg bromate/kg body weight (bw) per day. Evaluation of different age and activity groups revealed that top athletes had the highest exposure, followed by sport-active children, sport-active adults, infants and toddlers, children and adults. The predominant route of exposure was oral (73–98%) by swallowing water, followed by the dermal route (2–27%), while the inhalation route was insignificant (< 0.5%). Accepting the same risk level for all population groups resulted in different guidance values due to the large variation in exposure. For example, for an additional risk of 1 in 100,000, the bromate concentrations would range between 0.011 for top athletes, 0.015 for sport-active children and 2.1 mg/L for adults. In conclusion, the present study shows that health risks due to bromate exposure by swimming pool water cannot be excluded and that large differences in risk exist depending on the individual swimming habits and water concentrations.

Evaluation of animal toxicity studies with diisocyanates regarding presence of thresholds for induction and elicitation of respiratory allergy by quantitative weight of evidence

Animal toxicity studies on diisocyanates were evaluated using quantitative weight of evidence (QWoE) to test the hypothesis that the dose-response curve shows a threshold for the induction and/or elicitation of respiratory sensitization. A literature search identified 59 references that included at least two concentration groups of the diisocyanate and a vehicle-exposed concurrent control in the study design. These studies were subjected to a QWoE-assessment applying scoring criteria for quality and relevance/strength of effects relevant to the selected endpoint of respiratory sensitization. Overall, the studies assessing dose/concentration-response for diisocyanates with the endpoint, respiratory sensitization, were heterogenous regarding study design, animal models used, endpoints assessed, and quality. Only a limited number of the studies subjected to the QWoE-assessment allowed drawing conclusions about possible thresholds for respiratory sensitization. Highest quality and relevance/strength of effects scores were obtained by a series of studies specifically designed to investigate a potential threshold for elicitation of respiratory sensitization in the Brown Norway (BN) rat. These studies applied an elaborate study design to optimize induction of respiratory sensitization and reduce interference by respiratory tract irritation. In summary, the available studies provided moderate to good support for the existence of a threshold for elicitation and limited to moderate support for a threshold regarding induction of respiratory allergy by diisocyanates in experimental animals. However, a quantitative extrapolation of threshold values established in rodents to humans remains complex.

Development and application of a health-based framework for informing regulatory action in relation to exposure of microplastic particles in California drinking water

Microplastics have been documented in drinking water, but their effects on human health from ingestion, or the concentrations at which those effects begin to manifest, are not established. Here, we report on the outcome of a virtual expert workshop conducted between October 2020 and October 2021 in which a comprehensive review of mammalian hazard studies was conducted. A key objective of this assessment was to evaluate the feasibility and confidence in deriving a human health-based threshold value to inform development of the State of California's monitoring and management strategy for microplastics in drinking water. A tiered approach was adopted to evaluate the quality and reliability of studies identified from a review of the peer-reviewed scientific literature. A total of 41 in vitro and 31 in vivo studies using mammals were identified and subjected to a Tier 1 screening and prioritization exercise, which was based on an evaluation of how each of the studies addressed various quality criteria. Prioritized studies were identified largely based on their application and reporting of dose-response relationships. Given that methods for extrapolating between in vitro and in vivo systems are currently lacking, only oral exposure in vivo studies were identified as fit-for-purpose within the context of this workshop. Twelve mammalian toxicity studies were prioritized and subjected to a Tier 2 qualitative evaluation by external experts. Of the 12 studies, 7 report adverse effects on male and female reproductive systems, while 5 reported effects on various other physiological endpoints. It is notable that the majority of studies (83%) subjected to Tier 2 evaluation report results from exposure to a single polymer type (polystyrene spheres), representing a size range of 0.040 to 20 µm. No single study met all desired quality criteria, but collectively toxicological effects with respect to biomarkers of inflammation and oxidative stress represented a consistent trend. While it was possible to derive a conservative screening level to inform monitoring activities, it was not possible to extrapolate a human-health-based threshold value for microplastics, which is largely due to concerns regarding the relative quality and reliability of current data, but also due to the inability to extrapolate data from studies using monodisperse plastic particles, such as polystyrene spheres to an environmentally relevant exposure of microplastics. Nevertheless, a conservative screening level value was used to estimate a volume of drinking water (1000 L) that could be used to support monitoring activities and improve our overall understanding of exposure in California's drinking water. In order to increase confidence in our ability to derive a human-health-based threshold value in the future, several research recommendations are provided, with an emphasis towards strengthening how toxicity studies should be conducted in the future and an improved understanding of human exposure to microplastics, insights critically important to better inform future risk assessments.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1186/s43591-022-00030-6.

Towards a reporting guideline for developmental and reproductive toxicology testing in C. elegans and other nematodes

Implementation of reliable methodologies allowing Reduction, Refinement, and Replacement (3Rs) of animal testing is a process that takes several decades and is still not complete. Reliable methods are essential for regulatory hazard assessment of chemicals where differences in test protocol can influence the test outcomes and thus affect the confidence in the predictive value of the organisms used as an alternative for mammals. Although test guidelines are common for mammalian studies, they are scarce for non-vertebrate organisms that would allow for the 3Rs of animal testing. Here, we present a set of 30 reporting criteria as the basis for such a guideline for Developmental and Reproductive Toxicology (DART) testing in the nematode Caenorhabditis elegans. Small organisms like C. elegans are upcoming in new approach methodologies for hazard assessment; thus, reliable and robust test protocols are urgently needed. A literature assessment of the fulfilment of the reporting criteria demonstrates that although studies describe methodological details, essential information such as compound purity and lot/batch number or type of container is often not reported. The formulated set of reporting criteria for C. elegans testing can be used by (i) researchers to describe essential experimental details (ii) data scientists that aggregate information to assess data quality and include data in aggregated databases (iii) regulators to assess study data for inclusion in regulatory hazard assessment of chemicals.

Development of the SciRAP Approach for Evaluating the Reliability and Relevance of in vitro Toxicity Data

Efficient and successful integration of data generated from non-animal test methods must rely on reliable and relevant data. It is important therefore to develop tools and criteria that facilitate scientifically sound, structured, and transparent evaluation of reliability and relevance of in vitro toxicity data to efficiently inform regulatory hazard and risk assessment. The Science in Risk Assessment and Policy (SciRAP) initiative aims to promote such overarching goals. We present the work to develop and refine the SciRAP tool for evaluation of reliability and relevance of in vitro studies for incorporation on the SciRAP web-based platform (www.scirap.org). In the SciRAP approach, reliability evaluation is based on criteria for reporting quality and methodological quality, and is explicitly separated from relevance evaluation. The SciRAP in vitro tool (version 1.0) was tested and evaluated during an expert test round (April 2019-September 2020) on three in vitro studies by thirty-one experts from regulatory authorities, industry and academia from different geographical areas and with various degree of experience in in vitro research and/or human health risk assessment. In addition, the experts answered an online survey to collect their feedback about the general features and desired characteristics of the tool for further refinement. The SciRAP in vitro tool (version 2.0) was revised based on the outcome of the expert test round (study evaluation and online survey) and consists of 24 criteria for evaluating “reporting quality” (reliability), 16 criteria for “methodological quality” (reliability), and 4 items for evaluating relevance of in vitro studies. Participants were generally positive about the adequacy, flexibility, and user-friendliness of the tool. The expert test round outlined the need to (i) revise the formulation of certain criteria; (ii) provide new or revised accompanying guidance for reporting quality and methodological quality criteria in the “test compounds and controls,” “test system,” and “data collection and analysis” domains; and (iii) provide revised guidance for relevance items, as general measures to reduce inter-expert variability. The SciRAP in vitro tool allows for a structured and transparent evaluation of in vitro studies for use in regulatory hazard and risk assessment of chemicals.

Effect of Different Root Canal Irrigant Solutions on the Release of Dentin-Growth Factors: A Systematic Review and Meta-Analysis

Irrigant solutions are used to promote dentin-growth factors (GF) release for regenerative endodontics. This review aimed to evaluate the reports comparing the release of GFs using different root canal irrigant solutions. Eligible studies compared the in vitro GF release in human teeth after the use of at least two distinct solutions. A search was conducted on Pubmed, Scopus, Web of Science, and Lilacs on 11 August 2021. Risk of bias was assessed using SciRAP. Study characteristics and quantitative data were extracted, and meta-analyses were performed for the mean difference (95% confidence interval) of the release of transforming growth factors Beta 1 (TGF-β1) by EDTA compared to other irrigants. Of sixteen eligible studies, eight were included in quantitative analysis. ELISA assays showed higher TGF-β1 release from 10% EDTA compared to 10% citric acid (p < 0.00001). Immunogold assays showed higher levels of TGF-β1 for 17% EDTA (p < 0.00001) compared to 10% citric acid. GRADE identified a low to very low certainty of evidence. These results point to an increased release of TGF-β1 in dentin treated with EDTA. The high heterogeneity and very low certainty of the evidence demand further studies before EDTA indication as a better irrigant for regenerative endodontics. Registration: CRD42020160871 (PROSPERO).

Assessment of the endocrine disrupting properties of bisphenol AF: a case study applying the European regulatory criteria and guidance

BACKGROUND

Scientific criteria to identify endocrine disruptors (ED) was recently implemented for plant protection products (PPP) and biocidal products (BP). A guidance document has been published by ECHA and EFSA in the context of ED criteria for PPPs and BPs.

METHODS

In the present work, a case study was performed on Bisphenol AF (BPAF) to explore the application of the EU criteria and EFSA/ECHA guidance document for the ED assessment of a non-pesticide chemical regulated under REACH. A data dossier was built by a systematic literature search (Web of Science, Pubmed, Embase; n = 511), title/abstract screening (n = 124) and full text examination (n = 88). All the information was extracted and systematically reported for 309 parameters (100 for adversity; 209 for endocrine activity). The reliability of studies was assessed (SciRAP tool).

RESULTS

Data were synthesized into 96 lines of evidence for adversity (n = 57), and endocrine activity (n = 39); and assessed by weight of evidence methodology. The initial analysis of the evidence indicated EATS-mediated adversity in mammals, therefore a mode of action (MoA) was postulated for both male and female adult exposure. Female MoA included estrogen receptor activation and altered steroidogenesis leading to ovarian dysfunction, altered estrous cycling and impaired female fertility. Male MoA was initiated by androgen receptor inhibition and altered steroidogenesis leading to dysfunction of male reproductive organs and impaired male fertility.

CONCLUSIONS

The overall conclusion of the ED assessment indicated that BPAF meets the ED criteria for human health. The steps described in the ED guidance document were successfully completed, resulting in a thorough, structured and transparent identification of BPAF as an ED. Advantages and limitations of applying the ED criteria and guidance for a REACH chemical are discussed.

Facilitation of risk assessment with evidence-based methods - A framework for use of systematic mapping and systematic reviews in determining hazard, developing toxicity values, and characterizing uncertainty

Systematic review tools and approaches developed for clinical medicine are often difficult to apply "off the shelf" in order to meet the needs of chemical risk assessments. To address such, we propose an approach that can be used by practitioners for using evidence-based methods to facilitate the risk assessment process. The framework builds on and combines efforts conducted to date by a number of agencies and researchers; the novelty is in combining these efforts with a practical understanding of risk assessment, and translating such into a 'step-by-step' guide. The approach relies on three key components: problem formulation, systematic evidence mapping, and systematic review, applied using a stepwise approach. Unique to this framework is the consideration of exposure in selecting, prioritizing, and evaluating data (e.g., dose-relevance, routes of exposure, etc.). Using the proposed step-by-step process, critical appraisal of individual studies (e.g., formal and structured assessment of both relevance and reliability) and integration efforts are considered in context of specified risk assessment objectives (e.g., mode of action, dose-response) as well as chemical-specific considerations. The resulting framework provides a logical approach of how evidence-based methods can be used to facilitate risk assessment, and elevates the use of systematic methods beyond hazard identification to directly facilitating transparent and objective selection of candidate studies and/or datasets used to quantitatively characterize risk, and to better use the underlying process to inform the approaches used to develop toxicity values.

A novel study evaluation strategy in the systematic review of animal toxicology studies for human health assessments of environmental chemicals

A key aspect of the systematic review process is study evaluation to understand the strengths and weaknesses of individual studies included in the review. The present manuscript describes the process currently being used by the Environmental Protection Agency's (EPA) Integrated Risk Information System (IRIS) Program to evaluate animal toxicity studies, illustrated by application to the recent systematic reviews of two phthalates: diisobutyl phthalate (DIBP) and diethyl phthalate (DEP). The IRIS Program uses a domain-based approach that was developed after careful consideration of tools used by others to evaluate experimental animal studies in toxicology and pre-clinical research. Standard practice is to have studies evaluated by at least two independent reviewers for aspects related to reporting quality, risk of bias/internal validity (e.g., randomization, blinding at outcome assessment, methods used to expose animals and assess outcomes, etc.), and sensitivity to identify factors that may limit the ability of a study to detect a true effect. To promote consistency across raters, prompting considerations and example responses are provided to reviewers, and a pilot phase is conducted. The evaluation process is performed separately for each outcome reported in a study, as the utility of a study may vary for different outcomes. Input from subject matter experts is used to identify chemical- and outcome-specific considerations (e.g., lifestage of exposure and outcome assessment when considering reproductive effects) to guide judgments within particular evaluation domains. For each evaluation domain, reviewers reach a consensus on a rating of Good, Adequate, Deficient, or Critically Deficient. These individual domain ratings are then used to determine the overall confidence in the study (High Confidence, Medium Confidence, Low Confidence, or Deficient). Study evaluation results, including the justifications for reviewer judgements, are documented and made publicly available in EPA's version of Health Assessment Workspace Collaborative (HAWC), a free and open source web-based software application. (The views expressed are those of the authors and do not necessarily represent the views or policies of the US EPA).

MTT versus other cell viability assays to evaluate the biocompatibility of root canal filling materials: a systematic review

OBJECTIVES

This systematic review aimed to compare the cytotoxicity of root canal filling materials (RCFMs) assessed using tetrazolium salt-based tests (TSBT), including the 3-(4,5-dimethylthiazol-2-yl)-2,5-diphenyl tetrazolium bromide (MTT) assay, with those obtained using other cell viability assays.

METHODS

A search was performed on PubMed, Scopus, Web of Science and OpenGrey up to March 2019, followed by a manual search. According to the Participants, Exposure, Comparator and Outcomes (PECO) criteria, in vitro studies that evaluated the cytotoxic effect of RCFMss on animal and/or human cells through TSBT and at least one other viability assay were compared. The methodological quality of selected papers was assessed using ToxRTool^® and SciRAP^® . Data were analysed using Wilcoxon's signed-rank test for paired samples and linear weighting kappa.

RESULTS

A total of 230 non-duplicated records were identified. After applying the eligibility criteria, 55 studies were selected for methodological evaluation, seven were selected by manual searching, 22 were excluded for methodological reasons, and 40 were included. A total of 410 comparisons were performed between TSBT and distinct cell viability tests (DCVT). MTT had moderate concordance with DCVT using human cells (n = 138 samples) (P = 0.507; k = 0.4225) and animal cells (n = 122 samples) (P = 0.124; k = 0.5775). XTT had good concordance using human (n = 110 samples) (P = 0.507; k = 0.6336) and animal cells (n = 12 samples) (P = 0.564; k = 0.6604). MTT, XTT, WST and MTS assays showed moderate concordance with DCVT (n = 410 samples) (P = 0.375; k = 0.5138) and complete agreement in 226 samples.

DISCUSSION

The included studies had methodological heterogeneity that was minimized by the systematic review methodology.

CONCLUSIONS

MTT and XTT do not cause over- or underestimation of cell viability during cytotoxicity screening of root canal filling materials, implying that these assays can be considered reliable for this purpose. Nonetheless, the development of protocols for the cytotoxic screening of these materials on 3D tissue-like cultures aiming to improve their predictability in the clinical scenario is suggested.

Recommendations for further revisions to improve the International Agency for Research on Cancer (IARC) Monograph program

In 2019, the International Agency for Research on Cancer (IARC) "Preamble to the IARC Monographs" expanded guidance regarding the scientific approaches that should be employed in its monographs. These amendments to the monograph development process are an improvement but still fall short in several areas. While the revised Preamble lays out broad methods and approaches to evaluate scientific evidence, there is a lack of specificity with regard to how IARC Working Groups will conduct consistent evaluations in a standardized, objective, and transparent manner; document systematic review and evidence integration actions, and substantiate how these actions and decisions inform the ultimate classifications. Furthermore, no guidance is provided to ensure Working Groups consistently incorporate mechanistic evidence in a robust manner using a defined approach in the context of 21st century knowledge of modes of action. Nor are the conclusions of the working groups subjected to outside, independent scientific peer review. Continued improvements and modernization of the procedures for evaluating, presenting, and communicating study quality, and in the methods used to conduct and peer-review evidence-based decision making will benefit the Working Group members, the IARC Monographs Programme overall, and the international regulatory community and public who rely upon the monographs.

Adaptation of the Systematic Review Framework to the Assessment of Toxicological Test Methods: Challenges and Lessons Learned with the Zebrafish Embryotoxicity Test

Systematic review methodology is a means of addressing specific questions through structured, consistent, and transparent examinations of the relevant scientific evidence. This methodology has been used to advantage in clinical medicine, and is being adapted for use in other disciplines. Although some applications to toxicology have been explored, especially for hazard identification, the present preparatory study is, to our knowledge, the first attempt to adapt it to the assessment of toxicological test methods. As our test case, we chose the zebrafish embryotoxicity test (ZET) for developmental toxicity and its mammalian counterpart, the standard mammalian prenatal development toxicity study, focusing the review on how well the ZET predicts the presence or absence of chemical-induced prenatal developmental toxicity observed in mammalian studies. An interdisciplinary team prepared a systematic review protocol and adjusted it throughout this piloting phase, where needed. The final protocol was registered and will guide the main study (systematic review), which will execute the protocol to comprehensively answer the review question. The goal of this preparatory study was to translate systematic review methodology to the assessment of toxicological test method performance. Consequently, it focused on the methodological issues encountered, whereas the main study will report substantive findings. These relate to numerous systematic review steps, but primarily to searching and selecting the evidence. Applying the lessons learned to these challenges can improve not only our main study, but may also be helpful to others seeking to use systematic review methodology to compare toxicological test methods. We conclude with a series of recommendations that, if adopted, would help improve the quality of the published literature, and make conducting systematic reviews of toxicological studies faster and easier over time.