GRADE guidelines for environmental and occupational health: A new series of articles in Environment International

Systems for rating bodies of evidence used in systematic reviews of air pollution exposure and reproductive and children's health: a methodological survey

BACKGROUND

Translating findings from systematic reviews assessing associations between environmental exposures and reproductive and children's health into policy recommendations requires valid and transparent evidence grading.

METHODS

We aimed to evaluate systems for grading bodies of evidence used in systematic reviews of environmental exposures and reproductive/ children's health outcomes, by conducting a methodological survey of air pollution research, comprising a comprehensive search for and assessment of all relevant systematic reviews. To evaluate the frameworks used for rating the internal validity of primary studies and for grading bodies of evidence (multiple studies), we considered whether and how specific criteria or domains were operationalized to address reproductive/children's environmental health, e.g., whether the timing of exposure assessment was evaluated with regard to vulnerable developmental stages.

RESULTS

Eighteen out of 177 (9.8%) systematic reviews used formal systems for rating the body of evidence; 15 distinct internal validity assessment tools for primary studies, and nine different grading systems for bodies of evidence were used, with multiple modifications applied to the cited approaches. The Newcastle Ottawa Scale (NOS) and the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) framework, neither developed specifically for this field, were the most commonly used approaches for rating individual studies and bodies of evidence, respectively. Overall, the identified approaches were highly heterogeneous in both their comprehensiveness and their applicability to reproductive/children's environmental health research.

CONCLUSION

Establishing the wider use of more appropriate evidence grading methods is instrumental both for strengthening systematic review methodologies, and for the effective development and implementation of environmental public health policies, particularly for protecting pregnant persons and children.

Association between per- and polyfluoroalkyl substances and risk of hypertension: a systematic review and meta-analysis

Background

Existing evidence indicates that exposure to per- and polyfluoroalkyl substances (PFASs) may increase the risk of hypertension, but the findings are inconsistent. Therefore, we aimed to explore the relationship between PFASs and hypertension through this systematic review and meta-analysis.

Methods

We searched PubMed, Embase, and the Web of Science databases for articles published in English that examined the relationship between PFASs and hypertension before 13 August 2022. The random effects model was used to aggregate the evaluation using Stata 15.0 for Windows. We also conducted subgroup analyses by region and hypertension definition. In addition, a sensitivity analysis was carried out to determine the robustness of the findings.

Results

The meta-analysis comprised 15 studies in total with 69,949 individuals. The risk of hypertension was substantially and positively correlated with exposure to perfluorooctane sulfonate (PFOS) (OR = 1.31, 95% CI: 1.14, 1.51), perfluorooctanoic acid (PFOA) (OR = 1.16, 95% CI: 1.07, 1.26), and perfluorohexane sulfonate (PFHxS) (OR = 1.04, 95% CI: 1.00, 1.09). However, perfluorononanoic acid (PFNA) exposure and hypertension were not significantly associated (OR = 1.08, 95% CI: 0.99, 1.17).

Conclusion

We evaluated the link between PFASs exposure and hypertension and discovered that higher levels of PFOS, PFOA, and PFHxS were correlated with an increased risk of hypertension. However, further high-quality population-based and pathophysiological investigations are required to shed light on the possible mechanism and demonstrate causation because of the considerable variability.

Systematic review registration

https://www.crd.york.ac.uk/prospero/ PROSPERO, registration number: CRD 42022358142.

Association between per- and polyfluoroalkyl substances exposure and risk of diabetes: a systematic review and meta-analysis

BACKGROUND

Emerging evidence suggests that per- and polyfluoroalkyl substances (PFAS) are endocrine disruptors and may contribute to the etiology of diabetes.

OBJECTIVES

This study aimed to systematically review the epidemiological evidence on the associations of PFAS with mortality and morbidity of diabetes and to quantitatively evaluate the summary effect estimates of the existing literature.

METHODS

We searched three electronic databases for epidemiological studies concerning PFAS and diabetes published before April 1, 2022. Summary odds ratio (OR), hazard ratio (HR), or β and their 95% confidence intervals (CIs) were respectively calculated to evaluate the association between PFAS and diabetes using random-effects model by the exposure type, and dose-response meta-analyses were also performed when possible. We also assessed the risk of bias of the studies included and the confidence in the body of evidence.

RESULTS

An initial literature search identified 1969 studies, of which 22 studies were eventually included. The meta-analyses indicated that the observed statistically significant PFAS-T2DM associations were consistent in cohort studies, while the associations were almost non-significant in case-control and cross-sectional studies. Dose-response meta-analysis showed a "parabolic-shaped" association between perfluorooctanoate acid (PFOA) exposure and T2DM risk. Available evidence was rated with "low" risk of bias, and the level of evidence for PFAS and incident T2DM was considered "moderate".

CONCLUSIONS

Our findings suggest that PFAS exposure may increase the risk of incident T2DM, and that PFOA may exert non-monotonic dose-response effect on T2DM risk. Considering the widespread exposure, persistence, and potential for adverse health effects of PFAS, further cohort studies with improvements in expanding the sample size, adjusting the covariates, and considering different types of PFAS exposure at various doses, are needed to elucidate the putative causal associations and potential mode of action of different PFAS on diabetes.

IMPACT STATEMENT

A growing body of evidence suggests that per- and polyfluoroalkyl substances (PFAS) are endocrine disruptors and may contribute to the development of diabetes. However, epidemiological evidence on the associations of PFAS and diabetes is inconsistent. We performed this comprehensive systematic review and meta-analysis to quantitatively synthesize the evidence. The findings of this study suggest that exposure to PFAS may increase diabetes risk among the general population. Reduced exposure to these "forever and everywhere chemicals" may be an important preventative approach to reducing the risk of diabetes across the population.

Biological plausibility in environmental health systematic reviews: a GRADE concept paper

BACKGROUND

"Biological plausibility" is a concept frequently referred to in environmental and public health when researchers are evaluating how confident they are in the results and inferences of a study or evidence review. Biological plausibility is not, however, a domain of one of the most widely-used approaches for assessing the certainty of evidence (CoE) which underpins the findings of a systematic review, the Grading of Recommendations Assessment, Development and Evaluation (GRADE) CoE Framework. Whether the omission of biological plausibility is a potential limitation of the GRADE CoE Framework is a topic that is regularly discussed, especially in the context of environmental health systematic reviews.

OBJECTIVES

We analyse how the concept of "biological plausibility", as applied in the context of assessing certainty of the evidence that supports the findings of a systematic review, is accommodated under the processes of systematic review and the existing GRADE domains.

RESULTS AND DISCUSSION

We argue that "biological plausibility" is a concept which primarily comes into play when direct evidence about the effects of an exposure on a population of concern (usually humans) is absent, at high risk of bias, is inconsistent, or limited in other ways. In such circumstances, researchers look toward evidence from other study designs in order to draw conclusions. In this respect, we can consider experimental animal and in vitro evidence as "surrogates" for the target populations, exposures, comparators and outcomes of actual interest. Through discussion of 10 examples of experimental surrogates, we propose that the concept of biological plausibility consists of two principal aspects: a "generalisability aspect" and a "mechanistic aspect". The "generalisability aspect" concerns the validity of inferences from experimental models to human scenarios, and asks the same question as does the assessment of external validity or indirectness in systematic reviews. The "mechanistic aspect" concerns certainty in knowledge of biological mechanisms and would inform judgements of indirectness under GRADE, and thus the overall CoE. While both aspects are accommodated under the indirectness domain of the GRADE CoE Framework, further research is needed to determine how to use knowledge of biological mechanisms in the assessment of indirectness of the evidence in systematic reviews.

Biological plausibility in environmental health systematic reviews: a GRADE concept paper

BACKGROUND

"Biological plausibility" is a concept frequently referred to in environmental and public health when researchers are evaluating how confident they are in the results and inferences of a study or evidence review. Biological plausibility is not, however, a domain of one of the most widely-used approaches for assessing the certainty of evidence (CoE) which underpins the findings of a systematic review, the Grading of Recommendations Assessment, Development and Evaluation (GRADE) CoE Framework. Whether the omission of biological plausibility is a potential limitation of the GRADE CoE Framework is a topic that is regularly discussed, especially in the context of environmental health systematic reviews.

OBJECTIVES

We analyse how the concept of "biological plausibility", as applied in the context of assessing certainty of the evidence that supports the findings of a systematic review, is accommodated under the processes of systematic review and the existing GRADE domains.

RESULTS AND DISCUSSION

We argue that "biological plausibility" is a concept which primarily comes into play when direct evidence about the effects of an exposure on a population of concern (usually humans) is absent, at high risk of bias, is inconsistent, or limited in other ways. In such circumstances, researchers look toward evidence from other study designs in order to draw conclusions. In this respect, we can consider experimental animal and in vitro evidence as "surrogates" for the target populations, exposures, comparators and outcomes of actual interest. Through discussion of 10 examples of experimental surrogates, we propose that the concept of biological plausibility consists of two principal aspects: a "generalisability aspect" and a "mechanistic aspect". The "generalisability aspect" concerns the validity of inferences from experimental models to human scenarios, and asks the same question as does the assessment of external validity or indirectness in systematic reviews. The "mechanistic aspect" concerns certainty in knowledge of biological mechanisms and would inform judgements of indirectness under GRADE, and thus the overall CoE. While both aspects are accommodated under the indirectness domain of the GRADE CoE Framework, further research is needed to determine how to use knowledge of biological mechanisms in the assessment of indirectness of the evidence in systematic reviews.

A systematic review on solid fuel combustion exposure and respiratory health in adults in Europe, USA, Canada, Australia and New Zealand

Epidemiological studies performed in low- and middle-income countries have shown a positive association between solid fuel burning exposure and adverse health effects, including respiratory effects in adults. However, the evidence is less clear in other countries. We performed a systematic review of epidemiological studies conducted in Europe, North America (Canada and USA only), Australia and New Zealand on the association between outdoor and indoor exposure to solid fuel (biomass and coal) combustion and respiratory outcomes in adults. We identified 34 articles. The epidemiological evidence is still limited. Positive associations were found between indoor coal, wood and combined solid fuel combustion exposure and lung cancer risk, although based on a limited number of studies. A significant association was found between indoor solid fuel exposure and COPD risk. Inconsistent results were found considering indoor coal, wood and mixed solid fuel burning exposure and other respiratory outcomes (i.e. lower respiratory infections, upper respiratory infections and other upper respiratory tract diseases, asthma and respiratory symptoms). Inconsistent results were found considering the relationship between the exposure to outdoor wood burning exposure and overall respiratory mortality, asthma, COPD and respiratory symptoms in adults. The available epidemiological evidence between outdoor exposure to residential coal burning and respiratory outcomes suggests an increased risk of adverse respiratory effects. The studies considering the impact of the introduction of measures in order to reduce solid fuel burning on air quality and health showed an improvement in air quality resulting in a reduction of adverse respiratory effects. The identified epidemiological studies have several limitations. Additional and better conducted epidemiological studies are needed to establish whether exposure occurring indoors and outdoors to solid fuel combustion pollutants is associated with adverse respiratory outcomes in adults.

The effect of exposure to radiofrequency fields on cancer risk in the general and working population: A protocol for a systematic review of human observational studies

BACKGROUND

The World Health Organization (WHO) has an ongoing project to assess potential health effects of exposure to radiofrequency electromagnetic fields (RF-EMF) in the general and working population. Here we present the protocol for a systematic review of the scientific literature on cancer hazards from exposure to RF-EMF in humans, commissioned by the WHO as part of that project.

OBJECTIVE

To assess the quality and strength of the evidence provided by human observational studies for a causal association between exposure to RF-EMF and risk of neoplastic diseases.

ELIGIBILITY CRITERIA

We will include cohort and case-control studies investigating neoplasia risks in relation to three types of exposure to RF-EMF: near-field, head-localized, exposure from wireless phone use (SR-A); far-field, whole body, environmental exposure from fixed-site transmitters (SR-B); near/far-field occupational exposures from use of handheld transceivers or RF-emitting equipment in the workplace (SR-C). While no restriction on tumour type will be applied, we will focus on selected neoplasms of the central nervous system (brain, meninges, pituitary gland, acoustic nerve) and salivary gland tumours (SR-A); brain tumours and leukaemias (SR-B, SR-C).

INFORMATION SOURCES

Eligible studies will be identified through Medline, Embase, and EMF-Portal.

RISK-OF-BIAS ASSESSMENT

We will use a tailored version of the OHAT's tool to evaluate the study's internal validity.

DATA SYNTHESIS

We will consider separately studies on different tumours, neoplasm-specific risks from different exposure sources, and a given exposure-outcome pair in adults and children. When a quantitative synthesis of findings can be envisaged, the main aims of the meta-analysis will be to assess the strength of association and the shape of the exposure-response relationship; to quantify the degree of heterogeneity across studies; and explore the sources of inconsistency (if any). When a meta-analysis is judged inappropriate, we will perform a narrative synthesis, complemented by a structured tabulation of results and appropriate visual displays.

EVIDENCE ASSESSMENT

Confidence in evidence will be assessed in line with the GRADE approach.

FUNDING

This project is supported by the World Health Organization. Co-financing was provided by the New Zealand Ministry of Health; the Istituto Superiore di Sanità in its capacity as a WHO Collaborating Centre for Radiation and Health; ARPANSA as a WHO Collaborating Centre for Radiation Protection.

REGISTRATION

PROSPERO CRD42021236798.

Assessing the Risk of Respiratory-Related Healthcare Visits Associated with Wildfire Smoke Exposure in Children 0-18 Years Old: A Systematic Review

Wildfires are increasing in frequency, size, and intensity, and increasingly affect highly populated areas. Wildfire smoke impacts cardiorespiratory health; children are at increased risk due to smaller airways, a higher metabolic rate and ongoing development. The objective of this systematic review was to describe the risk of pediatric respiratory symptoms and healthcare visits following exposure to wildfire smoke. Medical and scientific databases and the grey literature were searched from inception until December 2020. Included studies evaluated pediatric respiratory-related healthcare visits or symptoms associated with wildfire smoke exposure. Prescribed burns, non-respiratory symptoms and non-pediatric studies were excluded. Risk of bias was evaluated using the National Toxicology Program’s Office of Health Assessment and Translation Risk of Bias Rating Tool. Data are presented narratively due to study heterogeneity. Of 2138 results, 1167 titles and abstracts were screened after duplicate removal; 65 full text screens identified 5 pre-post and 11 cross-sectional studies of rural, urban and mixed sites from the USA, Australia, Canada and Spain. There is a significant increase in respiratory emergency department visits and asthma hospitalizations within the first 3 days of exposure to wildfire smoke, particularly in children < 5 years old.

Towards guidelines for time-trend reviews examining temporal variability in human biomonitoring data of pollutants

In the last few decades, a plethora of studies have focused on human biomonitoring (HBM) of chemical pollutants. Reviewing the copious HBM data reported in these studies is essential for evaluating the effectiveness of pollution management efforts, for example by evaluating time-trends. Nevertheless, guidance to systematically evaluate time trends in published HBM data has never been developed. In this study, we therefore present a proposal for guidelines to conduct "time-trend reviews" (TTRs) that examine time trends in published large HBM datasets of chemical pollutant concentrations. We also demonstrate the applicability of these guidelines through a case study that assesses time-trends in global and regional HBM data on mercury. The recommended TTR guidelines in this study are divided into seven steps: formulating the objective of the TTR, setting up of eligibility criteria, defining search strategy and screening of literature, screening results of search, extracting data, analysing data, and assessing certainty, including the potential for bias in the evidence base. The TTR guidelines proposed in this study are straightforward and less complex than those for conducting systematic reviews assessing datasets on potential human health effects of exposure to pollutants or medical interventions. These proposed guidelines are intended to enable the credible, transparent, and reproducible conduct of TTRs.

Genotoxicity of radiofrequency electromagnetic fields: Protocol for a systematic review of in vitro studies

BACKGROUND

Exposure to radiofrequency electromagnetic fields (RF-EMF, 100 kHz - 300 GHz) emitted by wireless communication technologies is pervasive and ubiquitous. Concern has been raised about possible adverse effects to human health. In 2011 the International Agency for Research on Cancer has classified RF-EMF as possibly carcinogenic to humans, highlighting that the evidence is weak and far from conclusive. Updated systematic reviews of the scientific literature on this topic are lacking, especially for mechanistic studies.

OBJECTIVES

To develop a protocol for a systematic review of experimental studies investigating genotoxic effects induced by RF-EMF in in vitro cellular models. Genotoxicity is one of the key-biological indicators of carcinogenicity, and the most common characteristics of established carcinogens. The predefined procedures for conducting the systematic review are outlined below.

METHODS

We will follow the guidelines developed by the National Toxicology Program-Office of Health Assessment and Translation (NTP-OHAT), adapted to the evaluation of in vitro studies.

ELIGIBILITY CRITERIA

We will include experimental in vitro studies addressing the relationship between controlled exposures to RF-EMF and genotoxicity in mammalian cells only. Eligibility for inclusion will be further restricted to peer reviewed articles reporting findings from primary studies.

INFORMATION SOURCES

We will search the scientific literature databases NCBI PubMed, Web of Science, and EMF-Portal. No filter on publication date will be applied. Only studies published in English will be considered. The reference lists of the included papers and available reviews will be screened for unidentified relevant papers. References will be managed through Endnote X9 software.

DATA EXTRACTION AND SYNTHESIS OF RESULTS

Data from included papers will be extracted according to predefined forms. Heterogeneity within the available evidence will determine the type of evidence synthesis that is appropriate. Findings will be summarized in tables, graphical displays and in a narrative synthesis of the available evidences. A meta-analysis will be carried out if subgroups of studies homogeneous in terms of exposure characteristics, endpoint, and cell types will be identified.

RISK OF BIAS

The internal validity of included studies will be assessed using the NTP-OHAT Risk of Bias Rating Tool for animal studies, adapted to in vitro studies. This stage of the process will be managed through the Health Assessment Workspace Collaborative (HAWC).

EVIDENCE APPRAISAL

To rate confidence in the body of evidence, we will use the OHAT GRADE-based approach for animal studies.

FRAMEWORK AND FUNDING

This protocol concerns one of the evidence streams considered in a larger systematic review of the scientific literature on the potential carcinogenicity of RF-EMF, performed by scientists from several Italian public research agencies. The project is supported by the Italian Workers' Compensation Authority (INAIL) in the framework of the CRA with the Istituto Superiore di Sanità "BRiC 2018/06 - Scientific evidence on the carcinogenicity of radiofrequency electromagnetic fields".

Recommendations for the conduct of systematic reviews in toxicology and environmental health research (COSTER)

BACKGROUND

There are several standards that offer explicit guidance on good practice in systematic reviews (SRs) for the medical sciences; however, no similarly comprehensive set of recommendations has been published for SRs that focus on human health risks posed by exposure to environmental challenges, chemical or otherwise.

OBJECTIVES

To develop an expert, cross-sector consensus view on a key set of recommended practices for the planning and conduct of SRs in the environmental health sciences.

METHODS

A draft set of recommendations was derived from two existing standards for SRs in biomedicine and developed in a consensus process, which engaged international participation from government, industry, non-government organisations, and academia. The consensus process consisted of a workshop, follow-up webinars, email discussion and bilateral phone calls.

RESULTS

The Conduct of Systematic Reviews in Toxicology and Environmental Health Research (COSTER) recommendations cover 70 SR practices across eight performance domains. Detailed explanations for specific recommendations are made for those identified by the authors as either being novel to SR in general, specific to the environmental health SR context, or potentially controversial to environmental health SR stakeholders.

DISCUSSION

COSTER provides a set of recommendations that should facilitate the production of credible, high-value SRs of environmental health evidence, and advance discussion of a number of controversial aspects of conduct of EH SRs. Key recommendations include the management of conflicts of interest, handling of grey literature, and protocol registration and publication. A process for advancing from COSTER's recommendations to developing a formal standard for EH SRs is also indicated.

Association of working conditions including digital technology use and systemic inflammation among employees: study protocol for a systematic review

BACKGROUND

With the dynamic advancement of digitalization, working environments are changing and risk for employee stress may be increasing. Work stress has been associated with a dysregulation of inflammatory processes as a component of immune function. Systemic low-grade inflammation is discussed as a key player in the relation between stress exposure and chronic illness, such as cardiovascular diseases. The objective of this investigation will be to evaluate the association of working conditions including digital technology use and systemic inflammation among employees.

METHODS

We designed and registered a study protocol for a systematic review of randomized controlled trials and prospective non-randomized studies (e.g., cohort, interrupted time series, or before-after studies). We will include studies conducted among adult workers reporting associations of working conditions and inflammatory activity. The outcome will be biomarkers of systemic low-grade inflammation on cell, plasma molecule and intracellular level, such as C-reactive protein, or different types of leukocytes, cytokines, etc. Literature searches will be conducted in several electronic databases (from January 1982 onwards), including PubMed/MEDLINE, Embase, PsycINFO, Web of Science, and CENTRAL. Two reviewers will independently screen all retrieved records, full-text articles, and extract data. The study methodological quality (or bias) will be appraised using appropriate tools. Our results will be described qualitatively. Random effects meta-analysis will be conducted, if feasible and appropriate. Additional analyses will be performed to explore potential sources of heterogeneity.

DISCUSSION

This systematic review and meta-analysis will provide a synthesis of studies evaluating the association of working conditions and systemic inflammation. We anticipate our findings to identify knowledge gaps in the literature that future research should address. Moreover, results of our review may provide implications for corporate and public policy action for employee health promotion and prevention of occupational stress.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO ID: CRD42020166887.