Challenges in applying the GRADE approach in public health guidelines and systematic reviews: a concept article from the GRADE Public Health Group

Should my child be given antibiotics? A systematic review of parental decision making in rural and remote locations

BACKGROUND

The emergence and growth in antibiotic resistant bacteria is a critical public health problem exacerbated by the misuse of antibiotics. Children frequently succumb to illness and are often treated with antibiotic medicines which may be used improperly by the parent. There is limited evidence of the factors influencing parental decision-making about the use of antibiotics in low-resource contexts. The aim of this systematic review was to understand and describe how parents living in rural and remote locations make choices about their children's antibiotic use.

METHOD

The CINAHL, Web of Science, Medline, Scopus and Academic Search Premier databases were systematically searched from 31 January until 28 June in 2023. No date restrictions were applied and additional search methods were utilised to identify further studies that met inclusion criteria. Eligibility criteria included studies which reported on factors contributing to parental decisions about their children's use of antibiotics in rural and remote settings. The Joanna Briggs Institute Critical Appraisal Checklists were employed to evaluate studies. Characteristics and findings were extracted from studies, and data was synthesised descriptively and presented in summary tables.

RESULTS

A total of 3827 articles were screened and 25 worldwide studies comprising of quantitative, qualitative and prospective designs were included in the review. Studies that reported the number of rural caregivers consisted of 12 143 participants. Data analysis produced six broad themes representing the mechanisms that influenced parents in their access and use of antibiotics: the child's symptoms; external advice and influences; parent-related determinants; barriers to healthcare; access to antibiotics; and socio-demographic characteristics.

CONCLUSIONS

A number of factors that influence parents' prudent use of antibiotics in rural contexts were identified. In seeking to enhance appropriate use of antibiotics by parents in rural and remote settings, these determinants can serve to inform interventions. However, the identified studies all relied upon parental self-reports and not all studies reviewed reported survey validation. Further research incorporating validated measures and intervention strategies is required.

REGISTRATION DETAILS

Should my child be given antibiotics? A systematic review of parental decision making in rural and remote locations; CRD42023382169; 29 January 2023 (date of registration). Available from PROSPERO.

The effectiveness, cost-effectiveness and policy processes of regulatory, voluntary and partnership policies to improve food environments: an evidence synthesis

Background

Dietary factors are among the largest and costliest drivers of chronic diseases in England. As a response, the government implements a range of population interventions to promote healthy diets by targeting food environments.

Objectives

This study aimed to conduct a systematic review of the effectiveness, cost-effectiveness and policy process of real-world evaluations of national and state policies on improving food environments, with a focus on whether they were regulatory, voluntary or partnership approaches.

Data sources

Fourteen relevant English-language databases were searched in November 2020 for studies published between 2010 and 2020.

Methods

Six separate evidence reviews were conducted to assess the evidence of effectiveness, cost-effectiveness and policy processes of policies to improve food environments.

Results

A total of 483 primary research evaluations and 14 evidence syntheses were included. The study reveals considerable geographic, methodological and other imbalances across the literature, with, for example, 81% of publications focusing only on 12 countries. The systematic reviews also reveal the effectiveness and cost-effectiveness of reviewed regulatory approaches designed to improve health, consumer behaviour and food environment outcomes while public-private partnerships and voluntary approaches to improve diets via reformulation, advertising and promotion restrictions or other changes to the environment were limited in their effectiveness and cost-effectiveness. The study also revealed key enabling and impeding factors across regulatory, voluntary and public-private partnership approaches.

Conclusion

From the available evidence reviewed, this study finds that regulatory approaches appear most effective at improving the food environment, and voluntary agreements and partnerships have limited effectiveness. These findings should be carefully considered in future public health policy development, as should the findings of geographic imbalance in the evidence and inadequate representation of equity dimensions across the policy evaluations. We find that food policies are at times driven by factors other than the evidence and shaped by compromise and pragmatism. Food policy should be first and foremost designed and driven by the evidence of greatest effectiveness to improve food environments for healthier diets.

Limitations

This was a complex evidence synthesis due to its scope and some policy evaluations may have been missed as the literature searches did not include specific policy names. The literature was limited to studies published in English from 2010 to 2020, potentially missing studies of interest.

Future work

Priorities include the need for guidance for appraising risk of bias and quality of non-clinical studies, for reporting policy characteristics in evaluations, for supporting evaluations of real-world policies equitably across geographic regions, for capturing equity dimensions in policy evaluations, and for guideline development for quality and risk of bias of policy evaluations.

Study registration

This study is registered as PROSPERO CRD42020170963.

Funding

This award project was funded by the National Institute for Health and Care Research (NIHR) Public Health Research programme (NIHR award ref: NIHR128607) and is published in full in Public Health Research; Vol. 12, No. 8. See the NIHR Funding and Awards website for further award information.

The challenges and benefits of public health in smart cities from a 4 M perspective

Introduction

With the acceleration of urbanization, public health issues have become increasingly prominent in smart city construction, especially in the face of sudden public health crises. A deep research method for public health management based on a 4M perspective (human, machine, materials, methods) is proposed to effectively address these challenges. Methods: The method involves studying the impact of human factors such as population age, gender, and occupation on public health from a human perspective. It incorporates a machine perspective by constructing a public health prediction model using deep neural networks. Additionally, it analyzes resource allocation and process optimization in public health management from the materials and methods perspectives.

Results

The experiments demonstrate that the public health prediction model based on deep neural networks achieved a prediction accuracy of 98.6% and a recall rate of 97.5% on the test dataset. In terms of resource allocation and process optimization, reasonable adjustments and optimizations increased the coverage of public health services by 20% and decreased the response time to public health events by 30%.

Discussion

This research method has significant benefits for addressing the challenges of public health in smart cities. It can improve the efficiency and effectiveness of public health services, helping smart cities respond more quickly and accurately to potential large-scale public health events in the future. This approach holds important theoretical and practical significance.

Systems for rating bodies of evidence used in systematic reviews of air pollution exposure and reproductive and children's health: a methodological survey

BACKGROUND

Translating findings from systematic reviews assessing associations between environmental exposures and reproductive and children's health into policy recommendations requires valid and transparent evidence grading.

METHODS

We aimed to evaluate systems for grading bodies of evidence used in systematic reviews of environmental exposures and reproductive/ children's health outcomes, by conducting a methodological survey of air pollution research, comprising a comprehensive search for and assessment of all relevant systematic reviews. To evaluate the frameworks used for rating the internal validity of primary studies and for grading bodies of evidence (multiple studies), we considered whether and how specific criteria or domains were operationalized to address reproductive/children's environmental health, e.g., whether the timing of exposure assessment was evaluated with regard to vulnerable developmental stages.

RESULTS

Eighteen out of 177 (9.8%) systematic reviews used formal systems for rating the body of evidence; 15 distinct internal validity assessment tools for primary studies, and nine different grading systems for bodies of evidence were used, with multiple modifications applied to the cited approaches. The Newcastle Ottawa Scale (NOS) and the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) framework, neither developed specifically for this field, were the most commonly used approaches for rating individual studies and bodies of evidence, respectively. Overall, the identified approaches were highly heterogeneous in both their comprehensiveness and their applicability to reproductive/children's environmental health research.

CONCLUSION

Establishing the wider use of more appropriate evidence grading methods is instrumental both for strengthening systematic review methodologies, and for the effective development and implementation of environmental public health policies, particularly for protecting pregnant persons and children.

Causal Assessment of Income Inequality on Self-Rated Health and All-Cause Mortality: A Systematic Review and Meta-Analysis

Policy Points Income is thought to impact a broad range of health outcomes. However, whether income inequality (how unequal the distribution of income is in a population) has an additional impact on health is extensively debated. Studies that use multilevel data, which have recently increased in popularity, are necessary to separate the contextual effects of income inequality on health from the effects of individual income on health. Our systematic review found only small associations between income inequality and poor self-rated health and all-cause mortality. The available evidence does not suggest causality, although it remains methodologically flawed and limited, with very few studies using natural experimental approaches or examining income inequality at the national level.

CONTEXT

Whether income inequality has a direct effect on health or is only associated because of the effect of individual income has long been debated. We aimed to understand the association between income inequality and self-rated health (SRH) and all-cause mortality (mortality) and assess if these relationships are likely to be causal.

METHODS

We searched Medline, ISI Web of Science, Embase, and EconLit (PROSPERO: CRD42021252791) for studies considering income inequality and SRH or mortality using multilevel data and adjusting for individual-level socioeconomic position. We calculated pooled odds ratios (ORs) for poor SRH and relative risk ratios (RRs) for mortality from random-effects meta-analyses. We critically appraised included studies using the Risk of Bias in Nonrandomized Studies - of Interventions tool. We assessed certainty of evidence using the Grading of Recommendations Assessment, Development and Evaluation framework and causality using Bradford Hill (BH) viewpoints.

FINDINGS

The primary meta-analyses included 2,916,576 participants in 38 cross-sectional studies assessing SRH and 10,727,470 participants in 14 cohort studies of mortality. Per 0.05-unit increase in the Gini coefficient, a measure of income inequality, the ORs and RRs (95% confidence intervals) for SRH and mortality were 1.06 (1.03-1.08) and 1.02 (1.00-1.04), respectively. A total of 63.2% of SRH and 50.0% of mortality studies were at serious risk of bias (RoB), resulting in very low and low certainty ratings, respectively. For SRH and mortality, we did not identify relevant evidence to assess the specificity or, for SRH only, the experiment BH viewpoints; evidence for strength of association and dose-response gradient was inconclusive because of the high RoB; we found evidence in support of temporality and plausibility.

CONCLUSIONS

Increased income inequality is only marginally associated with SRH and mortality, but the current evidence base is too methodologically limited to support a causal relationship. To address the gaps we identified, future research should focus on income inequality measured at the national level and addressing confounding with natural experiment approaches.

The Relationship Between Physical Housing Characteristics, Housing Accessibility and Different Aspects of Health Among Community-Dwelling Older People: A Systematic Review

Objectives: To synthesize the evidence on the relationships between physical housing characteristics or housing accessibility and different aspects of health among community-dwelling people 60 years and older. Methods: A systematic review of recent evidence with a narrative synthesis was conducted. Results: We included 15 studies and found three themes covering physical housing characteristics or housing accessibility that are associated with aspects of health among community-dwelling older adults: (1) interventions by home modifications targeting housing features both at entrances and indoors; (2) non-interventions targeting indoor features; (3) non-interventions targeting entrance features, that is, the presence of an elevator or stairs at the entrance. The overall quality of evidence across studies was assessed as very low. Discussion: The findings highlight the need for studies with a stronger research design and higher methodological quality that address the physical housing environment in relation to health among older adults to strengthen the body of evidence.

How the COVID-19 pandemic and related school closures reduce physical activity among children and adolescents in the WHO European Region: a systematic review and meta-analysis

BACKGROUND

Emerging research suggests that physical activity among children and adolescents decreased during the COVID-19 pandemic. However, a differentiated overview of European youth is lacking. In particular, no systematic analysis has been conducted to date on the impact of heterogeneous pandemic restrictions and school closures within European countries, and with regard to potentially vulnerable groups.

METHODS

We searched seven databases and included studies for children and adolescents (≤ 19 years) of the WHO European Region that compared physical activity during the COVID-19 pandemic with a pre-pandemic baseline using validated measurement instruments. We used the Oxford Stringency Index and School Closure Index as indicators of restriction stringency. Screening for eligibility, data extraction, assessment of the study risk of bias (using the 'Risk of Bias in Non-randomized Studies - of Exposure' [ROBINS-E]) and certainty grading of evidence (using the GRADE approach), were all done in duplicate. Unpublished data was requested from study authors. Data were pooled in random effects models. An a priori protocol was published, reporting is carried out in accordance with the 'Preferred Reporting Items for Systematic Review and Meta-Analyses' (PRISMA) statement.

RESULTS

Of 14,897 non-duplicate records, 26 publications (n = 15,038 pre-pandemic, n = 13,041 during pandemic) met full inclusion criteria. Comparison before and during the COVID-19 pandemic revealed a significant reduction in total physical activity (standardized mean difference [SMD], -0.57 [95%CI, -0.95; -0.20]) and moderate-to-vigorous physical activity (SMD, -0.43 [95% CI, -0.75; -0.10]), corresponding to a decrease of 12 min per day (a 20% reduction of the WHO recommendation). A decrease in sporting activity was also recorded. Subgroup analyses suggested that middle childhood (aged 8-12) and adolescents were particularly affected by the decline. School closures were associated with a reduction in physical activity. The certainty of evidence for all outcomes was low.

CONCLUSIONS

A sharp decline in all forms of physical activity was recorded among European children and adolescents during the COVID-19 pandemic. This decline was higher during periods of school closure and mainly affected younger schoolchildren and adolescents. Immediate action by policy-makers and practitioners, as well as evidence-based public health strategies, are imperative in reversing this trend.

TRIAL REGISTRATION

PROSPERO: CRD42023395871.

The longitudinal effects of the built environment on transportation and recreational walking, and differences by age and sex: systematic review protocol

BACKGROUND

In high-income countries, the prevalence of physical inactivity and non-communicable diseases is high, and it is now well-established that insufficient physical activity is a risk factor for non-communicable diseases. Walking for recreation and transportation are effective means of improving population levels of physical activity. Research finds that the built environment (BE) can encourage or discourage walking behaviour, and this association varies for different age groups and sexes. This systematic review aims to synthesise longitudinal evidence to better understand how the BE affects recreational and transportation walking for different age groups (above 64 years and 18-64 years) and sexes in high-income countries.

METHOD

We will use Scopus, PubMed, SPORTDiscus with Full Text (EBSCO), Business Source Complete (EBSCO), Art and Architecture Archive (Proquest), Avery Index to Architectural Periodicals (ProQuest), and Art, Design & Architecture Collection (ProQuest) databases to search for relevant studies. Reviewers will screen the search results according to pre-specified eligibility criteria for study inclusion in the review. Required data for the synthesis will be extracted from the included studies to answer the research questions. Further, the methodological quality of the studies included in this systematic review will be evaluated using an established instrument, and the resulting quality scores will be utilized in sensitivity analysis. The Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) checklist will be followed when reporting the findings.

DISCUSSION

This review will identify BE attributes that are likely to influence transportation and recreational walking for younger and older adults and different sexes in high-income countries. The findings will help policymakers with making decisions around walkable built environments for older and younger adults and different sexes to keep them healthy.

TRIAL REGISTRATION

This protocol of the prospective systematic review is developed following PRISMA-P guidelines and is registered on the Prospective Register of Systematic Reviews (PROSPERO) (registration ID CRD42022351919).

Efficacy and safety of traditional Chinese medicine adjuvant therapy for severe pneumonia: evidence mapping of the randomized controlled trials, systematic reviews, and meta-analyses

Background and Objective: Severe pneumonia is a critical respiratory disease with high mortality. There is insufficient evidence on the efficacy and safety of traditional Chinese medicine (TCM) adjuvant therapy for severe pneumonia. This study aims to identify, describe, assess, and summarize the currently available high-quality design evidence on TCM adjuvant therapy for severe pneumonia to identify evidence gaps using the evidence mapping approach. Methods: Systematic searches were performed on English and Chinese online databases (PubMed, EMBASE, Cochrane Library, Web of Science, CNKI, WanFang Data, CQVIP, and SinoMed) to identify papers from inception until August 2023 for inclusion into the review. Randomized controlled trials (RCTs), systematic reviews (SRs), and meta-analyses concerning TCM adjuvant therapy for severe pneumonia or its complications in adults were included. The risk of bias in RCTs was evaluated by using the Cochrane Handbook ROB tool. The Assessment of Multiple Systematic Reviews 2 (AMSTAR-2), the Risk of Bias in Systematic Review (ROBIS) tool, and the Grading of Recommendations Assessment, Development and Evaluation (GRADE) system were used to assess the methodological quality, risk of bias, and evidence quality of SRs or meta-analyses, respectively. Then, a bubble plot was designed to visually display information in four dimensions. Results: A total of 354 RCTs and 17 SRs or meta-analyses met the inclusion criteria. The published RCTs had several flaws, such as unreasonable design, limited sample size, insufficient attention to non-drug therapy studies and syndrome differentiation, improper selection or use of outcome indicators, and failure to provide high-quality evidence. Sixteen SRs or meta-analyses of methodological quality scored "Critically Low" confidence. Twelve SRs or meta-analyses were rated as "High Risk." Most outcomes were rated as "Low" evidence quality. We found that TCM combined with conventional treatment could improve the clinical total effective rate and the TCM syndromes efficacy. The combined approach could also shorten mechanical ventilation time, infection control time, and length of hospital and ICU stay; significantly reduce temperature, respiratory rate, heart rate, white blood cell counts, levels of C-reactive protein, procalcitonin, blood inflammatory factors, bacteriological response, and D-dimer; decrease CPIS, APACHE II score, and PSI score; improve pulmonary imaging features, arterial blood gas indicators (including arterial oxygen pressure, arterial oxygen saturation, and oxygen index), and lung function (including forced vital capacity and forced expiratory volume in the first second) for severe pneumonia compared with conventional treatment only (p < 0.05). There was no significant difference in adverse reactions and incidence of adverse events (p > 0.05). In addition, compared with conventional treatment only, most SRs or meta-analyses concluded that TCM combined with conventional treatment was "Beneficial" or "Probably beneficial." Conclusion: TCM combined with conventional treatment had advantages in efficacy, clinical signs, laboratory results, and life quality outcomes of severe pneumonia, with no difference in safety outcomes compared with conventional treatment only. QingJin Huatan decoction is the most promising target, and Xuanbai Chengqi decoction has a "Probably beneficial" conclusion. XueBiJing injection and TanReQing injection are two commonly used Chinese herbal injections for treating severe pneumonia, and both are "Probably beneficial." However, there was a need for multicenter RCTs with large sample sizes and high methodological quality in the future. In addition, the methodological design and quality of SRs or meta-analyses should be improved to form high-quality, evidence-based medical evidence and provide evidence for the effectiveness and safety of TCM adjuvant therapy for severe pneumonia.

Overall, plant-based, or animal-based low carbohydrate diets and all-cause and cause-specific mortality: A systematic review and dose-response meta-analysis of prospective cohort studies

INTRODUCTION

In this study, we sought to summarize the associations between overall, plant-, and animal-based low carbohydrate diet (LCD) scores and the risk of all-cause, cardiovascular disease (CVD), and cancer mortality from prospective cohort studies.

METHODS

We searched PubMed, Scopus, and Web of Science up to January 2022. We included prospective cohort studies that investigated the relationship between LCD-score and risk of overall, CVD, or cancer mortality. Two investigators assessed the studies for eligibility and extracted the data. Summary hazard ratios (HRs) and 95% confidence intervals (CIs) were estimated using a random-effects model.

RESULTS

Ten studies, with 421022 participants, were included in the analysis. In the high-versus-low meta-analysis, overall (HR:1.05,95%CI:0.97, 1.13, I2 =72.0%) and animal-based LCD-scores (HR: 1.08, 95% CI: 0.97-1.21; I2 = 88.0%) were not associated with all-cause mortality, but plant-based LCD-score was associated with a risk reduction (HR:0.87, 95%CI:0.78,0.97; I2 = 88.4%). CVD mortality was not associated with overall, plant-, or animal-based LCD-scores. Overall (HR:1.14, 95%CI:1.05,1.24; I2 = 37.4%) and animal-based LCD scores (HR:1.16,95%CI:1.02,1.31; I2 = 73.7%) were associated with a higher risk of cancer mortality, while plant-based LCD-score was not. A U-shaped relationship was revealed between overall LCD-score and all-cause and CVD mortality. The shape of relationship between LCD and cancer mortality was a linear dose-response.

CONCLUSION

In conclusion, diets with a moderate carbohydrate content were associated with the lowest risk of all-cause and CVD mortality. If the sources of macronutrients that replaced carbohydrates were plant-based, the risk of all-cause mortality was reduced linearly with lower carbohydrate content. The risk of cancer mortality increased linearly with the increase in carbohydrate content. Considering the low certainty of evidence, more robust prospective cohort studies are suggested.

Guidance on take-home naloxone distribution and use by community overdose responders in Canada

BACKGROUND

The increasing toxicity of opioids in the unregulated drug market has led to escalating numbers of overdoses in Canada and worldwide; takehome naloxone (THN) is an evidence-based intervention that distributes kits containing naloxone to people in the community who may witness an overdose. The purpose of this guidance is to provide policy recommendations for territorial, provincial and federal THN programs, using evidence from scientific and grey literature and community evidence that reflects 11 years of THN distribution in Canada.

METHODS

The Naloxone Guidance Development Group - a multidisciplinary team including people with lived and living experience and expertise of drug use - used the Appraisal of Guidelines for Research & Evaluation (AGREE II) instrument to inform development of this guidance. We considered published evidence identified through systematic reviews of all literature types, along with community evidence and expertise, to generate recommendations between December 2021 and September 2022. We solicited feedback on preliminary recommendations through an External Review Committee and a public input process. The project was funded by the Canadian Institutes of Health Research through the Canadian Research Initiative in Substance Misuse. We used the Guideline International Network principles for managing competing interests.

RECOMMENDATIONS

Existing evidence from the literature on THN was of low quality. We incorporated evidence from scientific and grey literature, and community expertise to develop our recommendations. These were in 3 areas: routes of naloxone administration, THN kit contents and overdose response. Take-home naloxone programs should offer the choice of both intramuscular and intranasal formulations of naloxone in THN kits. Recommended kit contents include naloxone, a naloxone delivery device, personal protective equipment, instructions and a carrying case. Trained community overdose responders should prioritize rescue breathing in the case of respiratory depression, and conventional cardiopulmonary resuscitation in the case of cardiac arrest, among other interventions.

INTERPRETATION

This guidance development project provides direction for THN programs in Canada in the context of limited published evidence, with recommendations developed in collaboration with diverse stakeholders.

Online pain management programs for chronic, widespread musculoskeletal conditions: A systematic review with meta-analysis

Face-to-face pain management programs demonstrate positive clinical outcomes in the chronic pain population by improving pain intensity and attitudes, depression, and functional disability scores. The effects of this modality carried out online is less known, particularly in subgroups of chronic pain. This systematic review assessed the effects of online pain management programs in chronic, widespread musculoskeletal conditions on pain measurements (intensity, interference, coping, and catastrophizing), health-related quality of life, depression, and anxiety scores immediately post-intervention. Five electronic databases (Embase, Medline, CINAHL, Scopus, and PEDro) were searched with 3546 studies identified. Eighteen randomized controlled trials fulfilled the inclusion criteria. Included studies had moderate methodological quality (using the Effective Public Health Practice Project (EPHPP) quality assessment tool) but high risk of bias (using the revised Cochrane risk-of-bias tool for randomized trials (RoB 2)). There were significant improvements in pain intensity (11 studies, 1397 participants, SMD -0.30, 95% CI -0.50 to -0.10, p = 0.004), health-related quality of life (eight studies, 1054 participants, SMD 0.41, 95% CI 0.08 to 0.75, p = 0.02), and depression (nine studies, 1283 participants, SMD -0.32, 95% CI -0.55 to -0.08, p = 0.008). However, effect sizes were small and did not meet their respective measure's minimal clinically important change score. Guided interventions (regular interaction with an instructor) appeared to be superior to self-completed interventions. Future research should standardize outcome measures for assessing pain, use active control groups, and analyze other outcome measures such as cost and long-term effects. This study was registered with Prospero on August 15, 2021 (CRD42021267565).

Anxiety among children and adolescents during the COVID-19 pandemic in Europe: a systematic review protocol

BACKGROUND

A growing number of studies point to a high mental health burden among children and adolescents during the COVID-19 pandemic, particularly concerning anxiety. However, the study quality and effect direction are heterogeneous in the existing primary studies with a lacking overview for the European continent. Therefore, this systematic review aims to critically synthesise the evidence regarding the impact of the COVID-19 pandemic on anxiety among children and adolescents in Europe compared to a pre-pandemic baseline.

METHODS

A systematic literature search will be performed in six databases (MEDLINE, EMBASE, PsycINFO, Cochrane Central Register of Controlled Trials, Web of Science, and WHO COVID-19 database) with a peer reviewed search strategy according to the evidence-based checklist Peer Review of Electronic Search Strategies (PRESS). Inclusion criteria are children and adolescents ≤ 19 years living in Europe and data report during the COVID-19 pandemic with an appropriate pre-pandemic baseline. Primary outcomes are general anxiety symptoms and clinically relevant anxiety rates. Risk of bias will be assessed using the 'Risk of Bias in Non-randomised Studies of Exposure' (ROBINS-E). Data extraction will systematically include information on study design, population characteristics, COVID-19 determinants, pre-pandemic baseline, diagnostic instruments and outcome. The certainty of evidence for each outcome will be evaluated by using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach adapted to the use of non-randomised studies. All process steps will be performed independently by two reviewers; any discrepancies will be discussed and, if necessary, resolved by a third author. Also, subgroup analysis, sensitivity analysis, publication bias analysis, and meta-regression analysis, if applicable, will be performed. The systematic review was registered in the Prospective Register of Systematic Reviews (PROSPERO) and the protocol was prepared in accordance to the Preferred Reporting Items for Systematic review and Meta-Analysis Protocols (PRISMA-P) statement.

DISCUSSION

This systematic review will address the lack of a critical and comprehensive summary of findings on the COVID-19 pandemic impact on anxiety among children and adolescents in Europe. In addition, it aims to identify pandemic-policy differences, such as the effect of school-closures, and identify particularly vulnerable risk groups.

SYSTEMATIC REVIEW REGISTRATION

CRD42022303714 (PROSPERO).

Characteristics of the sources, evaluation, and grading of the certainty of evidence in systematic reviews in public health: A methodological study

Objectives

To systematically explore how the sources of evidence, types of primary studies, and tools used to assess the quality of the primary studies vary across systematic reviews (SRs) in public health.

Methods

We conducted a methodological survey of SRs in public health by searching the of literature in selected journals from electronic bibliographic databases. We selected a 10% random sample of the SRs that met the explicit inclusion criteria. Two researchers independently extracted data for analysis.

Results

We selected 301 SRs for analysis: 94 (31.2%) of these were pre-registered, and 211 (70.1%) declared to have followed published reporting standard. All SRs searched for evidence in electronic bibliographic databases, and more than half (n = 180, 60.0%) searched also the references of the included studies. The common types of primary studies included in the SRs were primarily cross-sectional studies (n = 132, 43.8%), cohort studies (n = 126, 41.9%), randomized controlled trials (RCTs, n = 89, 29.6%), quasi-experimental studies (n = 83, 27.6%), case-control studies (n = 58, 19.3%) qualitative studies (n = 38, 12.6%) and mixed-methods studies (n = 32, 10.6%). The most frequently used quality assessment tools were the Newcastle-Ottawa Scale (used for 50.0% of cohort studies and 55.6% of case-control studies), Cochrane Collaboration's Risk of Bias tool (50.7% of RCTs) and Critical Appraisal Skills Program (38.5% of qualitative studies). Only 20 (6.6%) of the SRs assessed the certainty of the body of evidence, of which 19 (95.0%) used the GRADE approach. More than 65% of the evidence in the SRs using GRADE was of low or very low certainty.

Conclusions

SRs should always assess the quality both at the individual study level and the body of evidence for outcomes, which will benefit patients, health care practitioners, and policymakers.

Epidemiological, methodological, and statistical characteristics of network meta-analysis in anaesthesia: a systematic review

BACKGROUND

Network meta-analyses (NMAs) combine direct and indirect estimates to provide mixed (or network) estimates of effect sizes. The scientific rigour of the conduct and reporting of anaesthesia NMAs is unknown. This review assessed the epidemiological, methodological, and statistical characteristics of anaesthesia NMAs.

METHODS

We searched four databases for anaesthesia NMAs and developed a 64-item checklist to evaluate NMAs. For 29 binary items, we defined compliance as 'the ratio of NMAs that was awarded a 'yes' for that item, divided by the total number of NMAs. The compliance of such binary items was reclassified as very low (≤25%), low (26-50%), fair (51-75%), and high (>75%). We amalgamated findings from 29 key items to provide specific recommendations (post hoc). We compared the compliance of NMAs in anaesthesia across 26 items, with that of cancer NMAs and Cochrane NMAs, and analysed improvement over time (post hoc).

RESULTS

Among 62 included NMAs, compliance was low (26-50%) for protocol registration, use of PRISMA-NMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses for NMA), publication bias assessment, evidence appraisal, reporting of Bayesian methodology and consistency evaluation. Compliance was very low (≤25%) for bias assessment, biostatistician involvement, search specialist, and use of predefined important differences.

CONCLUSIONS

Anaesthesia NMAs need improvement in their conduct and reporting. Anaesthesia journals should mandate the registration of protocols and reporting of NMAs using PRISMA-NMA. Authors should carefully assess publication bias, and use updated bias assessment tools, and evidence appraisal methods designed for NMAs.

SYSTEMATIC REVIEW PROTOCOL

PROSPERO CRD42021227608.

Strengthening implementation guidelines for HIV service delivery: Considerations for future evidence generation and synthesis

Ingrid Eshun-Wilson and colleagues summarize gaps in primary HIV implementation research methods and reporting, and propose areas for future methodological development.

Medicines for Obesity: Appraisal of Clinical Studies with Grading of Recommendations, Assessment, Development, and Evaluation Tool

We evaluated the quality of evidence from phase III/IV clinical trials of drugs against obesity using the principles of Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) tool. Our systematic review evaluates the quality of clinical evidence from existing clinical trials and not the pharmacological efficacy of anti-obesity therapies. A literature search using select keywords in separate was performed in PubMed and ClinicalTrials.gov databases for phase III/IV clinical trials during the last ten years. Our findings indicate that the quality of existing clinical evidence from anti-obesity trials generally ranges from low to moderate. Most trials suffered from publication bias. Less frequently, trials suffered from the risk of bias mainly due to lack of blindness in the treatment. Our work indicates that additional higher-quality clinical trials are needed to gain more confidence in the estimate of the effect of currently used anti-obesity medicines, to allow more informed clinical decisions, thus reducing the risk of implementing potentially ineffective or even harmful therapeutic strategies.

Evidence for objects of implementation in healthcare: considerations for Implementation Science and Implementation Science Communications

The journals Implementation Science and Implementation Science Communications are focused on the implementation of evidence into healthcare practice and policy. This editorial offers reflections on how we handle this as editors. Studies that focus on the simultaneous implementation of implementation objects and (technological or other) structures to enable their implementation are considered on a case-by-case basis regarding their contribution to implementation science. Studies on implementation objects with limited, mixed, or of out-of-context evidence are considered if the evidence for key components of the object of interest is sufficiently robust. We follow GRADE principles in our assessment of the certainty of research findings for health-related interventions in individuals. Adapted thresholds apply to evidence for population health interventions, organizational changes, health reforms, health policy innovations, and medical devices. The added value of a study to the field of implementation science remains of central interest for our journals.

[Evidence syntheses in public health: An overview]

BACKGROUND

Since the beginning of the COVID-19 pandemic, there has been a high demand for rapid evidence syntheses to answer urgent public health questions. This article provides an overview of different types of reviews for public health questions and a synthesis of existing recommendations for the preparation of reviews. The aim is to support the planning of one's own review and the critical evaluation of published reviews.

METHODS

The basis of this summary is an extensive search for guidelines and recommendations for different review types. Furthermore, internal journal clubs were held to determine knowledge needs and to critically discuss the various review types. Relating to the dissemination of results, fact sheets were developed for the individual review types including the most important information, prerequisites and work steps, as well as a decision tree for identifying the appropriate review type for the respective question.

RESULTS

Of the review types identified, Systematic, Rapid, Scoping, Umbrella, and Narrative Reviews were considered in more detail because they are particularly relevant to public health issues. Together with scoping and umbrella reviews, systematic reviews have the highest resource requirements due to the demands for extensive, systematic evidence synthesis and reproducibility. Rapid methods can accelerate the review process, for example by a very narrowly formulated question, a limited literature search, or the execution of certain steps by one instead of two persons.

DISCUSSION

Systematic Reviews may be considered as the gold standard, but they were developed primarily for clinical questions relating to interventions. This article, however, focusses on review types that consider the diversity of questions as well as the predominant use of quantitative methods in the field of public health. The fact sheets developed and the decision tree should enable low-threshold access to reviews while linking the perspectives of research and resource planning. They complement existing guidelines and recommendations.

CONCLUSION

To answer the diverse spectrum of public health questions, various types of reviews with various requirements and approaches are available. Given this diversity, a systematic introduction can be helpful for researchers planning or assessing a review.

Suicide among transport industry workers: A systematic review and meta-analysis

OBJECTIVES

Working in high-stress and male-dominated occupations is associated with an elevated risk of suicide. The current study sought to conduct the first systematic literature review and meta-analysis aimed at determining suicide risk across the diverse, high pressure and male-dominated transport industry (commercial aviation, merchant seafaring, transit/driving) as compared to the general/employed population.

METHODS

Searches of PubMed/Medline, Scopus and PsycINFO databases were conducted without date restriction until March 2021. Studies were included if they were written in English, were peer reviewed, and presented primary observational research data. Studies referring exclusively to suicidal ideation, suicide attempts, self-harm, and/or accidents were excluded.

RESULTS

Following deletion of duplicates and non-English titles, a total of 4201 titles/abstracts were screened and 92 full-texts were read against inclusion/exclusion criteria. The final included sample consisted of 23 articles (16 used for meta-analysis). Results from the meta-analysis indicated that transport workers had a significantly elevated risk for suicide as compared to the general/employed population. Results were consistent across sensitivity analyses, and there was some variation across subgroup analyses.

CONCLUSIONS

Overall, we found transport workers had a significantly higher risk for suicide than the general/employed population, and this appeared to be driven by the association for those working in merchant seafaring/maritime occupations. The findings are discussed in relation to an identified need for the development, implementation, and evaluation of tailored workplace suicide prevention strategies for transport industry workers.

Prevalence and Severity of Lower Gastrointestinal Symptoms amongst Non-Dialysis Chronic Kidney Disease Patients: A Systematic Review and Meta-Analysis

Chronic kidney disease (CKD) patients experience a wide range of symptoms that deteriorate their health-related quality of life (HRQoL). We aimed to estimate the prevalence and severity of lower gastrointestinal (GI) symptoms in non-dialysis CKD adult outpatients, and to summarize the relationships between these symptoms and HRQoL, laboratory test results, and clinical data. The protocol of the study was preregistered (PROSPERO CRD42021255122). We searched MEDLINE, Scopus, Web of Science, and grey literature sources from the databases' inception up until 27 November 2021. Wide citation chasing was conducted. Single proportions (prevalence of functional constipation, self-reported constipation, diarrhea, abdominal bloating, fecal incontinence, and abdominal/rectal pain) were pooled using generalized linear mixed models. A total of 37 studies with 12,074 patients were included. We found that lower GI symptoms, especially self-reported abdominal bloating [CKD G1-2: 48.45% (95% CI: 43.5-53.4%; 2 studies); G3: 46.95% (95% CI: 45.0-48.9%; 2 studies), G4-5: 36.1% (95% CI: 25.4-48.5%; 8 studies)] and constipation [CKD G1-2: 31.8% (95% CI: 13.9-54.9%); G3: 29.8% (95% CI: 21.2-40.1%; 4 studies); G4-5: 38.8% (95% CI: 30.9-47.4%); 22 studies)], were common in non-dialysis CKD patients. The severity of the symptoms was limited. Self-reported constipation was most consistently associated with worse HRQoL, whereas hard stool consistency was associated with higher uremic toxins levels. To conclude, since lower GI symptoms are common in CKD, using symptom questionnaires that do not take them into account cannot provide full insight into the patient's experience. Further studies are needed to cover identified knowledge gaps, including the exploration of the pathophysiology of GI symptoms in CKD with multi-omics data.

Guideline development in harm reduction: Considerations around the meaningful involvement of people who access services

Background

Harm reduction seeks to minimizes the negative effects of drug use while respecting the rights of people with lived and living experience of substance use (PWLLE). Guideline standards ("guidelines for guidelines") provide direction on developing healthcare guidelines. To identify essential considerations for guideline development within harm reduction, we examined whether guideline standards are consistent with a harm reduction approach in their recommendations on involving people who access services.

Methods

We searched the literature from 2011-2021 to identify guideline standards used in harm reduction and publications on involving PWLLE in developing harm reduction services. We used thematic analysis to compare their guidance on involving people who access services. Findings were validated with two organizations of PWLLE.

Results

Six guideline standards and 18 publications met inclusion criteria. We identified three themes related to involving people who access services: Reasons for Involvement, Methods of Involvement, and Factors in Success. Subthemes varied across the literature. We identified five essential considerations for guideline development in harm reduction: establishing a shared understanding of reasons for involving PWLLE; respecting their expertise; partnering with PWLLE to ensure appropriate engagement; incorporating perspectives of populations disproportionately affected by substance use; and securing resources.

Conclusion

Guideline standards and the harm reduction literature approach the involvement of people who access services from different perspectives. Thoughtful integration of the two paradigms can improve guidelines while empowering PWLLE. Our findings can support the development of high-quality guidelines that align with the fundamental principles of harm reduction in their involvement of PWLLE.

Nature-Based Early Childhood Education and Children's Physical Activity, Sedentary Behavior, Motor Competence, and Other Physical Health Outcomes: A Mixed-Methods Systematic Review

BACKGROUND

The purpose was to synthesize evidence on the association between nature-based Early Childhood Education (ECE) and children's physical activity (PA) and motor competence (MC).

METHODS

A literature search of 9 databases was concluded in August 2020. Studies were eligible if (1) children were aged 2-7 years old and attending ECE, (2) ECE settings integrated nature, and (3) assessed physical outcomes. Two reviewers independently screened full-text articles and assessed study quality. Synthesis was conducted using effect direction (quantitative), thematic analysis (qualitative), and combined using a results-based convergent synthesis.

RESULTS

1370 full-text articles were screened and 39 (31 quantitative and 8 qualitative) studies were eligible; 20 quantitative studies assessed PA and 6 assessed MC. Findings indicated inconsistent associations between nature-based ECE and increased moderate to vigorous PA, and improved speed/agility and object control skills. There were positive associations between nature-based ECE and reduced sedentary time and improved balance. From the qualitative analysis, nature-based ECE affords higher intensity PA and risky play, which could improve some MC domains. The quality of 28/31 studies was weak.

CONCLUSIONS

More controlled experimental designs that describe the dose and quality of nature are needed to better inform the effectiveness of nature-based ECE on PA and MC.

Nature-Based Early Childhood Education and Children's Social, Emotional and Cognitive Development: A Mixed-Methods Systematic Review

This systematic review synthesised evidence on associations between nature-based early childhood education (ECE) and children's social, emotional, and cognitive development. A search of nine databases was concluded in August 2020. Studies were eligible if: (a) children (2-7 years) attended ECE, (b) ECE integrated nature, and (c) assessed child-level outcomes. Two reviewers independently screened full-text articles and assessed study quality. Synthesis included effect direction, thematic analysis, and results-based convergent synthesis. One thousand three hundred and seventy full-text articles were screened, and 36 (26 quantitative; 9 qualitative; 1 mixed-methods) studies were eligible. Quantitative outcomes were cognitive (n = 11), social and emotional (n = 13), nature connectedness (n = 9), and play (n = 10). Studies included controlled (n = 6)/uncontrolled (n = 6) before-after, and cross-sectional (n = 15) designs. Based on very low certainty of the evidence, there were positive associations between nature-based ECE and self-regulation, social skills, social and emotional development, nature relatedness, awareness of nature, and play interaction. Inconsistent associations were found for attention, attachment, initiative, environmentally responsible behaviour, and play disruption/disconnection. Qualitative studies (n = 10) noted that nature-based ECE afforded opportunities for play, socialising, and creativity. Nature-based ECE may improve some childhood development outcomes, however, high-quality experimental designs describing the dose and quality of nature are needed to explore the hypothesised pathways connecting nature-based ECE to childhood development (Systematic Review Registration: CRD42019152582).

How can WHO transform its approach to social determinants of health?

WHO has a pivotal role in reducing health inequities but faces five fundamental constraints to progress, argue Unni Gopinathan and Kent Buse

Addressing Challenges When Applying GRADE to Public Health Guidelines: A Scoping Review Protocol and Pilot Analysis

This is a protocol for a scoping review that aims to determine how guideline authors using the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach have addressed previously identified challenges related to public health. The Joanna Briggs Institute (JBI) methodology for scoping reviews will be followed. We will search and screen titles of guidelines for all languages published in 2013–2021 in: the GIN library, BIGG database, Epistemonikos GRADE guidelines repository, GRADEpro Database, MAGICapp, NICE and WHO websites. Two reviewers will independently screen full texts of the documents identified. The following information will be extracted: methods used for identifying different stakeholders and incorporating their perspectives; methods for identification and prioritization of non-health outcomes; methods for determining thresholds for decision-making; methods for incorporating and grading evidence from non-randomized studies; methods for addressing concerns with conditional recommendations in public health; methods for reaching consensus; additional methodological concerns; and any modifications made to GRADE. A combination of directed content analysis and descriptive statistics will be used for data analysis, and the findings presented narratively in a tabular and graphical form. In this protocol, we present the pilot results from 13 identified eligible guidelines issued between January and August 2021. We will publish the full review results when they become available.

Saffron (Crocus sativus L.) and health outcomes: a meta-research review of meta-analyses and an evidence mapping study

BACKGROUND

Although a number of systematic reviews and meta-analyses of saffron (Crocus sativus L.) have been published, no study has comprehensively summarized the clinical evidence from meta-analyses, or assessed the reporting or methodological quality of these reviews.

PURPOSE

The present meta-research study was designed to fill the gaps in knowledge to inform future studies and allow enhanced clinical decision-making on saffron.

METHODS

The PubMed, Cochrane Library, Embase, and CNKI databases were systematically searched from inception to April 3 rd, 2021, for meta-analyses of clinical trials that assessed the efficacy and safety of saffron. PRISMA 2009 and AMSTAR-2 were employed to assess the reporting and methodological quality of meta-analyses identified in the search, respectively. The present study was registered on PROSPERO with registration number CRD42020220274.

RESULTS

Nineteen eligible systematic reviews with meta-analyses published in English were identified from 235 records. These meta-analyses were published in 12 peer-reviewed journals from 2013 to 2021. The heterogeneous results indicated that saffron significantly reduced fasting blood glucose, waist circumference, diastolic blood pressure, concentrations of total cholesterol and low-density lipoprotein cholesterol, and improved symptoms of depression, cognitive function and sexual dysfunction compared with controls (mainly placebos). Common side effects of saffron consumption included nausea, dry mouth, poor appetite, and headache, but no serious adverse reactions were reported. Primary analysis and sensitivity analysis confirmed that the reporting and methodological quality of reviews included in the study were highly correlated (p < 0.001). The quality of meta-analyses of saffron requires improvement by including a structured abstract, a prospective protocol and registration, explanation of the study designs within each study that is reviewed, the searches, risk of bias assessment, literature selection, and reporting of funding sources.

CONCLUSION

The available evidence indicates that saffron is a safe plant for administration as a medicine and can improve diverse clinical outcomes, but the scientific quality of the published systematic reviews needs to be improved. Moreover, the clinical effects of saffron need to be confirmed through high-quality randomized trials in multiple countries with large sample sizes.