Evidence synthesis workshops: moving from face-to-face to online learning

Newborn and child health national and provincial clinical practice guidelines in South Africa, Nigeria and Malawi: a scoping review

BACKGROUND

Low and middle-income countries remain disproportionately affected by high rates of child mortality. Clinical practice guidelines are essential clinical tools supporting implementation of effective, safe, and cost-effective healthcare. High-quality evidence-based guidelines play a key role in improving clinical management to impact child mortality. We aimed to identify and assess the quality of guidelines for newborn and child health published in South Africa, Nigeria and Malawi in the last 5 years (2017-2022).

METHODS

We searched relevant websites (June-July 2022), for publicly available national and subnational de novo or adapted guidelines, addressing newborn and child health in the three countries. Pairs of reviewers independently extracted information from eligible guidelines (scope, topic, target population and users, responsible developers, stakeholder consultation process, adaptation description, assessment of evidence certainty). We appraised guideline quality using the Appraisal of Guidelines for Research & Evaluation (AGREE II) instrument.

RESULTS

We identified 40-guidelines from the three countries. Of these, 8/40 reported being adopted from a parent guideline. More guidelines (n = 19) provided guidance on communicable diseases than on non-communicable diseases (n = 8). Guidelines were most often developed by national health ministries (n = 30) and professional societies (n = 14). Eighteen guidelines reported on stakeholder consultation; with Nigeria (10/11) and Malawi (3/6) faring better than South Africa (5/23) in reporting this activity. The Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach was used in 1/7 guidelines that reported assessing certainty of evidence. Overall guidelines scored well on two AGREE II domains: scope and purpose median (IQR) score 68% (IQR 47-83), and clarity of presentation 81% (67-94). Domains critical for ensuring credible guidance scored below 20%: rigour of development 11% (4-32) and editorial independence 6% (0-27).

CONCLUSION

National ministries and professional societies drive guideline activities in Malawi, Nigeria and South Arica. However, the methods and reporting do not adhere to global standards. We found low AGREE II scores for rigour of guideline development and editorial independence and limited use of GRADE or adaptation methods. This undermines the credibility of available guidelines to support evidence-informed care. Our findings highlight the importance of ongoing efforts to strengthen partnerships, capacity, and support for guideline development.

Building capacity for network meta-analysis in Sub-Saharan Africa: reflections and future direction

Robust, relevant, comprehensive, and up-to-date evidence syntheses are the cornerstone for evidence-informed healthcare decisions. When considering multiple treatment options, network meta-analysis (NMA) systematic reviews play a key role in informing impactful decisions and clinical practice guidelines. However, the capacity and literacy to conduct NMA systematic reviews and interpret its results remains out of reach for many clinicians and review authors, especially in low-to-middle-income countries. Despite ample resources and guides, NMA capacity and training opportunities remain limited to non-existent in Sub-Saharan Africa. Towards solutions and strengthening evidence synthesis and NMA capacity in the Sub-Saharan African region, we describe and reflect on two courses that build NMA capacity and aim to address NMA literacy in Sub-Saharan Africa.The Primer in NMA systematic reviews aimed for participants to be able to find, appraise, interpret, and consider the use of NMA SRs of intervention effects. It is a 6-week online course for clinicians, policy-makers, and researchers wanting to learn more about using NMA systematic reviews. The Global NMA Masterclass workshop aimed for participants to be able to understand and apply pairwise and NMA in STATA and R, evaluate NMA assumptions and confidence in NMA results, and appropriately report NMA results. This course was offered over 5 weeks to clinicians, biostatisticians, and researchers with basic knowledge of epidemiology and biostatics. Although the bulk of learning occurred through self-study, we had weekly, synchronous question-and-answer sessions for both courses. Using relevant examples throughout the courses helped to enable an authentic learning environment.This was the first NMA training developed in Africa for Africa. Development of the courses was a collaborative effort from a multi-disciplinary team. Both NMA courses were well received and attended by a diverse group of participants spread across Sub-Saharan African countries. Participants felt the courses were applicable to their setting. Although most participants appreciated the benefits of online learning, we also experienced some challenges. There is great potential to conduct NMA systematic reviews in Sub-Saharan Africa. The NMA Primer and NMA workshop can play an essential role in expanding and developing NMA SR capacity and literacy in SSA.

Quality of systematic reviews in African emergency medicine: a cross-sectional methodological study

Introduction

Reliable systematic reviews are essential to inform clinical practice guidelines, policies and further research priorities in Africa. For systematic review findings to be trustworthy, they need to be conducted with methodological rigour and reported transparently. We assessed the methodological quality of systematic reviews published in African emergency medicine journals, comparing them to those published in international emergency medicine journals. Additionally, we describe the types of review literature published in the African journals.

Methods

We performed a cross-sectional methodological study of systematic reviews published in selected African and international emergency medicine journals from 2012 to 2021. Studies were eligible if they were i) a systematic review on an emergency medicine topic, ii) published in one of the top five emergency medicine journals in the African region or internationally and iii) published between January 2012 and December 2021 in English or French. We searched PubMed, Web of Science and Scopus databases and hand-searched selected journals. Two authors screened titles, abstracts and full texts independently and in duplicate. Data extraction was performed by one reviewer, using a standardised form, after completing a calibration exercise. We described the characteristics of systematic reviews and assessed methodological quality using AMSTAR II.

Results

We identified 34 (37%) African and 511 (54%) international systematic reviews from 92 and 948 review articles respectively across 10 journals. We included all 34 African and a random sample of 100 international systematic reviews. Methodological quality was low or critically low for all the African systematic reviews (n=34, 100%) and all but three international systematic reviews (n=97, 97%). The median number of critical domain weaknesses was 4 (IQR 4;5) and 2 (IQR 2;4) for African and international systematic reviews respectively. The most common weaknesses across both African and international systematic reviews were i) not establishing a priori review protocols, ii) unclear selection of study designs iii) not providing a list of excluded studies and iv) unclear reporting on funding sources for included studies.

Conclusion

Emergency medicine systematic reviews published in African and international journals are lacking in methodological quality. Reporting an a priori protocol, developing a comprehensive search strategy, appropriate evidence synthesis and adequate assessment of risk of bias, heterogeneity and evidence certainty may improve the quality of systematic reviews.