1
|
Khalil H, Pollock D, McInerney P, Evans C, Moraes EB, Godfrey CM, Alexander L, Tricco A, Peters MDJ, Pieper D, Saran A, Ameen D, Taneri PE, Munn Z. Automation tools to support undertaking scoping reviews. Res Synth Methods 2024. [PMID: 38885942 DOI: 10.1002/jrsm.1731] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 05/15/2024] [Accepted: 06/02/2024] [Indexed: 06/20/2024]
Abstract
OBJECTIVE This paper describes several automation tools and software that can be considered during evidence synthesis projects and provides guidance for their integration in the conduct of scoping reviews. STUDY DESIGN AND SETTING The guidance presented in this work is adapted from the results of a scoping review and consultations with the JBI Scoping Review Methodology group. RESULTS This paper describes several reliable, validated automation tools and software that can be used to enhance the conduct of scoping reviews. Developments in the automation of systematic reviews, and more recently scoping reviews, are continuously evolving. We detail several helpful tools in order of the key steps recommended by the JBI's methodological guidance for undertaking scoping reviews including team establishment, protocol development, searching, de-duplication, screening titles and abstracts, data extraction, data charting, and report writing. While we include several reliable tools and software that can be used for the automation of scoping reviews, there are some limitations to the tools mentioned. For example, some are available in English only and their lack of integration with other tools results in limited interoperability. CONCLUSION This paper highlighted several useful automation tools and software programs to use in undertaking each step of a scoping review. This guidance has the potential to inform collaborative efforts aiming at the development of evidence informed, integrated automation tools and software packages for enhancing the conduct of high-quality scoping reviews.
Collapse
Affiliation(s)
- Hanan Khalil
- School of Psychology and Public Health, Department of Public Health, La Trobe University, Melbourne, Australia
- The Queensland Centre of Evidence Based Nursing and Midwifery: A JBI Centre of Excellence, Brisbane, Queensland, Australia
| | - Danielle Pollock
- JBI, University of Adelaide, Adelaide, Australia
- Health Evidence Synthesis, Recommendations and Impact (HESRI), School of Public Health, University of Adelaide, Adelaide, Australia
| | - Patricia McInerney
- The Wits JBI Centre for Evidence-Based Practice: A JBI Centre of Excellence, Faculty of Health Sciences, University of the Witwatersrand, South Africa
| | - Catrin Evans
- The Nottingham Centre for Evidence Based Healthcare: A JBI Centre of Excellence, University of Nottingham, UK
| | - Erica B Moraes
- Nursing School, Department of Nursing Fundamentals and Administration, Federal Fluminense University, Rio de Janeiro, Brazil
- The Brazilian Centre of Evidence-based Healthcare: A JBI Centre of Excellence - JBI, Brazil
| | - Christina M Godfrey
- Queen's Collaboration for Health Care Quality: A JBI Centre of Excellence, Queen's University School of Nursing, Kingston, Ontario, Canada
| | - Lyndsay Alexander
- The Scottish Centre for Evidence-based, Multi-Professional Practice: A JBI Centre of Excellence, Aberdeen, UK
- School of Health Sciences, Robert Gordon University, Aberdeen, UK
| | - Andrea Tricco
- Queen's Collaboration for Health Care Quality: A JBI Centre of Excellence, Queen's University School of Nursing, Kingston, Ontario, Canada
- Epidemiology Division and Institute for Health, Management, and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
- Knowledge Translation Program, Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, Toronto, Ontario, Canada
| | - Micah D J Peters
- Health Evidence Synthesis, Recommendations and Impact (HESRI), School of Public Health, University of Adelaide, Adelaide, Australia
- University of South Australia, Clinical and Health Sciences, Rosemary Bryant AO Research Centre, Adelaide, South Australia, Australia
- University of Adelaide, Faculty of Health and Medical Sciences, Adelaide Nursing School, Adelaide, Australia
| | - Dawid Pieper
- Faculty of Health Sciences Brandenburg, Brandenburg Medical School (Theodor Fontane), Institute for Health Services and Health System Research, Rüdersdorf, Germany
- Center for Health Services Research, Brandenburg Medical School (Theodor Fontane), Rüdersdorf, Germany
| | | | - Daniel Ameen
- Faculty of Medicine, Nursing and Health Sciences, School of Medicine, Monash University, Australia
| | - Petek Eylul Taneri
- HRB-Trials Methodology Research Network, College of Medicine, Nursing and Health Sciences, University of Galway, Galway, Ireland
| | - Zachary Munn
- JBI, University of Adelaide, Adelaide, Australia
- Health Evidence Synthesis, Recommendations and Impact (HESRI), School of Public Health, University of Adelaide, Adelaide, Australia
| |
Collapse
|
2
|
McSween-Cadieux E, Lane J, Hong QN, Houle AA, Lauzier-Jobin F, Saint-Pierre Mousset E, Prigent O, Ziam S, Poder T, Lesage A, Dagenais P. Production and use of rapid responses during the COVID-19 pandemic in Quebec (Canada): perspectives from evidence synthesis producers and decision makers. Health Res Policy Syst 2024; 22:22. [PMID: 38351054 PMCID: PMC10863098 DOI: 10.1186/s12961-024-01105-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 01/08/2024] [Indexed: 02/16/2024] Open
Abstract
BACKGROUND The COVID-19 pandemic has required evidence to be made available more rapidly than usual, in order to meet the needs of decision makers in a timely manner. These exceptional circumstances have caused significant challenges for organizations and teams responsible for evidence synthesis. They had to adapt to provide rapid responses to support decision-making. This study aimed to document (1) the challenges and adaptations made to produce rapid responses during the pandemic, (2) their perceived usefulness, reported use and factors influencing their use and (3) the methodological adaptations made to produce rapid responses. METHODS A qualitative study was conducted in 2021 with eight organizations in the health and social services system in Quebec (Canada), including three institutes with a provincial mandate. Data collection included focus groups (n = 9 groups in 8 organizations with 64 participants), interviews with decision makers (n = 12), and a document analysis of COVID-19 rapid responses (n = 128). A thematic analysis of qualitative data (objectives 1 and 2) and a descriptive analysis of documents (objective 3) were conducted. RESULTS The results highlight the teams and organizations' agility to deal with the many challenges encountered during the pandemic (e.g., increased their workloads, adoption of new technological tools or work processes, improved collaboration, development of scientific monitoring, adaptation of evidence synthesis methodologies and products). The challenge of balancing rigor and speed was reported by teams and organizations. When available at the right time, rapid responses have been reported as a useful tool for informing or justifying decisions in a context of uncertainty. Several factors that may influence their use were identified (e.g., clearly identify needs, interactions with producers, perceived rigor and credibility, precise and feasible recommendations). Certain trends in the methodological approaches used to speed up the evidence synthesis process were identified. CONCLUSIONS This study documented rapid responses producers' experiences during the COVID-19 pandemic in Quebec, and decision makers who requested, consulted, or used these products. Potential areas of improvements are identified such as reinforce coordination, improve communication loops, clarify guidelines or methodological benchmarks, and enhance utility of rapid response products for decision makers.
Collapse
Affiliation(s)
- Esther McSween-Cadieux
- Department of School and Social Adaptation Studies, Faculty of Education, Université de Sherbrooke, Sherbrooke, Canada.
- Centre RBC d'expertise Universitaire en Santé Mentale, Université de Sherbrooke, Sherbrooke, Canada.
| | - Julie Lane
- Department of School and Social Adaptation Studies, Faculty of Education, Université de Sherbrooke, Sherbrooke, Canada
- Centre RBC d'expertise Universitaire en Santé Mentale, Université de Sherbrooke, Sherbrooke, Canada
| | - Quan Nha Hong
- School of Rehabilitation, Université de Montréal, Montreal, Canada
| | - Andrée-Anne Houle
- Centre RBC d'expertise Universitaire en Santé Mentale, Université de Sherbrooke, Sherbrooke, Canada
- Department of Psychoeducation, Université de Sherbrooke, Sherbrooke, Canada
| | - François Lauzier-Jobin
- Centre RBC d'expertise Universitaire en Santé Mentale, Université de Sherbrooke, Sherbrooke, Canada
| | - Eliane Saint-Pierre Mousset
- Department of School and Social Adaptation Studies, Faculty of Education, Université de Sherbrooke, Sherbrooke, Canada
- Centre RBC d'expertise Universitaire en Santé Mentale, Université de Sherbrooke, Sherbrooke, Canada
| | - Ollivier Prigent
- Department of School and Social Adaptation Studies, Faculty of Education, Université de Sherbrooke, Sherbrooke, Canada
| | - Saliha Ziam
- School of Business Administration, Université TÉLUQ, Montreal, Canada
| | - Thomas Poder
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Montréal (CR-IUSMM), CIUSSS-de-l'Est-de-l'île-de-Montréal, Montreal, Canada
- Department of Management, Evaluation and Health Policy, School of Public Health, University of Montreal, Montreal, Canada
| | - Alain Lesage
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Montréal (CR-IUSMM), CIUSSS-de-l'Est-de-l'île-de-Montréal, Montreal, Canada
| | - Pierre Dagenais
- Department of Medicine, Faculty of Medicine and Health Science, University of Sherbrooke, Sherbrooke, Canada
| |
Collapse
|
3
|
Hocking L, Parkinson S, Adams A, Molding Nielsen E, Ang C, de Carvalho Gomes H. Overcoming the challenges of using automated technologies for public health evidence synthesis. Euro Surveill 2023; 28:2300183. [PMID: 37943502 PMCID: PMC10636742 DOI: 10.2807/1560-7917.es.2023.28.45.2300183] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Accepted: 08/10/2023] [Indexed: 11/10/2023] Open
Abstract
Many organisations struggle to keep pace with public health evidence due to the volume of published literature and length of time it takes to conduct literature reviews. New technologies that help automate parts of the evidence synthesis process can help conduct reviews more quickly and efficiently to better provide up-to-date evidence for public health decision making. To date, automated approaches have seldom been used in public health due to significant barriers to their adoption. In this Perspective, we reflect on the findings of a study exploring experiences of adopting automated technologies to conduct evidence reviews within the public health sector. The study, funded by the European Centre for Disease Prevention and Control, consisted of a literature review and qualitative data collection from public health organisations and researchers in the field. We specifically focus on outlining the challenges associated with the adoption of automated approaches and potential solutions and actions that can be taken to mitigate these. We explore these in relation to actions that can be taken by tool developers (e.g. improving tool performance and transparency), public health organisations (e.g. developing staff skills, encouraging collaboration) and funding bodies/the wider research system (e.g. researchers, funding bodies, academic publishers and scholarly journals).
Collapse
|
4
|
Akl EA, Cuker A, Mustafa RA, Nieuwlaat R, Stevens A, Schünemann HJ. Prospective collaborative recommendation development: a novel model for more timely and trustworthy guidelines. J Clin Epidemiol 2023; 162:156-159. [PMID: 37648070 DOI: 10.1016/j.jclinepi.2023.08.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2023] [Revised: 08/14/2023] [Accepted: 08/23/2023] [Indexed: 09/01/2023]
Affiliation(s)
- Elie A Akl
- Department of Internal Medicine, American University of Beirut, Beirut, Lebanon; Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada.
| | - Adam Cuker
- Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; Department of Pathology and Laboratory Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA; Outcomes and Implementation Research Unit, Department of Internal Medicine, University of Kansas Medical Center, Kansas City, KS, USA
| | - Reem A Mustafa
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Robby Nieuwlaat
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Adrienne Stevens
- Centre for Immunization Readiness, Public Health Agency of Canada, Ottawa, Ontario, Canada
| | - Holger J Schünemann
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada; Department of Biomedical Sciences, Humanitas University, Pieve Emanuele, Italy
| |
Collapse
|
5
|
Sbaity E, Zahwe M, Helou V, Bahsoun R, Hassan Z, Abi Khalil P, Akl EA. Health Research Collaborations by Academic Entities: A Systematic Review. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2023; 98:1220-1227. [PMID: 37232854 DOI: 10.1097/acm.0000000000005277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
PURPOSE To review the literature on health research collaborations by academic entities and to identify the main phases, components, and concepts of these research collaborations. METHOD The authors conducted a systematic review of the literature, searching 4 databases in March 2022 for studies on health research collaboration between an academic entity (individual, group, or institution) and any other entity included. They excluded non-health-related studies and studies in which collaboration was not for the purpose of research. From included studies, reviewers abstracted data about the 4 main phases of research collaborations (initiation, conduct, monitoring, and evaluation) and synthesized their corresponding components and concepts using thematic analysis method. RESULTS A total of 59 studies met inclusion criteria. These studies described building research collaborations between an academic entity and other academic entities (n = 29; 49%), communities (n = 28; 47%), industry (n = 7; 12%), and/or governmental entities (n = 4; 7%). Of the 59 studies, 22 addressed 2 phases of collaboration, 20 addressed 3 phases, and 17 addressed all 4 phases. All included studies described at least 1 of the components relevant to the initiation phase and at least 1 relevant to the conduct phase. Team structure was the most common component discussed in relation to the initiation phase (n = 48; 81%), and team dynamics was the most common component discussed in relation to the conduct phase (n = 55; 93%). At least 1 of the components relevant to the monitoring phase was reported in 36 studies, and at least 1 component relevant to the evaluation phase was reported in 28 studies. CONCLUSIONS This review provides important information for groups aiming to engage in collaborative research. The synthesized list of collaboration phases and their components can serve as a road map for collaborators at different steps of their research.
Collapse
Affiliation(s)
- Eman Sbaity
- E. Sbaity is assistant professor, Department of Surgery, American University of Beirut Medical Center, Beirut, Lebanon
| | - Mariam Zahwe
- M. Zahwe is postdoctoral research associate, Faculty of Medicine, American University of Beirut, Beirut, Lebanon
| | - Vanessa Helou
- V. Helou is a medical student, American University of Beirut, Beirut, Lebanon; ORCID: https://orcid.org/0000-0003-4826-1659
| | - Reem Bahsoun
- R. Bahsoun is a medical student, American University of Beirut, Beirut, Lebanon
| | - Zeina Hassan
- Z. Hassan is research assistant, Department of Surgery, American University of Beirut Medical Center, Beirut, Lebanon
| | - Pamela Abi Khalil
- P. Abi Khalil is senior research assistant, Clinical Research Institute, American University of Beirut Medical Center, Beirut, Lebanon
| | - Elie A Akl
- E.A. Akl is professor, Department of Medicine, American University of Beirut, Beirut, Lebanon, and professor, Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, Ontario, Canada; ORCID: https://orcid.org/0000-0002-3444-8618
| |
Collapse
|
6
|
Wilmes N, Hendriks CWE, Viets CTA, Cornelissen SJWM, van Mook WNKA, Cox-Brinkman J, Celi LA, Martinez-Martin N, Gichoya JW, Watkins C, Bakhshi-Raiez F, Wynants L, van der Horst ICC, van Bussel BCT. Structural under-reporting of informed consent, data handling and sharing, ethical approval, and application of Open Science principles as proxies for study quality conduct in COVID-19 research: a systematic scoping review. BMJ Glob Health 2023; 8:bmjgh-2023-012007. [PMID: 37257937 DOI: 10.1136/bmjgh-2023-012007] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Accepted: 04/13/2023] [Indexed: 06/02/2023] Open
Abstract
BACKGROUND The COVID-19 pandemic required science to provide answers rapidly to combat the outbreak. Hence, the reproducibility and quality of conducting research may have been threatened, particularly regarding privacy and data protection, in varying ways around the globe. The objective was to investigate aspects of reporting informed consent and data handling as proxies for study quality conduct. METHODS A systematic scoping review was performed by searching PubMed and Embase. The search was performed on November 8th, 2020. Studies with hospitalised patients diagnosed with COVID-19 over 18 years old were eligible for inclusion. With a focus on informed consent, data were extracted on the study design, prestudy protocol registration, ethical approval, data anonymisation, data sharing and data transfer as proxies for study quality. For reasons of comparison, data regarding country income level, study location and journal impact factor were also collected. RESULTS 972 studies were included. 21.3% of studies reported informed consent, 42.6% reported waivers of consent, 31.4% did not report consent information and 4.7% mentioned other types of consent. Informed consent reporting was highest in clinical trials (94.6%) and lowest in retrospective cohort studies (15.0%). The reporting of consent versus no consent did not differ significantly by journal impact factor (p=0.159). 16.8% of studies reported a prestudy protocol registration or design. Ethical approval was described in 90.9% of studies. Information on anonymisation was provided in 17.0% of studies. In 257 multicentre studies, 1.2% reported on data sharing agreements, and none reported on Findable, Accessible, Interoperable and Reusable data principles. 1.2% reported on open data. Consent was most often reported in the Middle East (42.4%) and least often in North America (4.7%). Only one report originated from a low-income country. DISCUSSION Informed consent and aspects of data handling and sharing were under-reported in publications concerning COVID-19 and differed between countries, which strains study quality conduct when in dire need of answers.
Collapse
Affiliation(s)
- Nick Wilmes
- Deparment of Intensive Care Medicine, Maastricht University Medical Centre, Maastricht, The Netherlands
- Cardiovascular research institute Maastricht (CARIM), Maastricht University, Maastricht, The Netherlands
| | - Charlotte W E Hendriks
- Deparment of Intensive Care Medicine, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Caspar T A Viets
- Deparment of Intensive Care Medicine, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Simon J W M Cornelissen
- Deparment of Intensive Care Medicine, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Walther N K A van Mook
- Deparment of Intensive Care Medicine, Maastricht University Medical Centre, Maastricht, The Netherlands
- Academy for Postgraduate Medical Training, Maastricht University Medical Center, Maastricht, The Netherlands
- School of Health Professions Education, Maastricht University, Maastricht, The Netherlands
| | - Josanne Cox-Brinkman
- Department of Health Law, Maastricht University Medical Centre, Maastricht, The Netherlands
| | - Leo A Celi
- Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Centre, Boston, Massachusetts, USA
- Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA
| | - Nicole Martinez-Martin
- Department of Pediatrics, Stanford Center for Biomedical Ethics, Stanford University, San Jose, California, USA
| | - Judy W Gichoya
- Department of Radiology and Imaging Sciences, Emory University School of Medicine, Emory University, Atlanta, Florida, USA
| | - Craig Watkins
- School of Journalism and Media, University of Texas, Austin, Texas, USA
| | - Ferishta Bakhshi-Raiez
- Department of Medical Informatics, Amsterdam University Medical Centre, Amsterdam and Amsterdam Public Health, Quality of care The Netherlands, Amsterdam, The Netherlands
| | - Laure Wynants
- Department of Development and Regeneration, KU Leuven, Leuven, Belgium
- Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands
| | - Iwan C C van der Horst
- Deparment of Intensive Care Medicine, Maastricht University Medical Centre, Maastricht, The Netherlands
- Cardiovascular research institute Maastricht (CARIM), Maastricht University, Maastricht, The Netherlands
| | - Bas C T van Bussel
- Deparment of Intensive Care Medicine, Maastricht University Medical Centre, Maastricht, The Netherlands
- Cardiovascular research institute Maastricht (CARIM), Maastricht University, Maastricht, The Netherlands
- Care and Public Health Research Institute, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
7
|
Campbell F, Tricco AC, Munn Z, Pollock D, Saran A, Sutton A, White H, Khalil H. Mapping reviews, scoping reviews, and evidence and gap maps (EGMs): the same but different- the "Big Picture" review family. Syst Rev 2023; 12:45. [PMID: 36918977 PMCID: PMC10014395 DOI: 10.1186/s13643-023-02178-5] [Citation(s) in RCA: 30] [Impact Index Per Article: 30.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/03/2022] [Accepted: 01/24/2023] [Indexed: 03/16/2023] Open
Abstract
Scoping reviews, mapping reviews, and evidence and gap maps are evidence synthesis methodologies that address broad research questions, aiming to describe a bigger picture rather than address a specific question about intervention effectiveness. They are being increasingly used to support a range of purposes including guiding research priorities and decision making. There is however a confusing array of terminology used to describe these different approaches. In this commentary, we aim to describe where there are differences in terminology and where this equates to differences in meaning. We demonstrate the different theoretical routes that underpin these differences. We suggest ways in which the approaches of scoping and mapping reviews may differ in order to guide consistency in reporting and method. We propose that mapping and scoping reviews and evidence and gap maps have similarities that unite them as a group but also have unique differences. Understanding these similarities and differences is important for informing the development of methods used to undertake and report these types of evidence synthesis.
Collapse
Affiliation(s)
- Fiona Campbell
- Population Health Sciences Institute, Newcastle University, Newcastle, UK
- School of Psychology and Public Health, Department of Public Health, La Trobe University, Melbourne, Australia
| | - Andrea C. Tricco
- Knowledge Translation Program of the Li Ka Shing Knowledge Institute, St. Michael’s Hospital, University of Toronto in the Dalla Lana School of Public Health & Institute of Health Policy, Management, and Evaluation, Toronto, Canada
| | - Zacchary Munn
- JBI, Faculty of Health and Medical Sciences, University of Adelaide, Adelaide, Australia
| | - Dannielle Pollock
- JBI, Faculty of Health and Medical Sciences, University of Adelaide, Adelaide, Australia
| | - Ashrita Saran
- International Development Coordinating Group, Campbell Collaboration, Oslo, Norway
| | - Anthea Sutton
- ScHARR, University of Sheffield, Sheffield, United Kingdom
| | - Howard White
- Evaluation and Evidence Synthesis, Global Development Network, New Delhi, India
| | - Hanan Khalil
- School of Psychology and Public Health, Department of Public Health, La Trobe University, Melbourne, Australia
| |
Collapse
|
8
|
Whear R, Bethel A, Abbott R, Rogers M, Orr N, Manzi S, Ukoumunne OC, Stein K, Coon JT. Systematic reviews of convalescent plasma in COVID-19 continue to be poorly conducted and reported: a systematic review. J Clin Epidemiol 2022; 151:53-64. [PMID: 35934268 PMCID: PMC9351208 DOI: 10.1016/j.jclinepi.2022.07.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 05/18/2022] [Accepted: 07/07/2022] [Indexed: 12/25/2022]
Abstract
OBJECTIVES To suggest possible approaches to combatting the impact of the COVID-19 infodemic to prevent research waste in future health emergencies and in everyday research and practice. STUDY DESIGN AND SETTING Systematic review. The Epistemonikos database was searched in June 2021 for systematic reviews on the effectiveness of convalescent plasma for COVID-19. Two reviewers independently screened the retrieved references with disagreements resolved by discussion. Data extraction was completed by one reviewer with a proportion checked by a second. We used the Assessment of Multiple Systematic Reviews to assess the quality of conduct and reporting of included reviews. RESULTS Fifty one systematic reviews are included with 193 individual studies included within the systematic reviews. There was considerable duplication of effort; multiple reviews were conducted at the same time with inconsistencies in the evidence included. The reviews were of low methodological quality, poorly reported, and did not adhere to preferred reporting items for systematic reviews and meta-analysis guidance. CONCLUSION Researchers need to conduct, appraise, interpret, and disseminate systematic reviews better. All in the research community (researchers, peer-reviewers, journal editors, funders, decision makers, clinicians, journalists, and the public) need to work together to facilitate the conduct of robust systematic reviews that are published and communicated in a timely manner, reducing research duplication and waste, increasing transparency and accessibility of all systematic reviews.
Collapse
Affiliation(s)
- Rebecca Whear
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK,Corresponding author. St Lukes Campus, University of Exeter, 3.09 South Cloisters, Heavitree Road, Exeter EX1 2LU. Tel.: +1392 726064
| | - Alison Bethel
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Rebecca Abbott
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Morwenna Rogers
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Noreen Orr
- Evidence Synthesis Team, University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Sean Manzi
- National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Obioha C. Ukoumunne
- National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Ken Stein
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Jo Thompson Coon
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| |
Collapse
|
9
|
Greenhalgh T, Fisman D, Cane DJ, Oliver M, Macintyre CR. Adapt or die: how the pandemic made the shift from EBM to EBM+ more urgent. BMJ Evid Based Med 2022; 27:bmjebm-2022-111952. [PMID: 35853682 PMCID: PMC9510422 DOI: 10.1136/bmjebm-2022-111952] [Citation(s) in RCA: 27] [Impact Index Per Article: 13.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 07/05/2022] [Indexed: 12/12/2022]
Abstract
Evidence-based medicine (EBM's) traditional methods, especially randomised controlled trials (RCTs) and meta-analyses, along with risk-of-bias tools and checklists, have contributed significantly to the science of COVID-19. But these methods and tools were designed primarily to answer simple, focused questions in a stable context where yesterday's research can be mapped more or less unproblematically onto today's clinical and policy questions. They have significant limitations when extended to complex questions about a novel pathogen causing chaos across multiple sectors in a fast-changing global context. Non-pharmaceutical interventions which combine material artefacts, human behaviour, organisational directives, occupational health and safety, and the built environment are a case in point: EBM's experimental, intervention-focused, checklist-driven, effect-size-oriented and deductive approach has sometimes confused rather than informed debate. While RCTs are important, exclusion of other study designs and evidence sources has been particularly problematic in a context where rapid decision making is needed in order to save lives and protect health. It is time to bring in a wider range of evidence and a more pluralist approach to defining what counts as 'high-quality' evidence. We introduce some conceptual tools and quality frameworks from various fields involving what is known as mechanistic research, including complexity science, engineering and the social sciences. We propose that the tools and frameworks of mechanistic evidence, sometimes known as 'EBM+' when combined with traditional EBM, might be used to develop and evaluate the interdisciplinary evidence base needed to take us out of this protracted pandemic. Further articles in this series will apply pluralistic methods to specific research questions.
Collapse
Affiliation(s)
- Trisha Greenhalgh
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - David Fisman
- Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
| | - Danielle J Cane
- Coalition for Healthcare Acquired Infection Reduction, Cambridge, Ontario, Canada
| | - Matthew Oliver
- Association of Professional Engineers and Geoscientists, Edmonton, Alberta, Canada
| | - Chandini Raina Macintyre
- The Biosecurity Program, Kirby Institute, University of New South Wales, Sydney, New South Wales, Australia
| |
Collapse
|
10
|
Rehfuess EA, Burns JB, Pfadenhauer LM, Krishnaratne S, Littlecott H, Meerpohl JJ, Movsisyan A. Lessons learnt: Undertaking rapid reviews on public health and social measures during a global pandemic. Res Synth Methods 2022; 13:558-572. [PMID: 35704478 PMCID: PMC9349463 DOI: 10.1002/jrsm.1580] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Revised: 06/01/2022] [Accepted: 06/10/2022] [Indexed: 12/04/2022]
Abstract
Public health and social measures (PHSM) have been central to the COVID‐19 response. Consequently, there has been much pressure on decision‐makers to make evidence‐informed decisions and on researchers to synthesize the evidence regarding these measures. This article describes our experiences, responses and lessons learnt regarding key challenges when planning and conducting rapid reviews of PHSM during the COVID‐19 pandemic. Stakeholder consultations and scoping reviews to obtain an overview of the evidence inform the scope of reviews that are policy‐relevant and feasible. Multiple complementary reviews serve to examine the benefits and harms of PHSM across different populations and contexts. Conceiving reviews of effectiveness as adaptable living reviews helps to respond to evolving evidence needs and an expanding evidence base. An appropriately skilled review team and good planning, coordination and communication ensures smooth and rigorous processes and efficient use of resources. Scientific rigor, the practical implications of PHSM‐related complexity and likely time savings should be carefully weighed in deciding on methodological shortcuts. Making the best possible use of modeling studies represents a particular challenge, and methods should be carefully chosen, piloted and implemented. Our experience raises questions regarding the nature of rapid reviews and regarding how different types of evidence should be considered in making decisions about PHSM during a global pandemic. We highlight the need for readily available protocols for conducting studies on the effectiveness, unintended consequences and implementation of PHSM in a timely manner, as well as the need for rapid review standards tailored to “rapid” versus “emergency” mode reviewing.
Collapse
Affiliation(s)
- E A Rehfuess
- Institute for Medical Information Processing, Biometry and Epidemiology, Ludwig-Maximilians-Universität, Munich, Germany.,Pettenkofer School of Public Health, Munich, Germany
| | - J B Burns
- Institute for Medical Information Processing, Biometry and Epidemiology, Ludwig-Maximilians-Universität, Munich, Germany.,Pettenkofer School of Public Health, Munich, Germany
| | - L M Pfadenhauer
- Institute for Medical Information Processing, Biometry and Epidemiology, Ludwig-Maximilians-Universität, Munich, Germany.,Pettenkofer School of Public Health, Munich, Germany
| | - S Krishnaratne
- Institute for Medical Information Processing, Biometry and Epidemiology, Ludwig-Maximilians-Universität, Munich, Germany.,Pettenkofer School of Public Health, Munich, Germany.,Department of Disease Control, Faculty of Infectious and Tropical Diseases, London School of Hygiene and Tropical Medicine, London, United Kingdom
| | - H Littlecott
- Institute for Medical Information Processing, Biometry and Epidemiology, Ludwig-Maximilians-Universität, Munich, Germany.,Pettenkofer School of Public Health, Munich, Germany.,DECIPHer (Centre for Development, Evaluation, Complexity and Implementation in Public Health Improvement), School of Social Sciences, Cardiff University, Cardiff, United Kingdom
| | - J J Meerpohl
- Institute for Evidence in Medicine, Medical Center & Faculty of Medicine, University of Freiburg, Freiburg, Germany.,Cochrane Germany, Cochrane Germany Foundation, Freiburg, Germany
| | - A Movsisyan
- Institute for Medical Information Processing, Biometry and Epidemiology, Ludwig-Maximilians-Universität, Munich, Germany.,Pettenkofer School of Public Health, Munich, Germany
| |
Collapse
|
11
|
Tovey D, Tugwell P. Editors' Choice: February 2022. J Clin Epidemiol 2022; 142:A6-A7. [PMID: 35210058 DOI: 10.1016/j.jclinepi.2022.01.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|