1
|
Guo Q, Jiang G, Zhao Q, Long Y, Feng K, Gu X, Xu Y, Li Z, Huang J, Du L. Rapid review: A review of methods and recommendations based on current evidence. J Evid Based Med 2024; 17:434-453. [PMID: 38512942 DOI: 10.1111/jebm.12594] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/26/2023] [Accepted: 02/28/2024] [Indexed: 03/23/2024]
Abstract
Rapid review (RR) could accelerate the traditional systematic review (SR) process by simplifying or omitting steps using various shortcuts. With the increasing popularity of RR, numerous shortcuts had emerged, but there was no consensus on how to choose the most appropriate ones. This study conducted a literature search in PubMed from inception to December 21, 2023, using terms such as "rapid review" "rapid assessment" "rapid systematic review" and "rapid evaluation". We also scanned the reference lists and performed citation tracking of included impact studies to obtain more included studies. We conducted a narrative synthesis of all RR approaches, shortcuts and studies assessing their effectiveness at each stage of RRs. Based on the current evidence, we provided recommendations on utilizing certain shortcuts in RRs. Ultimately, we identified 185 studies focusing on summarizing RR approaches and shortcuts, or evaluating their impact. There was relatively sufficient evidence to support the use of the following shortcuts in RRs: limiting studies to those published in English-language; conducting abbreviated database searches (e.g., only searching PubMed/MEDLINE, Embase, and CENTRAL); omitting retrieval of grey literature; restricting the search timeframe to the recent 20 years for medical intervention and the recent 15 years for reviewing diagnostic test accuracy; conducting a single screening by an experienced screener. To some extent, the above shortcuts were also applicable to SRs. This study provided a reference for future RR researchers in selecting shortcuts, and it also presented a potential research topic for methodologists.
Collapse
Affiliation(s)
- Qiong Guo
- Innovation Institute for Integration of Medicine and Engineering, West China Hospital, Sichuan University, Chengdu, P. R. China
- West China Medical Publishers, West China Hospital, Sichuan University, Chengdu, P. R. China
| | - Guiyu Jiang
- West China School of Public Health, Sichuan University, Chengdu, P. R. China
| | - Qingwen Zhao
- West China School of Public Health, Sichuan University, Chengdu, P. R. China
| | - Youlin Long
- Innovation Institute for Integration of Medicine and Engineering, West China Hospital, Sichuan University, Chengdu, P. R. China
- Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, Chengdu, P. R. China
| | - Kun Feng
- Innovation Institute for Integration of Medicine and Engineering, West China Hospital, Sichuan University, Chengdu, P. R. China
- Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, Chengdu, P. R. China
| | - Xianlin Gu
- Innovation Institute for Integration of Medicine and Engineering, West China Hospital, Sichuan University, Chengdu, P. R. China
- Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, Chengdu, P. R. China
| | - Yihan Xu
- Innovation Institute for Integration of Medicine and Engineering, West China Hospital, Sichuan University, Chengdu, P. R. China
- Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, Chengdu, P. R. China
- Center for education of medical humanities, West China Hospital, Sichuan University, Chengdu, P. R. China
| | - Zhengchi Li
- Center for education of medical humanities, West China Hospital, Sichuan University, Chengdu, P. R. China
| | - Jin Huang
- Innovation Institute for Integration of Medicine and Engineering, West China Hospital, Sichuan University, Chengdu, P. R. China
| | - Liang Du
- Innovation Institute for Integration of Medicine and Engineering, West China Hospital, Sichuan University, Chengdu, P. R. China
- West China Medical Publishers, West China Hospital, Sichuan University, Chengdu, P. R. China
- Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, Chengdu, P. R. China
| |
Collapse
|
2
|
Haby MM, Barreto JOM, Kim JYH, Peiris S, Mansilla C, Torres M, Guerrero-Magaña DE, Reveiz L. What are the best methods for rapid reviews of the research evidence? A systematic review of reviews and primary studies. Res Synth Methods 2024; 15:2-20. [PMID: 37696668 DOI: 10.1002/jrsm.1664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Revised: 07/09/2023] [Accepted: 08/07/2023] [Indexed: 09/13/2023]
Abstract
Rapid review methodology aims to facilitate faster conduct of systematic reviews to meet the needs of the decision-maker, while also maintaining quality and credibility. This systematic review aimed to determine the impact of different methodological shortcuts for undertaking rapid reviews on the risk of bias (RoB) of the results of the review. Review stages for which reviews and primary studies were sought included the preparation of a protocol, question formulation, inclusion criteria, searching, selection, data extraction, RoB assessment, synthesis, and reporting. We searched 11 electronic databases in April 2022, and conducted some supplementary searching. Reviewers worked in pairs to screen, select, extract data, and assess the RoB of included reviews and studies. We included 15 systematic reviews, 7 scoping reviews, and 65 primary studies. We found that several commonly used shortcuts in rapid reviews are likely to increase the RoB in the results. These include restrictions based on publication date, use of a single electronic database as a source of studies, and use of a single reviewer for screening titles and abstracts, selecting studies based on the full-text, and for extracting data. Authors of rapid reviews should be transparent in reporting their use of these shortcuts and acknowledge the possibility of them causing bias in the results. This review also highlights shortcuts that can save time without increasing the risk of bias. Further research is needed for both systematic and rapid reviews on faster methods for accurate data extraction and RoB assessment, and on development of more precise search strategies.
Collapse
Affiliation(s)
- Michelle M Haby
- Science and Knowledge Unit, Evidence and Intelligence for Action in Health Department, Pan American Health Organization, Washington, DC, USA
- Department of Chemical and Biological Sciences, University of Sonora, Hermosillo, Mexico
- Melbourne School of Population and Global Health, The University of Melbourne, Parkville, Victoria, Australia
| | | | - Jenny Yeon Hee Kim
- Science and Knowledge Unit, Evidence and Intelligence for Action in Health Department, Pan American Health Organization, Washington, DC, USA
| | - Sasha Peiris
- Science and Knowledge Unit, Evidence and Intelligence for Action in Health Department, Pan American Health Organization, Washington, DC, USA
| | - Cristián Mansilla
- McMaster Health Forum, McMaster University, Hamilton, Ontario, Canada
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Marcela Torres
- Science and Knowledge Unit, Evidence and Intelligence for Action in Health Department, Pan American Health Organization, Washington, DC, USA
| | - Diego Emmanuel Guerrero-Magaña
- Doctoral Program in Chemical and Biological Sciences and Health, Department of Chemical and Biological Sciences, University of Sonora, Hermosillo, Mexico
| | - Ludovic Reveiz
- Science and Knowledge Unit, Evidence and Intelligence for Action in Health Department, Pan American Health Organization, Washington, DC, USA
| |
Collapse
|
3
|
Afifi M, Stryhn H, Sanchez J. Data extraction and comparison for complex systematic reviews: a step-by-step guideline and an implementation example using open-source software. Syst Rev 2023; 12:226. [PMID: 38041161 PMCID: PMC10691069 DOI: 10.1186/s13643-023-02322-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/23/2022] [Accepted: 08/15/2023] [Indexed: 12/03/2023] Open
Abstract
BACKGROUND Data extraction (DE) is a challenging step in systematic reviews (SRs). Complex SRs can involve multiple interventions and/or outcomes and encompass multiple research questions. Attempts have been made to clarify DE aspects focusing on the subsequent meta-analysis; there are, however, no guidelines for DE in complex SRs. Comparing datasets extracted independently by pairs of reviewers to detect discrepancies is also cumbersome, especially when the number of extracted variables and/or studies is colossal. This work aims to provide a set of practical steps to help SR teams design and build DE tools and compare extracted data for complex SRs. METHODS We provided a 10-step guideline, from determining data items and structure to data comparison, to help identify discrepancies and solve data disagreements between reviewers. The steps were organised into three phases: planning and building the database and data manipulation. Each step was described and illustrated with examples, and relevant references were provided for further guidance. A demonstration example was presented to illustrate the application of Epi Info and R in the database building and data manipulation phases. The proposed guideline was also summarised and compared with previous DE guidelines. RESULTS The steps of this guideline are described generally without focusing on a particular software application or meta-analysis technique. We emphasised determining the organisational data structure and highlighted its role in the subsequent steps of database building. In addition to the minimal programming skills needed, creating relational databases and data validation features of Epi info can be utilised to build DE tools for complex SRs. However, two R libraries are needed to facilitate data comparison and solve discrepancies. CONCLUSIONS We hope adopting this guideline can help review teams construct DE tools that suit their complex review projects. Although Epi Info depends on proprietary software for data storage, it can still be a potential alternative to other commercial DE software for completing complex reviews.
Collapse
Affiliation(s)
- Mohamed Afifi
- Department of Animal Wealth Development, Biostatistics Section, Faculty of Veterinary Medicine, Zagazig University, Zagazig, Ash Sharqia Governorate, 44519, Egypt.
- Department of Health Management, Atlantic Veterinary College, University of Prince Edward Island, Charlottetown, PEI, C1A 4P3, Canada.
| | - Henrik Stryhn
- Department of Health Management, Atlantic Veterinary College, University of Prince Edward Island, Charlottetown, PEI, C1A 4P3, Canada
| | - Javier Sanchez
- Department of Health Management, Atlantic Veterinary College, University of Prince Edward Island, Charlottetown, PEI, C1A 4P3, Canada
| |
Collapse
|
4
|
Büchter RB, Rombey T, Mathes T, Khalil H, Lunny C, Pollock D, Puljak L, Tricco AC, Pieper D. Systematic reviewers used various approaches to data extraction and expressed several research needs: a survey. J Clin Epidemiol 2023; 159:214-224. [PMID: 37286149 DOI: 10.1016/j.jclinepi.2023.05.027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Revised: 05/28/2023] [Accepted: 05/31/2023] [Indexed: 06/09/2023]
Abstract
OBJECTIVE Data extraction is a prerequisite for analyzing, summarizing, and interpreting evidence in systematic reviews. Yet guidance is limited, and little is known about current approaches. We surveyed systematic reviewers on their current approaches to data extraction, opinions on methods, and research needs. STUDY DESIGN AND SETTING We developed a 29-question online survey and distributed it through relevant organizations, social media, and personal networks in 2022. Closed questions were evaluated using descriptive statistics, and open questions were analyzed using content analysis. RESULTS 162 reviewers participated. Use of adapted (65%) or newly developed extraction forms (62%) was common. Generic forms were rarely used (14%). Spreadsheet software was the most popular extraction tool (83%). Piloting was reported by 74% of respondents and included a variety of approaches. Independent and duplicate extraction was considered the most appropriate approach to data collection (64%). About half of respondents agreed that blank forms and/or raw data should be published. Suggested research gaps were the effects of different methods on error rates (60%) and the use of data extraction support tools (46%). CONCLUSION Systematic reviewers used varying approaches to pilot data extraction. Methods to reduce errors and use of support tools such as (semi-)automation tools are top research gaps.
Collapse
Affiliation(s)
- Roland Brian Büchter
- Institute for Research in Operative Medicine (IFOM), Faculty of Health, School of Medicine, Witten/Herdecke University, Cologne, Germany.
| | - Tanja Rombey
- Department of Health Care Management, Technische Universität Berlin, Berlin, Germany
| | - Tim Mathes
- Institute for Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| | - Hanan Khalil
- School of Psychology and Public Health, Department of Public Health, La Trobe University, Victoria, Australia
| | - Carole Lunny
- Knowledge Translation Program, Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, Cochrane Hypertension Review Group, The Therapeutics Initiative, University of British Columbia, Vancouver, Canada
| | - Danielle Pollock
- Health Evidence Synthesis, Recommendations and Impact (HESRI), School of Public Health, Faculty of Health and Medical Sciences, University of Adelaide, Adelaide, South Australia, Australia
| | - Livia Puljak
- Center for Evidence-Based Medicine and Healthcare, Catholic University of Croatia, Zagreb, Croatia
| | - Andrea C Tricco
- Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, Toronto, Ontario, Canada; Epidemiology Division and Institute of Health Policy, Management, and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada; Queen's Collaboration for Health Care Quality: A JBI Centre of Excellence, Toronto, Ontario, Canada
| | - Dawid Pieper
- Faculty of Health Sciences Brandenburg, Brandenburg Medical School Theodor Fontane, Institute for Health Services and Health System Research, Rüdersdorf, Germany; Center for Health Services Research, Brandenburg Medical School Theodor Fontane, Rüdersdorf, Germany; Evidence Based Practice in Brandenburg: A JBI Affiliated Group, University of Adelaide, Adelaide, South Australia, Australia
| |
Collapse
|
5
|
Fraile Navarro D, Cheyne S, Hill K, McFarlane E, Morgan RL, Murad MH, Mustafa RA, Sultan S, Tunnicliffe DJ, Vogel JP, White H, Turner T. Methods for living guidelines: early guidance based on practical experience. Article 5: decisions on methods for evidence synthesis and recommendation development for living guidelines. J Clin Epidemiol 2023; 155:118-128. [PMID: 36608720 DOI: 10.1016/j.jclinepi.2022.12.022] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Revised: 12/15/2022] [Accepted: 12/21/2022] [Indexed: 01/05/2023]
Abstract
OBJECTIVES Producing living guidelines requires making important decisions about methods for evidence identification, appraisal, and integration to allow the living mode to function. Clarifying what these decisions are and the trade-offs between options is necessary. This article provides living guideline developers with a framework to enable them to choose the most suitable model for their living guideline topic, question, or context. STUDY DESIGN AND SETTING We developed this guidance through an iterative process informed by interviews, feedback, and a consensus process with an international group of living guideline developers. RESULTS Several key decisions need to be made both before commencing and throughout the continual process of living guideline development and maintenance. These include deciding what approach is taken to the systematic review process; decisions about methods to be applied for the evidence appraisal process, including the use of unpublished data; and selection of "triggers" to incorporate new studies into living guideline recommendations. In each case, there are multiple options and trade-offs. CONCLUSION We identify trade-offs and important decisions to be considered throughout the living guideline development process. The most appropriate, and most sustainable, mode of development and updating will be dependent on the choices made in each of these areas.
Collapse
Affiliation(s)
- David Fraile Navarro
- Cochrane Australia, School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia.
| | - Saskia Cheyne
- Cochrane Australia, School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| | - Kelvin Hill
- Stroke Foundation, Melbourne, Victoria, Australia
| | - Emma McFarlane
- National Institute for Health and care Excellence, Manchester, UK
| | - Rebecca L Morgan
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
| | - M Hassan Murad
- Evidence-based Practice Center, Mayo Clinic, Rochester, MN, USA
| | - Reem A Mustafa
- University of Kansas Medical Center, Kansas City, KS, USA
| | - Shahnaz Sultan
- University of Minnesota, Minneapolis Veterans Affairs Healthcare System, MN, USA
| | - David J Tunnicliffe
- Sydney School of Public Health, The University of Sydney, Sydney, New South Wales, Australia; Centre for Kidney Research, The Children's Hospital at Westmead, Sydney, New South Wales, Australia
| | - Joshua P Vogel
- Maternal, Child and Adolescent Health Program, Burnet Institute, Melbourne, Australia
| | - Heath White
- Cochrane Australia, School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| | - Tari Turner
- Cochrane Australia, School of Public Health and Preventive Medicine, Monash University, Melbourne, Victoria, Australia
| |
Collapse
|
6
|
McCann P, Kruoch Z, Qureshi R, Li T. Effectiveness of interventions for dry eye: a protocol for an overview of systematic reviews. BMJ Open 2022; 12:e058708. [PMID: 35672062 PMCID: PMC9174758 DOI: 10.1136/bmjopen-2021-058708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
INTRODUCTION Dry eye is a leading cause of ocular morbidity and economic and societal burden for patients and healthcare systems. There are several treatment options available for dry eye and high-quality systematic reviews synthesise the evidence for their effectiveness and potential harms. METHODS AND ANALYSIS We will search the Cochrane Eyes and Vision US satellite (CEV@US) database of eyes and vision systematic reviews for systematic reviews on interventions for dry eye. CEV@US conducted an initial search of PubMed and Embase to populate the CEV@US database of eyes and vision systematic reviews in 2007, which was updated most recently in August 2021. We will search the database for systematic reviews published since 1 January 2016 because systematic reviews more than 5 years are unlikely to be up to date. We will consider Cochrane and non-Cochrane systematic reviews eligible for inclusion. Two authors will independently screen articles. We will include studies that evaluate interventions for dry eye and/or meibomian gland dysfunction with no restriction on types of participants or review language. We will select reliable systematic reviews (ie, those meeting pre-established methodological criteria) for inclusion, assessed by one investigator and verified by a second investigator. We will extract ratings of the certainty of evidence from within each review. We will report the degree of overlap for systematic reviews that answer similar questions and include overlapping primary studies. We will present results of the overview in alignment with guidelines in the Cochrane Handbook of Systematic Reviews of Interventions (Online Chapter 5: Overviews of Reviews), the Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement, and an overview of reviews quality and transparency checklist. The anticipated start and completion dates for this overview are 1 May 2021 and 30 April 2022, respectively. ETHICS AND DISSEMINATION This overview will not require the approval of an Ethics Committee because it will use published studies. We will publish results in a peer-reviewed journal. PROSPERO REGISTRATION NUMBER CRD42021279880.
Collapse
Affiliation(s)
- Paul McCann
- Department of Ophthalmology, University of Colorado - Anschutz Medical Campus, Aurora, Colorado, USA
| | - Zanna Kruoch
- Cedar Springs Eye Clinic, College of Optometry, University of Houston, Houston, Texas, USA
| | - Riaz Qureshi
- Department of Ophthalmology, University of Colorado - Anschutz Medical Campus, Aurora, Colorado, USA
| | - Tianjing Li
- Department of Ophthalmology, University of Colorado - Anschutz Medical Campus, Aurora, Colorado, USA
| |
Collapse
|
7
|
McCann P, Abraham AG, Gregory DG, Hauswirth S, Ifantides C, Liu SH, Saldanha IJ, Li T. Prevalence and incidence of dry eye in the USA: a systematic review protocol. BMJ Open 2021; 11:e056203. [PMID: 34815292 PMCID: PMC8611449 DOI: 10.1136/bmjopen-2021-056203] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
INTRODUCTION Dry eye is a multifactorial chronic condition characterised by tear film insufficiency and instability, and ocular symptoms including foreign body sensation, itching, irritation, soreness and visual disturbance. The prevalence and incidence of dry eye are major determinants of the magnitude of economic and societal costs of the disease. This protocol proposes a systematic review and meta-analysis of the prevalence and incidence of dry eye in the USA. METHODS AND ANALYSIS Working with an information specialist, we will develop search strategies for Ovid Medline and Embase for population-based cross-sectional and cohort studies involving US-based populations that report the prevalence and/or incidence of dry eye. We will include studies involving persons of all ages from 1 January 2010 to the current date with no language restrictions. We will also hand-search references of included studies, dry eye epidemiology-related systematic reviews, clinical practice guidelines and literature provided by agencies and organisations. Two investigators will independently screen the titles and abstracts, and then full-text reports to determine eligibility. One investigator will extract study data and perform risk of bias assessments using tools designed specifically for prevalence and incidence studies. A second investigator will verify all extracted study data and risk of bias assessments. We will assess heterogeneity, qualitatively and quantitatively. When appropriate, we will meta-analyse prevalence and incidence estimates. ETHICS AND DISSEMINATION This review does not require approval by an ethics committee because it will use published studies. We will publish our results in a peer-reviewed journal and present at relevant conferences. PROSPERO REGISTRATION NUMBER CRD42021256934.
Collapse
Affiliation(s)
- Paul McCann
- Department of Ophthalmology, University of Colorado - Anschutz Medical Campus, Aurora, Colorado, USA
| | - Alison G Abraham
- Department of Epidemiology, Colorado School of Public Health, and Department of Ophthalmology, University of Colorado - Anschutz Medical Campus, Aurora, Colorado, USA
| | - Darren G Gregory
- Department of Ophthalmology, University of Colorado - Anschutz Medical Campus, Aurora, Colorado, USA
| | - Scott Hauswirth
- Department of Ophthalmology, University of Colorado - Anschutz Medical Campus, Aurora, Colorado, USA
| | - Cristos Ifantides
- Department of Ophthalmology, University of Colorado - Anschutz Medical Campus, Aurora, Colorado, USA
| | - Su-Hsun Liu
- Department of Ophthalmology, University of Colorado - Anschutz Medical Campus, Aurora, Colorado, USA
| | - Ian J Saldanha
- Health Services, Policy and Practice, Brown University School of Public Health, Providence, Rhode Island, USA
| | - Tianjing Li
- Department of Ophthalmology, University of Colorado - Anschutz Medical Campus, Aurora, Colorado, USA
| |
Collapse
|
8
|
Büchter RB, Weise A, Pieper D. Reporting of methods to prepare, pilot and perform data extraction in systematic reviews: analysis of a sample of 152 Cochrane and non-Cochrane reviews. BMC Med Res Methodol 2021; 21:240. [PMID: 34742231 PMCID: PMC8571672 DOI: 10.1186/s12874-021-01438-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Accepted: 10/11/2021] [Indexed: 12/02/2022] Open
Abstract
BACKGROUND Previous research on data extraction methods in systematic reviews has focused on single aspects of the process. We aimed to provide a deeper insight into these methods by analysing a current sample of reviews. METHODS We included systematic reviews of health interventions in humans published in English. We analysed 75 Cochrane reviews from May and June 2020 and a random sample of non-Cochrane reviews published in the same period and retrieved from Medline. We linked reviews with protocols and study registrations. We collected information on preparing, piloting, and performing data extraction and on use of software to assist review conduct (automation tools). Data were extracted by one author, with 20% extracted in duplicate. Data were analysed descriptively. RESULTS Of the 152 included reviews, 77 reported use of a standardized extraction form (51%); 42 provided information on the type of form used (28%); 24 on piloting (16%); 58 on what data was collected (38%); 133 on the extraction method (88%); 107 on resolving disagreements (70%); 103 on methods to obtain additional data or information (68%); 52 on procedures to avoid data errors (34%); and 47 on methods to deal with multiple study reports (31%). Items were more frequently reported in Cochrane than non-Cochrane reviews. The data extraction form used was published in 10 reviews (7%). Use of software was rarely reported except for statistical analysis software and use of RevMan and GRADEpro GDT in Cochrane reviews. Covidence was the most frequent automation tool used: 18 reviews used it for study selection (12%) and 9 for data extraction (6%). CONCLUSIONS Reporting of data extraction methods in systematic reviews is limited, especially in non-Cochrane reviews. This includes core items of data extraction such as methods used to manage disagreements. Few reviews currently use software to assist data extraction and review conduct. Our results can serve as a baseline to assess the uptake of such tools in future analyses.
Collapse
Affiliation(s)
- Roland Brian Büchter
- Institute for Research in Operative Medicine (IFOM), Faculty of Health, School of Medicine, Witten/Herdecke University, Ostmerheimer Str. 200, 51109 Cologne, Germany
| | - Alina Weise
- Institute for Research in Operative Medicine (IFOM), Faculty of Health, School of Medicine, Witten/Herdecke University, Ostmerheimer Str. 200, 51109 Cologne, Germany
| | - Dawid Pieper
- Institute for Research in Operative Medicine (IFOM), Faculty of Health, School of Medicine, Witten/Herdecke University, Ostmerheimer Str. 200, 51109 Cologne, Germany
- Faculty of Health Sciences Brandenburg, Brandenburg Medical School Theodor Fontane, Institute for Health Services and Health System Research, Rüdersdorf, Germany
- Center for Health Services Research, Brandenburg Medical School Theodor Fontane, Rüdersdorf, Germany
| |
Collapse
|
9
|
Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, McKenzie JE. PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ 2021; 372:n160. [PMID: 33781993 PMCID: PMC8005925 DOI: 10.1136/bmj.n160+10.1136/bmj.n160] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/26/2023]
Abstract
The methods and results of systematic reviews should be reported in sufficient detail to allow users to assess the trustworthiness and applicability of the review findings. The Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) statement was developed to facilitate transparent and complete reporting of systematic reviews and has been updated (to PRISMA 2020) to reflect recent advances in systematic review methodology and terminology. Here, we present the explanation and elaboration paper for PRISMA 2020, where we explain why reporting of each item is recommended, present bullet points that detail the reporting recommendations, and present examples from published reviews. We hope that changes to the content and structure of PRISMA 2020 will facilitate uptake of the guideline and lead to more transparent, complete, and accurate reporting of systematic reviews.
Collapse
Affiliation(s)
- Matthew J Page
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada; School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Canada
| | - Patrick M Bossuyt
- Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Amsterdam University Medical Centres, University of Amsterdam, Amsterdam, Netherlands
| | - Isabelle Boutron
- Université de Paris, Centre of Epidemiology and Statistics (CRESS), Inserm, F 75004 Paris, France
| | - Tammy C Hoffmann
- Institute for Evidence-Based Healthcare, Faculty of Health Sciences and Medicine, Bond University, Gold Coast, Australia
| | - Cynthia D Mulrow
- University of Texas Health Science Center at San Antonio, San Antonio, Texas, United States; Annals of Internal Medicine
| | - Larissa Shamseer
- Knowledge Translation Program, Li Ka Shing Knowledge Institute, Toronto, Canada; School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Canada
| | | | - Elie A Akl
- Clinical Research Institute, American University of Beirut, Beirut, Lebanon; Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Sue E Brennan
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Roger Chou
- Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, Oregon, United States
| | - Julie Glanville
- York Health Economics Consortium (YHEC Ltd), University of York, York, UK
| | - Jeremy M Grimshaw
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada; School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada; Department of Medicine, University of Ottawa, Ottawa, Canada
| | - Asbjørn Hróbjartsson
- Centre for Evidence-Based Medicine Odense, Odense University Hospital, Odense, Denmark; Department of Clinical Research, University of Southern Denmark, Odense, Denmark; Open Patient data Explorative Network, Odense University Hospital, Odense, Denmark
| | - Manoj M Lalu
- Department of Anesthesiology and Pain Medicine, The Ottawa Hospital, Ottawa, Canada; Clinical Epidemiology Program, Blueprint Translational Research Group, Ottawa Hospital Research Institute, Ottawa, Canada; Regenerative Medicine Program, Ottawa Hospital Research Institute, Ottawa, Canada
| | - Tianjing Li
- Department of Ophthalmology, School of Medicine, University of Colorado Denver, Denver, Colorado, United States; Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States
| | - Elizabeth W Loder
- Division of Headache, Department of Neurology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States; Head of Research, The BMJ, London, UK
| | - Evan Mayo-Wilson
- Department of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, Bloomington, Indiana, United States
| | - Steve McDonald
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Luke A McGuinness
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Lesley A Stewart
- Centre for Reviews and Dissemination, University of York, York, UK
| | - James Thomas
- EPPI-Centre, UCL Social Research Institute, University College London, London, UK
| | - Andrea C Tricco
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, Unity Health Toronto, Toronto, Canada; Epidemiology Division of the Dalla Lana School of Public Health and the Institute of Health Management, Policy, and Evaluation, University of Toronto, Toronto, Canada; Queen's Collaboration for Health Care Quality Joanna Briggs Institute Centre of Excellence, Queen's University, Kingston, Canada
| | - Vivian A Welch
- Methods Centre, Bruyère Research Institute, Ottawa, Ontario, Canada; School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Canada
| | - Penny Whiting
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Joanne E McKenzie
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| |
Collapse
|
10
|
Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, McKenzie JE. PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ : BRITISH MEDICAL JOURNAL 2021. [DOI: 10.1136/bmj.n160 10.1136/bmj.n160] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
|
11
|
Page MJ, Moher D, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R, Glanville J, Grimshaw JM, Hróbjartsson A, Lalu MM, Li T, Loder EW, Mayo-Wilson E, McDonald S, McGuinness LA, Stewart LA, Thomas J, Tricco AC, Welch VA, Whiting P, McKenzie JE. PRISMA 2020 explanation and elaboration: updated guidance and exemplars for reporting systematic reviews. BMJ 2021; 372:n160. [PMID: 33781993 PMCID: PMC8005925 DOI: 10.1136/bmj.n160] [Citation(s) in RCA: 3101] [Impact Index Per Article: 1033.7] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 01/04/2021] [Indexed: 12/16/2022]
Affiliation(s)
- Matthew J Page
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada; School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Canada
| | - Patrick M Bossuyt
- Department of Clinical Epidemiology, Biostatistics and Bioinformatics, Amsterdam University Medical Centres, University of Amsterdam, Amsterdam, Netherlands
| | - Isabelle Boutron
- Université de Paris, Centre of Epidemiology and Statistics (CRESS), Inserm, F 75004 Paris, France
| | - Tammy C Hoffmann
- Institute for Evidence-Based Healthcare, Faculty of Health Sciences and Medicine, Bond University, Gold Coast, Australia
| | - Cynthia D Mulrow
- University of Texas Health Science Center at San Antonio, San Antonio, Texas, United States; Annals of Internal Medicine
| | - Larissa Shamseer
- Knowledge Translation Program, Li Ka Shing Knowledge Institute, Toronto, Canada; School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Canada
| | | | - Elie A Akl
- Clinical Research Institute, American University of Beirut, Beirut, Lebanon; Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Sue E Brennan
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Roger Chou
- Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, Oregon, United States
| | - Julie Glanville
- York Health Economics Consortium (YHEC Ltd), University of York, York, UK
| | - Jeremy M Grimshaw
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada; School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada; Department of Medicine, University of Ottawa, Ottawa, Canada
| | - Asbjørn Hróbjartsson
- Centre for Evidence-Based Medicine Odense, Odense University Hospital, Odense, Denmark; Department of Clinical Research, University of Southern Denmark, Odense, Denmark; Open Patient data Explorative Network, Odense University Hospital, Odense, Denmark
| | - Manoj M Lalu
- Department of Anesthesiology and Pain Medicine, The Ottawa Hospital, Ottawa, Canada; Clinical Epidemiology Program, Blueprint Translational Research Group, Ottawa Hospital Research Institute, Ottawa, Canada; Regenerative Medicine Program, Ottawa Hospital Research Institute, Ottawa, Canada
| | - Tianjing Li
- Department of Ophthalmology, School of Medicine, University of Colorado Denver, Denver, Colorado, United States; Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland, United States
| | - Elizabeth W Loder
- Division of Headache, Department of Neurology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, United States; Head of Research, The BMJ, London, UK
| | - Evan Mayo-Wilson
- Department of Epidemiology and Biostatistics, Indiana University School of Public Health-Bloomington, Bloomington, Indiana, United States
| | - Steve McDonald
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| | - Luke A McGuinness
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Lesley A Stewart
- Centre for Reviews and Dissemination, University of York, York, UK
| | - James Thomas
- EPPI-Centre, UCL Social Research Institute, University College London, London, UK
| | - Andrea C Tricco
- Li Ka Shing Knowledge Institute of St. Michael's Hospital, Unity Health Toronto, Toronto, Canada; Epidemiology Division of the Dalla Lana School of Public Health and the Institute of Health Management, Policy, and Evaluation, University of Toronto, Toronto, Canada; Queen's Collaboration for Health Care Quality Joanna Briggs Institute Centre of Excellence, Queen's University, Kingston, Canada
| | - Vivian A Welch
- Methods Centre, Bruyère Research Institute, Ottawa, Ontario, Canada; School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Canada
| | - Penny Whiting
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Joanne E McKenzie
- School of Public Health and Preventive Medicine, Monash University, Melbourne, Australia
| |
Collapse
|