1
|
Ibragimova I, Fulbright H. Librarians and information specialists as methodological peer-reviewers: a case-study of the International Journal of Health Governance. Res Integr Peer Rev 2024; 9:1. [PMID: 38238865 PMCID: PMC10797710 DOI: 10.1186/s41073-023-00142-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Accepted: 12/28/2023] [Indexed: 01/22/2024] Open
Abstract
BACKGROUND Objectives of this study were to analyze the impact of including librarians and information specialist as methodological peer-reviewers. We sought to determine if and how librarians' comments differed from subject peer-reviewers'; whether there were differences in the implementation of their recommendations; how this impacted editorial decision-making; and the perceived utility of librarian peer-review by librarians and authors. METHODS We used a mixed method approach, conducting a qualitative analysis of reviewer reports, author replies and editors' decisions of submissions to the International Journal of Health Governance. Our content analysis categorized 16 thematic areas, so that methodological and subject peer-reviewers' comments, decisions and rejection rates could be compared. Categories were based on the standard areas covered in peer-review (e.g., title, originality, etc.) as well as additional in-depth categories relating to the methodology (e.g., search strategy, reporting guidelines, etc.). We developed and used criteria to judge reviewers' perspectives and code their comments. We conducted two online multiple-choice surveys which were qualitatively analyzed: one of methodological peer-reviewers' perceptions of peer-reviewing, the other of published authors' views on the suggested revisions. RESULTS Methodological peer-reviewers assessed 13 literature reviews submitted between September 2020 and March 2023. 55 reviewer reports were collected: 25 from methodological peer-reviewers, 30 from subject peer-reviewers (mean: 4.2 reviews per manuscript). Methodological peer-reviewers made more comments on methodologies, with authors more likely to implement their changes (52 of 65 changes, vs. 51 of 82 by subject peer-reviewers); they were also more likely to reject submissions (seven vs. four times, respectively). Where there were differences in recommendations to editors, journal editors were more likely to follow methodological peer-reviewers (nine vs. three times, respectively). The survey of published authors (87.5% response rate) revealed four of seven found comments on methodologies helpful. Librarians' survey responses (66.5% response rate) revealed those who conducted peer-reviews felt they improved quality of publications. CONCLUSIONS Librarians can enhance evidence synthesis publications by ensuring methodologies have been conducted and reported appropriately. Their recommendations helped authors revise submissions and facilitated editorial decision-making. Further research could determine if sharing reviews with subject peer-reviewers and journal editors could benefit them in better understanding of evidence synthesis methodologies.
Collapse
Affiliation(s)
- Irina Ibragimova
- HealthConnect International, F. Fanceva 70, Zadar, 23000, Croatia.
| | - Helen Fulbright
- Centre for Reviews and Dissemination, University of York, York, UK
| |
Collapse
|
2
|
Whear R, Bethel A, Abbott R, Rogers M, Orr N, Manzi S, Ukoumunne OC, Stein K, Coon JT. Systematic reviews of convalescent plasma in COVID-19 continue to be poorly conducted and reported: a systematic review. J Clin Epidemiol 2022; 151:53-64. [PMID: 35934268 PMCID: PMC9351208 DOI: 10.1016/j.jclinepi.2022.07.005] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Revised: 05/18/2022] [Accepted: 07/07/2022] [Indexed: 12/25/2022]
Abstract
OBJECTIVES To suggest possible approaches to combatting the impact of the COVID-19 infodemic to prevent research waste in future health emergencies and in everyday research and practice. STUDY DESIGN AND SETTING Systematic review. The Epistemonikos database was searched in June 2021 for systematic reviews on the effectiveness of convalescent plasma for COVID-19. Two reviewers independently screened the retrieved references with disagreements resolved by discussion. Data extraction was completed by one reviewer with a proportion checked by a second. We used the Assessment of Multiple Systematic Reviews to assess the quality of conduct and reporting of included reviews. RESULTS Fifty one systematic reviews are included with 193 individual studies included within the systematic reviews. There was considerable duplication of effort; multiple reviews were conducted at the same time with inconsistencies in the evidence included. The reviews were of low methodological quality, poorly reported, and did not adhere to preferred reporting items for systematic reviews and meta-analysis guidance. CONCLUSION Researchers need to conduct, appraise, interpret, and disseminate systematic reviews better. All in the research community (researchers, peer-reviewers, journal editors, funders, decision makers, clinicians, journalists, and the public) need to work together to facilitate the conduct of robust systematic reviews that are published and communicated in a timely manner, reducing research duplication and waste, increasing transparency and accessibility of all systematic reviews.
Collapse
Affiliation(s)
- Rebecca Whear
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK,Corresponding author. St Lukes Campus, University of Exeter, 3.09 South Cloisters, Heavitree Road, Exeter EX1 2LU. Tel.: +1392 726064
| | - Alison Bethel
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Rebecca Abbott
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Morwenna Rogers
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Noreen Orr
- Evidence Synthesis Team, University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Sean Manzi
- National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Obioha C. Ukoumunne
- National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Ken Stein
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| | - Jo Thompson Coon
- Evidence Synthesis Team, National Institute for Health Research (NIHR) Applied Research Collaboration (ARC) South West Peninsula (PenARC), University of Exeter Medical School, College of Medicine and Health, University of Exeter, Exeter, Devon, UK
| |
Collapse
|