1
|
Chung Z, Mbuagbaw L, Mokete L, Bhandari M, Thabane L. Quality and completeness of, and spin in reporting of, pilot and feasibility studies in hip and knee arthroplasty: a protocol for a methodological survey. BMJ Open 2024; 14:e085441. [PMID: 39384225 DOI: 10.1136/bmjopen-2024-085441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/11/2024] Open
Abstract
INTRODUCTION Pilot or feasibility trials examine the feasibility, viability and recruitment potential of larger, main trials. Specifically, a pilot trial can be instrumental in identifying methodological issues essential to the development of an effective research protocol. However, numerous studies published as pilot or feasibility studies have demonstrated notable inconsistencies in the nature of information reported, resulting in poor-quality and incomplete reporting. It is unclear whether such low quality or incompleteness of reporting is also prevalent in arthroplasty pilot trials. METHODS AND ANALYSIS This protocol outlines a methodological survey examining the completeness of reporting among hip and knee arthroplasty pilot trials in accordance with the Consolidated Standards of Reporting Trials (CONSORT) 2010 extension to pilot trials. Secondary objectives include: (1) determining the prevalence of 'spin' practices, defined as: (a) placing a focus on statistical significance rather than feasibility, (b) presenting results that show the trial to be non-feasible as feasible or (c) emphasising the effectiveness or potential intervention benefits rather than feasibility; (2) determining factors associated with incomplete reporting, and 'spin'. A search of PubMed will be conducted for pilot trials in hip or knee arthroplasty published between 01 January 2017 and 31 December 2023. Following screening, appropriate data will be extracted from eligible publications and reported as descriptive statistics, encompassing elements of the CONSORT checklist associated with completeness of reporting. Logistic regression analysis and Poisson regression will be used to analyse factors associated with completeness of reporting and spin. ETHICS AND DISSEMINATION This methodological review does not require formal ethical approval, as it will solely involve the use of published and publicly reported literature. The results of this study will be disseminated through submission to peer-reviewed journals and academic conference presentations. Study details will be sent to McMaster University's media coordinators to be shared through the institution's research-focused platforms.
Collapse
Affiliation(s)
- Zinnia Chung
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Lawrence Mbuagbaw
- Department of Health Research Methods Evidence and Impact, McMaster University, Hamilton, Ontario, Canada
- Biostatistics Unit, Father Sean O'Sullivan Research Centre, St Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada
| | - Lipalo Mokete
- Division of Orthopaedic Surgery, University of the Witwatersrand Johannesburg, Johannesburg, Gauteng, South Africa
| | - Mohit Bhandari
- Department of Surgery, McMaster University, Hamilton, Ontario, Canada
| | - Lehana Thabane
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Research Institute, St Joseph's Healthcare Hamilton, Hamilton, Ontario, Canada
| |
Collapse
|
2
|
Shirafkan H, Moher D, Mirabi P. The reporting quality and spin of randomized controlled trials of endometriosis pain: Methodological study based on CONSORT extension on abstracts. PLoS One 2024; 19:e0302108. [PMID: 38696383 PMCID: PMC11065215 DOI: 10.1371/journal.pone.0302108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Accepted: 03/27/2024] [Indexed: 05/04/2024] Open
Abstract
OBJECTIVE To assess the reporting quality of published RCT abstracts regarding patients with endometriosis pelvic pain and investigate the prevalence and characteristics of spin in these abstracts. METHODS PubMed and Scopus were searched for RCT abstracts addressing endometriosis pelvic pain published from January 1st, 2010 to December 1st, 2023.The reporting quality of RCT abstracts was assessed using the CONSORT statement for abstracts. Additionally, spin was evaluated in the results and conclusions section of the abstracts, defined as the misleading reporting of study findings to emphasize the perceived benefits of an intervention or to confound readers from statistically non-significant results. Assessing factors affecting the reporting quality and spin existence, linear and logistic regression was used, respectively. RESULTS A total of 47 RCT abstracts were included. Out of 16 checklist items, only three items including objective, intervention and conclusions were sufficiently reported in the most abstracts (more than 95%), and none of the abstracts presented precise data as required by the CONSORT-A guidelines. In the reporting quality of material and method section, trial design, type of randomization, the generation of random allocation sequences, the allocation concealment and blinding were most items identified that were suboptimal. The total score for the quality varied between 5 and 15 (mean: 9.59, SD: 3.03, median: 9, IQR: 5). Word count (beta = 0.015, p-value = 0.005) and publishing in open-accessed journals (beta = 2.023, p-value = 0.023) were the significant factors that affecting the reporting quality. Evaluating spin within each included paper, we found that 18 (51.43%) papers had statistically non-significant results. From these studies, 12 (66.66%) had spin in both results and conclusion sections. Furthermore, the spin intensity increased during 2010-2023 and 38.29% of abstracts had spin in both results and conclusion sections. CONCLUSION Overall poor adherence to CONSORT-A was observed, with spin detected in several RCTs featuring non-significant primary endpoints in obstetrics and gynecology literature.
Collapse
Affiliation(s)
- Hoda Shirafkan
- Social Determinants of Health Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran
| | - David Moher
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | - Parvaneh Mirabi
- Infertility and Reproductive Health Research Center, Health Research Institute, Babol University of Medical Sciences, Babol, Iran
| |
Collapse
|
3
|
Yang Y, Yang S, Han Y, Zou G, Wang R, Liu L. Quality reporting of randomized controlled trials on SGLT2 inhibitors for heart failure: a comprehensive assessment. Sci Rep 2024; 14:6819. [PMID: 38514865 PMCID: PMC10958037 DOI: 10.1038/s41598-024-57514-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Accepted: 03/19/2024] [Indexed: 03/23/2024] Open
Abstract
Randomised controlled trials (RCTs) provide clinicians with the best evidence of the effectiveness of an intervention, and complete and transparent trial reports help to critically assess and use trial results. The objective of our study was to assess the quality of reporting in RCTs of sodium-glucose co-transporter protein 2 (SGLT2) inhibitors for heart failure (HF) and identify factors associated with improved reporting quality. Two researchers conducted a comprehensive search in four databases (PubMed, Web of Science, EMBASE, and Cochrane). The quality of each report was assessed using a 25-point Overall Quality Score (OQS) based on the guidelines provided in the 2010 Consolidated Standards for Reporting of Trials (CONSORT) statement. We included a total of 58 relevant RCTs. The median OQS in the 2010 CONSORT statement was 15 (range 7.5-24). The missing items were primarily found in the 'Methods' and 'Results' sections of the 2010 CONSORT statement. Multivariate regression modeling revealed that a more recent publication year, high impact factor, and large sample size were significant predictors of OQS improvement. The findings suggest that the overall quality of reported RCTs of SGLT2 inhibitors in HF is unsatisfactory, which reduces their potential usefulness.
Collapse
Affiliation(s)
- YueGuang Yang
- Heilongjiang University of Chinese Medicine, Harbin, Heilongjiang, 150040, People's Republic of China
| | - ShunWen Yang
- Heilongjiang University of Chinese Medicine, Harbin, Heilongjiang, 150040, People's Republic of China
| | - YuBo Han
- The First Department of Cardiovascular, First Affiliated Hospital, Heilongjiang University of Chinese Medicine, 26 Heping Road, Xiangfang, Harbin, Heilongjiang, 150040, People's Republic of China
| | - GuoLiang Zou
- The First Department of Cardiovascular, First Affiliated Hospital, Heilongjiang University of Chinese Medicine, 26 Heping Road, Xiangfang, Harbin, Heilongjiang, 150040, People's Republic of China
| | - RuiNan Wang
- The First Department of Cardiovascular, First Affiliated Hospital, Heilongjiang University of Chinese Medicine, 26 Heping Road, Xiangfang, Harbin, Heilongjiang, 150040, People's Republic of China
| | - Li Liu
- The First Department of Cardiovascular, First Affiliated Hospital, Heilongjiang University of Chinese Medicine, 26 Heping Road, Xiangfang, Harbin, Heilongjiang, 150040, People's Republic of China.
| |
Collapse
|
4
|
Talukdar JR, Chu A, Garg A, Chowdhury F, E. Harnack H, Huang L, Sikorski C, Mbuagbaw L, de Souza RJ. Assessment of reporting quality of randomized controlled trials investigating the effects of inulin-type fructans supplementation on cardiovascular disease risk factors: A systematic survey. PLoS One 2024; 19:e0292184. [PMID: 38166017 PMCID: PMC10760872 DOI: 10.1371/journal.pone.0292184] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2023] [Accepted: 09/11/2023] [Indexed: 01/04/2024] Open
Abstract
BACKGROUND Transparent and detailed reporting of randomized controlled trials (RCTs) is essential to judge its validity and generalizability. We assessed the reporting quality of RCTs examining the effects of inulin-type fructans supplementation on cardiovascular risk factors, before and after the publication of the Consolidated Standards of Reporting Trials (CONSORT) in 2010. METHODS We searched MEDLINE, EMBASE, Emcare, AMED, the Cochrane Library, and CINAHL from inception to May 15, 2022, including the reference lists of selected RCTs. We screened titles and abstracts and extracted the data independently and in duplicate. We included RCTs that investigated the effects of inulin-type fructans on cardiovascular disease risk factors (e.g., low-density lipoprotein cholesterol, triglycerides, fasting blood glucose) in adults (18 years or older). The primary outcomes of this study were: the overall reporting quality of RCTs (defined as the total number of items [0 to 36] present from the CONSORT checklist) published before and after CONSORT; and the study characteristics (e.g., sample size, significance of primary outcome) predictive of the CONSORT score. The secondary outcome was the reporting of each specific item of the CONSORT checklist during pre- and post-CONSORT periods. The mean difference in the total number of reported items in studies published before and after CONSORT were compared using a t-test and Poisson regression to explore the factors associated with overall reporting quality of RCTs. We used Fisher's exact test to compare the adherence to each of the 36 items during pre- and post-CONSORT periods. RESULTS We identified 1,767 citations from our systematic search, of which 55 were eligible. There was a significant increase in the reporting of CONSORT items (mean difference 8.5, 95% confidence interval [CI] 5.24 to 11.71) between studies published before and after publication of CONSORT. The sole variable that was predictive of better reporting quality of RCTs was whether the study was published before or after CONSORT (incidence rate ratio 1.67, 95% CI 1.40 to 2.02). Completeness of reporting of RCTs only improved in 15 out of 36 items (41.6%) after the publication of CONSORT. CONCLUSION The completeness of reporting in RCTs investigating inulin-type fructans supplementation on cardiovascular disease risk factors remains inadequate after the publication of CONSORT. Greater adherence to CONSORT by authors and enforcement of CONSORT by journals may improve the quality of reporting among RCTs.
Collapse
Affiliation(s)
- Jhalok Ronjan Talukdar
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Alexandro Chu
- Department of Medicine, McMaster University, Hamilton, Ontario, Canada
| | - Anika Garg
- Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Fariha Chowdhury
- School of Rehabilitation Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Hope E. Harnack
- Department of Kinesiology, McMaster University, Hamilton, Ontario, Canada
| | - Louise Huang
- Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada
| | - Claudia Sikorski
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Population Health Research Institute, Hamilton Health Sciences Corporation, Hamilton, Ontario, Canada
| | - Lawrence Mbuagbaw
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Department of Anesthesia, McMaster University, Hamilton, Ontario, Canada
- Department of Pediatrics, McMaster University, Hamilton, Ontario, Canada
- Biostatistics Unit, Father Sean O’Sullivan Research Centre, St Joseph’s Healthcare, Hamilton, Ontario, Canada
- Centre for Development of Best Practices in Health (CDBPH), Yaoundé Central Hospital, Yaoundé, Cameroon
- Department of Global Health, Stellenbosch University, Cape Town, South Africa
| | - Russell J. de Souza
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
- Population Health Research Institute, Hamilton Health Sciences Corporation, Hamilton, Ontario, Canada
- Toronto 3D Knowledge Synthesis and Clinical Trials Unit, Clinical Nutrition, St Michael’s Hospital, Toronto, ON, Canada
- Clinical Nutrition & Risk Factor Modification Centre, St. Michael’s Hospital, Toronto, Ontario, Canada
- Li Ka Shing Knowledge Institute, St. Michael’s Hospital, Toronto, Ontario, Canada
- Global Health Graduate Program, McMaster University, Hamilton, Ontario, Canada
| |
Collapse
|
5
|
Grüßer L, Eißing C, Kowark A, Keszei AP, Wallqvist J, Rossaint R, Ziemann S. Poor reporting quality of randomized controlled trials comparing treatments of COVID-19-A retrospective cross-sectional study on the first year of publications. PLoS One 2023; 18:e0292860. [PMID: 37844082 PMCID: PMC10578566 DOI: 10.1371/journal.pone.0292860] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2023] [Accepted: 09/21/2023] [Indexed: 10/18/2023] Open
Abstract
INTRODUCTION Transparent and complete reporting of randomized controlled trials (RCTs) is essential for critical scientific appraisal of the results. It has been argued whether publications during the COVID-19 pandemic have met reporting standards. In this study, we assessed reporting adherence of RCTs on treatment interventions in COVID-19 patients to the CONSORT checklist and discuss which lessons can be learned to improve reporting in the future. METHODS This was a retrospective, cross-sectional study performed at the University Hospital RWTH Aachen, Germany. We conducted a pragmatic systematic literature search in the PubMed database to identify RCTs on treatment interventions in COVID-19 patients in the first year of publications on the topic (March 2020-February 2021). We investigated the adherence of each publication to the CONSORT checklist and assessed the association between specific predictors and percentage adherence in an exploratory multivariable regression model. RESULTS We analyzed 127 RCTs and found that the median percentage adherence to the CONSORT checklist was 54.3% [IQR 38.9 to 65.7]. In the exploratory multivariable regression model, the impact factor (highest tertile of impact factor compared to lowest tertile ß = 21.77, 95% CI 13.89 to 29.66, p<0.001; middle tertile compared lowest tertile ß = 11.79, 95% CI 5.74 to 17.84, p<0.001)) and authors' referral to the CONSORT statement (ß = 9.29, 95% CI 2.98 to 15.60, p = 0.004) were associated with a higher percentage adherence to the CONSORT checklist. CONCLUSION The reporting quality of RCTs on treatment interventions in COVID-19 patients during the first year of publications was poor. Measures to improve reporting quality are urgently needed.
Collapse
Affiliation(s)
- Linda Grüßer
- Department of Anesthesiology, University Hospital RWTH Aachen, Aachen, Germany
| | - Charlotte Eißing
- Department of Dermatology, Fachklinik Hornweide, Muenster, Germany
| | - Ana Kowark
- Department of Anesthesiology and Intensive Care Medicine, University Hospital Bonn, Bonn, Germany
| | - András P. Keszei
- Center for Translational & Clinical Research Aachen (CTC-A), Medical Faculty RWTH Aachen University, Aachen, Germany
| | - Julia Wallqvist
- Department of Anesthesiology, University Hospital RWTH Aachen, Aachen, Germany
| | - Rolf Rossaint
- Department of Anesthesiology, University Hospital RWTH Aachen, Aachen, Germany
| | - Sebastian Ziemann
- Department of Anesthesiology, University Hospital RWTH Aachen, Aachen, Germany
| |
Collapse
|
6
|
Kilicoglu H, Jiang L, Hoang L, Mayo-Wilson E, Vinkers CH, Otte WM. Methodology reporting improved over time in 176,469 randomized controlled trials. J Clin Epidemiol 2023; 162:19-28. [PMID: 37562729 PMCID: PMC10829891 DOI: 10.1016/j.jclinepi.2023.08.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 07/25/2023] [Accepted: 08/02/2023] [Indexed: 08/12/2023]
Abstract
OBJECTIVES To describe randomized controlled trial (RCT) methodology reporting over time. STUDY DESIGN AND SETTING We used a deep learning-based sentence classification model based on the Consolidated Standards of Reporting Trials (CONSORT) statement, considered minimum requirements for reporting RCTs. We included 176,469 RCT reports published between 1966 and 2018. We analyzed the reporting trends over 5-year time periods, grouping trials from 1966 to 1990 in a single stratum. We also explored the effect of journal impact factor (JIF) and medical discipline. RESULTS Population, Intervention, Comparator, Outcome (PICO) items were commonly reported during each period, and reporting increased over time (e.g., interventions: 79.1% during 1966-1990 to 87.5% during 2010-2018). Reporting of some methods information has increased, although there is room for improvement (e.g., sequence generation: 10.8-41.8%). Some items are reported infrequently (e.g., allocation concealment: 5.1-19.3%). The number of items reported and JIF are weakly correlated (Pearson's r (162,702) = 0.16, P < 0.001). The differences in the proportion of items reported between disciplines are small (<10%). CONCLUSION Our analysis provides large-scale quantitative support for the hypothesis that RCT methodology reporting has improved over time. Extending these models to all CONSORT items could facilitate compliance checking during manuscript authoring and peer review, and support metaresearch.
Collapse
Affiliation(s)
- Halil Kilicoglu
- School of Information Sciences, University of Illinois Urbana-Champaign, Champaign, IL, USA.
| | - Lan Jiang
- School of Information Sciences, University of Illinois Urbana-Champaign, Champaign, IL, USA
| | - Linh Hoang
- School of Information Sciences, University of Illinois Urbana-Champaign, Champaign, IL, USA
| | - Evan Mayo-Wilson
- Department of Epidemiology, University of North Carolina School of Global Public Health, Chapel Hill, NC, USA
| | - Christiaan H Vinkers
- Department of Psychiatry and Anatomy & Neurosciences, Amsterdam University Medical Center Location Vrije Universiteit Amsterdam, 1081 HV, Amsterdam, The Netherlands; Amsterdam Public Health, Mental Health Program and Amsterdam Neuroscience, Mood, Anxiety, Psychosis, Sleep & Stress Program, Amsterdam, The Netherlands; GGZ inGeest Mental Health Care, 1081 HJ, Amsterdam, The Netherlands
| | - Willem M Otte
- Department of Child Neurology, UMC Utrecht Brain Center, University Medical Center Utrecht, and Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
7
|
He Y, Zhang R, Shan W, Yin Y, Zhang X, Zhang Y, Wang X. Evaluating the completeness of the reporting of abstracts since the publication of the CONSORT extension for abstracts: an evaluation of randomized controlled trial in ten nursing journals. Trials 2023; 24:423. [PMID: 37349754 DOI: 10.1186/s13063-023-07419-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 05/27/2023] [Indexed: 06/24/2023] Open
Abstract
BACKGROUND As a practice-oriented discipline, strict adherence to reporting guidelines is particularly important in randomized controlled trial (RCT) abstracts of the nursing area. However, whether abstract reports after 2010 have complied with the Consolidated Standards of Reporting Trials for Abstracts (CONSORT-A) guideline is unclear. This study aimed to evaluate whether the publication of CONSORT-A has improved abstract reporting in nursing and explores the factors associated with better adherence to the guidelines. METHODS We searched the Web of Science for 200 RCTs randomly selected from ten nursing journals. We used a data extraction form based on CONSORT-A, including 16 items, to analyze the reporting adherence to the guidelines, and the reporting rate of each item and the total score for each abstract were used to indicate adherence and overall quality score (OQS, range 0-16). A comparison of the total mean score between the two periods was made, and affecting factors were analyzed. RESULTS In the studies we included, 48 abstracts were published pre-CONSORT-A whereas 152 post-CONSORT-A. The overall mean score for reporting adherence to 16 items was 7.41 ± 2.78 and 9.16 ± 2.76 for pre- and post-CONSORT-A, respectively (total score: 16). The most poorly reported items are "harms (0%)," "outcomes in method (8.5%)," "randomization (25%)," and "blinding (6.5%)." Items including the year of publication, impact factor, multiple center trial, word count, and structured abstract are significantly associated with higher adherence. CONCLUSIONS The adherence to abstract reporting in nursing literature has improved since the CONSORT-A era, but the overall completeness of RCT abstracts remained low. A joint effort by authors, editors, and journals is necessary to improve reporting quality of RCT abstracts.
Collapse
Affiliation(s)
- Yan He
- Health Human Resources Service Center, Health Commission of Gansu Province, Lanzhou, Gansu, 730000, China
| | - Rong Zhang
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Wenjing Shan
- Oncology Department, Nursing, Xi'an International Medical Center, Xi'an, 710000, Shaanxi, China
| | - Yuhuan Yin
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Xiaoli Zhang
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Yiyin Zhang
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Xiaoping Wang
- Urological Examination Room, Gansu Provincial Hospital, Lanzhou, 730000, Gansu, China.
| |
Collapse
|
8
|
Purja S, Park S, Oh S, Kim M, Kim E. Reporting quality was suboptimal in a systematic review of randomized controlled trials with adaptive designs. J Clin Epidemiol 2023; 154:85-96. [PMID: 36528234 DOI: 10.1016/j.jclinepi.2022.12.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 12/04/2022] [Accepted: 12/12/2022] [Indexed: 12/23/2022]
Abstract
OBJECTIVE The study was conducted to evaluate the reporting quality of randomized controlled trials (RCTs) that use an adaptive design (AD) based on the 2020 AD Consolidated Standards for Reporting Trials 2010 extension (ACE) guidelines and identify factors associated with better reporting quality. STUDY DESIGN AND SETTING PubMed, Embase, Cochrane, Web of Science, and Google Scholar were searched until November 1, 2022. Multivariable linear regression analysis was performed to investigate potential predictors. RESULTS In total, 109 RCTs were included in our study. The mean compliance rate for the ACE checklist items was 69.75% ± 16.02. Key methodological items including allocation concealment and its implementations were poorly reported. There was also suboptimal reporting of checklist items related to the conduct of interim analyzes. Multivariable regression analysis showed better reporting quality with trial registration, nonindustry affiliation (first author), a sample size of >100, general medical journal type, publication date (≥2020), funding, and disclosure of the number of interim analyzes. CONCLUSION Our study showed that RCTs with AD had suboptimal reporting of 2020 ACE checklist items, particularly AD-specific items. Following the development of ACE guidelines, stricter adherence to the ACE guideline is necessary to improve their reporting quality. Pre-ACE and post-ACE adherence comparisons can be conducted in the future.
Collapse
Affiliation(s)
- Sujata Purja
- Evidence-Based and Clinical Research Laboratory, Department of Health, Social and Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea
| | - Sunuk Park
- Evidence-Based and Clinical Research Laboratory, Department of Health, Social and Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea
| | - SuA Oh
- Evidence-Based and Clinical Research Laboratory, Department of Health, Social and Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea
| | - Minji Kim
- Evidence-Based and Clinical Research Laboratory, Department of Health, Social and Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea
| | - EunYoung Kim
- Evidence-Based and Clinical Research Laboratory, Department of Health, Social and Clinical Pharmacy, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea; The Graduate School for Food and Drug Administration, and The Graduate School for Pharmaceutical Industry Management, College of Pharmacy, Chung-Ang University, Seoul 06974, Republic of Korea.
| |
Collapse
|
9
|
Nejstgaard CH, Boutron I, Chan AW, Chow R, Hopewell S, Masalkhi M, Moher D, Schulz KF, Shlobin NA, Østengaard L, Hróbjartsson A. A scoping review identifies multiple comments suggesting modifications to SPIRIT 2013 and CONSORT 2010. J Clin Epidemiol 2023; 155:48-63. [PMID: 36669708 DOI: 10.1016/j.jclinepi.2023.01.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2022] [Accepted: 01/12/2023] [Indexed: 01/19/2023]
Abstract
OBJECTIVES To identify, summarize, and analyse comments on the core reporting guidelines for protocols of randomized trials (Standard Protocol Items: Recommendations for Interventional Trials [SPIRIT] 2013) and for completed trials (Consolidated Standards of Reporting Trials [CONSORT] 2010), with special emphasis on suggestions for guideline modifications. METHODS We included documents written in English and published after 2010 that explicitly commented on SPIRIT 2013 or CONSORT 2010. We searched four bibliographic databases (Embase and MEDLINE to June 2022; Web of Science and Google Scholar to April 2022) and other sources (e.g., the EQUATOR Network website, the BMC Blog Network, and the BMJ rapid response section). Two authors independently assessed documents for eligibility and extracted data on basic characteristics and the wording of the main comments. We categorized comments as 'suggestion for modification to the wording of an existing guideline item,' 'suggestion for a new item,' or 'reflections on challenges or strengths.' We provided a summary and examples of the proposed suggestions and categorized comments into those that were directly linked to empirical investigations, were continuations of previous methodological discussions, or reflected new methodological developments. RESULTS We assessed full text of 2,320 potentially eligible documents and included 93 documents with 114 comments. In total, 37 comments suggested modifications to existing guideline items. The participant flow section of CONSORT 2010 received the most comments (eight comments made different suggestions, e.g., one comment suggested to add numbers on nonrandomized screened participants). There were 46 comments suggesting new items. Multiple suggestions were related to trial interventions (eight comments made different suggestions, e.g., one comment suggested to add content on cointerventions), blinding (six comments suggested to add content on risk of unblinding), statistical methods (five comments made different suggestions, e.g., one comment suggested to add content on blinding of statisticians), and participant flow (seven comments made different suggestions, e.g., three comments suggested to add content on missing data). Half (53%) of the suggestions were directly linked to empirical investigations. Six (7%) suggestions were continuations of previous methodological discussions and five (6%) suggestions reflected new methodological developments related to conflicts of interest and funding, data sharing, and patient and public involvement. CONCLUSION The issues raised provide context to authors, peer reviewers, editors, and readers of trials using SPIRIT 2013 and CONSORT 2010 and inform the planned updates of the core guidelines.
Collapse
Affiliation(s)
- Camilla H Nejstgaard
- Centre for Evidence-Based Medicine Odense (CEBMO) and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Denmark; Open Patient Data Explorative Network (OPEN), Odense University Hospital, Denmark.
| | - Isabelle Boutron
- Université Paris Cité, Centre of Research in Epidemiology and Statistics (CRESS), Inserm, France; Cochrane France, France
| | - An-Wen Chan
- Department of Medicine, Women's College Research Institute, University of Toronto, Canada
| | - Ryan Chow
- Faculty of Medicine, University of Ottawa, Canada
| | - Sally Hopewell
- Oxford Clinical Trials Research Unit/Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | | | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Canada; School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Canada
| | - Kenneth F Schulz
- Department of Obstetrics and Gynecology, School of Medicine, The University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Nathan A Shlobin
- Department of Neurological Surgery, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Lasse Østengaard
- Centre for Evidence-Based Medicine Odense (CEBMO) and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Denmark; Open Patient Data Explorative Network (OPEN), Odense University Hospital, Denmark; University Library of Southern Denmark, University of Southern Denmark, Odense, Denmark
| | - Asbjørn Hróbjartsson
- Centre for Evidence-Based Medicine Odense (CEBMO) and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Denmark; Open Patient Data Explorative Network (OPEN), Odense University Hospital, Denmark
| |
Collapse
|
10
|
Umar TP, Jain N. Debunking the myth of using "quiet" in clinical departments: an integrative overview of available literature. Ann Med Surg (Lond) 2022; 82:104792. [PMID: 36268415 PMCID: PMC9577947 DOI: 10.1016/j.amsu.2022.104792] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2022] [Accepted: 10/01/2022] [Indexed: 11/23/2022] Open
Affiliation(s)
| | - Nityanand Jain
- Faculty of Medicine, Riga Stradiņš University, Dzirciema Street 16, Riga, LV-1007, Latvia
| |
Collapse
|
11
|
Kapp P, Esmail L, Ghosn L, Ravaud P, Boutron I. Transparency and reporting characteristics of COVID-19 randomized controlled trials. BMC Med 2022; 20:363. [PMID: 36154932 PMCID: PMC9510360 DOI: 10.1186/s12916-022-02567-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/19/2022] [Accepted: 09/13/2022] [Indexed: 11/17/2022] Open
Abstract
BACKGROUND In the context of the COVID-19 pandemic, randomized controlled trials (RCTs) are essential to support clinical decision-making. We aimed (1) to assess and compare the reporting characteristics of RCTs between preprints and peer-reviewed publications and (2) to assess whether reporting improves after the peer review process for all preprints subsequently published in peer-reviewed journals. METHODS We searched the Cochrane COVID-19 Study Register and L·OVE COVID-19 platform to identify all reports of RCTs assessing pharmacological treatments of COVID-19, up to May 2021. We extracted indicators of transparency (e.g., trial registration, data sharing intentions) and assessed the completeness of reporting (i.e., some important CONSORT items, conflict of interest, ethical approval) using a standardized data extraction form. We also identified paired reports published in preprint and peer-reviewed publications. RESULTS We identified 251 trial reports: 121 (48%) were first published in peer-reviewed journals, and 130 (52%) were first published as preprints. Transparency was poor. About half of trials were prospectively registered (n = 140, 56%); 38% (n = 95) made their full protocols available, and 29% (n = 72) provided access to their statistical analysis plan report. A data sharing statement was reported in 68% (n = 170) of the reports of which 91% stated their willingness to share. Completeness of reporting was low: only 32% (n = 81) of trials completely defined the pre-specified primary outcome measures; 57% (n = 143) reported the process of allocation concealment. Overall, 51% (n = 127) adequately reported the results for the primary outcomes while only 14% (n = 36) of trials adequately described harms. Primary outcome(s) reported in trial registries and published reports were inconsistent in 49% (n = 104) of trials; of them, only 15% (n = 16) disclosed outcome switching in the report. There were no major differences between preprints and peer-reviewed publications. Of the 130 RCTs published as preprints, 78 were subsequently published in a peer-reviewed journal. There was no major improvement after the journal peer review process for most items. CONCLUSIONS Transparency, completeness, and consistency of reporting of COVID-19 clinical trials were insufficient both in preprints and peer-reviewed publications. A comparison of paired reports published in preprint and peer-reviewed publication did not indicate major improvement.
Collapse
Affiliation(s)
- Philipp Kapp
- Université Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France
- Centre d'Épidémiologie Clinique, AP-HP, Hôpital Hôtel-Dieu, F-75004, Paris, France
- Cochrane France, F-75004, Paris, France
- Institute for Evidence in Medicine, Medical Center - University of Freiburg, Faculty of Medicine, University of Freiburg, D-79110, Freiburg, Germany
| | - Laura Esmail
- Université Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France
- Centre d'Épidémiologie Clinique, AP-HP, Hôpital Hôtel-Dieu, F-75004, Paris, France
- Cochrane France, F-75004, Paris, France
| | - Lina Ghosn
- Université Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France
- Centre d'Épidémiologie Clinique, AP-HP, Hôpital Hôtel-Dieu, F-75004, Paris, France
- Cochrane France, F-75004, Paris, France
| | - Philippe Ravaud
- Université Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France
- Centre d'Épidémiologie Clinique, AP-HP, Hôpital Hôtel-Dieu, F-75004, Paris, France
- Cochrane France, F-75004, Paris, France
| | - Isabelle Boutron
- Université Paris Cité, Inserm, INRAE, Centre of Research in Epidemiology and Statistics (CRESS), F-75004, Paris, France.
- Centre d'Épidémiologie Clinique, AP-HP, Hôpital Hôtel-Dieu, F-75004, Paris, France.
- Cochrane France, F-75004, Paris, France.
| |
Collapse
|
12
|
Minley K, Smith CA, Batioja K, Andriana Peña BS, Shepard S, Heigle B, Kee M, Wise A, Hillman C, Ottwell R, Hartwell M, Vassar M. The evaluation of reporting of patient-reported outcomes in MDD: A meta-epidemiological study of clinical trials. J Psychiatr Res 2022; 150:79-86. [PMID: 35358835 DOI: 10.1016/j.jpsychires.2022.03.028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Revised: 01/26/2022] [Accepted: 03/21/2022] [Indexed: 11/25/2022]
Abstract
Major depressive disorder (MDD) is a multifaceted disease that profoundly affects quality of life. Patient reported outcomes (PROs) are used in randomized controlled trials (RCTs) to better understand patient perspectives on interventions. Therefore, we sought to assess the completeness of reporting PROs in RCTs addressing MDD. We identified RCTs evaluating MDD containing a PRO measure published between 2016 and 2020 from MEDLINE, Embase, and the Cochrane Central Register of Controlled Trials. Inclusion of studies was performed in duplicate. The completion of reporting of RCTs was assessed using the Consolidated Standards of Reporting Trials (CONSORT-PRO) adaptation. Bivariate regression analyses were used to evaluate reporting completeness and trial characteristics. A total of 49 RCTs were included in our analysis, with a mean CONSORT-PRO completion score of 56.7% (SD = 17.3).Our findings show a significant association with completeness of reporting and the following: secondary PRO trials were less completely reported as compared to primary PRO trials (t = -3.19, p = .003); studies with a follow-up period between six months and year were more completely reported as compared to three months or less (6 months to a year, t = 2.34, p = .024); and increased trial sample size was associated with more completeness of reporting (t = 3.17, p = .003). As compared to brain stimulation, the intervention types classified as combination, other, and psychotherapy had greater completeness of reporting (combination, t = 2.35, p = .024; other, t = 3.13, p = .003; psychotherapy, t = 3.41, p = .001). There were no other significant findings. Our study found the completeness of PRO reporting to be inconsistent in RCTs regarding MDD. Moreover, we advocate for the need to establish a core outcome set relevant to the management of adults diagnosed with MDD and facilitate training on the application of PRO data.
Collapse
Affiliation(s)
- Kirstien Minley
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.
| | - Caleb A Smith
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Kelsi Batioja
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - B S Andriana Peña
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Samuel Shepard
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Benjamin Heigle
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Micah Kee
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Audrey Wise
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Cody Hillman
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA; Department of Internal Medicine, University of Oklahoma, School of Community Medicine, Tulsa, OK, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| |
Collapse
|
13
|
Deng J, Heybati K, Hou W, Zuo QK. Safety cannot justify the use of ivermectin for the management of COVID-19. QJM 2022; 115:194-195. [PMID: 35080630 DOI: 10.1093/qjmed/hcac019] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/16/2022] [Indexed: 11/12/2022] Open
Affiliation(s)
- J Deng
- From the Faculty of Health Sciences, McMaster University, 1280 Main St W, Hamilton, ON L8S 4L8, Canada
| | - K Heybati
- Mayo Clinic Alix School of Medicine, Mayo Clinic, 200 1st St SW, Rochester, MN 55905, USA
| | - W Hou
- From the Faculty of Health Sciences, McMaster University, 1280 Main St W, Hamilton, ON L8S 4L8, Canada
| | - Q K Zuo
- Department of Anesthesiology, Rutgers New Jersey Medical School, 185 S Orange Ave, Newark, NJ 07103, USA
- Faculty of Science, McGill University, 845 Sherbrooke St W, Montreal, QC H3A 0G5, Canada
| |
Collapse
|
14
|
Bhatt A. Clinical trials and Consolidated Standards of Reporting Trials: Continuing concerns of compliance in COVID-19 era. Perspect Clin Res 2022; 13:1-2. [PMID: 35198421 PMCID: PMC8815672 DOI: 10.4103/picr.picr_259_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Accepted: 12/07/2021] [Indexed: 11/06/2022] Open
Affiliation(s)
- Arun Bhatt
- Clinical Research and Drug Development, Mumbai, Maharashtra, India
| |
Collapse
|