|
1
|
Verhagen A, Stubbs PW, Mehta P, Kennedy D, Nasser AM, Quel de Oliveira C, Pate JW, Skinner IW, McCambridge AB. Comparison between 2000 and 2018 on the reporting of statistical significance and clinical relevance in physiotherapy clinical trials in six major physiotherapy journals: a meta-research design. BMJ Open 2022; 12:e054875. [PMID: 34980625 PMCID: PMC8724707 DOI: 10.1136/bmjopen-2021-054875] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
DESIGN Meta-research. OBJECTIVE To compare the prevalence of reporting p values, effect estimates and clinical relevance in physiotherapy randomised controlled trials (RCTs) published in the years 2000 and 2018. METHODS We performed a meta-research study of physiotherapy RCTs obtained from six major physiotherapy peer-reviewed journals that were published in the years 2000 and 2018. We searched the databases Embase, Medline and PubMed in May 2019, and extracted data on the study characteristics and whether articles reported on statistical significance, effect estimates and confidence intervals for baseline, between-group, and within-group differences, and clinical relevance. Data were presented using descriptive statistics and inferences were made based on proportions. A 20% difference between 2000 and 2018 was regarded as a meaningful difference. RESULTS We found 140 RCTs: 39 were published in 2000 and 101 in 2018. Overall, there was a high prevalence (>90%) of reporting p values for the main (between-group) analysis, with no difference between years. Statistical significance testing was frequently used for evaluating baseline differences, increasing from 28% in 2000 to 61.4% in 2018. The prevalence of reporting effect estimates, CIs and the mention of clinical relevance increased from 2000 to 2018 by 26.6%, 34% and 32.8% respectively. Despite an increase in use in 2018, over 40% of RCTs failed to report effect estimates, CIs and clinical relevance of results. CONCLUSION The prevalence of using p values remains high in physiotherapy research. Although the proportion of reporting effect estimates, CIs and clinical relevance is higher in 2018 compared to 2000, many publications still fail to report and interpret study findings in this way.
Collapse
Affiliation(s)
- Arianne Verhagen
- Discipline of Physiotherapy, Graduate School of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Peter William Stubbs
- Discipline of Physiotherapy, Graduate School of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Poonam Mehta
- Discipline of Physiotherapy, Graduate School of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - David Kennedy
- Discipline of Physiotherapy, Graduate School of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Anthony M Nasser
- Discipline of Physiotherapy, Graduate School of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Camila Quel de Oliveira
- Discipline of Physiotherapy, Graduate School of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Joshua W Pate
- Discipline of Physiotherapy, Graduate School of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Ian W Skinner
- Discipline of Physiotherapy, Graduate School of Health, University of Technology Sydney, Sydney, New South Wales, Australia
- School of Allied Health, Department Exercise and Sports Sciences, Charles Sturt University, Port Macquarie, New South Wales, Australia
| | - Alana B McCambridge
- Discipline of Physiotherapy, Graduate School of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| |
Collapse
|