1
|
van Ierssel JJ, Galea O, Holte K, Luszawski C, Jenkins E, O'Neil J, Emery CA, Mannix R, Schneider K, Yeates KO, Zemek R. How completely are randomized controlled trials of non-pharmacological interventions following concussion reported? A systematic review. JOURNAL OF SPORT AND HEALTH SCIENCE 2024; 13:537-547. [PMID: 37619783 PMCID: PMC11184319 DOI: 10.1016/j.jshs.2023.08.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Revised: 05/20/2023] [Accepted: 07/12/2023] [Indexed: 08/26/2023]
Abstract
PURPOSE The study aimed to examine the reporting completeness of randomized controlled trials (RCTs) of non-pharmacological interventions following concussion. METHODS We searched MEDLINE, Embase, PsycInfo, CINAHL, and Web of Science up to May 2022. Two reviewers independently screened studies and assessed reporting completeness using the Template for Intervention Description and Replication (TIDieR), Consensus on Exercise Reporting Template (CERT), and international Consensus on Therapeutic Exercise aNd Training (i-CONTENT) checklists. Additional information was sought my study authors where reporting was incomplete. Risk of bias (ROB) was assessed with the Cochrane ROB-2 Tool. RCTs examining non-pharmacological interventions following concussion. RESULTS We included 89 RCTs (n = 53 high ROB) examining 11 different interventions for concussion: sub-symptom threshold aerobic exercise, cervicovestibular therapy, physical/cognitive rest, vision therapy, education, psychotherapy, hyperbaric oxygen therapy, transcranial magnetic stimulation, blue light therapy, osteopathic manipulation, and head/neck cooling. Median scores were: TIDieR 9/12 (75%; interquartile range (IQR) = 5; range: 5-12), CERT 17/19 (89%; IQR = 2; range: 10-19), and i-CONTENT 6/7 (86%; IQR = 1; range: 5-7). Percentage of studies completely reporting all items was TIDieR 35% (31/89), CERT 24% (5/21), and i-CONTENT 10% (2/21). Studies were more completely reported after publication of TIDieR (t87 = 2.08; p = 0.04) and CERT (t19 = 2.72; p = 0.01). Reporting completeness was not strongly associated with journal impact factor (TIDieR: rs = 0.27; p = 0.01; CERT: rs = -0.44; p = 0.06; i-CONTENT: rs = -0.17; p = 0.48) or ROB (TIDieR: rs = 0.11; p = 0.31; CERT: rs = 0.04; p = 0.86; i-CONTENT: rs = 0.12; p = 0.60). CONCLUSION RCTs of non-pharmacological interventions following concussion demonstrate moderate to good reporting completeness, but are often missing key components, particularly modifications, motivational strategies, and qualified supervisor. Reporting completeness improved after TIDieR and CERT publication, but publication in highly cited journals and low ROB do not guarantee reporting completeness.
Collapse
Affiliation(s)
| | - Olivia Galea
- The Centre for Health, Activity and Rehabilitation Research, University of Otago, Dunedin 9016, New Zealand
| | - Kirsten Holte
- Sport Injury Prevention Research Centre, Faculty of Kinesiology, University of Calgary, Calgary, AB T2N 1N4, Canada; Alberta Children's Hospital Research Institute; University of Calgary, Calgary, AB T2N 1N4, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB T2N 4N1, Canada
| | - Caroline Luszawski
- Alberta Children's Hospital Research Institute; University of Calgary, Calgary, AB T2N 1N4, Canada; Department of Psychology, University of Calgary, Calgary, AB T2N 1N4, Canada
| | - Elizabeth Jenkins
- Faculty of Medicine, University of Ottawa, Ottawa, ON K1H 8M5, Canada
| | - Jennifer O'Neil
- School of Rehabilitation Sciences, University of Ottawa, Ottawa, ON K1H 8M5, Canada; Bruyère Research Institute, Ottawa, ON K1N 5C8, Canada
| | - Carolyn A Emery
- Sport Injury Prevention Research Centre, Faculty of Kinesiology, University of Calgary, Calgary, AB T2N 1N4, Canada; Alberta Children's Hospital Research Institute; University of Calgary, Calgary, AB T2N 1N4, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB T2N 4N1, Canada
| | - Rebekah Mannix
- Departments of Pediatrics and Emergency Medicine, Harvard Medical School, Boston, MA 02115, USA
| | - Kathryn Schneider
- Sport Injury Prevention Research Centre, Faculty of Kinesiology, University of Calgary, Calgary, AB T2N 1N4, Canada; Alberta Children's Hospital Research Institute; University of Calgary, Calgary, AB T2N 1N4, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB T2N 4N1, Canada
| | - Keith Owen Yeates
- Department of Psychology, University of Calgary, Calgary, AB T2N 1N4, Canada; Alberta Children's Hospital Research Institute; University of Calgary, Calgary, AB T2N 1N4, Canada; Hotchkiss Brain Institute, University of Calgary, Calgary, AB T2N 4N1, Canada
| | - Roger Zemek
- Children's Hospital of Eastern Ontario Research Institute, Ottawa, ON K1H 8L1, Canada; Departments of Pediatrics and Emergency Medicine, University of Ottawa, Ottawa, ON K1H 8M5, Canada
| |
Collapse
|
2
|
Zhou J, Qi H, Hu J, Feng Z, Wang G. Low-quality of patient-reported outcome reporting in randomized clinical trials of major depressive disorder-a meta-epidemiological review. Front Psychiatry 2023; 14:1246938. [PMID: 38025477 PMCID: PMC10661948 DOI: 10.3389/fpsyt.2023.1246938] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/25/2023] [Accepted: 10/19/2023] [Indexed: 12/01/2023] Open
Abstract
Objective Our goal was to review current peer-reviewed articles in which the BDI (Beck Depression Inventory), PHQ-9 (Patient Health Questionnaire), or QIDS-SR16 (16-Item Quick Inventory of Depressive Symptomatology) was used as the primary or secondary outcome measure and to evaluate the quality of PRO (Patient-Reported Outcome) reporting in RCTs (Randomized Controlled Trials) according to the 2013 PRO-specific CONSORT (Consolidated Standards of Reporting Trials) extension. Methods We systematically searched in electronic databases. A study would be included if it included patients diagnosed with major depressive disorder according to the criteria of the Diagnostic and Statistical Manual of Mental Disorders (DSM) or International Classification of Diseases, version 10 (ICD-10) as participants, was a randomized controlled trial, included the BDI, PHQ-9, or QIDS-SR16 as the primary or secondary outcome measure, published between 1990 and 2013, and was in English. Two of the authors evaluated the quality of PRO reporting according to the 2013 CONSORT-PRO. Logistic regression were used to evaluate the association between reporting completeness and trial characteristics. Results A total of 116 studies were included. These studies were conducted in 25 countries. Sample sizes ranged from 12 to 750. The CONSORT-PRO was not cited in any one of the included studies. Among the 116 studies, 2 (1.72%) studies introduced the rationale for PRO assessment, 60 (51.72%) studies explicitly stated statistical approaches for dealing with missing data, 87 (75.00%) studies reported PRO outcome data at baseline and at subsequent time points. The mean score of reporting completeness was 66.24%. Significantly higher reporting completeness was found for RCTs published after 2013 (OR, 95%CI: 3.81, 1.32-10.99). Studies with a higher sample size were more completely reported than studies with a lower sample size (OR, 95%CI: 1.01, 1.00-1.02). Conclusion The CONSORT-PRO guidance was rarely cited. The quality of PRO reporting in depression studies requires improvement. This result may be meaningful for the promotion of PRO reporting in RCTs.
Collapse
Affiliation(s)
- Jia Zhou
- Beijing Key Laboratory of Mental Disorders, National Clinical Research Center for Mental Disorders & National Center for Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China
- Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
| | - Han Qi
- Beijing Key Laboratory of Mental Disorders, National Clinical Research Center for Mental Disorders & National Center for Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China
- Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
| | - Jia Hu
- Beijing Key Laboratory of Mental Disorders, National Clinical Research Center for Mental Disorders & National Center for Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China
- Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
| | - Zizhao Feng
- Beijing Key Laboratory of Mental Disorders, National Clinical Research Center for Mental Disorders & National Center for Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China
- Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
| | - Gang Wang
- Beijing Key Laboratory of Mental Disorders, National Clinical Research Center for Mental Disorders & National Center for Mental Disorders, Beijing Anding Hospital, Capital Medical University, Beijing, China
- Advanced Innovation Center for Human Brain Protection, Capital Medical University, Beijing, China
| |
Collapse
|
3
|
Ladd C, Jacobsen SM, Snider K, Bacani R, Hillman C, Shepard S, Heigle B, Ottwell R, Hartwell M, Vassar M. Evaluating the underreporting of patient-reported outcomes in carpal tunnel syndrome randomized controlled trials. J Osteopath Med 2023; 123:301-308. [PMID: 36840430 DOI: 10.1515/jom-2022-0223] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2022] [Accepted: 12/24/2022] [Indexed: 02/26/2023]
Abstract
CONTEXT In recent years, patient-centered healthcare has become a primary concern for researchers and healthcare professionals. When included in randomized controlled trials (RCTs), patient-reported outcome (PRO) measures serve a critical role in supplementing efficacy outcomes with a patient perspective. OBJECTIVES The goals of this study are to evaluate the reporting completeness of PROs within literature concerning carpal tunnel syndrome (CTS) utilizing the Consolidated Standards of Reporting Trials Patient-Reported Outcomes (CONSORT-PRO) extension. METHODS We searched MEDLINE, Embase, and Cochrane Central Register of Controlled Trials (CENTRAL) for published RCTs relating to CTS with at least one PRO measure from 2006 to 2020. Two investigators screened all RCTs for inclusion utilizing Rayyan (https://rayyan.qcri.org/), a systematic review screening platform. In an independent, masked fashion, investigators then evaluated all RCTs utilizing the CONSORT-PRO adaptation and Cochrane Collaboration Risk of Bias (RoB) 2.0 tool. Bivariate regression analyses were utilized to assess relationships between trial characteristics and completeness of reporting. RESULTS Our search returned 374 publications, yet only 31 unique RCTs met the inclusion criteria. The mean overall percent of adherence for CONSORT-PRO was 41%. Our secondary outcome-assessing study characteristics-indicated significantly higher completeness of reporting in the absence of a conflict of interest statement (p<0.05), 'some concerns' for bias (p<0.005), and when journals required the use of the CONSORT statement (p<0.005). The RoB assessment determined overall suspicion for bias among included RCTs, with 35% (n=11/31) being labeled as 'high,' 58% (n=18/31) as 'some concerns,' and 7% (n=2/31) as 'low.' CONCLUSIONS Our study indicated that the completeness of CONSORT-PRO reporting was deficient within CTS trials. Because of the importance placed on PROs in clinical practice, we recommend adherence to CONSORT-PRO prior to publication of RCTs to increase the understanding of various interventions on patients' quality of life (QoL).
Collapse
Affiliation(s)
- Chase Ladd
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Samuel M Jacobsen
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Kelsey Snider
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Rigel Bacani
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Cody Hillman
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Samuel Shepard
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Benjamin Heigle
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.,Department of Internal Medicine, School of Community Medicine, University of Oklahoma, Tulsa, OK, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| |
Collapse
|
4
|
Douglas A, Garrett E, Staggs J, Williams C, Shepard S, Wise A, Hillman C, Ottwell R, Hartwell M, Vassar M. Reporting of patient-reported outcomes in trials on alcohol use disorder: a meta-epidemiological study. BMJ Evid Based Med 2023; 28:21-29. [PMID: 35470132 DOI: 10.1136/bmjebm-2021-111876] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/10/2022] [Indexed: 01/25/2023]
Abstract
OBJECTIVES Currently, limited research exists to assess the extent of patient-reported outcome (PRO) reporting among randomised controlled trials (RCTs) evaluating alcohol use disorder (AUD). We sought to investigate the completeness of reporting of PROs using the Consolidated Standards of Reporting Trials-PRO (CONSORT-PRO) extension in AUD RCTs. DESIGN SETTING Meta-epidemiological study. METHODS We searched MEDLINE, Embase and the Cochrane Central Register of Controlled Trials (CENTRAL) on 29 June 2021 for published RCTs focused on AUD. Following these searches, title and abstract screening, and full-text screening were performed by two investigators. To be included, a study must have employed a randomised trial design, published in English, focused on treatment of AUD and included at least one PRO. Trials meeting inclusion criteria were evaluated for completeness of reporting using the CONSORT-PRO extension adaptation. These trials were also evaluated for risk of bias (RoB) using the Cochrane RoB V.2.0 tool. Additionally, an exploratory analysis of each RCT's therapeutic area was extracted using the Mapi Research Trust's ePROVIDE platform. Screening and data collection were all performed in masked, duplicate fashion. MAIN OUTCOME MEASURES PRO completeness of reporting, identification of factors associated with completeness of reporting and PRO measures used in RCTs to evaluate patients with AUD. RESULTS Nineteen RCTs were evaluated in our analysis. Our primary outcome, the mean completion score for CONSORT-PRO, was 40.8%. Our secondary outcome-the identification of factors associated with completeness of reporting-found that trials published after 2014 (ie, 1 year after the publication of the CONSORT-PRO extension) were 15.0% more complete than trials published before 2014. We found no additional associations with better reporting. CONCLUSIONS We found that the completeness of PRO reporting in RCTs involving AUD was deficient. Complete reporting of PROs is instrumental in understanding the effects of interventions, encourages patient participation in their treatment and may increase clinician confidence in the value of PROs. High quality treatment strategies for AUD require properly reported PROs.
Collapse
Affiliation(s)
- Alexander Douglas
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Elizabeth Garrett
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Jordan Staggs
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Cole Williams
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Samuel Shepard
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Audrey Wise
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Cody Hillman
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Internal Medicine, University of Oklahoma School of Community Medicine, Tulsa, Oklahoma, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| |
Collapse
|
5
|
van der Vet P, Wilson S, Houwert RM, Verleisdonk EJ, Heng M. Quality and reporting of patient-reported outcomes in elderly patients with hip fracture: a systematic review. BMJ Open 2022; 12:e058197. [PMID: 36521890 PMCID: PMC9756149 DOI: 10.1136/bmjopen-2021-058197] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
OBJECTIVE To assess how patient-reported outcomes (PROs) are reported and to assess the quality of reporting PROs for elderly patients with a hip fracture in both randomised controlled trials (RCTs) and observational studies. DESIGN Systematic review. DATA SOURCES Medline, Embase and CENTRAL were searched on 1 March 2013 to 25 May 2021. ELIGIBILITY CRITERIA RCTs and observational studies on geriatric (≥65 years of age) patients, with one or more PRO as outcome were included. DATA EXTRACTION AND SYNTHESIS Primary outcome was type of PRO; secondary outcome and quality assessment was measured by adherence to the Consolidated Standards of Reporting Trials (CONSORT) extension for patient-reported outcomes (CONSORT-PRO). Because of heterogeneity in study population and outcomes, data pooling was not possible. RESULTS 3659 studies were found in the initial search. Of those, 67 were included in the final analysis. 83.6% of studies did not adequately mention missing data, 52.3% did not correctly report how PROs were collected and 61.2% did not report adequate effect size. PRO limitations were adequately reported in 20.9% of studies and interpretation of PROs was adequately reported in 19.4% of studies. Most Quality of Life (QoL) outcomes were measured by the EuroQol 5-Dimension 3-Levels, and pain as well as patient satisfaction by Visual Analogue Scale. CONCLUSION This study found that a high variety of PRO measures are used to evaluate geriatric hip fracture care. In addition, 47.8% of studies examining PROs in elderly patients with hip fracture do not satisfy at least 50% of the CONSORT-PRO criteria. This enables poorly conducted research to be published and used in evidence-based medicine and, consequently, shared decision-making. More efforts should be undertaken to improve adequate reporting. We believe extending the CONSORT-PRO extension to Strengthening the Reporting of Observational Studies in Epidemiology for observational studies would be a valuable addition to current guidelines.
Collapse
Affiliation(s)
- Puck van der Vet
- Department of Trauma Surgery, University Medical Centre Utrecht, Utrecht, Netherlands
| | - Sandra Wilson
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, Massachusetts, USA
| | - R Marijn Houwert
- Department of Trauma Surgery, University Medical Centre Utrecht, Utrecht, Netherlands
| | | | - Marilyn Heng
- Department of Orthopaedic Surgery, Massachusetts General Hospital, Boston, Massachusetts, USA
| |
Collapse
|
6
|
van Wissen MAT, Berger MAM, Schoones JW, Gademan MGJ, van den Ende CHM, Vliet Vlieland TPM, van Weely SFE. Reporting quality of interventions using a wearable activity tracker to improve physical activity in patients with inflammatory arthritis or osteoarthritis: a systematic review. Rheumatol Int 2022; 43:803-824. [PMID: 36454326 PMCID: PMC10073167 DOI: 10.1007/s00296-022-05241-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2022] [Accepted: 10/23/2022] [Indexed: 12/03/2022]
Abstract
AbstractTo assess the reporting quality of interventions aiming at promoting physical activity (PA) using a wearable activity tracker (WAT) in patients with inflammatory arthritis (IA) or hip/knee osteoarthritis (OA). A systematic search was performed in eight databases (including PubMed, Embase and Cochrane Library) for studies published between 2000 and 2022. Two reviewers independently selected studies and extracted data on study characteristics and the reporting of the PA intervention using a WAT using the Consensus on Exercise Reporting Template (CERT) (12 items) and Consolidated Standards of Reporting Trials (CONSORT) E-Health checklist (16 items). The reporting quality of each study was expressed as a percentage of reported items of the total CERT and CONSORT E-Health (50% or less = poor; 51–79% = moderate; and 80–100% = good reporting quality). Sixteen studies were included; three involved patients with IA and 13 with OA. Reporting quality was poor in 6/16 studies and moderate in 10/16 studies, according to the CERT and poor in 8/16 and moderate in 8/16 studies following the CONSORT E-Health checklist. Poorly reported checklist items included: the description of decision rule(s) for determining progression and the starting level, the number of adverse events and how adherence or fidelity was assessed. In clinical trials on PA interventions using a WAT in patients with IA or OA, the reporting quality of delivery process is moderate to poor. The poor reporting quality of the progression and tailoring of the PA programs makes replication difficult. Improvements in reporting quality are necessary.
Collapse
Affiliation(s)
- M A T van Wissen
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Albinusdreef 2, P.O. Box 9600, 2300 RC, Leiden, The Netherlands.
| | - M A M Berger
- The Hague University of Applied Sciences, The Hague, The Netherlands
| | - J W Schoones
- Directorate of Research Policy (Walaeus Library), Leiden, The Netherlands
| | - M G J Gademan
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Albinusdreef 2, P.O. Box 9600, 2300 RC, Leiden, The Netherlands
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - C H M van den Ende
- Department of Research, Sint Maartenskliniek, Nijmegen, The Netherlands
- Department of Rheumatology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - T P M Vliet Vlieland
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Albinusdreef 2, P.O. Box 9600, 2300 RC, Leiden, The Netherlands
| | - S F E van Weely
- Department of Orthopaedics, Rehabilitation and Physical Therapy, Leiden University Medical Center, Albinusdreef 2, P.O. Box 9600, 2300 RC, Leiden, The Netherlands
| |
Collapse
|
7
|
Staggs J, Williams C, Love M, Renner A, Kee M, Hillman C, Shepard S, Heigle B, Rauh S, Ottwell R, Hartwell M, Vassar M. Evaluating Reporting Completeness of Patient-Reported Outcomes in Esophageal Motility Disorders: A Cross-Sectional Analysis of Randomized Controlled Trials. Dysphagia 2022; 37:1576-1585. [PMID: 35194671 DOI: 10.1007/s00455-022-10415-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2021] [Accepted: 02/04/2022] [Indexed: 12/16/2022]
Abstract
Esophageal motility disorders (EMD) can have significant effects on quality of life. Patient-reported outcomes (PROs) provide valuable insight into the patient's perspective on their treatment and are becoming increasingly used in randomized controlled trials (RCTs). Thus, our investigation aims to evaluate the completeness of reporting of PROs in RCTs pertaining to EMDs. We searched MEDLINE, Embase, and Cochrane Central Register of Controlled Trials for published RCTs focused on EMDs. Included RCTs were published between 2006 and 2020, reported a primary outcome related to an EMDs, and listed at least one PRO measure as a primary or secondary outcome. Investigators screened and extracted data in a masked, duplicate fashion. Data extraction was carried out using both the CONSORT-PRO adaptation and Cochrane Collaboration Risk of Bias 2.0 tool. We assessed overall mean percent completion of the CONSORT-PRO adaptation and a bivariate regression analysis was used to assess relationships between trial characteristics and completeness of reporting. The overall mean percent completion of the CONSORT-PRO checklist adaptation was 43.86% (SD = 17.03). RCTs with a primary PRO had a mean completeness of 47.73% (SD = 17.32) and RCTs with a secondary PRO was 35.36% (SD = 13.52). RCTs with a conflict of interest statement were 18.15% (SE = 6.5) more complete (t = 2.79, P = .009) than trials lacking a statement. No additional significant associations between trial characteristics and completeness of reporting were found. PRO reporting completeness in RCTs focused on EMDs was inadequate. We urge EMD researchers to prioritize complete PRO reporting to foster patient-centered research for future RCTs on EMDs.
Collapse
Affiliation(s)
- Jordan Staggs
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA.
| | - Cole Williams
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA
| | - Mitchell Love
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA
| | - Abbey Renner
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA
| | - Micah Kee
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA
| | - Cody Hillman
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA
| | - Samuel Shepard
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA
| | - Benjamin Heigle
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA
| | - Shelby Rauh
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA.,Department of Internal Medicine, School of Community Medicine, University of Oklahoma, Tulsa, OK, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK, 74107, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| |
Collapse
|
8
|
Batioja K, Peña A, Smith C, Minley K, Wise A, Shepard S, Heigle B, Ottwell R, Hartwell M, Vassar M. Evaluating The Reporting of Patient-Reported Outcomes in Surgical Management of Stress Urinary Incontinence in Women: An Analysis of Randomized Controlled Trials. Womens Health Issues 2022; 33:312-319. [DOI: 10.1016/j.whi.2022.10.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 10/15/2022] [Accepted: 10/21/2022] [Indexed: 11/26/2022]
|
9
|
Moore T, Nees D, Hightower B, Brock L, Kee M, Wise A, Heigle B, Ottwell R, Hartwell M, Vassar M. Underreporting of patient-reported outcomes in cystic fibrosis randomized controlled trials using CONSORT-PRO and RoB 2.0. Respir Med Res 2022; 83:100962. [PMID: 36563550 DOI: 10.1016/j.resmer.2022.100962] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Revised: 07/23/2022] [Accepted: 10/03/2022] [Indexed: 12/24/2022]
Abstract
BACKGROUND Patient-reported outcomes (PROs) are increasingly used in randomized controlled trials (RCTs) to foster patient-centered healthcare. The aim of this investigation was to assess the completeness of reporting of PROs in RCTs pertaining to cystic fibrosis (CF). METHODS We searched MEDLINE, Embase, and Cochrane Central Register of Controlled Trials for RCTs concerning CF that included PROs as a primary or secondary outcome. The RCTs were assessed by 2 independent investigators using an adaptation of the Consolidated Standards of Reporting Trials for Patient-Reported Outcomes (CONSORT-PRO) and the Cochrane Risk of Bias (RoB) 2.0 assessment. We calculated the mean completion percentage of adherence to the CONSORT-PRO adaptation and used bivariate regression models to evaluate for associations with particular trial characteristics. RESULTS Our systematic search returned 2302 potential studies. Fifty-nine eligible RCTs were included after full-text screening. The RCT mean completeness of reporting was 38.38% (SD = 12.74). We found the following associations between trial characteristics and completeness of PRO reporting: (1) significantly higher reporting completeness for RCTs published in journals requiring adherence to the CONSORT guideline (p-value = 0.049), (2) improved reporting completeness in studies with 'some concerns' of RoB versus 'high' RoB (p-value = 0.042), and (3) significantly better reporting completeness when the PRO is the primary outcome of a RCT (p-value = 0.006). CONCLUSION Inadequate PRO reporting exists within RCTs focused on CF. Given that CF has substantial effects on quality of life, PROs are imperative to understand patients' experiences. We believe greater adherence to CONSORT-PRO will promote the standardization of PRO reporting and will facilitate comprehension of PROs by stakeholders, patients, and clinicians.
Collapse
Affiliation(s)
- Ty Moore
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107, United States.
| | - Danya Nees
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107, United States
| | - Brooke Hightower
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107, United States
| | - Lydia Brock
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107, United States
| | - Micah Kee
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107, United States
| | - Audrey Wise
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107, United States
| | - Benjamin Heigle
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107, United States
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107, United States; Department of Internal Medicine, University of Oklahoma, School of Community Medicine, Tulsa, OK, United States
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107, United States; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107, United States; Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, United States
| |
Collapse
|
10
|
Anderson R, Streck S, Hughes G, Suterfield B, Kee M, Wise A, Hillman C, Ottwell R, Hartwell M, Vassar M. Evaluating reporting of patient-reported outcomes in peptic ulcer disease: a meta-epidemiological study of randomized controlled trials. Expert Rev Pharmacoecon Outcomes Res 2022; 22:1253-1260. [PMID: 36073013 DOI: 10.1080/14737167.2022.2122955] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
OBJECTIVES Peptic ulcer disease (PUD) can significantly affect quality of life (QoL). These QoL outcomes are often patient-reported, and their inclusion in clinical trials supplements efficacy outcomes to provide the patients' perspective. This study aimed to assess existing literature for completeness of PRO reporting across randomized controlled trials (RCTs) evaluating PUD. METHODS This was a meta-epidemiological, cross-sectional study which assessed completeness of reporting among RCTs addressing management of PUD. We conducted a comprehensive literature search using MEDLINE, Embase, and the Cochrane Register of Controlled Trials to identify RCTs with a PRO as a primary or secondary outcome. These RCTs were assessed for completion of reporting according to the PRO adaptation of Consolidated Standards of Reporting Trials checklist. RCTs were also assessed for Risk of Bias (RoB) using the Cochrane RoB 2.0 tool. RESULTS Masked, duplicate screening of 829 results from our search yielded a final sample of 35 RCTs. The average completeness of reporting was 32.9% according to the CONSORT-PRO adaptation. Twenty-one (of 35; 60%) of the RCTs were assessed as having 'high' risk of bias and nine (of 35; 25.71%) were assessed as having 'some concerns' for risk of bias. Bivariate regression found completeness of reporting to be positively associated with increased PRO follow-up duration, larger sample size, and studies which report conflicts of interest. CONCLUSION RCTs examining the treatment and prevention of PUD with PROs as an outcome measure have deficient reporting and 'high' risk of bias according to the CONSORT-PRO and Cochrane RoB guidelines.
Collapse
Affiliation(s)
- Reece Anderson
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Sam Streck
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Griffin Hughes
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Bethany Suterfield
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Micah Kee
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Audrey Wise
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Cody Hillman
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA.,Department of Internal Medicine, University of Oklahoma, School of Community Medicine, Tulsa, OK, United States
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| |
Collapse
|
11
|
Fabian A, Domschikowski J, Letsch A, Schmalz C, Freitag-Wolf S, Dunst J, Krug D. Use and Reporting of Patient-Reported Outcomes in Trials of Palliative Radiotherapy: A Systematic Review. JAMA Netw Open 2022; 5:e2231930. [PMID: 36136335 PMCID: PMC9500555 DOI: 10.1001/jamanetworkopen.2022.31930] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/03/2022] Open
Abstract
IMPORTANCE Approximately 50% of all patients with cancer have an indication for radiotherapy, and approximately 50% of radiotherapy is delivered with palliative intent, with the aim of alleviating symptoms. Symptoms are best assessed by patient-reported outcomes (PROs), yet their reliable interpretation requires adequate reporting in publications. OBJECTIVE To investigate the use and reporting of PROs in clinical trials of palliative radiotherapy. EVIDENCE REVIEW This preregistered systematic review searched PubMed/Medline, EMBASE, and the Cochrane Center Register of Controlled Trials for clinical trials of palliative radiotherapy published from 1990 to 2020. Key eligibility criteria were palliative setting, palliative radiotherapy as treatment modality, and clinical trial design (per National Institutes of Health definition). Two authors independently assessed eligibility. Trial characteristics were extracted and standard of PRO reporting was assessed in adherence to the Consolidated Standards of Reporting Trials (CONSORT) PRO extension. The association of the year of publication with the use of PROs was assessed by logistic regression. Factors associated with higher CONSORT-PRO adherence were analyzed by multiple regression. This study is reported following the PRISMA guidelines. FINDINGS Among 7377 records screened, 225 published clinical trials representing 24 281 patients were eligible. Of these, 45 trials (20%) used a PRO as a primary end point and 71 trials (31%) used a PRO as a secondary end point. The most prevalent PRO measures were the Numeric Rating Scale/Visual Analogue Scale (38 trials), European Organization for the Research and Treatment of Cancer Quality of Life Questionnaire C30 (32 trials), and trial-specific unvalidated measures (25 trials). A more recent year of publication was significantly associated with a higher chance of PROs as a secondary end point (odds ratio [OR], 1.04 [95% CI, 1.00-1.07]; P = .03) but not as primary end point. Adherence to CONSORT-PRO was poor or moderate for most items. Mean (SD) adherence to the extension adherence score was 46.2% (19.6%) for trials with PROs as primary end point and 31.8% (19.8%) for trials with PROs as a secondary end point. PROs as a primary end point (regression coefficient, 9.755 [95% CI, 2.270-17.240]; P = .01), brachytherapy as radiotherapy modality (regression coefficient, 16.795 [95% CI, 5.840-27.751]; P = .003), and larger sample size (regression coefficient, 0.028 [95% CI, 0.006-0.049]; P = .01) were significantly associated with better PRO reporting per extension adherence score. CONCLUSIONS AND RELEVANCE In this systematic review of palliative radiotherapy trials, the use and reporting of PROs had room for improvement for future trials, preferably with PROs as a primary end point.
Collapse
Affiliation(s)
- Alexander Fabian
- Department of Radiation Oncology, University Hospital Schleswig-Holstein, Kiel, Germany
| | - Justus Domschikowski
- Department of Radiation Oncology, University Hospital Schleswig-Holstein, Kiel, Germany
| | - Anne Letsch
- Department of Haematology and Oncology, University Hospital Schleswig-Holstein, Kiel, Germany
| | - Claudia Schmalz
- Department of Radiation Oncology, University Hospital Schleswig-Holstein, Kiel, Germany
| | - Sandra Freitag-Wolf
- Institute of Medical Informatics and Statistics, Christian-Albrechts-University Kiel, Kiel, Germany
| | - Juergen Dunst
- Department of Radiation Oncology, University Hospital Schleswig-Holstein, Kiel, Germany
| | - David Krug
- Department of Radiation Oncology, University Hospital Schleswig-Holstein, Kiel, Germany
| |
Collapse
|
12
|
Renner A, Love M, Garrett E, Douglas A, Kee M, Heigle B, Wise A, Ottwell R, Hartwell M, Vassar M. Sickle Cell Disease and Quality of Life: An Evaluation of Reporting of Patient-Reported Outcomes in Randomized Controlled Trials. Hemoglobin 2022; 46:265-268. [PMID: 36268837 DOI: 10.1080/03630269.2022.2121215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
Sickle cell disease significantly impacts one's quality of life (QOL); thus, randomized controlled trials (RCTs) have integrated patient-reported outcomes (PROs) to assess patients' health from their perspective. We aim to evaluate the completeness of reporting of PROs included in sickle cell disease RCTs. We searched MEDLINE, Embase and Cochrane Central Register of Controlled Trials (CENTRAL) for published sickle cell disease RCTs with at least one PRO measure from 2006 to 2021. In a masked, duplicate fashion, two investigators evaluated RCTs using the Consolidated Standards of Reporting in Trials (CONSORT)-PRO adaptation and Cochrane Collaboration Risk of Bias (RoB) 2.0 tool. The primary objective was mean percent completeness of the CONSORT-PRO adaptation. Additional relationships between trial characteristics and completeness of reporting were evaluated. Mean completeness of reporting of RCTs was 41.49% (SD = 20.90). Randomized controlled trials with primary outcomes were more complete (57.50%, SD = 8.33) than RCTs with secondary PROs (33.48%, SD = 20.91). We did not find a significant difference in completion between trials with primary PROs and secondary PROs (t1 = 2.07; p = 0.06). Our secondary objectives included factors that may be associated with completeness of PRO reporting. Of the 12 included studies, five were considered to be overall 'high' RoB (41.67%). In each of the five domains, the majority of studies received 'low' RoB evaluations. Incomplete PRO reporting was common within sickle cell RCTs. Therefore, we recommend future RCTs including PROs should take measures to increase completeness of reporting.
Collapse
Affiliation(s)
- Abbey Renner
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Mitchell Love
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Elizabeth Garrett
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Alexander Douglas
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Micah Kee
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Benjamin Heigle
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Audrey Wise
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.,Department of Internal Medicine, University of Oklahoma, School of Community Medicine, Tulsa, OK, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, OK, USA
| |
Collapse
|
13
|
McIntire R, Waters P, Tanner D, Dhillon J, Hillman C, Wise A, Kee M, Anderson R, Ottwell R, Hartwell M, Vassar M. Evaluating reporting of patient-reported outcomes in randomized controlled trials regarding inflammatory bowel disease: a methodological study. J Investig Med 2022; 70:1690-1696. [PMID: 35914805 DOI: 10.1136/jim-2022-002327] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/13/2022] [Indexed: 11/04/2022]
Abstract
Patient-reported outcomes (PROs) in randomized controlled trials pertaining to inflammatory bowel disease are important in identifying patients' perspective of treatment. Incompletely reported PROs within trials could misrepresent information for clinicians and may contribute to treatment which lacks accommodation of patient input. Our study evaluates completeness of reporting of PROs and risk of bias (RoB) to identify how well trialists are adhering to known resources for trials. We used MEDLINE, Embase, and the Cochrane Central Register of Controlled Trials to identify eligible trials from 2006 to 2020 with at least 1 PRO measure related to inflammatory bowel disease. The trials were screened in duplicate using Rayyan. We then compared trial completion of reporting to the Consolidated Standards of Reporting Trials (CONSORT)-PRO adaptation, and assessed RoB using the Cochrane Collaboration RoB 2.0 tool. To measure trial and reporting characteristics, we performed bivariate regression analyses. Among a sample of 29 trials, the mean completion percentage for CONSORT-PRO was 46.77%. We found PROs as a secondary outcome had significantly lower CONSORT-PRO reporting (p<0.05). In addition, per cent completeness of reporting was significantly higher with both a 'therapy' intervention, and trials published following the development of CONSORT-PRO (p<0.05). Incomplete PRO reporting is common in trials focused on inflammatory bowel disease. This suboptimal reporting indicates the need for adherence to reporting guidelines. Trialists should use the CONSORT-PRO checklist, as endorsed by Patient-Reported Outcomes Tools: Engaging Users and Stakeholders, to assess their studies in order to enhance reporting adherence.
Collapse
Affiliation(s)
- Ryan McIntire
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Philo Waters
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - David Tanner
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Jaydeep Dhillon
- Office of Research, Rocky Vista University College of Osteopathic Medicine, Parker, Colorado, USA
| | - Cody Hillman
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Audrey Wise
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Micah Kee
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Reece Anderson
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA.,Department of Internal Medicine, School of Community Medicine, Tulsa, Oklahoma, USA
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA.,Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences, Tulsa, Oklahoma, USA
| |
Collapse
|
14
|
Brock L, Hightower B, Moore T, Nees D, Heigle B, Shepard S, Kee M, Ottwell R, Hartwell M, Vassar M. Reporting of Patient-Reported Outcome Measures in Randomized Controlled Trials on Shoulder Rotator Cuff Injuries Is Suboptimal and Requires Standardization. Arthrosc Sports Med Rehabil 2022; 4:e1429-e1436. [PMID: 36033194 PMCID: PMC9402470 DOI: 10.1016/j.asmr.2022.04.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Accepted: 04/25/2022] [Indexed: 11/29/2022] Open
Abstract
Purpose Methods Results Conclusions Clinical Relevance
Collapse
Affiliation(s)
- Lydia Brock
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
- Address correspondence to Lydia Brock, Oklahoma State University Center for Health Sciences, 1111 W 17th St., Tulsa, OK 74107.
| | - Brooke Hightower
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Ty Moore
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Danya Nees
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Benjamin Heigle
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Samuel Shepard
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Micah Kee
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Ryan Ottwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
- Department of Internal Medicine, University of Oklahoma, School of Community Medicine Tulsa, Oklahoma, U.S.A
| | - Micah Hartwell
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| | - Matt Vassar
- Office of Medical Student Research, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
- Department of Psychiatry and Behavioral Sciences, Oklahoma State University Center for Health Sciences Tulsa, Oklahoma, U.S.A
| |
Collapse
|
15
|
Rutherford C, Boehnke JR. Introduction to the special section "Reducing research waste in (health-related) quality of life research". Qual Life Res 2022; 31:2881-2887. [PMID: 35907111 DOI: 10.1007/s11136-022-03194-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Affiliation(s)
- Claudia Rutherford
- Faculty of Medicine and Health, The University of Sydney Susan Wakil School of Nursing and Midwifery, Cancer Care Research Unit (CCRU), The University of Sydney, Sydney, Australia. .,Faculty of Science, School of Psychology, Sydney Quality of Life Office, The University of Sydney, Sydney, Australia. .,The Daffodil Centre, The University of Sydney, a joint venture with Cancer Council NSW, Sydney, Australia.
| | - Jan R Boehnke
- School of Health Sciences, University of Dundee, Dundee, UK
| |
Collapse
|
16
|
Newman C, Kgosidialwa O, Dervan L, Bogdanet D, Egan AM, Biesty L, Devane D, O'Shea PM, Dunne FP. Quality of patient-reported outcome reporting in trials of diabetes in pregnancy: A systematic review. Diabetes Res Clin Pract 2022; 188:109879. [PMID: 35483543 DOI: 10.1016/j.diabres.2022.109879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 04/07/2022] [Accepted: 04/20/2022] [Indexed: 11/24/2022]
Abstract
AIMS Patient-reported outcomes (PROs) are reports of the patient's health status that come directly from the patient without interpretation by the clinician or anyone else. They are increasingly used in randomised controlled trials (RCTs). In this systematic review we identified RCTs conducted in women with diabetes in pregnancy which included PROs in their primary or secondary outcomes. We then evaluated the quality of PRO reporting against an internationally accepted reporting framework (Consolidated Standards of Reporting Trials (CONSORT-PRO) guidelines). METHODS We searched online databases for studies published 2013-2021 using a combination of keywords. Two authors reviewed all abstracts independently. Data on study characteristics and the quality of PRO reporting were extracted from relevant studies. We conducted a multiple regression analysis to identify factors associated with high quality reporting. RESULTS We identified 7122 citations. Thirty-five articles were included for review. Only 17% of RCTs included a PRO as a primary or secondary outcome. Out of a maximum score of 100 the median score was 46, indicating sub-optimal reporting. A multiple regression analysis did not reveal any factors associated with high quality reporting. CONCLUSIONS Researchers should be mindful of the importance of PRO inclusion and reporting and include reliable PROs in trials.
Collapse
Affiliation(s)
- C Newman
- College of Medicine, Nursing and Health Sciences, National University of Ireland Galway, Galway, Ireland.
| | - O Kgosidialwa
- College of Medicine, Nursing and Health Sciences, National University of Ireland Galway, Galway, Ireland
| | - L Dervan
- College of Medicine, Nursing and Health Sciences, National University of Ireland Galway, Galway, Ireland
| | - D Bogdanet
- College of Medicine, Nursing and Health Sciences, National University of Ireland Galway, Galway, Ireland
| | - A M Egan
- Division of Endocrinology, Mayo Clinic, Rochester, MN, USA
| | - L Biesty
- School of Nursing and Midwifery, National University of Ireland, Galway, Galway, Ireland
| | - D Devane
- HRB-Trials Methodology Research Network, National University of Ireland Galway, Galway, Ireland; INFANT Centre and Department of Paediatrics & Child Health, University College Cork, Cork, Ireland
| | - P M O'Shea
- Department of Clinical Biochemistry, Galway University Hospital, Galway, Ireland
| | - F P Dunne
- College of Medicine, Nursing and Health Sciences, National University of Ireland Galway, Galway, Ireland
| |
Collapse
|
17
|
Khan T, Khalid M, Dunford B, Nguyen T, Wise A, Heigle B, Shepard S, Kee M, Hillman C, Ottwell R, Hartwell M, Vassar M. Incomplete Reporting of Patient-Reported Outcomes in Multiple Sclerosis: A Meta-Epidemiological Study of Randomized Controlled Trials. Mult Scler Relat Disord 2022; 63:103819. [DOI: 10.1016/j.msard.2022.103819] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2021] [Revised: 03/25/2022] [Accepted: 04/21/2022] [Indexed: 11/28/2022]
|
18
|
Mercieca-Bebber R, Aiyegbusi OL, King MT, Brundage M, Snyder C, Calvert M. Knowledge translation concerns for the CONSORT-PRO extension reporting guidance: a review of reviews. Qual Life Res 2022; 31:2939-2957. [PMID: 35347521 PMCID: PMC9470606 DOI: 10.1007/s11136-022-03119-w] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/28/2022] [Indexed: 10/29/2022]
Abstract
This review of reviews aimed to appraise the use of the CONSORT-PRO Extension as an evaluation tool for assessing the reporting of patient-reported outcome (PROs) in publications, and to describe the reporting of PRO research across reviews. We also outlined how variation in such evaluations impacts knowledge translation and may lead to potential misuse of the CONSORT-PRO Extension. We systematically searched Medline, Pubmed and CINAHL from 2013 to 2025 March 2021 for reviews of the completeness of reporting of PRO endpoints according to CONSORT-PRO criteria. Two reviewers extracted details of each review, the percentage of included studies that addressed each CONSORT-PRO item, and key recommendations from each review. Fourteen reviews met inclusion criteria, and only six of these used the full CONSORT-PRO checklist with minimal justified modifications. The remaining eight studies made significant or unjustified adjustments to the CONSORT-PRO Extension. Review studies also varied in how they scored multi-component CONSORT-PRO items. CONSORT-PRO items were often unreported in trial reports, and certain CONSORT-PRO items were reported less often than others. The reporting of statistical approaches to dealing with missing PRO data were poor in RCTs included in all 14 review articles. Studies reviewing PRO publications often omitted recommended CONSORT-PRO items from their evaluations, which may cause confusion among readers regarding how best to report their PRO research according to the CONSORT-PRO extension. Many trials published since CONSORT-PRO's release did not report recommended CONSORT-PRO items, which may lead to misinterpretation and consequently to research waste.
Collapse
Affiliation(s)
- Rebecca Mercieca-Bebber
- NHMRC Clinical Trials Centre, Faculty of Medicine and Health, University of Sydney, Sydney, Australia.
| | - Olalekan Lee Aiyegbusi
- Centre for Patient Reported Outcomes Research, and Birmingham Health Partners Centre for Regulatory Science and Innovation, Institute of Applied Health Research, University of Birmingham, and University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK.,National Institute for Health Research (NIHR) Birmingham Biomedical Research Centre, NIHR Surgical Reconstruction and Microbiology Research Centre, NIHR Applied Research Centre West Midlands, University of Birmingham, Birmingham, UK
| | - Madeleine T King
- School of Psychology, Faculty of Science, University of Sydney, Sydney, Australia
| | - Michael Brundage
- Cancer Care and Epidemiology, Department of Oncology, Cancer Research Institute, Queen's University, Kingston, ON, Canada
| | - Claire Snyder
- Johns Hopkins School of Medicine and Bloomberg School of Public Health, Baltimore, MD, USA
| | - Melanie Calvert
- Centre for Patient Reported Outcomes Research, and Birmingham Health Partners Centre for Regulatory Science and Innovation, Institute of Applied Health Research, University of Birmingham, and University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK.,School of Psychology, Faculty of Science, University of Sydney, Sydney, Australia
| |
Collapse
|
19
|
Ward L, Nault D, Cramer H, Moonaz S. Development of the CLARIFY (CheckList stAndardising the Reporting of Interventions For Yoga) guidelines: a Delphi study. BMJ Open 2022; 12:e054585. [PMID: 35105638 PMCID: PMC8804643 DOI: 10.1136/bmjopen-2021-054585] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/29/2022] Open
Abstract
BACKGROUND The use of yoga as a therapeutic modality is increasing; however, a lack of transparent intervention reporting is restricting the dissemination and implementation of yoga research into clinical and community practice. The aim of this study was to develop a yoga-specific reporting guideline as an extension to existing reporting guidelines for randomised controlled trials, observational studies and case reports. METHODS Recognised international stakeholders in the design and conduct of yoga research were invited to contribute to the electronic Delphi survey. A four-round Delphi was conducted, whereby panellists rated selected items for their importance in the inclusion of yoga reporting guidelines, according to a 5-step Likert scale. A priori consensus for item inclusion was agreement of items as 'Very important' or 'Extremely important' by ≥80% of panellists. Non-consensus items were forwarded to subsequent rounds for re-rating. RESULTS 53 experts in yoga research from 11 countries, primarily identifying as researchers (50%), allied health professionals (18.8%) and yoga professionals (12.5%), consented to participate in the Delphi. Of these, 48 completed Round 1 (91%), 43 completed Round 2 (81%), 39 completed Round 3 (74%) and 32 completed Round 4 (60%). Panellists reached consensus for inclusion on 21 items, grouped under 10 domains reflective of more generic intervention-based guidelines. CONCLUSIONS The consensus-based 21-item CLARIFY (CheckList stAndardising the Reporting of Interventions For Yoga) checklist provides a minimum reporting template for researchers across a range of methodology designs. Use of these yoga-specific guidelines, in conjunction with the CLARIFY explanation and elaboration guidelines, will standardise the minimum level of detail required for transparent yoga intervention, facilitating the replication, dissemination and implementation of yoga research. Ongoing research will assess the uptake and impact of CLARIFY, to ensure these guidelines retain their relevance to the internationally growing field of yoga research.
Collapse
Affiliation(s)
- Lesley Ward
- Department of Sport, Exercise and Rehabilitation, Northumbria University, Newcastle upon Tyne, UK
- Australian Research Centre in Complementary and Integrative Medicine, Faculty of Health, University of Technology Sydney, Sydney, New South Wales, Australia
| | - Daryl Nault
- Department of Integrative Health Research, Maryland University of Integrative Health, Laurel, Maryland, USA
| | - Holger Cramer
- Department of Internal and Integrative Medicine, Evang, Kliniken Essen-Mitte, Faculty of Medicine, University of Duisburg-Essen, Essen, Germany
| | - Steffany Moonaz
- Department of Integrative Health Research, Maryland University of Integrative Health, Laurel, Maryland, USA
| |
Collapse
|
20
|
Efficace F, Giesinger JM, Cella D, Cottone F, Sparano F, Vignetti M, Aaronson NK. Investigating Trends in the Quality of Reporting of Patient-Reported Outcomes in Oncology Over Time: Analysis of 631 Randomized Controlled Trials Published Between 2004 and 2019. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2021; 24:1715-1719. [PMID: 34838268 DOI: 10.1016/j.jval.2021.06.003] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Revised: 05/10/2021] [Accepted: 06/07/2021] [Indexed: 06/13/2023]
Abstract
OBJECTIVES Incomplete reporting of key information on patient-reported outcomes (PROs) in randomized controlled trials (RCTs) in oncology has been highlighted repeatedly as a major barrier to the use of study findings in clinical practice. We investigated whether the quality of reporting of PRO data in cancer RCTs has improved over the last 15 years. METHODS We identified all cancer RCTs with PRO endpoints conducted across the most prevalent solid tumor types worldwide published between 2004 and 2019. The quality of PRO reporting was assessed using the International Society for Quality of Life Research recommended standards, which include important aspects related to assessment methodology, statistical analyses, and interpretation of data. RESULTS We assessed a total of 631 cancer RCTs in breast (n = 187), lung (n = 131), prostate (n = 120), colorectal (n = 107), and gynecological (n = 86) cancer. We observed a higher adherence to the International Society for Quality of Life Research reporting criteria in the more recently published studies. In a multivariable linear regression analysis, we observed a statistically significant improvement in the quality of PRO reporting over time (P<.001), and this relationship was independent of other measured confounding factors, such as sample size and study sponsorship. Overall, the quality of PRO reporting was higher for studies published after the publication of the Consolidated Standards of Reporting Trials-PRO Extension. CONCLUSIONS The quality of PRO reporting in cancer RCTs published in the last 15 years has improved significantly. Our findings are encouraging because better reporting of PRO results may translate into a greater impact of study findings on real-world practice.
Collapse
Affiliation(s)
- Fabio Efficace
- Data Center and Health Outcomes Research Unit, Italian Group for Adult Hematologic Diseases (GIMEMA), Rome, Italy; Department of Medical Social Sciences and Robert H. Lurie Comprehensive Cancer Center, Northwestern University, Chicago, IL, USA.
| | - Johannes M Giesinger
- University Hospital of Psychiatry II, Medical University of Innsbruck, Innsbruck, Austria
| | - David Cella
- Department of Medical Social Sciences and Robert H. Lurie Comprehensive Cancer Center, Northwestern University, Chicago, IL, USA
| | - Francesco Cottone
- Data Center and Health Outcomes Research Unit, Italian Group for Adult Hematologic Diseases (GIMEMA), Rome, Italy
| | - Francesco Sparano
- Data Center and Health Outcomes Research Unit, Italian Group for Adult Hematologic Diseases (GIMEMA), Rome, Italy
| | - Marco Vignetti
- Data Center and Health Outcomes Research Unit, Italian Group for Adult Hematologic Diseases (GIMEMA), Rome, Italy
| | - Neil K Aaronson
- Division of Psychosocial Research and Epidemiology, The Netherlands Cancer Institute, Amsterdam, The Netherlands
| |
Collapse
|
21
|
Malički M, Jerončić A, Aalbersberg IJJ, Bouter L, Ter Riet G. Systematic review and meta-analyses of studies analysing instructions to authors from 1987 to 2017. Nat Commun 2021; 12:5840. [PMID: 34611157 PMCID: PMC8492806 DOI: 10.1038/s41467-021-26027-y] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2020] [Accepted: 08/24/2021] [Indexed: 02/08/2023] Open
Abstract
To gain insight into changes of scholarly journals' recommendations, we conducted a systematic review of studies that analysed journals' Instructions to Authors (ItAs). We summarised results of 153 studies, and meta-analysed how often ItAs addressed: 1) authorship, 2) conflicts of interest, 3) data sharing, 4) ethics approval, 5) funding disclosure, and 6) International Committee of Medical Journal Editors' Uniform Requirements for Manuscripts. For each topic we found large between-study heterogeneity. Here, we show six factors that explained most of that heterogeneity: 1) time (addressing of topics generally increased over time), 2) country (large differences found between countries), 3) database indexation (large differences found between databases), 4) impact factor (topics were more often addressed in highest than in lowest impact factor journals), 5) discipline (topics were more often addressed in Health Sciences than in other disciplines), and 6) sub-discipline (topics were more often addressed in general than in sub-disciplinary journals).
Collapse
Affiliation(s)
- Mario Malički
- Urban Vitality Centre of Expertise, Amsterdam University of Applied Sciences, Amsterdam, The Netherlands.
- Amsterdam UMC, University of Amsterdam, Department of Cardiology, Amsterdam, The Netherlands.
| | - Ana Jerončić
- Department of Research in Biomedicine and Health, University of Split School of Medicine, Split, Croatia
| | | | - Lex Bouter
- Department of Philosophy, Faculty of Humanities, Vrije Universiteit, Amsterdam, The Netherlands
- Amsterdam UMC, Vrije Universiteit, Department of Epidemiology and Statistics, Amsterdam, The Netherlands
| | - Gerben Ter Riet
- Urban Vitality Centre of Expertise, Amsterdam University of Applied Sciences, Amsterdam, The Netherlands
- Amsterdam UMC, University of Amsterdam, Department of Cardiology, Amsterdam, The Netherlands
| |
Collapse
|
22
|
Moonaz S, Nault D, Cramer H, Ward L. CLARIFY 2021: explanation and elaboration of the Delphi-based guidelines for the reporting of yoga research. BMJ Open 2021; 11:e045812. [PMID: 34353794 PMCID: PMC8344321 DOI: 10.1136/bmjopen-2020-045812] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Accepted: 07/07/2021] [Indexed: 12/01/2022] Open
Abstract
BACKGROUND Reporting of yoga research often lacks the detail required for clinical application, study replication, summary research and comparative effectiveness studies. METHODS To improve the transparency of reporting yoga interventions, and building on the development of previous reporting guidelines, a group of international yoga research stakeholders developed the consensus-based CheckList stAndardising the Reporting of Interventions For Yoga (CLARIFY) guidelines. RESULTS The 21-item CLARIFY checklist outlines the minimum details considered necessary for high-quality reporting of yoga research. This paper provides a detailed explanation of each of the 21 items of the CLARIFY checklist, together with model examples of how to integrate each item into publications of yoga research. The CLARIFY guideline serves as an extension for existing research reporting guidelines, and is flexible for use across all study designs. CONCLUSION We strongly encourage the uptake of these reporting guidelines by researchers and journals, to facilitate improvements in the transparency and utility of yoga research.
Collapse
Affiliation(s)
- Steffany Moonaz
- Department of Integrative Health Research, Maryland University of Integrative Health, Laurel, Maryland, USA
| | - Daryl Nault
- Department of Integrative Health Research, Maryland University of Integrative Health, Laurel, Maryland, USA
| | - Holger Cramer
- Department of Internal and Integrative Medicine, Evang, Kliniken Essen-Mitte, Faculty of Medicine, University of Duisburg-Essen, Essen, Germany
| | - Lesley Ward
- Department of Sport, Exercise & Rehabilitation, Northumbria University, Newcastle Upon Tyne, Northumberland, UK
| |
Collapse
|
23
|
Astrup GL, Rohde G, Rimehaug SA, Andersen MH, Bernklev T, Bjordal K, Falk RS, Jørgensen NMH, Stavem K, Tollisen A, Amdal CD. Comparing the use of patient-reported outcomes in clinical studies in Europe in 2008 and 2018: a literature review. Qual Life Res 2021; 31:659-669. [PMID: 34350566 PMCID: PMC8921066 DOI: 10.1007/s11136-021-02946-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/08/2021] [Indexed: 11/30/2022]
Abstract
PURPOSE Several guidelines for the use of patient-reported outcomes (PROs) in clinical studies have been published in the past decade. This review primarily aimed to compare the number and compliance with selected PRO-specific criteria for reporting of clinical studies in Europe using PROs published in 2008 and 2018. Secondarily, to describe the study designs, PRO instruments used, patient groups studied, and countries where the clinical studies were conducted. METHODS A literature search was conducted in MEDLINE to identify eligible publications. To assess the number of publications, all abstracts were screened for eligibility by pairs of reviewers. Compliance with PRO-specific criteria and other key characteristics was assessed in a random sample of 150 eligible full-text publications from each year. Randomized controlled trials (RCTs) were assessed according to the full CONSORT-PRO checklist. RESULTS The search identified 1692 publications in 2008 and 4290 in 2018. After screening of abstracts, 1240 from 2008 and 2869 from 2018 were clinical studies using PROs. By full-text review, the proportion of studies discussing PRO-specific limitations and implications was higher in 2018 than in 2008, but there were no differences in the other selected PRO-specific criteria. In 2018, a higher proportion of studies were longitudinal/cohort studies, included ≥ 300 patients, and used electronic administration of PRO than in 2008. The most common patient groups studied were those with cancer or diseases of the musculoskeletal system or connective tissue. CONCLUSION The number of clinical studies from Europe using PROs was higher in 2018 than in 2008, but there was little difference in compliance with the PRO-specific criteria. The studies varied in terms of study design and PRO instruments used in both publication years.
Collapse
Affiliation(s)
| | - Gudrun Rohde
- Department of Clinical Research, Sørlandet Hospital, Kristiansand, Norway.,Faculty of Health and Sport Sciences, University of Agder, Kristiansand, Norway
| | | | - Marit Helen Andersen
- Department of Transplantation Medicine, Oslo University Hospital, Oslo, Norway.,Faculty of Medicine, University of Oslo, Oslo, Norway
| | - Tomm Bernklev
- Faculty of Medicine, University of Oslo, Oslo, Norway.,Department of Research and Innovation, Vestfold Hospital, Tønsberg, Norway
| | - Kristin Bjordal
- Research support services, Oslo University Hospital, Oslo, Norway.,Faculty of Medicine, University of Oslo, Oslo, Norway
| | | | | | - Knut Stavem
- Faculty of Medicine, University of Oslo, Oslo, Norway.,Department of Pulmonary Medicine, Akershus University Hospital, Lørenskog, Norway.,Health Services Research Unit, Akershus University Hospital, Lørenskog, Norway
| | - Anita Tollisen
- Unger-Vetlesens Institute, Lovisenberg Diaconal Hospital, Oslo, Norway
| | | | | |
Collapse
|
24
|
Calvert M, King M, Mercieca-Bebber R, Aiyegbusi O, Kyte D, Slade A, Chan AW, Basch E, Bell J, Bennett A, Bhatnagar V, Blazeby J, Bottomley A, Brown J, Brundage M, Campbell L, Cappelleri JC, Draper H, Dueck AC, Ells C, Frank L, Golub RM, Griebsch I, Haywood K, Hunn A, King-Kallimanis B, Martin L, Mitchell S, Morel T, Nelson L, Norquist J, O'Connor D, Palmer M, Patrick D, Price G, Regnault A, Retzer A, Revicki D, Scott J, Stephens R, Turner G, Valakas A, Velikova G, von Hildebrand M, Walker A, Wenzel L. SPIRIT-PRO Extension explanation and elaboration: guidelines for inclusion of patient-reported outcomes in protocols of clinical trials. BMJ Open 2021; 11:e045105. [PMID: 34193486 PMCID: PMC8246371 DOI: 10.1136/bmjopen-2020-045105] [Citation(s) in RCA: 60] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/24/2020] [Revised: 12/21/2020] [Accepted: 01/08/2021] [Indexed: 01/21/2023] Open
Abstract
Patient-reported outcomes (PROs) are used in clinical trials to provide valuable evidence on the impact of disease and treatment on patients' symptoms, function and quality of life. High-quality PRO data from trials can inform shared decision-making, regulatory and economic analyses and health policy. Recent evidence suggests the PRO content of past trial protocols was often incomplete or unclear, leading to research waste. To address this issue, international, consensus-based, PRO-specific guidelines were developed: the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT)-PRO Extension. The SPIRIT-PRO Extension is a 16-item checklist which aims to improve the content and quality of aspects of clinical trial protocols relating to PRO data collection to minimise research waste, and ultimately better inform patient-centred care. This SPIRIT-PRO explanation and elaboration (E&E) paper provides information to promote understanding and facilitate uptake of the recommended checklist items, including a comprehensive protocol template. For each SPIRIT-PRO item, we provide a detailed description, one or more examples from existing trial protocols and supporting empirical evidence of the item's importance. We recommend this paper and protocol template be used alongside the SPIRIT 2013 and SPIRIT-PRO Extension paper to optimise the transparent development and review of trial protocols with PROs.
Collapse
Affiliation(s)
- Melanie Calvert
- Centre for Patient Reported Outcome Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
- Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, UK
- NIHR Biomedical Research Centre, Institute of Translational Medicine, Birmingham, UK
- NIHR Surgical Reconstruction and Microbiology Research Centre, Birmingham, UK
- NIHR Applied Research Collaboration West Midlands, University of Birmingham, Birmingham, UK
| | - Madeleine King
- Faculty of Science, School of Psychology, University of Sydney, Sydney, New South Wales, Australia
| | - Rebecca Mercieca-Bebber
- Faculty of Medicine and Health, NHMRC Clinical Trials Centre, University of Sydney, Sydney, New South Wales, Australia
| | - Olalekan Aiyegbusi
- Centre for Patient Reported Outcome Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
- NIHR Biomedical Research Centre, Institute of Translational Medicine, Birmingham, UK
| | - Derek Kyte
- Centre for Patient Reported Outcome Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Anita Slade
- Centre for Patient Reported Outcome Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
- NIHR Surgical Reconstruction and Microbiology Research Centre, Birmingham, UK
| | - An-Wen Chan
- Women's College Research Institute, Department of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - E Basch
- University of North Carolina, Chapel Hill, North Carolina, USA
| | - Jill Bell
- Oncology Digital Health, AstraZeneca, Gaithersburg, Maryland, USA
| | - Antonia Bennett
- Cancer Outcomes Research Program, University of North Carolina, Chapel Hill, North Carolina, USA
| | | | - Jane Blazeby
- NIHR Bristol Biomedical Research Centre, University of Bristol, Bristol, UK
- Division of Surgery, Head and Neck, University Hospitals Bristol NHS Foundation Trust, Bristol, UK
| | - Andrew Bottomley
- Department of Quality of Life, European Organisation for Research and Treatment of Cancer, Brussels, Belgium
| | - Julia Brown
- Clinical Trials Research Unit, University of Leeds, Leeds, UK
| | - Michael Brundage
- Department of Oncology, Queen's University Cancer Research Institute, Kingston, Ontario, Canada
| | - Lisa Campbell
- Medicines and Healthcare Products Regulatory Agency, London, UK
| | - Joseph C Cappelleri
- Global Biometrics & Data Management-Statistics, Pfizer Inc, New York City, New York, USA
| | | | - Amylou C Dueck
- Department of Health Sciences Research, Mayo Clinic, Scottsdale, Arizona, USA
| | - Carolyn Ells
- School of Population and Global Health, McGill University, Montreal, Quebec, Canada
| | - Lori Frank
- Patient-Centered Outcomes Research Institute, Washington, DC, USA
| | | | | | - Kirstie Haywood
- Warwick Research in Nursing, University of Warwick, Warwick Medical School, Coventry, UK
| | | | | | | | | | - Thomas Morel
- Patient-Centered Outcomes Research, UCB Pharma, Brussels, Belgium
| | - Linda Nelson
- Value Evidence and Outcomes-Patient Centered Outcomes, GSK, Collegeville, Pennsylvania, USA
| | - Josephine Norquist
- Center for Observational Real-world Evidence (CORE), Patient-Centered Endpoints & Strategy, Merck & Co Inc, Kenilworth, New Jersey, USA
| | - Daniel O'Connor
- Medicines and Healthcare Products Regulatory Agency, London, UK
| | - Michael Palmer
- Cancer Research Institute, Queen's University, Kingston, Ontario, Canada
| | - Donald Patrick
- Department of Health Services, University of Washington, Seattle, Washington, USA
| | - Gary Price
- Centre for Patient Reported Outcome Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | | | - Ameeta Retzer
- Centre for Patient Reported Outcome Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | | | - Jane Scott
- Johnson and Johnson, Janssen Global Services LLC, High Wycombe, UK
| | | | - Grace Turner
- Centre for Patient Reported Outcome Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
- NIHR Surgical Reconstruction and Microbiology Research Centre, Birmingham, UK
| | - Antonia Valakas
- EMD Serono Inc, Healthcare Business of Merck KGaA, Darmstadt, Germany
| | - Galina Velikova
- Leeds Institute of Medical Research at St James's, University of Leeds, Leeds, UK
| | - Maria von Hildebrand
- Centre for Patient Reported Outcome Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Anita Walker
- Centre for Patient Reported Outcome Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Lari Wenzel
- University of California, Irvine, California, USA
| |
Collapse
|
25
|
Slade AL, Retzer A, Ahmed K, Kyte D, Keeley T, Armes J, Brown JM, Calman L, Gavin A, Glaser AW, Greenfield DM, Lanceley A, Taylor RM, Velikova G, Turner G, Calvert MJ. Systematic review of the use of translated patient-reported outcome measures in cancer trials. Trials 2021; 22:306. [PMID: 33902699 PMCID: PMC8074490 DOI: 10.1186/s13063-021-05255-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Accepted: 04/08/2021] [Indexed: 01/10/2023] Open
Abstract
BACKGROUND Patient-reported outcomes (PROs) are used in clinical trials to assess the effectiveness and tolerability of interventions. Inclusion of participants from different ethnic backgrounds is essential for generalisability of cancer trial results. PRO data collection should include appropriately translated patient-reported outcome measures (PROMs) to minimise missing data and sample attrition. METHODS Protocols and/or publications from cancer clinical trials using a PRO endpoint and registered on the National Institute for Health Research Portfolio were systematically reviewed for information on recruitment, inclusion of ethnicity data, and use of appropriately translated PROMs. Semi-structured interviews were conducted with key stakeholders to explore barriers and facilitators for optimal PRO trial design, diverse recruitment and reporting, and use of appropriately translated PROMs. RESULTS Eighty-four trials met the inclusion criteria, only 14 (17%) (n = 4754) reported ethnic group data, and ethnic group recruitment was low, 611 (13%). Although 8 (57%) studies were multi-centred and multi-national, none reported using translated PROMs, although available for 7 (88%) of the studies. Interviews with 44 international stakeholders identified a number of perceived barriers to ethnically diverse recruitment including diverse participant engagement, relevance of ethnicity to research question, prominence of PROs, and need to minimise investigator burden. Stakeholders had differing opinions on the use of translated PROMs, the impact of trial designs, and recruitment strategies on diverse recruitment. Facilitators of inclusive research were described and examples of good practice identified. CONCLUSIONS Greater transparency is required when PROs are used as primary or secondary outcomes in clinical trials. Protocols and publications should demonstrate that recruitment was accessible to diverse populations and facilitated by trial design, recruitment strategies, and appropriate PROM usage. The use of translated PROMs should be made explicit when used in cancer clinical trials.
Collapse
Affiliation(s)
- A L Slade
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK. .,National Institute for Health Research (NIHR) Birmingham Biomedical Research Centre, University Hospitals Birmingham NHS Foundation Trust and the University of Birmingham, Birmingham, UK. .,National Institute for Health Research Surgical Reconstruction and Microbiology Research Centre, University of Birmingham, Birmingham, West Midlands, UK.
| | - A Retzer
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK
| | - K Ahmed
- Birmingham Clinical Trials Unit, University of Birmingham, Birmingham, UK
| | - D Kyte
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK.,National Institute for Health Research (NIHR) Birmingham Biomedical Research Centre, University Hospitals Birmingham NHS Foundation Trust and the University of Birmingham, Birmingham, UK.,National Cancer Research Institute (NCRI) Psychosocial Oncology and Survivorship Clinical Studies Group subgroup: Understanding and measuring the consequences of cancer and its treatment, London, UK
| | - T Keeley
- Patient Centred Outcomes, GlaxoSmithKline, Brentford, UK
| | - J Armes
- National Cancer Research Institute (NCRI) Psychosocial Oncology and Survivorship Clinical Studies Group subgroup: Understanding and measuring the consequences of cancer and its treatment, London, UK.,School of Health Sciences, University of Surrey, Guildford, UK.,NIHR Applied Research Collaboration Kent Surrey & Sussex University of Surrey, Guildford, UK
| | - J M Brown
- Clinical Trials Research Unit, University of Leeds, Leeds, UK
| | - L Calman
- National Cancer Research Institute (NCRI) Psychosocial Oncology and Survivorship Clinical Studies Group subgroup: Understanding and measuring the consequences of cancer and its treatment, London, UK.,Macmillan Survivorship Research Group, Health Sciences, University of Southampton, Highfield Campus, Southampton, UK
| | - A Gavin
- National Cancer Research Institute (NCRI) Psychosocial Oncology and Survivorship Clinical Studies Group subgroup: Understanding and measuring the consequences of cancer and its treatment, London, UK.,Northern Ireland Cancer Registry, Centre for Public Health, Queens University Belfast, Belfast, Northern Ireland
| | - A W Glaser
- National Cancer Research Institute (NCRI) Psychosocial Oncology and Survivorship Clinical Studies Group subgroup: Understanding and measuring the consequences of cancer and its treatment, London, UK.,Leeds Institute of Medical Research at St James's, University of Leeds, Leeds, UK
| | - D M Greenfield
- National Cancer Research Institute (NCRI) Psychosocial Oncology and Survivorship Clinical Studies Group subgroup: Understanding and measuring the consequences of cancer and its treatment, London, UK.,Sheffield Teaching Hospital NHS Foundation Trust, Sheffield, UK
| | - A Lanceley
- National Cancer Research Institute (NCRI) Psychosocial Oncology and Survivorship Clinical Studies Group subgroup: Understanding and measuring the consequences of cancer and its treatment, London, UK.,Elizabeth Garrett Anderson Institute for Women's Health, University College London, London, UK
| | - R M Taylor
- National Cancer Research Institute (NCRI) Psychosocial Oncology and Survivorship Clinical Studies Group subgroup: Understanding and measuring the consequences of cancer and its treatment, London, UK.,Cancer Clinical Trials Unit, University College London Hospitals NHS Foundation Trust, London, UK
| | - G Velikova
- Leeds Institute of Medical Research at St James's, University of Leeds, Leeds, UK
| | - G Turner
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK
| | - M J Calvert
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK.,National Institute for Health Research (NIHR) Birmingham Biomedical Research Centre, University Hospitals Birmingham NHS Foundation Trust and the University of Birmingham, Birmingham, UK.,National Institute for Health Research Surgical Reconstruction and Microbiology Research Centre, University of Birmingham, Birmingham, West Midlands, UK.,National Institute for Health Research Applied Research Collaboration, University of Birmingham, Birmingham, West Midlands, UK.,Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, West Midlands, UK
| |
Collapse
|
26
|
Garnier L, Charton E, Falcoz A, Paget-Bailly S, Vernerey D, Jary M, Ducray F, Curtit E. Quality of patient-reported outcome reporting according to the CONSORT statement in randomized controlled trials with glioblastoma patients. Neurooncol Pract 2020; 8:148-159. [PMID: 33898048 DOI: 10.1093/nop/npaa074] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Background Randomized controlled trials (RCTs) represent the best evidence in oncology research. Glioblastoma is the most frequent and deadly primary brain tumor, affecting health-related quality of life. An important end point is patient-reported outcomes (PROs). There are no data regarding how well publications of glioblastoma RCTs report PROs. A specific PRO extension of the Consolidated Standards of Reporting Trials (CONSORT) statement was created to improve the quality of reporting. The aim of this study was to evaluate adherence to the CONSORT-PRO statement in reporting RCTs addressing the treatment of patients with glioblastoma. PRO analysis methodology was explored and criteria associated with higher quality of reporting were investigated. Methods From PubMed/MEDLINE and the Cochrane Library databases, all phase 2 and 3 RCTs related to glioblastoma published between 1995 and 2018 were reviewed according to the CONSORT-PRO statements. An overall quality score on a 0 to 100 scale was defined based on these criteria and factors associated with this score were identified. Results Forty-four RCTs were identified as relevant according to predefined criteria. The median overall quality score was 26. No difference was observed regarding reporting quality over the years. CONSORT-PRO items concerning data collection and analysis were poorly reported. Thirty-four trials (77%) used longitudinal data. The most frequent statistical method for PROs analysis was the mean change from baseline (63%). Factors associated with improved overall quality score were the presence of a secondary publication dedicated to PROs results, the statement of any targeted dimensions, and when trials reported results using multiple methods. Conclusion Despite the importance of measuring PROs in patients with glioblastoma, employment of the CONSORT-PRO statement is poor in RCTs.
Collapse
Affiliation(s)
- Louis Garnier
- Department of Medical Oncology, University Hospital of Besançon, Besançon, France.,University Bourgogne Franche-Comté, INSERM, EFS BFC, UMR1098, Host-Graft Tumor Interaction, Besançon, France.,Department of Neuro-Oncology, Hospices Civils de Lyon, Lyon, France
| | - Emilie Charton
- University Bourgogne Franche-Comté, INSERM, EFS BFC, UMR1098, Host-Graft Tumor Interaction, Besançon, France.,Methodology and Quality of Life Unit in Oncology, University Hospital of Besançon, Besançon, France.,French National Platform Quality of Life and Cancer, Besançon, France
| | - Antoine Falcoz
- University Bourgogne Franche-Comté, INSERM, EFS BFC, UMR1098, Host-Graft Tumor Interaction, Besançon, France.,Methodology and Quality of Life Unit in Oncology, University Hospital of Besançon, Besançon, France
| | - Sophie Paget-Bailly
- University Bourgogne Franche-Comté, INSERM, EFS BFC, UMR1098, Host-Graft Tumor Interaction, Besançon, France.,Methodology and Quality of Life Unit in Oncology, University Hospital of Besançon, Besançon, France
| | - Dewi Vernerey
- University Bourgogne Franche-Comté, INSERM, EFS BFC, UMR1098, Host-Graft Tumor Interaction, Besançon, France.,Methodology and Quality of Life Unit in Oncology, University Hospital of Besançon, Besançon, France
| | - Marine Jary
- Department of Medical Oncology, University Hospital of Besançon, Besançon, France.,University Bourgogne Franche-Comté, INSERM, EFS BFC, UMR1098, Host-Graft Tumor Interaction, Besançon, France
| | - François Ducray
- Department of Neuro-Oncology, Hospices Civils de Lyon, Lyon, France
| | - Elsa Curtit
- Department of Medical Oncology, University Hospital of Besançon, Besançon, France.,University Bourgogne Franche-Comté, INSERM, EFS BFC, UMR1098, Host-Graft Tumor Interaction, Besançon, France
| |
Collapse
|
27
|
Affiliation(s)
- Jan R Boehnke
- School of Health Sciences, University of Dundee, 11 Airlie Place, Dundee, DD1 4HJ, UK.
| | - Claudia Rutherford
- Faculty of Science, School of Psychology, Quality of Life Office, The University of Sydney, Sydney, Australia.,Faculty of Medicine and Health, The University of Sydney Susan Wakil School of Nursing and Midwifery, Cancer Nursing Research Unit (CNRU), The University of Sydney, Sydney, Australia
| |
Collapse
|
28
|
Armstrong TS, Dirven L, Arons D, Bates A, Chang SM, Coens C, Espinasse C, Gilbert MR, Jenkinson D, Kluetz P, Mendoza T, Rubinstein L, Sul J, Weller M, Wen PY, van den Bent MJ, Taphoorn MJB. Glioma patient-reported outcome assessment in clinical care and research: a Response Assessment in Neuro-Oncology collaborative report. Lancet Oncol 2020; 21:e97-e103. [PMID: 32007210 DOI: 10.1016/s1470-2045(19)30796-x] [Citation(s) in RCA: 42] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2019] [Revised: 11/06/2019] [Accepted: 11/14/2019] [Indexed: 12/19/2022]
Abstract
Clinical trials of treatments for high-grade gliomas have traditionally relied on measures of response or time-dependent metrics; however, these endpoints have limitations because they do not characterise the functional or symptomatic effect of the condition on the person. Including clinical outcome assessments, such as patient- reported outcomes (PROs), to determine net clinical benefit of a treatment strategy is needed because of the substantial burden of symptoms and impaired functioning in this patient population. The US National Cancer Institute convened a meeting to review previous recommendations and existing PRO measures of symptoms and function that can be applied to current trials and clinical practice for high-grade gliomas. Measures were assessed for relevance, relationship to disease and therapy, sensitivity to change, psychometric properties, response format, patient acceptability, and use of self-report. The group also relied on patient input including the results of an online survey, a literature review on available clinical outcomes, expert opinion, and alignment with work done by other organisations. A core set of priority constructs was proposed that allows more comprehensive evaluation of therapies and comparison of outcomes among studies, and enhances efforts to improve the measurement of these core clinical outcomes. The proposed set of constructs was then presented to the Society for Neuro-Oncology Response Assessment in Neuro-Oncology Working Group and feedback was solicited.
Collapse
Affiliation(s)
- Terri S Armstrong
- Neuro-Oncology Branch, Center for Cancer Research, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA.
| | - Linda Dirven
- Department of Neurology, Leiden University Medical Center, Leiden, Netherlands
| | - David Arons
- National Brain Tumor Society, Newton, MA, USA
| | | | - Susan M Chang
- Division of Neuro Oncology, Department of Neurological Surgery, University of California San Francisco, San Francisco, CA, USA
| | - Corneel Coens
- Statistical Department, European Organization for the Outcomes and Treatment of Cancer Headquarters, Brussels, Belgium
| | - Claire Espinasse
- Scientific and Regulatory Management, European Medicines Agency, Amsterdam, Netherlands
| | - Mark R Gilbert
- Neuro-Oncology Branch, Center for Cancer Research, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | | | - Paul Kluetz
- Oncology Center of Excellence, US Food and Drug Administration, Silver Spring, MD, USA
| | - Tito Mendoza
- Symptom Research, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Larry Rubinstein
- Biometric Research Program, National Cancer Institute, Bethesda, MD, USA
| | - Joohee Sul
- Oncology Center of Excellence, US Food and Drug Administration, Silver Spring, MD, USA
| | - Michael Weller
- Department of Neurology, Institution University Hospital and University of Zurich, Zurich, Switzerland
| | - Patrick Y Wen
- Center For Neuro-Oncology, Dana-Farber Cancer Institute, Boston, MA, USA
| | | | - Martin J B Taphoorn
- Department of Neurology, Leiden University Medical Center, Leiden, Netherlands; Department of Neurology, Haaglanden Medical Center, The Hague, Netherlands
| |
Collapse
|
29
|
Van Hemelrijck M, Sparano F, Moris L, Beyer K, Cottone F, Sprangers M, Efficace F. Harnessing the patient voice in prostate cancer research: Systematic review on the use of patient-reported outcomes in randomized controlled trials to support clinical decision-making. Cancer Med 2020; 9:4039-4058. [PMID: 32333639 PMCID: PMC7300413 DOI: 10.1002/cam4.3018] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Revised: 01/31/2020] [Accepted: 03/10/2020] [Indexed: 02/06/2023] Open
Abstract
Background Given the growing importance of patient‐reported outcomes (PROs) as part of “big data” in improving patient care, there is a need to provide a state‐of‐the‐art picture of the added value of using PROs in prostate cancer (PCa) randomized controlled trials (RCTs). We aimed to synthetize the most recent high‐quality PRO evidence‐based knowledge from PCa RCTs and to examine whether quality of PRO reporting in PCa research improved over time. Methods We conducted a systematic literature search using PubMed, from April 2012 until February 2019. For benchmarking purposes, we also included RCTs identified in our previously published review of RCTs (2004‐2012). Methodology for study identification and evaluation followed standardized criteria and a predefined data extraction form was used to abstract information. PRO quality of the studies was evaluated using the International Society of Quality of Life Research (ISOQOL) recommended criteria. Results A total of 55 new RCTs were published between April 2012 and February 2019. About 24 (43.6%) RCTs were found to be of high‐quality regarding PRO assessments. Of these, 13 (54.2%) have been reported in the most recent European Association of Urology (EAU) PCa Guidelines. Overall QoL and sexual, urinary, and bowel function were the most commonly reported PROs. FACT‐P, EPIC‐26, and EORTC QLQ‐C30 and/or its module PR25 were most frequently used as measurement tools. An overall improvement in the completeness of PRO reporting was noted over time. Conclusion Many PRO trials are currently not included in the EAU guidelines. Our findings suggest that there has to be a better consensus on the use of PRO data for PCa patients, which will then be reflected in the PCa Guidelines and future data collection. Homogeneity in PROs collection and measurement tools will in turn enable “big data” Consortia to increase the patients’ voice in clinical research.
Collapse
Affiliation(s)
- Mieke Van Hemelrijck
- School of Cancer and Pharmaceutical Sciences, Translational Oncology and Urology Research (TOUR), King's College London, London, UK
| | - Francesco Sparano
- Data Center and Health Outcomes Research Unit, Italian Group for Adult Hematologic Disease (GIMEMA), Rome, Italy
| | - Lisa Moris
- University Hospitals Leuven, Leuven, Belgium
| | - Katharina Beyer
- School of Cancer and Pharmaceutical Sciences, Translational Oncology and Urology Research (TOUR), King's College London, London, UK
| | - Francesco Cottone
- Data Center and Health Outcomes Research Unit, Italian Group for Adult Hematologic Disease (GIMEMA), Rome, Italy
| | - Mirjam Sprangers
- Department of Medical Psychology, Amsterdam University Medical Centers, Location Academic Medical Center, University of Amsterdam, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Fabio Efficace
- Data Center and Health Outcomes Research Unit, Italian Group for Adult Hematologic Disease (GIMEMA), Rome, Italy
| |
Collapse
|
30
|
Kyte D, Retzer A, Ahmed K, Keeley T, Armes J, Brown JM, Calman L, Gavin A, Glaser AW, Greenfield DM, Lanceley A, Taylor RM, Velikova G, Brundage M, Efficace F, Mercieca-Bebber R, King MT, Turner G, Calvert M. Systematic Evaluation of Patient-Reported Outcome Protocol Content and Reporting in Cancer Trials. J Natl Cancer Inst 2019; 111:1170-1178. [PMID: 30959516 PMCID: PMC6855977 DOI: 10.1093/jnci/djz038] [Citation(s) in RCA: 73] [Impact Index Per Article: 14.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2018] [Revised: 01/11/2019] [Accepted: 04/04/2019] [Indexed: 11/12/2022] Open
Abstract
BACKGROUND Patient-reported outcomes (PROs) are captured within cancer trials to help future patients and their clinicians make more informed treatment decisions. However, variability in standards of PRO trial design and reporting threaten the validity of these endpoints for application in clinical practice. METHODS We systematically investigated a cohort of randomized controlled cancer trials that included a primary or secondary PRO. For each trial, an evaluation of protocol and reporting quality was undertaken using standard checklists. General patterns of reporting where also explored. RESULTS Protocols (101 sourced, 44.3%) included a mean (SD) of 10 (4) of 33 (range = 2-19) PRO protocol checklist items. Recommended items frequently omitted included the rationale and objectives underpinning PRO collection and approaches to minimize/address missing PRO data. Of 160 trials with published results, 61 (38.1%, 95% confidence interval = 30.6% to 45.7%) failed to include their PRO findings in any publication (mean 6.43-year follow-up); these trials included 49 568 participants. Although two-thirds of included trials published PRO findings, reporting standards were often inadequate according to international guidelines (mean [SD] inclusion of 3 [3] of 14 [range = 0-11]) CONSORT PRO Extension checklist items). More than one-half of trials publishing PRO results in a secondary publication (12 of 22, 54.5%) took 4 or more years to do so following trial closure, with eight (36.4%) taking 5-8 years and one trial publishing after 14 years. CONCLUSIONS PRO protocol content is frequently inadequate, and nonreporting of PRO findings is widespread, meaning patient-important information may not be available to benefit patients, clinicians, and regulators. Even where PRO data are published, there is often considerable delay and reporting quality is suboptimal. This study presents key recommendations to enhance the likelihood of successful delivery of PROs in the future.
Collapse
Affiliation(s)
- Derek Kyte
- Correspondence to: Derek Kyte, PhD, Centre for Patient-Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Edgbaston, Birmingham B15 2TT, UK (e-mail: )
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
31
|
Van Der Weijst L, Lievens Y, Schrauwen W, Surmont V. Health-Related Quality of Life in Advanced Non-small Cell Lung Cancer: A Methodological Appraisal Based on a Systematic Literature Review. Front Oncol 2019; 9:715. [PMID: 31456938 PMCID: PMC6699450 DOI: 10.3389/fonc.2019.00715] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2019] [Accepted: 07/18/2019] [Indexed: 12/24/2022] Open
Abstract
Background: The majority of lung cancer patients are diagnosed with advanced non-small cell lung cancer (NSCLC), the bulk of which receive palliative systemic treatment with the goal to provide effective symptom palliation and safeguard health-related quality of life (HRQoL). Advanced NSCLC trials with HRQoL endpoints face methodological constraints limiting interpretability. Objectives: We provide a comprehensive overview of recent clinical trials evaluating the impact of systemic therapies on HRQoL in advanced NSCLC, focusing on the methodological quality, with the ultimate goal to improve interpretation, comparison and reporting of HRQoL data. Methods: A systematic literature review was performed. Prospective studies published over the last decade evaluating the impact of systemic treatments on HRQoL in advanced NSCLC were included. Methodological quality of HRQoL reporting was assessed with the CONSORT-PRO extension. Results: Hundred-twelve manuscripts describing 85 trials met all criteria. No formal conclusion can be drawn regarding the impact on HRQoL of different treatments. We report an important variety in methodological quality in terms of definitions of HRQoL, missing data points, lack of standardization of analyzing and presenting HRQoL and no standard follow-up time. The quality of HRQoL data reporting varies substantially between studies but improves over time. Conclusion: This review shows that in the heterogeneous landscape of trials addressing HRQoL in advanced stage NSCLC. Methodology reporting remains generally poor. Adequate reporting of HRQoL outcome data is equally important to support clinical decision-making as to correctly inform health policy regarding direct approval and reimbursement of the new drugs and combinations that will come online.
Collapse
Affiliation(s)
| | - Yolande Lievens
- Department of Radiotherapy-Oncology, Ghent University Hospital, Ghent, Belgium
| | - Wim Schrauwen
- Department of Medical Oncology, Ghent University Hospital, Ghent, Belgium
| | - Veerle Surmont
- Department of Thoracic Oncology, Ghent University Hospital, Ghent, Belgium
| |
Collapse
|
32
|
DiRisio AC, Harary M, van Westrhenen A, Nassr E, Ermakova A, Smith TR, Dirven L, Taphoorn MJB, Mekary RA, Broekman MLD. Quality of reporting and assessment of patient-reported health-related quality of life in patients with brain metastases: a systematic review. Neurooncol Pract 2019; 5:214-222. [PMID: 31386015 DOI: 10.1093/nop/npy024] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022] Open
Abstract
Brain metastases (BMs) have become increasingly prevalent and present unique considerations for patients, including neurocognitive sequelae and advanced disease burden. Therefore, assessing health-related quality of life (HRQoL) via patient-reported outcome measures (PROMs) is an important element of managing these patients. A systematic review of the literature was conducted with the aims of (1) assessing how PROMS used in BM patients were validated, (2) assessing PROM content, and (3) evaluating quality of PROM-results reporting. PROM validation and quality of reporting were assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) grading criteria and International Society of Quality of Life (ISOQOL)-recommended PROM-reporting standards, respectively. Forty-seven studies reporting on 5178 patients with a range of primacy cancer types were included. Eight different PROMs were applied, ranging from general to brain-specific questionnaires. Weaknesses in the validation of these PROMs were assessed by the COSMIN criteria. Many of these PROMs were not developed for BM patients and contained little information on cognitive symptoms. The overall quality of PROM reporting was insufficient based on the ISOQOL scale. Given the unique clinical considerations in BM patients, our results indicate the need for a standardized, validated questionnaire to assess HRQoL in this population. Additionally, there is room for quality improvement with regard to reporting of PROM-related results.
Collapse
Affiliation(s)
- Aislyn C DiRisio
- Computational Neurosciences Outcomes Center, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.,Icahn School of Medicine at Mount Sinai, New York, New York, USA
| | - Maya Harary
- Computational Neurosciences Outcomes Center, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Anouk van Westrhenen
- Computational Neurosciences Outcomes Center, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.,Department of Neurosurgery, Brain Center Rudolf Magnus University Medical Center Utrecht, Utrecht, The Netherlands
| | - Eman Nassr
- School of Pharmacy, Massachusetts College of Pharmacy and Health Sciences University, Boston, USA
| | - Anastasia Ermakova
- School of Pharmacy, Massachusetts College of Pharmacy and Health Sciences University, Boston, USA
| | - Timothy R Smith
- Computational Neurosciences Outcomes Center, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Linda Dirven
- Department of Neurology, Leiden University Medical Center, Leiden, The Netherlands.,Department of Neurology, Haaglanden Medical Center, The Hague, The Netherlands
| | - Martin J B Taphoorn
- Department of Neurology, Leiden University Medical Center, Leiden, The Netherlands.,Department of Neurology, Haaglanden Medical Center, The Hague, The Netherlands
| | - Rania A Mekary
- Computational Neurosciences Outcomes Center, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.,School of Pharmacy, Massachusetts College of Pharmacy and Health Sciences University, Boston, USA
| | - Marike L D Broekman
- Computational Neurosciences Outcomes Center, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.,Department of Neurology, Leiden University Medical Center, Leiden, The Netherlands (MLDB).,Department of Neurology, Haaglanden Medical Center, The Hague, The Netherlands
| |
Collapse
|
33
|
Martin RL, Kivlan BR, Christoforetti JJ, Wolff AB, Nho SJ, Salvo JP, Ellis TJ, Van Thiel G, Matsuda D, Carreira DS. Minimal Clinically Important Difference and Substantial Clinical Benefit Values for a Pain Visual Analog Scale After Hip Arthroscopy. Arthroscopy 2019; 35:2064-2069. [PMID: 31208920 DOI: 10.1016/j.arthro.2019.02.032] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/14/2018] [Revised: 02/12/2019] [Accepted: 02/17/2019] [Indexed: 02/02/2023]
Abstract
PURPOSE To define minimal clinically important difference (MCID) and substantial clinical benefit (SCB) values for a pain visual analog scale (VAS) in patients undergoing hip arthroscopy for femoroacetabular impingement or chondrolabral pathology. METHODS This was a retrospective review of prospective collected data on patients having hip arthroscopy for femoroacetabular impingement and/or chondrolabral pathology. On initial assessment and follow-up between 335 and 395 days postsurgery, subjects completed a pain VAS and categorical self-rating of function. MCID was calculated using one-half the standard deviation (SD) of the change in 1-year pain VAS values. Receiver operator characteristic analysis was performed to determine SCB values. A change in SCB value was determined based on change in categorical self-rating of function to create "improved" and "not improved" groups. Absolute postoperative SCB scores were calculated to determine scores that would be associated with "normal" or "abnormal" function ratings. RESULTS Of 1,034 eligible patients, 733 (71%) met the inclusion criteria, with 537 (73%) women and 196 (27%) men having a mean age of 35.3 years (SD 13). At a mean of 352 (SD 21) days postsurgery, 536 (73%) were in the improved group and 197 (27%) in the not improved group. MCID was -15.0 mm. A change of -22.7 mm on the pain VAS was able to identify those that improved with high sensitivity (0.74) and specificity (0.63). Values of ≤10.4 mm and ≥29.0 mm were cutoffs identifying subjects that rated their function as normal or abnormal, respectively, with high sensitivity (0.79 and 0.76) and specificity (0.88 and 0.76). CONCLUSIONS This study provides surgeons with information to help interpret pain VAS values at a follow-up period ranging from 335 to 395 days with MCID and SCB values of -15.0 mm and -22.7 mm, respectively. Additionally, a patient who assesses a pain level at ≤10.4 mm is likely to have a normal rating of function, whereas a patient who assesses a pain level at ≥29.0 mm is likely to have an abnormal rating of function. LEVEL OF EVIDENCE III, retrospective comparative study.
Collapse
Affiliation(s)
- RobRoy L Martin
- Department of Physical Therapy, Rangos School of Health Sciences, Duquesne University, Pittsburgh, Pennsylvania, U.S.A.; Center for Sports Medicine, University of Pittsburgh Medical Center, Pittsburgh, Pennsylvania, U.S.A..
| | - Benjamin R Kivlan
- Department of Physical Therapy, Rangos School of Health Sciences, Duquesne University, Pittsburgh, Pennsylvania, U.S.A
| | - John J Christoforetti
- Center for Athletic Hip Injury, Allegheny Health Network, Pittsburgh, Pennsylvania, U.S.A.; Department of Orthopaedic Surgery, Drexel University School of Medicine, Faculty-at-Large, American Hip Institute, Pittsburgh, Pennsylvania, U.S.A
| | - Andrew B Wolff
- Hip Preservation and Sports Medicine, Washington Orthopaedics and Sports Medicine, Washington, D.C., U.S.A
| | - Shane J Nho
- Division of Sports Medicine, Department of Orthopedic Surgery, Hip Preservation Center, Rush University Medical Center, Chicago, Illinois, U.S.A
| | - John P Salvo
- Orthopaedic Surgery, The Sydney Kimmel Medical College at Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, U.S.A.; Hip Arthroscopy Program, Rothman Institute, Philadelphia, Pennsylvania, U.S.A
| | - Thomas J Ellis
- Orthopedic One, Ohio Orthopedic Surgery Institute, Dublin Methodist Hospital, Columbus, Ohio, U.S.A
| | - Geoff Van Thiel
- OrthoIllinois, Chicago, Illinois, U.S.A.; Rush University Medical Center, Chicago, Illinois, U.S.A.; Chicago Blackhawks Medical Network, Chicago, Illinois, U.S.A
| | - Dean Matsuda
- DISC Sports and Spine Center, Marina del Rey, California, U.S.A
| | | |
Collapse
|
34
|
The Patient Acceptable Symptomatic State of the 12-Item International Hip Outcome Tool at 1-Year Follow-Up of Hip-Preservation Surgery. Arthroscopy 2019; 35:1457-1462. [PMID: 31000393 DOI: 10.1016/j.arthro.2018.11.072] [Citation(s) in RCA: 36] [Impact Index Per Article: 7.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/26/2018] [Revised: 11/29/2018] [Accepted: 11/29/2018] [Indexed: 02/02/2023]
Abstract
PURPOSE To determine the patient acceptable symptomatic state (PASS) cutoff score for the 12-item International Hip Outcome Tool (iHOT-12) for patients after hip-preservation surgery. METHODS A multicenter hip arthroscopy registry containing deidentified patient data was analyzed to discriminate patients who achieved satisfactory results from patients who did not. Patients eligible for inclusion in the study were between 18 and 75 years of age, consented to undergo elective hip arthroscopy, and completed preoperative patient-reported outcome questionnaires. A receiver operating characteristic analysis was performed to determine the PASS cutoff score for the iHOT-12 at 1 year after surgery based on the sensitivity and specificity of achieving satisfaction with surgery. A visual analog scale rating patient satisfaction 1 year after surgery was documented and compared between subjects who achieved the PASS score for the iHOT-12 and those who did not achieve it through an independent t test with an a priori α set at .05. RESULTS A total of 647 subjects (66% women) aged between 18 and 73 years (mean, 36.5 years; standard deviation [SD], 12.0 years) were included in the study. A cutoff score of 75.2 for the iHOT-12 yielded a sensitivity of 0.91 and specificity of 0.81. Satisfaction averaged 89.5% (SD, 18.0%) for the patients with iHOT-12 scores greater than the PASS cutoff score versus 60.9% (SD, 30.61%) for those who did not achieve the PASS iHOT-12 score. CONCLUSIONS The PASS cutoff score of 75.2 for the iHOT-12 establishes a "minimal" target score at which the patient is highly likely to be satisfied with the physical state of his or her hip joint at 1 year after hip arthroscopy. LEVEL OF EVIDENCE Level III, case-control study.
Collapse
|
35
|
Anderson NE, Calvert M, Cockwell P, Dutton M, Kyte D. The Use of Patient-Reported Outcomes in Patients Treated With Maintenance Hemodialysis: A Perspective. Am J Kidney Dis 2019; 74:399-406. [PMID: 31031088 DOI: 10.1053/j.ajkd.2019.01.035] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2018] [Accepted: 01/29/2019] [Indexed: 12/20/2022]
Abstract
There is increasing interest in the integration of patient-reported outcomes (PROs) into health care research and clinical practice for the benefit of patients with end-stage kidney disease receiving hemodialysis. In a research setting, PROs can be used as a patient-centered primary or secondary outcome in clinical studies. In routine care, PRO data may be used to support service delivery through benchmarking and audit or inform and enhance the care of the individual patient by improving patient-clinician communication. Despite evidence demonstrating the potential benefits of PROs and prioritization of these outcomes by patients, their use in kidney disease remains limited. Although there are significant methodological and operational challenges for the widespread integration of PROs, there is now consensus that this area should be at the forefront of clinical research and implementation science. We discuss the current use of PROs for patients with end-stage kidney disease receiving hemodialysis and identify a roadmap for increasing the evidence base and introducing PROs into mainstream clinical practice.
Collapse
Affiliation(s)
- Nicola Elizabeth Anderson
- Centre for Patient Reported Outcomes Research, University of Birmingham, Birmingham, United Kingdom; Institute of Applied Health Research, University of Birmingham, Birmingham, United Kingdom; Research and Development, University Hospitals Birmingham NHS Foundation Trust, Birmingham, United Kingdom; Department of Renal Medicine, University Hospitals Birmingham NHS Foundation Trust, Birmingham, United Kingdom.
| | - Melanie Calvert
- Centre for Patient Reported Outcomes Research, University of Birmingham, Birmingham, United Kingdom; Institute of Applied Health Research, University of Birmingham, Birmingham, United Kingdom; NIHR Birmingham Biomedical Research Centre, University Hospitals Birmingham NHS Foundation Trust and University of Birmingham, Birmingham, United Kingdom; NIHR Surgical Reconstruction and Microbiology Research Centre, University Hospitals Birmingham NHS Foundation Trust and University of Birmingham, Birmingham, United Kingdom
| | - Paul Cockwell
- Centre for Patient Reported Outcomes Research, University of Birmingham, Birmingham, United Kingdom; Institute of Applied Health Research, University of Birmingham, Birmingham, United Kingdom; Department of Renal Medicine, University Hospitals Birmingham NHS Foundation Trust, Birmingham, United Kingdom
| | - Mary Dutton
- Centre for Patient Reported Outcomes Research, University of Birmingham, Birmingham, United Kingdom; Research and Development, University Hospitals Birmingham NHS Foundation Trust, Birmingham, United Kingdom; Department of Renal Medicine, University Hospitals Birmingham NHS Foundation Trust, Birmingham, United Kingdom
| | - Derek Kyte
- Centre for Patient Reported Outcomes Research, University of Birmingham, Birmingham, United Kingdom; Institute of Applied Health Research, University of Birmingham, Birmingham, United Kingdom; NIHR Birmingham Biomedical Research Centre, University Hospitals Birmingham NHS Foundation Trust and University of Birmingham, Birmingham, United Kingdom; NIHR Surgical Reconstruction and Microbiology Research Centre, University Hospitals Birmingham NHS Foundation Trust and University of Birmingham, Birmingham, United Kingdom
| |
Collapse
|
36
|
Martin RL, Kivlan BR, Christoforetti JJ, Wolff AB, Nho SJ, Salvo JP, Ellis TJ, Van Thiel G, Matsuda DK, Carreira DS. Minimal Clinically Important Difference and Substantial Clinical Benefit Values for the 12-Item International Hip Outcome Tool. Arthroscopy 2019; 35:411-416. [PMID: 30612776 DOI: 10.1016/j.arthro.2018.09.028] [Citation(s) in RCA: 61] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/04/2018] [Revised: 09/06/2018] [Accepted: 09/07/2018] [Indexed: 02/02/2023]
Abstract
PURPOSE To define minimal clinically important difference (MCID) and substantial clinical benefit (SCB) values for the 12-item International Hip Outcome Tool (iHOT-12) in patients undergoing hip arthroscopy for intra-articular pathology. METHODS This was a retrospective review of prospectively collected data on patients who underwent hip arthroscopy. On initial assessment and follow-up between 335 and 395 days after surgery, subjects completed the iHOT-12 and a categorical self-rating of function (severely abnormal, abnormal, nearly normal, or normal). One-half the standard deviation (SD) of the change in 1-year iHOT-12 scores was used to calculate the MCID. Receiver operator characteristic analysis was performed to determine SCB values. A change in SCB value was determined based on an improvement in the categorical rating of function. Absolute postoperative SCB scores were calculated to determine scores that would be associated with normal function ratings or with abnormal or severely abnormal function ratings. RESULTS Of 1,034 eligible patients, 733 (71%) met the inclusion criteria. The subjects consisted of 537 female patients (73%) and 196 male patients (27%), with a mean age of 35.3 years (SD, 13 years). At a mean of 352 days (SD, 21 days) after surgery, 536 patients (73%) were in the "improved" group and 197 (27%) were in the "not improved" group. The MCID was 13 points. An SCB change score of 28 points was able to identify patients who improved with high sensitivity (0.79) and specificity (0.72). Scores of 86 points or greater and 56 points or less were the cutoff values found to identify subjects who rated their function as normal and abnormal, respectively, with high sensitivity (0.74 and 0.90, respectively) and specificity (0.82 and 0.86, respectively). CONCLUSIONS This study provides information to help interpret iHOT-12 scores for a follow-up period ranging between 335 and 395 days with MCID and SCB values of 13 and 28 points, respectively. In addition, a vpatient who scored 86 points or better was likely to have a normal rating of function, whereas a patient with a score of 56 points or less was likely to have an abnormal rating of function. LEVEL OF EVIDENCE Level III, retrospective comparative study.
Collapse
Affiliation(s)
- RobRoy L Martin
- Department of Physical Therapy, Rangos School of Health Sciences, Duquesne University, Pittsburgh, Pennsylvania, U.S.A.; University of Pittsburgh Medical Center, Center for Sports Medicine, Pittsburgh, Pennsylvania, U.S.A..
| | - Benjamin R Kivlan
- Department of Physical Therapy, Rangos School of Health Sciences, Duquesne University, Pittsburgh, Pennsylvania, U.S.A
| | - John J Christoforetti
- Center for Athletic Hip Injury, Allegheny Health Network, Pittsburgh, Pennsylvania, U.S.A.; Department of Orthopaedic Surgery, Drexel University School of Medicine, Philadelphia, Pennsylvania, U.S.A.; American Hip Institute, Pittsburgh, Pennsylvania, U.S.A
| | - Andrew B Wolff
- Hip Preservation and Sports Medicine, Washington Orthopaedics and Sports Medicine, Chicago, Illinois, U.S.A
| | - Shane J Nho
- Department of Orthopedic Surgery, Division of Sports Medicine, Hip Preservation Center, Rush University Medical Center, Chicago, Illinois, U.S.A
| | - John P Salvo
- Orthopaedic Surgery, Sidney Kimmel Medical College, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, U.S.A.; Hip Arthroscopy Program, Rothman Institute, Philadelphia, Pennsylvania, U.S.A
| | - Thomas J Ellis
- Orthopedic One, Ohio Orthopedic Surgery Institute, Dublin Methodist Hospital, Columbus, Ohio, U.S.A
| | - Geoff Van Thiel
- OrthoIllinois, Chicago, Illinois, U.S.A.; Rush University Medical Center, Chicago, Illinois, U.S.A.; US National Soccer Teams, Chicago, Illinois, U.S.A.; Chicago Blackhawks Medical Network, Chicago, Illinois, U.S.A
| | - Dean K Matsuda
- Hip Arthroscopy DISC Sports and Spine Center, Marina del Rey, California, U.S.A
| | | |
Collapse
|
37
|
Patient-reported outcomes in stroke clinical trials 2002–2016: a systematic review. Qual Life Res 2018; 28:1119-1128. [DOI: 10.1007/s11136-018-2053-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/12/2018] [Indexed: 10/27/2022]
|
38
|
Mercieca-Bebber R, King MT, Calvert MJ, Stockler MR, Friedlander M. The importance of patient-reported outcomes in clinical trials and strategies for future optimization. Patient Relat Outcome Meas 2018; 9:353-367. [PMID: 30464666 PMCID: PMC6219423 DOI: 10.2147/prom.s156279] [Citation(s) in RCA: 298] [Impact Index Per Article: 49.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022] Open
Abstract
Patient-reported outcomes (PROs) can be included in clinical trials as primary or secondary endpoints and are increasingly recognized by regulators, clinicians, and patients as valuable tools to collect patient-centered data. PROs provide unique information on the impact of a medical condition and its treatment from the patient's perspective; therefore, PROs can be included in clinical trials to ensure the impact of a trial intervention is comprehensively assessed. This review first discusses examples of how PRO endpoints have added value to clinical trial interpretation. Second, it describes the problems with current practices in designing, implementing, and reporting PRO studies, and how these problems may be addressed by complying with guidance for protocol development, selecting appropriate PRO measures to match clinically motivated PRO hypotheses, minimizing the rates of avoidable missing PRO data, analyzing and interpreting PRO data, and transparently reporting PRO findings.
Collapse
Affiliation(s)
| | - Madeleine T King
- Central Clinical School, Sydney Medical School, The University of Sydney, Sydney, NSW, Australia
- School of Psychology, The University of Sydney, Sydney, NSW, Australia
| | - Melanie J Calvert
- Centre for Patient-Reported Outcomes Research and NIHR Birmingham Biomedical Research Centre, University of Birmingham, Edgbaston, Birmingham, UK
- Institute of Applied Health Research, University of Birmingham, Edgbaston, Birmingham, UK
| | - Martin R Stockler
- NHMRC Clinical Trials Centre, The University of Sydney, Sydney, NSW, Australia, ;
| | - Michael Friedlander
- NHMRC Clinical Trials Centre, The University of Sydney, Sydney, NSW, Australia, ;
- Prince of Wales Clinical School, University of New South Wales, Sydney, NSW, Australia,
| |
Collapse
|
39
|
Mack DE, Wilson PM, Santos E, Brooks K. Standards of reporting: the use of CONSORT PRO and CERT in individuals living with osteoporosis. Osteoporos Int 2018; 29:305-313. [PMID: 28971256 DOI: 10.1007/s00198-017-4249-z] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/14/2017] [Accepted: 09/26/2017] [Indexed: 12/29/2022]
Abstract
The Consolidated Standards of Reporting Trials for Patient-Reported Outcomes (CONSORT PRO) and the Consensus on Exercise Reporting Template (CERT) have been developed to improve the quality and transparency of reporting standards in scientific research. The purpose of this study was to provide evidence for the adoption of CONSORT PRO and CERT by researchers examining the link between exercise and quality of life in individuals living with osteoporosis. A systematic search was conducted to identify randomized control trials published in English evaluating exercise interventions on quality of life in individuals living with osteoporosis. Reporting standards were assessed using CONSORT PRO and CERT. A total of 127 studies were identified with 23 meeting inclusion criteria. "Good" evidence for eight (42.1%) CONSORT PRO and two (12.5%) CERT items was found. Adherence to CONSORT PRO was not related to the year of publication, journal impact factor, or study quality. Adherence to CONSORT PRO and CERT reporting standards is inadequate in the literature examining exercise interventions on quality of life in individuals living with osteoporosis. Sufficient reporting is paramount to knowledge translation, interpretation by interventionists, and clinician confidence in understanding if (and how) exercise is associated with quality of life outcomes in this cohort. Concerns associated with failure to include this information are highlighted.
Collapse
Affiliation(s)
- D E Mack
- Behavioural Health Sciences Research Lab, Centre for Bone and Muscle Health, Department of Kinesiology, Brock University, 287 Walker Complex, 1812 Sir Isaac Brock Way, St. Catharines, ON, L2S 3A1, Canada.
| | - P M Wilson
- Behavioural Health Sciences Research Lab, Centre for Bone and Muscle Health, Department of Kinesiology, Brock University, 287 Walker Complex, 1812 Sir Isaac Brock Way, St. Catharines, ON, L2S 3A1, Canada
| | - E Santos
- Behavioural Health Sciences Research Lab, Faculty of Applied Health Sciences, Brock University, 1812 Sir Isaac Brock Way, St. Catharines, ON, L2S 3A1, Canada
| | - K Brooks
- Behavioural Health Sciences Research Lab, Faculty of Applied Health Sciences, Brock University, 1812 Sir Isaac Brock Way, St. Catharines, ON, L2S 3A1, Canada
| |
Collapse
|