1
|
Manyara AM, Davies P, Stewart D, Weir CJ, Young AE, Blazeby J, Butcher NJ, Bujkiewicz S, Chan AW, Dawoud D, Offringa M, Ouwens M, Hróbjartssson A, Amstutz A, Bertolaccini L, Bruno VD, Devane D, Faria CDCM, Gilbert PB, Harris R, Lassere M, Marinelli L, Markham S, Powers JH, Rezaei Y, Richert L, Schwendicke F, Tereshchenko LG, Thoma A, Turan A, Worrall A, Christensen R, Collins GS, Ross JS, Taylor RS, Ciani O. Reporting of surrogate endpoints in randomised controlled trial reports (CONSORT-Surrogate): extension checklist with explanation and elaboration. BMJ 2024; 386:e078524. [PMID: 38981645 PMCID: PMC11231881 DOI: 10.1136/bmj-2023-078524] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/30/2024] [Indexed: 07/11/2024]
Affiliation(s)
- Anthony Muchai Manyara
- MRC/CSO Social and Public Health Sciences Unit, School of Health and Wellbeing, University of Glasgow, Glasgow, UK
- Global Health and Ageing Research Unit, Bristol Medical School, University of Bristol, Bristol, UK
| | - Philippa Davies
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | | | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - Amber E Young
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Jane Blazeby
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
- Bristol NIHR Biomedical Research Centre, Bristol, UK
- University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK
| | - Nancy J Butcher
- Child Health Evaluative Sciences, Hospital for Sick Children Research Institute, Toronto, ON, Canada
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
| | - Sylwia Bujkiewicz
- Biostatistics Research Group, Department of Population Health Sciences, University of Leicester, Leicester, UK
| | - An-Wen Chan
- Women's College Research Institute, Toronto, ON, Canada
- Department of Medicine, University of Toronto, Toronto, ON, Canada
| | - Dalia Dawoud
- Science, Evidence, and Analytics Directorate, Science Policy and Research Programme, National Institute for Health and Care Excellence, London, UK
- Faculty of Pharmacy, Cairo University, Cairo, Egypt
| | - Martin Offringa
- Child Health Evaluative Sciences, Hospital for Sick Children Research Institute, Toronto, ON, Canada
- Department of Paediatrics, University of Toronto, Toronto, ON, Canada
| | | | - Asbjørn Hróbjartssson
- Centre for Evidence-Based Medicine Odense and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Open Patient data Explorative Network, Odense University hospital, Odense, Denmark
| | - Alain Amstutz
- CLEAR Methods Centre, Division of Clinical Epidemiology, Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
- Oslo Centre for Biostatistics and Epidemiology, Oslo University Hospital, Oslo, Norway
- Bristol Medical School, University of Bristol, Bristol, UK
| | - Luca Bertolaccini
- Department of Thoracic Surgery, IEO, European Institute of Oncology IRCCS, Milan, Italy
| | - Vito Domenico Bruno
- IRCCS Galeazzi-Sant'Ambrogio Hospital, Department of Minimally Invasive Cardiac Surgery, Milan, Italy
| | - Declan Devane
- University of Galway, Galway, Ireland
- Health Research Board-Trials Methodology Research Network, University of Galway, Galway, Ireland
| | - Christina D C M Faria
- Department of Physical Therapy, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
| | | | | | - Marissa Lassere
- St George Hospital and School of Population Health, University of New South Wales, Sydney, NSW, Australia
| | - Lucio Marinelli
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, University of Genova, Genoa, Italy
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Sarah Markham
- Patient author, UK
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - John H Powers
- George Washington University School of Medicine, Washington, DC, USA
| | - Yousef Rezaei
- Heart Valve Disease Research Centre, Rajaie Cardiovascular Medical and Research Centre, Iran University of Medical Sciences, Tehran, Iran
- Ardabil University of Medical Sciences, Ardabil, Iran
- Behyan Clinic, Pardis New Town, Tehran, Iran
| | - Laura Richert
- University of Bordeaux, Centre d'Investigation Clinique-Epidémiologie Clinique 1401, Research in Clinical Epidemiology and in Public Health and European Clinical Trials Platform & Development/French Clinical Research Infrastructure Network, Institut National de la Santé et de la Recherche Médicale/Institut Bergonié/Centre Hospitalier Universitaire Bordeaux, Bordeaux, France
| | | | - Larisa G Tereshchenko
- Department of Quantitative Health Sciences, Lerner Research Institute, Cleveland Clinic, Cleveland, OH, USA
| | | | - Alparslan Turan
- Department of Outcomes Research, Anaesthesiology Institute, Cleveland Clinic, OH, USA
| | | | - Robin Christensen
- Section for Biostatistics and Evidence-Based Research, the Parker Institute, Bispebjerg and Frederiksberg Hospital, Copenhagen and Research Unit of Rheumatology, Department of Clinical Research, University of Southern Denmark, Odense University Hospital, Odense, Denmark
| | - Gary S Collins
- UK EQUATOR Centre, Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Joseph S Ross
- Department of Health Policy and Management, Yale School of Public Health, New Haven, CT, USA
- Section of General Medicine, Department of Internal Medicine, Yale School of Medicine, New Haven, CT, USA
| | - Rod S Taylor
- MRC/CSO Social and Public Health Sciences Unit, School of Health and Wellbeing, University of Glasgow, Glasgow, UK
- Robertson Centre for Biostatistics, School of Health and Well Being, University of Glasgow, Glasgow, UK
| | - Oriana Ciani
- Centre for Research on Health and Social Care Management, Bocconi University, Milan 20136, Italy
| |
Collapse
|
2
|
Manyara AM, Davies P, Stewart D, Weir CJ, Young AE, Blazeby J, Butcher NJ, Bujkiewicz S, Chan AW, Dawoud D, Offringa M, Ouwens M, Hróbjartssson A, Amstutz A, Bertolaccini L, Bruno VD, Devane D, Faria CDCM, Gilbert PB, Harris R, Lassere M, Marinelli L, Markham S, Powers JH, Rezaei Y, Richert L, Schwendicke F, Tereshchenko LG, Thoma A, Turan A, Worrall A, Christensen R, Collins GS, Ross JS, Taylor RS, Ciani O. Reporting of surrogate endpoints in randomised controlled trial protocols (SPIRIT-Surrogate): extension checklist with explanation and elaboration. BMJ 2024; 386:e078525. [PMID: 38981624 PMCID: PMC11231880 DOI: 10.1136/bmj-2023-078525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 04/30/2024] [Indexed: 07/11/2024]
Affiliation(s)
- Anthony Muchai Manyara
- MRC/CSO Social and Public Health Sciences Unit, School of Health and Wellbeing, University of Glasgow, Glasgow, UK
- Global Health and Ageing Research Unit, Bristol Medical School, University of Bristol, Bristol, UK
| | - Philippa Davies
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | | | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - Amber E Young
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Jane Blazeby
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
- Bristol NIHR Biomedical Research Centre, Bristol, UK
- University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK
| | - Nancy J Butcher
- Child Health Evaluative Sciences, Hospital for Sick Children Research Institute, Toronto, ON, Canada
- Department of Psychiatry, University of Toronto, Toronto, ON, Canada
| | - Sylwia Bujkiewicz
- Biostatistics Research Group, Department of Population Health Sciences, University of Leicester, Leicester, UK
| | - An-Wen Chan
- Women's College Research Institute, Toronto, ON, Canada
- Department of Medicine, University of Toronto, Toronto, ON, Canada
| | - Dalia Dawoud
- Science, Evidence, and Analytics Directorate, Science Policy and Research Programme, National Institute for Health and Care Excellence, London, UK
- Faculty of Pharmacy, Cairo University, Cairo, Egypt
| | - Martin Offringa
- Child Health Evaluative Sciences, Hospital for Sick Children Research Institute, Toronto, ON, Canada
- Department of Paediatrics, University of Toronto, Toronto, ON, Canada
| | | | - Asbjørn Hróbjartssson
- Centre for Evidence-Based Medicine Odense and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Open Patient data Explorative Network, Odense University hospital, Odense, Denmark
| | - Alain Amstutz
- CLEAR Methods Centre, Division of Clinical Epidemiology, Department of Clinical Research, University Hospital Basel and University of Basel, Basel, Switzerland
- Oslo Centre for Biostatistics and Epidemiology, Oslo University Hospital, Oslo, Norway
- Bristol Medical School, University of Bristol, Bristol, UK
| | - Luca Bertolaccini
- Department of Thoracic Surgery, IEO, European Institute of Oncology IRCCS, Milan, Italy
| | - Vito Domenico Bruno
- IRCCS Galeazzi-Sant'Ambrogio Hospital, Department of Minimally Invasive Cardiac Surgery, Milan, Italy
| | - Declan Devane
- University of Galway, Galway, Ireland
- Health Research Board-Trials Methodology Research Network, University of Galway, Galway, Ireland
| | - Christina D C M Faria
- Department of Physical Therapy, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
| | | | | | - Marissa Lassere
- St George Hospital and School of Population Health, University of New South Wales, Sydney, NSW, Australia
| | - Lucio Marinelli
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, University of Genova, Genoa, Italy
- IRCCS Ospedale Policlinico San Martino, Genoa, Italy
| | - Sarah Markham
- Patient author, UK
- Department of Biostatistics and Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - John H Powers
- George Washington University School of Medicine, Washington, DC, USA
| | - Yousef Rezaei
- Heart Valve Disease Research Centre, Rajaie Cardiovascular Medical and Research Centre, Iran University of Medical Sciences, Tehran, Iran
- Ardabil University of Medical Sciences, Ardabil, Iran
- Behyan Clinic, Pardis New Town, Tehran, Iran
| | - Laura Richert
- University of Bordeaux, Centre d'Investigation Clinique-Epidémiologie Clinique 1401, Research in Clinical Epidemiology and in Public Health and European Clinical Trials Platform & Development/French Clinical Research Infrastructure Network, Institut National de la Santé et de la Recherche Médicale/Institut Bergonié/Centre Hospitalier Universitaire Bordeaux, Bordeaux, France
| | | | - Larisa G Tereshchenko
- Department of Quantitative Health Sciences, Lerner Research Institute, Cleveland Clinic, Cleveland, OH, USA
| | | | - Alparslan Turan
- Department of Outcomes Research, Anaesthesiology Institute, Cleveland Clinic, OH, USA
| | | | - Robin Christensen
- Section for Biostatistics and Evidence-Based Research, the Parker Institute, Bispebjerg and Frederiksberg Hospital, Copenhagen and Research Unit of Rheumatology, Department of Clinical Research, University of Southern Denmark, Odense University Hospital, Odense, Denmark
| | - Gary S Collins
- UK EQUATOR Centre, Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology, and Musculoskeletal Sciences, University of Oxford, Oxford, UK
| | - Joseph S Ross
- Department of Health Policy and Management, Yale School of Public Health, New Haven, CT, USA
- Section of General Medicine, Department of Internal Medicine, Yale School of Medicine, New Haven, CT, USA
| | - Rod S Taylor
- MRC/CSO Social and Public Health Sciences Unit, School of Health and Wellbeing, University of Glasgow, Glasgow, UK
- Robertson Centre for Biostatistics, School of Health and Well Being, University of Glasgow, Glasgow, UK
| | - Oriana Ciani
- Centre for Research on Health and Social Care Management, Bocconi University, Milan 20136, Italy
| |
Collapse
|
3
|
Rodrigues M, Oprea A, Johnson K, Dufort A, Sanger N, Ghiassi P, Sanger S, Panesar B, D'Elia A, Parpia S, Samaan Z, Thabane L. Primary outcome reporting in clinical trials for older adults with depression. BJPsych Open 2024; 10:e60. [PMID: 38450491 PMCID: PMC10951853 DOI: 10.1192/bjo.2023.650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/15/2023] [Revised: 11/29/2023] [Accepted: 12/18/2023] [Indexed: 03/08/2024] Open
Abstract
BACKGROUND Findings from randomised controlled trials (RCTs) are synthesised through meta-analyses, which inform evidence-based decision-making. When key details regarding trial outcomes are not fully reported, knowledge synthesis and uptake of findings into clinical practice are impeded. AIMS Our study assessed reporting of primary outcomes in RCTs for older adults with major depressive disorder (MDD). METHOD Trials published between 2011 and 2021, which assessed any intervention for adults aged ≥65 years with a MDD diagnosis, and that specified a single primary outcome were considered for inclusion in our study. Outcome reporting assessment was conducted independently and in duplicate with a 58-item checklist, used in developing the CONSORT-Outcomes statement, and information in each RCT was scored as 'fully reported', 'partially reported' or 'not reported', as applicable. RESULTS Thirty-one of 49 RCTs reported one primary outcome and were included in our study. Most trials (71%) did not fully report over half of the 58 checklist items. Items pertaining to outcome analyses and interpretation were fully reported by 65% or more of trials. Items reported less frequently included: outcome measurement instrument properties (varied from 3 to 30%) and justification of the criteria used to define clinically meaningful change (23%). CONCLUSIONS There is variability in how geriatric depression RCTs report primary outcomes, with omission of details regarding measurement, selection, justification and definition of clinically meaningful change. Outcome reporting deficiencies may hinder replicability and synthesis efforts that inform clinical guidelines and decision-making. The CONSORT-Outcomes guideline should be used when reporting geriatric depression RCTs.
Collapse
Affiliation(s)
- Myanca Rodrigues
- Health Research Methodology Graduate Program, Department of Health Research Methods, Evidence, and Impact, McMaster University, Canada
| | - Anna Oprea
- Life Sciences Undergraduate Program, School of Interdisciplinary Science, McMaster University, Canada
| | - Keily Johnson
- Psychology, Neuroscience and Behaviour Undergraduate Program, Faculty of Science, McMaster University, Canada
| | - Alexander Dufort
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Canada
| | - Nitika Sanger
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Canada
| | - Pegah Ghiassi
- Delivery Management Office, Canadian Partnership Against Cancer, Toronto, Canada
| | | | - Balpreet Panesar
- Neuroscience Graduate Program, McMaster University, Canada; and Department of Psychiatry and Behavioural Neurosciences, St. Joseph's Healthcare Hamilton, Ontario, Canada
| | - Alessia D'Elia
- Neuroscience Graduate Program, McMaster University, Canada; and Department of Psychiatry and Behavioural Neurosciences, St. Joseph's Healthcare Hamilton, Ontario, Canada
| | - Sameer Parpia
- Department of Oncology, McMaster University, Canada; and Department of Health Research Methods, Evidence, and Impact, McMaster University, Canada
| | - Zainab Samaan
- Department of Psychiatry and Behavioural Neurosciences, McMaster University, Canada; Department of Health Research Methods, Evidence, and Impact, McMaster University, Canada; and Mood Disorders Program, St. Joseph's Healthcare Hamilton, Ontario, Canada
| | - Lehana Thabane
- Department of Health Research Methods, Evidence, and Impact, McMaster University, Canada; Population Health Research Institute, Ontario, Canada; and Father Sean O'Sullivan Research Centre, St. Joseph's Healthcare Hamilton, Ontario, Canada
| |
Collapse
|
4
|
Patel A, Caruana EJ, Hodson J, Morrison R, Khor B, Gysling S, Trevis J, Mangel T, Benson R, Zakeri R, Manders J, Vaja R, Rogers L, Baker P, Pournaras DJ, Thickett D, Hewison M, Naidu B, Lim E. Role of vitamin D supplementation in modifying outcomes after surgery: a systematic review of randomised controlled trials. BMJ Open 2024; 14:e073431. [PMID: 38233048 PMCID: PMC10806719 DOI: 10.1136/bmjopen-2023-073431] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Accepted: 12/22/2023] [Indexed: 01/19/2024] Open
Abstract
BACKGROUND There is increasing evidence to suggest vitamin D plays a role in immune and vascular function; hence, it may be of biological and clinical relevance for patients undergoing major surgery. With a greater number of randomised studies being conducted evaluating the impact of vitamin D supplementation on surgical patients, it is an opportune time to conduct further analysis of the impact of vitamin D on surgical outcomes. METHODS MEDLINE, EMBASE and the Cochrane Trials Register were interrogated up to December 2023 to identify randomised controlled trials of vitamin D supplementation in surgery. The risk of bias in the included studies was assessed using the Cochrane Risk of Bias tool. A narrative synthesis was conducted for all studies. The primary outcome assessed was overall postoperative survival. RESULTS We screened 4883 unique studies, assessed 236 full-text articles and included 14 articles in the qualitative synthesis, comprising 1982 patients. The included studies were highly heterogeneous with respect to patient conditions, ranging from open heart surgery to cancer operations to orthopaedic conditions, and also with respect to the timing and equivalent daily dose of vitamin D supplementation (range: 0.5-7500 mcg; 20-300 000 IU). No studies reported significant differences in overall survival or postoperative mortality with vitamin D supplementation. There was also no clear evidence of benefit with respect to overall or intensive care unit length of stay. DISCUSSION Numerous studies have reported the benefits of vitamin D supplementation in different surgical settings without any consistency. However, this systematic review found no clear evidence of benefit, which warrants the supposition that a single biological effect of vitamin D supplementation does not exist. The observed improvement in outcomes in low vitamin D groups has not been convincingly proven beyond chance findings. TRIAL REGISTRATION NUMBER CRD42021232067.
Collapse
Affiliation(s)
- Akshay Patel
- Institute of Immunology and Immunotherapy, University of Birmingham, Birmingham, UK
- Department of Thoracic Surgery, University Hospitals Birmingham, Birmingham, UK
| | - Edward J Caruana
- Department of Thoracic Surgery, Glenfield Hospital, Leicester, UK
| | - James Hodson
- Research Development and Innovation, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Rory Morrison
- Department of Orthopaedic Surgery, South Tees NHS Foundation Trust, Nottingham, UK
| | - Bo Khor
- Department of Colorectal Surgery, University Hospitals Birmingham, Nottingham, UK
| | - Savannah Gysling
- Department of Academic Colorectal Surgery, Nottingham University Hospitals NHS Trust, Nottingham, UK
| | - Jason Trevis
- Department of Cardiothoracic Surgery, James Cook University Hospital, Middlesborough, UK
| | - Tobin Mangel
- Department of Cardiothoracic Surgery, Bart's Heart Centre, London, UK
| | - Ruth Benson
- Department of Vascular Surgery, University of Otago, Christchurch, New Zealand
| | - Roxanna Zakeri
- Department of Upper GI, Bariatric and Metabolic Surgery, North Bristol NHS Trust, Westbury on Trym, UK
| | - Jennifer Manders
- University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Ricky Vaja
- Department of Cardiovascular Sciences Surgery, Imperial College London, London, UK
| | - Luke Rogers
- Department of Cardiac Surgery, University Hospitals Bristol, Bristol, UK
| | - Paul Baker
- Department of Orthopaedic Surgery, South Tees NHS Foundation Trust, Nottingham, UK
- University of Teeside, Middlesborough, UK
| | - Dimitri J Pournaras
- Department of Upper GI, Bariatric and Metabolic Surgery, North Bristol NHS Trust, Westbury on Trym, UK
| | - David Thickett
- Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK
| | - Martin Hewison
- Institute of Metabolism and Systems Research, University of Birmingham, Birmingham, UK
| | - Babu Naidu
- Department of Thoracic Surgery, University Hospitals Birmingham, Birmingham, UK
- Institute of Inflammation and Ageing, University of Birmingham, Birmingham, UK
| | - Eric Lim
- Department of Thoracic Surgery, Royal Brompton Hospital, London, UK
| |
Collapse
|
5
|
Green HR, Dawson A, Elfeky A, Pickles D, Treweek S, Gillies K. Exploring the perspectives of selectors and collecters of trial outcome data: an international qualitative study. BMC Med Res Methodol 2023; 23:229. [PMID: 37821867 PMCID: PMC10568821 DOI: 10.1186/s12874-023-02054-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 10/01/2023] [Indexed: 10/13/2023] Open
Abstract
INTRODUCTION Selecting and collecting data to support appropriate primary and secondary outcomes is a critical step in designing trials that can change clinical practice. In this study, we aimed to investigate who contributes to the process of selecting and collecting trial outcomes, and how these people are involved. This work serves two main purposes: (1) it provides the trials community with evidence to demonstrate how outcomes are currently selected and collected, and (2) it allows people involved in trial design and conduct to pick apart these processes to consider how efficiencies and improvements can be made. METHODS One-with-one semi-structured interviews, supported by a topic guide to ensure coverage of key content. The Framework approach was used for thematic analysis of data, and themes were linked through constant comparison of data both within and across participant groups. Interviews took place between July 2020 and January 2021. Participants were twenty-nine international trialists from various contributor groups, working primarily on designing and/or delivering phase III pragmatic effectiveness trials. Their experience spanned various funders, trial settings, clinical specialties, intervention types, and participant populations. RESULTS We identified three descriptive themes encompassing the process of primary and secondary outcome selection, collection, and the publication of outcome data. Within these themes, participants raised issues around the following: 1) Outcome selection: clarity of the research question; confidence in selecting trial outcomes and how confidence decreases with increased experience; interplay between different interested parties; how patients and the public are involved in outcome selection; perceived impact of poor outcome selection including poor recruitment and/or retention; and use of core outcome sets. 2) Outcome collection: disconnect between decisions made by outcome selectors and the practical work done by outcome collectors; potential impact of outcome measures on trial participants; potential impact on trial staff workload; and use of routinely collected data. 3) Publication of outcome data: difficulties in finding time to write and revise manuscripts for publication due to time and funding constraints. Participants overwhelmingly focused on the process of outcome selection, a topic they talked about unprompted. When prompted, participants do discuss outcome collection, but poor communication between selectors and collectors at the trial design stage means that outcome selection is rarely linked with the data collection workload it generates. DISCUSSION People involved in the design and conduct of trials fail to connect decisions around outcome selection with data collection workload. Publication of outcome data and effective dissemination of trial results are hindered due to the project-based culture of some academic clinical trial research.
Collapse
Affiliation(s)
- Heidi R Green
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK.
- COUCH Health, Manchester, UK.
| | | | - Adel Elfeky
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
- Division of Health Sciences, Warwick Medical School, University of Warwick, Warwick, UK
| | - David Pickles
- Rheumatology department, Leeds Teaching Hospitals NHS Trust, Leeds, UK
| | - Shaun Treweek
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| | - Katie Gillies
- Health Services Research Unit, University of Aberdeen, Aberdeen, UK
| |
Collapse
|
6
|
Hobart J, Chitnis T, Oh J, Burke L, King M, Vo P, Vandercappellen J, Lloyd A. Do clinical trials prepare to fail by failing to prepare? An examination of MS trials and recommendations for patient-reported outcome measure selection. Mult Scler Relat Disord 2023; 76:104788. [PMID: 37327599 DOI: 10.1016/j.msard.2023.104788] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Revised: 05/24/2023] [Accepted: 06/01/2023] [Indexed: 06/18/2023]
Abstract
BACKGROUND Many clinical trials use patient-reported outcome (PRO) measures, which can influence treatment decision-making, drug approval and label claims. Given that many PRO measure options exist, and there are conceptual and contextual complexities with PRO measurement, we aimed to evaluate how and why specific PRO measures have been selected for pivotal multiple sclerosis (MS) clinical trials. Specifically, we aimed to identify the reasons documented for PRO measure selection in contemporary phase III MS disease-modifying treatment (DMT) clinical trials. METHODS We searched for phase III clinical trials of MS DMTs published between 2015 and 2021 and evaluated trial protocols, or primary publications where available, for PRO measure selection information. Specifically, we examined study documents for their clarification of clinical concepts measured, definitions of concepts measured, explanations of which PRO measures were considered, why specific PRO measures were chosen, and trade-offs in PRO measure selection. RESULTS We identified 1705 abstracts containing 61 unique phase III MS DMT clinical trials. We obtained and examined 27/61 trial protocols. Six protocols were excluded: four contained no mention of PRO measures and two contained redacted sections preventing adequate assessment, leaving 21 protocols for assessment. For the remaining 34 trials (61-27), we retrieved 31 primary publications; 15 primary publications mentioned the use of a PRO measure. None of the 36 clinical trials that mentioned the use of PRO measures (21 protocols and 15 primary publications) documented clear PRO or clinical outcome assessment (COA) measurement strategies, provided clear justifications for PRO selection, or reasons why specific PRO measures were selected when alternatives existed. CONCLUSION PRO measure selection for clinical trials is not evidence-based or underpinned by structured systematic approaches. This represents a critical area for study design improvement as PRO measure results directly affect patient care, PRO measurement has conceptual and contextual complexities, and there is a wide range of options when selecting a PRO measure. We recommend trial designers use formal approaches for PRO measure selection to ensure PRO measurement-based decisions are optimised. We provide a simple, logical, five-stage approach for PRO measure selection in clinical trials.
Collapse
Affiliation(s)
- Jeremy Hobart
- Peninsula Schools of Medicine and Dentistry, University of Plymouth, Plymouth, UK.
| | - Tanuja Chitnis
- Department of Neurology, Brigham and Women's Hospital, Boston, MA, USA
| | - Jiwon Oh
- Division of Neurology, St Michael's Hospital, University of Toronto, Toronto, ON, Canada
| | | | | | - Pamela Vo
- Novartis Pharma AG, Basel, Switzerland
| | | | | |
Collapse
|
7
|
Manyara AM, Davies P, Stewart D, Weir CJ, Young AE, Wells V, Blazeby J, Butcher NJ, Bujkiewicz S, Chan AW, Collins GS, Dawoud D, Offringa M, Ouwens M, Ross JS, Taylor RS, Ciani O. Definitions, acceptability, limitations, and guidance in the use and reporting of surrogate end points in trials: a scoping review. J Clin Epidemiol 2023; 160:83-99. [PMID: 37380118 DOI: 10.1016/j.jclinepi.2023.06.013] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 06/09/2023] [Accepted: 06/20/2023] [Indexed: 06/30/2023]
Abstract
OBJECTIVE To synthesize the current literature on the use of surrogate end points, including definitions, acceptability, and limitations of surrogate end points and guidance for their design/reporting, into trial reporting items. STUDY DESIGN AND SETTING Literature was identified through searching bibliographic databases (until March 1, 2022) and gray literature sources (until May 27, 2022). Data were thematically analyzed into four categories: (1) definitions, (2) acceptability, (3) limitations and challenges, and (4) guidance, and synthesized into reporting guidance items. RESULTS After screening, 90 documents were included: 79% (n = 71) had data on definitions, 77% (n = 69) on acceptability, 72% (n = 65) on limitations and challenges, and 61% (n = 55) on guidance. Data were synthesized into 17 potential trial reporting items: explicit statements on the use of surrogate end point(s) and justification for their use (items 1-6); methodological considerations, including whether sample size calculations were informed by surrogate validity (items 7-9); reporting of results for composite outcomes containing a surrogate end point (item 10); discussion and interpretation of findings (items 11-14); plans for confirmatory studies, collecting data on the surrogate end point and target outcome, and data sharing (items 15-16); and informing trial participants about using surrogate end points (item 17). CONCLUSION The review identified and synthesized items on the use of surrogate end points in trials; these will inform the development of the Standard Protocol Items: Recommendations for Interventional Trials-SURROGATE and Consolidated Standards of Reporting Trials-SURROGATE extensions.
Collapse
Affiliation(s)
- Anthony Muchai Manyara
- MRC/CSO Social and Public Health Sciences Unit, School of Health and Wellbeing, University of Glasgow, Glasgow, UK.
| | - Philippa Davies
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | | | - Christopher J Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - Amber E Young
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Valerie Wells
- MRC/CSO Social and Public Health Sciences Unit, School of Health and Wellbeing, University of Glasgow, Glasgow, UK
| | - Jane Blazeby
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK; Bristol NIHR Biomedical Research Centre, Bristol, UK; University Hospitals Bristol and Weston NHS Foundation Trust, Bristol, UK
| | - Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Canada; Department of Psychiatry, University of Toronto, Toronto, Canada
| | - Sylwia Bujkiewicz
- Biostatistics Research Group, Department of Population Health Sciences, University of Leicester, Leicester, UK
| | - An-Wen Chan
- Women's College Research Institute, Toronto, Canada; Department of Medicine, University of Toronto, Toronto, Canada
| | - Gary S Collins
- Nuffield Department of Orthopaedics, Rheumatology & Musculoskeletal Sciences, Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | - Dalia Dawoud
- Science, Evidence and Analytics Directorate, Science Policy and Research Programme, National Institute for Health and Care Excellence, London, UK
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Canada; Department of Paediatrics, University of Toronto, Toronto, Canada
| | | | - Joseph S Ross
- Department of Health Policy and Management, Yale School of Public Health, New Haven, CT, USA; Section of General Medicine, Department of Internal Medicine, Yale School of Medicine, New Haven, CT, USA
| | - Rod S Taylor
- MRC/CSO Social and Public Health Sciences Unit, School of Health and Wellbeing, University of Glasgow, Glasgow, UK; Robertson Centre for Biostatistics, School of Health and Well Being, University of Glasgow, Glasgow, UK
| | - Oriana Ciani
- Centre for Research on Health and Social Care Management, SDA Bocconi School of Management, Milan, Italy
| |
Collapse
|
8
|
Stoll M, Lindner S, Marquardt B, Salholz-Hillel M, DeVito NJ, Klemperer D, Lieb K. Completeness and consistency of primary outcome reporting in COVID-19 publications in the early pandemic phase: a descriptive study. BMC Med Res Methodol 2023; 23:173. [PMID: 37516878 PMCID: PMC10385884 DOI: 10.1186/s12874-023-01991-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Accepted: 07/13/2023] [Indexed: 07/31/2023] Open
Abstract
BACKGROUND The COVID-19 pandemic saw a steep increase in the number of rapidly published scientific studies, especially early in the pandemic. Some have suggested COVID-19 trial reporting is of lower quality than typical reports, but there is limited evidence for this in terms of primary outcome reporting. The objective of this study was to assess the prevalence of completely defined primary outcomes reported in registry entries, preprints, and journal articles, and to assess consistent primary outcome reporting between these sources. METHODS This is a descriptive study of a cohort of registered interventional clinical trials for the treatment and prevention of COVID-19, drawn from the DIssemination of REgistered COVID-19 Clinical Trials (DIRECCT) study dataset. The main outcomes are: 1) Prevalence of complete primary outcome reporting; 2) Prevalence of consistent primary outcome reporting between registry entry and preprint as well as registry entry and journal article pairs. RESULTS We analyzed 87 trials with 116 corresponding publications (87 registry entries, 53 preprints and 63 journal articles). All primary outcomes were completely defined in 47/87 (54%) registry entries, 31/53 (58%) preprints and 44/63 (70%) journal articles. All primary outcomes were consistently reported in 13/53 (25%) registry-preprint pairs and 27/63 (43%) registry-journal article pairs. No primary outcome was specified in 13/53 (25%) preprints and 8/63 (13%) journal articles. In this sample, complete primary outcome reporting occurred more frequently in trials with vs. without involvement of pharmaceutical companies (76% vs. 45%), and in RCTs vs. other study designs (68% vs. 49%). The same pattern was observed for consistent primary outcome reporting (with vs. without pharma: 56% vs. 12%, RCT vs. other: 43% vs. 22%). CONCLUSIONS In COVID-19 trials in the early phase of the pandemic, all primary outcomes were completely defined in 54%, 58%, and 70% of registry entries, preprints and journal articles, respectively. Only 25% of preprints and 43% of journal articles reported primary outcomes consistent with registry entries.
Collapse
Affiliation(s)
- Marlene Stoll
- Department of Psychiatry and Psychotherapy, University Medical Center of the Johannes Gutenberg University Mainz, Mainz, Germany.
- Leibniz Institute for Resilience Research (LIR), Mainz, Germany.
| | - Saskia Lindner
- Department of Psychiatry and Psychotherapy, University Medical Center of the Johannes Gutenberg University Mainz, Mainz, Germany
| | - Bernd Marquardt
- Department of Psychiatry and Psychotherapy, University Medical Center of the Johannes Gutenberg University Mainz, Mainz, Germany
| | - Maia Salholz-Hillel
- QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charité Universitätsmedizin Berlin, Berlin, Germany
| | - Nicholas J DeVito
- Bennett Institute for Applied Data Science, Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | - David Klemperer
- Ostbayrische Technische Hochschule Regensburg, Regensburg, Germany
| | - Klaus Lieb
- Department of Psychiatry and Psychotherapy, University Medical Center of the Johannes Gutenberg University Mainz, Mainz, Germany
- Leibniz Institute for Resilience Research (LIR), Mainz, Germany
| |
Collapse
|
9
|
He Y, Zhang R, Shan W, Yin Y, Zhang X, Zhang Y, Wang X. Evaluating the completeness of the reporting of abstracts since the publication of the CONSORT extension for abstracts: an evaluation of randomized controlled trial in ten nursing journals. Trials 2023; 24:423. [PMID: 37349754 DOI: 10.1186/s13063-023-07419-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 05/27/2023] [Indexed: 06/24/2023] Open
Abstract
BACKGROUND As a practice-oriented discipline, strict adherence to reporting guidelines is particularly important in randomized controlled trial (RCT) abstracts of the nursing area. However, whether abstract reports after 2010 have complied with the Consolidated Standards of Reporting Trials for Abstracts (CONSORT-A) guideline is unclear. This study aimed to evaluate whether the publication of CONSORT-A has improved abstract reporting in nursing and explores the factors associated with better adherence to the guidelines. METHODS We searched the Web of Science for 200 RCTs randomly selected from ten nursing journals. We used a data extraction form based on CONSORT-A, including 16 items, to analyze the reporting adherence to the guidelines, and the reporting rate of each item and the total score for each abstract were used to indicate adherence and overall quality score (OQS, range 0-16). A comparison of the total mean score between the two periods was made, and affecting factors were analyzed. RESULTS In the studies we included, 48 abstracts were published pre-CONSORT-A whereas 152 post-CONSORT-A. The overall mean score for reporting adherence to 16 items was 7.41 ± 2.78 and 9.16 ± 2.76 for pre- and post-CONSORT-A, respectively (total score: 16). The most poorly reported items are "harms (0%)," "outcomes in method (8.5%)," "randomization (25%)," and "blinding (6.5%)." Items including the year of publication, impact factor, multiple center trial, word count, and structured abstract are significantly associated with higher adherence. CONCLUSIONS The adherence to abstract reporting in nursing literature has improved since the CONSORT-A era, but the overall completeness of RCT abstracts remained low. A joint effort by authors, editors, and journals is necessary to improve reporting quality of RCT abstracts.
Collapse
Affiliation(s)
- Yan He
- Health Human Resources Service Center, Health Commission of Gansu Province, Lanzhou, Gansu, 730000, China
| | - Rong Zhang
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Wenjing Shan
- Oncology Department, Nursing, Xi'an International Medical Center, Xi'an, 710000, Shaanxi, China
| | - Yuhuan Yin
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Xiaoli Zhang
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Yiyin Zhang
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, 730000, Gansu, China
| | - Xiaoping Wang
- Urological Examination Room, Gansu Provincial Hospital, Lanzhou, 730000, Gansu, China.
| |
Collapse
|
10
|
Elagami RA, Tedesco TK, Pannuti CM, da Silva GS, Braga MM, Mendes FM, Raggio DP. Selective outcome reporting in paediatric dentistry restorative treatment randomised clinical trials-A meta-research. Int J Paediatr Dent 2023; 33:89-98. [PMID: 35838202 PMCID: PMC10087835 DOI: 10.1111/ipd.13024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2021] [Revised: 06/26/2022] [Accepted: 06/30/2022] [Indexed: 01/01/2023]
Abstract
BACKGROUND Selective outcome reporting (SOR) is a bias that occurs when the primary outcome of a randomised clinical trial (RCT) is omitted or changed. AIM To evaluate the prevalence of SOR in RCTs on restorative treatment in primary teeth. DESIGN We conducted an electronic search on ClinicalTrials.gov and the World Health Organization platform (International Clinical Trials Registry Platform) on 1st of April 2021, with no registry time or language restrictions. We included RCT protocols that evaluated restorative treatments in primary teeth and excluded trials that did not have a complete publication in a scientific journal. The chi-squared test was used to identify the association between SOR and variables as a discrepancy in the follow-up period, the timing of registration, the type of sponsorship and the type of study design (α = 5%). RESULTS Of the 294 identified protocols, 30 were included in the study. 83.3% of trials were registered retrospectively. SOR was observed in 53.3% (n = 16) of the published trials and was significantly associated with a discrepancy in the follow-up period (p = .017). CONCLUSIONS The high prevalence of SOR in RCTs on restorative treatment proves that this is a prominent threat. A proper preregistered protocol, declaration of any protocol deviation and allowance of stakeholders to compare the protocol with that of the submitted papers will achieve transparency.
Collapse
Affiliation(s)
- Rokaia Ahmed Elagami
- Department of Paediatric Dentistry, School of Dentistry, University of São Paulo, São Paulo, Brazil
| | | | - Claudio Mendes Pannuti
- Department of Periodontics, School of Dentistry, University of São Paulo, São Paulo, Brazil
| | - Gabriela Seabra da Silva
- Department of Paediatric Dentistry, School of Dentistry, University of São Paulo, São Paulo, Brazil
| | - Mariana Minatel Braga
- Department of Paediatric Dentistry, School of Dentistry, University of São Paulo, São Paulo, Brazil
| | - Fausto Medeiros Mendes
- Department of Paediatric Dentistry, School of Dentistry, University of São Paulo, São Paulo, Brazil
| | - Daniela Prócida Raggio
- Department of Paediatric Dentistry, School of Dentistry, University of São Paulo, São Paulo, Brazil.,School of Dentistry, Cardiff University, Cardiff, UK
| |
Collapse
|
11
|
Butcher NJ, Monsour A, Mew EJ, Chan AW, Moher D, Mayo-Wilson E, Terwee CB, Chee-A-Tow A, Baba A, Gavin F, Grimshaw JM, Kelly LE, Saeed L, Thabane L, Askie L, Smith M, Farid-Kapadia M, Williamson PR, Szatmari P, Tugwell P, Golub RM, Monga S, Vohra S, Marlin S, Ungar WJ, Offringa M. Guidelines for Reporting Outcomes in Trial Protocols: The SPIRIT-Outcomes 2022 Extension. JAMA 2022; 328:2345-2356. [PMID: 36512367 DOI: 10.1001/jama.2022.21243] [Citation(s) in RCA: 52] [Impact Index Per Article: 26.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
IMPORTANCE Complete information in a trial protocol regarding study outcomes is crucial for obtaining regulatory approvals, ensuring standardized trial conduct, reducing research waste, and providing transparency of methods to facilitate trial replication, critical appraisal, accurate reporting and interpretation of trial results, and knowledge synthesis. However, recommendations on what outcome-specific information should be included are diverse and inconsistent. To improve reporting practices promoting transparent and reproducible outcome selection, assessment, and analysis, a need for specific and harmonized guidance as to what outcome-specific information should be addressed in clinical trial protocols exists. OBJECTIVE To develop harmonized, evidence- and consensus-based standards for describing outcomes in clinical trial protocols through integration with the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) 2013 statement. EVIDENCE REVIEW Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the SPIRIT-Outcomes 2022 extension of the SPIRIT 2013 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for outcome-specific reporting to be addressed in clinical trial protocols. FINDINGS The scoping review and consultation with experts identified 108 recommendations relevant to outcome-specific reporting to be addressed in trial protocols, the majority (72%) of which were not included in the SPIRIT 2013 statement. All recommendations were consolidated into 56 items for Delphi voting; after the Delphi survey process, 19 items met criteria for further evaluation at the consensus meeting and possible inclusion in the SPIRIT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 9 items that elaborate on the SPIRIT 2013 statement checklist items and are related to completely defining and justifying the choice of primary, secondary, and other outcomes (SPIRIT 2013 statement checklist item 12) prospectively in the trial protocol, defining and justifying the target difference between treatment groups for the primary outcome used in the sample size calculations (SPIRIT 2013 statement checklist item 14), describing the responsiveness of the study instruments used to assess the outcome and providing details on the outcome assessors (SPIRIT 2013 statement checklist item 18a), and describing any planned methods to account for multiplicity relating to the analyses or interpretation of the results (SPIRIT 2013 statement checklist item 20a). CONCLUSIONS AND RELEVANCE This SPIRIT-Outcomes 2022 extension of the SPIRIT 2013 statement provides 9 outcome-specific items that should be addressed in all trial protocols and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.
Collapse
Affiliation(s)
- Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
| | - Andrea Monsour
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Emma J Mew
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Department of Chronic Disease Epidemiology, School of Public Health, Yale University, New Haven, Connecticut
| | - An-Wen Chan
- Department of Medicine, Women's College Research Institute, University of Toronto, Toronto, Ontario, Canada
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
| | - Evan Mayo-Wilson
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill
| | - Caroline B Terwee
- Amsterdam University Medical Centers, Vrije Universiteit, Department of Epidemiology and Data Science, Amsterdam, the Netherlands
- Department of Methodology, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | - Alyssandra Chee-A-Tow
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Ami Baba
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Frank Gavin
- public panel member, Toronto, Ontario, Canada
| | - Jeremy M Grimshaw
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Lauren E Kelly
- Department of Pharmacology and Therapeutics, University of Manitoba, Winnipeg, Canada
- Children's Hospital Research Institute of Manitoba, Winnipeg, Canada
| | - Leena Saeed
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Lehana Thabane
- Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Lisa Askie
- NHMRC Clinical Trials Centre, University of Sydney, Sydney, New South Wales, Australia
| | | | - Mufiza Farid-Kapadia
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Paula R Williamson
- MRC-NIHR Trials Methodology Research Partnership, Department of Health Data Science, University of Liverpool, Liverpool, England
| | - Peter Szatmari
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Peter Tugwell
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Bruyère Research Institute, Ottawa, Ontario, Canada
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | - Robert M Golub
- Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - Suneeta Monga
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Sunita Vohra
- Departments of Pediatrics and Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Canada
| | - Susan Marlin
- Clinical Trials Ontario, Toronto, Canada
- Department of Public Health Sciences, Queen's University, Kingston, Ontario, Canada
| | - Wendy J Ungar
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada
- Division of Neonatology, The Hospital for Sick Children, Toronto, Ontario, Canada
| |
Collapse
|
12
|
Butcher NJ, Monsour A, Mew EJ, Chan AW, Moher D, Mayo-Wilson E, Terwee CB, Chee-A-Tow A, Baba A, Gavin F, Grimshaw JM, Kelly LE, Saeed L, Thabane L, Askie L, Smith M, Farid-Kapadia M, Williamson PR, Szatmari P, Tugwell P, Golub RM, Monga S, Vohra S, Marlin S, Ungar WJ, Offringa M. Guidelines for Reporting Outcomes in Trial Reports: The CONSORT-Outcomes 2022 Extension. JAMA 2022; 328:2252-2264. [PMID: 36511921 DOI: 10.1001/jama.2022.21022] [Citation(s) in RCA: 158] [Impact Index Per Article: 79.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
IMPORTANCE Clinicians, patients, and policy makers rely on published results from clinical trials to help make evidence-informed decisions. To critically evaluate and use trial results, readers require complete and transparent information regarding what was planned, done, and found. Specific and harmonized guidance as to what outcome-specific information should be reported in publications of clinical trials is needed to reduce deficient reporting practices that obscure issues with outcome selection, assessment, and analysis. OBJECTIVE To develop harmonized, evidence- and consensus-based standards for reporting outcomes in clinical trial reports through integration with the Consolidated Standards of Reporting Trials (CONSORT) 2010 statement. EVIDENCE REVIEW Using the Enhancing the Quality and Transparency of Health Research (EQUATOR) methodological framework, the CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement was developed by (1) generation and evaluation of candidate outcome reporting items via consultation with experts and a scoping review of existing guidance for reporting trial outcomes (published within the 10 years prior to March 19, 2018) identified through expert solicitation, electronic database searches of MEDLINE and the Cochrane Methodology Register, gray literature searches, and reference list searches; (2) a 3-round international Delphi voting process (November 2018-February 2019) completed by 124 panelists from 22 countries to rate and identify additional items; and (3) an in-person consensus meeting (April 9-10, 2019) attended by 25 panelists to identify essential items for the reporting of outcomes in clinical trial reports. FINDINGS The scoping review and consultation with experts identified 128 recommendations relevant to reporting outcomes in trial reports, the majority (83%) of which were not included in the CONSORT 2010 statement. All recommendations were consolidated into 64 items for Delphi voting; after the Delphi survey process, 30 items met criteria for further evaluation at the consensus meeting and possible inclusion in the CONSORT-Outcomes 2022 extension. The discussions during and after the consensus meeting yielded 17 items that elaborate on the CONSORT 2010 statement checklist items and are related to completely defining and justifying the trial outcomes, including how and when they were assessed (CONSORT 2010 statement checklist item 6a), defining and justifying the target difference between treatment groups during sample size calculations (CONSORT 2010 statement checklist item 7a), describing the statistical methods used to compare groups for the primary and secondary outcomes (CONSORT 2010 statement checklist item 12a), and describing the prespecified analyses and any outcome analyses not prespecified (CONSORT 2010 statement checklist item 18). CONCLUSIONS AND RELEVANCE This CONSORT-Outcomes 2022 extension of the CONSORT 2010 statement provides 17 outcome-specific items that should be addressed in all published clinical trial reports and may help increase trial utility, replicability, and transparency and may minimize the risk of selective nonreporting of trial results.
Collapse
Affiliation(s)
- Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
| | - Andrea Monsour
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Emma J Mew
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Department of Chronic Disease Epidemiology, School of Public Health, Yale University, New Haven, Connecticut
| | - An-Wen Chan
- Department of Medicine, Women's College Research Institute, University of Toronto, Toronto, Ontario, Canada
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
| | - Evan Mayo-Wilson
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill
| | - Caroline B Terwee
- Amsterdam University Medical Centers, Vrije Universiteit, Department of Epidemiology and Data Science, Amsterdam, the Netherlands
- Department of Methodology, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | - Alyssandra Chee-A-Tow
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Ami Baba
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Frank Gavin
- public panel member, Toronto, Ontario, Canada
| | - Jeremy M Grimshaw
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Lauren E Kelly
- Department of Pharmacology and Therapeutics, University of Manitoba, Winnipeg, Canada
- Children's Hospital Research Institute of Manitoba, Winnipeg, Canada
| | - Leena Saeed
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Lehana Thabane
- Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, Ontario, Canada
| | - Lisa Askie
- NHMRC Clinical Trials Centre, University of Sydney, Sydney, New South Wales, Australia
| | | | - Mufiza Farid-Kapadia
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Paula R Williamson
- MRC-NIHR Trials Methodology Research Partnership, Department of Health Data Science, University of Liverpool, Liverpool, England
| | - Peter Szatmari
- Cundill Centre for Child and Youth Depression, Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Peter Tugwell
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
- Department of Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Bruyère Research Institute, Ottawa, Ontario, Canada
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | - Robert M Golub
- Department of Medicine, Feinberg School of Medicine, Northwestern University, Chicago, Illinois
| | - Suneeta Monga
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Ontario, Canada
| | - Sunita Vohra
- Departments of Pediatrics and Psychiatry, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Canada
| | - Susan Marlin
- Clinical Trials Ontario, Toronto, Canada
- Department of Public Health Sciences, Queen's University, Kingston, Ontario, Canada
| | - Wendy J Ungar
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Institute of Health Policy, Management, and Evaluation, University of Toronto, Toronto, Ontario, Canada
- Division of Neonatology, The Hospital for Sick Children, Toronto, Ontario, Canada
| |
Collapse
|
13
|
Peng S, Tian Y, Chang W, Yang Y, Li S, Ni J, Zhu W. Current state of research on acupuncture for the treatment of amyotrophic lateral sclerosis: A scoping review. Front Neurol 2022; 13:1019156. [PMID: 36408510 PMCID: PMC9669253 DOI: 10.3389/fneur.2022.1019156] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Accepted: 10/24/2022] [Indexed: 11/06/2022] Open
Abstract
Objective To provide an overview of the range and characteristics of existing evidence, research gaps, and future research priorities in treating amyotrophic lateral sclerosis (ALS) with acupuncture. Method Clinical studies on acupuncture treatment for ALS were searched in 9 databases and two websites. Two independent researchers screened the literature according to the inclusion and exclusion criteria; extracted the demographic data, interventions, and significant findings of the studies; and comprehensively analyzed the characteristics and limitations of the included articles. Results A total of 2,326 studies were retrieved, of which 92 were included. Most of the studies were conducted in China, with the number increasing over time. Study designs included case reports, case series, randomized controlled trials (RCTs), and before-and-after studies, among which case reports were the most frequently used. A total of 1,388 patients were enrolled, of whom 1,031 had ALS, 274 had progressive bulbar palsy (PBP), 60 had progressive muscle atrophy (PMA), and 23 had primary lateral sclerosis (PLS). Acupuncture interventions included body acupuncture, electroacupuncture, acupoint injection, scalp acupuncture, acupoint massage, Sa-am acupuncture, needle-embedding therapy, auricular acupuncture, venom pharmacopuncture therapy, plum blossom needling, acupoint paste, electroacupuncture, and needle warming through moxibustion. The most frequently used acupoints were ST36, LI4, SP6, and LI11. Acupuncture is often applied in combination with other treatments, such as herbal or Western medicine. The frequency of treatment ranged from once a month to three times a day, and the duration of treatment ranged from 5 days to 3 years. Clinical symptoms, muscle strength, and effective rates were the most frequently used outcomes. Most studies reported significant efficacy, and only a few studies reported adverse events explicitly. Conclusion Evidence gaps include poor study design, complex interventions, limited significance of the selected outcomes, and limited study reporting. The promotion of acupuncture treatment for ALS still faces several obstacles. Rigorous study design and conduct, standardized intervention and outcome measurements, and normative reporting are needed to investigate the efficacy and safety of acupuncture treatment for ALS.
Collapse
Affiliation(s)
- Siyang Peng
- Acupuncture Department, Guang'anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| | - Yukun Tian
- Acupuncture Department, Guang'anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| | - Weiqian Chang
- Acupuncture Department, Guang'anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| | - Yajing Yang
- Acupuncture Department, Guang'anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| | - Shaohong Li
- Acupuncture Department, Guang'anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| | - Jinxia Ni
- Acupuncture Department, Dongzhimen Hospital of Beijing University of Chinese Medicine, Beijing, China
| | - Wenzeng Zhu
- Acupuncture Department, Guang'anmen Hospital, China Academy of Chinese Medical Sciences, Beijing, China
| |
Collapse
|
14
|
Manyara AM, Davies P, Stewart D, Wells V, Weir C, Young A, Taylor R, Ciani O. Scoping and targeted reviews to support development of SPIRIT and CONSORT extensions for randomised controlled trials with surrogate primary endpoints: protocol. BMJ Open 2022; 12:e062798. [PMID: 36229145 PMCID: PMC9562307 DOI: 10.1136/bmjopen-2022-062798] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Accepted: 10/05/2022] [Indexed: 12/12/2022] Open
Abstract
INTRODUCTION Using a surrogate endpoint as a substitute for a primary patient-relevant outcome enables randomised controlled trials (RCTs) to be conducted more efficiently, that is, with shorter time, smaller sample size and lower cost. However, there is currently no consensus-driven guideline for the reporting of RCTs using a surrogate endpoint as a primary outcome; therefore, we seek to develop SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) and CONSORT (Consolidated Standards of Reporting Trials) extensions to improve the design and reporting of these trials. As an initial step, scoping and targeted reviews will identify potential items for inclusion in the extensions and participants to contribute to a Delphi consensus process. METHODS AND ANALYSIS The scoping review will search and include literature reporting on the current understanding, limitations and guidance on using surrogate endpoints in trials. Relevant literature will be identified through: (1) bibliographic databases; (2) grey literature; (3) handsearching of reference lists and (4) solicitation from experts. Data from eligible records will be thematically analysed into potential items for inclusion in extensions. The targeted review will search for RCT reports and protocols published from 2017 to 2021 in six high impact general medical journals. Trial corresponding author contacts will be listed as potential participants for the Delphi exercise. ETHICS AND DISSEMINATION Ethical approval is not required. The reviews will support the development of SPIRIT and CONSORT extensions for reporting surrogate primary endpoints (surrogate endpoint as the primary outcome). The findings will be published in open-access publications.This review has been prospectively registered in the OSF Registration DOI: 10.17605/OSF.IO/WP3QH.
Collapse
Affiliation(s)
- Anthony Muchai Manyara
- MRC/CSO Social and Public Health Sciences Unit, Institute of Health and Wellbeing, University of Glasgow, Glasgow, UK
| | - Philippa Davies
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | | | - Valerie Wells
- MRC/CSO Social and Public Health Sciences Unit, Institute of Health and Wellbeing, University of Glasgow, Glasgow, UK
| | - Christopher Weir
- Edinburgh Clinical Trials Unit, Usher Institute, University of Edinburgh, Edinburgh, UK
| | - Amber Young
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, UK
| | - Rod Taylor
- MRC/CSO Social and Public Health Sciences Unit, Institute of Health and Wellbeing, University of Glasgow, Glasgow, UK
- Robertson Centre for Biostatistics, Institute of Health and Well Being, University of Glasgow, Glasgow, UK
| | | |
Collapse
|
15
|
Hopewell S, Boutron I, Chan AW, Collins GS, de Beyer JA, Hróbjartsson A, Nejstgaard CH, Østengaard L, Schulz KF, Tunn R, Moher D. An update to SPIRIT and CONSORT reporting guidelines to enhance transparency in randomized trials. Nat Med 2022; 28:1740-1743. [PMID: 36109642 DOI: 10.1038/s41591-022-01989-8] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022]
Affiliation(s)
- Sally Hopewell
- Oxford Clinical Trials Research Unit / Centre for Statistics in Medicine, University of Oxford, Oxford, UK.
| | - Isabelle Boutron
- Université Paris Cité, Inserm, INRAE, Centre de Recherche Epidémiologie et Statistiques, Université Paris Cité, Paris, France
- Centre d'Epidémiologie Clinique, AP-HP, Hôpital Hôtel Dieu, Paris, France
| | - An-Wen Chan
- Department of Medicine, Women's College Research Institute, University of Toronto, Toronto, Ontario, Canada
| | - Gary S Collins
- UK EQUATOR Centre/Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | - Jennifer A de Beyer
- UK EQUATOR Centre/Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | - Asbjørn Hróbjartsson
- Centre for Evidence-Based Medicine Odense and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Open Patient Data Explorative Network, Odense University Hospital, Odense, Denmark
| | - Camilla Hansen Nejstgaard
- Centre for Evidence-Based Medicine Odense and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Open Patient Data Explorative Network, Odense University Hospital, Odense, Denmark
| | - Lasse Østengaard
- Centre for Evidence-Based Medicine Odense and Cochrane Denmark, Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Open Patient Data Explorative Network, Odense University Hospital, Odense, Denmark
| | - Kenneth F Schulz
- Department of Obstetrics and Gynecology, School of Medicine, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Ruth Tunn
- Oxford Clinical Trials Research Unit / Centre for Statistics in Medicine, University of Oxford, Oxford, UK
| | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| |
Collapse
|
16
|
Elsman EBM, Butcher NJ, Mokkink LB, Terwee CB, Tricco A, Gagnier JJ, Aiyegbusi OL, Barnett C, Smith M, Moher D, Offringa M. Study protocol for developing, piloting and disseminating the PRISMA-COSMIN guideline: a new reporting guideline for systematic reviews of outcome measurement instruments. Syst Rev 2022; 11:121. [PMID: 35698213 PMCID: PMC9195229 DOI: 10.1186/s13643-022-01994-5] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Accepted: 05/28/2022] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND Systematic reviews of outcome measurement instruments are important tools in the evidence-based selection of these instruments. COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) has developed a comprehensive and widespread guideline to conduct systematic reviews of outcome measurement instruments, but key information is often missing in published reviews. This hinders the appraisal of the quality of outcome measurement instruments, impacts the decisions of knowledge users regarding their appropriateness, and compromises reproducibility and interpretability of the reviews' findings. To facilitate sufficient, transparent, and consistent reporting of systematic reviews of outcome measurement instruments, an extension of the PRISMA (Preferred Reporting of Items for Systematic reviews and Meta-Analyses) 2020 guideline will be developed: the PRISMA-COSMIN guideline. METHODS The PRISMA-COSMIN guideline will be developed in accordance with recommendations for reporting guideline development from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network. First, a candidate reporting item list will be created through an environmental literature scan and expert consultations. Second, an international Delphi study will be conducted with systematic review authors, biostatisticians, epidemiologists, psychometricians/clinimetricians, reporting guideline developers, journal editors as well as patients, caregivers, and members of the public. Delphi panelists will rate candidate items for inclusion on a 5-point scale, suggest additional candidate items, and give feedback on item wording and comprehensibility. Third, the draft PRISMA-COSMIN guideline and user manual will be iteratively piloted by applying it to systematic reviews in several disease areas to assess its relevance, comprehensiveness, and comprehensibility, along with usability and user satisfaction. Fourth, a consensus meeting will be held to finalize the PRISMA-COSMIN guideline through roundtable discussions and voting. Last, a user manual will be developed and the final PRISMA-COSMIN guideline will be disseminated through publications, conferences, newsletters, and relevant websites. Additionally, relevant journals and organizations will be invited to endorse and implement PRISMA-COSMIN. Throughout the project, evaluations will take place to identify barriers and facilitators of involving patient/public partners and employing a virtual process. DISCUSSION The PRISMA-COSMIN guideline will ensure that the reports of systematic reviews of outcome measurement instruments are complete and informative, enhancing their reproducibility, ease of use, and uptake.
Collapse
Affiliation(s)
- Ellen B M Elsman
- Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands.
- Quality of Care, Amsterdam Public Health, Amsterdam, The Netherlands.
| | - Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Department of Psychiatry, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
| | - Lidwine B Mokkink
- Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands
- Methodology, Amsterdam Public Health, Amsterdam, The Netherlands
| | - Caroline B Terwee
- Epidemiology and Data Science, Amsterdam UMC location Vrije Universiteit Amsterdam, de Boelelaan 1117, Amsterdam, Netherlands
- Methodology, Amsterdam Public Health, Amsterdam, The Netherlands
| | - Andrea Tricco
- Li Ka Shing Knowledge Institute, St. Michael's Hospital, Unity Health Toronto, Toronto, Ontario, Canada
- Epidemiology Division and Institute of Health Policy, Management, and Evaluation, Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
- Queen's Collaboration for Health Care Quality Joanna Briggs Institute Centre of Excellence, Queen's University, Kingston, Canada
| | - Joel J Gagnier
- Department of Epidemiology and Biostatistics, Schulich School of Medicine and Dentistry, London, Ontario, Canada
- Department of Surgery, Schulich School of Medicine and Dentistry, London, Ontario, Canada
- Department of Orthopaedic Surgery, University of Michigan, Ann Arbor, Michigan, USA
- Department of Epidemiology, School of Public Health, University of Michigan, Ann Arbor, Michigan, USA
| | - Olalekan Lee Aiyegbusi
- Centre for Patient Reported Outcomes Research, Institute of Applied Health Research, University of Birmingham, Birmingham, UK
| | - Carolina Barnett
- Division of Neurology, Department of Medicine, University Health Network and University of Toronto, Toronto, Ontario, Canada
| | | | - David Moher
- Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
- Management and Evaluation, Institute of Health Policy, University of Toronto, Toronto, Ontario, Canada
- Division of Neonatology, The Hospital for Sick Children, Toronto, Ontario, Canada
| |
Collapse
|
17
|
Wagemans J, Bleakley C, Taeymans J, Schurz AP, Kuppens K, Baur H, Vissers D. Exercise-based rehabilitation reduces reinjury following acute lateral ankle sprain: A systematic review update with meta-analysis. PLoS One 2022; 17:e0262023. [PMID: 35134061 PMCID: PMC8824326 DOI: 10.1371/journal.pone.0262023] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 12/15/2021] [Indexed: 12/26/2022] Open
Abstract
Research questions 1) Do exercise-based rehabilitation programs reduce re-injury following acute ankle sprain?; 2) Is rehabilitation effectiveness moderated by the exercise’s therapeutic quality, content and volume? Methods This systematic review with meta-analysis (PROSPERO: CRD42020210858) included randomized controlled trials in which adults who sustained an acute ankle sprain received exercise-based rehabilitation as an intervention. Databases CINAHL, Web of Science, SPORTDiscus, Cochrane Central Register of Controlled Trials, PEDro and Google Scholar were searched for eligible articles (last search: March 2021). ROB II screening tool by Cochrane was used to assess risk of bias and the i-CONTENT tool was used to assess quality of interventions. Both qualitative analysis and quantitative data synthesis were performed. Results Fourteen randomized controlled trials comprising 2182 participants were included. Five studies were judged overall low risk of bias and i-CONTENT assessment showed poor to moderate therapeutic quality of exercise across all included articles. Pooled data found significant reductions in re-injury prevalence at 12 months, in favour of the exercise-based rehabilitation group vs usual care (OR: 0.60; 95%CI: 0.36 to 0.99). Pooled data for re-injury incidence showed not-significant results (MD: 0.027; 95%CI: -2.14 to 2.19). Meta-regression displayed no statistically significant association between training volume and odds of re-injury (r = -0.00086; SD: 0.00057; 95%CI: -0.00197 to 0.00025). Results from patient-reported outcomes and clinical outcomes were inconclusive at 1 month, 3–6 months and 7–12 months of follow up. Conclusion Exercise-based rehabilitation reduces the risk of recurrent ankle sprain compared to usual care, but there is insufficient data to determine the optimal content of exercise-based interventions. Training volume varied considerably across studies but did not affect the odds of sustaining a re-injury. Effects on patient-reported outcomes and clinical outcomes are equivocal. Future research should compare different exercise contents, training volumes and intensities after ankle sprain.
Collapse
Affiliation(s)
- Jente Wagemans
- Department of Rehabilitation Sciences and Physiotherapy, Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium
- Department of Health Professions, Bern University of Applied Sciences, Bern, Switzerland
- * E-mail: ,
| | - Chris Bleakley
- School of Health Science, Ulster University, Newtownabbey, Northern Ireland
| | - Jan Taeymans
- Department of Health Professions, Bern University of Applied Sciences, Bern, Switzerland
- Faculty of Physical Education and Physiotherapy, Vrije Universiteit Brussel, Brussels, Belgium
| | | | - Kevin Kuppens
- Department of Rehabilitation Sciences and Physiotherapy, Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium
- Faculty of Physical Education and Physiotherapy, Vrije Universiteit Brussel, Brussels, Belgium
| | - Heiner Baur
- Department of Health Professions, Bern University of Applied Sciences, Bern, Switzerland
| | - Dirk Vissers
- Department of Rehabilitation Sciences and Physiotherapy, Faculty of Medicine and Health Sciences, University of Antwerp, Antwerp, Belgium
- Department of Health Professions, Bern University of Applied Sciences, Bern, Switzerland
| |
Collapse
|
18
|
Courtney DB, Watson P, Chan BW, Bennett K, Krause KR, Offringa M, Butcher NJ, Monga S, Neprily K, Zentner T, Rodak T, Szatmari P. Forks in the road: Definitions of response, remission, recovery, and other dichotomized outcomes in randomized controlled trials for adolescent depression. A scoping review. Depress Anxiety 2021; 38:1152-1168. [PMID: 34312952 DOI: 10.1002/da.23200] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/23/2020] [Revised: 06/18/2021] [Accepted: 06/24/2021] [Indexed: 01/19/2023] Open
Abstract
BACKGROUND Definitions of dichotomous outcome terms, such as "response," "remission," and "recovery" are central to the design, interpretation, and clinical application of randomized controlled trials of adolescent depression interventions. Accordingly, this scoping review was conducted to document how these terms have been defined and justified in clinical trials. METHOD Bibliographic databases MEDLINE, Embase, APA PsycInfo, and CINAHL were searched from inception to February 2020 for randomized controlled trials evaluating treatments for adolescent depression. Ninety-eight trials were included for data extraction and analysis. RESULTS Assessment of outcome measurement instruments, metric strategies, methods of aggregation, and measurement timing, yielded 53 unique outcome definitions of "response" across 45 trials that assessed response, 47 unique definitions of "remission" in 29 trials that assessed remission, and 19 unique definitions of "recovery" across 11 trials that assessed recovery. A minority of trials (N = 35) provided a rationale for dichotomous outcomes definitions, often by citing other studies that used a similar definition (N = 11). No rationale included input from youth or families with lived experience. CONCLUSION Our review revealed that definitions of "response," "remission," "recovery," and related terms are highly variable, lack clear rationales, and are not informed by key stakeholder input. These limitations impair pooling of trial results and the incorporation of trial findings into pragmatic treatment decisions in clinical practice. Systematic approaches to establishing outcome definitions are needed to enhance the impact of trials examining adolescent depression treatment.
Collapse
Affiliation(s)
- Darren B Courtney
- Department of Psychiatry, Child and Youth Mental Health, University of Toronto, Toronto, Ontario
| | - Priya Watson
- Department of Psychiatry, Child and Youth Mental Health, University of Toronto, Toronto, Ontario
| | | | - Kathryn Bennett
- Department of Health Research Methods, Evidence and Impact (formerly Clinical Epidemiology and Biostatistics), McMaster Univeristy, Toronto, Ontario
| | | | - Martin Offringa
- Department of Pediatrics, Neonatology, University of Toronto, Toronto, Ontario
| | - Nancy J Butcher
- Department of Psychiatry, Child and Youth Mental Health, University of Toronto, Toronto, Ontario
| | - Suneeta Monga
- Department of Psychiatry, Child and Youth Mental Health, University of Toronto, Toronto, Ontario
| | - Kirsten Neprily
- Department of Psychology, School and Applied Child Psychology, University of Calgary, Calgary, Alberta
| | - Tabitha Zentner
- Margaret and Wallace McCain Centre for Child, Youth and Family Mental Health, Centre for Addiction and Mental Health, Toronto, Ontario
| | - Terri Rodak
- Centre for Addiction and Mental Health, Toronto, Ontario
| | - Peter Szatmari
- Department of Psychiatry, Child and Youth Mental Health, University of Toronto, Toronto, Ontario
| |
Collapse
|
19
|
Yin Y, Shi F, Zhang Y, Zhang X, Ye J, Zhang J. Evaluation of reporting quality of randomized controlled trials in patients with COVID-19 using the CONSORT statement. PLoS One 2021; 16:e0257093. [PMID: 34555033 PMCID: PMC8460279 DOI: 10.1371/journal.pone.0257093] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2021] [Accepted: 08/23/2021] [Indexed: 11/17/2022] Open
Abstract
OBJECTIVE To evaluate the reporting quality of randomized controlled trials (RCTs) regarding patients with COVID-19 and analyse the influence factors. METHODS PubMed, Embase, Web of Science and the Cochrane Library databases were searched to collect RCTs regarding patients with COVID-19. The retrieval time was from the inception to December 1, 2020. The CONSORT 2010 statement was used to evaluate the overall reporting quality of these RCTs. RESULTS 53 RCTs were included. The study showed that the average reporting rate for 37 items in CONSORT checklist was 53.85% with mean overall adherence score of 13.02±3.546 (ranged: 7 to 22). The multivariate linear regression analysis showed the overall adherence score to the CONSORT guideline was associated with journal impact factor (P = 0.006), and endorsement of CONSORT statement (P = 0.014). CONCLUSION Although many RCTs of COVID-19 have been published in different journals, the overall reporting quality of these articles was suboptimal, it can not provide valid evidence for clinical decision-making and systematic reviews. Therefore, more journals should endorse the CONSORT statement, authors should strictly follow the relevant provisions of the CONSORT guideline when reporting articles. Future RCTs should particularly focus on improvement of detailed reporting in allocation concealment, blinding and estimation of sample size.
Collapse
Affiliation(s)
- Yuhuan Yin
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, China
| | - Fugui Shi
- Lanzhou Hand and Foot Surgery Hospital, Lanzhou, Gansu, China
| | - Yiyin Zhang
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, China
| | - Xiaoli Zhang
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, China
| | - Jianying Ye
- School of Nursing, Gansu University of Chinese Medicine, Lanzhou, China
| | - Juxia Zhang
- Clinical Educational Department, Gansu Provincial Hospital, Lanzhou, Gansu, China
| |
Collapse
|
20
|
Kampman JM, Sperna Weiland NH, Hollmann MW, Repping S, Hermanides J. High incidence of outcome switching observed in follow-up publications of randomized controlled trials: Meta-research study. J Clin Epidemiol 2021; 137:236-240. [PMID: 34004339 DOI: 10.1016/j.jclinepi.2021.05.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Accepted: 05/05/2021] [Indexed: 11/20/2022]
Abstract
OBJECTIVES To determine the incidence of outcome switching in follow-up publications of randomized controlled trials. Outcome switching leads to bias where treatment benefits are more likely to be overestimated or based on chance. STUDY DESIGN AND SETTING Meta-research study including all follow-up publications 2014-2018 in the New England Journal of Medicine, The Lancet, the Journal of the American Medical Association, and the British Medical Journal. Two independent reviewers compared the primary outcomes of follow-up publications with the original RCT publication and the trial protocol. RESULTS Seventy-eight follow-up publications were identified. Thirty-one (40%) used different primary outcomes in the follow-up publication compared with the original RCT. In seventeen (55%) of these the outcome switch was neither pre-specified nor explained in the journal publication. The incidence of outcome switching in follow-up studies rose to 70% when preceded by outcome switching in the corresponding initial RCT (P< 0.001). CONCLUSION In this study, outcome switching occurred in 40% of follow-up publications of previously published RCTs. The majority is neither pre-specified nor explained.
Collapse
Affiliation(s)
- Jasper M Kampman
- Department of Anesthesiology, Amsterdam University Medical Centers, University of Amsterdam, Meibergdreef 9, 1105, AZ, Amsterdam, The Netherlands.
| | - Nicolaas H Sperna Weiland
- Department of Anesthesiology, Amsterdam University Medical Centers, University of Amsterdam, Meibergdreef 9, 1105, AZ, Amsterdam, The Netherlands
| | - Markus W Hollmann
- Department of Anesthesiology, Amsterdam University Medical Centers, University of Amsterdam, Meibergdreef 9, 1105, AZ, Amsterdam, The Netherlands
| | - Sjoerd Repping
- Amsterdam University Medical Centers, University of Amsterdam, Meibergdreef 9, 1105, AZ, Amsterdam, The Netherlands; National Healthcare Institute, Healthcare Evaluation and Appropriate Use, Willem Dudokhof 1, 1112, ZA, Diemen, The Netherlands
| | - Jeroen Hermanides
- Department of Anesthesiology, Amsterdam University Medical Centers, University of Amsterdam, Meibergdreef 9, 1105, AZ, Amsterdam, The Netherlands
| |
Collapse
|
21
|
Response to "Trials for depressive disorder in adolescents: the emperor's new clothes," a letter to the editor by Alain Braillon, MD, PhD. J Clin Epidemiol 2020; 128:159-161. [PMID: 32860976 PMCID: PMC7449977 DOI: 10.1016/j.jclinepi.2020.08.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2020] [Accepted: 08/17/2020] [Indexed: 11/20/2022]
|
22
|
Monsour A, Mew EJ, Patel S, Chee-A-Tow A, Saeed L, Santos L, Courtney DB, Watson PN, Monga S, Szatmari P, Offringa M, Butcher NJ. Primary outcome reporting in adolescent depression clinical trials needs standardization. BMC Med Res Methodol 2020; 20:129. [PMID: 32450810 PMCID: PMC7247139 DOI: 10.1186/s12874-020-01019-6] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Accepted: 05/18/2020] [Indexed: 11/12/2022] Open
Abstract
BACKGROUND Evidence-based health care is informed by results of randomized clinical trials (RCTs) and their syntheses in meta-analyses. When the trial outcomes measured are not clearly described in trial publications, knowledge synthesis, translation, and decision-making may be impeded. While heterogeneity in outcomes measured in adolescent major depressive disorder (MDD) RCTs has been described, the comprehensiveness of outcome reporting is unknown. This study aimed to assess the reporting of primary outcomes in RCTs evaluating treatments for adolescent MDD. METHODS RCTs evaluating treatment interventions in adolescents with a diagnosis of MDD published between 2008 and 2017 specifying a single primary outcome were eligible for outcome reporting assessment. Outcome reporting assessment was done independently in duplicate using a comprehensive checklist of 58 reporting items. Primary outcome information provided in each RCT publication was scored as "fully reported", "partially reported", or "not reported" for each checklist item, as applicable. RESULTS Eighteen of 42 identified articles were found to have a discernable single primary outcome and were included for outcome reporting assessment. Most trials (72%) did not fully report on over half of the 58 checklist items. Items describing masking of outcome assessors, timing and frequency of outcome assessment, and outcome analyses were fully reported in over 70% of trials. Items less frequently reported included outcome measurement instrument properties (ranging from 6 to 17%), justification of timing and frequency of outcome assessment (6%), and justification of criteria used for clinically significant differences (17%). The overall comprehensiveness of reporting appeared stable over time. CONCLUSIONS Heterogeneous reporting exists in published adolescent MDD RCTs, with frequent omissions of key details about their primary outcomes. These omissions may impair interpretability, replicability, and synthesis of RCTs that inform clinical guidelines and decision-making in this field. Consensus on the minimal criteria for outcome reporting in adolescent MDD RCTs is needed.
Collapse
Affiliation(s)
- Andrea Monsour
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Emma J Mew
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Sagar Patel
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Alyssandra Chee-A-Tow
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Leena Saeed
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Lucia Santos
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| | - Darren B Courtney
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
| | - Priya N Watson
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
| | - Suneeta Monga
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Canada
| | - Peter Szatmari
- Centre for Addiction and Mental Health, Toronto, Ontario, Canada
- Department of Psychiatry, University of Toronto, Toronto, Ontario, Canada
- Department of Psychiatry, The Hospital for Sick Children, Toronto, Canada
| | - Martin Offringa
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada.
- Institute of Health Policy, Management and Evaluation, University of Toronto, Toronto, Ontario, Canada.
- Division of Neonatology, The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada.
| | - Nancy J Butcher
- Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, 686 Bay Street, Room 11.9712, Toronto, Ontario, M5G 0A4, Canada
| |
Collapse
|