1
|
Hansford HJ, Cashin AG, Jones MD, Swanson SA, Islam N, Douglas SRG, Rizzo RRN, Devonshire JJ, Williams SA, Dahabreh IJ, Dickerman BA, Egger M, Garcia-Albeniz X, Golub RM, Lodi S, Moreno-Betancur M, Pearson SA, Schneeweiss S, Sterne JAC, Sharp MK, Stuart EA, Hernán MA, Lee H, McAuley JH. Reporting of Observational Studies Explicitly Aiming to Emulate Randomized Trials: A Systematic Review. JAMA Netw Open 2023; 6:e2336023. [PMID: 37755828 PMCID: PMC10534275 DOI: 10.1001/jamanetworkopen.2023.36023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Accepted: 08/22/2023] [Indexed: 09/28/2023] Open
Abstract
Importance Observational (nonexperimental) studies that aim to emulate a randomized trial (ie, the target trial) are increasingly informing medical and policy decision-making, but it is unclear how these studies are reported in the literature. Consistent reporting is essential for quality appraisal, evidence synthesis, and translation of evidence to policy and practice. Objective To assess the reporting of observational studies that explicitly aimed to emulate a target trial. Evidence Review We searched Medline, Embase, PsycINFO, and Web of Science for observational studies published between March 2012 and October 2022 that explicitly aimed to emulate a target trial of a health or medical intervention. Two reviewers double-screened and -extracted data on study characteristics, key predefined components of the target trial protocol and its emulation (eligibility criteria, treatment strategies, treatment assignment, outcome[s], follow-up, causal contrast[s], and analysis plan), and other items related to the target trial emulation. Findings A total of 200 studies that explicitly aimed to emulate a target trial were included. These studies included 26 subfields of medicine, and 168 (84%) were published from January 2020 to October 2022. The aim to emulate a target trial was explicit in 70 study titles (35%). Forty-three studies (22%) reported use of a published reporting guideline (eg, Strengthening the Reporting of Observational Studies in Epidemiology). Eighty-five studies (43%) did not describe all key items of how the target trial was emulated and 113 (57%) did not describe the protocol of the target trial and its emulation. Conclusion and Relevance In this systematic review of 200 studies that explicitly aimed to emulate a target trial, reporting of how the target trial was emulated was inconsistent. A reporting guideline for studies explicitly aiming to emulate a target trial may improve the reporting of the target trial protocols and other aspects of these emulation attempts.
Collapse
Affiliation(s)
- Harrison J. Hansford
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Aidan G. Cashin
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Matthew D. Jones
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Sonja A. Swanson
- Department of Epidemiology, University of Pittsburgh, Pittsburgh, Pennsylvania
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Nazrul Islam
- Oxford Population Health, Big Data Institute, University of Oxford, Oxford, United Kingdom
- Faculty of Medicine, University of Southampton, Southampton, United Kingdom
| | - Susan R. G. Douglas
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
| | - Rodrigo R. N. Rizzo
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Jack J. Devonshire
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Sam A. Williams
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Issa J. Dahabreh
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Barbra A. Dickerman
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Matthias Egger
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Centre for Infectious Disease Epidemiology and Research, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
| | - Xabier Garcia-Albeniz
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- RTI Health Solutions, Barcelona, Spain
| | - Robert M. Golub
- Department of Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois
| | - Sara Lodi
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Boston University School of Public Health, Boston, Massachusetts
| | - Margarita Moreno-Betancur
- Clinical Epidemiology & Biostatistics Unit, Murdoch Children’s Research Institute, Royal Children’s Hospital, Parkville, Victoria, Australia
- Department of Paediatrics, The University of Melbourne, Parkville, Victoria, Australia
| | - Sallie-Anne Pearson
- School of Population Health, Faculty of Medicine and Health, UNSW Sydney, New South Wales, Australia
| | - Sebastian Schneeweiss
- Division of Pharmacoepidemiology, Department of Medicine, Brigham & Women’s Hospital, Harvard Medical School, Boston, Massachusetts
| | - Jonathan A. C. Sterne
- Department of Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
- NIHR Bristol Biomedical Research Centre, Bristol, United Kingdom
- Health Data Research UK South-West, Bristol, United Kingdom
| | - Melissa K. Sharp
- Department of Public Health and Epidemiology, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Elizabeth A. Stuart
- Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
| | - Miguel A. Hernán
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Hopin Lee
- University of Exeter Medical School, Exeter, United Kingdom
| | - James H. McAuley
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| |
Collapse
|
3
|
Hnynn Si PE, Gair R, Barnes T, Dunn L, Lee S, Ariss S, Walters SJ, Wilkie M, Fotheringham J. Symptom burden according to dialysis day of the week in three times a week haemodialysis patients. PLoS One 2022; 17:e0274599. [PMID: 36166424 PMCID: PMC9514641 DOI: 10.1371/journal.pone.0274599] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2021] [Accepted: 08/31/2022] [Indexed: 12/02/2022] Open
Abstract
Background Haemodialysis patients experience significant symptom burden and effects on health-related quality of life. Studies have shown increases in fluid overload, hospitalization and mortality immediately after the long interdialytic interval in thrice weekly in-centre haemodialysis patients, however the relationship between the dialytic interval and patient reported outcome measures (PROMs) has not been quantified and the extent to which dialysis day of PROM completion needs to be standardised is unknown. Methods Three times a week haemodialysis patients participating in a stepped wedge trial to increase patient participation in haemodialysis tasks completed PROMs (POS-S Renal symptom score and EQ-5D-5L) at recruitment, six, 12 and 18 months. Time from the long interdialytic interval, HD day of the week, and HD days vs non-HD days were included in mixed effects Linear Regression, estimating severity (none to overwhelming treated as 0 to 4) of 17 symptoms and EQ-5D-5L, adjusting for age, sex, time on HD, control versus intervention and Charlson Comorbidity Score. Results 517 patients completed 1659 YHS questionnaires that could be assigned HD day (510 on Mon/Tue/Sun, 549 on Wed/Thu/Tue, 308 on Fri/Sat/Thu and 269 on non-HD days). With the exception of restless legs and skin changes, there was no statistically significant change in symptom severity or EQ-5D-5L with increasing time from the long interdialytic interval. Patients who responded on non-HD days had higher severity of poor appetite, constipation, difficulty sleeping, poor mobility and depression (approximately 0.2 severity level), and lower EQ-5D-5L (-0.06, CI -0.09 to -0.03) compared to HD days. Conclusions Measuring symptom severity and EQ-5D-5L in haemodialysis populations does not need to account for dialysis schedule, but completion either on HD or non-HD days could introduce bias that may impact evaluation of interventions. Researchers should ensure completion of these instruments are standardized on either dialysis or non-dialysis days.
Collapse
Affiliation(s)
- Pann Ei Hnynn Si
- Sheffield Kidney Institute, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
- * E-mail:
| | - Rachel Gair
- Think Kidneys, UK Renal Registry, Bristol, United Kingdom
| | - Tania Barnes
- Sheffield Kidney Institute, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - Louese Dunn
- Sheffield Kidney Institute, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - Sonia Lee
- Sheffield Kidney Institute, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - Steven Ariss
- School of Health and Related Research, University of Sheffield, Sheffield, United Kingdom
| | - Stephen J. Walters
- School of Health and Related Research, University of Sheffield, Sheffield, United Kingdom
| | - Martin Wilkie
- Sheffield Kidney Institute, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
| | - James Fotheringham
- Sheffield Kidney Institute, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, United Kingdom
- School of Health and Related Research, University of Sheffield, Sheffield, United Kingdom
| |
Collapse
|
4
|
Fotheringham J, Vilar E, Bansal T, Laboi P, Davenport A, Dunn L, Hole AR. Patient Preferences for Longer or More Frequent In-Center Hemodialysis Regimens: A Multicenter Discrete Choice Study. Am J Kidney Dis 2022; 79:785-795. [PMID: 34699958 PMCID: PMC9153730 DOI: 10.1053/j.ajkd.2021.09.012] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2020] [Accepted: 09/05/2021] [Indexed: 11/11/2022]
Abstract
RATIONALE & OBJECTIVE Longer and more frequent hemodialysis sessions are associated with both benefits and harms. However, their relative importance to patients and how they influence acceptability for patients have not been quantified. STUDY DESIGN Discrete-choice experiment in which a scenario followed by 12 treatment choice sets were presented to patients in conjunction with varying information about the clinical impact of the treatments offered. SETTING & PARTICIPANTS Patients with kidney failure treated with maintenance dialysis for≥1 year in 5 UK kidney centers. PREDICTORS Length and frequency of hemodialysis sessions and their prior reported associations with survival, quality of life, need for fluid restriction, hospitalization, and vascular access complications. OUTCOME Selection of longer (4.5 hours) or more frequent (4 sessions per week) hemodialysis regimens versus remaining on 3 sessions per week with session lengths of 4 hours. ANALYTICAL APPROACH Multinomial mixed effects logistic regression estimating the relative influence of different levels of the predictors on the selection of longer and more frequent dialysis, controlling for patient demographic characteristics. RESULTS Among 183 prevalent in-center hemodialysis patients (mean age of 63.7 years, mean dialysis vintage of 4.7 years), 38.3% (70 of 183) always chose to remain on regimens of 3 sessions per week with session duration of 4 hours. Depicted associations of increasing survival and quality of life, reduced need for fluid restriction, and avoiding additional access complications were all significantly associated with choosing longer or more frequent treatment regimens. Younger age, fatigue, previous experience of vascular access complications, absence of heart failure, and shorter travel time to dialysis centers were associated with preference for 4 sessions per week. Patients expressed willingness to trade up to 2 years of life to avoid regimens of 4 sessions per week or access complications. After applying estimated treatment benefits and harms from existing literature, the fully adjusted model revealed that 27.1% would choose longer regimens delivered 3 times per week and 34.3% would choose 4 hours 4 times per week. Analogous estimates for younger fatigued patients living near their unit were 23.5% and 62.5%, respectively. LIMITATIONS Estimates were based on stated preferences rather than observed behaviors. Predicted acceptance of regimens was derived from data on treatment benefits and harms largely sourced from observational studies. CONCLUSIONS Predicted acceptance of longer and more frequent hemodialysis regimens substantially exceeds their use in current clinical practice. These findings underscore the need for robust data on clinical effectiveness of these more intensive regimens and more extensive consideration of patient choice in the selection of dialysis regimens.
Collapse
Affiliation(s)
- James Fotheringham
- School of Health and Related Research, University of Sheffield, Sheffield, United Kingdom; Sheffield Kidney Institute, Northern General Hospital, Sheffield, United Kingdom.
| | - Enric Vilar
- University of Hertfordshire, Hatfield, United Kingdom
| | - Tarun Bansal
- Bradford Teaching Hospitals NHS Trust, Bradford, United Kingdom
| | - Paul Laboi
- York Teaching Hospital NHS Foundation Trust, York, United Kingdom
| | - Andrew Davenport
- UCL Department of Nephrology, Royal Free Hospital, University College London, London, United Kingdom
| | - Louese Dunn
- Sheffield Kidney Institute, Northern General Hospital, Sheffield, United Kingdom
| | - Arne Risa Hole
- Department of Economics, University of Sheffield, Sheffield, United Kingdom
| |
Collapse
|
5
|
Gomes M, Latimer N, Soares M, Dias S, Baio G, Freemantle N, Dawoud D, Wailoo A, Grieve R. Target Trial Emulation for Transparent and Robust Estimation of Treatment Effects for Health Technology Assessment Using Real-World Data: Opportunities and Challenges. PHARMACOECONOMICS 2022; 40:577-586. [PMID: 35332434 DOI: 10.1007/s40273-022-01141-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/10/2022] [Indexed: 06/14/2023]
Abstract
Evidence about the relative effects of new treatments is typically collected in randomised controlled trials (RCTs). In many instances, evidence from RCTs falls short of the needs of health technology assessment (HTA). For example, RCTs may not be able to capture longer-term treatment effects, or include all relevant comparators and outcomes required for HTA purposes. Information routinely collected about patients and the care they receive have been increasingly used to complement RCT evidence on treatment effects. However, such routine (or real-world) data are not collected for research purposes, so investigators have little control over the way patients are selected into the study or allocated to the different treatment groups, introducing biases for example due to selection or confounding. A promising approach to minimise common biases in non-randomised studies that use real-world data (RWD) is to apply design principles from RCTs. This approach, known as 'target trial emulation' (TTE), involves (1) developing the protocol with respect to core study design and analysis components of the hypothetical RCT that would answer the question of interest, and (2) applying this protocol to the RWD so that it mimics the data that would have been gathered for the RCT. By making the 'target trial' explicit, TTE helps avoid common design flaws and methodological pitfalls in the analysis of non-randomised studies, keeping each step transparent and accessible. It provides a coherent framework that embeds existing analytical methods to minimise confounding and helps identify potential limitations of RWD and the extent to which these affect the HTA decision. This paper provides a broad overview of TTE and discusses the opportunities and challenges of using this approach in HTA. We describe the basic principles of trial emulation, outline some areas where TTE using RWD can help complement RCT evidence in HTA, identify potential barriers to its adoption in the HTA setting and highlight some priorities for future work.
Collapse
Affiliation(s)
- Manuel Gomes
- Department of Applied Health Research, University College London, London, UK.
| | - Nick Latimer
- School of Health and Related Research, University of Sheffield, Sheffield, UK
| | - Marta Soares
- Centre for Health Economics, University of York, York, UK
| | - Sofia Dias
- Centre for Reviews and Dissemination, University of York, York, UK
| | - Gianluca Baio
- Department of Statistical Science, University College London, London, UK
| | - Nick Freemantle
- Institute of Clinical Trials and Methodology, University College London, London, UK
| | - Dalia Dawoud
- Science, Policy and Research group, National Institute for Health and Care Excellence, London, UK
- Faculty of Pharmacy, Cairo University, Cairo, Egypt
| | - Allan Wailoo
- School of Health and Related Research, University of Sheffield, Sheffield, UK
| | - Richard Grieve
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
| |
Collapse
|