2
|
Hansford HJ, Cashin AG, Jones MD, Swanson SA, Islam N, Douglas SRG, Rizzo RRN, Devonshire JJ, Williams SA, Dahabreh IJ, Dickerman BA, Egger M, Garcia-Albeniz X, Golub RM, Lodi S, Moreno-Betancur M, Pearson SA, Schneeweiss S, Sterne JAC, Sharp MK, Stuart EA, Hernán MA, Lee H, McAuley JH. Reporting of Observational Studies Explicitly Aiming to Emulate Randomized Trials: A Systematic Review. JAMA Netw Open 2023; 6:e2336023. [PMID: 37755828 PMCID: PMC10534275 DOI: 10.1001/jamanetworkopen.2023.36023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Accepted: 08/22/2023] [Indexed: 09/28/2023] Open
Abstract
Importance Observational (nonexperimental) studies that aim to emulate a randomized trial (ie, the target trial) are increasingly informing medical and policy decision-making, but it is unclear how these studies are reported in the literature. Consistent reporting is essential for quality appraisal, evidence synthesis, and translation of evidence to policy and practice. Objective To assess the reporting of observational studies that explicitly aimed to emulate a target trial. Evidence Review We searched Medline, Embase, PsycINFO, and Web of Science for observational studies published between March 2012 and October 2022 that explicitly aimed to emulate a target trial of a health or medical intervention. Two reviewers double-screened and -extracted data on study characteristics, key predefined components of the target trial protocol and its emulation (eligibility criteria, treatment strategies, treatment assignment, outcome[s], follow-up, causal contrast[s], and analysis plan), and other items related to the target trial emulation. Findings A total of 200 studies that explicitly aimed to emulate a target trial were included. These studies included 26 subfields of medicine, and 168 (84%) were published from January 2020 to October 2022. The aim to emulate a target trial was explicit in 70 study titles (35%). Forty-three studies (22%) reported use of a published reporting guideline (eg, Strengthening the Reporting of Observational Studies in Epidemiology). Eighty-five studies (43%) did not describe all key items of how the target trial was emulated and 113 (57%) did not describe the protocol of the target trial and its emulation. Conclusion and Relevance In this systematic review of 200 studies that explicitly aimed to emulate a target trial, reporting of how the target trial was emulated was inconsistent. A reporting guideline for studies explicitly aiming to emulate a target trial may improve the reporting of the target trial protocols and other aspects of these emulation attempts.
Collapse
Affiliation(s)
- Harrison J. Hansford
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Aidan G. Cashin
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Matthew D. Jones
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Sonja A. Swanson
- Department of Epidemiology, University of Pittsburgh, Pittsburgh, Pennsylvania
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Nazrul Islam
- Oxford Population Health, Big Data Institute, University of Oxford, Oxford, United Kingdom
- Faculty of Medicine, University of Southampton, Southampton, United Kingdom
| | - Susan R. G. Douglas
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
| | - Rodrigo R. N. Rizzo
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Jack J. Devonshire
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Sam A. Williams
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| | - Issa J. Dahabreh
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Barbra A. Dickerman
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Matthias Egger
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
- Centre for Infectious Disease Epidemiology and Research, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa
- Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
| | - Xabier Garcia-Albeniz
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- RTI Health Solutions, Barcelona, Spain
| | - Robert M. Golub
- Department of Medicine, Northwestern University Feinberg School of Medicine, Chicago, Illinois
| | - Sara Lodi
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Boston University School of Public Health, Boston, Massachusetts
| | - Margarita Moreno-Betancur
- Clinical Epidemiology & Biostatistics Unit, Murdoch Children’s Research Institute, Royal Children’s Hospital, Parkville, Victoria, Australia
- Department of Paediatrics, The University of Melbourne, Parkville, Victoria, Australia
| | - Sallie-Anne Pearson
- School of Population Health, Faculty of Medicine and Health, UNSW Sydney, New South Wales, Australia
| | - Sebastian Schneeweiss
- Division of Pharmacoepidemiology, Department of Medicine, Brigham & Women’s Hospital, Harvard Medical School, Boston, Massachusetts
| | - Jonathan A. C. Sterne
- Department of Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, United Kingdom
- NIHR Bristol Biomedical Research Centre, Bristol, United Kingdom
- Health Data Research UK South-West, Bristol, United Kingdom
| | - Melissa K. Sharp
- Department of Public Health and Epidemiology, RCSI University of Medicine and Health Sciences, Dublin, Ireland
| | - Elizabeth A. Stuart
- Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
| | - Miguel A. Hernán
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, Massachusetts
| | - Hopin Lee
- University of Exeter Medical School, Exeter, United Kingdom
| | - James H. McAuley
- School of Health Sciences, Faculty of Medicine and Health, UNSW Sydney, Sydney, Australia
- Centre for Pain IMPACT, Neuroscience Research Australia, Sydney, Australia
| |
Collapse
|
3
|
Laurent T, Lambrelli D, Wakabayashi R, Hirano T, Kuwatsuru R. Strategies to Address Current Challenges in Real-World Evidence Generation in Japan. Drugs Real World Outcomes 2023:10.1007/s40801-023-00371-5. [PMID: 37178273 PMCID: PMC10182751 DOI: 10.1007/s40801-023-00371-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/19/2023] [Indexed: 05/15/2023] Open
Abstract
The generation of real-world evidence (RWE), which describes patient characteristics or treatment patterns using real-world data (RWD), is rapidly growing more popular as a tool for decision-making in Japan. The aim of this review was to summarize challenges to RWE generation in Japan related to pharmacoepidemiology, and to propose strategies to address some of these challenges. We first focused on data-related issues, including the lack of transparency of RWD sources, linkage across different care settings, definitions of clinical outcomes, and the overall assessment framework of RWD when used for research purposes. Next the study reviewed methodology-related challenges. As lack of design transparency impairs study reproducibility, transparent reporting of study design is critical for stakeholders. For this review, we considered different sources of biases and time-varying confounding, along with potential study design and methodological solutions. Additionally, the implementation of robust assessment of definition uncertainty, misclassification, and unmeasured confounders would enhance RWE credibility in light of RWD source-related limitations, and is being strongly considered by task forces in Japan. Overall, the development of guidance for best practices on data source selection, design transparency, and analytical methods to address different sources of biases and robustness in the process of RWE generation will enhance credibility for stakeholders and local decision-makers.
Collapse
Affiliation(s)
- Thomas Laurent
- Real-World Evidence and Data Assessment (READS), Graduate School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan
- Clinical Study Support Inc., 2F Daiei Bldg., 1-11-20 Nishiki Naka-ku, Nagoya, 460-0003, Japan
| | - Dimitra Lambrelli
- Real-World Evidence and Data Assessment (READS), Graduate School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan
- Real-World Evidence, Evidera, The Ark, 2nd Floor, 201 Talgarth Road, London, W6 8BJ, UK
| | - Ryozo Wakabayashi
- Real-World Evidence and Data Assessment (READS), Graduate School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan
- Clinical Study Support Inc., 2F Daiei Bldg., 1-11-20 Nishiki Naka-ku, Nagoya, 460-0003, Japan
| | - Takahiro Hirano
- Real-World Evidence and Data Assessment (READS), Graduate School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan.
- Clinical Study Support Inc., 2F Daiei Bldg., 1-11-20 Nishiki Naka-ku, Nagoya, 460-0003, Japan.
| | - Ryohei Kuwatsuru
- Real-World Evidence and Data Assessment (READS), Graduate School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan
- Department of Radiology, School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan
| |
Collapse
|