1
|
Sarri G, Hernandez LG. The maze of real-world evidence frameworks: from a desert to a jungle! An environmental scan and comparison across regulatory and health technology assessment agencies. J Comp Eff Res 2024; 13:e240061. [PMID: 39132748 DOI: 10.57264/cer-2024-0061] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/13/2024] Open
Abstract
Aim: Regulatory and health technology assessment (HTA) agencies have increasingly published frameworks, guidelines, and recommendations for the use of real-world evidence (RWE) in healthcare decision-making. Variations in the scope and content of these documents, with updates running in parallel, may create challenges for their implementation especially during the market authorization and reimbursement phases of a medicine's life cycle. This environmental scan aimed to comprehensively identify and summarize the guidance documents for RWE developed by most well-established regulatory and reimbursement agencies, as well as other organizations focused on healthcare decision-making, and present their similarities and differences. Methods: RWE guidance documents, including white papers from regulatory and HTA agencies, were reviewed in March 2024. Data on scope and recommendations from each body were extracted by two reviewers and similarities and differences were summarized across four topics: study planning, choosing fit-for-purpose data, study conduct, and reporting. Post-authorization or non-pharmacological guidance was excluded. Results: Forty-six documents were identified across multiple agencies; US FDA produced the most RWE-related guidance. All agencies addressed specific and often similar methodological issues related to study design, data fitness-for-purpose, reliability, and reproducibility, although inconsistency in terminologies on these topics was noted. Two HTA bodies (National Institute for Health and Care Excellence [NICE] and Canada's Drug Agency) each centralized all related RWE guidance under a unified framework. RWE quality tools and checklists were not consistently named and some differences in preferences were noted. European Medicines Agency, NICE, Haute Autorité de Santé, and the Institute for Quality and Efficiency in Health Care included specific recommendations on the use of analytical approaches to address RWE complexities and increase trust in its findings. Conclusion: Similarities in agencies' expectations on RWE studies design, quality elements, and reporting will facilitate evidence generation strategy and activities for manufacturers facing multiple, including global, regulatory and reimbursement submissions and re-submissions. A strong preference by decision-making bodies for local real-world data generation may hinder opportunities for data sharing and outputs from international federated data networks. Closer collaboration between decision-making agencies towards a harmonized RWE roadmap, which can be centrally preserved in a living mode, will provide manufacturers and researchers clarity on minimum acceptance requirements and expectations, especially as novel methodologies for RWE generation are rapidly emerging.
Collapse
Affiliation(s)
| | - Luis G Hernandez
- Global Pricing, Value & Access; Global Health Economics & US HEOR - Oncology, Takeda Pharmaceuticals America, Inc., Lexington, MA 02421, USA
| |
Collapse
|
2
|
Chang R, Chen HY, Hung YM, Huang JY, Wei JCC. Time-dependent risk of atopic dermatitis following nontyphoidal Salmonella infection. Postgrad Med J 2024; 100:649-656. [PMID: 38565127 DOI: 10.1093/postmj/qgae041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Revised: 02/18/2024] [Accepted: 03/06/2024] [Indexed: 04/04/2024]
Abstract
BACKGROUND The pathogenesis of atopic dermatitis (AD) remains unclear. Nontyphoidal Salmonella (NTS) infection might trigger immune-mediated reactions. We aimed to examine NTS and the risk of subsequent AD. METHODS From 2002 to 2015, eligible patients (aged 0-100 years) with NTS were identified. NTS and non-NTS groups were matched at a 1:10 ratio on age and sex. We utilized conditional multivariable Cox proportional hazard models to estimate the adjusted hazard ratio (aHR) and 95% confidence interval (CI) for AD development. Subgroup analyses were conducted based on age, sex, and severity of NTS infection. We utilized landmark analysis to explore the time-dependent hazard of AD following NTS. RESULTS In the NTS group (N = 6624), 403 developed AD. After full adjustment of demographics and comorbidities, the NTS group had a higher risk of AD than the reference group (aHR = 1.217, 95% CI = 1.096-1.352). Age-stratified analysis revealed that NTS group exhibited an elevated risk compared to the reference group, particularly among those aged 13-30 years (aHR = 1.25, 95% CI = 1.017-1.559), individuals aged 31-50 years (aHR = 1.388, 95% CI = 1.112-1.733), those aged 51-70 years (aHR = 1.301, 95% CI = 1.008-1.679), and individuals aged 71 years and over (aHR = 1.791, 95% CI = 1.260-2.545). Severe NTS was associated with a higher risk of AD than the reference group (aHR = 2.411, 95% CI = 1.577-3.685). Landmark analysis showed generally consistent findings. CONCLUSIONS Minimizing exposure to NTS infection may represent a prospective strategy for averting the onset and progression of atopic dermatitis.
Collapse
Affiliation(s)
- Renin Chang
- Department of Medical Education and Research, Kaohsiung Veterans General Hospital, Kaohsiung 81362, Taiwan
- Department of Emergency Medicine, Kaohsiung Veterans General Hospital, Kaohsiung 40201, Taiwan
- School of Medicine, Chung Shan Medical University, Taichung 95050, Taiwan
| | - Hui-Yuan Chen
- Institute of Medicine, Chung Shan Medical University, Taichung 40201, Taiwan
| | - Yao-Min Hung
- Division of Nephrology, Department of Internal Medicine, Taipei Veterans General Hospital Taitung Branch, 40201, Taiwan
| | - Jing-Yang Huang
- Institute of Medicine, Chung Shan Medical University, Taichung 40201, Taiwan
- Department of Medical Research, Chung Shan Medical University Hospital, Taichung 40201, Taiwan
| | - James Cheng-Chung Wei
- Institute of Medicine, Chung Shan Medical University, Taichung 40201, Taiwan
- Division of Allergy, Immunology and Rheumatology, Chung Shan Medical University Hospital, Taichung 40432, Taiwan
- Department of Nursing, Chung Shan Medical University, Taichung 40721, Taiwan
- Graduate Institute of Integrated Medicine, China Medical University, Taichung, Taiwan
| |
Collapse
|
3
|
Castanon A, Duffield S, Ramagopalan S, Reynolds R. Why is target trial emulation not being used in health technology assessment real-world data submissions? J Comp Eff Res 2024; 13:e240091. [PMID: 38850128 DOI: 10.57264/cer-2024-0091] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/09/2024] Open
Affiliation(s)
| | - Stephen Duffield
- National Institute of Health & Care Excellence, Manchester, M1 4BT, UK
| | | | | |
Collapse
|
4
|
Rand LZG, McGraw S, Wang J, Woloshin S, Wang SV, Darrow J, Kesselheim AS. Patient perspectives on evidence supporting drug safety and effectiveness: "What does it mean for me?". J Am Geriatr Soc 2024. [PMID: 38813805 DOI: 10.1111/jgs.19015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Revised: 04/22/2024] [Accepted: 04/29/2024] [Indexed: 05/31/2024]
Affiliation(s)
- Leah Z G Rand
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | | | - Junyi Wang
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Steven Woloshin
- The Dartmouth Institute, Geisel School of Medicine, Dartmouth, Hanover, New Hampshire, USA
- Lisa Schwartz Foundation for Truth in Medicine, Norwich, VT, USA
| | - Shirley V Wang
- Harvard Medical School, Boston, Massachusetts, USA
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
| | - Jonathan Darrow
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| | - Aaron S Kesselheim
- Program on Regulation, Therapeutics, and Law (PORTAL), Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Boston, Massachusetts, USA
- Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
5
|
Barkmeier AJ, Herrin J, Swarna KS, Deng Y, Polley EC, Umpierrez GE, Galindo RJ, Ross JS, Mickelson MM, McCoy RG. Comparative Effectiveness of Glucagon-Like Peptide-1 Receptor Agonists, Sodium-Glucose Cotransporter 2 Inhibitors, Dipeptidyl Peptidase-4 Inhibitors, and Sulfonylureas for Sight-Threatening Diabetic Retinopathy. Ophthalmol Retina 2024:S2468-6530(24)00229-X. [PMID: 38735641 DOI: 10.1016/j.oret.2024.05.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2024] [Revised: 04/24/2024] [Accepted: 05/06/2024] [Indexed: 05/14/2024]
Abstract
OBJECTIVE To investigate whether the choice of glucose-lowering agent for type 2 diabetes (T2D) impacts a patient's risk of developing sight-threatening diabetic retinopathy complications. DESIGN Retrospective observational database study emulating an idealized target trial. SUBJECTS Adult (≥21 years) enrollees in United States commercial, Medicare Advantage, and Medicare fee-for-service plans from January 1, 2014, to December 31, 2021, with T2D and moderate cardiovascular disease (CVD) risk who had no baseline history of advanced diabetic retinal complications, initiating treatment with glucagon-like peptide-1 receptor agonists (GLP-1 RA), sodium-glucose cotransporter 2 inhibitors (SGLT2i), dipeptidyl peptidase-4 inhibitors (DPP-4i), and sulfonylureas. METHODS We used inverse propensity scoring weights in time-to-event Cox proportional hazards models. MAIN OUTCOME MEASURES Treatment for either diabetic macular edema or proliferative diabetic retinopathy. RESULTS The final study population included 371 698 patients, of whom 42 265 initiated GLP-1 RA, 53 476 initiated SGLT2i, 78 444 initiated DPP-4i, and 197 513 initiated sulfonylurea agents. The probability of treatment for sight-threatening retinopathy within 2 and 5 years was 0.3% and 0.7% for patients initiating SGLT2i (median follow-up 830 [interquartile range (IQR), 343-1401] days), 0.4% and 1.0% for GLP-1 RA (669 [IQR, 256-1167] days), 0.4% and 0.9% for DPP-4i (1263 [IQR, 688-1938] days), and 0.5% and 1.2% for sulfonylurea (1223 [IQR, 662-1879] days). Sodium-glucose cotransporter 2 inhibitors use was associated with a lower risk of treatment for sight-threatening retinopathy compared with all other medication classes, including GLP-1 RA (hazard ratio [HR], 0.73; 95% confidence interval [CI], 0.55-0.97), DPP-4i (HR, 0.79; 95% CI, 0.64-0.97), and sulfonylurea (HR, 0.61; 95% CI, 0.50-0.74). Glucagon-like peptide-1 receptor agonists use was associated with a similar risk of sight-threatening retinopathy as DPP-4i (HR, 1.07; 95% CI, 0.85-1.35) and sulfonylurea (HR, 0.83; 95% CI, 0.67-1.03). CONCLUSIONS Sodium-glucose cotransporter 2 inhibitors use was associated with a lower risk of sight-threatening diabetic retinopathy among adults with T2D and moderate CVD risk compared with other glucose-lowering therapies. Glucagon-like peptide-1 receptor agonists do not confer increased retinal risk, relative to DPP-4i and sulfonylurea medications. FINANCIAL DISCLOSURE(S) Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
Collapse
Affiliation(s)
| | - Jeph Herrin
- Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut
| | - Kavya Sindhu Swarna
- Mayo Clinic Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Rochester, Minnesota; OptumLabs, Eden Prairie, Minnesota
| | - Yihong Deng
- Mayo Clinic Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Rochester, Minnesota; OptumLabs, Eden Prairie, Minnesota
| | - Eric C Polley
- Department of Public Health Sciences, the University of Chicago, Chicago, Illinois
| | - Guillermo E Umpierrez
- Division of Endocrinology, Department of Medicine, Emory University School of Medicine, Atlanta, Georgia
| | - Rodolfo J Galindo
- Division of Endocrinology, Department of Medicine, University of Miami Miller School of Medicine, Miami, Florida
| | - Joseph S Ross
- Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut; Department of Health Policy and Management, Yale School of Public Health, New Haven, Connecticut
| | - Mindy M Mickelson
- Mayo Clinic Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Rochester, Minnesota
| | - Rozalina G McCoy
- OptumLabs, Eden Prairie, Minnesota; Division of Endocrinology, Diabetes and Nutrition, Department of Medicine, University of Maryland School of Medicine, Baltimore, Maryland; Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore, Maryland; University of Maryland Institute for Health Computing, Bethesda, Maryland
| |
Collapse
|
6
|
Tarride JE, Okoh A, Aryal K, Prada C, Milinkovic D, Keepanasseril A, Iorio A. Scoping review of the recommendations and guidance for improving the quality of rare disease registries. Orphanet J Rare Dis 2024; 19:187. [PMID: 38711103 PMCID: PMC11075280 DOI: 10.1186/s13023-024-03193-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Accepted: 04/19/2024] [Indexed: 05/08/2024] Open
Abstract
BACKGROUND Rare disease registries (RDRs) are valuable tools for improving clinical care and advancing research. However, they often vary qualitatively, structurally, and operationally in ways that can determine their potential utility as a source of evidence to support decision-making regarding the approval and funding of new treatments for rare diseases. OBJECTIVES The goal of this research project was to review the literature on rare disease registries and identify best practices to improve the quality of RDRs. METHODS In this scoping review, we searched MEDLINE and EMBASE as well as the websites of regulatory bodies and health technology assessment agencies from 2010 to April 2023 for literature offering guidance or recommendations to ensure, improve, or maintain quality RDRs. RESULTS The search yielded 1,175 unique references, of which 64 met the inclusion criteria. The characteristics of RDRs deemed to be relevant to their quality align with three main domains and several sub-domains considered to be best practices for quality RDRs: (1) governance (registry purpose and description; governance structure; stakeholder engagement; sustainability; ethics/legal/privacy; data governance; documentation; and training and support); (2) data (standardized disease classification; common data elements; data dictionary; data collection; data quality and assurance; and data analysis and reporting); and (3) information technology (IT) infrastructure (physical and virtual infrastructure; and software infrastructure guided by FAIR principles (Findability; Accessibility; Interoperability; and Reusability). CONCLUSIONS Although RDRs face numerous challenges due to their small and dispersed populations, RDRs can generate quality data to support healthcare decision-making through the use of standards and principles on strong governance, quality data practices, and IT infrastructure.
Collapse
Affiliation(s)
- J E Tarride
- Department of Health Research Methods, Evidence and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Canada
- Centre for Health Economics and Policy Analysis (CHEPA), McMaster University, Hamilton, Canada
- Programs for the Assessment of Technologies in Health (PATH), The Research Institute of St. Joe's Hamilton, St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada
| | - A Okoh
- Department of Health Research Methods, Evidence and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Canada
| | - K Aryal
- Department of Health Research Methods, Evidence and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Canada
| | - C Prada
- Department of Health Research Methods, Evidence and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Canada
| | - Deborah Milinkovic
- Centre for Health Economics and Policy Analysis (CHEPA), McMaster University, Hamilton, Canada.
| | - A Keepanasseril
- Department of Health Research Methods, Evidence and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Canada
| | - A Iorio
- Department of Health Research Methods, Evidence and Impact, Faculty of Health Sciences, McMaster University, Hamilton, Canada
| |
Collapse
|
7
|
Gattellari M. Back to the Future: Observational Studies and Anticoagulant Selection for Nonvalvular Atrial Fibrillation. Stroke 2024; 55:1171-1173. [PMID: 38511348 DOI: 10.1161/strokeaha.124.046497] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/22/2024]
Affiliation(s)
- Melina Gattellari
- Department of Neurology, The Royal Prince Alfred Hospital, Camperdown, Australia
| |
Collapse
|
8
|
Castanon A, Bray BD, Ramagopalan SV. R WE ready for reimbursement? A round up of developments in real-world evidence relating to health technology assessment: part 15. J Comp Eff Res 2024; 13:e240033. [PMID: 38546012 PMCID: PMC11037032 DOI: 10.57264/cer-2024-0033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2024] [Accepted: 03/14/2024] [Indexed: 04/23/2024] Open
Abstract
In this latest update we discuss real-world evidence (RWE) guidance from the leading oncology professional societies, the American Society of Clinical Oncology and the European Society for Medical Oncology, and the PRINCIPLED practical guide on the design and analysis of causal RWE studies.
Collapse
Affiliation(s)
| | - Benjamin D Bray
- Lane Clark & Peacock LLP, London, W1U 1DQ, UK
- Department of Population Health Sciences, King's College London, SE1 9NH, UK
| | - Sreeram V Ramagopalan
- Lane Clark & Peacock LLP, London, W1U 1DQ, UK
- Centre for Pharmaceutical Medicine Research, King's College London, SE1 1UL, UK
| |
Collapse
|
9
|
Gini R, Pajouheshnia R, Gardarsdottir H, Bennett D, Li L, Gulea C, Wientzek-Fleischmann A, Bazelier MT, Burcu M, Dodd C, Durán CE, Kaplan S, Lanes S, Marinier K, Roberto G, Soman K, Zhou X, Platt R, Setoguchi S, Hall GC. Describing diversity of real world data sources in pharmacoepidemiologic studies: The DIVERSE scoping review. Pharmacoepidemiol Drug Saf 2024; 33:e5787. [PMID: 38724471 DOI: 10.1002/pds.5787] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2024] [Revised: 03/16/2024] [Accepted: 03/19/2024] [Indexed: 08/22/2024]
Abstract
PURPOSE Real-world evidence (RWE) is increasingly used for medical regulatory decisions, yet concerns persist regarding its reproducibility and hence validity. This study addresses reproducibility challenges associated with diversity across real-world data sources (RWDS) repurposed for secondary use in pharmacoepidemiologic studies. Our aims were to identify, describe and characterize practices, recommendations and tools for collecting and reporting diversity across RWDSs, and explore how leveraging diversity could improve the quality of evidence. METHODS In a preliminary phase, keywords for a literature search and selection tool were designed using a set of documents considered to be key by the coauthors. Next, a systematic search was conducted up to December 2021. The resulting documents were screened based on titles and abstracts, then based on full texts using the selection tool. Selected documents were reviewed to extract information on topics related to collecting and reporting RWDS diversity. A content analysis of the topics identified explicit and latent themes. RESULTS Across the 91 selected documents, 12 topics were identified: 9 dimensions used to describe RWDS (organization accessing the data source, data originator, prompt, inclusion of population, content, data dictionary, time span, healthcare system and culture, and data quality), tools to summarize such dimensions, challenges, and opportunities arising from diversity. Thirty-six themes were identified within the dimensions. Opportunities arising from data diversity included multiple imputation and standardization. CONCLUSIONS The dimensions identified across a large number of publications lay the foundation for formal guidance on reporting diversity of data sources to facilitate interpretation and enhance replicability and validity of RWE.
Collapse
Affiliation(s)
| | - Romin Pajouheshnia
- Division of Pharmacoepidemiology & Clinical Pharmacology, Utrecht University, Utrecht, The Netherlands
- Department of Epidemiology, RTI Health Solutions, Barcelona, Spain
| | - Helga Gardarsdottir
- Division of Pharmacoepidemiology & Clinical Pharmacology, Utrecht University, Utrecht, The Netherlands
- Department of Data Science & Biostatistics, University Medical Center Utrecht, Utrecht, The Netherlands
- University of Iceland, Reykjavik, Iceland
| | - Dimitri Bennett
- Takeda Development Center Americas, Cambridge, Massachusetts, USA
| | - Lin Li
- Epidemiology and Benefit Risk, Sanofi, Bridgewater, New Jersey, USA
| | - Claudia Gulea
- Center for Observational and Real-World Evidence, MSD, Zürich, Switzerland
| | | | - Marloes T Bazelier
- Division of Pharmacoepidemiology & Clinical Pharmacology, Utrecht University, Utrecht, The Netherlands
| | - Mehmet Burcu
- Department of Epidemiology, Merck & Co., Inc., Rahway, New Jersey, USA
| | | | - Carlos E Durán
- Department of Data Science & Biostatistics, University Medical Center Utrecht, Utrecht, The Netherlands
| | | | | | | | | | - Kanaka Soman
- Division of Pharmacoepidemiology & Clinical Pharmacology, Utrecht University, Utrecht, The Netherlands
| | - Xiaofeng Zhou
- Global Medical Epidemiology, Pfizer Inc. New York, USA
| | | | | | | |
Collapse
|
10
|
McCoy RG, Herrin J, Swarna KS, Deng Y, Kent DM, Ross JS, Umpierrez GE, Galindo RJ, Crown WH, Borah BJ, Montori VM, Brito JP, Neumiller JJ, Mickelson MM, Polley EC. Effectiveness of glucose-lowering medications on cardiovascular outcomes in patients with type 2 diabetes at moderate cardiovascular risk. NATURE CARDIOVASCULAR RESEARCH 2024; 3:431-440. [PMID: 38846711 PMCID: PMC11156225 DOI: 10.1038/s44161-024-00453-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Accepted: 02/22/2024] [Indexed: 06/09/2024]
Abstract
Cardiovascular disease (CVD) is the leading cause of death among people with type 2 diabetes1-5, most of whom are at moderate CVD risk6, yet there is limited evidence on the preferred choice of glucose-lowering medication for CVD risk reduction in this population. Here, we report the results of a retrospective cohort study where data for US adults with type 2 diabetes and moderate risk for CVD are used to compare the risks of experiencing a major adverse cardiovascular event with initiation of glucagon-like peptide-1 receptor agonists (GLP-1RA; n = 44,188), sodium-glucose cotransporter 2 inhibitors (SGLT2i; n = 47,094), dipeptidyl peptidase-4 inhibitors (DPP4i; n = 84,315) and sulfonylureas (n = 210,679). Compared to DPP4i, GLP-1RA (hazard ratio (HR) 0.87; 95% confidence interval (CI) 0.82-0.93) and SGLT2i (HR 0.85; 95% CI 0.81-0.90) were associated with a lower risk of a major adverse cardiovascular event, whereas sulfonylureas were associated with a higher risk (HR 1.19; 95% CI 1.16-1.22). Thus, GLP-1RA and SGLT2i may be the preferred glucose-lowering agents for cardiovascular risk reduction in patients at moderate baseline risk for CVD. ClinicalTrials.gov registration: NCT05214573.
Collapse
Affiliation(s)
- Rozalina G McCoy
- Division of Endocrinology, Diabetes, & Nutrition, Department of Medicine, University of Maryland School of Medicine, Baltimore, MD, USA
- University of Maryland Institute for Health Computing, Bethesda, MD, USA
- Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore, MD, USA
- OptumLabs, Eden Prairie, MN, USA
| | - Jeph Herrin
- Section of Cardiovascular Medicine, Yale School of Medicine, New Haven, CT, USA
| | - Kavya Sindhu Swarna
- OptumLabs, Eden Prairie, MN, USA
- Mayo Clinic Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Rochester, MN, USA
| | - Yihong Deng
- OptumLabs, Eden Prairie, MN, USA
- Mayo Clinic Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Rochester, MN, USA
| | - David M Kent
- Predictive Analytics and Comparative Effectiveness (PACE) Center, Institute for Clinical Research and Health Policy Studies, Tufts Medical Center, Boston, MA, USA
| | - Joseph S Ross
- Department of Internal Medicine, Yale School of Medicine, New Haven, CT, USA
- Department of Health Policy and Management, Yale School of Public Health, New Haven, CT, USA
| | - Guillermo E Umpierrez
- Division of Endocrinology, Department of Medicine, Emory University School of Medicine, Atlanta, GA, USA
| | - Rodolfo J Galindo
- Division of Endocrinology, Department of Medicine, University of Miami Miller School of Medicine, Miami, FL, USA
| | - William H Crown
- Florence Heller Graduate School, Brandeis University, Waltham, MA, USA
| | - Bijan J Borah
- Mayo Clinic Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Rochester, MN, USA
| | - Victor M Montori
- Division of Endocrinology, Department of Medicine, Mayo Clinic, Rochester, MN, USA
- Knowledge and Evaluation Research Unit, Mayo Clinic, Rochester, MN, USA
| | - Juan P Brito
- Division of Endocrinology, Department of Medicine, Mayo Clinic, Rochester, MN, USA
- Knowledge and Evaluation Research Unit, Mayo Clinic, Rochester, MN, USA
| | - Joshua J Neumiller
- Department of Pharmacotherapy, Washington State University, Spokane, WA, USA
- Providence Medical Research Center, Spokane, WA, USA
| | - Mindy M Mickelson
- Mayo Clinic Robert D. and Patricia E. Kern Center for the Science of Health Care Delivery, Rochester, MN, USA
| | - Eric C Polley
- Department of Public Health Sciences, University of Chicago, Chicago, IL, USA
| |
Collapse
|
11
|
Verkerk K, Voest EE. Generating and using real-world data: A worthwhile uphill battle. Cell 2024; 187:1636-1650. [PMID: 38552611 DOI: 10.1016/j.cell.2024.02.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 01/04/2024] [Accepted: 02/09/2024] [Indexed: 04/02/2024]
Abstract
The precision oncology paradigm challenges the feasibility and data generalizability of traditional clinical trials. Consequently, an unmet need exists for practical approaches to test many subgroups, evaluate real-world drug value, and gather comprehensive, accessible datasets to validate novel biomarkers. Real-world data (RWD) are increasingly recognized to have the potential to fill this gap in research methodology. Established applications of RWD include informing disease epidemiology, pharmacovigilance, and healthcare quality assessment. Currently, concerns regarding RWD quality and comprehensiveness, privacy, and biases hamper their broader application. Nonetheless, RWD may play a pivotal role in supplementing clinical trials, enabling conditional reimbursement and accelerated drug access, and innovating trial conduct. Moreover, purpose-built RWD repositories may support the extension or refinement of drug indications and facilitate the discovery and validation of new biomarkers. This perspective explores the potential of leveraging RWD to advance oncology, highlights its benefits and challenges, and suggests a path forward in this evolving field.
Collapse
Affiliation(s)
- K Verkerk
- Department of Molecular Oncology & Immunology, The Netherlands Cancer Institute, Amsterdam, the Netherlands; Oncode Institute, Utrecht, the Netherlands
| | - E E Voest
- Department of Molecular Oncology & Immunology, The Netherlands Cancer Institute, Amsterdam, the Netherlands; Oncode Institute, Utrecht, the Netherlands; Netherlands Cancer Institute, Plesmanlaan 121, Amsterdam 1066 CX, the Netherlands.
| |
Collapse
|
12
|
Ramsey SD, Onar-Thomas A, Wheeler SB. Real-World Database Studies in Oncology: A Call for Standards. J Clin Oncol 2024; 42:977-980. [PMID: 38320235 DOI: 10.1200/jco.23.02399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2023] [Accepted: 11/30/2023] [Indexed: 02/08/2024] Open
|
13
|
Muntner P, Hernandez RK, Kent ST, Browning JE, Gilbertson DT, Hurwitz KE, Jick SS, Lai EC, Lash TL, Monda KL, Rothman KJ, Bradbury BD, Brookhart MA. Staging and clean room: Constructs designed to facilitate transparency and reduce bias in comparative analyses of real-world data. Pharmacoepidemiol Drug Saf 2024; 33:e5770. [PMID: 38419140 DOI: 10.1002/pds.5770] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2023] [Revised: 01/29/2024] [Accepted: 01/30/2024] [Indexed: 03/02/2024]
Abstract
PURPOSE We describe constructs designed to protect the integrity of the results from comparative analyses using real-world data (RWD): staging and clean room. METHODS Staging involves performing sequential preliminary analyses and evaluating the population size available and potential bias before conducting comparative analyses. A clean room involves restricted access to data and preliminary results, policies governing exploratory analyses and protocol deviations, and audit trail. These constructs are intended to allow decisions about protocol deviations, such as changes to design or model specification, to be made without knowledge of how they might affect subsequent analyses. We describe an example for implementing staging with a clean room. RESULTS Stage 1 may involve selecting a data source, developing and registering a protocol, establishing a clean room, and applying inclusion/exclusion criteria. Stage 2 may involve attempting to achieve covariate balance, often through propensity score models. Stage 3 may involve evaluating the presence of residual confounding using negative control outcomes. After each stage, check points may be implemented when a team of statisticians, epidemiologists and clinicians masked to how their decisions may affect study outcomes, reviews the results. This review team may be tasked with making recommendations for protocol deviations to address study precision or bias. They may recommend proceeding to the next stage, conducting additional analyses to address bias, or terminating the study. Stage 4 may involve conducting the comparative analyses. CONCLUSIONS The staging and clean room constructs are intended to protect the integrity and enhance confidence in the results of analyses of RWD.
Collapse
Affiliation(s)
- Paul Muntner
- Department of Epidemiology, School of Public Health, University of Alabama at Birmingham, Birmingham, Alabama, USA
| | - Rohini K Hernandez
- Center for Observational Research, Amgen Inc., Thousand Oaks, California, USA
| | - Shia T Kent
- Center for Observational Research, Amgen Inc., Thousand Oaks, California, USA
| | - James E Browning
- Center for Observational Research, Amgen Inc., Thousand Oaks, California, USA
| | - David T Gilbertson
- Chronic Disease Research Group, Hennepin Healthcare Research Institute, Minneapolis, Minnesota, USA
| | | | - Susan S Jick
- Boston Collaborative Drug Surveillance Program, Boston University School of Public Health, Boston, Massachusetts, USA
| | - Edward C Lai
- School of Pharmacy, Institute of Clinical Pharmacy and Pharmaceutical Sciences, College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Timothy L Lash
- Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, USA
| | - Keri L Monda
- Center for Observational Research, Amgen Inc., Thousand Oaks, California, USA
| | - Kenneth J Rothman
- RTI Health Solutions, Research Triangle Institute, Research Triangle Park, North Carolina, USA
- Department of Epidemiology, Boston University School of Public Health, Boston, Massachusetts, USA
| | - Brian D Bradbury
- Center for Observational Research, Amgen Inc., Thousand Oaks, California, USA
| | - M Alan Brookhart
- Department of Population Health Sciences, Duke University, Durham, North Carolina, USA
| |
Collapse
|
14
|
Hwang YJ, Chang HY, Metkus T, Andersen KM, Singh S, Alexander GC, Mehta HB. Risk of Major Bleeding Associated with Concomitant Direct-Acting Oral Anticoagulant and Clopidogrel Use: A Retrospective Cohort Study. Drug Saf 2024; 47:251-260. [PMID: 38141156 PMCID: PMC10942724 DOI: 10.1007/s40264-023-01388-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/29/2023] [Indexed: 12/24/2023]
Abstract
BACKGROUND AND AIM Combined anticoagulant-antiplatelet therapy is often indicated in adults with cardiovascular disease and atrial fibrillation or venous thromboembolism. The study aim was to assess the comparative risk of bleeding between rivaroxaban and apixaban when combined with clopidogrel. METHODS We conducted a retrospective cohort study of commercially insured US adults newly treated with a combination of rivaroxaban+clopidogrel or apixaban+clopidogrel (2015-2018) using Merative™ Marketscan Research Databases. We used propensity score-based inverse probability of treatment weighting (IPTW) to balance the treatment groups. Weighted Cox proportional hazards regression was used to estimate the risk of major bleeding. RESULTS The study cohort included 2895 rivaroxaban+clopidogrel users and 3628 apixaban+clopidogrel users. The median (range) duration of follow up was 61 (73) days. Rivaroxaban+clopidogrel users had a similar risk of major bleeding compared with apixaban+clopidogrel users (IPTW incidence rate per 100 person-years 7.96 vs 7.38; IPTW hazard ratio [HR] 1.13 [95% CI 0.78-1.63]). In the subcohort of adults who were treated with DOAC or clopidogrel monotherapy prior to the combined therapy, the risk of major bleeding did not differ by the drug of monotherapy (IPTW HR for rivaroxaban+clopidogrel group: 0.66 [95% CI 0.33-1.32]; IPTW HR for apixaban+clopidogrel group: 1.10 [95% CI 0.55-2.23]) CONCLUSIONS: In our study of commercially insured US adults, the concomitant use of rivaroxaban+clopidogrel and apixaban+clopidogrel conferred a similar risk of major bleeding. DOAC versus clopidogrel monotherapy prior to the concomitant therapy did not influence the risk of major bleeding.
Collapse
Affiliation(s)
- Y Joseph Hwang
- Center for Drug Safety and Effectiveness, Johns Hopkins University, Baltimore, MD, USA.
- Division of General Internal Medicine, Department of Medicine, Johns Hopkins University, 2024 E. Monument Street, 2-300A, Baltimore, MD, 21287, USA.
| | - Hsien-Yen Chang
- Department of Health Policy and Management, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
- Janssen Scientific Affairs LLC, Titusville, NJ, USA
| | - Thomas Metkus
- Divisions of Cardiology and Cardiac Surgery, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Kathleen M Andersen
- Center for Drug Safety and Effectiveness, Johns Hopkins University, Baltimore, MD, USA
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Sonal Singh
- UMass Chan Medical School, Worcester, MA, USA
| | - G Caleb Alexander
- Center for Drug Safety and Effectiveness, Johns Hopkins University, Baltimore, MD, USA
- Division of General Internal Medicine, Department of Medicine, Johns Hopkins University, 2024 E. Monument Street, 2-300A, Baltimore, MD, 21287, USA
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Hemalkumar B Mehta
- Center for Drug Safety and Effectiveness, Johns Hopkins University, Baltimore, MD, USA
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| |
Collapse
|
15
|
Desai RJ, Wang SV, Sreedhara SK, Zabotka L, Khosrow-Khavar F, Nelson JC, Shi X, Toh S, Wyss R, Patorno E, Dutcher S, Li J, Lee H, Ball R, Dal Pan G, Segal JB, Suissa S, Rothman KJ, Greenland S, Hernán MA, Heagerty PJ, Schneeweiss S. Process guide for inferential studies using healthcare data from routine clinical practice to evaluate causal effects of drugs (PRINCIPLED): considerations from the FDA Sentinel Innovation Center. BMJ 2024; 384:e076460. [PMID: 38346815 DOI: 10.1136/bmj-2023-076460] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/15/2024]
Affiliation(s)
- Rishi J Desai
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02120, USA
| | - Shirley V Wang
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02120, USA
| | - Sushama Kattinakere Sreedhara
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02120, USA
| | - Luke Zabotka
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02120, USA
| | - Farzin Khosrow-Khavar
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02120, USA
| | - Jennifer C Nelson
- Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA
| | - Xu Shi
- Department of Biostatistics, University of Michigan, Ann Arbor, MI, USA
| | - Sengwee Toh
- Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, MA, USA
| | - Richard Wyss
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02120, USA
| | - Elisabetta Patorno
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02120, USA
| | - Sarah Dutcher
- US Food and Drug Administration, Silver Spring, MD, USA
| | - Jie Li
- US Food and Drug Administration, Silver Spring, MD, USA
| | - Hana Lee
- US Food and Drug Administration, Silver Spring, MD, USA
| | - Robert Ball
- US Food and Drug Administration, Silver Spring, MD, USA
| | | | - Jodi B Segal
- Department of Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Samy Suissa
- Departments of Epidemiology and Biostatistics, and Medicine, McGill University, Montreal, QC, Canada
| | | | - Sander Greenland
- Department of Epidemiology and Department of Statistics, University of California, Los Angeles, CA, USA
| | - Miguel A Hernán
- CAUSALab and Departments of Epidemiology and Biostatistics, Harvard T H Chan School of Public Health, Boston, MA, USA
| | | | - Sebastian Schneeweiss
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, MA 02120, USA
| |
Collapse
|
16
|
Perreault S, Boivin Proulx LA, Brouillette J, Jarry S, Dorais M. Antipsychotics and Risks of Cardiovascular and Cerebrovascular Diseases and Mortality in Dwelling Community Older Adults. Pharmaceuticals (Basel) 2024; 17:178. [PMID: 38399393 PMCID: PMC10892683 DOI: 10.3390/ph17020178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 01/24/2024] [Accepted: 01/26/2024] [Indexed: 02/25/2024] Open
Abstract
This study aims to investigate the effect of antipsychotic agents on cardiovascular and cerebrovascular diseases (CVD/CEV) and mortality risks in the older population living in a community. A cohort of 42,650 new users of antipsychotic agents was built using Quebec healthcare databases (1998-2011). The outcomes were CVD/CEV and mortality incidence in 5 years of follow-up in the total cohort, sub-cohort of patients with no schizophrenia/dementia, sub-cohort with schizophrenia, and sub-cohort with dementia. Comparisons were made between the new users who continued the treatment (adherent level ≥ 60%) vs. those ceasing treatment (adherence level < 60%) using inverse probability of treatment weighting and Cox models. Comparing high adherence vs. low levels, CVD/CEV risk was increased by 36% in the sub-cohort with schizophrenia for atypical antipsychotic users and by 25% in the sub-cohort with dementia for typical antipsychotic users. An increasing mortality risk of 2- to 3-fold was linked with the typical antipsychotic use in all cohorts except the sub-cohort with schizophrenia; in addition, mortality risk is linked with the use of high vs. low doses. Antipsychotics were not linked with CVD/CEV risk, except for atypical antipsychotics in patients with schizophrenia and typical antipsychotics in patients with dementia. The mortality risk was linked with the use of typical antipsychotics and the dose used.
Collapse
Affiliation(s)
- Sylvie Perreault
- Faculty of Pharmacy, Université de Montréal, Montreal, QC H3C 3J7, Canada
- Centre de Recherche en Santé Publique (CReSP), Partenaire CIUSSS du Centre-Sud-de-l’Île-de-Montréal et l’Université de Montréal, Montreal, QC H3L 1M3, Canada
| | - Laurie-Anne Boivin Proulx
- Department of Cardiology, Faculty of Medicine, University of Ottawa Heart Institute, Ottawa, ON K1Y 4W7, Canada;
| | - Judith Brouillette
- Department of Psychiatry and Addictology, Université de Montréal, Montreal, QC H3L 1M3, Canada;
| | - Stéphanie Jarry
- Department of Anesthesiology, Montreal Heart Institute, Université de Montréal, Montreal, QC H3L 1M3, Canada;
| | - Marc Dorais
- StatSciences Inc., Notre-Dame-de-l’Île-Perrot, QC H3L 1M3, Canada;
| |
Collapse
|
17
|
Weberpals J, Wang SV. The FAIRification of research in real-world evidence: A practical introduction to reproducible analytic workflows using Git and R. Pharmacoepidemiol Drug Saf 2024; 33:e5740. [PMID: 38173166 DOI: 10.1002/pds.5740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 11/29/2023] [Accepted: 11/30/2023] [Indexed: 01/05/2024]
Abstract
Transparency and reproducibility are major prerequisites for conducting meaningful real-world evidence (RWE) studies that are fit for decision-making. Many advances have been made in the documentation and reporting of study protocols and results, but the principles for version control and sharing of analytic code in RWE are not yet as established as in other quantitative disciplines like computational biology and health informatics. In this practical tutorial, we aim to give an introduction to distributed version control systems (VCS) tailored toward the FAIR (Findable, Accessible, Interoperable, and Reproducible) implementation of RWE studies. To ease adoption, we provide detailed step-by-step instructions with practical examples on how the Git VCS and R programming language can be implemented into RWE study workflows to facilitate reproducible analyzes. We further discuss and showcase how these tools can be used to track changes, collaborate, disseminate, and archive RWE studies through dedicated project repositories that maintain a complete audit trail of all relevant study documents.
Collapse
Affiliation(s)
- Janick Weberpals
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Shirley V Wang
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
18
|
White R. Building trust in real world evidence (RWE): moving transparency in RWE towards the randomized controlled trial standard. Curr Med Res Opin 2023; 39:1737-1741. [PMID: 37787381 DOI: 10.1080/03007995.2023.2263353] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Accepted: 09/22/2023] [Indexed: 10/04/2023]
Abstract
The increasing use of RWE in regulatory and reimbursement decision-making indicates the significant progress that has been made in building trust in RWE through greater transparency. This review of the published literature and key online sources was conducted to provide an update on progress towards greater transparency in RWE, based on four key barriers to trust identified in a 2016 paper and applying learnings from transparency initiatives established for RCTs, such as the US FDA Amendments Act (FDAAA) 2007 Final Rule. Multiple initiatives from the US FDA, EMA and organizations such as the ISPOR-ISPE Joint Task Force have yielded new guidance documents and tools that enable greater transparency in RWE study methodology (STaRT-RWE and HARPER templates), data source selection and quality (SPIFD2 framework, REQueST tool), strategy (the Center for Open Science RWE Study Registry), and will therefore improve transparency in RWE study reporting. Programs such as the REPEAT Initiative and RWE DUPLICATE are investigating reproducibility of RWE studies and improving understanding of the circumstances when valid inference on treatment effects can be obtained from RWE studies. Further work is needed to embed and to implement the new tools and guidance that are available, and thus raise standards for RWE transparency towards the levels expected for RCTs.
Collapse
Affiliation(s)
- Richard White
- Oxford PharmaGenesis, Oxford, UK
- Green Templeton College, University of Oxford, Oxford, UK
| |
Collapse
|
19
|
Smith DM, Minichmayr IK, Standing JF, Giacomini KM, van der Graaf PH, Peck RW. Ensuring Transparency and Quality of Clinical Trial Reporting in Clinical Pharmacology & Therapeutics: Prospective Trial Registration and Compliance with Reporting Guidelines Are Required for all Clinical Trials. Clin Pharmacol Ther 2023; 114:1153-1157. [PMID: 37971383 DOI: 10.1002/cpt.3070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2023] [Accepted: 10/02/2023] [Indexed: 11/19/2023]
Affiliation(s)
- D Max Smith
- MedStar Health, Columbia, Maryland, USA
- Department of Oncology, Georgetown University Medical Center, Washington, DC, USA
| | - Iris K Minichmayr
- Department of Clinical Pharmacology, Medical University of Vienna, Vienna, Austria
| | - Joseph F Standing
- Great Ormond Street Institute of Child Health, University College London, London, UK
- Department of Pharmacy, Great Ormond Street Hospital for Children, London, UK
| | - Kathleen M Giacomini
- Department of Bioengineering and Therapeutic Sciences, University of California San Francisco, San Francisco, California, USA
| | | | - Richard W Peck
- Department of Pharmacology & Therapeutics, University of Liverpool, Liverpool, UK
- Pharma Research & Development (pRED), Roche innovation Center, Basel, Switzerland
| |
Collapse
|
20
|
Thakur S. Real-World Evidence Studies in Oncology Therapeutics: Hope or Hype? Indian J Surg Oncol 2023; 14:829-835. [PMID: 38187834 PMCID: PMC10767035 DOI: 10.1007/s13193-023-01784-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2022] [Accepted: 06/12/2023] [Indexed: 01/09/2024] Open
Abstract
Randomized controlled trial (RCT) remains a gold standard in evidence-based medicine for assessing the efficacy and safety of cancer therapies. However, due to some inherent methodological limitations of RCT, such as stringent inclusion criteria, highly specific treatment, ethical and scientific compromise in rare cancer, and inability to adequately assess safety, real-world evidence (RWE) has been adjudged as a suitable option to complement data obtained from RCT. Moreover, in the context of cancer therapeutics, few notable merits pertain to developing a novel product for rare cancer subtypes, establishing new indications for already approved drugs, optimization of treatment regimen and sequence, a better description of long-term safety, and supporting the reimbursement-related decision. However, the implementation of RWE for the aforementioned purposes will be limited by various challenges, especially in the context of developing economies such as India. Special attention should be given to the availability of data, maintaining the quality standard, and establishing stringent regulations for privacy and security along with active regulatory engagement with relevant stakeholders. Such activities will be key to facilitating the use of RWE in cancer therapeutics.
Collapse
Affiliation(s)
- Sayanta Thakur
- Department of Pharmacology, MJNMC&H, Vivekananda Street, Pilkhana, Cooch Behar 736101 India
| |
Collapse
|
21
|
Lee YS, Lee YJ, Ha IH. Real-world data analysis on effectiveness of integrative therapies: A practical guide to study design and data analysis using healthcare databases. Integr Med Res 2023; 12:101000. [PMID: 37953753 PMCID: PMC10637915 DOI: 10.1016/j.imr.2023.101000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 10/17/2023] [Accepted: 10/18/2023] [Indexed: 11/14/2023] Open
Abstract
Real world data (RWD) is increasingly used to investigate health outcomes and treatment efficacy in the field of integrative medicine. Due to the fact that the majority of RWDs are not intended for research, their secondary use in research necessitates complex study designs to account for bias and confounding. To conduct a robust analysis of RWD in integrative medicine, a comprehensive study design process that reflects the characteristics of integrative therapies is necessary. In this paper, we present a guide for designing comparative effectiveness RWE research in integrative medicine. We discuss key factors to consider when selecting RWDs for research on integrative medicine. We provide practical steps for developing a research question, formulating the PICOT objectives (population, intervention, comparator, outcome, and time horizon), and selecting and defining covariates with a summary table. Specific study designs are depicted with corresponding diagrams. Finally, data analysis procedures are introduced. We hope this article clarifies the importance of RWE research design and related processes in order to improve the rigor of RWD studies in the field of integrative medicine research.
Collapse
Affiliation(s)
- Ye-Seul Lee
- Jaseng Spine and Joint Research Institute, Jaseng Medical Foundation, Seoul, Korea
| | - Yoon Jae Lee
- Jaseng Spine and Joint Research Institute, Jaseng Medical Foundation, Seoul, Korea
| | - In-Hyuk Ha
- Jaseng Spine and Joint Research Institute, Jaseng Medical Foundation, Seoul, Korea
| |
Collapse
|
22
|
Castelo-Branco L, Pellat A, Martins-Branco D, Valachis A, Derksen JWG, Suijkerbuijk KPM, Dafni U, Dellaporta T, Vogel A, Prelaj A, Groenwold RHH, Martins H, Stahel R, Bliss J, Kather J, Ribelles N, Perrone F, Hall PS, Dienstmann R, Booth CM, Pentheroudakis G, Delaloge S, Koopman M. ESMO Guidance for Reporting Oncology real-World evidence (GROW). Ann Oncol 2023; 34:1097-1112. [PMID: 37848160 DOI: 10.1016/j.annonc.2023.10.001] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Revised: 09/28/2023] [Accepted: 10/04/2023] [Indexed: 10/19/2023] Open
Affiliation(s)
- L Castelo-Branco
- Scientific and Medical Division, European Society for Medical Oncology (ESMO), Lugano, Switzerland.
| | - A Pellat
- Department of Gastroenterology and Digestive Oncology, Hôpital Cochin AP-HP, Université Paris Cité, Paris; Centre d'Épidémiologie Clinique, Hôtel Dieu, Paris, France
| | - D Martins-Branco
- Scientific and Medical Division, European Society for Medical Oncology (ESMO), Lugano, Switzerland; Université Libre de Bruxelles (ULB), Hôpital Universitaire de Bruxelles (HUB), Institut Jules Bordet, Academic Trials Promoting Team (ATPT), Brussels, Belgium
| | - A Valachis
- Department of Oncology, Faculty of Medicine and Health, Örebro University Hospital, Örebro University, Örebro, Sweden
| | - J W G Derksen
- Julius Center for Health Sciences and Primary Care, Department of Epidemiology and Health Economics, University Medical Centre Utrecht, Utrecht University, Utrecht
| | - K P M Suijkerbuijk
- Department of Medical Oncology, University Medical Centre Utrecht, Utrecht University, Utrecht, The Netherlands
| | - U Dafni
- Laboratory of Biostatistics, Department of Nursing, National and Kapodistrian University of Athens, Athens; Frontier Science Foundation Hellas, Athens, Greece
| | - T Dellaporta
- Frontier Science Foundation Hellas, Athens, Greece
| | - A Vogel
- Department of Gastroenterology, Hepatology and Endocrinology, Medical School of Hannover, Hannover, Germany; Toronto Center of Liver Disease, Toronto General Hospital, University Health Network, Toronto; Princess Margaret Cancer Centre, University of Toronto, Toronto, Canada
| | - A Prelaj
- AI-ON-Lab, Medical Oncology Department, Fondazione IRCCS Istituto Nazionale Tumori, Milan; NEARLab, Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| | - R H H Groenwold
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - H Martins
- Business Research Unit, ISCTE Business School, ISCTE-IUL, Lisbon, Portugal
| | - R Stahel
- ETOP IBCSG Partners Foundation, Berne, Switzerland
| | - J Bliss
- ICR-CTSU, Division of Clinical Studies, The Institute of Cancer Research, London, UK
| | - J Kather
- Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden; Medical Oncology, National Center for Tumor Diseases, University Hospital Heidelberg, Heidelberg, Germany
| | - N Ribelles
- Medical Oncology Intercenter Unit, Regional and Virgen de la Victoria University Hospitals, IBIMA, Málaga, Spain
| | - F Perrone
- Clinical Trial Unit, Istituto Nazionale Tumori IRCCS Fondazione G. Pascale, Naples, Italy
| | - P S Hall
- Institute of Genetics and Cancer, University of Edinburgh, Edinburgh, UK
| | - R Dienstmann
- Oncoclinicas Precision Medicine, Oncoclinicas Group, São Paulo, Brazil; Oncology Data Science Group, Vall d'Hebron Institute of Oncology, Barcelona, Spain
| | - C M Booth
- Department of Oncology; Department of Public Health Sciences, Queen's University, Kingston, Canada
| | - G Pentheroudakis
- Scientific and Medical Division, European Society for Medical Oncology (ESMO), Lugano, Switzerland
| | - S Delaloge
- Department of Cancer Medicine, Gustave Roussy, Villejuif, France
| | - M Koopman
- Department of Medical Oncology, University Medical Centre Utrecht, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
23
|
Acha V, Barefoot B, Juarez Garcia A, Lehner V, Monno R, Sandler S, Spooner A, Verpillat P. Principles for Good Practice in the Conduct of Non-interventional Studies: The View of Industry Researchers. Ther Innov Regul Sci 2023; 57:1199-1208. [PMID: 37460826 PMCID: PMC10579109 DOI: 10.1007/s43441-023-00544-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2022] [Accepted: 06/02/2023] [Indexed: 10/17/2023]
Abstract
This reflection paper presents a consolidated view of EFPIA on the need for principles for good practice in the generation and use of non-interventional studies (NIS), including overarching principles such as the registration of hypothesis evaluating treatment effect (HETE) studies. We first define NIS and the important adjacencies to clinical trials and relationship with real-world evidence (RWE). We then outline the principles for good practice with respect to appropriate research design, study protocol, fit-for-purpose variables and data quality, analytical methods, bias reduction, transparency in conduct and use, privacy management and ethics review. We conclude with recommendations for action for the research community to promote trust and credibility in the use of NIS.
Collapse
|
24
|
Campbell UB, Honig N, Gatto NM. SURF: A Screening Tool (for Sponsors) to Evaluate Whether Using Real-World Data to Support an Effectiveness Claim in an FDA Application Has Regulatory Feasibility. Clin Pharmacol Ther 2023; 114:981-993. [PMID: 37550832 DOI: 10.1002/cpt.3021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Accepted: 07/24/2023] [Indexed: 08/09/2023]
Abstract
Based on recent guidance and publicly available approvals, the US Food and Drug Administration (FDA) has demonstrated its openness to considering evidence of effectiveness from real-world data (RWD) and nonrandomized studies (or "real-world evidence (RWE)") in its decision making. Through analysis of the FDA approvals, several authors have identified methodologic issues commonly discussed by FDA reviewers. However, in our analysis of FDA guidance and use cases, acceptability of RWE also critically depends on whether the characteristics of the clinical development program align with circumstances in which the FDA may have flexibility in considering evidence from real-world study designs relative to more robust designs. Successful use of RWD requires advance planning to allocate the necessary resources and time to undertake principled epidemiology approaches to study design, data selection, and implementation of analyses as well as address regulatory feedback. Thus, sponsors benefit from early identification of programs in which successful RWD use is more likely, to ensure efficient use of resources required for the next steps of scientific feasibility assessment. We developed SURF, a screening tool intended to help a sponsor decide whether to prioritize resources for further exploring the feasibility of using an RWD approach to meet the FDA's effectiveness evidentiary standards for a particular clinical development program. Here, we provide an analysis of FDA guidance, highlighting the circumstances in which RWD approaches may be most acceptable, and demonstrate the use of this screening tool, including the rationale for its construction, types of evidence needed, and application to publicly available approvals as support of concept.
Collapse
Affiliation(s)
- Ulka B Campbell
- Aetion, Inc., New York, New York, USA
- Columbia Mailman School of Public Health, New York, New York, USA
| | | | - Nicolle M Gatto
- Aetion, Inc., New York, New York, USA
- Columbia Mailman School of Public Health, New York, New York, USA
- Tulane School of Public Health and Tropical Medicine, New Orleans, Louisiana, USA
| |
Collapse
|
25
|
Hettle R, Mihai A, Lang SH, Tatman S, Swift SL. Real-world outcomes for first line next-generation hormonal agents in metastatic prostate cancer: a systematic review. Future Oncol 2023; 19:2425-2443. [PMID: 37681288 DOI: 10.2217/fon-2023-0377] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/09/2023] Open
Abstract
Aim: This review aims to summarize published evidence on the real-world (RW) outcomes of abiraterone or enzalutamide in first-line metastatic castration-resistant prostate cancer. Materials & methods: Studies reporting on RW effectiveness, safety, economic and/or health-related quality of life outcomes were identified by systematic literature review (2011-2021, incl. Embase®, MEDLINE®) and presented in a qualitative synthesis. Risk of bias was assessed using ROBINS-I or the Molinier checklist. Results: 88 studies (n = 83,427 patients) were included. Median progression-free (40 studies) and overall survival (38 studies) ranged from 3.7 to 20.9 months and 9.8 to 45 months, respectively. Survival, safety and economic outcomes were similar across individual treatments, while limited health-related quality of life evidence suggested improvements with abiraterone. Risk of bias was moderate to high. Conclusion: RW outcomes in first-line metastatic castration-resistant prostate cancer remain poor despite treatment, highlighting an unmet need for new regimens. This review was supported by AstraZeneca and Merck Sharp & Dohme.
Collapse
Affiliation(s)
- Robert Hettle
- Payer Simulation & Analytics, Oncology Market Access and Pricing, AstraZeneca, Cambridge, Cambridgeshire, CB2 8PA, UK
| | - Adela Mihai
- Health Economics & Payer Evidence, Oncology Market Access and Pricing, AstraZeneca, Cambridge, Cambridgeshire, CB2 8PA, UK
| | - Shona H Lang
- Mtech Access, York, North Yorkshire, YO10 5NY, UK
| | | | | |
Collapse
|
26
|
Farrington AD, Frøstrup AG, Dahl P. The Value and Deliverables of Medical Affairs: Affiliate Perspectives and Future Expectations. Pharmaceut Med 2023; 37:417-424. [PMID: 37789114 PMCID: PMC10587308 DOI: 10.1007/s40290-023-00501-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/30/2023] [Indexed: 10/05/2023]
Abstract
The Medical Affairs (MA) function in pharmaceutical companies creates a unique opportunity to ensure the internal linkage between Research & Development (R&D) and Commercial/Marketing functions, in addition to managing external scientific engagements with multiple stakeholders across life-science ecosystems. In recognition of the strategic value of MA, the objective of this paper is to share a comprehensive set of practical examples of the main deliverables within the MA function in the affiliate and align these with the two distinct phases; pre- and post-launch, respectively. We believe that an information gap currently exists in the available literature on these matters addressing practical aspects and examples beyond visionary, strategic thinking. Based on this contribution, further opportunities within MA can be discussed. In addition, we share our thoughts and considerations on future advancements in the role.
Collapse
Affiliation(s)
| | | | - Palle Dahl
- AstraZeneca A/S, Medical Affairs, Copenhagen, Denmark
| |
Collapse
|
27
|
Corace K, Thavorn K, Suschinsky K, Willows M, Leece P, Kahan M, Nijmeh L, Aubin N, Roach M, Garner G, Saskin R, Kim E, Rice D, Taha S, Garber G, Hutton B. Rapid Access Addiction Medicine Clinics for People With Problematic Opioid Use. JAMA Netw Open 2023; 6:e2344528. [PMID: 37991762 PMCID: PMC10665968 DOI: 10.1001/jamanetworkopen.2023.44528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 10/12/2023] [Indexed: 11/23/2023] Open
Abstract
Importance New approaches are needed to provide care for individuals with problematic opioid use (POU). Rapid access addiction medicine (RAAM) clinics offer a flexible, low-barrier, rapid access care model for this population. Objective To assess the associations of RAAM clinics with emergency department (ED) visits, hospitalizations, and mortality for people with POU. Design, Setting, and Participants A retrospective cohort study involving a matched control group was performed using health administrative data from Ontario, Canada. Anonymized data from 4 Ontario RAAM clinics (cities of Ottawa, Toronto, Oshawa, and Sudbury) were linked with health administrative data. Analyses were performed on a cohort of individuals who received care at participating RAAM clinics and geographically matched controls who did not receive care at a RAAM clinic. All visits occurred between October 2, 2017, and October 30, 2019, and data analyses were completed in spring 2023. A propensity score-matching approach was used to balance confounding factors between groups, with adjustment for covariates that remained imbalanced after matching. Exposures Individuals who initiated care through the RAAM model (including assessment, pharmacotherapy, brief counseling, harm reduction, triage to appropriate level of care, navigation to community services and primary care, and related care) were compared with individuals who did not receive care through the RAAM model. Main Outcomes and Measures The primary outcome was a composite measure of ED visits for any reason, hospitalization for any reason, and all-cause mortality (all measured up to 30 days after index date). Outcomes up to 90 days after index date, as well as outcomes looking at opioid-related ED visits and hospitalizations, were also assessed. Results In analyses of the sample of 876 patients formed using propensity score matching, 440 in the RAAM group (mean [SD] age, 36.5 [12.6] years; 276 [62.7%] male) and 436 in the control group (mean [SD] age, 36.8 [13.8] years; 258 [59.2%] male), the pooled odds ratio (OR) for the primary, 30-day composite outcome of all-cause ED visit, hospitalization, or mortality favored the RAAM model (OR, 0.68; 95% CI, 0.50-0.92). Analysis of the same outcome for opioid-related reasons only also favored the RAAM intervention (OR, 0.47; 95% CI, 0.29-0.76). Findings for the individual events of hospitalization, ED visit, and mortality at both 30-day and 90-day follow-up also favored the RAAM model, with comparisons reaching statistical significance in most cases. Conclusions and Relevance In this cohort study of individuals with POU, RAAM clinics were associated with reductions in ED visits, hospitalizations, and mortality. These findings provide valuable evidence toward a broadened adoption of the RAAM model in other regions of North America and beyond.
Collapse
Affiliation(s)
- Kim Corace
- Substance Use and Concurrent Disorders Program, Royal Ottawa Mental Health Centre, Ottawa, Ontario, Canada
- Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada
- University of Ottawa Institute of Mental Health Research at The Royal, Ottawa, Ontario, Canada
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
| | - Kednapa Thavorn
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada
| | - Kelly Suschinsky
- Substance Use and Concurrent Disorders Program, Royal Ottawa Mental Health Centre, Ottawa, Ontario, Canada
| | - Melanie Willows
- Substance Use and Concurrent Disorders Program, Royal Ottawa Mental Health Centre, Ottawa, Ontario, Canada
- Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada
- University of Ottawa Institute of Mental Health Research at The Royal, Ottawa, Ontario, Canada
| | - Pamela Leece
- Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
- Substance Use Service, Women’s College Hospital, Toronto, Ontario, Canada
- Public Health Ontario, Toronto, Ontario, Canada
- Dalla Lana School of Public Health, University of Toronto, Toronto, Ontario, Canada
| | - Meldon Kahan
- Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
- Substance Use Service, Women’s College Hospital, Toronto, Ontario, Canada
| | - Larry Nijmeh
- Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
- Lakeridge Health, Oshawa, Ontario, Canada
- Department of Family Medicine, Queens University, Kingston, Ontario, Canada
| | - Natalie Aubin
- Health Sciences North, Sudbury, Ontario, Canada
- School of Northern and Rural Health, Laurentian University, Sudbury, Ontario, Canada
| | | | - Gord Garner
- Community Addictions Peer Support Association, Ottawa, Ontario, Canada
| | - Refik Saskin
- Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada
| | - Eliane Kim
- Institute for Clinical Evaluative Sciences, Toronto, Ontario, Canada
| | - Danielle Rice
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- Department of Psychiatry and Behavioral Neurosciences, McMaster University, Hamilton, Ontario, Canada
- St Joseph’s Healthcare Hamilton, Hamilton, Ontario, Canada
| | - Sheena Taha
- Canadian Centre on Substance Use and Addiction, Ottawa, Ontario, Canada
| | - Gary Garber
- Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| | - Brian Hutton
- Ottawa Hospital Research Institute, Ottawa, Ontario, Canada
- School of Epidemiology and Public Health, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada
| |
Collapse
|
28
|
Mpofu P, Kent S, Jónsson P, Pittell H, Groves B, Altomare I, Copeland A, Baxi S, Bargo D, Sujenthiran A, Adamson B. Evaluation of US oncology electronic health record real-world data to reduce uncertainty in health technology appraisals: a retrospective cohort study. BMJ Open 2023; 13:e074559. [PMID: 37848301 PMCID: PMC10582952 DOI: 10.1136/bmjopen-2023-074559] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Accepted: 09/26/2023] [Indexed: 10/19/2023] Open
Abstract
OBJECTIVES Examine whether data from early access to medicines in the USA can be used to inform National Institute for Health and Care Excellence (NICE) health technology assessments (HTA) in oncology. DESIGN Retrospective cohort study. SETTING Oncology-based community and academic treatment centres in the USA. PARTICIPANTS Patients present in a nationwide electronic health record (EHR)-derived deidentified database. INTERVENTIONS Cancer drugs that underwent NICE technology appraisal (TA) between 2014 and 2019. PRIMARY AND SECONDARY OUTCOME MEASURES The count and follow-up time of US patients, available in the EHR, who were exposed to cancer drugs of interest in the period between Food and Drug Administration (FDA) approval and dates relevant to the NICE appraisal process. RESULTS In 59 of 60 TAs analysed, the cancer therapy was approved in the USA before the final appraisal by NICE. The median time from FDA approval to the publication of NICE recommendations was 18.5 months, at which time the US EHR-derived database had, on average, 269 patients (SD=356) exposed to the new therapy, with a median of 75.3 person-years (IQR: 13.1-173) in time-at-risk. A case study generated evidence on real-world overall survival and treatment duration. CONCLUSIONS Across different cancer therapies, there was substantial variability in US real-world data accumulated between FDA approval and NICE decision milestones. The applicability of these data to generate evidence for HTA decision-making should be assessed on a case-by-case basis depending on the intended HTA use case.
Collapse
Affiliation(s)
| | | | - Páll Jónsson
- Data and Analytics, National Institute for Health and Care Excellence, Manchester, UK
| | | | - Brad Groves
- Managed Access Team, National Institute for Health and Care Excellence, London, UK
| | | | | | | | | | | | - Blythe Adamson
- Flatiron Health Inc, New York, New York, USA
- University of Washington, Seattle, Washington, USA
| |
Collapse
|
29
|
Dang LE, Gruber S, Lee H, Dahabreh IJ, Stuart EA, Williamson BD, Wyss R, Díaz I, Ghosh D, Kıcıman E, Alemayehu D, Hoffman KL, Vossen CY, Huml RA, Ravn H, Kvist K, Pratley R, Shih MC, Pennello G, Martin D, Waddy SP, Barr CE, Akacha M, Buse JB, van der Laan M, Petersen M. A causal roadmap for generating high-quality real-world evidence. J Clin Transl Sci 2023; 7:e212. [PMID: 37900353 PMCID: PMC10603361 DOI: 10.1017/cts.2023.635] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 09/01/2023] [Accepted: 09/17/2023] [Indexed: 10/31/2023] Open
Abstract
Increasing emphasis on the use of real-world evidence (RWE) to support clinical policy and regulatory decision-making has led to a proliferation of guidance, advice, and frameworks from regulatory agencies, academia, professional societies, and industry. A broad spectrum of studies use real-world data (RWD) to produce RWE, ranging from randomized trials with outcomes assessed using RWD to fully observational studies. Yet, many proposals for generating RWE lack sufficient detail, and many analyses of RWD suffer from implausible assumptions, other methodological flaws, or inappropriate interpretations. The Causal Roadmap is an explicit, itemized, iterative process that guides investigators to prespecify study design and analysis plans; it addresses a wide range of guidance within a single framework. By supporting the transparent evaluation of causal assumptions and facilitating objective comparisons of design and analysis choices based on prespecified criteria, the Roadmap can help investigators to evaluate the quality of evidence that a given study is likely to produce, specify a study to generate high-quality RWE, and communicate effectively with regulatory agencies and other stakeholders. This paper aims to disseminate and extend the Causal Roadmap framework for use by clinical and translational researchers; three companion papers demonstrate applications of the Causal Roadmap for specific use cases.
Collapse
Affiliation(s)
- Lauren E. Dang
- Department of Biostatistics, University of California, Berkeley, CA, USA
| | | | - Hana Lee
- Office of Biostatistics, Office of Translational Sciences, Center for Drug Evaluation and Research, U.S. Food and Drug Administration, Silver Spring, MD, USA
| | - Issa J. Dahabreh
- CAUSALab, Department of Epidemiology and Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Elizabeth A. Stuart
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | - Brian D. Williamson
- Biostatistics Division, Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA
| | - Richard Wyss
- Division of Pharmacoepidemiology and Pharmacoeconomics, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA
| | - Iván Díaz
- Division of Biostatistics, Department of Population Health, New York University Grossman School of Medicine, New York, NY, USA
| | - Debashis Ghosh
- Department of Biostatistics and Informatics, Colorado School of Public Health, University of Colorado Anschutz Medical Campus, Aurora, CO, USA
| | | | | | - Katherine L. Hoffman
- Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, NY, USA
| | - Carla Y. Vossen
- Syneos Health Clinical Solutions, Amsterdam, The Netherlands
| | | | | | | | - Richard Pratley
- AdventHealth Translational Research Institute, Orlando, FL, USA
| | - Mei-Chiung Shih
- Cooperative Studies Program Coordinating Center, VA Palo Alto Health Care System, Palo Alto, CA, USA
- Department of Biomedical Data Science, Stanford University, Stanford, CA, USA
| | - Gene Pennello
- Division of Imaging Diagnostics and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD, USA
| | - David Martin
- Global Real World Evidence Group, Moderna, Cambridge, MA, USA
| | - Salina P. Waddy
- National Center for Advancing Translational Sciences, Bethesda, MD, USA
| | - Charles E. Barr
- Graticule Inc., Newton, MA, USA
- Adaptic Health Inc., Palo Alto, CA, USA
| | | | - John B. Buse
- Division of Endocrinology, Department of Medicine, University of North Carolina, Chapel Hill, NC, USA
| | - Mark van der Laan
- Department of Biostatistics, University of California, Berkeley, CA, USA
| | - Maya Petersen
- Department of Biostatistics, University of California, Berkeley, CA, USA
| |
Collapse
|
30
|
Boivin-Proulx LA, Brouillette J, Dorais M, Perreault S. Association between cardiovascular diseases and dementia among various age groups: a population-based cohort study in older adults. Sci Rep 2023; 13:14881. [PMID: 37689801 PMCID: PMC10492794 DOI: 10.1038/s41598-023-42071-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2023] [Accepted: 09/05/2023] [Indexed: 09/11/2023] Open
Abstract
The link between cardiovascular (CV) risk factors or diseases and dementia is documented. There is conflicting evidence whether age moderates the association. We need to study this gap so that research and clinical initiatives target appropriate age groups. A cohort of 320,630 adult patients without dementia was built using Quebec healthcare databases (1998-2010). The CV risk factors were hypertension, diabetes and dyslipidemia, while diseases included stroke, myocardial infarction (MI), chronic heart failure (HF), and atrial fibrillation (AF). Dementia risk and CV risk factors or diseases were assessed using incidence rate ratios and Cox regression across age groups. The cohort presented by mainly female sex (67.7%) and mean age of 74.1 years. Incident rate of dementia increased with age, ranging from 4.1 to 93.5 per 1000 person-years. Diabetes, stroke, HF and AF were significantly associated with dementia risk, hazard ratios ranged from 1.08 to 3.54. The strength of association decreased in advanced age for diabetes, stroke and HF. The results suggest that prevention of diabetes, stroke, HF and AF are crucial to mitigate dementia risk. The pathophysiology of dementia in younger and older populations seems to differ, with less impact of CV risk factors in advanced age.
Collapse
Affiliation(s)
- Laurie-Anne Boivin-Proulx
- Department of Cardiology, Faculty of Medicine, University of Ottawa Heart Institute, Ottawa, ON, Canada
| | - Judith Brouillette
- Department of Cardiology, Faculty of Medicine, University of Ottawa Heart Institute, Ottawa, ON, Canada
- Department of Psychiatry and Addictology, Université de Montréal, Montreal, QC, Canada
| | - Marc Dorais
- StatSciences Inc., Notre-Dame-de-l'Île-Perrot, QC, Canada
| | - Sylvie Perreault
- Faculté de Pharmacie, Université de Montréal, Succursale Centre-Ville, Case Postale 6128, Montreal, QC, H3C 3J7, Canada.
- Centre de Recherche en Santé Publique (CReSP), Partenaire CIUSSS du Centre-Sud-de-l'Île-de-Montréal et l'Université de Montréal, Montreal, QC, Canada.
| |
Collapse
|
31
|
Sarri G, Liu W, Zabotka L, Freitag A, Claire R, Wangge G, Elvidge J, Dawoud D, Bennett D, Wen X, Li X, Rentsch CT, Uddin MJ, Ali MS, Gokhale M, Déruaz-Luyet A, Moga DC, Guo JJ, Zullo AR, Patorno E, Lin KJ. Prognostic Factors of COVID-19: An Umbrella Review Endorsed by the International Society for Pharmacoepidemiology. Clin Pharmacol Ther 2023; 114:604-613. [PMID: 37342987 DOI: 10.1002/cpt.2977] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2023] [Accepted: 06/12/2023] [Indexed: 06/23/2023]
Abstract
During the coronavirus disease 2019 (COVID-19) pandemic, the urgency for updated evidence to inform public health and clinical care placed systematic literature reviews (SLRs) at the cornerstone of research. We aimed to summarize evidence on prognostic factors for COVID-19 outcomes through published SLRs and to critically assess quality elements in the findings' interpretation. An umbrella review was conducted via electronic databases from January 2020 to April 2022. All SLRs (and meta-analyses) in English were considered. Data screening and extraction were conducted by two independent reviewers. AMSTAR 2 tool was used to assess SLR quality. The study was registered with PROSPERO (CRD4202232576). Out of 4,564 publications, 171 SLRs were included of which 3 were umbrella reviews. Our primary analysis included 35 SLRs published in 2022, which incorporated studies since the beginning of the pandemic. Consistent findings showed that, for adults, older age, obesity, heart disease, diabetes, and cancer were more strongly predictive of risk of hospitalization, intensive care unit admission, and mortality due to COVID-19. Male sex was associated with higher risk of short-term adverse outcomes, but female sex was associated with higher risk of long COVID. For children, socioeconomic determinants that may unravel COVID-19 disparities were rarely reported. This review highlights key prognostic factors of COVID-19, which can help clinicians and health officers identify high-risk groups for optimal care. Findings can also help optimize confounding adjustment and patient phenotyping in comparative effectiveness research. A living SLR approach may facilitate dissemination of new findings. This paper is endorsed by the International Society for Pharmacoepidemiology.
Collapse
Affiliation(s)
| | - Wei Liu
- Office of Surveillance and Epidemiology, CDER, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Luke Zabotka
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | | | - Ravinder Claire
- National Institute for Health and Care Excellence, London, UK
| | | | - Jamie Elvidge
- National Institute for Health and Care Excellence, London, UK
| | - Dalia Dawoud
- National Institute for Health and Care Excellence, London, UK
- Cairo University, Cairo, Egypt
| | - Dimitri Bennett
- Takeda Development Center Americas, Inc., Cambridge, Massachusetts, USA
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, Pennsylvania, USA
| | - Xuerong Wen
- College of Pharmacy, University of Rhode Island, Kingston, Rhode Island, USA
| | - Xiaojuan Li
- Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, Massachusetts, USA
| | - Christopher T Rentsch
- Faculty of Epidemiology and Population Health, London School of Hygiene & Tropical Medicine, London, UK
- Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut, USA
| | - Md Jamal Uddin
- Department of Statistics, Shahjalal University of Science and Technology, Sylhet, Bangladesh
- Department of General Educational Development (GED), Daffodil International University, Dhaka, Bangladesh
| | - M Sanni Ali
- Faculty of Public Health and Policy, London School of Hygiene & Tropical Medicine, London, UK
- Liverpool School of Tropical Medicine, Liverpool, UK
| | | | | | - Daniela C Moga
- Department of Pharmacy Practice and Science, College of Pharmacy, University of Kentucky, Lexington, Kentucky, USA
| | - Jeff Jianfei Guo
- Division of Pharmacy Practice & Administrative Sciences, College of Pharmacy, University of Cincinnati, Cincinnati, Ohio, USA
| | - Andrew R Zullo
- Department of Epidemiology, School of Public Health, Brown University, Providence, Rhode Island, USA
| | - Elisabetta Patorno
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Kueiyu Joshua Lin
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
32
|
Huang Y, Chatterjee S, Agarwal SK, Chen H, Johnson ML, Aparasu RR. Factors influencing prescribing the first add-on disease-modifying antirheumatic drugs in patients initiating methotrexate for rheumatoid arthritis. EXPLORATORY RESEARCH IN CLINICAL AND SOCIAL PHARMACY 2023; 11:100296. [PMID: 37521021 PMCID: PMC10372178 DOI: 10.1016/j.rcsop.2023.100296] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 05/31/2023] [Accepted: 06/13/2023] [Indexed: 08/01/2023] Open
Abstract
Background Advances in Disease-Modifying Antirheumatic Drugs (DMARDs) have expanded the treatment landscape for Rheumatoid Arthritis (RA). Guidelines recommend adding either conventional synthetic (cs), biologic (b), or targeted synthetic (ts) DMARDs to methotrexate (MTX) for managing RA. Limited evidence exists regarding the factors that contribute to adding a DMARD agent to the MTX regimen. This study examined the factors associated with adding the first DMARD in RA patients initiating MTX. Methods This retrospective cohort study utilized the MarketScan data (2012-2014) involving adults (aged ≥18) with RA initiating an MTX (index date) between Jul 1, 2012 and Dec 30, 2013, and with continuous enrollment for the 6-month pre-index period. The combination therapy users received the first treatment addition of DMARD starting from day 30 after the index MTX over one year period. The study focused on the addition of csDMARDs, Tumor Necrosis Factor Inhibitors (TNFi) bDMARDs, non-TNFi bDMARDs, or tsDMARDs. Baseline covariates were measured in the 6-month pre-index and grouped into predisposing, enabling, and need factors, as per the Andersen Behavior Model. Multivariable logistic regression examined the factors associated with the addition of TNFi compared to adding a csDMARD. An additional regression model evaluated the factors associated with adding any biologic (combining TNFi and non-TNFi biologics). Results Among 8350 RA patients starting MTX, 31.92% (n = 2665) initiated any DMARD within the 1-year post-index period. Among RA patients initiating a DMARD prescription after starting MTX, 945 (11.32%) received combination therapy with treatment addition of a DMARD to MTX regimen; majority added TNFi (550, 58%), followed by csDMARD (352, 37%); non-TNF biologic (40, 4%), or tsDMARD (3, 0.3%). The tsDMARD group was limited and was not included for further analysis. The multivariable model found Preferred Provider Organization insurance coverage (odds ratio [OR], 1.43; 95% confidence interval (CI), 1.06-1.93), chronic pulmonary disease (OR, 1.98; 95% CI, 1.14-3.44), liver disease (OR, 5.24; 95% CI, 1.77-15.49), and Elixhauser score (OR, 0.91; 95% CI, 0.86-0.97) were significantly associated with the addition of TNF-α inhibitors. The separate multivariable model additionally found that patients from metropolitan areas (OR, 1.50; 95% CI, 1.04-2.16) were positively associated with adding any biological agent. Conclusions TNFi are often added to MTX for managing RA. Enabling and need factors contribute to the prescribing of a TNFi add-on therapy in RA. Future research should examine the impact of these combination therapies on RA management.
Collapse
Affiliation(s)
- Yinan Huang
- Department of Pharmacy Administration, University of Mississippi, Oxford, MS, United States of America
| | - Satabdi Chatterjee
- Department of Pharmaceutical Health Outcomes and Policy, College of Pharmacy, University of Houston, TX, United States of America
| | - Sandeep K. Agarwal
- Section of Immunology, Allergy & Rheumatology, Department of Medicine, Baylor College of Medicine, Houston, TX, United States of America
| | - Hua Chen
- Department of Pharmaceutical Health Outcomes and Policy, College of Pharmacy, University of Houston, TX, United States of America
| | - Michael L. Johnson
- Department of Pharmaceutical Health Outcomes and Policy, College of Pharmacy, University of Houston, TX, United States of America
| | - Rajender R. Aparasu
- Department of Pharmaceutical Health Outcomes and Policy, College of Pharmacy, University of Houston, TX, United States of America
| |
Collapse
|
33
|
Winterstein AG, Ehrenstein V, Brown JS, Stürmer T, Smith MY. A Road Map for Peer Review of Real-World Evidence Studies on Safety and Effectiveness of Treatments. Diabetes Care 2023; 46:1448-1454. [PMID: 37471605 PMCID: PMC10369122 DOI: 10.2337/dc22-2037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Accepted: 05/05/2023] [Indexed: 07/22/2023]
Abstract
The growing acceptance of real-world evidence (RWE) in clinical and regulatory decision-making, coupled with increasing availability of health care data and advances in automated analytic approaches, has contributed to a marked expansion of RWE studies of diabetes and other diseases. However, a recent spate of high-profile retractions highlights the need for improvements in the conduct of RWE research as well as in the associated peer review and editorial processes. We review best pharmacoepidemiologic practices and common pitfalls regarding design, measurement, analysis, data validity, appropriateness, and generalizability of RWE studies. To enhance RWE study assessments, we propose that journal editors require 1) study authors to complete RECORD-PE, a reporting guideline for pharmacoepidemiological studies on routinely collected data, 2) availability of predetermined study protocols and analysis plans, 3) inclusion of pharmacoepidemiologists on the peer review team, and 4) provision of detail on data provenance, characterization, and custodianship to facilitate assessment of the data source. We recognize that none of these steps guarantees a high-quality research study. Collectively, however, they permit an informed assessment of whether the study was adequately designed and conducted and whether the data source used was fit for purpose.
Collapse
Affiliation(s)
- Almut G. Winterstein
- Department of Pharmaceutical Outcomes and Policy, Department of Epidemiology, and Center for Drug Evaluation and Safety, University of Florida, Gainesville, FL
- International Network for Epidemiology in Policy, American College of Epidemiology, Washington Avenue Extension, Albany, NY
- International Society for Pharmacoepidemiology, Bethesda, MD
| | - Vera Ehrenstein
- International Network for Epidemiology in Policy, American College of Epidemiology, Washington Avenue Extension, Albany, NY
- International Society for Pharmacoepidemiology, Bethesda, MD
- Department of Clinical Epidemiology, Aarhus University and Aarhus University Hospital, Aarhus, Denmark
| | - Jeffrey S. Brown
- International Network for Epidemiology in Policy, American College of Epidemiology, Washington Avenue Extension, Albany, NY
- International Society for Pharmacoepidemiology, Bethesda, MD
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Cambridge, MA
- TriNetX, LLC, Cambridge, MA
| | - Til Stürmer
- International Network for Epidemiology in Policy, American College of Epidemiology, Washington Avenue Extension, Albany, NY
- International Society for Pharmacoepidemiology, Bethesda, MD
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, NC
| | - Meredith Y. Smith
- International Network for Epidemiology in Policy, American College of Epidemiology, Washington Avenue Extension, Albany, NY
- International Society for Pharmacoepidemiology, Bethesda, MD
- Evidera, Inc., PPD, Boston, MA
- School of Pharmacy, University of Southern California, Los Angeles, CA
| |
Collapse
|
34
|
Luijken K, van Eekelen R, Gardarsdottir H, Groenwold RHH, van Geloven N. Tell me what you want, what you really really want: Estimands in observational pharmacoepidemiologic comparative effectiveness and safety studies. Pharmacoepidemiol Drug Saf 2023; 32:863-872. [PMID: 36946319 DOI: 10.1002/pds.5620] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Revised: 03/02/2023] [Accepted: 03/18/2023] [Indexed: 03/23/2023]
Abstract
PURPOSE Ideally, the objectives of a pharmacoepidemiologic comparative effectiveness or safety study should dictate its design and data analysis. This paper discusses how defining an estimand is instrumental to this process. METHODS We applied the ICH-E9 (Statistical Principles for Clinical Trials) R1 addendum on estimands - which originally focused on randomized trials - to three examples of observational pharmacoepidemiologic comparative effectiveness and safety studies. Five key elements specify the estimand: the population, contrasted treatments, endpoint, intercurrent events, and population-level summary measure. RESULTS Different estimands were defined for case studies representing three types of pharmacological treatments: (1) single-dose treatments using a case study about the effect of influenza vaccination versus no vaccination on mortality risk in an adult population of ≥60 years of age; (2) sustained-treatments using a case study about the effect of dipeptidyl peptidase 4 inhibitor versus glucagon-like peptide-1 agonist on hypoglycemia risk in treatment of uncontrolled diabetes; and (3) as needed treatments using a case study on the effect of nitroglycerin spray as-needed versus no nitroglycerin on syncope risk in treatment of stabile angina pectoris. CONCLUSIONS The case studies illustrated that a seemingly clear research question can still be open to multiple interpretations. Defining an estimand ensures that the study targets a treatment effect that aligns with the treatment decision the study aims to inform. Estimand definitions further help to inform choices regarding study design and data-analysis and clarify how to interpret study findings.
Collapse
Affiliation(s)
- Kim Luijken
- Department of Epidemiology, Utrecht University Medical Center, University Utrecht, Utrecht, The Netherlands
| | - Rik van Eekelen
- Centre for Reproductive Medicine, Amsterdam University Medical Center, Amsterdam, The Netherlands
| | - Helga Gardarsdottir
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, The Netherlands
- Department of Clinical Pharmacy, Division Laboratories, Pharmacy and Biomedical Genetics, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
- Faculty of Pharmaceutical Sciences, University of Iceland, Reykjavik, Iceland
| | - Rolf H H Groenwold
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Nan van Geloven
- Department of Biomedical Data Sciences, Leiden University Medical Center, Leiden, The Netherlands
| |
Collapse
|
35
|
Huang YT, Wei T, Huang YL, Wu YP, Chan KA. Validation of diagnosis codes in healthcare databases in Taiwan, a literature review. Pharmacoepidemiol Drug Saf 2023; 32:795-811. [PMID: 36890603 DOI: 10.1002/pds.5608] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 02/02/2023] [Accepted: 03/03/2023] [Indexed: 03/10/2023]
Abstract
PURPOSE To compile validation findings of diagnosis codes and related algorithms for health outcomes of interest from National Health Insurance (NHI) or electronic medical records in Taiwan. METHODS We carried out a literature review of English articles in PubMed® and Embase from 2000 through July 2022 with appropriate search terms. Potentially relevant articles were identified through review of article titles and abstracts, full text search of methodology terms "validation", "positive predictive value", and "algorithm" in Subjects & Methods (or Methods) and Results sections of articles, followed by full text review of potentially eligible articles. RESULTS We identified 50 published reports with validation findings of diagnosis codes and related algorithms for a wide range of health outcomes of interest in Taiwan, including cardiovascular diseases, stroke, renal impairment, malignancy, diabetes, mental health diseases, respiratory diseases, viral (B and C) hepatitis, and tuberculosis. Most of the reported PPVs were in the 80% ~ 99% range. Assessment of algorithms based on ICD-10 systems were reported in 8 articles, all published in 2020 or later. CONCLUSIONS Investigators have published validation reports that may serve as empirical evidence to evaluate the utility of secondary health data environment in Taiwan for research and regulatory purpose.
Collapse
Affiliation(s)
- Yue-Ton Huang
- Health Data Research Center, National Taiwan University, Taipei, Taiwan
| | - Tiffaney Wei
- Health Data Research Center, National Taiwan University, Taipei, Taiwan
- Epidemiology and Biostatistics, Master of Public Health (MPH), Boston University School of Public Health, Boston, Massachusetts, USA
| | - Ya-Ling Huang
- Health Data Research Center, National Taiwan University, Taipei, Taiwan
| | - Yu-Pu Wu
- Health Data Research Center, National Taiwan University, Taipei, Taiwan
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, USA
| | - K Arnold Chan
- Health Data Research Center, National Taiwan University, Taipei, Taiwan
| |
Collapse
|
36
|
Gregg EW, Patorno E, Karter AJ, Mehta R, Huang ES, White M, Patel CJ, McElvaine AT, Cefalu WT, Selby J, Riddle MC, Khunti K. Use of Real-World Data in Population Science to Improve the Prevention and Care of Diabetes-Related Outcomes. Diabetes Care 2023; 46:1316-1326. [PMID: 37339346 PMCID: PMC10300521 DOI: 10.2337/dc22-1438] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 04/11/2023] [Indexed: 06/22/2023]
Abstract
The past decade of population research for diabetes has seen a dramatic proliferation of the use of real-world data (RWD) and real-world evidence (RWE) generation from non-research settings, including both health and non-health sources, to influence decisions related to optimal diabetes care. A common attribute of these new data is that they were not collected for research purposes yet have the potential to enrich the information around the characteristics of individuals, risk factors, interventions, and health effects. This has expanded the role of subdisciplines like comparative effectiveness research and precision medicine, new quasi-experimental study designs, new research platforms like distributed data networks, and new analytic approaches for clinical prediction of prognosis or treatment response. The result of these developments is a greater potential to progress diabetes treatment and prevention through the increasing range of populations, interventions, outcomes, and settings that can be efficiently examined. However, this proliferation also carries an increased threat of bias and misleading findings. The level of evidence that may be derived from RWD is ultimately a function of the data quality and the rigorous application of study design and analysis. This report reviews the current landscape and applications of RWD in clinical effectiveness and population health research for diabetes and summarizes opportunities and best practices in the conduct, reporting, and dissemination of RWD to optimize its value and limit its drawbacks.
Collapse
Affiliation(s)
- Edward W. Gregg
- School of Population Health, RRCSI University of Medicine and Health Sciences, Dublin, Ireland
- Department of Epidemiology and Biostatistics, School of Public Health, Imperial College London, London, U.K
| | - Elisabetta Patorno
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women’s Hospital and Harvard Medical School, Boston, MA
| | - Andrew J. Karter
- Division of Research, Kaiser Permanente, Oakland, CA
- Department of Health Systems and Population Health, University of Washington, Seattle, WA
| | - Roopa Mehta
- Metabolic Research Unit (UIEM), Department of Endocrinology and Metabolism, Instituto Nacional de Ciencias Medicas y Nutricion, Salvador Zubiran (INCMNSZ), Mexico City, Mexico
| | - Elbert S. Huang
- Section of General Internal Medicine, Center for Chronic Disease Research and Policy (CDRP), The University of Chicago, Chicago, IL
| | - Martin White
- Medical Research Council Epidemiology Unit, University of Cambridge, Cambridge, U.K
| | - Chirag J. Patel
- Department of Biomedical Informatics, Harvard Medical School, Boston, MA
| | | | - William T. Cefalu
- Division of Diabetes, Endocrinology, and Metabolic Diseases, National Institute of Diabetes, Digestive, and Kidney Diseases, National Institutes of Health, Bethesda, MD
| | - Joseph Selby
- Patient-Centered Outcomes Institute, Washington, DC
| | - Matthew C. Riddle
- Division of Endocrinology, Diabetes, and Clinical Nutrition, Oregon Health & Science University, Portland, OR
| | - Kamlesh Khunti
- Leicester Real World Evidence Unit, Diabetes Research Centre, University of Leicester, Leicester, U.K
| |
Collapse
|
37
|
Postma M, Fisman D, Giglio N, Márquez-Peláez S, Nguyen VH, Pugliese A, Ruiz-Aragón J, Urueña A, Mould-Quevedo J. Real-World Evidence in Cost-Effectiveness Analysis of Enhanced Influenza Vaccines in Adults ≥ 65 Years of Age: Literature Review and Expert Opinion. Vaccines (Basel) 2023; 11:1089. [PMID: 37376478 DOI: 10.3390/vaccines11061089] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Revised: 05/30/2023] [Accepted: 06/01/2023] [Indexed: 06/29/2023] Open
Abstract
Influenza vaccination can benefit most populations, including adults ≥ 65 years of age, who are at greater risk of influenza-related complications. In many countries, enhanced vaccines, such as adjuvanted, high-dose, and recombinant trivalent/quadrivalent influenza vaccines (aTIV/aQIV, HD-TIV/HD-QIV, and QIVr, respectively), are recommended in older populations to provide higher immunogenicity and increased relative vaccine efficacy/effectiveness (rVE) than standard-dose vaccines. This review explores how efficacy and effectiveness data from randomized controlled trials and real-world evidence (RWE) are used in economic evaluations. Findings from published cost-effectiveness analyses (CEA) on enhanced influenza vaccines for older adults are summarized, and the assumptions and approaches used in these CEA are assessed alongside discussion of the importance of RWE in CEA. Results from many CEA showed that adjuvanted and high-dose enhanced vaccines were cost-effective compared with standard vaccines, and that differences in rVE estimates and acquisition price may drive differences in cost-effectiveness estimates between enhanced vaccines. Overall, RWE and CEA provide clinical and economic rationale for enhanced vaccine use in people ≥ 65 years of age, an at-risk population with substantial burden of disease. Countries that consider RWE when making vaccine recommendations have preferentially recommended aTIV/aQIV, as well as HD-TIV/HD-QIV and QIVr, to protect older individuals.
Collapse
Affiliation(s)
- Maarten Postma
- Department of Health Sciences, University Medical Center Groningen, University of Groningen, P.O. Box 72, 9700 AB Groningen, The Netherlands
- Department of Economics, Econometrics & Finance, Faculty of Economics & Business, University of Groningen, 9713 AB Groningen, The Netherlands
- Centre of Excellence in Higher Education for Pharmaceutical Care Innovation, Universitas Padjadjaran, 40132 Bandung, Indonesia
| | - David Fisman
- Dalla Lana School of Public Health, Toronto, ON M5T 3M7, Canada
| | - Norberto Giglio
- Hospital de Niños Ricardo Gutièrrez, Buenos Aires 1425, Argentina
| | - Sergio Márquez-Peláez
- Department of Economics, Economic Analysis, Faculty of Business Pablo de Olavide University, 41013 Seville, Spain
| | | | - Andrea Pugliese
- Department of Mathematics, University of Trento, 38123 Trento, Italy
| | | | - Analia Urueña
- Centro de Estudios para la Prevención y Control de Enfermedades Transmisibles, Universidad Isalud, Buenos Aires C1095AAS, Argentina
| | | |
Collapse
|
38
|
Laurent T, Lambrelli D, Wakabayashi R, Hirano T, Kuwatsuru R. Strategies to Address Current Challenges in Real-World Evidence Generation in Japan. Drugs Real World Outcomes 2023:10.1007/s40801-023-00371-5. [PMID: 37178273 PMCID: PMC10182751 DOI: 10.1007/s40801-023-00371-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/19/2023] [Indexed: 05/15/2023] Open
Abstract
The generation of real-world evidence (RWE), which describes patient characteristics or treatment patterns using real-world data (RWD), is rapidly growing more popular as a tool for decision-making in Japan. The aim of this review was to summarize challenges to RWE generation in Japan related to pharmacoepidemiology, and to propose strategies to address some of these challenges. We first focused on data-related issues, including the lack of transparency of RWD sources, linkage across different care settings, definitions of clinical outcomes, and the overall assessment framework of RWD when used for research purposes. Next the study reviewed methodology-related challenges. As lack of design transparency impairs study reproducibility, transparent reporting of study design is critical for stakeholders. For this review, we considered different sources of biases and time-varying confounding, along with potential study design and methodological solutions. Additionally, the implementation of robust assessment of definition uncertainty, misclassification, and unmeasured confounders would enhance RWE credibility in light of RWD source-related limitations, and is being strongly considered by task forces in Japan. Overall, the development of guidance for best practices on data source selection, design transparency, and analytical methods to address different sources of biases and robustness in the process of RWE generation will enhance credibility for stakeholders and local decision-makers.
Collapse
Affiliation(s)
- Thomas Laurent
- Real-World Evidence and Data Assessment (READS), Graduate School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan
- Clinical Study Support Inc., 2F Daiei Bldg., 1-11-20 Nishiki Naka-ku, Nagoya, 460-0003, Japan
| | - Dimitra Lambrelli
- Real-World Evidence and Data Assessment (READS), Graduate School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan
- Real-World Evidence, Evidera, The Ark, 2nd Floor, 201 Talgarth Road, London, W6 8BJ, UK
| | - Ryozo Wakabayashi
- Real-World Evidence and Data Assessment (READS), Graduate School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan
- Clinical Study Support Inc., 2F Daiei Bldg., 1-11-20 Nishiki Naka-ku, Nagoya, 460-0003, Japan
| | - Takahiro Hirano
- Real-World Evidence and Data Assessment (READS), Graduate School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan.
- Clinical Study Support Inc., 2F Daiei Bldg., 1-11-20 Nishiki Naka-ku, Nagoya, 460-0003, Japan.
| | - Ryohei Kuwatsuru
- Real-World Evidence and Data Assessment (READS), Graduate School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan
- Department of Radiology, School of Medicine, Juntendo University, Hongo 2-1-1, Bunkyo-ku, Tokyo, 113-8421, Japan
| |
Collapse
|
39
|
Bray B, Ramagopalan SV. R WE ready for reimbursement? A round up of developments in real-world evidence relating to health technology assessment: part 11. J Comp Eff Res 2023; 12:e230008. [PMID: 37052075 PMCID: PMC10402780 DOI: 10.57264/cer-2023-0008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Accepted: 03/09/2023] [Indexed: 04/14/2023] Open
Abstract
In this latest update we highlight a study from the REPEAT initiative that evaluates the reproducibility of real-world data studies, the publication of the HARPER Protocol Template developed by a joint ISPE/ISPOR taskforce, and discuss recent US FDA guidance on external control arms.
Collapse
Affiliation(s)
- Ben Bray
- Health Analytics, Lane Clark & Peacock, London, W1U 1DQ, UK
- Department of Population Health Sciences, King’s College London, SE1 9NH, UK
| | | |
Collapse
|
40
|
Ostropolets A, Albogami Y, Conover M, Banda JM, Baumgartner WA, Blacketer C, Desai P, DuVall SL, Fortin S, Gilbert JP, Golozar A, Ide J, Kanter AS, Kern DM, Kim C, Lai LYH, Li C, Liu F, Lynch KE, Minty E, Neves MI, Ng DQ, Obene T, Pera V, Pratt N, Rao G, Rappoport N, Reinecke I, Saroufim P, Shoaibi A, Simon K, Suchard MA, Swerdel JN, Voss EA, Weaver J, Zhang L, Hripcsak G, Ryan PB. Reproducible variability: assessing investigator discordance across 9 research teams attempting to reproduce the same observational study. J Am Med Inform Assoc 2023; 30:859-868. [PMID: 36826399 PMCID: PMC10114120 DOI: 10.1093/jamia/ocad009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Revised: 01/04/2023] [Accepted: 01/23/2023] [Indexed: 02/25/2023] Open
Abstract
OBJECTIVE Observational studies can impact patient care but must be robust and reproducible. Nonreproducibility is primarily caused by unclear reporting of design choices and analytic procedures. This study aimed to: (1) assess how the study logic described in an observational study could be interpreted by independent researchers and (2) quantify the impact of interpretations' variability on patient characteristics. MATERIALS AND METHODS Nine teams of highly qualified researchers reproduced a cohort from a study by Albogami et al. The teams were provided the clinical codes and access to the tools to create cohort definitions such that the only variable part was their logic choices. We executed teams' cohort definitions against the database and compared the number of subjects, patient overlap, and patient characteristics. RESULTS On average, the teams' interpretations fully aligned with the master implementation in 4 out of 10 inclusion criteria with at least 4 deviations per team. Cohorts' size varied from one-third of the master cohort size to 10 times the cohort size (2159-63 619 subjects compared to 6196 subjects). Median agreement was 9.4% (interquartile range 15.3-16.2%). The teams' cohorts significantly differed from the master implementation by at least 2 baseline characteristics, and most of the teams differed by at least 5. CONCLUSIONS Independent research teams attempting to reproduce the study based on its free-text description alone produce different implementations that vary in the population size and composition. Sharing analytical code supported by a common data model and open-source tools allows reproducing a study unambiguously thereby preserving initial design choices.
Collapse
Affiliation(s)
- Anna Ostropolets
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, New York, USA
| | - Yasser Albogami
- Department of Clinical Pharmacy, College of Pharmacy, King Saud University, Riyadh, Saudi Arabia
| | - Mitchell Conover
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| | - Juan M Banda
- Department of Computer Science, Georgia State University, Atlanta, Georgia, USA
| | - William A Baumgartner
- Division of General Internal Medicine, Department of Medicine, University of Colorado Anschutz Medical Campus, Aurora, Colorado, USA
| | - Clair Blacketer
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| | - Priyamvada Desai
- Research IT, Technology and Digital Solutions, Stanford Medicine, Stanford, California, USA
| | - Scott L DuVall
- VA Salt Lake City Health Care System, Salt Lake City, Utah, USA
- Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Stephen Fortin
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| | - James P Gilbert
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| | | | - Joshua Ide
- Johnson & Johnson, Titusville, New Jersey, USA
| | - Andrew S Kanter
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, New York, USA
| | - David M Kern
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| | - Chungsoo Kim
- Department of Biomedical Sciences, Ajou University Graduate School of Medicine, Suwon, South Korea
| | - Lana Y H Lai
- Department of Informatics, Imaging & Data Sciences, University of Manchester, Manchester, UK
| | - Chenyu Li
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, Pennsylvania, USA
| | - Feifan Liu
- Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, Worcester, Massachusetts, USA
| | - Kristine E Lynch
- VA Salt Lake City Health Care System, Salt Lake City, Utah, USA
- Department of Internal Medicine, University of Utah School of Medicine, Salt Lake City, Utah, USA
| | - Evan Minty
- O’Brien Institute for Public Health, Faculty of Medicine, University of Calgary, Calgary, Canada
| | | | - Ding Quan Ng
- Department of Pharmaceutical Sciences, School of Pharmacy & Pharmaceutical Sciences, University of California, Irvine, California, USA
| | - Tontel Obene
- Mississippi Urban Research Center, Jackson State University, Jackson, Mississippi, USA
| | - Victor Pera
- Department of Medical Informatics, Erasmus University Medical Center, Rotterdam, The Netherlands
| | - Nicole Pratt
- Quality Use of Medicines and Pharmacy Research Centre, University of South Australia, Adelaide, Australia
| | - Gowtham Rao
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| | - Nadav Rappoport
- Department of Software and Information Systems Engineering, Ben-Gurion University of the Negev, Israel
| | - Ines Reinecke
- Institute for Medical Informatics and Biometry, Carl Gustav Carus Faculty of Medicine, Technische Universität Dresden, Dresden, Germany
| | - Paola Saroufim
- Cleveland Institute for Computational Biology, Case Western Reserve University, Cleveland, Ohio, USA
| | - Azza Shoaibi
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| | - Katherine Simon
- VA Tennessee Valley Health Care System, Vanderbilt University Medical Center, Nashville, Tennessee, USA
| | - Marc A Suchard
- Department of Biostatistics, University of California, Los Angeles, California, USA
- Department of Human Genetics, University of California, Los Angeles, California, USA
| | - Joel N Swerdel
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| | - Erica A Voss
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| | - James Weaver
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| | - Linying Zhang
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, New York, USA
| | - George Hripcsak
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, New York, USA
- Medical Informatics Services, New York-Presbyterian Hospital, New York, New York, USA
| | - Patrick B Ryan
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, New York, USA
- Observational Health Data Analytics, Janssen Research & Development, Titusville, New Jersey, USA
| |
Collapse
|
41
|
Solà-Morales O, Sigurðardóttir K, Akehurst R, Murphy LA, Mestre-Ferrandiz J, Cunningham D, de Pouvourville G. Data Governance for Real-World Data Management: A Proposal for a Checklist to Support Decision Making. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2023; 26:32-42. [PMID: 36870678 DOI: 10.1016/j.jval.2023.02.012] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2022] [Revised: 02/10/2023] [Accepted: 02/21/2023] [Indexed: 05/06/2023]
Abstract
OBJECTIVES Real-world data (RWD) and real-world evidence (RWE) can provide extensive information on healthcare for use in health technology assessment and decision making. Nevertheless, there is a lack of consensus surrounding the appropriate data governance (DG) practices for RWD/RWE. Data sharing is also a large concern, especially considering evolving data protection regulations. Our objective is to propose recommendations for international standards of evaluating the acceptability of RWD governance practices. METHODS After reviewing the literature, we created a checklist targeting DG practices for RWD/RWE. We then carried out a 3-round Delphi panel, including European policy makers, health technology assessment experts, and hospital managers. The consensus for each statement was measured and the checklist adjusted accordingly. RESULTS The literature review identified the main topics regarding RWD/RWE DG practices: data privacy and security, data management and linkage, data access management, and the generation and use of RWE. Members of the Delphi panel (21 experts/25 invited) were presented a total of 24 statements related to each of the topics. Experts demonstrated a progressive level of consensus and importance ratings in all topics and to most statements. We suggest a refined checklist in which the statements rated less important or with less consensus have been removed. CONCLUSIONS This study suggests how the DG of RWD/RWE could be qualitatively evaluated. We propose checklists that could be used by all RWD/RWE users to help ensure the quality and integrity of RWD/RWE governance and complement data protection law.
Collapse
|
42
|
Segal JB, Varadhan R, Groenwold RH, Henderson NC, Li X, Nomura K, Kaplan S, Ardeshirrouhanifard S, Heyward J, Nyberg F, Burcu M. Assessing Heterogeneity of Treatment Effect in Real-World Data. Ann Intern Med 2023; 176:536-544. [PMID: 36940440 PMCID: PMC10273137 DOI: 10.7326/m22-1510] [Citation(s) in RCA: 11] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/22/2023] Open
Abstract
Increasing availability of real-world data (RWD) generated from patient care enables the generation of evidence to inform clinical decisions for subpopulations of patients and perhaps even individuals. There is growing opportunity to identify important heterogeneity of treatment effects (HTE) in these subgroups. Thus, HTE is relevant to all with interest in patients' responses to interventions, including regulators who must make decisions about products when signals of harms arise postapproval and payers who make coverage decisions based on expected net benefit to their beneficiaries. Prior work discussed HTE in randomized studies. Here, we address methodological considerations when investigating HTE in observational studies. We propose 4 primary goals of HTE analyses and the corresponding approaches in the context of RWD: to confirm subgroup effects, to describe the magnitude of HTE, to discover clinically important subgroups, and to predict individual effects. We discuss other possible goals including exploring prognostic score- and propensity score-based treatment effects, and testing the transportability of trial results to populations different from trial participants. Finally, we outline methodological needs for enhancing real-world HTE analysis.
Collapse
Affiliation(s)
- Jodi B. Segal
- Johns Hopkins University School of Medicine, Baltimore, and Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland
| | - Ravi Varadhan
- Johns Hopkins University School of Medicine, Baltimore, and Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland
| | | | | | - Xiaojuan Li
- Harvard Medical School Department of Population Medicine and Harvard Pilgrim Health Care Institute, Boston, Massachusetts
| | - Kaori Nomura
- Jikei University School of Medicine, Tokyo, Japan
| | - Sigal Kaplan
- Teva Pharmaceutical Industries, Petah Tikva, Israel
| | | | - James Heyward
- Johns Hopkins University Bloomberg School of Public Health, Baltimore, Maryland
| | - Fredrik Nyberg
- School of Public Health and Community Medicine, Institute of Medicine, University of Gothenburg, Gothenburg, Sweden
| | | |
Collapse
|
43
|
Hampson LV, Chu J, Zia A, Zhang J, Hsu WC, Parzynski CS, Hao Y, Degtyarev E. Combining the target trial and estimand frameworks to define the causal estimand: an application using real-world data to contextualize a single-arm trial. Stat Biopharm Res 2023. [DOI: 10.1080/19466315.2023.2190931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/17/2023]
Affiliation(s)
| | - Jufen Chu
- Novartis Pharmaceuticals Corporation, East Hanover, NJ, USA
| | | | - Jie Zhang
- Novartis Pharmaceuticals Corporation, East Hanover, NJ, USA
| | | | | | - Yanni Hao
- Novartis Pharmaceuticals Corporation, East Hanover, NJ, USA
| | | |
Collapse
|
44
|
Gatto NM, Vititoe SE, Rubinstein E, Reynolds RF, Campbell UB. A Structured Process to Identify Fit-for-Purpose Study Design and Data to Generate Valid and Transparent Real-World Evidence for Regulatory Uses. Clin Pharmacol Ther 2023; 113:1235-1239. [PMID: 36871138 DOI: 10.1002/cpt.2883] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Accepted: 02/16/2023] [Indexed: 03/06/2023]
Abstract
Generating evidence from real-world data requires fit-for-purpose study design and data. In addition to validity, decision makers require transparency in the reasoning that underlies study design and data source decisions. The 2019 Structured Preapproval and Postapproval Comparative Study Design Framework to Generate Valid and Transparent Real-World Evidence (SPACE) and the 2021 Structured Process to Identify Fit-For-Purpose Data (SPIFD)-intended to be used together-provide a step-by-step guide to identify decision grade, fit-for-purpose study design and data. In this update (referred to as "SPIFD2" to encompass both the design and data aspects) we provide an update to these frameworks that combines the templates into one, more explicitly calls for articulation of the hypothetical target trial and sources of bias that may arise in the real-world emulation, and provides explicit references to the Structured Template and Reporting Tool for Real-World Evidence (STaRT-RWE) tables that we suggest using immediately after invoking the SPIFD2 framework. Following the steps recommended in the SPIFD2 process requires due diligence on the part of the researcher to ensure that every aspect of study design and data selection is rationalized and supported by evidence. The resulting stepwise documentation enables reproducibility and clear communication with decision makers, and it increases the likelihood that the evidence generated is valid, fit-for-purpose, and sufficient to support healthcare and regulatory decisions.
Collapse
Affiliation(s)
- Nicolle M Gatto
- Aetion, Inc., New York, New York, USA.,Columbia Mailman School of Public Health, New York, New York, USA.,Tulane School of Public Health and Tropical Medicine, New Orleans, Louisiana, USA
| | | | | | - Robert F Reynolds
- Tulane School of Public Health and Tropical Medicine, New Orleans, Louisiana, USA.,GSK, New York, New York, USA
| | - Ulka B Campbell
- Aetion, Inc., New York, New York, USA.,Columbia Mailman School of Public Health, New York, New York, USA
| |
Collapse
|
45
|
Khambholja K, Gehani M. Use of Structured Template and Reporting Tool for Real-World Evidence for Critical Appraisal of the Quality of Reporting of Real-World Evidence Studies: A Systematic Review. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2023; 26:427-434. [PMID: 36210293 DOI: 10.1016/j.jval.2022.09.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/20/2022] [Revised: 08/30/2022] [Accepted: 09/01/2022] [Indexed: 06/16/2023]
Abstract
OBJECTIVES Real-world evidence (RWE) studies are increasingly being used to support healthcare decisions. Various frameworks, tools, and checklists exist for ensuring quality of real-world data, designing robust studies, and assessing potential for bias. In January 2021, Structured Template and Reporting Tool for RWE (STaRT-RWE) was released to further reduce ambiguity, assumptions, and misinterpretation while planning, implementing, and reporting RWE studies of the safety and effectiveness of treatments. The objective of this study was to identify gaps in the reporting quality of published RWE studies by using this template for critical appraisal. METHODS Two reviewers conducted a keyword search on PubMed for free-full-text research articles using real-world data, RWE design, and safety with or without effectiveness outcomes of a medicinal product or intervention in humans of any age or gender, published in English between January 13, 2021, and January 13, 2022. Assessment of risk of bias was done using Assessment of Real-World Observational Studies critical appraisal tool. Deficiencies in methods and findings as per STaRT-RWE template were reported as frequencies. RESULTS A total of 54 of 2374 retrieved studies were included in the review. Based on the STaRT-RWE template, the studies inadequately reported empirically defined covariates, power and sample size calculation, attrition, sensitivity analyses, index date (day 0) defining criterion, predefined covariates, outcome, metadata about data source and software, objective, inclusion and exclusion criteria, analysis specifications, and follow-up. CONCLUSIONS The use of STaRT-RWE template along with its tables, design diagram, and library of published studies has a potential of improving robustness of RWE studies.
Collapse
Affiliation(s)
- Kapil Khambholja
- Department of Medical Writing and Real World Evidence, Genpro Research Inc, Waltham, MA, USA.
| | - Manish Gehani
- Department of Medical Writing and Real World Evidence, Genpro Research Pvt Ltd, Thiruvananthapuram, India
| |
Collapse
|
46
|
Li Y, Tian Y, Pei S, Xie B, Xu X, Wang B. Worldwide Trends in Registering Real-World Studies at ClinicalTrials.gov: A Cross-Sectional Analysis. Int J Gen Med 2023; 16:1123-1136. [PMID: 37007912 PMCID: PMC10065426 DOI: 10.2147/ijgm.s402478] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 03/22/2023] [Indexed: 03/29/2023] Open
Abstract
Objective The purpose of this study was to characterize real-world studies (RWSs) registered at ClinicalTrials.gov to help investigators better conduct relevant research in clinical practice. Methods A retrospective analysis of 944 studies was performed on February 28, 2023. Results A total of 944 studies were included. The included studies involved a total of 48 countries. China was the leading country in terms of the total number of registered studies (37.9%, 358), followed by the United States (19.7%, 186). Regarding intervention type, 42.4% (400) of the studies involved drugs, and only 9.1% (86) of the studies involved devices. Only 8.5% (80) of the studies mentioned both the detailed study design type and data source in the "Brief Summary". A total of 49.4% (466) of studies had a sample size of 500 participants and above. Overall, 63% (595) of the studies were single-center studies. A total of 213 conditions were covered in the included studies. One-third of the studies (32.7%, 309) involved neoplasms (or tumors). China and the United States were very different regarding the study of different conditions. Conclusion Although the pandemic has provided new opportunities for RWSs, the rigor of scientific research still needs to be emphasized. Special attention needs to be given to the correct and comprehensive description of the study design in the Brief Summary of registered studies, thereby promoting communication and understanding. In addition, deficiencies in ClinicalTrials.gov registration data remain prominent.
Collapse
Affiliation(s)
- Yuanxiao Li
- Department of Pediatric Gastroenterology, Lanzhou University Second Hospital, Lanzhou, People’s Republic of China
| | - Ying Tian
- Department of Clinical Medicine, Lanzhou University Second Hospital, Lanzhou, People’s Republic of China
| | - Shufen Pei
- Department of Clinical Medicine, North Sichuan Medical College, Nanchong, People’s Republic of China
| | - Baoyuan Xie
- Department of Clinical Medicine, Lanzhou University Second Hospital, Lanzhou, People’s Republic of China
| | - Xiaonan Xu
- Department of Pediatric Gastroenterology, Lanzhou University Second Hospital, Lanzhou, People’s Republic of China
| | - Bin Wang
- Department of Infectious Diseases, Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, People’s Republic of China
- Correspondence: Bin Wang, 88 Jie Fang Lu, Shangcheng District, Hangzhou, Zhejiang, 310009, People’s Republic of China, Email
| |
Collapse
|
47
|
Ho M, Gruber S, Fang Y, Faris DE, Mishra-Kalyani P, Benkeser D, van der Laan M. Examples of Applying RWE Causal-Inference Roadmap to Clinical Studies. Stat Biopharm Res 2023. [DOI: 10.1080/19466315.2023.2177333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/10/2023]
|
48
|
Tang M, Pearson SA, Simes RJ, Chua BH. Harnessing Real-World Evidence to Advance Cancer Research. Curr Oncol 2023; 30:1844-1859. [PMID: 36826104 PMCID: PMC9955401 DOI: 10.3390/curroncol30020143] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 01/16/2023] [Accepted: 01/30/2023] [Indexed: 02/05/2023] Open
Abstract
Randomized controlled trials (RCTs) form a cornerstone of oncology research by generating evidence about the efficacy of therapies in selected patient populations. However, their implementation is often resource- and cost-intensive, and their generalisability to patients treated in routine practice may be limited. Real-world evidence leverages data collected about patients receiving clinical care in routine practice outside of clinical trial settings and provides opportunities to identify and address gaps in clinical trial evidence. This review outlines the strengths and limitations of real-world and RCT evidence and proposes a framework for the complementary use of the two bodies of evidence to advance cancer research. There are challenges to the implementation of real-world research in oncology, including heterogeneity of data sources, timely access to high-quality data, and concerns about the quality of methods leveraging real-world data, particularly causal inference. Improved understanding of the strengths and limitations of real-world data and ongoing efforts to optimise the conduct of real-world evidence research will improve its reliability, understanding and acceptance, and enable the full potential of real-world evidence to be realised in oncology practice.
Collapse
Affiliation(s)
- Monica Tang
- Nelune Comprehensive Cancer Centre, Prince of Wales Hospital, Randwick 2031, Australia
- Correspondence:
| | | | - Robert J. Simes
- NHMRC Clinical Trials Centre, University of Sydney, Camperdown 2050, Australia
| | - Boon H. Chua
- Nelune Comprehensive Cancer Centre, Prince of Wales Hospital, Randwick 2031, Australia
- Faculty of Medicine and Health, UNSW Sydney, Sydney 2052, Australia
| |
Collapse
|
49
|
Rassen JA, Blin P, Kloss S, Neugebauer RS, Platt RW, Pottegård A, Schneeweiss S, Toh S. High-dimensional propensity scores for empirical covariate selection in secondary database studies: Planning, implementation, and reporting. Pharmacoepidemiol Drug Saf 2023; 32:93-106. [PMID: 36349471 PMCID: PMC10099872 DOI: 10.1002/pds.5566] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2022] [Revised: 09/14/2022] [Accepted: 10/17/2022] [Indexed: 11/11/2022]
Abstract
Real-world evidence used for regulatory, payer, and clinical decision-making requires principled epidemiology in design and analysis, applying methods to minimize confounding given the lack of randomization. One technique to deal with potential confounding is propensity score (PS) analysis, which allows for the adjustment for measured preexposure covariates. Since its first publication in 2009, the high-dimensional propensity score (hdPS) method has emerged as an approach that extends traditional PS covariate selection to include large numbers of covariates that may reduce confounding bias in the analysis of healthcare databases. hdPS is an automated, data-driven analytic approach for covariate selection that empirically identifies preexposure variables and proxies to include in the PS model. This article provides an overview of the hdPS approach and recommendations on the planning, implementation, and reporting of hdPS used for causal treatment-effect estimations in longitudinal healthcare databases. We supply a checklist with key considerations as a supportive decision tool to aid investigators in the implementation and transparent reporting of hdPS techniques, and to aid decision-makers unfamiliar with hdPS in the understanding and interpretation of studies employing this approach. This article is endorsed by the International Society for Pharmacoepidemiology.
Collapse
Affiliation(s)
| | - Patrick Blin
- Bordeaux PharmacoEpi, Bordeaux University, INSERM CIC‐P 1401BordeauxFrance
| | - Sebastian Kloss
- EMEA Real‐World Evidence & Value‐Based HealthcareJanssenBerlinGermany
| | | | - Robert W. Platt
- Professor, Departments of Pediatrics and of Epidemiology, Biostatistics, and Occupational HealthMcGill UniversityMontrealQuebecCanada
| | - Anton Pottegård
- Clinical Pharmacology, Pharmacy and Environmental Medicine, Department of Public HealthUniversity of Southern DenmarkOdenseDenmark
| | - Sebastian Schneeweiss
- Division of Pharmacoepidemiology and PharmacoeconomicsBrigham and Women's Hospital, Harvard Medical SchoolBostonMassachusettsUSA
| | - Sengwee Toh
- Department of Population MedicineHarvard Medical School and Harvard Pilgrim Health Care InstituteBostonMassachusettsUSA
| |
Collapse
|
50
|
Syndrome d’apnées du sommeil 1999–2022 : des essais randomisés aux études de cohorte. BULLETIN DE L'ACADÉMIE NATIONALE DE MÉDECINE 2023. [DOI: 10.1016/j.banm.2022.10.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/03/2023]
|