1
|
Tanaka S, Igarashi A, De Moor R, Li N, Hirozane M, Hong LW, Wu DBC, Yu DY, Hashim M, Hutton B, Tantakoun K, Olsen C, Mirzayeh Fashami F, Samjoo IA, Cameron C. A Targeted Review of Worldwide Indirect Treatment Comparison Guidelines and Best Practices. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2024; 27:1179-1190. [PMID: 38843980 DOI: 10.1016/j.jval.2024.05.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 05/10/2024] [Accepted: 05/21/2024] [Indexed: 07/07/2024]
Abstract
OBJECTIVES Controls and governance over the methodology and reporting of indirect treatment comparisons (ITCs) have been introduced to minimize bias and ensure scientific credibility and transparency in healthcare decision making. The objective of this study was to highlight ITC techniques that are key to conducting objective and analytically sound analyses and to ascertain circumstantial suitability of ITCs as a source of comparative evidence for healthcare interventions. METHODS Ovid MEDLINE was searched from January 2010 through August 2023 to identify publicly available ITC-related documents (ie, guidelines and best practices) in the English language. This was supplemented with hand searches of websites of various international organizations, regulatory agencies, and reimbursement agencies of Europe, North America, and Asia-Pacific. The jurisdiction-specific ITC methodology and reporting recommendations were reviewed. RESULTS Sixty-eight guidelines from 10 authorities worldwide were included for synthesis. Many of the included guidelines were updated within the last 5 years and commonly cited the absence of direct comparative studies as primary justification for using ITCs. Most jurisdictions favored population-adjusted or anchored ITC techniques opposed to naive comparisons. Recommendations on the reporting and presentation of these ITCs varied across authorities; however, there was some overlap among the key elements. CONCLUSIONS Given the challenges of conducting head-to-head randomized controlled trials, comparative data from ITCs offer valuable insights into clinical-effectiveness. As such, multiple ITC guidelines have emerged worldwide. According to the most recent versions of the guidelines, the suitability and subsequent acceptability of the ITC technique used depends on the data sources, available evidence, and magnitude of benefit/uncertainty.
Collapse
Affiliation(s)
- Shiro Tanaka
- Faculty of medicine, Kyoto University, Kyoto, Japan
| | - Ataru Igarashi
- Unit of Public Health and Preventive Medicine, Yokohama City University School of Medicine, Yokohama, Japan
| | - Raf De Moor
- Value, Evidence and Access Department, IMAT, Janssen Pharmaceutical K.K., Tokyo, Japan
| | - Nan Li
- Value, Evidence and Access Department, IMAT, Janssen Pharmaceutical K.K., Tokyo, Japan
| | - Mariko Hirozane
- Policy Department, IMAT, Janssen Pharmaceutical K.K., Tokyo, Japan
| | - Li Wen Hong
- Asia Pacific Regional Market Access, Janssen Pharmaceutical Companies of Johnson and Johnson, Singapore
| | - David Bin-Chia Wu
- Asia Pacific Regional Market Access, Janssen Pharmaceutical Companies of Johnson and Johnson, Singapore; Saw Swee Hock School of Public Health, National University of Singapore, Singapore
| | - Dae Young Yu
- Asia Pacific Regional Market Access, Janssen Pharmaceutical Companies of Johnson and Johnson, Singapore
| | - Mahmoud Hashim
- Janssen Vaccines and Prevention B.V., Leiden, The Netherlands
| | - Brian Hutton
- Ottawa Hospital Research Institute, Ottawa, ON, Canada
| | | | | | | | | | - Chris Cameron
- Value and Evidence, EVERSANA, Burlington, ON, Canada.
| |
Collapse
|
2
|
Egelseer-Bruendl T, Jahn B, Arvandi M, Puntscher S, Santamaria J, Brunelli L, Weissenegger K, Pfeifer B, Neururer S, Rissbacher C, Huber A, Fetz B, Kleinheinz C, Modre-Osprian R, Kreiner K, Siebert U, Poelzl G. Cost-effectiveness of a multidimensional post-discharge disease management program for heart failure patients-economic evaluation along a one-year observation period. Clin Res Cardiol 2024; 113:1232-1241. [PMID: 38353683 PMCID: PMC11269486 DOI: 10.1007/s00392-024-02395-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Accepted: 02/02/2024] [Indexed: 07/26/2024]
Abstract
OBJECTIVE This study aimed to assess the cost-effectiveness of the telemedically assisted post-discharge management program (DMP) HerzMobil Tirol (HMT) for heart failure (HF) patients in clinical practice in Austria. METHODS We conducted a cost-effectiveness analysis along a retrospective cohort study (2016-2019) of HMT with a propensity score matched cohort of 251 individuals in the HMT and 257 in the usual care (UC) group and a 1-year follow-up. We calculated the effectiveness (hospital-free survival, hospital-free life-years gained, and number of avoided rehospitalizations), costs (HMT, rehospitalizations), and the incremental cost-effectiveness ratio (ICER). We performed a nonparametric sensitivity analysis with bootstrap sampling and sensitivity analyses on costs of HF rehospitalizations and on costs per disease-related diagnosis (DRG) score for rehospitalizations. RESULTS Base-case analysis showed that HMT resulted in an average of 42 additional hospital-free days, 40 additional days alive, and 0.12 avoided hospitalizations per patient-year compared with UC during follow-up. The average HMT costs were EUR 1916 per person. Mean rehospitalization costs were EUR 5551 in HMT and EUR 6943 in UC. The ICER of HMT compared to UC was EUR 4773 per life-year gained outside the hospital. In a sensitivity analysis, HMT was cost-saving when "non-HF related costs" related to the DMP were replaced with average costs. CONCLUSIONS The economic evaluation along the cohort study showed that the HerzMobil Tirol is very cost-effective compared to UC and cost-saving in a sensitivity analysis correcting for "non-HF related costs." These findings promote a widespread adoption of telemedicine-assisted DMP for HF.
Collapse
Affiliation(s)
- T Egelseer-Bruendl
- Clinical Division of Orthopaedics and Traumatology, Medical University of Innsbruck, Innsbruck, Austria
| | - B Jahn
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL-University for Health Sciences and Technology, Hall in Tirol, Austria
| | - M Arvandi
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL-University for Health Sciences and Technology, Hall in Tirol, Austria
| | - S Puntscher
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL-University for Health Sciences and Technology, Hall in Tirol, Austria
| | - J Santamaria
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL-University for Health Sciences and Technology, Hall in Tirol, Austria
| | - L Brunelli
- Department of Internal Medicine III, Cardiology & Angiology, Medical University of Innsbruck, Innsbruck, Austria
- Interdisciplinary Heart Failure Center Tirol, IHZ, Anichstraße 35, 6020, Innsbruck, Tyrol, Austria
| | - K Weissenegger
- Department of Internal Medicine III, Cardiology & Angiology, Medical University of Innsbruck, Innsbruck, Austria
| | - B Pfeifer
- Tyrolean Federal Institute for Integrated Care, Tirol Kliniken GmbH, Innsbruck, Austria
- Division for Digital Medicine and Telehealth, UMIT TIROL - Private University for Health Sciences and Health Technology, Hall (Tyrol), Austria
| | - S Neururer
- Tyrolean Federal Institute for Integrated Care, Tirol Kliniken GmbH, Innsbruck, Austria
- Division for Digital Medicine and Telehealth, UMIT TIROL - Private University for Health Sciences and Health Technology, Hall (Tyrol), Austria
| | - C Rissbacher
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL-University for Health Sciences and Technology, Hall in Tirol, Austria
- State Hospital - University Hospital, Innsbruck, Austria
| | - A Huber
- Department of Health, Federal State of Tyrol, Innsbruck, Austria
| | - B Fetz
- Tyrolean Federal Institute for Integrated Care, Tirol Kliniken GmbH, Innsbruck, Austria
| | - C Kleinheinz
- Tyrolean Federal Institute for Integrated Care, Tirol Kliniken GmbH, Innsbruck, Austria
| | | | - K Kreiner
- Center for Health & Bioresources, AIT Austrian Institute of Technology, Graz, Austria
| | - U Siebert
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL-University for Health Sciences and Technology, Hall in Tirol, Austria
- Program On Cardiovascular Research, Institute for Technology Assessment and Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
- Center for Health Decision Science and Departments of Epidemiology and Health Policy & Management, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - G Poelzl
- Department of Internal Medicine III, Cardiology & Angiology, Medical University of Innsbruck, Innsbruck, Austria.
- Interdisciplinary Heart Failure Center Tirol, IHZ, Anichstraße 35, 6020, Innsbruck, Tyrol, Austria.
| |
Collapse
|
3
|
Wang C, Nie P, Wang P, Wang Y, Zang Y, Zhang Y. The Therapeutic Effect of Transcranial Magnetic Stimulation on Post-stroke Aphasia and the Optimal Treatment Parameters: A Meta-analysis. Arch Phys Med Rehabil 2024; 105:1388-1398. [PMID: 37984539 DOI: 10.1016/j.apmr.2023.11.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Revised: 10/23/2023] [Accepted: 11/10/2023] [Indexed: 11/22/2023]
Abstract
OBJECTIVE This meta-analysis aimed to examine the overall effectiveness of TMS on post-stroke aphasia using a meta-analysis approach, as well as examine the effect of moderating variables (eg, study design, TMS protocol) on the effectiveness of TMS. DATA SOURCES A keyword search was conducted in 5 databases: ERIC, Google Scholar, PsycINFO, MEDLINE, and ProQuest (01/1985-12/2022). The search algorithm included all possible combinations of relevant keywords. Full-text articles were thoroughly examined using forward/backward search methods. STUDY SELECTION Studies were thoroughly screened using the following inclusion criteria: patients were diagnosed with post-stroke aphasia; studies focused on the effect of TMS on post-stroke aphasia; language assessments were conducted at pretest and posttest for TMS treatment and data were reported; studies included both an experimental group (ie, a group with TMS treatment) and a control group (ie, a group without TMS treatment). DATA EXTRACTION Information was extracted from each study including authors, publication year, first language of participants, study design, stroke duration, demographics of participants, TMS protocol, stimulation site, targeting, and statistical data of language performance pre- and post-TMS treatment. DATA SYNTHESIS A total of 17 studies were included in the final review, involving 682 patients with post-stroke aphasia (348 in the experimental group, 334 in the control group). The results showed that TMS treatment has significant immediate (Hedges' g=0.37) and maintenance (Hedges' g=0.34) effects on post-stroke aphasia. Additionally, the moderating variables showed a moderation effect on the effectiveness of TMS. CONCLUSION TMS treatment can significantly improve language ability for post-stroke aphasia. Additionally, this study provides an important reference for selecting the optimal TMS treatment parameters in treating post-stroke aphasia. Specifically, administering 15 sessions of rTMS lasting 10 min over the mirror area within Broca's area may produce the best TMS treatment outcomes.
Collapse
Affiliation(s)
- Cuicui Wang
- Zhejiang Philosophy and Social Science Laboratory for Research in Early Development and Childcare, Hangzhou Normal University, Hangzhou, China; College of Education, Hangzhou Normal University, Hangzhou, China; TMS Center, Deqing Hospital of Hangzhou Normal University, China; Center for Cognition and Brain Disorders, The Affiliated Hospital of Hangzhou Normal University, Hangzhou, China
| | - Peixin Nie
- Cognitive Brain Research Unit, Faculty of Medicine, University of Helsinki, Finland; Centre of Excellence in Music, Mind, Body, and Brain, Faculty of Medicine, University of Helsinki, Finland
| | - Peng Wang
- Center for Cognition and Brain Disorders, The Affiliated Hospital of Hangzhou Normal University, Hangzhou, China; University of Greifswald, Institute of Psychology, Greifswald, Germany
| | - Yunxia Wang
- Center for Cognition and Brain Disorders, The Affiliated Hospital of Hangzhou Normal University, Hangzhou, China
| | - Yufeng Zang
- TMS Center, Deqing Hospital of Hangzhou Normal University, China; Center for Cognition and Brain Disorders, The Affiliated Hospital of Hangzhou Normal University, Hangzhou, China; Institute of Psychological Sciences, Hangzhou Normal University, Hangzhou, China; Zhejiang Key Laboratory for Research in Assessment of Cognitive Impairments, Hangzhou Normal University, Hangzhou, China
| | - Ye Zhang
- Center for Cognition and Brain Disorders, The Affiliated Hospital of Hangzhou Normal University, Hangzhou, China; Institute of Psychological Sciences, Hangzhou Normal University, Hangzhou, China; Zhejiang Key Laboratory for Research in Assessment of Cognitive Impairments, Hangzhou Normal University, Hangzhou, China.
| |
Collapse
|
4
|
van Nassau SCMW, Bol GM, van der Baan FH, Roodhart JML, Vink GR, Punt CJA, May AM, Koopman M, Derksen JWG. Harnessing the Potential of Real-World Evidence in the Treatment of Colorectal Cancer: Where Do We Stand? Curr Treat Options Oncol 2024; 25:405-426. [PMID: 38367182 PMCID: PMC10997699 DOI: 10.1007/s11864-024-01186-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/17/2024] [Indexed: 02/19/2024]
Abstract
OPINION STATEMENT Treatment guidelines for colorectal cancer (CRC) are primarily based on the results of randomized clinical trials (RCTs), the gold standard methodology to evaluate safety and efficacy of oncological treatments. However, generalizability of trial results is often limited due to stringent eligibility criteria, underrepresentation of specific populations, and more heterogeneity in clinical practice. This may result in an efficacy-effectiveness gap and uncertainty regarding meaningful benefit versus treatment harm. Meanwhile, conduct of traditional RCTs has become increasingly challenging due to identification of a growing number of (small) molecular subtypes. These challenges-combined with the digitalization of health records-have led to growing interest in use of real-world data (RWD) to complement evidence from RCTs. RWD is used to evaluate epidemiological trends, quality of care, treatment effectiveness, long-term (rare) safety, and quality of life (QoL) measures. In addition, RWD is increasingly considered in decision-making by clinicians, regulators, and payers. In this narrative review, we elaborate on these applications in CRC, and provide illustrative examples. As long as the quality of RWD is safeguarded, ongoing developments, such as common data models, federated learning, and predictive modelling, will further unfold its potential. First, whenever possible, we recommend conducting pragmatic trials, such as registry-based RCTs, to optimize generalizability and answer clinical questions that are not addressed in registrational trials. Second, we argue that marketing approval should be conditional for patients who would have been ineligible for the registrational trial, awaiting planned (non) randomized evaluation of outcomes in the real world. Third, high-quality effectiveness results should be incorporated in treatment guidelines to aid in patient counseling. We believe that a coordinated effort from all stakeholders is essential to improve the quality of RWD, create a learning healthcare system with optimal use of trials and real-world evidence (RWE), and ultimately ensure personalized care for every CRC patient.
Collapse
Affiliation(s)
- Sietske C M W van Nassau
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Heidelberglaan 100, PO Box 85500, Utrecht, 3584 CX, The Netherlands.
| | - Guus M Bol
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Heidelberglaan 100, PO Box 85500, Utrecht, 3584 CX, The Netherlands
| | - Frederieke H van der Baan
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Heidelberglaan 100, PO Box 85500, Utrecht, 3584 CX, The Netherlands
- Department of Epidemiology & Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Jeanine M L Roodhart
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Heidelberglaan 100, PO Box 85500, Utrecht, 3584 CX, The Netherlands
| | - Geraldine R Vink
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Heidelberglaan 100, PO Box 85500, Utrecht, 3584 CX, The Netherlands
- Department of Research and Development, Netherlands Comprehensive Cancer Organisation (IKNL), Utrecht, The Netherlands
| | - Cornelis J A Punt
- Department of Epidemiology & Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Anne M May
- Department of Epidemiology & Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Miriam Koopman
- Department of Medical Oncology, University Medical Center Utrecht, Utrecht University, Heidelberglaan 100, PO Box 85500, Utrecht, 3584 CX, The Netherlands
| | - Jeroen W G Derksen
- Department of Epidemiology & Health Economics, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| |
Collapse
|
5
|
Corbeil O, Brodeur S, Courteau J, Béchard L, Huot-Lavoie M, Angelopoulos E, Di Stefano S, Marrone E, Vanasse A, Fleury MJ, Stip E, Lesage A, Joober R, Demers MF, Roy MA. Treatment with psychostimulants and atomoxetine in people with psychotic disorders: reassessing the risk of clinical deterioration in a real-world setting. Br J Psychiatry 2024; 224:98-105. [PMID: 38044665 PMCID: PMC10884826 DOI: 10.1192/bjp.2023.149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/25/2023] [Revised: 09/18/2023] [Accepted: 10/17/2023] [Indexed: 12/05/2023]
Abstract
BACKGROUND Although attention-deficit hyperactivity disorder (ADHD) is often comorbid with schizophrenia spectrum and other psychotic disorders (SZSPD), concerns about an increased risk of psychotic events have limited its treatment with either psychostimulants or atomoxetine. AIMS To examine whether the risk of hospital admission for psychosis in people with SZSPD was increased during the year following the introduction of such medications compared with the year before. METHOD This was a retrospective cohort study using Quebec (Canada) administrative health registries, including all Quebec residents with a public prescription drug insurance plan and a diagnosis of psychotic disorder, defined by relevant ICD-9 or ICD-10 codes, who initiated either methylphenidate, amphetamines or atomoxetine, between January 2010 and December 2016, in combination with antipsychotic medication. The primary outcome was time to hospital admission for psychosis within 1 year of initiation. State sequence analysis was also used to visualise admission trajectories for psychosis in the year following initiation of these medications, compared with the previous year. RESULTS Out of 2219 individuals, 1589 (71.6%) initiated methylphenidate, 339 (15.3%) amphetamines and 291 (13.1%) atomoxetine during the study period. After adjustment, the risk of hospital admission for psychosis was decreased during the 12 months following the introduction of these medications when used in combination with antipsychotics (adjusted HR = 0.36, 95% CI 0.24-0.54; P < 0.0001). CONCLUSIONS These findings suggest that, in a real-world setting, when used concurrently with antipsychotic medication, methylphenidate, amphetamines and atomoxetine may be safer than generally believed in individuals with psychotic disorders.
Collapse
Affiliation(s)
| | - Sébastien Brodeur
- Department of Psychiatry and Neurosciences, Laval University, Quebec, Canada; and Institute of Psychiatry, Psychology and Neuroscience, King's College London, UK
| | - Josiane Courteau
- PRIMUS Research Group, Research Centre of Sherbrooke University Hospital Center (CRCHUS), Sherbrooke, Canada
| | | | | | | | | | - Erica Marrone
- Faculty of Pharmacy, Laval University, Quebec, Canada
| | - Alain Vanasse
- PRIMUS Research Group, Research Centre of Sherbrooke University Hospital Center (CRCHUS), Sherbrooke, Canada; and Department of Family Medicine and Urgent Medicine, University of Sherbrooke, Sherbrooke, Canada
| | - Marie-Josée Fleury
- Douglas Research Centre, Douglas Mental Health University Institute, Montreal, Canada; and Department of Psychiatry, McGill University, Montreal, Canada
| | - Emmanuel Stip
- Department de Psychiatry and Addictology, University of Montreal, Montreal, Canada; and Department of Psychiatry and Behavioral Science, College of Medicine and Health Science, United Arab Emirates University, Al Ain, UAE
| | - Alain Lesage
- Department of Psychiatry and Addictology, University of Montreal, Montreal, Canada; and Research Centre, Montreal University Institute of Mental Health, Montreal, Canada
| | - Ridha Joober
- Douglas Research Centre, Douglas Mental Health University Institute, Montreal, Canada; and Department of Psychiatry, McGill University, Montreal, Canada
| | - Marie-France Demers
- Faculty of Pharmacy, Laval University, Quebec, Canada; and CERVO Research Centre, Quebec, Canada
| | - Marc-André Roy
- Department of Psychiatry and Neurosciences, Laval University, Quebec, Canada; and CERVO Research Centre, Quebec, Canada
| |
Collapse
|
6
|
Coates G, Clewes P, Lohan C, Stevenson H, Wood R, Tritton T, Knaggs RD, Dickson AJ, Walsh DA. Chronic Low Back Pain with and without Concomitant Osteoarthritis: A Retrospective, Longitudinal Cohort Study of Patients in England. Int J Clin Pract 2023; 2023:5105810. [PMID: 38020538 PMCID: PMC10653975 DOI: 10.1155/2023/5105810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Revised: 09/18/2023] [Accepted: 10/10/2023] [Indexed: 12/01/2023] Open
Abstract
Objective Despite the high prevalence of chronic low back pain (CLBP) and osteoarthritis (OA), few estimates of the economic cost of these conditions in England have been published. The aim of the present analysis was to characterise the economic burden of moderate-to-severe pain associated with CLBP + OA and CLBP alone compared with general population-matched controls without CLBP or OA. The primary objective was to describe the total healthcare resource use (HCRU) and direct healthcare costs associated with the target patient populations. Secondary objectives were to describe treatment patterns and surgical procedures. Methods This was a retrospective, observational cohort study of patients receiving healthcare indicative of moderate-to-severe chronic pain associated with CLBP, with or without OA. We used linked longitudinal data from the Clinical Practice Research Datalink GOLD and Hospital Episode Statistics (HES). Patients (cases) were matched 1 : 1 with controls on age, sex, comorbidity burden, GP practice, and HES data availability. Results The CLBP-alone cohort comprised 13 554 cases with CLBP and 13 554 matched controls; the CLBP + OA cohort comprised 7803 cases with both OA and CLBP and 7803 matched controls. Across all follow-up periods, patients with CLBP alone and those with CLBP + OA had significantly more GP consultations, outpatient attendances, emergency department visits, and inpatient stays than controls (all p < 0.0001). By 36 months after indexing, the mean (SD) per-patient total direct healthcare cost in the CLBP-alone cohort was £5081 (£5905) for cases and £1809 (£4451) for controls (p < 0.0001); in the CLBP + OA cohort, the mean (SD) per-patient total direct healthcare cost was £8819 (£7143) for cases and £2428 (£4280) for controls (p < 0.0001). Conclusion Moderate-to-severe chronic pain associated with CLBP-with or without OA-has a substantial impact on patients and healthcare providers, leading to higher HCRU and costs versus controls among people with CLBP alone or together with OA.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Roger D. Knaggs
- Pain Centre Versus Arthritis and NIHR Nottingham Biomedical Research Centre, School of Medicine, University of Nottingham, Nottingham, UK
| | - Alastair J. Dickson
- Primary Care Rheumatology & Musculoskeletal Medicine Society, York, UK
- The North of England Low Back Pain Pathway, NIHR Applied Research Collaboration (ARC) North East and North Cumbria, St. Nicholas' Hospital, Newcastle Upon Tyne, UK
- AD Outcomes Ltd., York, UK
| | - David A. Walsh
- Pain Centre Versus Arthritis and NIHR Nottingham Biomedical Research Centre, School of Medicine, University of Nottingham, Nottingham, UK
| |
Collapse
|
7
|
Harskamp RE, De Clercq L, Veelers L, Schut MC, van Weert HCPM, Handoko ML, Moll van Charante EP, Himmelreich JCL. Diagnostic properties of natriuretic peptides and opportunities for personalized thresholds for detecting heart failure in primary care. Diagnosis (Berl) 2023; 10:432-439. [PMID: 37667563 DOI: 10.1515/dx-2023-0089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Accepted: 08/25/2023] [Indexed: 09/06/2023]
Abstract
OBJECTIVES Heart failure (HF) is a prevalent syndrome with considerable disease burden, healthcare utilization and costs. Timely diagnosis is essential to improve outcomes. This study aimed to compare the diagnostic performance of B-type natriuretic peptide (BNP) and N-terminal proBNP (NT-proBNP) in detecting HF in primary care. Our second aim was to explore if personalized thresholds (using age, sex, or other readily available parameters) would further improve diagnostic accuracy over universal thresholds. METHODS A retrospective study was performed among patients without prior HF who underwent natriuretic peptide (NP) testing in the Amsterdam General Practice Network between January 2011 and December 2021. HF incidence was based on registration out to 90 days after NP testing. Diagnostic accuracy was evaluated with AUROC, sensitivity and specificity based on guideline-recommended thresholds (125 ng/L for NT-proBNP and 35 ng/L for BNP). We used inverse probability of treatment weighting to adjust for confounding. RESULTS A total of 15,234 patients underwent NP testing, 6,870 with BNP (4.5 % had HF), and 8,364 with NT-proBNP (5.7 % had HF). NT-proBNP was more accurate than BNP, with an AUROC of 89.9 % (95 % CI: 88.4-91.2) vs. 85.9 % (95 % CI 83.5-88.2), with higher sensitivity (95.3 vs. 89.7 %) and specificity (59.1 vs. 58.0 %). Differentiating NP cut-off by clinical variables modestly improved diagnostic accuracy for BNP and NT-proBNP compared with a universal threshold. CONCLUSIONS NT-proBNP outperforms BNP for detecting HF in primary care. Personalized instead of universal diagnostic thresholds led to modest improvement.
Collapse
Affiliation(s)
- Ralf E Harskamp
- Department of General Practice, Amsterdam UMC Location University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
- Amsterdam Cardiovascular Sciences Research Institute, Amsterdam, The Netherlands
| | - Lukas De Clercq
- Department of General Practice, Amsterdam UMC Location University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Lieke Veelers
- Department of General Practice, Amsterdam UMC Location University of Amsterdam, Amsterdam, The Netherlands
| | - Martijn C Schut
- Department of Laboratory Medicine, Translational AI. Amsterdam UMC, Amsterdam, The Netherlands
| | - Henk C P M van Weert
- Department of General Practice, Amsterdam UMC Location University of Amsterdam, Amsterdam, The Netherlands
| | - M Louis Handoko
- Department of Cardiology, Amsterdam UMC Location VU University, Amsterdam, The Netherlands
- Amsterdam Cardiovascular Sciences Research Institute, Amsterdam, The Netherlands
| | - Eric P Moll van Charante
- Department of General Practice, Amsterdam UMC Location University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Jelle C L Himmelreich
- Department of General Practice, Amsterdam UMC Location University of Amsterdam, Amsterdam, The Netherlands
- Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
- Amsterdam Cardiovascular Sciences Research Institute, Amsterdam, The Netherlands
| |
Collapse
|
8
|
Coates G, Clewes P, Lohan C, Stevenson H, Wood R, Tritton T, Knaggs R, Dickson AJ, Walsh D. Health economic impact of moderate-to-severe chronic pain associated with osteoarthritis in England: a retrospective analysis of linked primary and secondary care data. BMJ Open 2023; 13:e067545. [PMID: 37438077 DOI: 10.1136/bmjopen-2022-067545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 07/14/2023] Open
Abstract
OBJECTIVE Despite the prevalence of osteoarthritis (OA) in England, few studies have examined the health economic impact of chronic pain associated with OA. The aim of this study was to compare outcomes in patients with moderate-to-severe chronic pain associated with OA and matched controls without known OA. DESIGN Retrospective, longitudinal, observational cohort study. SETTING Electronic records extracted from the Clinical Practice Research Datalink GOLD primary care database linked to Hospital Episode Statistics (HES) data set. PARTICIPANTS Patients (cases; n=5931) ≥18 years and with existing diagnosis of OA and moderate-to-severe pain associated with their OA, and controls matched on age, sex, comorbidity burden, general practitioner (GP) practice and availability of HES data. INTERVENTIONS None. PRIMARY AND SECONDARY OUTCOME MEASURES Total healthcare resource use (HCRU) and direct healthcare costs during 0-6, 0-12, 0-24 and 0-36 months of follow-up. Secondary outcomes measures included pharmacological management and time to total joint replacement. RESULTS Patients with moderate-to-severe chronic pain associated with OA used significantly more healthcare services versus matched controls, reflected by higher HCRU and significantly higher direct costs. During the first 12 months' follow-up, cases had significantly more GP consultations, outpatient attendances, emergency department visits and inpatient stays than matched controls (all p<0.0001). Total mean costs incurred by cases during 0-12 months' follow-up were five times higher in cases versus controls (mean (SD): £4199 (£3966) vs £781 (£2073), respectively). Extensive cycling through pharmacological therapies was observed; among cases, 2040 (34.4%), 1340 (22.6%), 841 (14.2%), 459 (7.7%) and 706 (11.9%) received 1-5, 6-10, 11-15, 16-20 and >20 lines of therapy, respectively. CONCLUSIONS This wide-ranging, longitudinal, observational study of real-world primary and secondary care data demonstrates the impact of moderate-to-severe chronic pain associated with OA in patients compared with matched controls. Further studies are required to fully quantify the health economic burden of moderate-to-severe pain associated with OA.
Collapse
Affiliation(s)
| | | | - Christoph Lohan
- Pfizer Australia Pty Ltd, Sydney, New South Wales, Australia
| | | | | | | | - Roger Knaggs
- Pain Centre Versus Arthritis and NIHR Nottingham Biomedical Research Centre, School of Medicine, University of Nottingham, Nottingham, UK
| | - Alastair J Dickson
- Primary Care Rheumatology & Musculoskeletal Medicine Society, York, UK
- The North of England Low Back Pain Pathway, NIHR Applied Research Collaboration North East and North Cumbria, St Nicholas' Hospital, Newcastle Upon Tyne, UK
- AD Outcomes Ltd, York, UK
| | - David Walsh
- Pain Centre Versus Arthritis and NIHR Nottingham Biomedical Research Centre, School of Medicine, University of Nottingham, Nottingham, UK
| |
Collapse
|
9
|
Hidayat K, Zhou YY, Du HZ, Qin LQ, Shi BM, Li ZN. A systematic review and meta-analysis of observational studies of the association between the use of incretin-based therapies and the risk of pancreatic cancer. Pharmacoepidemiol Drug Saf 2023; 32:107-125. [PMID: 36224724 DOI: 10.1002/pds.5550] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 09/25/2022] [Accepted: 10/04/2022] [Indexed: 01/26/2023]
Abstract
BACKGROUND Some early reports in the medical literature have raised concern about a possible increased risk of pancreatic cancer associated with the use of two broad classes of incretin-based therapies, dipeptidyl peptidase-4 inhibitors, and glucagon-like peptide-1 receptor agonists. This possibility has been somewhat mitigated by the null findings meta-analyses of randomized controlled trials, but the usefulness of their findings was hampered by serious shortcomings of lack of power and representativeness. These shortcomings can typically be addressed by observational studies, but observational studies on the topic have yielded conflicting findings. A systematic review and meta-analysis of observational studies was performed to qualitatively and quantitatively appraise the totality of evidence on the association between the use of incretin-based therapies and the risk of pancreatic cancer in routine clinical practice. METHODS The PubMed, Web of Science, Embase, and Google Scholar databases were searched. The study quality was appraised using the ROBINS-I tool and based on the presence of pharmacoepidemiology biases. A random-effects model was used to estimate the summary relative risks with corresponding CIs. RESULTS A total of 14 studies were included. The qualitative assessment revealed that all studies had inadequate follow-up (≤5 years), 12 studies were suspected to suffer from time-lag bias (due to inappropriate choice of comparator group) to varying extent, five studies included prevalent users, five studies did not implement exposure lag period, five studies had a serious risk of bias due to confounding, and one study had a time-window bias. The quantitative assessment showed no indication of an increased risk when all studies were pooled together (RR 1.04, 95% CI 0.87, 1.24) and when the analysis was restricted to the studies with the least bias (RR 0.77, 95% CI 0.51, 1.17). However, the pooled RRs were more frequently higher in the studies with less rigorous design and analysis. Specifically, a tendency toward an increased risk was observed in the studies with (RR 1.34, 95% CI 1.04, 1.72) or possibly with (RR 1.10, 95% CI 0.89, 1.36) time-lag bias, in the studies that did not apply (RR 1.23, 95% CI 0.93, 1.63) or with potentially inadequate exposure lag period of 6 months (RR 1.13, 95% CI 0.66, 1.94), in the studies that inappropriate comparator group of a combination of unspecified (RR 1.49, 95% CI 1.25, 1.78) or non-insulin (RR 1.15, 95% CI 0.93, 1.42) antidiabetic drugs, and in the studies with serious risk of bias due to confounding (RR 1.18, 95% CI 0.56, 2.49). CONCLUSIONS In summary, the totality of evidence from observational studies does not support the claim that the use of incretin-based therapies is associated with an increased risk of pancreatic cancer in routine clinical practice. The increased risk of pancreatic cancer observed in observational studies reflects bias resulting from suboptimal methodological approaches, which need to be avoided by future studies.
Collapse
Affiliation(s)
- Khemayanto Hidayat
- Department of Endocrinology and Metabolism, The First Affiliated Hospital of Soochow University, Suzhou, China.,Department of Nutrition and Food Hygiene, School of Public Health, Soochow University, Suzhou, China
| | - Ying-Yi Zhou
- Department of Endocrinology and Metabolism, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Hong-Zhen Du
- Department of Nutrition, The First Hospital of Hebei Medical University, Hebei Province Key Laboratory of Nutrition, Shijiazhuang, China
| | - Li-Qiang Qin
- Department of Nutrition and Food Hygiene, School of Public Health, Soochow University, Suzhou, China
| | - Bi-Min Shi
- Department of Endocrinology and Metabolism, The First Affiliated Hospital of Soochow University, Suzhou, China
| | - Zeng-Ning Li
- Department of Nutrition, The First Hospital of Hebei Medical University, Hebei Province Key Laboratory of Nutrition, Shijiazhuang, China
| |
Collapse
|
10
|
Rotshild V, Rabkin N, Matok I. The Risk for Prostate Cancer With Calcium Channel Blockers: A Systematic Review, Meta-Analysis, and Meta-Regression. Ann Pharmacother 2023; 57:16-28. [PMID: 35645169 DOI: 10.1177/10600280221098121] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND For decades, conflicting results were published regarding the increased risk of Prostate cancer (PCa) among calcium channel blocker (CCB) users. OBJECTIVE We aimed to evaluate the association between PCa and CCB exposure and assess moderating factors. METHODS We performed a systematic literature search in PubMed, Embase, and Cochrane databases for observational and randomized studies published until November 2020 with no language limitations, including data on the risk for PCa in CCB users compared with non-CCB users. We applied a random-effects model meta-analysis to pool results. In addition, we investigated potential moderating factors, such as CCB type, study type, participants' age, and duration of exposure, using meta-regression methods. RESULTS In our primary analysis, we included 18 studies. A statistically significant 5% increase in the risk for PCa was observed among CCB users (risk ratio [RR] = 1.05; 95% confidence interval [CI]: 1.01-1.10), with no significant association between the duration of exposure to CCBs and the risk for PCa (RR = 1.08; 95% CI: 0.98-1.19 for exposure for < 5years and RR = 1.01; 95% CI: 0.9-1.14 for exposure ≥ 5 years). The association remained statistically significant for the subgroup of dihydropyridines (RR = 1.13; 95% CI: 1.05-1.22). In addition, the association was not influenced by participants' age. CONCLUSION AND RELEVANCE CCBs are an important modality in treating hypertension. The 5% increased risk observed in the current meta-analysis could be influenced by residual confounding factors and should not affect hypertension treatment guidelines until more studies provide additional clinical information.
Collapse
Affiliation(s)
- Victoria Rotshild
- Division of Clinical Pharmacy, Institute for Drug Research, School of Pharmacy, Faculty of Medicine, The Hebrew University of Jerusalem, Jerusalem, Israel
| | - Natalie Rabkin
- Division of Clinical Pharmacy, Institute for Drug Research, School of Pharmacy, Faculty of Medicine, The Hebrew University of Jerusalem, Jerusalem, Israel
| | - Ilan Matok
- Pharmacoepidemiology Research Lab, Division of Clinical Pharmacy, Institute for Drug Research, School of Pharmacy, Faculty of Medicine, The Hebrew University of Jerusalem, Jerusalem, Israel
| |
Collapse
|
11
|
Decker B, Tuzil J, Lukas M, Cerna K, Bortlik M, Velackova B, Pilnackova B, Dolezal T. Patient-reported symptoms are a more reliable predictor of the societal burden compared to established physician-reported activity indices in inflammatory bowel disease: a cross-sectional study. Expert Rev Gastroenterol Hepatol 2023; 17:99-108. [PMID: 36537197 DOI: 10.1080/17474124.2023.2161047] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
BACKGROUND The societal burden of inflammatory bowel diseases (IBD) is not well documented, and further studies are needed to quantify the costs of the disease state. Thus, the aim was to estimate the societal burden and identify its predictors. METHODS A cross-sectional questionnaire-based study complemented by objective data from patient medical records was performed for patients with Crohn's disease (CD) and ulcerative colitis (UC). RESULTS We analyzed data from 161 patients (CD: 102, UC: 59). The overall work impairment reached 15.4%, 11.2% vs. 28.8% without/with self-reported symptoms (p = 0.006). Daily activity impairment was 19.3%, 14.1% vs. 35.6% (p < 0.001). The disability pension rate was 28%, 23% vs. 44% (p = 0.012). The total productivity loss due to absenteeism, presenteeism, and disability amounted to 7,673 €/patient/year, 6,018 vs. 12,354 €/patient/year (p = 0.000). Out-of-pocket costs amounted to 562 €/patient/year, 472 vs. 844 €/patient/year (p = 0.001). Self-reported symptoms were the strongest predictor of costs (p < 0.001). CONCLUSION We found a high societal burden for IBD and a significant association between patient-reported disease symptoms and work disability, daily activity impairment, disability pensions, and out-of-pocket costs. Physician-reported disease activity is not a reliable predictor of costs except for out-of-pocket expenses.
Collapse
Affiliation(s)
- Barbora Decker
- Institute of Health Economics and Technology Assessment, Prague, Czech Republic.,Department of Pharmacology, Faculty of Medicine, Masaryk University, Brno, Czech Republic
| | - Jan Tuzil
- Institute of Health Economics and Technology Assessment, Prague, Czech Republic.,Department of Medical Informatics, First Faculty of Medicine, Charles University, Prague, Czech Republic
| | - Milan Lukas
- IBD clinical and research center ISCARE a.s, Prague, Czech Republic.,Institute of Medical Biochemistry and Laboratory Medicine, General University Hospital and First Faculty of Medicine, Charles University, Prague, Czech Republic
| | - Karin Cerna
- IBD clinical and research center ISCARE a.s, Prague, Czech Republic
| | - Martin Bortlik
- Gastroenterology Department, Ceske Budejovice Hospital, Ceske Budejovice, Czech Republic.,Department of Internal Medicine, Military University Hospital and First Faculty of Medicine, Charles University, Prague, Czech Republic.,Institute of Pharmacology, First Faculty of Medicine, Charles University, Prague, Czech Republic
| | - Barbora Velackova
- Institute of Health Economics and Technology Assessment, Prague, Czech Republic
| | - Barbora Pilnackova
- Institute of Health Economics and Technology Assessment, Prague, Czech Republic
| | - Tomas Dolezal
- Institute of Health Economics and Technology Assessment, Prague, Czech Republic.,Department of Pharmacology, Faculty of Medicine, Masaryk University, Brno, Czech Republic
| |
Collapse
|
12
|
Conrads-Frank A, Schnell-Inderst P, Neusser S, Hallsson LR, Stojkov I, Siebert S, Kühne F, Jahn B, Siebert U, Sroczynski G. Decision-analytic modeling for early health technology assessment of medical devices - a scoping review. GERMAN MEDICAL SCIENCE : GMS E-JOURNAL 2022; 20:Doc11. [PMID: 36742459 PMCID: PMC9869403 DOI: 10.3205/000313] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Indexed: 02/07/2023]
Abstract
Objective The goal of this review was to identify decision-analytic modeling studies in early health technology assessments (HTA) of high-risk medical devices, published over the last three years, and to provide a systematic overview of model purposes and characteristics. Additionally, the aim was to describe recent developments in modeling techniques. Methods For this scoping review, we performed a systematic literature search in PubMed and Embase including studies published in English or German. The search code consisted of terms describing early health technology assessment and terms for decision-analytic models. In abstract and full-text screening, studies were excluded that were not modeling studies for a high-risk medical device or an in-vitro diagnostic test. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) flow diagram was used to report on the search and exclusion of studies. For all included studies, study purpose, framework and model characteristics were extracted and reported in systematic evidence tables and a narrative summary. Results Out of 206 identified studies, 19 studies were included in the review. Studies were either conducted for hypothetical devices or for existing devices after they were already available on the market. No study extrapolated technical data from early development stages to estimate potential value of devices in development. All studies except one included cost as an outcome. Two studies were budget impact analyses. Most studies aimed at adoption and reimbursement decisions. The majority of studies were on in-vitro diagnostic tests for personalized and targeted medicine. A timed automata model, to our knowledge a model type new to HTA, was tested by one study. It describes the agents in a clinical pathway in separate models and, by allowing for interaction between the models, can reflect complex individual clinical pathways and dynamic system interactions. Not all sources of uncertainty for in-vitro tests were explicitly modeled. Elicitation of expert knowledge and judgement was used for substitution of missing empirical data. Analysis of uncertainty was the most valuable strength of decision-analytic models in early HTA, but no model applied sensitivity analysis to optimize the test positivity cutoff with regard to the benefit-harm balance or cost-effectiveness. Value-of-information analysis was rarely performed. No information was found on the use of causal inference methods for estimation of effect parameters from observational data. Conclusion Our review provides an overview of the purposes and model characteristics of nineteen recent early evaluation studies on medical devices. The review shows the growing importance of personalized interventions and confirms previously published recommendations for careful modeling of uncertainties surrounding diagnostic devices and for increased use of value-of-information analysis. Timed automata may be a model type worth exploring further in HTA. In addition, we recommend to extend the application of sensitivity analysis to optimize positivity criteria for in-vitro tests with regard to benefit-harm or cost-effectiveness. We emphasize the importance of causal inference methods when estimating effect parameters from observational data.
Collapse
Affiliation(s)
- Annette Conrads-Frank
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences and Technology, Hall i. T., Austria
| | - Petra Schnell-Inderst
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences and Technology, Hall i. T., Austria
| | - Silke Neusser
- Alfried Krupp von Bohlen and Halbach Foundation Endowed Chair for Medicine Management, University of Duisburg-Essen, Essen, Germany
| | - Lára R. Hallsson
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences and Technology, Hall i. T., Austria
| | - Igor Stojkov
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences and Technology, Hall i. T., Austria
| | - Silke Siebert
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences and Technology, Hall i. T., Austria
| | - Felicitas Kühne
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences and Technology, Hall i. T., Austria
| | - Beate Jahn
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences and Technology, Hall i. T., Austria
| | - Uwe Siebert
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences and Technology, Hall i. T., Austria,Center for Health Decision Science, Departments of Epidemiology and Health Policy & Management, Harvard T. H. Chan School of Public Health, Boston, MA, USA,Institute for Technology Assessment and Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA,Division of Health Technology Assessment, ONCOTYROL – Center for Personalized Cancer Medicine, Innsbruck, Austria,*To whom correspondence should be addressed: Uwe Siebert, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences and Technology, Eduard-Wallnoefer-Zentrum 1, 6060 Hall i. T., Austria, Phone: +43 50 8648-3930, Twitter: @UweSiebert9, Linkedin: uwe-siebert9, E-mail:
| | - Gabi Sroczynski
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences and Technology, Hall i. T., Austria
| |
Collapse
|
13
|
Kühne F, Schomaker M, Stojkov I, Jahn B, Conrads-Frank A, Siebert S, Sroczynski G, Puntscher S, Schmid D, Schnell-Inderst P, Siebert U. Causal evidence in health decision making: methodological approaches of causal inference and health decision science. GERMAN MEDICAL SCIENCE : GMS E-JOURNAL 2022; 20:Doc12. [PMID: 36742460 PMCID: PMC9869404 DOI: 10.3205/000314] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Figures] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Indexed: 02/07/2023]
Abstract
Objectives Public health decision making is a complex process based on thorough and comprehensive health technology assessments involving the comparison of different strategies, values and tradeoffs under uncertainty. This process must be based on best available evidence and plausible assumptions. Causal inference and health decision science are two methodological approaches providing information to help guide decision making in health care. Both approaches are quantitative methods that use statistical and modeling techniques and simplifying assumptions to mimic the complexity of the real world. We intend to review and lay out both disciplines with their aims, strengths and limitations based on a combination of textbook knowledge and expert experience. Methods To help understanding and differentiating the methodological approaches of causal inference and health decision science, we reviewed both methods with the focus on aims, research questions, methods, assumptions, limitations and challenges, and software. For each methodological approach, we established a group of four experts from our own working group to carefully review and summarize each method, followed by structured discussion rounds and written reviews, in which the experts from all disciplines including HTA and medicine were involved. The entire expert group discussed objectives, strengths and limitations of both methodological areas, and potential synergies. Finally, we derived recommendations for further research and provide a brief outlook on future trends. Results Causal inference methods aim for drawing causal conclusions from empirical data on the relationship of pre-specified interventions on a specific target outcome and apply a counterfactual framework and statistical techniques to derive causal effects of exposures or interventions from these data. Causal inference is based on a causal diagram, more specifically, a directed acyclic graph (DAG), which encodes the assumptions regarding the causal relations between variables. Depending on the type of confounding and selection bias, traditional statistical methods or more complex g-methods are needed to derive valid causal effects. Besides the correct specification of the DAG and the statistical model, assumptions such as consistency, positivity, and exchangeability must be checked when aiming at causal inference. Health decision science aims for guiding policy decision making regarding health interventions considering and balancing multiple competing objectives of a decision based on data from multiple sources and studies, for example prevalence studies, clinical trials and long-term observational routine effectiveness studies, and studies on preferences and costs. It involves decision analysis, a systematic, explicit and quantitative framework to guide decisions under uncertainty. Decision analyses are based on decision-analytic models to mimic the course of disease as well as aspects and consequences of the intervention in order to quantitatively optimize the decision. Depending on the type of decision problem, decision trees, state-transition models, discrete event simulation models, dynamic transmission models, or other model types are applied. Models must be validated against observed data, and comprehensive sensitivity analyses must be performed to assess uncertainty. Besides the appropriate choice of the model type and the valid specification of the model structure, it must be checked if input parameters of effects can be interpreted as causal parameters in the model. Otherwise results will be biased. Conclusions Both causal inference and health decision science aim for providing best causal evidence for informed health decision making. The strengths and limitations of both methods differ and a good understanding of both methods is essential for correct application but also for correct interpretation of findings from the described methods. Importantly, decision-analytic modeling should be combined with causal inference when developing guidance and recommendations regarding decisions on health care interventions.
Collapse
Affiliation(s)
- Felicitas Kühne
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
| | - Michael Schomaker
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
- Centre for Infectious Disease Epidemiology & Research, University of Cape Town, South Africa
| | - Igor Stojkov
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
| | - Beate Jahn
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
- Division of Health Technology Assessment, ONCOTYROL – Center for Personalized Cancer Medicine, Innsbruck, Austria
| | - Annette Conrads-Frank
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
| | - Silke Siebert
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
| | - Gaby Sroczynski
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
| | - Sibylle Puntscher
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
| | - Daniela Schmid
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
| | - Petra Schnell-Inderst
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
| | - Uwe Siebert
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT TIROL – University for Health Sciences, Medical Informatics and Technology, Hall i.T., Austria
- Division of Health Technology Assessment, ONCOTYROL – Center for Personalized Cancer Medicine, Innsbruck, Austria
- Center for Health Decision Science, Departments of Epidemiology and Health Policy & Management, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Program on Cardiovascular Research, Institute for Technology Assessment and Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
14
|
Deshpande A, Chen Y, Boye-Codjoe E, Obi EN. Adoption and Trends in Uptake of Updated ICD-10 Codes for Clostridioides difficile-A Retrospective Observational Study. Open Forum Infect Dis 2022; 9:ofac622. [PMID: 36519119 PMCID: PMC9745779 DOI: 10.1093/ofid/ofac622] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Accepted: 11/12/2022] [Indexed: 08/30/2023] Open
Abstract
BACKGROUND In October 2017, the single International Classification of Diseases, Tenth Revision (ICD-10), code for Clostridioides difficile infection (CDI), A04.7, was replaced with 2 codes delineating "recurrent CDI" (rCDI; A04.71) and "nonrecurrent CDI" (nrCDI; A04.72). METHODS To evaluate and validate use of the updated codes, this retrospective study included inpatient encounters with a CDI-related ICD-10 code from October 2016 to May 2019 in the PINC AITM Healthcare Database (PHD). Encounters after the October 2017 code update were characterized by clinical, facility, and provider variables and whether coding was concordant or discordant to the 8-week recurrence period. Multivariable regression analysis assessed variables associated with concordant coding. RESULTS Widespread adoption of the updated CDI codes across PHD hospitals occurred in October 2017. After October 2017, 21 446 CDI-related encounters met sample selection criteria (concordance in 67% of rCDI and 25% of nrCDI encounters). Higher proportions of rCDI- vs nrCDI-coded encounters (P < .05) had emergency room admission, admission by a gastroenterologist or infectious disease specialist, and were prescribed fidaxomicin, bezlotoxumab, or fecal microbiota transfer (FMT), with no significant difference by coding concordance status. Encounters coded concordantly were significantly more likely to be for rCDI (odds ratio [OR], 5.67; 95% CI, 5.32-6.03), a nonelective admission (OR, 1.35-1.69), or prescribed fidaxomicin (OR, 1.11; 95% CI, 1.01-1.23) or FMT (OR, 1.29; 95% CI, 1.17-1.42). CONCLUSIONS Our study findings suggest no delay in transition to the updated CDI-related codes. Treatment patterns for rCDI vs nrCDI encounters were consistent with Infectious Diseases Society of America guidelines, regardless of concordance status.
Collapse
Affiliation(s)
- Abhishek Deshpande
- Center for Value-Based Care Research, Cleveland Clinic Community Care, Cleveland Clinic, Cleveland, Ohio, USA
- Department of Infectious Disease, Respiratory Institute, Cleveland Clinic, Cleveland, Ohio, USA
| | - Yiyun Chen
- Merck & Co., Inc., Rahway, New Jersey, USA
| | | | | |
Collapse
|
15
|
Santi D, Spaggiari G, Granata ARM, Simoni M. Real-world evidence analysis of the follicle-stimulating hormone use in male idiopathic infertility. Best Pract Res Clin Obstet Gynaecol 2022; 85:121-133. [PMID: 35618626 DOI: 10.1016/j.bpobgyn.2022.04.004] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 02/11/2022] [Accepted: 04/20/2022] [Indexed: 12/14/2022]
Abstract
Male idiopathic infertility remains a therapeutic challenge in the couple infertility management. In this setting, an empirical treatment with follicle-stimulating hormone (FSH) is allowed, although not recommended. Twenty-one clinical trials and four meta-analyses highlighted an overall increased pregnancy rate in case of FSH administration, but the indiscriminate FSH prescription is still unsupported by clinical evidence in idiopathic infertility. This context could represent an example in which real-world data (RWD) could add useful information. From a nationwide clinical practice survey performed in Italy, emerged the clinicians' attitude to prescribe FSH in the case of impaired semen with a significant improvement of semen parameters, identifying FSH treatment as a therapeutic card in the real-life management. Although more robust data are still needed to optimize FSH treatment in male idiopathic infertility, RWD should be included in the body of evidence considered in healthcare decision-making.
Collapse
Affiliation(s)
- Daniele Santi
- Unit of Endocrinology, Department of Medical Specialties, Azienda Ospedaliero-Universitaria of Modena, Ospedale Civile of Baggiovara, Via Giardini 1355, 41126 Modena, Italy; Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Via Campi 287, 41125, Modena, Italy.
| | - Giorgia Spaggiari
- Unit of Endocrinology, Department of Medical Specialties, Azienda Ospedaliero-Universitaria of Modena, Ospedale Civile of Baggiovara, Via Giardini 1355, 41126 Modena, Italy
| | - Antonio R M Granata
- Unit of Endocrinology, Department of Medical Specialties, Azienda Ospedaliero-Universitaria of Modena, Ospedale Civile of Baggiovara, Via Giardini 1355, 41126 Modena, Italy
| | - Manuela Simoni
- Unit of Endocrinology, Department of Medical Specialties, Azienda Ospedaliero-Universitaria of Modena, Ospedale Civile of Baggiovara, Via Giardini 1355, 41126 Modena, Italy; Department of Biomedical, Metabolic and Neural Sciences, University of Modena and Reggio Emilia, Via Campi 287, 41125, Modena, Italy
| |
Collapse
|
16
|
Ross RK, Su IH, Webster-Clark M, Jonsson Funk M. Nondifferential Treatment Misclassification Biases Toward the Null? Not a Safe Bet for Active Comparator Studies. Am J Epidemiol 2022; 191:1917-1925. [PMID: 35882378 PMCID: PMC10144712 DOI: 10.1093/aje/kwac131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Revised: 05/04/2022] [Accepted: 07/21/2022] [Indexed: 02/01/2023] Open
Abstract
Active comparator studies are increasingly common, particularly in pharmacoepidemiology. In such studies, the parameter of interest is a contrast (difference or ratio) in the outcome risks between the treatment of interest and the selected active comparator. While it may appear treatment is dichotomous, treatment is actually polytomous as there are at least 3 levels: no treatment, the treatment of interest, and the active comparator. Because misclassification may occur between any of these groups, independent nondifferential treatment misclassification may not be toward the null (as expected with a dichotomous treatment). In this work, we describe bias from independent nondifferential treatment misclassification in active comparator studies with a focus on misclassification that occurs between each active treatment and no treatment. We derive equations for bias in the estimated outcome risks, risk difference, and risk ratio, and we provide bias correction equations that produce unbiased estimates, in expectation. Using data obtained from US insurance claims data, we present a hypothetical comparative safety study of antibiotic treatment to illustrate factors that influence bias and provide an example probabilistic bias analysis using our derived bias correction equations.
Collapse
Affiliation(s)
- Rachael K Ross
- Correspondence to Rachael Ross, Department of Epidemiology, Gillings School of Global Public Health, UNC, Campus Box 7435m Chapel Hill, NC 27599-6435 (e-mail: )
| | | | | | | |
Collapse
|
17
|
Wang SV, Pottegård A, Crown W, Arlett P, Ashcroft DM, Benchimol EI, Berger ML, Crane G, Goettsch W, Hua W, Kabadi S, Kern DM, Kurz X, Langan S, Nonaka T, Orsini L, Perez-Gutthann S, Pinheiro S, Pratt N, Schneeweiss S, Toussi M, Williams RJ. HARmonized Protocol Template to Enhance Reproducibility of Hypothesis Evaluating Real-World Evidence Studies on Treatment Effects: A Good Practices Report of a Joint ISPE/ISPOR Task Force. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2022; 25:1663-1672. [PMID: 36241338 DOI: 10.1016/j.jval.2022.09.001] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 06/28/2022] [Indexed: 06/16/2023]
Abstract
OBJECTIVES Ambiguity in communication of key study parameters limits the utility of real-world evidence (RWE) studies in healthcare decision-making. Clear communication about data provenance, design, analysis, and implementation is needed. This would facilitate reproducibility, replication in independent data, and assessment of potential sources of bias. METHODS The International Society for Pharmacoepidemiology (ISPE) and ISPOR-The Professional Society for Health Economics and Outcomes Research (ISPOR) convened a joint task force, including representation from key international stakeholders, to create a harmonized protocol template for RWE studies that evaluate a treatment effect and are intended to inform decision-making. The template builds on existing efforts to improve transparency and incorporates recent insights regarding the level of detail needed to enable RWE study reproducibility. The over-arching principle was to reach for sufficient clarity regarding data, design, analysis, and implementation to achieve 3 main goals. One, to help investigators thoroughly consider, then document their choices and rationale for key study parameters that define the causal question (e.g., target estimand), two, to facilitate decision-making by enabling reviewers to readily assess potential for biases related to these choices, and three, to facilitate reproducibility. STRATEGIES TO DISSEMINATE AND FACILITATE USE Recognizing that the impact of this harmonized template relies on uptake, we have outlined a plan to introduce and pilot the template with key international stakeholders over the next 2 years. CONCLUSION The HARmonized Protocol Template to Enhance Reproducibility (HARPER) helps to create a shared understanding of intended scientific decisions through a common text, tabular and visual structure. The template provides a set of core recommendations for clear and reproducible RWE study protocols and is intended to be used as a backbone throughout the research process from developing a valid study protocol, to registration, through implementation and reporting on those implementation decisions.
Collapse
Affiliation(s)
- Shirley V Wang
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
| | | | | | | | | | - Eric I Benchimol
- Child Health Evaluative Sciences, SickKids Research Institute, Toronto, Ontario, Canada; ICES, Toronto, Ontario, Canada; Department of Paediatrics and Institute of Health Policy, Management and Evaluation, The Hospital for Sick Children, University of Toronto, Toronto, Ontario, Canada
| | | | | | - Wim Goettsch
- The National Health Care Institute, Diemen, The Netherlands; Utrecht University, Utrecht, The Netherlands
| | - Wei Hua
- US Food and Drug Administration, Silver Springs, Maryland, USA
| | - Shaum Kabadi
- Sanofi-Aventis US LLC, North Potomac, Maryland, USA
| | - David M Kern
- Janssen Research & Development, LLC, Philadelphia, Pennsylvania, USA
| | | | | | | | | | | | - Simone Pinheiro
- US Food and Drug Administration, Silver Springs, Maryland, USA
| | - Nicole Pratt
- Quality Use of Medicines and Pharmacy Research Centre, Clinical and Health Sciences, University of South Australia, South Australia, Australia
| | | | | | | |
Collapse
|
18
|
Henk HJ, Shih YCT, Borah BJ. Methods and Study Design for Cancer Health Economics Research: Summary of Discussions From a Breakout Session. J Natl Cancer Inst Monogr 2022; 2022:95-101. [PMID: 35788374 PMCID: PMC9255929 DOI: 10.1093/jncimonographs/lgac013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Accepted: 03/31/2022] [Indexed: 11/12/2022] Open
Abstract
The legitimacy of findings from cancer health economics research depends on study design and methods. A breakout session, Methods and Study Design for Cancer Health Economics Research, was convened at the Future of Cancer Health Economics Research Conference to discuss 2 commonly used analytic tools for cancer health economics research: observational studies and decision-analytic modeling. Observational studies include analysis of data collected with the primary purpose of supporting economic evaluation or secondary use of data collected for another purpose. Modeling studies develop a parametrized structure, such as a decision tree, to estimate hypothetical impact. Whereas observational studies focus on what has happened and why, modeling studies address what may happen. We summarize the discussion at this breakout session, focusing on 3 key elements of high-quality cancer health economics research: study design, analytical methods, and addressing uncertainty.
Collapse
Affiliation(s)
| | - Ya-Chen Tina Shih
- Department of Health Services Research, University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Bijan J Borah
- Division of Health Care Delivery Research, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
19
|
Gomes M, Latimer N, Soares M, Dias S, Baio G, Freemantle N, Dawoud D, Wailoo A, Grieve R. Target Trial Emulation for Transparent and Robust Estimation of Treatment Effects for Health Technology Assessment Using Real-World Data: Opportunities and Challenges. PHARMACOECONOMICS 2022; 40:577-586. [PMID: 35332434 DOI: 10.1007/s40273-022-01141-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/10/2022] [Indexed: 06/14/2023]
Abstract
Evidence about the relative effects of new treatments is typically collected in randomised controlled trials (RCTs). In many instances, evidence from RCTs falls short of the needs of health technology assessment (HTA). For example, RCTs may not be able to capture longer-term treatment effects, or include all relevant comparators and outcomes required for HTA purposes. Information routinely collected about patients and the care they receive have been increasingly used to complement RCT evidence on treatment effects. However, such routine (or real-world) data are not collected for research purposes, so investigators have little control over the way patients are selected into the study or allocated to the different treatment groups, introducing biases for example due to selection or confounding. A promising approach to minimise common biases in non-randomised studies that use real-world data (RWD) is to apply design principles from RCTs. This approach, known as 'target trial emulation' (TTE), involves (1) developing the protocol with respect to core study design and analysis components of the hypothetical RCT that would answer the question of interest, and (2) applying this protocol to the RWD so that it mimics the data that would have been gathered for the RCT. By making the 'target trial' explicit, TTE helps avoid common design flaws and methodological pitfalls in the analysis of non-randomised studies, keeping each step transparent and accessible. It provides a coherent framework that embeds existing analytical methods to minimise confounding and helps identify potential limitations of RWD and the extent to which these affect the HTA decision. This paper provides a broad overview of TTE and discusses the opportunities and challenges of using this approach in HTA. We describe the basic principles of trial emulation, outline some areas where TTE using RWD can help complement RCT evidence in HTA, identify potential barriers to its adoption in the HTA setting and highlight some priorities for future work.
Collapse
Affiliation(s)
- Manuel Gomes
- Department of Applied Health Research, University College London, London, UK.
| | - Nick Latimer
- School of Health and Related Research, University of Sheffield, Sheffield, UK
| | - Marta Soares
- Centre for Health Economics, University of York, York, UK
| | - Sofia Dias
- Centre for Reviews and Dissemination, University of York, York, UK
| | - Gianluca Baio
- Department of Statistical Science, University College London, London, UK
| | - Nick Freemantle
- Institute of Clinical Trials and Methodology, University College London, London, UK
| | - Dalia Dawoud
- Science, Policy and Research group, National Institute for Health and Care Excellence, London, UK
- Faculty of Pharmacy, Cairo University, Cairo, Egypt
| | - Allan Wailoo
- School of Health and Related Research, University of Sheffield, Sheffield, UK
| | - Richard Grieve
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
| |
Collapse
|
20
|
Squara PA, Luu VP, Pérol D, Coudert B, Machuron V, Bachot C, Samelson L, Florentin V, Pinguet JM, Ben Hadj Yahia B. Personalized Reimbursement Model (PRM) program: A real-world data platform of cancer drugs use to improve and personalize drug pricing and reimbursement in France. PLoS One 2022; 17:e0267242. [PMID: 35439247 PMCID: PMC9017943 DOI: 10.1371/journal.pone.0267242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2021] [Accepted: 04/05/2022] [Indexed: 11/27/2022] Open
Abstract
Objective This article describes the Personalized Reimbursement Model (PRM) program methodology, limitations, achievement and perspectives in using real-world data of cancer drugs use to improve and personalize drug pricing and reimbursement in France. Materials and methods PRM platform aggregates Electronic Pharmacy Records (EPR) data from French medical centers (PRM centers) to build retrospective cohorts of patients treated with injectable cancer drugs in a hospital setting. Data extracted on January 1st, 2020, from breast cancer (BC) patients who received trastuzumab, trastuzumab emtansin or pertuzumab since January 1st, 2011, and from lung cancer (LC) patients who received bevacizumab or atezolizumab since January 1st, 2015, enabled recovering their injectable cancer drugs history from diagnosis date until December 30th, 2019, and served as dataset for assessment. Results 123 PRM centers provided data from 30,730 patients (25,660 BC and 5,070 LC patients respectively). Overall, 20,942 (82%) of BC and 4,716 (93%) of LC patients were analyzed. Completion rate was above 98% for patients characteristics, diagnostic and treatment related data. PRM centers cover 48% and 33% of BC and LC patients in-hospital therapeutic management in France, respectively. Distribution of BC and LC patients therapeutic management, by medical center category and geographic location, was similar in PRM centers to all French medical centers, ensuring the representativeness of the PRM platform. Conclusion PRM Platform enabled building a national database generating on demand Real-World Evidence based on EPR. This enabled the first performance-based risk-sharing arrangements based on PRM data, between the CEPS and Roche, for atezolizumab cancer immunotherapy in metastatic non-small cell lung cancer indication.
Collapse
Affiliation(s)
| | - Vinh-Phuc Luu
- Medical Affairs Department, Roche, Boulogne-Billancourt, France
| | - David Pérol
- Medical Oncology Department, Centre Léon Bérard Comprehensive Cancer Center, Lyon, France
| | - Bruno Coudert
- Medical Oncology Department, Georges Francois Leclerc Comprehensive Cancer Center, Dijon, France
| | - Valérie Machuron
- Medical Evidence Department, Roche, Boulogne-Billancourt, France
| | - Camille Bachot
- Medical Evidence Department, Roche, Boulogne-Billancourt, France
| | | | | | - Jean-Marc Pinguet
- Personalized Healthcare Department, Roche, Boulogne-Billancourt, France
| | | |
Collapse
|
21
|
Sarri G, Patorno E, Yuan H, Guo JJ, Bennett D, Wen X, Zullo AR, Largent J, Panaccio M, Gokhale M, Moga DC, Ali MS, Debray TPA. Framework for the synthesis of non-randomised studies and randomised controlled trials: a guidance on conducting a systematic review and meta-analysis for healthcare decision making. BMJ Evid Based Med 2022; 27:109-119. [PMID: 33298465 PMCID: PMC8961747 DOI: 10.1136/bmjebm-2020-111493] [Citation(s) in RCA: 48] [Impact Index Per Article: 24.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/03/2020] [Indexed: 12/17/2022]
Abstract
INTRODUCTION High-quality randomised controlled trials (RCTs) provide the most reliable evidence on the comparative efficacy of new medicines. However, non-randomised studies (NRS) are increasingly recognised as a source of insights into the real-world performance of novel therapeutic products, particularly when traditional RCTs are impractical or lack generalisability. This means there is a growing need for synthesising evidence from RCTs and NRS in healthcare decision making, particularly given recent developments such as innovative study designs, digital technologies and linked databases across countries. Crucially, however, no formal framework exists to guide the integration of these data types. OBJECTIVES AND METHODS To address this gap, we used a mixed methods approach (review of existing guidance, methodological papers, Delphi survey) to develop guidance for researchers and healthcare decision-makers on when and how to best combine evidence from NRS and RCTs to improve transparency and build confidence in the resulting summary effect estimates. RESULTS Our framework comprises seven steps on guiding the integration and interpretation of evidence from NRS and RCTs and we offer recommendations on the most appropriate statistical approaches based on three main analytical scenarios in healthcare decision making (specifically, 'high-bar evidence' when RCTs are the preferred source of evidence, 'medium,' and 'low' when NRS is the main source of inference). CONCLUSION Our framework augments existing guidance on assessing the quality of NRS and their compatibility with RCTs for evidence synthesis, while also highlighting potential challenges in implementing it. This manuscript received endorsement from the International Society for Pharmacoepidemiology.
Collapse
Affiliation(s)
- Grammati Sarri
- Real World Evidence Sciences, Visible Analytics Ltd, Oxford, UK
| | - Elisabetta Patorno
- Division of Pharmacoepidemiology and Pharmacoeconomics, Dept. of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Hongbo Yuan
- Canadian Agency for Drugs and Technologies in Health (CADTH), Ottawa, Ontario, Canada
| | - Jianfei Jeff Guo
- Department of Pharmacy Practice & Administrative Sciences, University of Cincinnati College of Pharmacy, Cincinnati, Ohio, USA
| | | | - Xuerong Wen
- Pharmacy Practice, College of Pharmacy, University of Rhode Island, Kingston, Rhode Island, USA
| | - Andrew R Zullo
- Health Services, Policy, and Practice, Brown University, Providence, Rhode Island, USA
| | - Joan Largent
- Real-World Solutions, IQVIA, California, Colorado, USA
| | - Mary Panaccio
- Epidemiology and Outcomes Research, Research Outcomes Innovations LLC, New York City, New York, USA
| | | | - Daniela Claudia Moga
- University of Kentucky, Department of Pharmacy Practice and Science, Lexington, Kentucky, USA
| | - M Sanni Ali
- NDORMS, Center for Statistics in Medicine, University of Oxford, Oxford, UK
- Department of Non-communicable Disease Epidemiology, Faculty of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine (LSHTM), London, UK
- Department of Public Heath, Environments and Society, Faculty of Public Health and Policy, London School of Hygiene and Tropical Medicine (LSHTM), London, UK
| | - Thomas P A Debray
- Julius Center for Health Sciences and Primary Care, University Medical Centre Utrecht, Utrecht, The Netherlands
- Smart Data Analysis and Statistics, Utrecht, The Netherlands
| |
Collapse
|
22
|
Tan J, Liu C, Li M, Shang H, Wang W, Li L, Xiong Y, Huang S, Rao C, Luo X, Qi Y, Wang J, Zou K, Sun X. A methodological framework for tackling confounding by indication when assessing the treatment effects of Chinese herbal injections in the real world. J Evid Based Med 2022; 15:64-72. [PMID: 35199965 PMCID: PMC9305735 DOI: 10.1111/jebm.12462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/06/2021] [Revised: 12/24/2021] [Accepted: 01/13/2022] [Indexed: 02/05/2023]
Abstract
AIM In the context of integrative medicine, whether Chinese herbal injections are effective in routine practice has become a question of broad interest. However, confounding by indication (i.e., indication bias) is a prevalent and highly challenging methodological issue when using routinely collected health care data to assess the real-world effectiveness of Chinese herbal injections. METHODS AND RESULTS We proposed a methodological approach to tackling confounding by indication in assessing the real-world effectiveness of Chinese herbal injections, incorporating empirical experiences, a literature review and interactive discussions, and a panel of external experts to finally achieve a consensus. This approach consisted of three cohesive steps, including a full understanding of treatment patterns, construction of fair comparisons by identifying appropriate combination treatments and comparators, and using statistical methods to further control for confounding. In the investigation of treatment patterns, we proposed five domains to identify treatment patterns with Chinese herbal injections, and we offered five patterns of combination treatments to characterize how Chinese herbal injections are used in conjunction with other treatments. In constructing fair comparisons, we suggested the use of both nonuse and active comparators; given the diverse combination treatments, we developed six scenarios that may form fair comparisons. In the statistical analysis, we discussed five statistical models for controlling confounding by indication, including their pros and cons. We also included a practical example to illustrate the usefulness of the methodological approach. CONCLUSION The proposed approach may serve as an effective tool to guide researchers to reliably assess the effectiveness of Chinese herbal injections in the context of integrative medicine.
Collapse
Affiliation(s)
- Jing Tan
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- NMPA Key Laboratory for Real World Data Research and Evaluation in HainanChengduChina
- Sichuan Center of Technology Innovation for Real World DataChengduChina
| | - Chunrong Liu
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- NMPA Key Laboratory for Real World Data Research and Evaluation in HainanChengduChina
- Sichuan Center of Technology Innovation for Real World DataChengduChina
| | - Mingxi Li
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- NMPA Key Laboratory for Real World Data Research and Evaluation in HainanChengduChina
- Sichuan Center of Technology Innovation for Real World DataChengduChina
| | - Hongcai Shang
- Key Laboratory of Chinese Internal Medicine of MOE and BeijingBeijing University of Chinese Medicine and PharmacologyBeijingChina
| | - Wen Wang
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- NMPA Key Laboratory for Real World Data Research and Evaluation in HainanChengduChina
- Sichuan Center of Technology Innovation for Real World DataChengduChina
| | - Ling Li
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- NMPA Key Laboratory for Real World Data Research and Evaluation in HainanChengduChina
- Sichuan Center of Technology Innovation for Real World DataChengduChina
| | - Yiquan Xiong
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- NMPA Key Laboratory for Real World Data Research and Evaluation in HainanChengduChina
- Sichuan Center of Technology Innovation for Real World DataChengduChina
| | - Shiyao Huang
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- Sichuan Evidence‐Based Medicine Center of Traditional Chinese MedicineHospital of Chengdu, University of Traditional Chinese MedicineChengduChina
| | - Chaolong Rao
- School of Public HealthChengdu University of Traditional Chinese MedicineChengduChina
| | - Xiaochao Luo
- Acupuncture and Tuina SchoolChengdu University of Traditional Chinese MedicineChengduChina
| | - Yana Qi
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- NMPA Key Laboratory for Real World Data Research and Evaluation in HainanChengduChina
- Sichuan Center of Technology Innovation for Real World DataChengduChina
| | - Jing Wang
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- NMPA Key Laboratory for Real World Data Research and Evaluation in HainanChengduChina
- Sichuan Center of Technology Innovation for Real World DataChengduChina
| | - Kang Zou
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- NMPA Key Laboratory for Real World Data Research and Evaluation in HainanChengduChina
- Sichuan Center of Technology Innovation for Real World DataChengduChina
| | - Xin Sun
- Chinese Evidence‐Based Medicine CenterWest China Hospital, Sichuan UniversityChengduChina
- NMPA Key Laboratory for Real World Data Research and Evaluation in HainanChengduChina
- Sichuan Center of Technology Innovation for Real World DataChengduChina
| |
Collapse
|
23
|
Liu M, Wang W, Wang M, He Q, Li L, Li G, He L, Zou K, Sun X. Reporting of abstracts in studies that used routinely collected data for exploring drug treatment effects: a cross-sectional survey. BMC Med Res Methodol 2022; 22:6. [PMID: 34996370 PMCID: PMC8742367 DOI: 10.1186/s12874-021-01482-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Accepted: 11/29/2021] [Indexed: 02/08/2023] Open
Abstract
Background In recent years, studies that used routinely collected data (RCD), such as electronic medical records and administrative claims, for exploring drug treatment effects, including effectiveness and safety, have been increasingly published. Abstracts of such studies represent a highly attended source for busy clinicians or policy-makers, and are important for indexing by literature database. If less clearly presented, they may mislead decisions or indexing. We thus conducted a cross-sectional survey to systematically examine how the abstracts of such studies were reported. Methods We searched PubMed to identify all observational studies published in 2018 that used RCD for assessing drug treatment effects. Teams of methods-trained collected data from eligible studies using pilot-tested, standardized forms that were developed and expanded from “The reporting of studies conducted using observational routinely collected health data statement for pharmacoepidemiology” (RECORD-PE) statement. We used descriptive analyses to examine how authors reported data source, study design, data analysis, and interpretation of findings. Results A total of 222 studies were included, of which 118 (53.2%) reported type of database used, 17 (7.7%) clearly reported database linkage, and 140 (63.1%) reported coverage of data source. Only 44 (19.8%) studies stated a predefined hypothesis, 127 (57.2%) reported study design, 140 (63.1%) reported statistical models used, 142 (77.6%) reported adjusted estimates, 33 (14.9%) mentioned sensitivity analyses, and 39 (17.6%) made a strong claim about treatment effect. Studies published in top 5 general medicine journals were more likely to report the name of data source (94.7% vs. 67.0%) and study design (100% vs. 53.2%) than those in other journals. Conclusions The under-reporting of key methodological features in abstracts of RCD studies was common, which would substantially compromise the indexing of this type of literature and prevent the effective use of study findings. Substantial efforts to improve the reporting of abstracts in these studies are highly warranted. Supplementary Information The online version contains supplementary material available at 10.1186/s12874-021-01482-9.
Collapse
Affiliation(s)
- Mei Liu
- Chinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, China.,Sichuan Center of Technology Innovation for Real World Data, Chengdu, China
| | - Wen Wang
- Chinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, China.,Sichuan Center of Technology Innovation for Real World Data, Chengdu, China
| | - Mingqi Wang
- Chinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, China.,Sichuan Center of Technology Innovation for Real World Data, Chengdu, China
| | - Qiao He
- Chinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, China.,Sichuan Center of Technology Innovation for Real World Data, Chengdu, China
| | - Ling Li
- Chinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, China.,Sichuan Center of Technology Innovation for Real World Data, Chengdu, China
| | - Guowei Li
- Department of Health Research Methods, Evidence and Impact, McMaster University, Hamilton, ON, L8S 4L8, Canada.,Center for Clinical Epidemiology and Methodology, Guangdong Second Provincial General Hospital, Guangzhou, 510317, Guangdong, China.,Biostatistics Unit, Research Institute at St. Joseph's Healthcare Hamilton, Hamilton, ON, L8N 4A6, Canada
| | - Lin He
- Intelligence Library Center, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China
| | - Kang Zou
- Chinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China.,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, China.,Sichuan Center of Technology Innovation for Real World Data, Chengdu, China
| | - Xin Sun
- Chinese Evidence-based Medicine Center and Cochrane China Center, National Clinical Research Center for Geriatrics, West China Hospital, Sichuan University, Chengdu, 610041, Sichuan, China. .,NMPA Key Laboratory for Real World Data Research and Evaluation in Hainan, Chengdu, China. .,Sichuan Center of Technology Innovation for Real World Data, Chengdu, China.
| |
Collapse
|
24
|
Read SH, Khachatryan A, Chandak A, Casciano R, Hodgkins P, Haubrich R, Mozaffari E. Comparative effectiveness research in COVID-19 using real-world data: methodological considerations. J Comp Eff Res 2021; 10:1259-1264. [PMID: 34463118 PMCID: PMC8407277 DOI: 10.2217/cer-2021-0179] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2021] [Accepted: 08/13/2021] [Indexed: 12/27/2022] Open
|
25
|
Wood GC, Bailey-Davis L, Benotti P, Cook A, Dove J, Mowery J, Ramasamy A, Iyer N, Smolarz BG, Kumar N, Still CD. Effects of sustained weight loss on outcomes associated with obesity comorbidities and healthcare resource utilization. PLoS One 2021; 16:e0258545. [PMID: 34731171 PMCID: PMC8565747 DOI: 10.1371/journal.pone.0258545] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Accepted: 09/29/2021] [Indexed: 01/01/2023] Open
Abstract
Objective Determine the impact of long-term non-surgical weight loss maintenance on clinical relevance for osteoarthritis, cancer, opioid use, and depression/anxiety and healthcare resource utilization. Methods A cohort of adults receiving primary care within Geisinger Health System between 2001–2017 was retrospectively studied. Patients with ≥3 weight measurements in the two-year index period and obesity at baseline (BMI ≥30 kg/m2) were categorized: Obesity Maintainers (reference group) maintained weight within +/-3%; Weight Loss Rebounders lost ≥5% body weight in year one, regaining ≥20% of weight loss in year two; Weight Loss Maintainers lost ≥5% body weight in year one, maintaining ≥80% of weight loss. Association with development of osteoarthritis, cancer, opioid use, and depression/anxiety, was assessed; healthcare resource utilization was quantified. Magnitude of weight loss among maintainers was evaluated for impact on health outcomes. Results In total, 63,567 patients were analyzed including 67% Obesity Maintainers, 19% Weight Loss Rebounders, and 14% Weight Loss Maintainers; median follow-up was 9.7 years. Time until osteoarthritis onset was delayed for Weight Loss Maintainers compared to Obesity Maintainers (Logrank test p <0.0001). Female Weight Loss Maintainers had a 19% and 24% lower risk of developing any cancer (p = 0.0022) or obesity-related cancer (p = 0.0021), respectively. No significant trends were observed for opioid use. Weight loss Rebounders and Maintainers had increased risk (14% and 25%) of future treatment for anxiety/depression (both <0.0001). Weight loss maintenance of >15% weight loss was associated with the greatest decrease in incident osteoarthritis. Healthcare resource utilization was significantly higher for Weight Loss Rebounders and Maintainers compared to Obesity Maintainers. Increased weight loss among Weight Loss Maintainers trended with lower overall healthcare resource utilization, except for hospitalizations. Conclusions In people with obesity, sustained weight loss was associated with greater clinical benefits than regained short-term weight loss and obesity maintenance. Higher weight loss magnitudes were associated with delayed onset of osteoarthritis and led to decreased healthcare utilization.
Collapse
Affiliation(s)
- G. Craig Wood
- Geisinger Health, Danville, Pennsylvania, United States of America
- * E-mail:
| | | | - Peter Benotti
- Geisinger Health, Danville, Pennsylvania, United States of America
| | - Adam Cook
- Geisinger Health, Danville, Pennsylvania, United States of America
| | - James Dove
- Geisinger Health, Danville, Pennsylvania, United States of America
| | - Jacob Mowery
- Geisinger Health, Danville, Pennsylvania, United States of America
| | | | - Neeraj Iyer
- Novo Nordisk Inc, Plainsboro, New Jersey, United States of America
| | | | - Neela Kumar
- Novo Nordisk Inc, Plainsboro, New Jersey, United States of America
| | | |
Collapse
|
26
|
Gatto NM, Campbell UB, Rubinstein E, Jaksa A, Mattox P, Mo J, Reynolds RF. The Structured Process to Identify Fit-for-purpose Data (SPIFD): A data feasibility assessment framework. Clin Pharmacol Ther 2021; 111:122-134. [PMID: 34716990 PMCID: PMC9299818 DOI: 10.1002/cpt.2466] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2021] [Accepted: 10/19/2021] [Indexed: 12/15/2022]
Abstract
To complement real‐world evidence (RWE) guidelines, the 2019 Structured Preapproval and Postapproval Comparative study design framework to generate valid and transparent real‐world Evidence (SPACE) framework elucidated a process for designing valid and transparent real‐world studies. As an extension to SPACE, here, we provide a structured framework for conducting feasibility assessments—a step‐by‐step guide to identify decision grade, fit‐for‐purpose data, which complements the United States Food and Drug Administration (FDA)’s framework for a RWE program. The process was informed by our collective experience conducting systematic feasibility assessments of existing data sources for pharmacoepidemiology studies to support regulatory decisions. Used with the SPACE framework, the Structured Process to Identify Fit‐For‐Purpose Data (SPIFD) provides a systematic process for conducting feasibility assessments to determine if a data source is fit for decision making, helping ensure justification and transparency throughout study development, from articulation of a specific and meaningful research question to identification of fit‐for‐purpose data and study design.
Collapse
Affiliation(s)
- Nicolle M Gatto
- Aetion, Inc., New York.,Columbia Mailman School of Public Health, New York.,Tulane School of Public Health and Tropical Medicine, New Orleans
| | - Ulka B Campbell
- Columbia Mailman School of Public Health, New York.,Pfizer Inc., New York
| | | | | | | | | | - Robert F Reynolds
- Tulane School of Public Health and Tropical Medicine, New Orleans.,GlaxoSmithKline, New York
| |
Collapse
|
27
|
Lambert-Obry V, Lafrance JP, Savoie M, Lachaine J. Real-world evidence: a practical toolbox for collecting health state utilities. J Comp Eff Res 2021; 11:57-64. [PMID: 34668758 DOI: 10.2217/cer-2021-0121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Health state utilities (HSU) data collected in real-world evidence studies are at risk of bias. Although numerous guidance documents are available, practical advice to avoid bias in HSU studies is limited. Thus, the objective of this article was to develop a concise toolbox intended for investigators seeking to collect HSU in a real-world setting. The proposed toolbox builds on existing guidance and provides practical steps to help investigators perform good quality research. The toolbox aims at increasing the credibility of HSU data for future reimbursement decision making.
Collapse
Affiliation(s)
- Veronique Lambert-Obry
- The Faculty of Pharmacy, Université de Montréal, 2940, Chemin de Polytechnique, Montréal, Québec H3T 1J4, Canada
| | - Jean-Philippe Lafrance
- The Faculty of Medicine, Université de Montréal, 2900, Boulevard Édouard-Montpetit, Montréal, Québec H3T 1J4, Canada
| | - Michelle Savoie
- The Faculty of Pharmacy, Université de Montréal, 2940, Chemin de Polytechnique, Montréal, Québec H3T 1J4, Canada
| | - Jean Lachaine
- The Faculty of Pharmacy, Université de Montréal, 2940, Chemin de Polytechnique, Montréal, Québec H3T 1J4, Canada
| |
Collapse
|
28
|
Weiser M, Davis JM, Brown CH, Slade EP, Fang LJ, Medoff DR, Buchanan RW, Levi L, Davidson M, Kreyenbuhl J. Differences in Antipsychotic Treatment Discontinuation Among Veterans With Schizophrenia in the U.S. Department of Veterans Affairs. Am J Psychiatry 2021; 178:932-940. [PMID: 34256606 DOI: 10.1176/appi.ajp.2020.20111657] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
OBJECTIVE Effectiveness of antipsychotic drugs is inferred from relatively small randomized clinical trials conducted with carefully selected and monitored participants. This evidence is not necessarily generalizable to individuals treated in daily clinical practice. The authors compared the clinical effectiveness between all oral and long-acting injectable (LAI) antipsychotic medications used in the treatment of schizophrenia in the U.S. Department of Veterans Affairs (VA) health care system. METHODS This was an observational study utilizing VA pharmacy data from 37,368 outpatient veterans with schizophrenia. Outcome measures were all-cause antipsychotic discontinuation and psychiatric hospitalizations. Oral olanzapine was used as the reference group. RESULTS In multivariable analysis, clozapine (hazard ratio=0.43), aripiprazole long-acting injectable (LAI) (hazard ratio=0.71), paliperidone LAI (hazard ratio=0.76), antipsychotic polypharmacy (hazard ratio=0.77), and risperidone LAI (hazard ratio=0.91) were associated with reduced hazard of discontinuation compared with oral olanzapine. Oral first-generation antipsychotics (hazard ratio=1.16), oral risperidone (hazard ratio=1.15), oral aripiprazole (hazard ratio=1.14), oral ziprasidone (hazard ratio=1.13), and oral quetiapine (hazard ratio=1.11) were significantly associated with an increased risk of discontinuation compared with oral olanzapine. No treatment showed reduced risk of psychiatric hospitalization compared with oral olanzapine; quetiapine was associated with a 36% worse outcome in terms of hospitalizations compared with olanzapine. CONCLUSIONS In a national sample of veterans with schizophrenia, those treated with clozapine, two of the LAI second-generation antipsychotics, and antipsychotic polypharmacy continued the same antipsychotic therapy for a longer period of time compared with the reference drug. This may reflect greater overall acceptability of these medications in clinical practice.
Collapse
Affiliation(s)
- Mark Weiser
- Stanley Medical Research Institute, Kensington, Md. (Weiser); Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel (Weiser, Levi); Department of Psychiatry, Tel Aviv University, Ramat Aviv, Israel (Weiser); Department of Psychiatry, University of Illinois, Chicago (Davis); VA Capitol Healthcare Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MIRECC), Baltimore (Brown, Medoff, Kreyenbuhl); Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore (Brown; Medoff, Kreyenbuhl); Johns Hopkins School of Nursing, Baltimore (Slade); Department of Psychiatry, Division of Psychiatric Services Research, University of Maryland School of Medicine, Baltimore (Fang); Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore (Buchanan); and University of Nicosia Medical School, Nicosia, Cyprus (Davison)
| | - John M Davis
- Stanley Medical Research Institute, Kensington, Md. (Weiser); Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel (Weiser, Levi); Department of Psychiatry, Tel Aviv University, Ramat Aviv, Israel (Weiser); Department of Psychiatry, University of Illinois, Chicago (Davis); VA Capitol Healthcare Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MIRECC), Baltimore (Brown, Medoff, Kreyenbuhl); Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore (Brown; Medoff, Kreyenbuhl); Johns Hopkins School of Nursing, Baltimore (Slade); Department of Psychiatry, Division of Psychiatric Services Research, University of Maryland School of Medicine, Baltimore (Fang); Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore (Buchanan); and University of Nicosia Medical School, Nicosia, Cyprus (Davison)
| | - Clayton H Brown
- Stanley Medical Research Institute, Kensington, Md. (Weiser); Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel (Weiser, Levi); Department of Psychiatry, Tel Aviv University, Ramat Aviv, Israel (Weiser); Department of Psychiatry, University of Illinois, Chicago (Davis); VA Capitol Healthcare Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MIRECC), Baltimore (Brown, Medoff, Kreyenbuhl); Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore (Brown; Medoff, Kreyenbuhl); Johns Hopkins School of Nursing, Baltimore (Slade); Department of Psychiatry, Division of Psychiatric Services Research, University of Maryland School of Medicine, Baltimore (Fang); Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore (Buchanan); and University of Nicosia Medical School, Nicosia, Cyprus (Davison)
| | - Eric P Slade
- Stanley Medical Research Institute, Kensington, Md. (Weiser); Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel (Weiser, Levi); Department of Psychiatry, Tel Aviv University, Ramat Aviv, Israel (Weiser); Department of Psychiatry, University of Illinois, Chicago (Davis); VA Capitol Healthcare Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MIRECC), Baltimore (Brown, Medoff, Kreyenbuhl); Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore (Brown; Medoff, Kreyenbuhl); Johns Hopkins School of Nursing, Baltimore (Slade); Department of Psychiatry, Division of Psychiatric Services Research, University of Maryland School of Medicine, Baltimore (Fang); Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore (Buchanan); and University of Nicosia Medical School, Nicosia, Cyprus (Davison)
| | - Li Juan Fang
- Stanley Medical Research Institute, Kensington, Md. (Weiser); Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel (Weiser, Levi); Department of Psychiatry, Tel Aviv University, Ramat Aviv, Israel (Weiser); Department of Psychiatry, University of Illinois, Chicago (Davis); VA Capitol Healthcare Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MIRECC), Baltimore (Brown, Medoff, Kreyenbuhl); Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore (Brown; Medoff, Kreyenbuhl); Johns Hopkins School of Nursing, Baltimore (Slade); Department of Psychiatry, Division of Psychiatric Services Research, University of Maryland School of Medicine, Baltimore (Fang); Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore (Buchanan); and University of Nicosia Medical School, Nicosia, Cyprus (Davison)
| | - Deborah R Medoff
- Stanley Medical Research Institute, Kensington, Md. (Weiser); Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel (Weiser, Levi); Department of Psychiatry, Tel Aviv University, Ramat Aviv, Israel (Weiser); Department of Psychiatry, University of Illinois, Chicago (Davis); VA Capitol Healthcare Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MIRECC), Baltimore (Brown, Medoff, Kreyenbuhl); Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore (Brown; Medoff, Kreyenbuhl); Johns Hopkins School of Nursing, Baltimore (Slade); Department of Psychiatry, Division of Psychiatric Services Research, University of Maryland School of Medicine, Baltimore (Fang); Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore (Buchanan); and University of Nicosia Medical School, Nicosia, Cyprus (Davison)
| | - Robert W Buchanan
- Stanley Medical Research Institute, Kensington, Md. (Weiser); Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel (Weiser, Levi); Department of Psychiatry, Tel Aviv University, Ramat Aviv, Israel (Weiser); Department of Psychiatry, University of Illinois, Chicago (Davis); VA Capitol Healthcare Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MIRECC), Baltimore (Brown, Medoff, Kreyenbuhl); Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore (Brown; Medoff, Kreyenbuhl); Johns Hopkins School of Nursing, Baltimore (Slade); Department of Psychiatry, Division of Psychiatric Services Research, University of Maryland School of Medicine, Baltimore (Fang); Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore (Buchanan); and University of Nicosia Medical School, Nicosia, Cyprus (Davison)
| | - Linda Levi
- Stanley Medical Research Institute, Kensington, Md. (Weiser); Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel (Weiser, Levi); Department of Psychiatry, Tel Aviv University, Ramat Aviv, Israel (Weiser); Department of Psychiatry, University of Illinois, Chicago (Davis); VA Capitol Healthcare Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MIRECC), Baltimore (Brown, Medoff, Kreyenbuhl); Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore (Brown; Medoff, Kreyenbuhl); Johns Hopkins School of Nursing, Baltimore (Slade); Department of Psychiatry, Division of Psychiatric Services Research, University of Maryland School of Medicine, Baltimore (Fang); Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore (Buchanan); and University of Nicosia Medical School, Nicosia, Cyprus (Davison)
| | - Michael Davidson
- Stanley Medical Research Institute, Kensington, Md. (Weiser); Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel (Weiser, Levi); Department of Psychiatry, Tel Aviv University, Ramat Aviv, Israel (Weiser); Department of Psychiatry, University of Illinois, Chicago (Davis); VA Capitol Healthcare Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MIRECC), Baltimore (Brown, Medoff, Kreyenbuhl); Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore (Brown; Medoff, Kreyenbuhl); Johns Hopkins School of Nursing, Baltimore (Slade); Department of Psychiatry, Division of Psychiatric Services Research, University of Maryland School of Medicine, Baltimore (Fang); Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore (Buchanan); and University of Nicosia Medical School, Nicosia, Cyprus (Davison)
| | - Julie Kreyenbuhl
- Stanley Medical Research Institute, Kensington, Md. (Weiser); Sheba Medical Center, Tel Hashomer, Ramat Gan, Israel (Weiser, Levi); Department of Psychiatry, Tel Aviv University, Ramat Aviv, Israel (Weiser); Department of Psychiatry, University of Illinois, Chicago (Davis); VA Capitol Healthcare Network (VISN 5) Mental Illness Research, Education, and Clinical Center (MIRECC), Baltimore (Brown, Medoff, Kreyenbuhl); Department of Epidemiology and Public Health, University of Maryland School of Medicine, Baltimore (Brown; Medoff, Kreyenbuhl); Johns Hopkins School of Nursing, Baltimore (Slade); Department of Psychiatry, Division of Psychiatric Services Research, University of Maryland School of Medicine, Baltimore (Fang); Department of Psychiatry, Maryland Psychiatric Research Center, University of Maryland School of Medicine, Baltimore (Buchanan); and University of Nicosia Medical School, Nicosia, Cyprus (Davison)
| |
Collapse
|
29
|
Wouters HJCM, Conrads-Frank A, Koinig KA, Smith A, Yu G, de Witte T, Wolffenbuttel BHR, Huls G, Siebert U, Stauder R, van der Klauw MM. The anemia-independent impact of myelodysplastic syndromes on health-related quality of life. Ann Hematol 2021; 100:2921-2932. [PMID: 34476573 PMCID: PMC8592948 DOI: 10.1007/s00277-021-04654-1] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Accepted: 08/24/2021] [Indexed: 01/12/2023]
Abstract
Myelodysplastic syndromes (MDS) are in the majority of cases characterized by anemia. Both anemia and MDS per se may directly contribute to impairments in health-related quality of life (HRQoL). In this study, we aimed to investigate the anemia-independent impact of MDS on HRQoL. We evaluated participants (≥ 50 years) from the large population-based Lifelines cohort (N = 44,694, mean age 59.0 ± 7.4 years, 43.6% male) and the European MDS Registry (EUMDS) (N = 1538, mean age 73.4 ± 9.0 years, 63.0% male), which comprises a cohort of lower-risk MDS patients. To enable comparison concerning HRQoL, SF-36 scores measured in Lifelines were converted to EQ-5D-3L index (range 0–1) and dimension scores. Lower-risk MDS patients had significantly lower HRQoL than those from the Lifelines cohort, as illustrated in both the index score and in the five different dimensions. Multivariable linear regression analysis demonstrated that MDS had an adjusted total impact on the EQ-5D index score (B = − 0.12, p < 0.001) and an anemia-independent “direct” impact (B = − 0.10, p < 0.001). Multivariable logistic regression analysis revealed an anemia-independent impact of MDS in the dimension mobility, self-care, usual activities, and anxiety/depression (all except pain/discomfort). This study demonstrates that the major part of the negative impact of lower-risk MDS on HRQoL is not mediated via anemia. Thus, the therapeutic focus should include treatment strategies directed at underlying pathogenic mechanisms to improve HRQoL, rather than aiming predominantly at increasing hemoglobin levels.
Collapse
Affiliation(s)
- Hanneke J C M Wouters
- Department of Hematology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands.
- Department of Endocrinology, University of Groningen, University Medical Center Groningen, 9700 RB, Groningen, The Netherlands.
| | - Annette Conrads-Frank
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT - University for Health Sciences, Medical Informatics and Technology, Hall in Tirol, Austria
| | - Karin A Koinig
- Department of Internal Medicine V (Hematology and Oncology), Medical University Innsbruck, Innsbruck, Austria
| | - Alex Smith
- Epidemiology and Cancer Statistics Group, Department of Health Sciences, University of York, York, UK
| | - Ge Yu
- Epidemiology and Cancer Statistics Group, Department of Health Sciences, University of York, York, UK
- Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Theo de Witte
- Department of Tumor Immunology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Bruce H R Wolffenbuttel
- Department of Endocrinology, University of Groningen, University Medical Center Groningen, 9700 RB, Groningen, The Netherlands
| | - Gerwin Huls
- Department of Hematology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Uwe Siebert
- Institute of Public Health, Medical Decision Making and Health Technology Assessment, Department of Public Health, Health Services Research and Health Technology Assessment, UMIT - University for Health Sciences, Medical Informatics and Technology, Hall in Tirol, Austria
- Division of Health Technology Assessment, ONCOTYROL - Center for Personalized Cancer Medicine, Innsbruck, Austria
- Center for Health Decision Science, Department of Health Policy and Management, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Institute for Technology Assessment and Department of Radiology and Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Reinhard Stauder
- Department of Internal Medicine V (Hematology and Oncology), Medical University Innsbruck, Innsbruck, Austria
| | - Melanie M van der Klauw
- Department of Endocrinology, University of Groningen, University Medical Center Groningen, 9700 RB, Groningen, The Netherlands
| |
Collapse
|
30
|
Patil S, Trinidade A, Wong B, Yung MW. Secondary Obliteration Surgery for Troublesome Mastoid Cavities: A Prospective Series of 228 Pediatric and Adult Cases. Otol Neurotol 2021; 42:e881-e886. [PMID: 33710158 DOI: 10.1097/mao.0000000000003114] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
OBJECTIVE To present the results of a 15-year longitudinal study in a pediatric and adult population with secondary obliteration of troublesome mastoid cavities. STUDY DESIGN Prospective longitudinal study. PATIENTS Children (≤16 yrs) and adults who had obliteration surgery (228 ears) between 2000 and 2017. INTERVENTIONS Therapeutic. SETTING Tertiary referral center. MAIN OUTCOME MEASURES 1) Incidence of recurrent or residual cholesteatoma; 2) creation of a dry ear at 5 years postsurgery; 3) postoperative complications; 4) waterproof status of ear; 5) number of subsequent ear surgery required. RESULTS Thirty-one pediatric and 197 adult cases contributed to the study. At 5 years 11 of 98 (10.8%) had been lost to follow-up. Using Kaplan-Meier survival analysis, the residual rate after 5 years was 4.2% (95% CI: 0.3%-8.2%) and the recurrence rate was 1% (95% CI: 0.0%-3.0%). Of the 223 ears available for assessment, 209 (93.7%) achieved a dry state, 6 (2.7%) had intermittent discharge, 6 (2.7%) had flap necrosis requiring flap trimming, and 1 (0.4%) developed meatal stenosis. Using a cross-sectional analysis at 12 months of follow-up, the otorrhea risk was 19.2% and the risk of definitive waterproofing was 10.9%. There was a reoperation risk of 10% within 5 years which included second-stage ossiculoplasty. CONCLUSIONS Secondary mastoid obliteration is a safe and useful technique in treating the troublesome mastoid cavity in both children and adults. It is associated with a low cholesteatoma recidivism rate and high rate of a trouble-free ear in the long term.
Collapse
Affiliation(s)
| | - Aaron Trinidade
- Southend University Hospital NHS Foundation Trust, Southend-on-Sea, UK
| | - Billy Wong
- Southend University Hospital NHS Foundation Trust, Southend-on-Sea, UK
| | | |
Collapse
|
31
|
Hong D, Fort D, Shi L, Price-Haywood EG. Electronic Medical Record Risk Modeling of Cardiovascular Outcomes Among Patients with Type 2 Diabetes. Diabetes Ther 2021; 12:2007-2017. [PMID: 34143415 PMCID: PMC8266923 DOI: 10.1007/s13300-021-01096-w] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/27/2021] [Accepted: 06/05/2021] [Indexed: 11/24/2022] Open
Abstract
INTRODUCTION Increased utilization of electronic health records (EHR) has enriched databases for creating risk models. We used machine learning techniques to develop an EHR-based risk model locally fitted to patients with type 2 diabetes mellitus (T2DM) for predicting cardiovascular disease. METHODS This retrospective observational study was conducted within Ochsner Health, Louisiana, USA, between 2013-2017. Data analysis included 6245 patients who had two outpatient diagnoses of T2DM recorded on separate days or a diagnosis recorded during an inpatient encounter. Baseline clinical data were limited to 180 days before the index diagnosis. Cardiovascular outcomes were coronary heart disease (CHD), heart failure and stroke. Machine learning approaches were used to select predictor variables into Cox proportional hazards models for each outcome. Locally fit equations were compared to "generalized" risk equations (RECODe, AS-CVD, QRISK3) using model discrimination and calibration. RESULTS Among factors identified in the Ochsner (n = 11), RECODe (n = 14), AS-CVD (n = 15) and QRISK3 (n = 23), only age was common to all four risk equations. The Ochsner model had high internal discrimination for CHD (C-statistics 0.85) and better discrimination than RECODe (C-statistics 0.45), the QRISK3 (C-statistics 0.72) and AS-CVD (C-statistics 0.54). CONCLUSIONS The Ochsner model overestimated 5-year CHD risk, but had relatively higher calibration than the other models in CHD. Risk equations fitted for local populations improved cardiovascular risk stratification for patients with T2DM. Application of machine learning simplified the models compared to "generalized" risk equations.
Collapse
Affiliation(s)
- Dongzhe Hong
- Department of Health Policy and Management, Tulane University School of Public Health and Tropical Medicine, New Orleans, LA, USA
| | - Daniel Fort
- Center for Outcomes and Health Services Research, Ochsner Health, New Orleans, LA, USA
| | - Lizheng Shi
- Department of Health Policy and Management, Tulane University School of Public Health and Tropical Medicine, New Orleans, LA, USA
| | - Eboni G Price-Haywood
- Center for Outcomes and Health Services Research, Ochsner Health, New Orleans, LA, USA.
- University of Queensland Ochsner Clinical School, New Orleans, LA, USA.
| |
Collapse
|
32
|
Luijken K, Spekreijse JJ, van Smeden M, Gardarsdottir H, Groenwold RHH. New-user and prevalent-user designs and the definition of study time origin in pharmacoepidemiology: A review of reporting practices. Pharmacoepidemiol Drug Saf 2021; 30:960-974. [PMID: 33899305 PMCID: PMC8252086 DOI: 10.1002/pds.5258] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Revised: 04/01/2021] [Accepted: 04/20/2021] [Indexed: 12/16/2022]
Abstract
BACKGROUND Guidance reports for observational comparative effectiveness and drug safety research recommend implementing a new-user design whenever possible, since it reduces the risk of selection bias in exposure effect estimation compared to a prevalent-user design. The uptake of this guidance has not been studied extensively. METHODS We reviewed 89 observational effectiveness and safety cohort studies published in six pharmacoepidemiological journals in 2018 and 2019. We developed an extraction tool to assess how frequently new-user and prevalent-user designs were reported to be implemented. For studies that implemented a new-user design in both treatment arms, we extracted information about the extent to which the moment of meeting eligibility criteria, treatment initiation, and start of follow-up were reported to be aligned. RESULTS Of the 89 studies included, 40% reported implementing a new-user design for both the study exposure arm and the comparator arm, while 13% reported implementing a prevalent-user design in both arms. The moment of meeting eligibility criteria, treatment initiation, and start of follow-up were reported to be aligned in both treatment arms in 53% of studies that reported implementing a new-user design. We provided examples of studies that minimized the risk of introducing bias due to unclear definition of time origin in unexposed participants, immortal time, or a time lag. CONCLUSIONS Almost half of the included studies reported implementing a new-user design. Implications of misalignment of study design origin were difficult to assess because it would require explicit reporting of the target estimand in original studies. We recommend that the choice for a particular study time origin is explicitly motivated to enable assessment of validity of the study.
Collapse
Affiliation(s)
- Kim Luijken
- Department of Clinical EpidemiologyLeiden University Medical CenterLeidenThe Netherlands
| | | | - Maarten van Smeden
- Department of Clinical EpidemiologyLeiden University Medical CenterLeidenThe Netherlands
- Julius Center for Health Sciences and Primary Care, University Medical Center UtrechtUtrecht UniversityUtrechtThe Netherlands
| | - Helga Gardarsdottir
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical SciencesUtrecht UniversityUtrechtThe Netherlands
- Department of Clinical Pharmacy, Division Laboratories, Pharmacy and Biomedical Genetics, University Medical Center UtrechtUtrecht UniversityUtrechtThe Netherlands
- Faculty of Pharmaceutical SciencesUniversity of IcelandReykjavikIceland
| | - Rolf H. H. Groenwold
- Department of Clinical EpidemiologyLeiden University Medical CenterLeidenThe Netherlands
- Department of Biomedical Data SciencesLeiden University Medical CenterLeidenThe Netherlands
| |
Collapse
|
33
|
Mamidi TKK, Tran-Nguyen TK, Melvin RL, Worthey EA. Development of An Individualized Risk Prediction Model for COVID-19 Using Electronic Health Record Data. Front Big Data 2021; 4:675882. [PMID: 34151259 PMCID: PMC8211871 DOI: 10.3389/fdata.2021.675882] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Accepted: 05/19/2021] [Indexed: 11/13/2022] Open
Abstract
Developing an accurate and interpretable model to predict an individual's risk for Coronavirus Disease 2019 (COVID-19) is a critical step to efficiently triage testing and other scarce preventative resources. To aid in this effort, we have developed an interpretable risk calculator that utilized de-identified electronic health records (EHR) from the University of Alabama at Birmingham Informatics for Integrating Biology and the Bedside (UAB-i2b2) COVID-19 repository under the U-BRITE framework. The generated risk scores are analogous to commonly used credit scores where higher scores indicate higher risks for COVID-19 infection. By design, these risk scores can easily be calculated in spreadsheets or even with pen and paper. To predict risk, we implemented a Credit Scorecard modeling approach on longitudinal EHR data from 7,262 patients enrolled in the UAB Health System who were evaluated and/or tested for COVID-19 between January and June 2020. In this cohort, 912 patients were positive for COVID-19. Our workflow considered the timing of symptoms and medical conditions and tested the effects by applying different variable selection techniques such as LASSO and Elastic-Net. Within the two weeks before a COVID-19 diagnosis, the most predictive features were respiratory symptoms such as cough, abnormalities of breathing, pain in the throat and chest as well as other chronic conditions including nicotine dependence and major depressive disorder. When extending the timeframe to include all medical conditions across all time, our models also uncovered several chronic conditions impacting the respiratory, cardiovascular, central nervous and urinary organ systems. The whole pipeline of data processing, risk modeling and web-based risk calculator can be applied to any EHR data following the OMOP common data format. The results can be employed to generate questionnaires to estimate COVID-19 risk for screening in building entries or to optimize hospital resources.
Collapse
Affiliation(s)
- Tarun Karthik Kumar Mamidi
- Center for Computational Genomics and Data Science, Departments of Pediatrics and Pathology, University of Alabama at Birmingham School of Medicine, Birmingham, AL, United States
| | - Thi K. Tran-Nguyen
- Hugh Kaul Precision Medicine Institute, University of Alabama at Birmingham, Birmingham, AL, United States
| | - Ryan L. Melvin
- Department of Anesthesiology and Perioperative Medicine, University of Alabama at Birmingham, Birmingham, AL, United States
| | - Elizabeth A. Worthey
- Center for Computational Genomics and Data Science, Departments of Pediatrics and Pathology, University of Alabama at Birmingham School of Medicine, Birmingham, AL, United States
- Hugh Kaul Precision Medicine Institute, University of Alabama at Birmingham, Birmingham, AL, United States
| |
Collapse
|
34
|
Jaksa A, Wu J, Jónsson P, Eichler HG, Vititoe S, Gatto NM. Organized structure of real-world evidence best practices: moving from fragmented recommendations to comprehensive guidance. J Comp Eff Res 2021; 10:711-731. [PMID: 33928789 DOI: 10.2217/cer-2020-0228] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/28/2022] Open
Abstract
Decision-makers have become increasingly interested in incorporating real-world evidence (RWE) into their decision-making process. Due to concerns regarding the reliability and quality of RWE, stakeholders have issued numerous recommendation documents to assist in setting RWE standards. The fragmented nature of these documents poses a challenge to researchers and decision-makers looking for guidance on what is 'high-quality' RWE and how it can be used in decision-making. We offer researchers and decision-makers a structure to organize the landscape of RWE recommendations and identify consensus and gaps in the current recommendations. To provide researchers with a much needed pathway for generating RWE, we discuss how decision-makers can move from fragmented recommendations to comprehensive guidance.
Collapse
Affiliation(s)
- Ashley Jaksa
- Scientific Research, Aetion Inc., 5 Penn Plaza, 7th Fl., New York, NY 10001, USA
| | - James Wu
- Amgen Inc, 1 Amgen Center Drive, Thousand Oaks, CA 91320-1779, USA
| | - Páll Jónsson
- National Institute for Health & Care Excellence, Level 1A, City Tower, Piccadilly Plaza Manchester, M1 4BT, UK
| | - Hans-Georg Eichler
- European Medicines Agency, Domenico Scarlattilaan 6, Amsterdam 1083 HS, Netherlands
| | - Sarah Vititoe
- Scientific Research, Aetion Inc., 5 Penn Plaza, 7th Fl., New York, NY 10001, USA
| | - Nicolle M Gatto
- Scientific Research, Aetion Inc., 5 Penn Plaza, 7th Fl., New York, NY 10001, USA
| |
Collapse
|
35
|
Chen J, Ho M, Lee K, Song Y, Fang Y, Goldstein BA, He W, Irony T, Jiang Q, van der Laan M, Lee H, Lin X, Meng Z, Mishra-Kalyani P, Rockhold F, Wang H, White R. The Current Landscape in Biostatistics of Real-World Data and Evidence: Clinical Study Design and Analysis. Stat Biopharm Res 2021. [DOI: 10.1080/19466315.2021.1883474] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Affiliation(s)
- Jie Chen
- Overland Pharmaceuticals, Inc., Dover, DE
| | | | - Kwan Lee
- Janssen Research and Development, Spring House, PA
| | | | - Yixin Fang
- Global Medical Affairs Statistics, Data and Statistical Sciences, AbbVie, North Chicago, IL
| | - Benjamin A Goldstein
- Duke Clinical Research Institute and Duke University Medical Center, Duke University, Durham, NC
| | - Weili He
- Global Medical Affairs Statistics, Data and Statistical Sciences, AbbVie, North Chicago, IL
| | | | | | | | | | - Xiwu Lin
- Janssen Research and Development, Spring House, PA
| | | | | | - Frank Rockhold
- Global Medical Affairs Statistics, Data and Statistical Sciences, AbbVie, North Chicago, IL
| | - Hongwei Wang
- Global Medical Affairs Statistics, Data and Statistical Sciences, AbbVie, North Chicago, IL
| | | |
Collapse
|
36
|
Levenson M, He W, Chen J, Fang Y, Faries D, Goldstein BA, Ho M, Lee K, Mishra-Kalyani P, Rockhold F, Wang H, Zink RC. Biostatistical Considerations When Using RWD and RWE in Clinical Studies for Regulatory Purposes: A Landscape Assessment. Stat Biopharm Res 2021. [DOI: 10.1080/19466315.2021.1883473] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Affiliation(s)
| | - Weili He
- Global Medical Affairs Statistics, Data and Statistical Sciences, AbbVie, North Chicago, IL
| | - Jie Chen
- Overland Pharmaceuticals, Dover, DE
| | - Yixin Fang
- Global Medical Affairs Statistics, Data and Statistical Sciences, AbbVie, North Chicago, IL
| | - Douglas Faries
- Global Statistical Sciences, Eli Lilly & Company, Indianapolis, IN
| | - Benjamin A. Goldstein
- Department of Biostatistics & Bioinformatics, Duke University, Durham, NC
- Duke Clinical Research Institute, Duke University, Durham, NC
| | | | - Kwan Lee
- Statistics and Decision Sciences, Janssen Research and Development (retired), Spring House, PA
| | | | - Frank Rockhold
- Department of Biostatistics & Bioinformatics, Duke University, Durham, NC
- Duke Clinical Research Institute, Duke University, Durham, NC
| | - Hongwei Wang
- Global Medical Affairs Statistics, Data and Statistical Sciences, AbbVie, North Chicago, IL
| | | |
Collapse
|
37
|
Hempenius M, Groenwold RHH, Souverein PC, de Boer A, Klungel OH, Gardarsdottir H. Impact of anticoagulant exposure misclassification on the bleeding risk of direct oral anticoagulants. Br J Clin Pharmacol 2021; 87:3508-3517. [PMID: 33543516 PMCID: PMC8451929 DOI: 10.1111/bcp.14764] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2020] [Revised: 01/20/2021] [Accepted: 01/26/2021] [Indexed: 12/04/2022] Open
Abstract
Aims Drug exposure status based on routinely collected data might be misclassified when the database contains only prescriptions from 1 type of prescriber (e.g. general practitioner and not specialist). This study aims to quantify the impact of such exposure misclassification on the risk of major bleeding and stroke/transient ischaemic attack (TIA)associated with direct oral anticoagulants (DOACs) vs. vitamin K antagonists (VKAs). Methods Incident anticoagulant users (>12 mo free of anticoagulation use) in the Dutch PHARMO Database Network between 2008 and 2017 were included. Drug exposure was assessed using pharmacy dispensing information. The risks of hospital admission of major bleeding for DOAC vs. VKA users was assessed with Cox regression analysis, where exposure was based on all dispensings, on general practitioner (GP)‐prescribed dispensings only or on specialist‐prescribed dispensings only. Hazard ratios (HRs) were estimated also for hospitalization for gastrointestinal bleeding, intracranial bleeding and stroke/TIA. Results We included 99 182 VKA‐initiators and 21 795 DOAC‐initiators. Use of DOAC was associated with a lower risk of major bleeding compared to VKA use; HR 0.79 (95% confidence interval 0.70–0.90), 0.78 (0.68–0.91) and 0.62 (0.50–0.76), for exposure based on complete dispensing information, only GP‐ and only specialist‐prescribed dispensings, respectively. Similar results were found for the other bleeding outcomes. For stroke/TIA the HRs were 0.96 (0.84–1.09), 1.00 (0.84–1.18) and 0.72 (0.58–0.90), respectively. Conclusion Including only GP‐prescribed anticoagulant dispensings in this case did not materially impact the effect estimates compared to including all anticoagulant dispensings. Including only specialist‐prescribed dispensings, however, strengthened the effect estimates.
Collapse
Affiliation(s)
- Mirjam Hempenius
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, The Netherlands
| | - Rolf H H Groenwold
- Department of Clinical Epidemiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Patrick C Souverein
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, The Netherlands
| | - Anthonius de Boer
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, The Netherlands
| | - Olaf H Klungel
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, The Netherlands.,Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Helga Gardarsdottir
- Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, The Netherlands.,Department of Clinical Pharmacy, Division Laboratory and Pharmacy, University Medical Center Utrecht, Utrecht, The Netherlands.,Faculty of Pharmaceutical Sciences, University of Iceland, Reykjavik, Iceland
| |
Collapse
|
38
|
Enríquez ON, Guedea-Delgado JC, Gastelum-Cuadras G, Romero-Pérez EM, Luján RC, Nájera-Longoria RJ. Mexican physical education teacher’s self-reported and self-perception of teaching style. REVISTA BRASILEIRA DE CIÊNCIAS DO ESPORTE 2021. [DOI: 10.1590/rbce.43.e004821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
ABSTRACT To understand the self-reported and perception of teaching style used among Mexican physical education teachers. Participants included 104 (n=41 females and 63 males) elementary physical education teachers from northern Mexico. Results showed that a traditional teaching style tends to be mainly used either by male and female’s physical education teachers. Showing differences between genders and teaching styles. Female teachers tend to combine a traditional teaching style with one that connects with students engaging in physical activity, developing positive values and attitudes. Cultural context plays an important aspect when developing a teaching self-perception.
Collapse
|
39
|
Derington CG, Mueller SR, Glanz JM, Binswanger IA. Identifying naloxone administrations in electronic health record data using a text-mining tool. Subst Abus 2020; 42:806-812. [PMID: 33320803 PMCID: PMC8203755 DOI: 10.1080/08897077.2020.1856288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
Background: Effective and efficient methods are needed to identify naloxone administrations within electronic health record (EHR) data to conduct overdose surveillance and research. The objective of this study was to develop and validate a text-mining tool to identify naloxone administrations in EHR data. Methods: Clinical notes stored in databases between January 2017 and March 2018 were used to iteratively develop a text-mining tool to identify naloxone administrations. The first iteration of the tool used broad search terms. Then, after reviewing clinical notes of overdose encounters, we developed a list of phrases that described naloxone administrations to inform iteration two. While validating iteration two, additional phrases were found, which were then added to inform the final iteration. The comparator was an administrative code query extracted from the EHR. Medical record review was used to identify true positives. The primary outcome was the positive predictive values (PPV) of the second iteration, final iteration, and administrative code query. Results: Iteration two, the final iteration, and the administrative code had PPVs of 84.3% (95% confidence interval [CI] 78.6-89.0%), 83.8% (95% CI 78.6-88.2%), and 57.1% (95% CI 47.1-66.8%), respectively. Both iterations of the tool had a significantly higher PPV than the administrative code (p < 0.001). Conclusions: A text-mining tool improved the identification of naloxone administrations in EHR data from less than 60% with the administrative code to greater than 80% with both versions of the tool. Text-mining tools can inform the use of more sophisticated informatics methods, which often require significant time, resource, and expertise investment.
Collapse
Affiliation(s)
- Catherine G. Derington
- Department of Population Health Sciences, University of Utah, 295 Chipeta Way, Salt Lake City UT 84112
| | - Shane R. Mueller
- Institute for Health Research, Kaiser Permanente Colorado, 2550 S. Parker Road, Suite 200, Aurora CO 80014
| | - Jason M. Glanz
- Institute for Health Research, Kaiser Permanente Colorado, 2550 S. Parker Road, Suite 200, Aurora CO 80014
- Department of Epidemiology, Colorado School of Public Health, 13001 E 17 Place, Mail Stop B-119, Aurora CO 80045
| | - Ingrid A. Binswanger
- Institute for Health Research, Kaiser Permanente Colorado, 2550 S. Parker Road, Suite 200, Aurora CO 80014
- Colorado Permanente Medical Group, 10350 E. Dakota Ave, Denver CO 80247
- Division of General Internal Medicine, University of Colorado School of Medicine, 13001 E 17 Place, Aurora CO 80045
| |
Collapse
|
40
|
Takeuchi S, Takahashi Y, Asai S. Comparison of pleiotropic effects of statins vs fibrates on laboratory parameters in patients with dyslipidemia: A retrospective cohort study. Medicine (Baltimore) 2020; 99:e23427. [PMID: 33327270 PMCID: PMC7738156 DOI: 10.1097/md.0000000000023427] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/19/2022] Open
Abstract
Differences in the mechanism of action and potential pleiotropic effects between statins and fibrates would potentially drive a different effect on various laboratory parameters, but this remains controversial because of a paucity of reports comparing them. Therefore, the aim of this study was to compare the effects of statins and fibrates on laboratory parameters in Japanese patients in routine clinical practice.This retrospective cohort study included patients with dyslipidemia who had been newly treated with statin or fibrate monotherapy between January 2005 and December 2017. Patients were randomly matched into two sets of pairs by sex, age, and baseline triglyceride (TG) or low-density lipoprotein (LDL) cholesterol level. The 830 patients in TG-matched pairs (415 fibrate users and 415 matched statin users) and 1172 patients in LDL cholesterol-matched pairs (586 fibrate users and 586 matched statin users) were included in this study. Generalized estimating equations were used to estimate the effects of the drugs on serum creatinine level, estimated glomerular filtration rate (eGFR), urea nitrogen, hemoglobin A1c, aspartate aminotransferase, and alanine aminotransferase (ALT), in addition to LDL cholesterol and TG levels, and red blood cell (RBC) and platelet (PLT) counts, up to 12 months after the start of study drug administration.In TG-matched pairs, the increases in creatinine and urea nitrogen levels (P = .010 and P < .001, respectively) and the decreases in eGFR, ALT level and RBC count (P < .001, P = .003, and P = .014, respectively) were greater in fibrate users than in statin users. The decrease in PLT count was greater in statin users than in fibrate users (P < .001). The mean changes in aspartate aminotransferase and hemoglobin A1c levels were not significantly different between statin users and fibrate users. In LDL cholesterol-matched pairs, the differences in changes of all laboratory parameter levels between statin users and fibrate users were similar to those in TG-matched pairs.We demonstrate here that fibrates have a greater effect of increasing creatinine and urea nitrogen levels and of reducing eGFR, ALT level, and RBC count than statins, and that the lowering effect on PLT count is greater with statins than with fibrates.
Collapse
Affiliation(s)
- Satoshi Takeuchi
- Division of Pharmacology, Department of Biomedical Sciences, Nihon University School of Medicine
| | - Yasuo Takahashi
- Division of Genomic Epidemiology and Clinical Trials, Clinical Trials Research Center, Nihon University School of Medicine, 30-1 Oyaguchi-Kami Machi, Itabashi-ku, Tokyo, Japan
| | - Satoshi Asai
- Division of Pharmacology, Department of Biomedical Sciences, Nihon University School of Medicine
| |
Collapse
|
41
|
Hurwitz JT, Brown M, Graff JS, Peters L, Malone DC. Is Real-World Evidence Used in P&T Monographs and Therapeutic Class Reviews? J Manag Care Spec Pharm 2020; 26:1604-1611. [PMID: 33251991 PMCID: PMC10391281 DOI: 10.18553/jmcp.2020.26.12.1604] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
BACKGROUND Payers are faced with making coverage and reimbursement decisions based on the best available evidence. Often these decisions apply to patient populations, provider networks, and care settings not typically studied in clinical trials. Treatment effectiveness evidence is increasingly available from electronic health records, registries, and administrative claims. However, little is known about when and what types of real-world evidence (RWE) studies inform pharmacy and therapeutic (P&T) committee decisions. OBJECTIVE To evaluate evidence sources cited in P&T committee monographs and therapeutic class reviews and assess the design features and quality of cited RWE studies. METHODS A convenience sample of representatives from pharmacy benefit management, health system, and health plan organizations provided recent P&T monographs and therapeutic class reviews (or references from such documents). Two investigators examined and grouped references into major categories (published studies, unpublished studies, and other/unknown) and multiple subcategories (e.g., product label, clinical trials, RWE, systematic reviews). Cited comparative RWE was reviewed to assess design features (e.g., population, data source, comparators) and quality using the Good ReseArch for Comparative Effectiveness (GRACE) Checklist. RESULTS Investigators evaluated 565 references cited in 27 monographs/therapeutic class reviews from 6 managed care organizations. Therapeutic class reviews mostly cited published clinical trials (35.3%, 155/439), while single-product monographs relied most on manufacturer-supplied information (42.1%, 53/126). Published RWE comprised 4.8% (21/439) of therapeutic class review references, and none (0/126) of the monograph references. Of the 21 RWE studies, 12 were comparative and assessed patient care settings and outcomes typically not included in clinical trials (community ambulatory settings [10], long-term safety [8]). RWE studies most frequently were based on registry data (6), conducted in the United States (6), and funded by the pharmaceutical industry (5). GRACE Checklist ratings suggested the data and methods of these comparative RWE studies were of high quality. CONCLUSIONS RWE was infrequently cited in P&T materials, even among therapeutic class reviews where RWE is more readily available. Although few P&T materials cited RWE, the comparative RWE studies were generally high quality. More research is needed to understand when and what types of real-world studies can more routinely inform coverage and reimbursement decisions. DISCLOSURES This project was funded by the National Pharmaceutical Council. Hurwitz, Brown, Peters, and Malone have nothing to disclose. Graff is employed by the National Pharmaceutical Council Part of this study was presented as a poster presentation at the AMCP Managed Care & Specialty Pharmacy 2016 Annual Meeting; April 19-22, 2016; San Francisco, CA. Study concept and design were primarily contributed by Malone and Graff, along with Hurwitz and Brown. All authors participated in data collection, and data interpretation was performed by Malone, Hurwitz, and Graff, with assistance from Brown and Peters. The manuscript was written primarily by Hurwitz and Malone, along with Graff, Brown, and Peters, and revised by Malone, Brown, Peters, Hurwitz, and Graff.
Collapse
Affiliation(s)
- Jason T Hurwitz
- Center for Health Outcomes and PharmacoEconomic Research (HOPE Center), University of Arizona, Tucson
| | - Mary Brown
- College of Pharmacy, University of Arizona, Tucson
| | | | | | | |
Collapse
|
42
|
Luyendijk M, Vernooij RWM, Blommestein HM, Siesling S, Uyl-de Groot CA. Assessment of Studies Evaluating Incremental Costs, Effectiveness, or Cost-Effectiveness of Systemic Therapies in Breast Cancer Based on Claims Data: A Systematic Review. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2020; 23:1497-1508. [PMID: 33127021 DOI: 10.1016/j.jval.2020.05.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/19/2019] [Revised: 04/10/2020] [Accepted: 05/11/2020] [Indexed: 06/11/2023]
Abstract
OBJECTIVES Large secondary databases, such as those containing insurance claims data, are increasingly being used to compare the effects and costs of treatments in routine clinical practice. Despite their appeal, however, caution must be exercised when using these data. In this study, we aimed to identify and assess the methodological quality of studies that used claims data to compare the effectiveness, costs, or cost-effectiveness of systemic therapies for breast cancer. METHODS We searched Embase, the Cochrane Library, Medline, Web of Science, and Google Scholar for English-language publications and assessed the methodological quality using the Good Research for Comparative Effectiveness principles. This study was registered with the International Prospective Register of Systematic Reviews (PROSPERO) under number CRD42018103992. RESULTS We identified 1251 articles, of which 106 met the inclusion criteria. Most studies were conducted in the United States (74%) and Taiwan (9%) and were based on claims data sets (35%) or claims data linked to cancer registries (58%). Furthermore, most included large samples (mean 17 130 patients) and elderly patients, and they covered various outcomes (eg, survival, adverse events, resource use, and costs). Key methodological shortcomings were the lack of information on relevant confounders, the risk of immortal time bias, and the lack of information on the validity of outcomes. Only a few studies performed sensitivity analyses. CONCLUSIONS Many comparative studies of cost, effectiveness, and cost-effectiveness have been published in recent decades based on claims data, and the number of publications has increased over time. Despite the availability of guidelines to improve quality, methodological issues persist and are often inappropriately addressed or reported.
Collapse
Affiliation(s)
- Marianne Luyendijk
- Department of Research and Development, Netherlands Comprehensive Cancer Center, Utrecht, The Netherlands; Erasmus School of Health Policy and Management, Erasmus University, Rotterdam, The Netherlands.
| | - Robin W M Vernooij
- Department of Research and Development, Netherlands Comprehensive Cancer Center, Utrecht, The Netherlands
| | - Hedwig M Blommestein
- Erasmus School of Health Policy and Management, Erasmus University, Rotterdam, The Netherlands
| | - Sabine Siesling
- Department of Research and Development, Netherlands Comprehensive Cancer Center, Utrecht, The Netherlands; Department of Health Technology and Services Research, University of Twente, Enschede, The Netherlands
| | - Carin A Uyl-de Groot
- Erasmus School of Health Policy and Management, Erasmus University, Rotterdam, The Netherlands
| |
Collapse
|
43
|
Rubin DT, Griffith J, Zhang Q, Hepp Z, Keshishian A. The Impact of Intestinal Complications on Health Care Costs Among Patients With Inflammatory Bowel Disease Treated With Anti-Tumor Necrosis Factor Therapies. Inflamm Bowel Dis 2020; 27:1201-1209. [PMID: 33107564 PMCID: PMC8600026 DOI: 10.1093/ibd/izaa270] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/03/2020] [Indexed: 12/21/2022]
Abstract
BACKGROUND Although there is evidence that anti-tumor necrosis factor (TNF) utilization earlier in the inflammatory bowel disease (IBD) course and before the onset of disease-related complications leads to improved patient outcomes, the health care costs and utilization impact have not been well defined. This study assessed differences in health care utilization and costs among patients with IBD treated with anti-TNFs. METHODS Patients with a diagnosis of ulcerative colitis (UC) or Crohn disease (CD) between January 1, 2001, and December 31, 2014, were identified from a claims database. Patients were required to have ≥1 claim for a 5-aminosalicylic acid, corticosteroid, or immunomodulator after the IBD diagnosis and ≥1 anti-TNF drug claim after the first IBD treatment. Complication and noncomplication cohorts were identified based on disease-related complications and IBD-related hospitalizations or emergency department visits for 6 months before anti-TNF initiation. Generalized linear models were used to compare health care costs and utilization for the 12 months after anti-TNF initiation (follow-up). RESULTS The study included 6329 patients with CD and 4451 patients with UC. In patients with CD with complications, >33.7% had intestinal strictures and 6% had enteroenteric fistula before anti-TNF treatment. Patients with CD with complications incurred significantly higher IBD-related and all-cause health care costs during follow-up, and patients with UC experienced the same trends. CONCLUSIONS These results suggest that anti-TNF treatment after, rather than before, a patient develops complications leads to a higher economic burden. However, these findings could also result from patients with more severe disease having early complications that are more difficult to treat.
Collapse
Affiliation(s)
- David T Rubin
- University of Chicago Inflammatory Bowel Disease Center, Chicago, Illinois, USA,Address correspondence to: David T. Rubin, MD, University of Chicago Medicine, 5841 South Maryland Avenue, Chicago, IL 60637 ()
| | | | - Qisu Zhang
- STATinMED Research, Ann Arbor, Michigan, USA
| | | | - Allison Keshishian
- STATinMED Research, Ann Arbor, Michigan, USA,New York City College of Technology, City University of New York, New York, New York, USA
| |
Collapse
|
44
|
Ruigómez A, Brobert G, Vora P, García Rodríguez LA. Validation of venous thromboembolism diagnoses in patients receiving rivaroxaban or warfarin in The Health Improvement Network. Pharmacoepidemiol Drug Saf 2020; 30:229-236. [PMID: 33009708 PMCID: PMC7821274 DOI: 10.1002/pds.5146] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2020] [Revised: 07/14/2020] [Accepted: 09/28/2020] [Indexed: 12/14/2022]
Abstract
Purpose To describe the effect that validation of venous thromboembolism (VTE) coded entries in the health improvement network (THIN) has on incidence rates of VTE among a cohort of rivaroxaban/warfarin users. Methods Among 36 701 individuals with a first prescription for rivaroxaban/warfarin between 2012 and 2015, we performed a two‐step VTE case identification process followed by a two‐step case validation process involving manual review of patient records. A valid case required a coded entry for VTE at some point after their first rivaroxaban/warfarin prescription with evidence of referral/hospitalization either as a coded entry or entered as free text. Positive predictive values (PPVs) with 95% confidence intervals (CIs) were calculated using validated cases as the gold standard. Incidence rates were calculated per 1000 person‐years with 95% CIs. Results We identified 2166 patients with a coded entry of VTE after their initial rivaroxaban/warfarin prescription; incidence rate of 45.31 per 1000 person‐years (95% CI: 43.49‐47.22). After manual review of patient records including the free text, there were 712 incident VTE cases; incidence rate of 14.90 per 1000 person‐years (95% CI: 13.85‐16.02). The PPV for coded entries of VTE alone was 32.9%, and the PPV for coded entries of VTE with a coded entry of referral/hospitalization was 39.8%; this increased to 69.6% after manual review of coded clinical entries in patient records. Conclusions Among rivaroxaban/warfarin users in THIN, valid VTE case identification requires manual review of patient records including the free text to prevent outcome misclassification and substantial overestimation of VTE incidence rates.
Collapse
Affiliation(s)
- Ana Ruigómez
- Spanish Centre for Pharmacoepidemiologic Research (CEIFE), Madrid, Spain
| | | | | | | |
Collapse
|
45
|
Walter E, Hausberger SC, Groß E, Siebert U. Health-related quality of life, work productivity and costs related to patients with inflammatory bowel disease in Austria. J Med Econ 2020; 23:1061-1071. [PMID: 32713223 DOI: 10.1080/13696998.2020.1801187] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
OBJECTIVE Inflammatory-Bowel-Disease (IBD) is a lifelong illness with significant impact on health-related quality of life (HRQoL). The disease-burden causes work productivity impairment, such as sick-leave and restriction of leisure time activities. From a societal perspective, productivity loss often contributes significantly to the total costs. The aim of the study is to analyze the impact of disease-burden on work productivity, daily activities, and HRQoL. METHODS We performed a survey among Austrian patients with IBD to assess general questions about demography and disease pattern, impaired work productivity and reduced daily activities using the Work Productivity and Activity Impairment questionnaire and HRQoL utilizing the Short Inflammatory Bowel Disease Questionnaire (SIBDQ). Associations were assessed employing linear regressions. The questionnaire was circulated by the Austrian Crohn's Disease/Ulcerative Colitis Association. RESULTS In total, 510 patients with median age of 40 years completed the questionnaire. Patients had a median disease-duration of 9 years, 46% were treated with biologics and 64% were employed. The median SIBDQ score was 45 (16-69). Patients in self-assessed remission (n = 319) and relapse (n = 96) differed by 18 points on the SIBDQ score (p value < 0.0001). Mean work productivity reduction amounted to 7 h 17 min (95% CI 6:05-8:29) during the last 7 days. Work absenteeism accounted for 4 h 28 min (95% CI 3:25-5:31) and reduced productivity at the workplace (presenteeism) for 2 h 49 min (95% CI 2:31-3:07). During a relapse, 12 h 9 min were lost (p value < 0.0001). Productivity reduction correlated with HRQoL (r = 0.3964). In total, 143 €per patient per week (95% CI 119-167) were lost (7,411 €per year). On average, patients lost 4 h (95% CI 3:44-4:16) of unpaid daily activities; 3 h 17 min the employed subgroup and 5 h 19 min the not employed. CONCLUSION IBD leads to a substantial burden of disease, which is associated with indirect costs for society related to work ability reduction. HRQoL significantly influences loss of work productivity. Improving HRQoL should be a key factor to reduce disease burden and societal costs.
Collapse
Affiliation(s)
- Evelyn Walter
- IPF GmbH Institute for Pharmaeconomic Research, Vienna, Austria
- Institute for Public Health, Medical Decision Making und Health Technology Assessment, UMIT - University for Health Sciences, Medical Informatics and Technology, Hall in Tirol, Austria
| | | | - Evelyn Groß
- OMCCV Austrian Crohn's Disease/Ulcerative Colitis Association, Vienna, Austria
| | - Uwe Siebert
- Institute for Public Health, Medical Decision Making und Health Technology Assessment, UMIT - University for Health Sciences, Medical Informatics and Technology, Hall in Tirol, Austria
- Center for Health Decision Science, Department of Health Policy and Management, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Institute for Technology Assessment, Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
46
|
Orsini LS, Monz B, Mullins CD, Van Brunt D, Daniel G, Eichler HG, Graff J, Guerino J, Berger M, Lederer NM, Jonsson P, Schneeweiss S, Wang SV, Crown W, Goettsch W, Willke RJ. Improving transparency to build trust in real-world secondary data studies for hypothesis testing-Why, what, and how: recommendations and a road map from the real-world evidence transparency initiative. Pharmacoepidemiol Drug Saf 2020; 29:1504-1513. [PMID: 32924243 DOI: 10.1002/pds.5079] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2020] [Revised: 06/12/2020] [Accepted: 06/23/2020] [Indexed: 12/21/2022]
Abstract
Real-world data (RWD) and the derivations of these data into real-world evidence (RWE) are rapidly expanding from informing healthcare decisions at the patient and health system level to influencing major health policy decisions, including regulatory approvals and coverage. Recent examples include the approval of palbociclib in combination with endocrine therapy for male breast cancer and the inclusion of RWE in the label of paliperidone palmitate for schizophrenia. This interest has created an urgency to develop processes that promote trust in the evidence-generation process. Key stakeholders and decision-makers include patients and their healthcare providers; learning health systems; health technology assessment bodies and payers; pharmacoepidemiologists and other clinical reseachers, and policy makers interested in bioethical and regulatory issues. A key to optimal uptake of RWE is transparency of the research process to enable decision-makers to evaluate the quality of the methods used and the applicability of the evidence that results from the RWE studies. Registration of RWE studies-particularly for hypothesis evaluating treatment effectiveness (HETE) studies-has been proposed to improve transparency, trust, and research replicability. Although registration would not guarantee better RWE studies would be conducted, it would encourage the prospective disclosure of study plans, timing, and rationale for modifications. A joint task force of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the International Society for Pharmacoepidemiology (ISPE) recommended that investigators preregister their RWE studies and post their study protocols in a publicly available forum before starting studies to reduce publication bias and improve the transparency of research methods. Recognizing that published recommendations alone are insufficient, especially without accessible registration options and with no incentives, a group of experts gathered on February 25 and 26, 2019, in National Harbor, Maryland, to explore the structural and practical challenges to the successful implementation of the recommendations of the ISPOR/ISPE task force for preregistration. This positioning article describes a plan for making registration of HETE RWE studies routine. The plan includes specifying the rationale for registering HETE RWE studies, the studies that should be registered, where and when these studies should be registered, how and when analytic deviations from protocols should be reported, how and when to publish results, and incentives to encourage registration. Table 1 summarizes the rationale, goals, and potential solutions that increase transparency, in addition to unique concerns about secondary data studies. Definitions of terms used throughout this report are provided in Table 2.
Collapse
Affiliation(s)
| | | | - C Daniel Mullins
- Pharmaceutical Health Services Research Department, University of Maryland, Baltimore, Maryland, USA
| | | | - Gregory Daniel
- Duke-Margolis Center for Health Policy, Washington, District of Columbia, USA
| | | | - Jennifer Graff
- National Pharmaceutical Council, Washington, District of Columbia, USA
| | | | | | - Nirosha M Lederer
- Duke-Margolis Center for Health Policy, Washington, District of Columbia, USA
| | - Pall Jonsson
- National Institute for Health and Care Excellence (NICE), London, UK
| | | | - Shirley V Wang
- Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | | | - Wim Goettsch
- National Health Care Institute (ZIN), Diemen, the Netherlands.,Utrecht University, Utrecht, the Netherlands
| | | |
Collapse
|
47
|
Gokhale M, Stürmer T, Buse JB. Real-world evidence: the devil is in the detail. Diabetologia 2020; 63:1694-1705. [PMID: 32666226 PMCID: PMC7448554 DOI: 10.1007/s00125-020-05217-1] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/07/2020] [Accepted: 05/01/2020] [Indexed: 12/12/2022]
Abstract
Much has been written about real-world evidence (RWE), a concept that offers an understanding of the effects of healthcare interventions using routine clinical data. The reflection of diverse real-world practices is a double-edged sword that makes RWE attractive but also opens doors to several biases that need to be minimised both in the design and analytical phases of non-experimental studies. Additionally, it is critical to ensure that researchers who conduct these studies possess adequate methodological expertise and ability to accurately implement these methods. Critical design elements to be considered should include a clearly defined research question using a causal inference framework, choice of a fit-for-purpose data source, inclusion of new users of a treatment with comparators that are as similar as possible to that group, accurately classifying person-time and deciding censoring approaches. Having taken measures to minimise bias 'by design', the next step is to implement appropriate analytical techniques (for example propensity scores) to minimise the remnant potential biases. A clear protocol should be provided at the beginning of the study and a report of the results after, including caveats to consider. We also point the readers to readings on some novel analytical methods as well as newer areas of application of RWE. While there is no one-size-fits-all solution to evaluating RWE studies, we have focused our discussion on key methods and issues commonly encountered in comparative observational cohort studies with the hope that readers are better equipped to evaluate non-experimental studies that they encounter in the future. Graphical abstract.
Collapse
Affiliation(s)
- Mugdha Gokhale
- Pharmacoepidemiology, Center for Observational & Real-World Evidence, Merck, 770 Sumneytown Pike, West Point, PA, 19486, USA.
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA.
| | - Til Stürmer
- Department of Epidemiology, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC, USA
| | - John B Buse
- Department of Medicine, University of North Carolina, Chapel Hill, NC, USA
| |
Collapse
|
48
|
Orsini LS, Berger M, Crown W, Daniel G, Eichler HG, Goettsch W, Graff J, Guerino J, Jonsson P, Lederer NM, Monz B, Mullins CD, Schneeweiss S, Brunt DV, Wang SV, Willke RJ. Improving Transparency to Build Trust in Real-World Secondary Data Studies for Hypothesis Testing-Why, What, and How: Recommendations and a Road Map from the Real-World Evidence Transparency Initiative. VALUE IN HEALTH : THE JOURNAL OF THE INTERNATIONAL SOCIETY FOR PHARMACOECONOMICS AND OUTCOMES RESEARCH 2020; 23:1128-1136. [PMID: 32940229 DOI: 10.1016/j.jval.2020.04.002] [Citation(s) in RCA: 68] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2020] [Accepted: 04/09/2020] [Indexed: 06/11/2023]
Abstract
Real-world data (RWD) and the derivations of these data into real-world evidence (RWE) are rapidly expanding from informing healthcare decisions at the patient and health system level to influencing major health policy decisions, including regulatory approvals and coverage. Recent examples include the approval of palbociclib in combination with endocrine therapy for male breast cancer and the inclusion of RWE in the label of paliperidone palmitate for schizophrenia. This interest has created an urgency to develop processes that promote trust in the evidence-generation process. Key stakeholders and decision-makers include patients and their healthcare providers; learning health systems; health technology assessment bodies and payers; pharmacoepidemiologists and other clinical reseachers, and policy makers interested in bioethical and regulatory issues. A key to optimal uptake of RWE is transparency of the research process to enable decision-makers to evaluate the quality of the methods used and the applicability of the evidence that results from the RWE studies. Registration of RWE studies-particularly for hypothesis evaluating treatment effectiveness (HETE) studies-has been proposed to improve transparency, trust, and research replicability. Although registration would not guarantee better RWE studies would be conducted, it would encourage the prospective disclosure of study plans, timing, and rationale for modifications. A joint task force of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) and the International Society for Pharmacoepidemiology (ISPE) recommended that investigators preregister their RWE studies and post their study protocols in a publicly available forum before starting studies to reduce publication bias and improve the transparency of research methods. Recognizing that published recommendations alone are insufficient, especially without accessible registration options and with no incentives, a group of experts gathered on February 25 and 26, 2019, in National Harbor, Maryland, to explore the structural and practical challenges to the successful implementation of the recommendations of the ISPOR/ISPE task force for preregistration. This positioning article describes a plan for making registration of HETE RWE studies routine. The plan includes specifying the rationale for registering HETE RWE studies, the studies that should be registered, where and when these studies should be registered, how and when analytic deviations from protocols should be reported, how and when to publish results, and incentives to encourage registration. Table 1 summarizes the rationale, goals, and potential solutions that increase transparency, in addition to unique concerns about secondary data studies. Definitions of terms used throughout this report are provided in Table 2.
Collapse
Affiliation(s)
| | | | | | - Gregory Daniel
- Duke-Margolis Center for Health Policy, Washington, DC, USA
| | | | - Wim Goettsch
- National Health Care Institute (ZIN), Diemen, The Netherlands; Utrecht University, Utrecht, The Netherlands
| | | | | | - Pall Jonsson
- National Institute for Health and Care Excellence (NICE), London, England, UK
| | | | | | - C Daniel Mullins
- Pharmaceutical Health Services Research Department, University of Maryland, Baltimore, MD, USA
| | | | | | - Shirley V Wang
- Brigham and Women's Hospital, Harvard Medical School, Boston, MA, USA
| | | |
Collapse
|
49
|
Does the Encounter Type Matter When Defining Diabetes Complications in Electronic Health Records? Med Care 2020; 58 Suppl 6 Suppl 1:S53-S59. [PMID: 32011424 DOI: 10.1097/mlr.0000000000001297] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
Abstract
BACKGROUND Electronic health records (EHRs) and claims records are widely used in defining type 2 diabetes mellitus (T2DM) complications across different types of health care encounters. OBJECTIVE This study investigates whether using different EHR encounter types to define diabetes complications may lead to different results when examining associations between diabetes complications and their risk factors in patients with T2DM. RESEARCH DESIGN The study cohort of 64,855 adult patients with T2DM was created from EHR data from the Research Action for Health Network (REACHnet), using the Surveillance Prevention, and Management of Diabetes Mellitus (SUPREME-DM) definitions. Incidence of coronary heart disease (CHD) and stroke events were identified using International Classification of Diseases (ICD)-9/10 codes and grouped by encounter types: (1) inpatient (IP) or emergency department (ED) type, or (2) any health care encounter type. Cox proportional hazards regression was used to estimate associations between diabetes complications (ie, CHD and stroke) and risk factors (ie, low-density lipoprotein cholesterol and hemoglobin A1c). RESULTS The incidence rates of CHD and stroke in all health care settings were more than twice the incidence rates of CHD and stroke in IP/ED settings. The age-adjusted and multivariable-adjusted hazard ratios for incident CHD and stroke across different levels of low-density lipoprotein cholesterol and hemoglobin A1c were similar between IP/ED and all settings. CONCLUSION While there are large variations in incidence rates of CHD and stroke as absolute risks, the associations between both CHD and stroke and their respective risk factors measured by hazard ratios as relative risks are similar, regardless of alternative definitions.
Collapse
|
50
|
Hess LM, Winfree KB, Muehlenbein CE, Zhu YE, Oton AB, Princic N, Aggarwal H. Debunking Myths While Understanding Limitations. Am J Public Health 2020; 110:e2. [PMID: 32267743 DOI: 10.2105/ajph.2020.305603] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Affiliation(s)
- Lisa M Hess
- Lisa M. Hess, Katherine B. Winfree, Catherine E. Muehlenbein, Yajun E. Zhu, Ana B. Oton, and Himani Aggarwal are with Eli Lilly and Company, Indianapolis, IN. Nicole Princic is with IBM Watson Health, Cambridge, MA
| | - Katherine B Winfree
- Lisa M. Hess, Katherine B. Winfree, Catherine E. Muehlenbein, Yajun E. Zhu, Ana B. Oton, and Himani Aggarwal are with Eli Lilly and Company, Indianapolis, IN. Nicole Princic is with IBM Watson Health, Cambridge, MA
| | - Catherine E Muehlenbein
- Lisa M. Hess, Katherine B. Winfree, Catherine E. Muehlenbein, Yajun E. Zhu, Ana B. Oton, and Himani Aggarwal are with Eli Lilly and Company, Indianapolis, IN. Nicole Princic is with IBM Watson Health, Cambridge, MA
| | - Yajun E Zhu
- Lisa M. Hess, Katherine B. Winfree, Catherine E. Muehlenbein, Yajun E. Zhu, Ana B. Oton, and Himani Aggarwal are with Eli Lilly and Company, Indianapolis, IN. Nicole Princic is with IBM Watson Health, Cambridge, MA
| | - Ana B Oton
- Lisa M. Hess, Katherine B. Winfree, Catherine E. Muehlenbein, Yajun E. Zhu, Ana B. Oton, and Himani Aggarwal are with Eli Lilly and Company, Indianapolis, IN. Nicole Princic is with IBM Watson Health, Cambridge, MA
| | - Nicole Princic
- Lisa M. Hess, Katherine B. Winfree, Catherine E. Muehlenbein, Yajun E. Zhu, Ana B. Oton, and Himani Aggarwal are with Eli Lilly and Company, Indianapolis, IN. Nicole Princic is with IBM Watson Health, Cambridge, MA
| | - Himani Aggarwal
- Lisa M. Hess, Katherine B. Winfree, Catherine E. Muehlenbein, Yajun E. Zhu, Ana B. Oton, and Himani Aggarwal are with Eli Lilly and Company, Indianapolis, IN. Nicole Princic is with IBM Watson Health, Cambridge, MA
| |
Collapse
|