1
|
Scholte M, Ramaekers B, Danopoulos E, Grimm SE, Fernandez Coves A, Tian X, Debray T, Chen J, Stirk L, Croft R, Joore M, Armstrong N. Challenges in the Assessment of a Disease Model in the NICE Single Technology Appraisal of Tirzepatide for Treating Type 2 Diabetes: An External Assessment Group Perspective. PHARMACOECONOMICS 2024; 42:829-832. [PMID: 38717708 PMCID: PMC11249712 DOI: 10.1007/s40273-024-01394-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/30/2024] [Indexed: 07/16/2024]
Affiliation(s)
- Mirre Scholte
- Department of Clinical Epidemiology and Medical Technology Assessment (KEMTA), Maastricht University Medical Centre, Maastricht, The Netherlands.
- Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, The Netherlands.
| | - Bram Ramaekers
- Department of Clinical Epidemiology and Medical Technology Assessment (KEMTA), Maastricht University Medical Centre, Maastricht, The Netherlands
- Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, The Netherlands
| | - Evangelos Danopoulos
- Kleijnen Systematic Reviews (KSR) Ltd, York, UK
- Statistical Laboratory, Department of Pure Mathematics and Mathematical Statistics, University of Cambridge, Cambridge, UK
| | - Sabine E Grimm
- Department of Clinical Epidemiology and Medical Technology Assessment (KEMTA), Maastricht University Medical Centre, Maastricht, The Netherlands
- Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, The Netherlands
| | - Andrea Fernandez Coves
- Department of Clinical Epidemiology and Medical Technology Assessment (KEMTA), Maastricht University Medical Centre, Maastricht, The Netherlands
- Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, The Netherlands
| | - Xiaoyu Tian
- Kleijnen Systematic Reviews (KSR) Ltd, York, UK
| | - Thomas Debray
- Smart Data Analysis and Statistics B.V., Utrecht, The Netherlands
| | | | - Lisa Stirk
- Kleijnen Systematic Reviews (KSR) Ltd, York, UK
| | | | - Manuela Joore
- Department of Clinical Epidemiology and Medical Technology Assessment (KEMTA), Maastricht University Medical Centre, Maastricht, The Netherlands
- Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, The Netherlands
| | | |
Collapse
|
2
|
Petropoulou M, Rücker G, Weibel S, Kranke P, Schwarzer G. Model selection for component network meta-analysis in connected and disconnected networks: a simulation study. BMC Med Res Methodol 2023; 23:140. [PMID: 37316775 DOI: 10.1186/s12874-023-01959-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Accepted: 05/29/2023] [Indexed: 06/16/2023] Open
Abstract
BACKGROUND Network meta-analysis (NMA) allows estimating and ranking the effects of several interventions for a clinical condition. Component network meta-analysis (CNMA) is an extension of NMA which considers the individual components of multicomponent interventions. CNMA allows to "reconnect" a disconnected network with common components in subnetworks. An additive CNMA assumes that component effects are additive. This assumption can be relaxed by including interaction terms in the CNMA. METHODS We evaluate a forward model selection strategy for component network meta-analysis to relax the additivity assumption that can be used in connected or disconnected networks. In addition, we describe a procedure to create disconnected networks in order to evaluate the properties of the model selection in connected and disconnected networks. We apply the methods to simulated data and a Cochrane review on interventions for postoperative nausea and vomiting in adults after general anaesthesia. Model performance is compared using average mean squared errors and coverage probabilities. RESULTS CNMA models provide good performance for connected networks and can be an alternative to standard NMA if additivity holds. For disconnected networks, we recommend to use additive CNMA only if strong clinical arguments for additivity exist. CONCLUSIONS CNMA methods are feasible for connected networks but questionable for disconnected networks.
Collapse
Affiliation(s)
- Maria Petropoulou
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Stefan-Meier-Straße 26, 79104, Freiburg, Germany
| | - Gerta Rücker
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Stefan-Meier-Straße 26, 79104, Freiburg, Germany
| | - Stephanie Weibel
- Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Würzburg, Oberdürrbacher Straße 6, 97080, Würzburg, Germany
| | - Peter Kranke
- Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Würzburg, Oberdürrbacher Straße 6, 97080, Würzburg, Germany
| | - Guido Schwarzer
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Stefan-Meier-Straße 26, 79104, Freiburg, Germany.
| |
Collapse
|
3
|
Modeling Multicomponent Interventions in Network Meta-Analysis. Methods Mol Biol 2021. [PMID: 34550595 DOI: 10.1007/978-1-0716-1566-9_15] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/17/2023]
Abstract
There is a rapid increase in trials assessing healthcare interventions consisting of a combination of drugs (polytherapies) or multiple components. In the latter type of interventions (also known as complex interventions), the aspect of complexity is of paramount importance. For example, nonpharmacological interventions, such as psychological interventions or self-management interventions, usually share common components that relate to the nature of intervention, who delivers it, or where and how. In a network of trials, there is often the need to identify the most effective (or safest) component and/or combination of components. Four key meta-analytical approaches have been presented in the literature to handle complex interventions. These include (a) the single-effect model, (b) the full interaction model, (c) the additive main effects model, and (d) the two-way interaction model. In this chapter, we present and discuss the advantages and limitations of these approaches. We illustrate these methods using a network that assesses the relative effects of self-management interventions on waist size in patients with type 2 diabetes.
Collapse
|
4
|
Petropoulou M, Efthimiou O, Rücker G, Schwarzer G, Furukawa TA, Pompoli A, Koek HL, Del Giovane C, Rodondi N, Mavridis D. A review of methods for addressing components of interventions in meta-analysis. PLoS One 2021; 16:e0246631. [PMID: 33556155 PMCID: PMC7870082 DOI: 10.1371/journal.pone.0246631] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2020] [Accepted: 01/22/2021] [Indexed: 01/11/2023] Open
Abstract
Many healthcare interventions are complex, consisting of multiple, possibly interacting, components. Several methodological articles addressing complex interventions in the meta-analytical context have been published. We hereby provide an overview of methods used to evaluate the effects of complex interventions with meta-analytical models. We summarized the methodology, highlighted new developments, and described the benefits, drawbacks, and potential challenges of each identified method. We expect meta-analytical methods focusing on components of several multicomponent interventions to become increasingly popular due to recently developed, easy-to-use, software tools that can be used to conduct the relevant analyses. The different meta-analytical methods are illustrated through two examples comparing psychotherapies for panic disorder.
Collapse
Affiliation(s)
- Maria Petropoulou
- Faculty of Medicine and Medical Center, Institute of Medical Biometry and Statistics, University of Freiburg, Freiburg, Germany
- Department of Primary Education, Evidence Synthesis Methods Team, University of Ioannina, Ioannina, Greece
- * E-mail:
| | - Orestis Efthimiou
- Institute of Social and Preventive Medicine (ISPM), University of Bern, Bern, Switzerland
- Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Gerta Rücker
- Faculty of Medicine and Medical Center, Institute of Medical Biometry and Statistics, University of Freiburg, Freiburg, Germany
| | - Guido Schwarzer
- Faculty of Medicine and Medical Center, Institute of Medical Biometry and Statistics, University of Freiburg, Freiburg, Germany
| | - Toshi A. Furukawa
- Departments of Health Promotion and Human Behavior and Clinical Epidemiology, Kyoto University Graduate School of Medicine/School of Public Health, Kyoto, Japan
| | | | - Huiberdina L. Koek
- Department of Geriatric Medicine, University Medical Centre Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Cinzia Del Giovane
- Institute of Primary Health Care (BIHAM), University of Bern, Bern, Switzerland
- Population Health Laboratory (#PopHealthLab), University of Fribourg, Fribourg, Switzerland
| | - Nicolas Rodondi
- Institute of Primary Health Care (BIHAM), University of Bern, Bern, Switzerland
- Department of General Internal Medicine, Inselspital, Bern University Hospital, University of Bern, Bern, Switzerland
| | - Dimitris Mavridis
- Department of Primary Education, Evidence Synthesis Methods Team, University of Ioannina, Ioannina, Greece
- Faculté de Médecine, Paris Descartes University, Sorbonne Paris Cité, Paris, France
| |
Collapse
|
5
|
Agogo GO, Murphy TE, McAvay GJ, Allore HG. Joint modeling of concurrent binary outcomes in a longitudinal observational study using inverse probability of treatment weighting for treatment effect estimation. Ann Epidemiol 2019; 35:53-58. [PMID: 31085069 DOI: 10.1016/j.annepidem.2019.04.008] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2018] [Revised: 02/05/2019] [Accepted: 04/23/2019] [Indexed: 01/18/2023]
Abstract
PURPOSE Correlated healthcare utilization outcomes may be encoded as binary outcomes in epidemiologic studies. We demonstrate how to account for correlation between concurrent binary outcomes and confounding by person characteristics when estimating a treatment effect in observational studies. METHODS We present a joint shared-parameter model, weighted by inverse probability of treatment weights (IPTW) to account for confounding. The model is evaluated in a simulation study that emulates the Medical Expenditure Panel Survey data and compared with a covariate-adjusted joint model and with separate outcome models (IPTW weighted and covariate adjusted). RESULTS For the IPTW-weighted joint model, relative bias in the estimated treatment effect on outcome 1 ranged from -0.057 to -0.033 and outcome 2 from -0.077 to -0.043. For the covariate-adjusted joint model, relative bias ranged from -0.010 to -0.083 for outcome 1 and from -0.087 to -0.110 for outcome 2. The covariate-adjusted joint model estimated the effect more closely than the covariate-adjusted separate model. The IPTW-weighted joint model estimated the effect more closely for outcome 1. CONCLUSIONS The IPTW-weighted joint model handles correlation between binary outcomes, adjusts for confounding, and estimates the treatment effect accurately in observational studies. We illustrate the contribution of person-specific effects in estimating personalized risk.
Collapse
Affiliation(s)
- George O Agogo
- Department of Internal Medicine, Section of Geriatrics, Yale School of Medicine, New Haven, CT
| | - Terrence E Murphy
- Department of Internal Medicine, Section of Geriatrics, Yale School of Medicine, New Haven, CT; Department of Biostatistics, Yale School of Public Health, New Haven, CT
| | - Gail J McAvay
- Department of Internal Medicine, Section of Geriatrics, Yale School of Medicine, New Haven, CT
| | - Heather G Allore
- Department of Internal Medicine, Section of Geriatrics, Yale School of Medicine, New Haven, CT; Department of Biostatistics, Yale School of Public Health, New Haven, CT.
| |
Collapse
|
6
|
Rücker G, Petropoulou M, Schwarzer G. Network meta-analysis of multicomponent interventions. Biom J 2019; 62:808-821. [PMID: 31021449 PMCID: PMC7217213 DOI: 10.1002/bimj.201800167] [Citation(s) in RCA: 68] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2018] [Revised: 03/05/2019] [Accepted: 03/20/2019] [Indexed: 12/02/2022]
Abstract
In network meta‐analysis (NMA), treatments can be complex interventions, for example, some treatments may be combinations of others or of common components. In standard NMA, all existing (single or combined) treatments are different nodes in the network. However, sometimes an alternative model is of interest that utilizes the information that some treatments are combinations of common components, called component network meta‐analysis (CNMA) model. The additive CNMA model assumes that the effect of a treatment combined of two components A and B is the sum of the effects of A and B, which is easily extended to treatments composed of more than two components. This implies that in comparisons equal components cancel out. Interaction CNMA models also allow interactions between the components. Bayesian analyses have been suggested. We report an implementation of CNMA models in the frequentist R package netmeta. All parameters are estimated using weighted least squares regression. We illustrate the application of CNMA models using an NMA of treatments for depression in primary care. Moreover, we show that these models can even be applied to disconnected networks, if the composite treatments in the subnetworks contain common components.
Collapse
Affiliation(s)
- Gerta Rücker
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Germany
| | - Maria Petropoulou
- Department of Primary Education, School of Education, University of Ioannina, Ioannina, Greece
| | - Guido Schwarzer
- Institute of Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Freiburg, Germany
| |
Collapse
|
7
|
Efthimiou O, Debray TPA, van Valkenhoef G, Trelle S, Panayidou K, Moons KGM, Reitsma JB, Shang A, Salanti G. GetReal in network meta-analysis: a review of the methodology. Res Synth Methods 2016; 7:236-63. [PMID: 26754852 DOI: 10.1002/jrsm.1195] [Citation(s) in RCA: 218] [Impact Index Per Article: 27.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2014] [Revised: 09/30/2015] [Accepted: 11/06/2015] [Indexed: 11/11/2022]
Abstract
Pairwise meta-analysis is an established statistical tool for synthesizing evidence from multiple trials, but it is informative only about the relative efficacy of two specific interventions. The usefulness of pairwise meta-analysis is thus limited in real-life medical practice, where many competing interventions may be available for a certain condition and studies informing some of the pairwise comparisons may be lacking. This commonly encountered scenario has led to the development of network meta-analysis (NMA). In the last decade, several applications, methodological developments, and empirical studies in NMA have been published, and the area is thriving as its relevance to public health is increasingly recognized. This article presents a review of the relevant literature on NMA methodology aiming to pinpoint the developments that have appeared in the field. Copyright © 2016 John Wiley & Sons, Ltd.
Collapse
Affiliation(s)
- Orestis Efthimiou
- Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece.
| | - Thomas P A Debray
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands.,The Dutch Cochrane Centre, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Gert van Valkenhoef
- Department of Epidemiology, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
| | - Sven Trelle
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland.,CTU Bern, Department of Clinical Research, University of Bern, Bern, Switzerland
| | - Klea Panayidou
- Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
| | - Karel G M Moons
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands.,The Dutch Cochrane Centre, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Johannes B Reitsma
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands.,The Dutch Cochrane Centre, Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht, The Netherlands
| | | | - Georgia Salanti
- Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece
| | | |
Collapse
|
8
|
Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, Ioannidis JPA, Straus S, Thorlund K, Jansen JP, Mulrow C, Catalá-López F, Gøtzsche PC, Dickersin K, Boutron I, Altman DG, Moher D. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med 2015; 162:777-84. [PMID: 26030634 DOI: 10.7326/m14-2385] [Citation(s) in RCA: 4590] [Impact Index Per Article: 510.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
The PRISMA statement is a reporting guideline designed to improve the completeness of reporting of systematic reviews and meta-analyses. Authors have used this guideline worldwide to prepare their reviews for publication. In the past, these reports typically compared 2 treatment alternatives. With the evolution of systematic reviews that compare multiple treatments, some of them only indirectly, authors face novel challenges for conducting and reporting their reviews. This extension of the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) statement was developed specifically to improve the reporting of systematic reviews incorporating network meta-analyses. A group of experts participated in a systematic review, Delphi survey, and face-to-face discussion and consensus meeting to establish new checklist items for this extension statement. Current PRISMA items were also clarified. A modified, 32-item PRISMA extension checklist was developed to address what the group considered to be immediately relevant to the reporting of network meta-analyses. This document presents the extension and provides examples of good reporting, as well as elaborations regarding the rationale for new checklist items and the modification of previously existing items from the PRISMA statement. It also highlights educational information related to key considerations in the practice of network meta-analysis. The target audience includes authors and readers of network meta-analyses, as well as journal editors and peer reviewers.
Collapse
|
9
|
Hutton B, Tetzlaff J, Yazdi F, Thielman J, Kanji S, Fergusson D, Bjerre L, Mills E, Thorlund K, Tricco A, Straus S, Moher D, Leenen FHH. Comparative effectiveness of monotherapies and combination therapies for patients with hypertension: protocol for a systematic review with network meta-analyses. Syst Rev 2013; 2:44. [PMID: 23809864 PMCID: PMC3701495 DOI: 10.1186/2046-4053-2-44] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/04/2013] [Accepted: 05/01/2013] [Indexed: 12/11/2022] Open
Abstract
BACKGROUND Hypertension has been cited as the most common attributable risk factor for death worldwide, and in Canada more than one of every five adults had this diagnosis in 2007. In addition to different lifestyle modifications, such as diet and exercise, there exist many pharmaco-therapies from different drug classes which can be used to lower blood pressure, thereby reducing the risk of serious clinical outcomes. In moderate and severe cases, more than one agent may be used. The optimal mono- and combination therapies for mild hypertension and moderate/severe hypertension are unclear, and clinical guidelines provide different recommendations for first line therapy. The objective of this review is to explore the relative benefits and safety of different pharmacotherapies for management of non-diabetic patients with hypertension, whether of a mild or moderate to severe nature. METHODS/DESIGN Searches involving MEDLINE and the Cochrane Database of Systematic Reviews will be used to identify related systematic reviews and relevant randomized trials. The outcomes of interest include myocardial infarction, stroke, incident diabetes, heart failure, overall and cardiovascular related death, and important side effects (cancers, depression, syncopal episodes/falls and sexual dysfunction). Randomized controlled trials will be sought. Two reviewers will independently screen relevant reviews, titles and abstracts resulting from the literature search, and also potentially relevant full-text articles in duplicate. Data will be abstracted and quality will be appraised by two team members independently. Conflicts at all levels of screening and abstraction will be resolved through team discussion. Random effect pairwise meta-analyses and network meta-analyses will be conducted where deemed appropriate. Analyses will be geared toward studying treatment of mild hypertension and moderate/severe hypertension separately. DISCUSSION Our systematic review results will assess the extent of currently available evidence for single agent and multi-agent pharmacotherapies in patients with mild, moderate and severe hypertension, and will provide a rigorous and updated synthesis of a range of important clinical outcomes for clinicians, decision makers and patients. TRIAL REGISTRATION PROSPERO Registration Number: CRD42013004459.
Collapse
Affiliation(s)
- Brian Hutton
- Ottawa Hospital Research Institute, 501 Smyth Road, Ottawa, ON, Canada, Box 201 K1H 8L6
| | - Jennifer Tetzlaff
- Ottawa Hospital Research Institute, 501 Smyth Road, Ottawa, ON, Canada, Box 201 K1H 8L6
| | - Fatemeh Yazdi
- Ottawa Hospital Research Institute, 501 Smyth Road, Ottawa, ON, Canada, Box 201 K1H 8L6
| | - Justin Thielman
- Ottawa Hospital Research Institute, 501 Smyth Road, Ottawa, ON, Canada, Box 201 K1H 8L6
| | - Salmaan Kanji
- Ottawa Hospital Research Institute, 501 Smyth Road, Ottawa, ON, Canada, Box 201 K1H 8L6
| | - Dean Fergusson
- Ottawa Hospital Research Institute, 501 Smyth Road, Ottawa, ON, Canada, Box 201 K1H 8L6
| | - Lise Bjerre
- Department of Family Medicine, University of Ottawa, 43 Bruyere Street (Floor 3JB), Ottawa, ON, Canada K1N 5C8
- Department of Epidemiology and Community Medicine, University of Ottawa, 451 Smyth Road, Ottawa, ON, Canada K1H 8M5
| | - Edward Mills
- Department of Epidemiology and Community Medicine, University of Ottawa, 451 Smyth Road, Ottawa, ON, Canada K1H 8M5
| | - Kristian Thorlund
- Department of Clinical Epidemiology and Biostatistics, Faculty of Health Sciences, McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada L8S 4 K1
| | - Andrea Tricco
- Li Ka Shing Knowledge Institute, St Michael’s Hospital, 209 Victoria Street, East Building, Toronto, ON, Canada M5B 1T8
| | - Sharon Straus
- Li Ka Shing Knowledge Institute, St Michael’s Hospital, 209 Victoria Street, East Building, Toronto, ON, Canada M5B 1T8
| | - David Moher
- Ottawa Hospital Research Institute, 501 Smyth Road, Ottawa, ON, Canada, Box 201 K1H 8L6
| | - Frans HH Leenen
- University of Ottawa Heart Institute, 40 Ruskin Street, Ottawa, ON, Canada K1Y 4W7
| |
Collapse
|