1
|
Röver C, Friede T. Using the bayesmeta R package for Bayesian random-effects meta-regression. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2023; 229:107303. [PMID: 36566650 DOI: 10.1016/j.cmpb.2022.107303] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 11/25/2022] [Accepted: 12/07/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND Random-effects meta-analysis within a hierarchical normal modeling framework is commonly implemented in a wide range of evidence synthesis applications. More general problems may even be tackled when considering meta-regression approaches that in addition allow for the inclusion of study-level covariables. METHODS We describe the Bayesian meta-regression implementation provided in the bayesmetaR package including the choice of priors, and we illustrate its practical use. RESULTS A wide range of example applications are given, such as binary and continuous covariables, subgroup analysis, indirect comparisons, and model selection. Example R code is provided. CONCLUSIONS The bayesmeta package provides a flexible implementation. Due to the avoidance of MCMC methods, computations are fast and reproducible, facilitating quick sensitivity checks or large-scale simulation studies.
Collapse
Affiliation(s)
- Christian Röver
- Department of Medical Statistics, University Medical Center Göttingen, Humboldtallee 32, 37073 Göttingen, Germany.
| | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Humboldtallee 32, 37073 Göttingen, Germany
| |
Collapse
|
2
|
Wang H, Jonas KJ. Response to "Methodological issues in the designing and reporting of frequentist and Bayesian meta-analysis to assess COVID-19 outcomes among PLHIV with various comorbidities" by Ram Bajpai, Vivek Verma and Gyan Prakash Singh. J Int AIDS Soc 2022; 25:e25947. [PMID: 35678303 PMCID: PMC9178784 DOI: 10.1002/jia2.25947] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2022] [Accepted: 05/20/2022] [Indexed: 11/15/2022] Open
Affiliation(s)
- Haoyi Wang
- Department of Work and Social Psychology, Maastricht University, Maastricht, The Netherlands
| | - Kai J Jonas
- Department of Work and Social Psychology, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
3
|
Zheng Q, Ge L, Zhou J, Zhang Y, Lyu M, Chen C, Wang T, Liu L. Risk factors for prolonged air leak after pulmonary surgery: A systematic review and meta-analysis. Asian J Surg 2022; 45:2159-2167. [PMID: 35120835 DOI: 10.1016/j.asjsur.2022.01.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Revised: 10/09/2021] [Accepted: 01/14/2022] [Indexed: 02/08/2023] Open
Abstract
This study aimed to comprehensively identify risk factors for the occurrence of prolonged air leak (PAL) in patients undergoing pulmonary surgery. Studies were retrieved from 3 databases, including PubMed, Web of Science, and EmBase up to 13 May 2020. We performed meta-analysis using Bayesian random effect models through divergence restricting conditional tessellation (DIRECT) algorithm. The effect size was expressed as odds ratio (OR) or mean difference (MD), each with 95% credible interval (CrI). The evidence quality was evaluated. Subgroup analyses and sensitivity analyses were conducted. Thirty-nine studies with 89006 patients were finally included. Pooled PAL incidence was 15%. Of 30 risk factors, 22 were significantly associated with increased PAL incidence. Five risk factors were ultimately selected with high evidence quality: smoking history (OR 1.84, 95%CrI 1.45 to 2.31, P<0.001), preoperative steroid use (OR 1.51, 95%CrI 0.87 to 2.65, P = 0.031), lower ratio of forced expiratory volume in 1 s and forced vital capacity (OR 1.99, 95%CrI 1.22 to 3.33, P = 0.005), non-fissureless technique (OR 2.14, 95%CrI 1.31 to 3.66, P = 0.003), and pathological TNM stage III/IV (OR 1.50, 95%CrI 1.07 to 2.12, P = 0.003). Regarding the negative impact of PAL on the personal cost and postoperative recovery, the verification of previous proposed factors and investigation of recently discovered ones both implied directions for risk stratification and the establishment of an applicable prediction model.
Collapse
Affiliation(s)
- Quan Zheng
- Department of Thoracic Surgery, West China Hospital, Sichuan University, Chengdu, China; West China School of Medicine, Sichuan University, Chengdu, China
| | - Lingling Ge
- Department of Thoracic Surgery, West China Hospital, Sichuan University, Chengdu, China
| | - Jian Zhou
- Department of Thoracic Surgery, West China Hospital, Sichuan University, Chengdu, China; West China School of Medicine, Sichuan University, Chengdu, China
| | - Yuanjin Zhang
- West China School of Medicine, Sichuan University, Chengdu, China; Chinese Evidence-based Medicine Center, West China Hospital, Sichuan University, Chengdu, China
| | - Mengyuan Lyu
- Department of Thoracic Surgery, West China Hospital, Sichuan University, Chengdu, China
| | - Cheng Chen
- West China School of Medicine, Sichuan University, Chengdu, China; Department of Thoracic Surgery, Affiliated Hospital of Zunyi Medical University, Zunyi, China
| | - Tengyong Wang
- Department of Thoracic Surgery, West China Hospital, Sichuan University, Chengdu, China; West China School of Medicine, Sichuan University, Chengdu, China
| | - Lunxu Liu
- Department of Thoracic Surgery, West China Hospital, Sichuan University, Chengdu, China; West China School of Medicine, Sichuan University, Chengdu, China; Western China Collaborative Innovation Center for Early Diagnosis and Multidisciplinary Therapy of Lung Cancer, Sichuan University, Chengdu, China.
| |
Collapse
|
4
|
Wolf V, Kühnel A, Teckentrup V, Koenig J, Kroemer NB. Does transcutaneous auricular vagus nerve stimulation affect vagally mediated heart rate variability? A living and interactive Bayesian meta-analysis. Psychophysiology 2021; 58:e13933. [PMID: 34473846 DOI: 10.1111/psyp.13933] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Revised: 08/06/2021] [Accepted: 08/09/2021] [Indexed: 12/29/2022]
Abstract
Non-invasive brain stimulation techniques, such as transcutaneous auricular vagus nerve stimulation (taVNS), have considerable potential for clinical use. Beneficial effects of taVNS have been demonstrated on symptoms in patients with mental or neurological disorders as well as transdiagnostic dimensions, including mood and motivation. However, since taVNS research is still an emerging field, the underlying neurophysiological processes are not yet fully understood, and the replicability of findings on biomarkers of taVNS effects has been questioned. The objective of this analysis was to synthesize the current evidence concerning the effects of taVNS on vagally mediated heart rate variability (vmHRV), a candidate biomarker that has, so far, received most attention in the field. We performed a living Bayesian random effects meta-analysis. To keep the synthesis of evidence transparent and up to date as new studies are being published, we developed a Shiny web app that regularly incorporates new results and enables users to modify study selection criteria to evaluate the robustness of the inference across potential confounds. Our analysis focuses on 16 single-blind studies comparing taVNS versus sham in healthy participants. The meta-analysis provides strong evidence for the null hypothesis (g = 0.014, CIshortest = [-0.103, 0.132], BF01 = 24.678), indicating that acute taVNS does not alter vmHRV compared to sham. To conclude, there is no support for the hypothesis that vmHRV is a robust biomarker for acute taVNS. By increasing transparency and timeliness, the concept of living meta-analyses can lead to transformational benefits in emerging fields such as non-invasive brain stimulation.
Collapse
Affiliation(s)
- Vinzent Wolf
- Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health (TüCMH), University of Tübingen, Tübingen, Germany.,Department of Psychology, University of Salzburg, Salzburg, Austria
| | - Anne Kühnel
- Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health (TüCMH), University of Tübingen, Tübingen, Germany.,Department of Translational Research in Psychiatry, Max Planck Institute of Psychiatry and International Max Planck Research School for Translational Psychiatry (IMPRS-TP), Munich, Germany
| | - Vanessa Teckentrup
- Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health (TüCMH), University of Tübingen, Tübingen, Germany
| | - Julian Koenig
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Nils B Kroemer
- Department of Psychiatry and Psychotherapy, Tübingen Center for Mental Health (TüCMH), University of Tübingen, Tübingen, Germany
| |
Collapse
|
5
|
Röver C, Bender R, Dias S, Schmid CH, Schmidli H, Sturtz S, Weber S, Friede T. On weakly informative prior distributions for the heterogeneity parameter in Bayesian random-effects meta-analysis. Res Synth Methods 2021; 12:448-474. [PMID: 33486828 DOI: 10.1002/jrsm.1475] [Citation(s) in RCA: 44] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Revised: 01/13/2021] [Accepted: 01/16/2021] [Indexed: 12/13/2022]
Abstract
The normal-normal hierarchical model (NNHM) constitutes a simple and widely used framework for meta-analysis. In the common case of only few studies contributing to the meta-analysis, standard approaches to inference tend to perform poorly, and Bayesian meta-analysis has been suggested as a potential solution. The Bayesian approach, however, requires the sensible specification of prior distributions. While noninformative priors are commonly used for the overall mean effect, the use of weakly informative priors has been suggested for the heterogeneity parameter, in particular in the setting of (very) few studies. To date, however, a consensus on how to generally specify a weakly informative heterogeneity prior is lacking. Here we investigate the problem more closely and provide some guidance on prior specification.
Collapse
Affiliation(s)
- Christian Röver
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| | - Ralf Bender
- Department of Medical Biometry, Institute for Quality and Efficiency in Health Care (IQWiG), Köln, Germany
| | - Sofia Dias
- Centre for Reviews and Dissemination, University of York, York, UK
| | - Christopher H Schmid
- Department of Biostatistics and Center for Evidence Synthesis in Health, Brown University School of Public Health, Providence, Rhode Island, USA
| | - Heinz Schmidli
- Statistical Methodology, Development, Novartis Pharma AG, Basel, Switzerland
| | - Sibylle Sturtz
- Department of Medical Biometry, Institute for Quality and Efficiency in Health Care (IQWiG), Köln, Germany
| | - Sebastian Weber
- Advanced Exploratory Analytics, Novartis Pharma AG, Basel, Switzerland
| | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| |
Collapse
|
6
|
Bayesian Approaches for Confirmatory Trials in Rare Diseases: Opportunities and Challenges. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:ijerph18031022. [PMID: 33498915 PMCID: PMC7908592 DOI: 10.3390/ijerph18031022] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 11/29/2020] [Revised: 01/15/2021] [Accepted: 01/20/2021] [Indexed: 11/30/2022]
Abstract
The aim of this narrative review is to introduce the reader to Bayesian methods that, in our opinion, appear to be the most important in the context of rare diseases. A disease is defined as rare depending on the prevalence of the affected patients in the considered population, for example, about 1 in 1500 people in U.S.; about 1 in 2500 people in Japan; and fewer than 1 in 2000 people in Europe. There are between 6000 and 8000 rare diseases and the main issue in drug development is linked to the challenge of achieving robust evidence from clinical trials in small populations. A better use of all available information can help the development process and Bayesian statistics can provide a solid framework at the design stage, during the conduct of the trial, and at the analysis stage. The focus of this manuscript is to provide a review of Bayesian methods for sample size computation or reassessment during phase II or phase III trial, for response adaptive randomization and of for meta-analysis in rare disease. Challenges regarding prior distribution choice, computational burden and dissemination are also discussed.
Collapse
|
7
|
Weber F, Knapp G, Glass Ä, Kundt G, Ickstadt K. Interval estimation of the overall treatment effect in random-effects meta-analyses: Recommendations from a simulation study comparing frequentist, Bayesian, and bootstrap methods. Res Synth Methods 2020; 12:291-315. [PMID: 33264488 DOI: 10.1002/jrsm.1471] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2020] [Revised: 11/24/2020] [Accepted: 11/30/2020] [Indexed: 11/08/2022]
Abstract
There exists a variety of interval estimators for the overall treatment effect in a random-effects meta-analysis. A recent literature review summarizing existing methods suggested that in most situations, the Hartung-Knapp/Sidik-Jonkman (HKSJ) method was preferable. However, a quantitative comparison of those methods in a common simulation study is still lacking. Thus, we conduct such a simulation study for continuous and binary outcomes, focusing on the medical field for application. Based on the literature review and some new theoretical considerations, a practicable number of interval estimators is selected for this comparison: the classical normal-approximation interval using the DerSimonian-Laird heterogeneity estimator, the HKSJ interval using either the Paule-Mandel or the Sidik-Jonkman heterogeneity estimator, the Skovgaard higher-order profile likelihood interval, a parametric bootstrap interval, and a Bayesian interval using different priors. We evaluate the performance measures (coverage and interval length) at specific points in the parameter space, that is, not averaging over a prior distribution. In this sense, our study is conducted from a frequentist point of view. We confirm the main finding of the literature review, the general recommendation of the HKSJ method (here with the Sidik-Jonkman heterogeneity estimator). For meta-analyses including only two studies, the high length of the HKSJ interval limits its practical usage. In this case, the Bayesian interval using a weakly informative prior for the heterogeneity may help. Our recommendations are illustrated using a real-world meta-analysis dealing with the efficacy of an intramyocardial bone marrow stem cell transplantation during coronary artery bypass grafting.
Collapse
Affiliation(s)
- Frank Weber
- Institute for Biostatistics and Informatics in Medicine and Ageing Research, Rostock University Medical Center, Rostock, Germany
| | - Guido Knapp
- Department of Statistics, TU Dortmund University, Dortmund, Germany
| | - Änne Glass
- Institute for Biostatistics and Informatics in Medicine and Ageing Research, Rostock University Medical Center, Rostock, Germany
| | - Günther Kundt
- Institute for Biostatistics and Informatics in Medicine and Ageing Research, Rostock University Medical Center, Rostock, Germany
| | - Katja Ickstadt
- Department of Statistics, TU Dortmund University, Dortmund, Germany
| |
Collapse
|
8
|
Moraes MBD, Avgerinou C, Fukushima FB, Vidal EIO. Nutritional interventions for the management of frailty in older adults: systematic review and meta-analysis of randomized clinical trials. Nutr Rev 2020; 79:889-913. [PMID: 33330911 DOI: 10.1093/nutrit/nuaa101] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022] Open
Abstract
CONTEXT Although nutrition is considered an important intervention for the management of frailty, the actual effectiveness of interventions addressing nutrition in frail older people remains unclear. OBJECTIVE The aim for this systematic review was to appraise the evidence regarding the effectiveness of nutritional interventions for the management of frailty in older adults. DATA EXTRACTION We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. The MEDLINE, Embase, Cumulative Index to Nursing and Allied Health Literature, Cochrane Central Register of Controlled Trials, Web of Science, and Latin American and Caribbean Health Sciences Literature databases were searched from January 2001 to November 2019. Two independent reviewers extracted relevant data. From 2370 initial records, 19 publications presenting data from 17 studies (1564 individuals; follow-up: 7-96 weeks) were included. DATA ANALYSIS None of the Bayesian random-effects meta-analyses comparing nutritional supplements with placebo regarding mortality, body mass index, weight, frailty status, muscle strength, gait speed, body composition, and cognitive function showed statistically significant differences. The same applies to a single meta-analysis comparing nutritional education with general health advice regarding muscle strength. CONCLUSION Our results suggest, mostly with low to very low degrees of certainty, that nutritional supplements or nutritional education delivered in isolation may not be effective for the management of frailty in older people. REVIEW REGISTRATION NUMBER CRD42018111510 (PROSPERO).
Collapse
Affiliation(s)
- Mariana B de Moraes
- Public Health Department, São Paulo State University, Botucatu Medical School, Botucatu, São Paulo, Brazil
| | - Christina Avgerinou
- Department of Primary Care and Population Health, University College London, London, United Kingdom
| | - Fernanda B Fukushima
- Anesthesiology Department, Botucatu Medical School, São Paulo State University, Botucatu, São Paulo, Brazil
| | - Edison I O Vidal
- Internal Medicine Department, Botucatu Medical School, São Paulo State University, Botucatu, São Paulo, Brazil
| |
Collapse
|
9
|
Thompson CG, Semma B. An alternative approach to frequentist meta-analysis: A demonstration of Bayesian meta-analysis in adolescent development research. J Adolesc 2020; 82:86-102. [PMID: 32659594 DOI: 10.1016/j.adolescence.2020.05.001] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2019] [Revised: 04/06/2020] [Accepted: 05/03/2020] [Indexed: 01/29/2023]
Abstract
INTRODUCTION Past decades have seen a surge of applied and methodological research on meta-analysis. One methodological advancement that has gained significant traction is a Bayesian approach to meta-analysis. METHODS We present a non-technical introduction to Bayesian meta-analysis. This introduction re-analyzes data from a meta-analysis concerning the impact of media literacy interventions on attitudes and intentions related to risky health behaviors using a Bayesian approach. One data relate media literacy interventions to media literacy skills, and another relates media literacy interventions to attitudes and behavioral intentions towards risky health behaviors. In these examples we focus on how to conduct unconditional models via graphical and quantitative results. Further, we demonstrate how to conduct subgroup analyses using risk behavior type (drinking, sexual, or smoking). RESULTS We demonstrated how several meta-analytical quantities could be computed and interpreted in a Bayesian framework. This was done both graphically (plot of the marginal posterior distributions) and quantitatively (e.g., central tendency measures, highest posterior density intervals). Results also showed how analyzing effect sizes at the risk-behavior level could affect several interpretations. CONCLUSIONS We emphasize that in no way are Bayesian methods "superior" to frequentist methods, nor that frequentist methods should be abandoned. Instead, the two approaches should be viewed as familial, each with advantages and disadvantages, but strive at a common purpose. We hope for increased use of Bayesian meta-analyses, and Bayesian methodology at large, in adolescence research. Last, all R code is provided for readers to use as a foundation for their own research.
Collapse
|
10
|
Aiolfi A, Tornese S, Bonitta G, Cavalli M, Rausa E, Micheletto G, Campanelli G, Bona D. Dor versus Toupet fundoplication after Laparoscopic Heller Myotomy: Systematic review and Bayesian meta-analysis of randomized controlled trials. Asian J Surg 2019; 43:20-28. [PMID: 31031056 DOI: 10.1016/j.asjsur.2019.03.019] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2019] [Accepted: 03/28/2019] [Indexed: 02/06/2023] Open
Abstract
Laparoscopic Heller Myotomy (LHM) with partial fundoplication has become the treatment of choice for esophageal achalasia. However, the choice of the partial fundoplication is debated. The aim of this study was to compare outcomes for Dor and Toupet fundoplication after LHM. A systematic search of randomized controlled trials comparing Dor and Toupet fundoplication was performed using PubMed, EMBASE and Web of Science. Three studies met the inclusion criteria. Overall, 174 patients were included in the analysis. The postoperative abnormal acid reflux [pooled Risk Ratio 0.98 (95% HPD 0.54-1.80)] and dysphagia [pooled Risk Ratio 1.03 (95% HPD 0.51-2.05)] were similar comparing Dor and Toupet fundoplication. The % total time pH ≤ 4 [estimated pooled mean difference -0.08 (95% HPD -1.04-0.90)] and DeMeester score [estimated pooled mean difference 0.51 (95% HPD -0.90-1.94)] were comparable. Additionally, the operative time [estimated pooled mean difference 0.02 (95% HPD -0.53-0.52)] and iatrogenic esophageal perforation [pooled Risk Ratio 1.05 (95% HPD 0.52-2.10)] were similar in the two groups. Dor and Toupet fundoplication after laparoscopic Heller myotomy seem comparable in term of postoperative abnormal acid exposure and dysphagia. The choice of the partial fundoplication should be left to surgeon experience and tailored on each patient.
Collapse
Affiliation(s)
- Alberto Aiolfi
- Department of Biomedical Science for Health, Division of General Surgery, University of Milan, Istituto Clinico Sant'Ambrogio, Milan, Italy.
| | - Stefania Tornese
- Department of Biomedical Science for Health, Division of General Surgery, University of Milan, Istituto Clinico Sant'Ambrogio, Milan, Italy.
| | - Gianluca Bonitta
- Department of Biomedical Science for Health, Division of General Surgery, University of Milan, Istituto Clinico Sant'Ambrogio, Milan, Italy.
| | - Marta Cavalli
- Department of Surgery, University of Insubria, Istituto Clinico Sant'Ambrogio, Milan, Italy.
| | - Emanuele Rausa
- Department of Biomedical Science for Health, Division of General Surgery, University of Milan, Istituto Clinico Sant'Ambrogio, Milan, Italy.
| | - Giancarlo Micheletto
- Department of Pathophysiology and Transplantation, INCO and Department of General Surgery, University of Milan, Istituto Clinico Sant'Ambrogio, Milan, Italy.
| | - Giampiero Campanelli
- Department of Surgery, University of Insubria, Istituto Clinico Sant'Ambrogio, Milan, Italy.
| | - Davide Bona
- Department of Biomedical Science for Health, Division of General Surgery, University of Milan, Istituto Clinico Sant'Ambrogio, Milan, Italy.
| |
Collapse
|
11
|
Unkel S, Amiri M, Benda N, Beyersmann J, Knoerzer D, Kupas K, Langer F, Leverkus F, Loos A, Ose C, Proctor T, Schmoor C, Schwenke C, Skipka G, Unnebrink K, Voss F, Friede T. On estimands and the analysis of adverse events in the presence of varying follow-up times within the benefit assessment of therapies. Pharm Stat 2019; 18:166-183. [PMID: 30458579 PMCID: PMC6587465 DOI: 10.1002/pst.1915] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2018] [Revised: 09/19/2018] [Accepted: 10/23/2018] [Indexed: 12/21/2022]
Abstract
The analysis of adverse events (AEs) is a key component in the assessment of a drug's safety profile. Inappropriate analysis methods may result in misleading conclusions about a therapy's safety and consequently its benefit-risk ratio. The statistical analysis of AEs is complicated by the fact that the follow-up times can vary between the patients included in a clinical trial. This paper takes as its focus the analysis of AE data in the presence of varying follow-up times within the benefit assessment of therapeutic interventions. Instead of approaching this issue directly and solely from an analysis point of view, we first discuss what should be estimated in the context of safety data, leading to the concept of estimands. Although the current discussion on estimands is mainly related to efficacy evaluation, the concept is applicable to safety endpoints as well. Within the framework of estimands, we present statistical methods for analysing AEs with the focus being on the time to the occurrence of the first AE of a specific type. We give recommendations which estimators should be used for the estimands described. Furthermore, we state practical implications of the analysis of AEs in clinical trials and give an overview of examples across different indications. We also provide a review of current practices of health technology assessment (HTA) agencies with respect to the evaluation of safety data. Finally, we describe problems with meta-analyses of AE data and sketch possible solutions.
Collapse
Affiliation(s)
- Steffen Unkel
- Department of Medical StatisticsUniversity Medical Center GoettingenGoettingenGermany
| | - Marjan Amiri
- Center for Clinical TrialsUniversity Hospital EssenEssenGermany
| | - Norbert Benda
- Biostatistics and Special Pharmacokinetics Unit, Federal Institute for Drugs and Medical DevicesBonnGermany
| | | | | | - Katrin Kupas
- Bristol‐Myers Squibb GmbH & Co. KGaAMünchenGermany
| | | | | | | | - Claudia Ose
- Center for Clinical TrialsUniversity Hospital EssenEssenGermany
| | - Tanja Proctor
- Institute of Medical Biometry and InformaticsUniversity of HeidelbergHeidelbergGermany
| | - Claudia Schmoor
- Clinical Trials Unit, Faculty of Medicine and Medical CenterUniversity of FreiburgFreiburg im BreisgauGermany
| | - Carsten Schwenke
- Schwenke Consulting: Strategies and Solutions in Statistics (SCO:SSIS)BerlinGermany
| | - Guido Skipka
- Institute for Quality and Efficiency in Health CareCologneGermany
| | | | - Florian Voss
- Boehringer Ingelheim Pharma GmbH & Co. KGIngelheimGermany
| | - Tim Friede
- Department of Medical StatisticsUniversity Medical Center GoettingenGoettingenGermany
| |
Collapse
|
12
|
Friede T, Posch M, Zohar S, Alberti C, Benda N, Comets E, Day S, Dmitrienko A, Graf A, Günhan BK, Hee SW, Lentz F, Madan J, Miller F, Ondra T, Pearce M, Röver C, Toumazi A, Unkel S, Ursino M, Wassmer G, Stallard N. Recent advances in methodology for clinical trials in small populations: the InSPiRe project. Orphanet J Rare Dis 2018; 13:186. [PMID: 30359266 PMCID: PMC6203217 DOI: 10.1186/s13023-018-0919-y] [Citation(s) in RCA: 25] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2017] [Accepted: 09/24/2018] [Indexed: 12/16/2022] Open
Abstract
Where there are a limited number of patients, such as in a rare disease, clinical trials in these small populations present several challenges, including statistical issues. This led to an EU FP7 call for proposals in 2013. One of the three projects funded was the Innovative Methodology for Small Populations Research (InSPiRe) project. This paper summarizes the main results of the project, which was completed in 2017.The InSPiRe project has led to development of novel statistical methodology for clinical trials in small populations in four areas. We have explored new decision-making methods for small population clinical trials using a Bayesian decision-theoretic framework to compare costs with potential benefits, developed approaches for targeted treatment trials, enabling simultaneous identification of subgroups and confirmation of treatment effect for these patients, worked on early phase clinical trial design and on extrapolation from adult to pediatric studies, developing methods to enable use of pharmacokinetics and pharmacodynamics data, and also developed improved robust meta-analysis methods for a small number of trials to support the planning, analysis and interpretation of a trial as well as enabling extrapolation between patient groups. In addition to scientific publications, we have contributed to regulatory guidance and produced free software in order to facilitate implementation of the novel methods.
Collapse
Affiliation(s)
| | - Martin Posch
- Section of Medical Statistics, CeMSIIS, Medical University of Vienna, Vienna, Austria
| | - Sarah Zohar
- INSERM, U1138, team 22, Centre de Recherche des Cordeliers, Université Paris 5, Université Paris 6, Paris, France
| | - Corinne Alberti
- INSERM, Hôpital Robert-Debré, APHP, University Paris 7, Paris, France
| | | | - Emmanuelle Comets
- INSERM, IAME, UMR 1137, Univ Paris Diderot, Sorbonne Paris Cité, Paris, France.,INSERM, CIC 1414, Univ Rennes-1, Rennes, France
| | - Simon Day
- Clinical Trials Consulting and Training Limited, Buckingham, UK
| | | | - Alexandra Graf
- Section of Medical Statistics, CeMSIIS, Medical University of Vienna, Vienna, Austria
| | | | - Siew Wan Hee
- Warwick Medical School, University of Warwick, Coventry, UK
| | | | - Jason Madan
- Warwick Medical School, University of Warwick, Coventry, UK
| | - Frank Miller
- Department of Statistics, Stockholm University, Stockholm, Sweden
| | - Thomas Ondra
- Section of Medical Statistics, CeMSIIS, Medical University of Vienna, Vienna, Austria
| | | | | | - Artemis Toumazi
- INSERM, Hôpital Robert-Debré, APHP, University Paris 7, Paris, France
| | | | - Moreno Ursino
- INSERM, U1138, team 22, Centre de Recherche des Cordeliers, Université Paris 5, Université Paris 6, Paris, France
| | - Gernot Wassmer
- Section of Medical Statistics, CeMSIIS, Medical University of Vienna, Vienna, Austria
| | - Nigel Stallard
- Warwick Medical School, University of Warwick, Coventry, UK.
| |
Collapse
|
13
|
Röver C, Wandel S, Friede T. Model averaging for robust extrapolation in evidence synthesis. Stat Med 2018; 38:674-694. [PMID: 30302781 DOI: 10.1002/sim.7991] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2018] [Revised: 08/15/2018] [Accepted: 09/13/2018] [Indexed: 11/11/2022]
Abstract
Extrapolation from a source to a target, eg, from adults to children, is a promising approach to utilize external information when data are sparse. In the context of meta-analyses, one is commonly faced with a small number of studies, whereas potentially relevant additional information may also be available. Here, we describe a simple extrapolation strategy using heavy-tailed mixture priors for effect estimation in meta-analysis, which effectively results in a model-averaging technique. The described method is robust in the sense that a potential prior-data conflict, ie, a discrepancy between source and target data, is explicitly anticipated. The aim of this paper is to develop a solution for this particular application to showcase the ease of implementation by providing R code, and to demonstrate the robustness of the general approach in simulations.
Collapse
Affiliation(s)
- Christian Röver
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| | | | - Tim Friede
- Department of Medical Statistics, University Medical Center Göttingen, Göttingen, Germany
| |
Collapse
|
14
|
Bender R, Friede T, Koch A, Kuss O, Schlattmann P, Schwarzer G, Skipka G. Methods for evidence synthesis in the case of very few studies. Res Synth Methods 2018; 9:382-392. [PMID: 29504289 PMCID: PMC6175308 DOI: 10.1002/jrsm.1297] [Citation(s) in RCA: 111] [Impact Index Per Article: 18.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2017] [Revised: 11/03/2017] [Accepted: 02/25/2018] [Indexed: 11/29/2022]
Abstract
In systematic reviews, meta-analyses are routinely applied to summarize the results of the relevant studies for a specific research question. If one can assume that in all studies the same true effect is estimated, the application of a meta-analysis with common effect (commonly referred to as fixed-effect meta-analysis) is adequate. If between-study heterogeneity is expected to be present, the method of choice is a meta-analysis with random effects. The widely used DerSimonian and Laird method for meta-analyses with random effects has been criticized due to its unfavorable statistical properties, especially in the case of very few studies. A working group of the Cochrane Collaboration recommended the use of the Knapp-Hartung method for meta-analyses with random effects. However, as heterogeneity cannot be reliably estimated if only very few studies are available, the Knapp-Hartung method, while correctly accounting for the corresponding uncertainty, has very low power. Our aim is to summarize possible methods to perform meaningful evidence syntheses in the situation with only very few (ie, 2-4) studies. Some general recommendations are provided on which method should be used when. Our recommendations are based on the existing literature on methods for meta-analysis with very few studies and consensus of the authors. The recommendations are illustrated by 2 examples coming from dossier assessments of the Institute for Quality and Efficiency in Health Care.
Collapse
Affiliation(s)
- Ralf Bender
- Department of Medical BiometryInstitute for Quality and Efficiency in Health Care (IQWiG)CologneGermany
| | - Tim Friede
- Department of Medical StatisticsUniversity Medical Center GöttingenGöttingenGermany
| | - Armin Koch
- Institute for BiostatisticsHannover Medical SchoolHannoverGermany
| | - Oliver Kuss
- Institute for Biometrics and Epidemiology, German Diabetes CenterLeibniz Institute for Diabetes Research, Heinrich Heine UniversityDüsseldorfGermany
| | - Peter Schlattmann
- Institute of Medical Statistics, Computer Sciences and DocumentationJena University Hospital, Friedrich Schiller University JenaJenaGermany
| | - Guido Schwarzer
- Institute for Medical Biometry and Statistics, Faculty of Medicine and Medical CenterUniversity of FreiburgFreiburgGermany
| | - Guido Skipka
- Department of Medical BiometryInstitute for Quality and Efficiency in Health Care (IQWiG)CologneGermany
| |
Collapse
|
15
|
Weber K, Hemmings R, Koch A. How to use prior knowledge and still give new data a chance? Pharm Stat 2018; 17:329-341. [PMID: 29667367 PMCID: PMC6055870 DOI: 10.1002/pst.1862] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2016] [Revised: 11/01/2017] [Accepted: 03/13/2018] [Indexed: 01/05/2023]
Abstract
A common challenge for the development of drugs in rare diseases and special populations, eg, paediatrics, is the small numbers of patients that can be recruited into clinical trials. Extrapolation can be used to support development and licensing in paediatrics through the structured integration of available data in adults and prospectively generated data in paediatrics to derive conclusions that support licensing decisions in the target paediatric population. In this context, Bayesian analyses have been proposed to obtain formal proof of efficacy of a new drug or therapeutic principle by using additional information (data, opinion, or expectation), expressed through a prior distribution. However, little is said about the impact of the prior assumptions on the evaluation of outcome and prespecified strategies for decision‐making as required in the regulatory context. On the basis of examples, we explore the use of data‐based Bayesian meta‐analytic–predictive methods and compare these approaches with common frequentist and Bayesian meta‐analysis models. Noninformative efficacy prior distributions usually do not change the conclusions irrespective of the chosen analysis method. However, if heterogeneity is considered, conclusions are highly dependent on the heterogeneity prior. When using informative efficacy priors based on previous study data in combination with heterogeneity priors, these may completely determine conclusions irrespective of the data generated in the target population. Thus, it is important to understand the impact of the prior assumptions and ensure that prospective trial data in the target population have an appropriate chance, to change prior belief to avoid trivial and potentially erroneous conclusions.
Collapse
Affiliation(s)
- Kristina Weber
- Institute for Biostatistics, Hannover Medical School, Hanover, Germany
| | | | - Armin Koch
- Institute for Biostatistics, Hannover Medical School, Hanover, Germany
| |
Collapse
|