1
|
Leurent B, Gomes M, Cro S, Wiles N, Carpenter JR. Reference-based multiple imputation for missing data sensitivity analyses in trial-based cost-effectiveness analysis. HEALTH ECONOMICS 2020; 29:171-184. [PMID: 31845455 PMCID: PMC7004051 DOI: 10.1002/hec.3963] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/11/2019] [Revised: 08/22/2019] [Accepted: 09/17/2019] [Indexed: 05/06/2023]
Abstract
Missing data are a common issue in cost-effectiveness analysis (CEA) alongside randomised trials and are often addressed assuming the data are 'missing at random'. However, this assumption is often questionable, and sensitivity analyses are required to assess the implications of departures from missing at random. Reference-based multiple imputation provides an attractive approach for conducting such sensitivity analyses, because missing data assumptions are framed in an intuitive way by making reference to other trial arms. For example, a plausible not at random mechanism in a placebo-controlled trial would be to assume that participants in the experimental arm who dropped out stop taking their treatment and have similar outcomes to those in the placebo arm. Drawing on the increasing use of this approach in other areas, this paper aims to extend and illustrate the reference-based multiple imputation approach in CEA. It introduces the principles of reference-based imputation and proposes an extension to the CEA context. The method is illustrated in the CEA of the CoBalT trial evaluating cognitive behavioural therapy for treatment-resistant depression. Stata code is provided. We find that reference-based multiple imputation provides a relevant and accessible framework for assessing the robustness of CEA conclusions to different missing data assumptions.
Collapse
Affiliation(s)
- Baptiste Leurent
- Department of Medical StatisticsLondon School of Hygiene and Tropical MedicineLondonUK
| | - Manuel Gomes
- Department of Applied Health ResearchUniversity College LondonLondonUK
| | - Suzie Cro
- Imperial Clinical Trials Unit, School of Public HealthImperial College LondonLondonUK
| | - Nicola Wiles
- Population Health Sciences, Bristol Medical SchoolUniversity of BristolBristolUK
| | - James R. Carpenter
- Department of Medical StatisticsLondon School of Hygiene and Tropical MedicineLondonUK
- MRC Clinical Trials UnitUniversity College LondonLondonUK
| |
Collapse
|
2
|
Gillett JG, Lichtwark GA, Boyd RN, Carty CP, Barber LA. The effect of combined functional anaerobic and strength training on treadmill gait kinematics and kinetics in ambulatory young adults with cerebral palsy. Gait Posture 2019; 70:323-329. [PMID: 30947107 DOI: 10.1016/j.gaitpost.2019.03.023] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/23/2018] [Revised: 01/25/2019] [Accepted: 03/24/2019] [Indexed: 02/02/2023]
Abstract
BACKGROUND Leg muscle weakness is a major impairment for individuals with cerebral palsy (CP) and is related to reduced functional capacity. Evidence is limited regarding the translation of strength improvements following conventional resistance training to improved gait outcomes. RESEARCH QUESTION Does a combined functional anaerobic and lower limb strength training intervention improve gait kinematics and kinetics in individuals with CP aged 15-30 years? 17 young adults (21 ± 4 years, 9 males, GMFCS I = 11, II = 6) were randomized to 12 weeks, 3 sessions per week, of high intensity functional anaerobic and progressive resistance training of the lower limbs (n = 8), or a waitlist control group (n = 9). Pre- and post-training outcomes included maximum ankle dorsiflexion angle at foot contact and during stance, gait profile score, ankle and hip power generation during late stance, and the ratio of ankle to hip power generation. RESULTS There were no between-group differences after the intervention for any kinematic or kinetic gait outcome variable. Within-group analysis revealed an increase in peak ankle power during late stance (0.31 ± 0.28 W·kg-1, p = 0.043) and ankle to hip power ratio (0.43 ± 0.37, p = 0.034) following training in the intervention group. SIGNIFICANCE We have previously reported increased overground walking capacity, agility and sprint power, in the training group compared to the control group at 12-weeks. These changes in overground measures of functional capacity occurred in the absence of changes in treadmill gait kinematics and kinetics reported here. ANZCTR 12614001217695.
Collapse
Affiliation(s)
- Jarred G Gillett
- Queensland Cerebral Palsy and Rehabilitation Research Centre, UQ Child Health Research Centre, Faculty of Medicine, The University of Queensland, South Brisbane, Queensland, Australia.
| | - Glen A Lichtwark
- Centre for Sensorimotor Performance, School of Human Movement and Nutrition Sciences, The University of Queensland, St Lucia, Queensland, Australia.
| | - Roslyn N Boyd
- Queensland Cerebral Palsy and Rehabilitation Research Centre, UQ Child Health Research Centre, Faculty of Medicine, The University of Queensland, South Brisbane, Queensland, Australia.
| | - Christopher P Carty
- School of Allied Health Sciences and Menzies Health Institute Queensland, Griffith University, Southport, Queensland, Australia; Queensland Children's Motion Analysis Service, Children's Health Queensland Hospital and Health Service, South Brisbane, Queensland, Australia; Department of Orthopaedics, Children's Health Queensland Hospital and Health Service, South Brisbane, Queensland, Australia.
| | - Lee A Barber
- Queensland Cerebral Palsy and Rehabilitation Research Centre, UQ Child Health Research Centre, Faculty of Medicine, The University of Queensland, South Brisbane, Queensland, Australia; School of Health, Medical and Applied Sciences, Central Queensland University, Bundaberg, Queensland, Australia.
| |
Collapse
|
3
|
Leurent B, Gomes M, Faria R, Morris S, Grieve R, Carpenter JR. Sensitivity Analysis for Not-at-Random Missing Data in Trial-Based Cost-Effectiveness Analysis: A Tutorial. PHARMACOECONOMICS 2018; 36:889-901. [PMID: 29679317 PMCID: PMC6021473 DOI: 10.1007/s40273-018-0650-5] [Citation(s) in RCA: 62] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/02/2023]
Abstract
Cost-effectiveness analyses (CEA) of randomised controlled trials are a key source of information for health care decision makers. Missing data are, however, a common issue that can seriously undermine their validity. A major concern is that the chance of data being missing may be directly linked to the unobserved value itself [missing not at random (MNAR)]. For example, patients with poorer health may be less likely to complete quality-of-life questionnaires. However, the extent to which this occurs cannot be ascertained from the data at hand. Guidelines recommend conducting sensitivity analyses to assess the robustness of conclusions to plausible MNAR assumptions, but this is rarely done in practice, possibly because of a lack of practical guidance. This tutorial aims to address this by presenting an accessible framework and practical guidance for conducting sensitivity analysis for MNAR data in trial-based CEA. We review some of the methods for conducting sensitivity analysis, but focus on one particularly accessible approach, where the data are multiply-imputed and then modified to reflect plausible MNAR scenarios. We illustrate the implementation of this approach on a weight-loss trial, providing the software code. We then explore further issues around its use in practice.
Collapse
Affiliation(s)
- Baptiste Leurent
- Department of Medical Statistics, London School of Hygiene and Tropical Medicine, Keppel Street, London, WC1E 7HT, UK.
| | - Manuel Gomes
- Department of Applied Health Research, University College London, London, UK
| | - Rita Faria
- Centre for Health Economics, University of York, York, UK
| | - Stephen Morris
- Department of Applied Health Research, University College London, London, UK
| | - Richard Grieve
- Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London, UK
| | - James R Carpenter
- Department of Medical Statistics, London School of Hygiene and Tropical Medicine, Keppel Street, London, WC1E 7HT, UK
- MRC Clinical Trials Unit at University College London, London, UK
| |
Collapse
|
4
|
Leurent B, Gomes M, Carpenter JR. Missing data in trial-based cost-effectiveness analysis: An incomplete journey. HEALTH ECONOMICS 2018; 27:1024-1040. [PMID: 29573044 PMCID: PMC5947820 DOI: 10.1002/hec.3654] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/03/2017] [Revised: 12/07/2017] [Accepted: 02/14/2018] [Indexed: 05/04/2023]
Abstract
Cost-effectiveness analyses (CEA) conducted alongside randomised trials provide key evidence for informing healthcare decision making, but missing data pose substantive challenges. Recently, there have been a number of developments in methods and guidelines addressing missing data in trials. However, it is unclear whether these developments have permeated CEA practice. This paper critically reviews the extent of and methods used to address missing data in recently published trial-based CEA. Issues of the Health Technology Assessment journal from 2013 to 2015 were searched. Fifty-two eligible studies were identified. Missing data were very common; the median proportion of trial participants with complete cost-effectiveness data was 63% (interquartile range: 47%-81%). The most common approach for the primary analysis was to restrict analysis to those with complete data (43%), followed by multiple imputation (30%). Half of the studies conducted some sort of sensitivity analyses, but only 2 (4%) considered possible departures from the missing-at-random assumption. Further improvements are needed to address missing data in cost-effectiveness analyses conducted alongside randomised trials. These should focus on limiting the extent of missing data, choosing an appropriate method for the primary analysis that is valid under contextually plausible assumptions, and conducting sensitivity analyses to departures from the missing-at-random assumption.
Collapse
Affiliation(s)
- Baptiste Leurent
- Department of Medical StatisticsLondon School of Hygiene and Tropical MedicineLondonUK
| | - Manuel Gomes
- Department of Health Services Research and PolicyLondon School of Hygiene and Tropical MedicineLondonUK
| | - James R. Carpenter
- Department of Medical StatisticsLondon School of Hygiene and Tropical MedicineLondonUK
- MRC Clinical Trials UnitUniversity College LondonLondonUK
| |
Collapse
|
5
|
Sidi Y, Harel O. The treatment of incomplete data: Reporting, analysis, reproducibility, and replicability. Soc Sci Med 2018; 209:169-173. [PMID: 29807627 DOI: 10.1016/j.socscimed.2018.05.037] [Citation(s) in RCA: 84] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2018] [Revised: 05/11/2018] [Accepted: 05/19/2018] [Indexed: 02/08/2023]
Abstract
Proper analysis and reporting of incomplete data continues to be a challenging task for practitioners from various research areas. Recently Nguyen, Strazdins, Nicholson and Cooklin (NSNC; 2018) evaluated the impact of complete case analysis and multiple imputation in studies of parental employment and health. Their work joins interdisciplinary efforts to educate and motivate scientists across the research community to use principled statistical methods when analyzing incomplete data. Although we fully support and encourage work in parallel to NSNC's, we also think that further actions should be taken by the research community to improve current practices. In this commentary, we discuss some aspects and misconceptions related to analysis of incomplete data, in particular multiple imputation. In our view, the missing data problem is part of a larger problem of research reproducibility and replicability today. Thus, we believe that improving analysis and reporting of incomplete data will make reproducibility and replicability efforts easier. We also provide a brief checklist of recommendations which could be used by members of the scientific community, including practitioners, journal editors, and reviewers to set higher publication standards.
Collapse
Affiliation(s)
- Yulia Sidi
- Department of Statistics, University of Connecticut, 215 Glenbrook Road, Unit 4120, Storrs, CT 06269-4120, United States
| | - Ofer Harel
- Department of Statistics, University of Connecticut, 215 Glenbrook Road, Unit 4120, Storrs, CT 06269-4120, United States.
| |
Collapse
|
6
|
Ryan JM, Fortune J, Stennett A, Kilbride C, Anokye N, Victor C, Hendrie W, Abdul M, DeSouza L, Lavelle G, Brewin D, David L, Norris M. Changing physical activity behaviour for people with multiple sclerosis: protocol of a randomised controlled feasibility trial (iStep-MS). BMJ Open 2017; 7:e018875. [PMID: 29146660 PMCID: PMC5695400 DOI: 10.1136/bmjopen-2017-018875] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
INTRODUCTION Although physical activity may reduce disease burden, fatigue and disability, and improve quality of life among people with multiple sclerosis (MS), many people with MS are physically inactive and spend significant time in sedentary behaviour. Behaviour change interventions may assist people with MS to increase physical activity and reduce sedentary behaviour. However, few studies have investigated their effectiveness using objective measures of physical activity, particularly in the long term. Further, interventions that have proven effective in the short term may not be feasible in clinical practice because of the large amount of support provided. The iStep-MS trial aims to determine the safety, feasibility and acceptability of a behaviour change intervention to increase physical activity and reduce sedentary behaviour among people with MS. METHODS AND ANALYSIS Sixty people with MS will be randomised (1:1 ratio) to receive a 12-week intervention or usual care only. The intervention consists of four physical activity consultations with a physiotherapist supported by a handbook and pedometer. Outcomes assessed at baseline, 12 weeks and 9 months are physical activity (ActiGraph wGT3X-BT accelerometer), sedentary behaviour (activPAL3µ), self-reported activity and sitting time, walking capability, fatigue, self-efficacy, participation, quality of life and health service use. The safety of the intervention will be determined by assessing change in pain and fatigue and the incidence of adverse events during the follow-up period. A parallel process evaluation will assess the feasibility and acceptability of the intervention through assessment of fidelity to the programme and semistructured interviews exploring participants' and therapists' experiences of the intervention. The feasibility of conducting an economic evaluation will be determined by collecting data on quality of life and resource use. ETHICS AND DISSEMINATION Research ethics committee approval has been granted from Brunel University London. Results of the trial will be submitted for publication in journals and distributed to people with MS and physiotherapists. TRIAL REGISTRATION NUMBER ISRCTN15343862 (doi 10.1186/ISRCTN15343862). Protocol version: 1.0; Pre-results.
Collapse
Affiliation(s)
- Jennifer M Ryan
- Ageing Studies Theme, Institute of Environment, Health and Societies, Brunel University London, Uxbridge, UK
| | - Jennifer Fortune
- Ageing Studies Theme, Institute of Environment, Health and Societies, Brunel University London, Uxbridge, UK
| | - Andrea Stennett
- Ageing Studies Theme, Institute of Environment, Health and Societies, Brunel University London, Uxbridge, UK
| | - Cherry Kilbride
- Ageing Studies Theme, Institute of Environment, Health and Societies, Brunel University London, Uxbridge, UK
| | - Nana Anokye
- Health Economics Theme, Institute of Environment, Health and Societies, Brunel University London, London, UK
| | - Christina Victor
- Ageing Studies Theme, Institute of Environment, Health and Societies, Brunel University London, Uxbridge, UK
| | | | | | - Lorraine DeSouza
- Ageing Studies Theme, Institute of Environment, Health and Societies, Brunel University London, Uxbridge, UK
| | - Grace Lavelle
- Ageing Studies Theme, Institute of Environment, Health and Societies, Brunel University London, Uxbridge, UK
| | | | - Lee David
- 10 Minute CBT, Letchworth Garden City, UK
| | - Meriel Norris
- Ageing Studies Theme, Institute of Environment, Health and Societies, Brunel University London, Uxbridge, UK
| |
Collapse
|
7
|
Repeated-measure analyses: Which one? A survey of statistical models and recommendations for reporting. Neurotoxicol Teratol 2017; 59:78-84. [DOI: 10.1016/j.ntt.2016.10.003] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2016] [Revised: 09/27/2016] [Accepted: 10/12/2016] [Indexed: 11/17/2022]
|
8
|
Kelechi TJ, Madisetti M, Mueller M, Dooley M, Prentice M. Self-monitoring of lower leg skin temperature: accuracy of self-reported data and adherence to a cooling protocol for the prevention of venous leg ulcers. Patient Prefer Adherence 2015; 9:1751-61. [PMID: 26719678 PMCID: PMC4689265 DOI: 10.2147/ppa.s91992] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND For intervention studies that require the use of participant self-reports, the quality and accuracy of recorded data and variability in participant adherence rates to the treatment can cause significant outcome bias. PURPOSE To assess the quality and accuracy of participant documentation of daily self-monitoring of leg skin temperature, adherence to a graduated cooling treatment protocol to prevent venous leg ulcers, and the potential for bias in treatment effect in a randomized controlled trial that included a population with chronic venous disease. METHODS Individuals were randomized to a leg cooling intervention or placebo treatment group to daily self-monitor and record lower leg skin temperature over a 9-month period on monthly paper study logs. Returned study logs for the first 100 completed participants (n=54 cooling intervention, n=46 control) were reviewed for quality and accuracy. Adherence was determined from evaluating the accuracy of participant documentation. To examine potential outcome bias in treatment effect, mean between group and within group comparisons of the before and after treatment differences were conducted using an intention-to-treat (ITT) versus a modified intention-to-treat (mITT) analysis approach with an 85% accuracy cut-off rate. Data were collected in 2011-2014. RESULTS Of the expected 900 study logs, 91.8% (826/900) were returned and 8.2% (74/900) were not. Non-mutually exclusive main error types in returned documentation included: 59.2% (489/826) white-outs, cross-off and/or overwrites, 34.9% (288/826) entries omitted, 29.4% (243/826) no performance of daily self-monitoring, 28.7% (237/826) no performance of the treatment intervention per the prescribed protocol regime, 26.8% (221/826) extraneous data, 8.6% (71/826) suspected fabrication, and 7.6% (63/826) questionable validity. Under ITT analysis, 38.4% (346/900) of all returned logs were <85% accurate, 25.0% (225/900) were 85%-99% accurate, and 36.6% (329/900) were 100% accurate. Mean overall participant adherence rates were: 22.0% at <85% accuracy, 53.0% at 85%-99% accuracy, and 25.0% at 100% accuracy. Under the mITT analysis, 54.0% (483/900) of returned logs were deemed adherent with ≥85% accuracy. CONCLUSION This study found good rates of adherence. Under ITT analysis, 78.0% of participants were deemed adherent to the study protocol with ≥85% accuracy in documenting daily self-monitoring of skin temperatures in response to a topically applied experimental cooling cuff intervention for the prevention of venous leg ulcers.
Collapse
Affiliation(s)
- Teresa J Kelechi
- College of Nursing, Medical University of South Carolina, Charleston, SC, USA
- Correspondence: Teresa J Kelechi, College of Nursing, Medical University of South Carolina, 99 Jonathan Lucas Street, MSC 160, Charleston, SC 29425-1600, USA, Tel +1 843 792 4602, Fax +1 843 792 2104, Email
| | - Mohan Madisetti
- College of Nursing, Medical University of South Carolina, Charleston, SC, USA
| | - Martina Mueller
- College of Nursing, Medical University of South Carolina, Charleston, SC, USA
| | - Mary Dooley
- College of Nursing, Medical University of South Carolina, Charleston, SC, USA
| | - Margaret Prentice
- College of Nursing, Medical University of South Carolina, Charleston, SC, USA
| |
Collapse
|
9
|
Carpenter JR, Roger JH, Kenward MG. Analysis of longitudinal trials with protocol deviation: a framework for relevant, accessible assumptions, and inference via multiple imputation. J Biopharm Stat 2014; 23:1352-71. [PMID: 24138436 DOI: 10.1080/10543406.2013.834911] [Citation(s) in RCA: 157] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
Protocol deviations, for example, due to early withdrawal and noncompliance, are unavoidable in clinical trials. Such deviations often result in missing data. Additional assumptions are then needed for the analysis, and these cannot be definitively verified from the data at hand. Thus, as recognized by recent regulatory guidelines and reports, clarity about these assumptions and their implications is vital for both the primary analysis and framing relevant sensitivity analysis. This article focuses on clinical trials with longitudinal quantitative outcome data. For the target population, we define two estimands, the de jure estimand, "does the treatment work under the best case scenario," and the de facto estimand, "what would be the effect seen in practice." We then carefully define the concept of a deviation from the protocol relevant to the estimand, or for short a deviation. Each patient's postrandomization data can then be divided into predeviation data and postdeviation data. We set out an accessible framework for contextually appropriate assumptions relevant to de facto and de jure estimands, that is, assumptions about the joint distribution of pre- and postdeviation data relevant to the clinical question at hand. We then show how, under these assumptions, multiple imputation provides a practical approach to estimation and inference. We illustrate with data from a longitudinal clinical trial in patients with chronic asthma.
Collapse
Affiliation(s)
- James R Carpenter
- a Medical Statistics Department , London School of Hygiene & Tropical Medicine , London , UK
| | | | | |
Collapse
|
10
|
Liublinska V, Rubin DB. Sensitivity analysis for a partially missing binary outcome in a two-arm randomized clinical trial. Stat Med 2014; 33:4170-85. [PMID: 24845086 DOI: 10.1002/sim.6197] [Citation(s) in RCA: 37] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2013] [Revised: 02/09/2014] [Accepted: 04/13/2014] [Indexed: 11/06/2022]
Abstract
Although recent guidelines for dealing with missing data emphasize the need for sensitivity analyses, and such analyses have a long history in statistics, universal recommendations for conducting and displaying these analyses are scarce. We propose graphical displays that help formalize and visualize the results of sensitivity analyses, building upon the idea of 'tipping-point' analysis for randomized experiments with a binary outcome and a dichotomous treatment. The resulting 'enhanced tipping-point displays' are convenient summaries of conclusions obtained from making different modeling assumptions about missingness mechanisms. The primary goal of the displays is to make formal sensitivity analysesmore comprehensible to practitioners, thereby helping them assess the robustness of the experiment's conclusions to plausible missingness mechanisms. We also present a recent example of these enhanced displays in amedical device clinical trial that helped lead to FDA approval.
Collapse
|
11
|
Moreno-Betancur M, Chavance M. Sensitivity analysis of incomplete longitudinal data departing from the missing at random assumption: Methodology and application in a clinical trial with drop-outs. Stat Methods Med Res 2013; 25:1471-89. [PMID: 23698867 DOI: 10.1177/0962280213490014] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Statistical analyses of longitudinal data with drop-outs based on direct likelihood, and using all the available data, provide unbiased and fully efficient estimates under some assumptions about the drop-out mechanism. Unfortunately, these assumptions can never be tested from the data. Thus, sensitivity analyses should be routinely performed to assess the robustness of inferences to departures from these assumptions. However, each specific scientific context requires different considerations when setting up such an analysis, no standard method exists and this is still an active area of research. We propose a flexible procedure to perform sensitivity analyses when dealing with continuous outcomes, which are described by a linear mixed model in an initial likelihood analysis. The methodology relies on the pattern-mixture model factorisation of the full data likelihood and was validated in a simulation study. The approach was prompted by a randomised clinical trial for sleep-maintenance insomnia treatment. This case study illustrated the practical value of our approach and underlined the need for sensitivity analyses when analysing data with drop-outs: some of the conclusions from the initial analysis were shown to be reliable, while others were found to be fragile and strongly dependent on modelling assumptions. R code for implementation is provided.
Collapse
Affiliation(s)
- M Moreno-Betancur
- Inserm, Centre for Research in Epidemiology and Population Health, U1018, Biostatistics Team, F-94807, Villejuif, France Univ Paris-Sud, UMRS 1018, F-94807, Villejuif, France
| | - M Chavance
- Inserm, Centre for Research in Epidemiology and Population Health, U1018, Biostatistics Team, F-94807, Villejuif, France Univ Paris-Sud, UMRS 1018, F-94807, Villejuif, France
| |
Collapse
|
12
|
Baldwin DS, Nutt DJ. On assessing potential efficacy for vortioxetine in generalized anxiety disorder. Eur Neuropsychopharmacol 2012; 22:841-3. [PMID: 22906521 DOI: 10.1016/j.euroneuro.2012.07.018] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/21/2012] [Accepted: 07/24/2012] [Indexed: 10/28/2022]
|
13
|
White IR, Carpenter J, Horton NJ. Including all individuals is not enough: lessons for intention-to-treat analysis. Clin Trials 2012; 9:396-407. [PMID: 22752633 PMCID: PMC3428470 DOI: 10.1177/1740774512450098] [Citation(s) in RCA: 208] [Impact Index Per Article: 17.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND Intention-to-treat (ITT) analysis requires all randomised individuals to be included in the analysis in the groups to which they were randomised. However, there is confusion about how ITT analysis should be performed in the presence of missing outcome data. PURPOSES To explain, justify, and illustrate an ITT analysis strategy for randomised trials with incomplete outcome data. METHODS We consider several methods of analysis and compare their underlying assumptions, plausibility, and numbers of individuals included. We illustrate the ITT analysis strategy using data from the UK700 trial in the management of severe mental illness. RESULTS Depending on the assumptions made about the missing data, some methods of analysis that include all randomised individuals may be less valid than methods that do not include all randomised individuals. Furthermore, some methods of analysis that include all randomised individuals are essentially equivalent to methods that do not include all randomised individuals. LIMITATIONS This work assumes that the aim of analysis is to obtain an accurate estimate of the difference in outcome between randomised groups and not to obtain a conservative estimate with bias against the experimental intervention. CONCLUSIONS Clinical trials should employ an ITT analysis strategy, comprising a design that attempts to follow up all randomised individuals, a main analysis that is valid under a stated plausible assumption about the missing data, and sensitivity analyses that include all randomised individuals in order to explore the impact of departures from the assumption underlying the main analysis. Following this strategy recognises the extra uncertainty arising from missing outcomes and increases the incentive for researchers to minimise the extent of missing data.
Collapse
|