1
|
Kahan BC, Hindley J, Edwards M, Cro S, Morris TP. The estimands framework: a primer on the ICH E9(R1) addendum. BMJ 2024; 384:e076316. [PMID: 38262663 PMCID: PMC10802140 DOI: 10.1136/bmj-2023-076316] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/07/2023] [Indexed: 01/25/2024]
Affiliation(s)
- Brennan C Kahan
- MRC Clinical Trials Unit at UCL, University College London, London WC1V 6LJ, UK
| | - Joanna Hindley
- MRC Clinical Trials Unit at UCL, University College London, London WC1V 6LJ, UK
| | - Mark Edwards
- Department of Anaesthesia, University Hospital Southampton NHS Foundation Trust, Southampton, UK
- Southampton NIHR Biomedical Research Centre, University of Southampton, Southampton, UK
| | - Suzie Cro
- Imperial Clinical Trials Unit, School of Public Health, Imperial College London, London, UK
| | - Tim P Morris
- MRC Clinical Trials Unit at UCL, University College London, London WC1V 6LJ, UK
| |
Collapse
|
2
|
Kahan BC, White IR, Edwards M, Harhay MO. Using modified intention-to-treat as a principal stratum estimator for failure to initiate treatment. Clin Trials 2023; 20:269-275. [PMID: 36916466 PMCID: PMC10262320 DOI: 10.1177/17407745231160074] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/15/2023]
Abstract
BACKGROUND A common intercurrent event affecting many trials is when some participants do not begin their assigned treatment. For example, in a double-blind drug trial, some participants may not receive any dose of study medication. Many trials use a 'modified intention-to-treat' approach, whereby participants who do not initiate treatment are excluded from the analysis. However, it is not clear (a) the estimand being targeted by such an approach and (b) the assumptions necessary for such an approach to be unbiased. METHODS Using potential outcome notation, we demonstrate that a modified intention-to-treat analysis which excludes participants who do not begin treatment is estimating a principal stratum estimand (i.e. the treatment effect in the subpopulation of participants who would begin treatment, regardless of which arm they were assigned to). The modified intention-to-treat estimator is unbiased for the principal stratum estimand under the assumption that the intercurrent event is not affected by the assigned treatment arm, that is, participants who initiate treatment in one arm would also do so in the other arm (i.e. if someone began the intervention, they would also have begun the control, and vice versa). RESULTS We identify two key criteria in determining whether the modified intention-to-treat estimator is likely to be unbiased: first, we must be able to measure the participants in each treatment arm who experience the intercurrent event, and second, the assumption that treatment allocation will not affect whether the participant begins treatment must be reasonable. Most double-blind trials will satisfy these criteria, as the decision to start treatment cannot be influenced by the allocation, and we provide an example of an open-label trial where these criteria are likely to be satisfied as well, implying that a modified intention-to-treat analysis which excludes participants who do not begin treatment is an unbiased estimator for the principal stratum effect in these settings. We also give two examples where these criteria will not be satisfied (one comparing an active intervention vs usual care, where we cannot identify which usual care participants would have initiated the active intervention, and another comparing two active interventions in an unblinded manner, where knowledge of the assigned treatment arm may affect the participant's choice to begin or not), implying that a modified intention-to-treat estimator will be biased in these settings. CONCLUSION A modified intention-to-treat analysis which excludes participants who do not begin treatment can be an unbiased estimator for the principal stratum estimand. Our framework can help identify when the assumptions for unbiasedness are likely to hold, and thus whether modified intention-to-treat is appropriate or not.
Collapse
Affiliation(s)
| | | | - Mark Edwards
- Department of Anaesthesia, University Hospital Southampton NHS Foundation Trust, Southampton, UK
| | - Michael O Harhay
- Clinical Trials Methods and Outcomes Lab, PAIR (Palliative and Advanced Illness Research) Center, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
- Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| |
Collapse
|
3
|
Karageorgiou V, Tyrrell J, Mckinley TJ, Bowden J. Weak and pleiotropy robust sex-stratified Mendelian randomization in the one sample and two sample settings. Genet Epidemiol 2023; 47:135-151. [PMID: 36682072 DOI: 10.1002/gepi.22512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Revised: 09/06/2022] [Accepted: 11/28/2022] [Indexed: 01/23/2023]
Abstract
BACKGROUND Mendelian randomization (MR) leverages genetic data as an instrumental variable to provide estimates for the causal effect of an exposure X on a health outcome Y that is robust to confounding. Unfortunately, horizontal pleiotropy-the direct association of a genetic variant with multiple phenotypes-is highly prevalent and can easily render a genetic variant an invalid instrument. METHODS Building on existing work, we propose a simple method for leveraging sex-specific genetic associations to perform weak and pleiotropy-robust MR analysis. This is achieved by constructing an MR estimator in which pleiotropy is perfectly removed by cancellation, while placing it within the powerful machinery of the robust adjusted profile score (MR-RAPS) method. Pleiotropy cancellation has the attractive property that it removes heterogeneity and therefore justifies a statistically efficient fixed effects model. We extend the method from the typical two-sample summary-data MR setting to the one-sample setting by adapting the technique of Collider-Correction. Simulation studies and applied examples are used to assess how the sex-stratified MR-RAPS estimator performs against other common approaches. RESULTS The sex-stratified MR-RAPS method is shown to be robust to pleiotropy even in cases where all genetic variants violated the standard Instrument Strength Independent of Direct Effect assumption. In some cases where the strength of the pleiotropic effect additionally varied by sex (and so perfect cancellation was not achieved), over-dispersed MR-RAPS implementations can still consistently estimate the true causal effect. In applied analyses, we investigate the causal effect of waist-hip ratio (WHR), an important marker of central obesity, on a range of downstream traits. While the conventional approaches suggested paradoxical links between WHR and height and body mass index, the sex-stratified approach obtained a more realistic null effect. Nonzero effects were also detected for systolic and diastolic blood pressure as well as high-density and low-density lipoprotein cholesterol. DISCUSSION We provide a simple but attractive method for weak and pleiotropy robust causal estimation of sexually dimorphic traits on downstream outcomes, by combining several existing approaches in a novel fashion.
Collapse
Affiliation(s)
- Vasilios Karageorgiou
- Exeter Diabetes Group (ExCEED), College of Medicine and Health, University of Exeter, Exeter, UK
| | - Jess Tyrrell
- Exeter Diabetes Group (ExCEED), College of Medicine and Health, University of Exeter, Exeter, UK
| | - Trevelyan J Mckinley
- Exeter Diabetes Group (ExCEED), College of Medicine and Health, University of Exeter, Exeter, UK
| | - Jack Bowden
- Exeter Diabetes Group (ExCEED), College of Medicine and Health, University of Exeter, Exeter, UK
| |
Collapse
|
4
|
de Erausquin GA, Snyder H, Brugha TS, Seshadri S, Carrillo M, Sagar R, Huang Y, Newton C, Tartaglia C, Teunissen C, Håkanson K, Akinyemi R, Prasad K, D'Avossa G, Gonzalez‐Aleman G, Hosseini A, Vavougios GD, Sachdev P, Bankart J, Mors NPO, Lipton R, Katz M, Fox PT, Katshu MZ, Iyengar MS, Weinstein G, Sohrabi HR, Jenkins R, Stein DJ, Hugon J, Mavreas V, Blangero J, Cruchaga C, Krishna M, Wadoo O, Becerra R, Zwir I, Longstreth WT, Kroenenberg G, Edison P, Mukaetova‐Ladinska E, Staufenberg E, Figueredo‐Aguiar M, Yécora A, Vaca F, Zamponi HP, Re VL, Majid A, Sundarakumar J, Gonzalez HM, Geerlings MI, Skoog I, Salmoiraghi A, Boneschi FM, Patel VN, Santos JM, Arroyo GR, Moreno AC, Felix P, Gallo C, Arai H, Yamada M, Iwatsubo T, Sharma M, Chakraborty N, Ferreccio C, Akena D, Brayne C, Maestre G, Blangero SW, Brusco LI, Siddarth P, Hughes TM, Zuñiga AR, Kambeitz J, Laza AR, Allen N, Panos S, Merrill D, Ibáñez A, Tsuang D, Valishvili N, Shrestha S, Wang S, Padma V, Anstey KJ, Ravindrdanath V, Blennow K, Mullins P, Łojek E, Pria A, Mosley TH, Gowland P, Girard TD, Bowtell R, Vahidy FS. Chronic neuropsychiatric sequelae of SARS-CoV-2: Protocol and methods from the Alzheimer's Association Global Consortium. ALZHEIMER'S & DEMENTIA (NEW YORK, N. Y.) 2022; 8:e12348. [PMID: 36185993 PMCID: PMC9494609 DOI: 10.1002/trc2.12348] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/15/2021] [Revised: 04/11/2022] [Accepted: 06/14/2022] [Indexed: 12/27/2022]
Abstract
Introduction Coronavirus disease 2019 (COVID-19) has caused >3.5 million deaths worldwide and affected >160 million people. At least twice as many have been infected but remained asymptomatic or minimally symptomatic. COVID-19 includes central nervous system manifestations mediated by inflammation and cerebrovascular, anoxic, and/or viral neurotoxicity mechanisms. More than one third of patients with COVID-19 develop neurologic problems during the acute phase of the illness, including loss of sense of smell or taste, seizures, and stroke. Damage or functional changes to the brain may result in chronic sequelae. The risk of incident cognitive and neuropsychiatric complications appears independent from the severity of the original pulmonary illness. It behooves the scientific and medical community to attempt to understand the molecular and/or systemic factors linking COVID-19 to neurologic illness, both short and long term. Methods This article describes what is known so far in terms of links among COVID-19, the brain, neurological symptoms, and Alzheimer's disease (AD) and related dementias. We focus on risk factors and possible molecular, inflammatory, and viral mechanisms underlying neurological injury. We also provide a comprehensive description of the Alzheimer's Association Consortium on Chronic Neuropsychiatric Sequelae of SARS-CoV-2 infection (CNS SC2) harmonized methodology to address these questions using a worldwide network of researchers and institutions. Results Successful harmonization of designs and methods was achieved through a consensus process initially fragmented by specific interest groups (epidemiology, clinical assessments, cognitive evaluation, biomarkers, and neuroimaging). Conclusions from subcommittees were presented to the whole group and discussed extensively. Presently data collection is ongoing at 19 sites in 12 countries representing Asia, Africa, the Americas, and Europe. Discussion The Alzheimer's Association Global Consortium harmonized methodology is proposed as a model to study long-term neurocognitive sequelae of SARS-CoV-2 infection. Key Points The following review describes what is known so far in terms of molecular and epidemiological links among COVID-19, the brain, neurological symptoms, and AD and related dementias (ADRD)The primary objective of this large-scale collaboration is to clarify the pathogenesis of ADRD and to advance our understanding of the impact of a neurotropic virus on the long-term risk of cognitive decline and other CNS sequelae. No available evidence supports the notion that cognitive impairment after SARS-CoV-2 infection is a form of dementia (ADRD or otherwise). The longitudinal methodologies espoused by the consortium are intended to provide data to answer this question as clearly as possible controlling for possible confounders. Our specific hypothesis is that SARS-CoV-2 triggers ADRD-like pathology following the extended olfactory cortical network (EOCN) in older individuals with specific genetic susceptibility.The proposed harmonization strategies and flexible study designs offer the possibility to include large samples of under-represented racial and ethnic groups, creating a rich set of harmonized cohorts for future studies of the pathophysiology, determinants, long-term consequences, and trends in cognitive aging, ADRD, and vascular disease.We provide a framework for current and future studies to be carried out within the Consortium. and offers a "green paper" to the research community with a very broad, global base of support, on tools suitable for low- and middle-income countries aimed to compare and combine future longitudinal data on the topic.The Consortium proposes a combination of design and statistical methods as a means of approaching causal inference of the COVID-19 neuropsychiatric sequelae. We expect that deep phenotyping of neuropsychiatric sequelae may provide a series of candidate syndromes with phenomenological and biological characterization that can be further explored. By generating high-quality harmonized data across sites we aim to capture both descriptive and, where possible, causal associations.
Collapse
|
5
|
Fletcher C, Hefting N, Wright M, Bell J, Anzures-Cabrera J, Wright D, Lynggaard H, Schueler A. Marking 2-Years of New Thinking in Clinical Trials: The Estimand Journey. Ther Innov Regul Sci 2022; 56:637-650. [PMID: 35462609 PMCID: PMC9035309 DOI: 10.1007/s43441-022-00402-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Accepted: 04/04/2022] [Indexed: 11/30/2022]
Abstract
The ICH E9(R1) addendum on Estimands and Sensitivity Analyses in Clinical Trials has introduced a new estimand framework for the design, conduct, analysis, and interpretation of clinical trials. We share Pharmaceutical Industry experiences of implementing the estimand framework in the first two years since the final guidance became available with key lessons learned and highlight what else needs to be done to continue the journey in embedding the estimand framework in clinical trials. Emerging best practices and points to consider on strategies for implementing a new estimand thinking process are provided. Whilst much of the focus of implementing ICH E9(R1) to date has been on defining estimands, we highlight some of the important aspects relating to the choice of statistical analysis methods and sensitivity analyses to ensure estimands can be estimated robustly with minimal bias. In particular, we discuss the implications if complete follow-up is not possible when the treatment policy strategy is being used to handle intercurrent events. ICH E9(R1) was introduced just before the start of the COVID-19 pandemic, but a positive outcome from the pandemic has been an acceleration in the adoption of the estimand framework, including differentiating intercurrent events related or not related to the pandemic. In summary, much has been learned on the estimand journey and continued sharing of case studies will help to further advance the understanding and increase awareness across all clinical researchers of the estimand framework.
Collapse
Affiliation(s)
- C Fletcher
- Biostatistics, GlaxoSmithKline Plc, Stevenage, United Kingdom.
| | - N Hefting
- Clinical Development, Psychiatry, H. Lundbeck A/S, Valby, Denmark
| | - M Wright
- Analytics, Novartis Pharma AG, Basel, Switzerland
| | - J Bell
- Clinical Operations, Elderbrook Solutions GmbH, High Wycombe, United Kingdom
| | - J Anzures-Cabrera
- Data Sciences, Roche Products Ltd, Welywn Garden City, United Kingdom
| | - D Wright
- Statistical Innovation, DS&AI, BioPharma R&D, AstraZeneca, Cambridge, United Kingdom
| | - H Lynggaard
- Biostatistics, Data Science, Novo Nordisk A/S, Bagsværd, Denmark
| | - A Schueler
- Biostatistics, Epidemiology & Medical Writing, Merck Healthcare KGaA, Darmstadt, Germany
| |
Collapse
|