1
|
Robertson SE, Steingrimsson JA, Dahabreh IJ. Cluster Randomized Trials Designed to Support Generalizable Inferences. EVALUATION REVIEW 2024:193841X231169557. [PMID: 38234059 DOI: 10.1177/0193841x231169557] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/19/2024]
Abstract
When planning a cluster randomized trial, evaluators often have access to an enumerated cohort representing the target population of clusters. Practicalities of conducting the trial, such as the need to oversample clusters with certain characteristics in order to improve trial economy or support inferences about subgroups of clusters, may preclude simple random sampling from the cohort into the trial, and thus interfere with the goal of producing generalizable inferences about the target population. We describe a nested trial design where the randomized clusters are embedded within a cohort of trial-eligible clusters from the target population and where clusters are selected for inclusion in the trial with known sampling probabilities that may depend on cluster characteristics (e.g., allowing clusters to be chosen to facilitate trial conduct or to examine hypotheses related to their characteristics). We develop and evaluate methods for analyzing data from this design to generalize causal inferences to the target population underlying the cohort. We present identification and estimation results for the expectation of the average potential outcome and for the average treatment effect, in the entire target population of clusters and in its non-randomized subset. In simulation studies, we show that all the estimators have low bias but markedly different precision. Cluster randomized trials where clusters are selected for inclusion with known sampling probabilities that depend on cluster characteristics, combined with efficient estimation methods, can precisely quantify treatment effects in the target population, while addressing objectives of trial conduct that require oversampling clusters on the basis of their characteristics.
Collapse
Affiliation(s)
- Sarah E Robertson
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Jon A Steingrimsson
- Department of Biostatistics, Brown University School of Public Health, Providence, RI, USA
| | - Issa J Dahabreh
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| |
Collapse
|
2
|
Joyce NR, Robertson SE, McCreedy E, Ogarek J, Davidson EH, Mor V, Gravenstein S, Dahabreh IJ. Assessing the representativeness of cluster randomized trials: Evidence from two large pragmatic trials in United States nursing homes. Clin Trials 2023; 20:613-623. [PMID: 37493171 PMCID: PMC10811279 DOI: 10.1177/17407745231185055] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/27/2023]
Abstract
BACKGROUND/AIMS When the randomized clusters in a cluster randomized trial are selected based on characteristics that influence treatment effectiveness, results from the trial may not be directly applicable to the target population. We used data from two large nursing home-based pragmatic cluster randomized trials to compare nursing home and resident characteristics in randomized facilities to eligible non-randomized and ineligible facilities. METHODS We linked data from the high-dose influenza vaccine trial and the Music & Memory Pragmatic TRIal for Nursing Home Residents with ALzheimer's Disease (METRICaL) to nursing home assessments and Medicare fee-for-service claims. The target population for the high-dose trial comprised Medicare-certified nursing homes; the target population for the METRICaL trial comprised nursing homes in one of four US-based nursing home chains. We used standardized mean differences to compare facility and individual characteristics across the three groups and logistic regression to model the probability of nursing home trial participation. RESULTS In the high-dose trial, 4476 (29%) of the 15,502 nursing homes in the target population were eligible for the trial, of which 818 (18%) were randomized. Of the 1,361,122 residents, 91,179 (6.7%) were residents of randomized facilities, 463,703 (34.0%) of eligible non-randomized facilities, and 806,205 (59.3%) of ineligible facilities. In the METRICaL trial, 160 (59%) of the 270 nursing homes in the target population were eligible for the trial, of which 80 (50%) were randomized. Of the 20,262 residents, 973 (34.4%) were residents of randomized facilities, 7431 (36.7%) of eligible non-randomized facilities, and 5858 (28.9%) of ineligible facilities. In the high-dose trial, randomized facilities differed from eligible non-randomized and ineligible facilities by the number of beds (132.5 vs 145.9 and 91.9, respectively), for-profit status (91.8% vs 66.8% and 68.8%), belonging to a nursing home chain (85.8% vs 49.9% and 54.7%), and presence of a special care unit (19.8% vs 25.9% and 14.4%). In the METRICaL trial randomized facilities differed from eligible non-randomized and ineligible facilities by the number of beds (103.7 vs 110.5 and 67.0), resource-poor status (4.6% vs 10.0% and 18.8%), and presence of a special care unit (26.3% vs 33.8% and 10.9%). In both trials, the characteristics of residents in randomized facilities were similar across the three groups. CONCLUSION In both trials, facility-level characteristics of randomized nursing homes differed considerably from those of eligible non-randomized and ineligible facilities, while there was little difference in resident-level characteristics across the three groups. Investigators should assess the characteristics of clusters that participate in cluster randomized trials, not just the individuals within the clusters, when examining the applicability of trial results beyond participating clusters.
Collapse
Affiliation(s)
- Nina R Joyce
- Department of Epidemiology, Brown University School of Public Health, Providence, RI, USA
- Center for Gerontology and Health Care Research, Brown University School of Public Health, Providence, RI, USA
| | - Sarah E Robertson
- Department of Health Services Policy and Practice, Brown University School of Public Health, Providence, RI, USA
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Ellen McCreedy
- Center for Gerontology and Health Care Research, Brown University School of Public Health, Providence, RI, USA
- Department of Health Services Policy and Practice, Brown University School of Public Health, Providence, RI, USA
| | - Jessica Ogarek
- Center for Gerontology and Health Care Research, Brown University School of Public Health, Providence, RI, USA
- Department of Health Services Policy and Practice, Brown University School of Public Health, Providence, RI, USA
| | | | - Vincent Mor
- Center for Gerontology and Health Care Research, Brown University School of Public Health, Providence, RI, USA
- Department of Health Services Policy and Practice, Brown University School of Public Health, Providence, RI, USA
| | - Stefan Gravenstein
- Center for Gerontology and Health Care Research, Brown University School of Public Health, Providence, RI, USA
- Department of Health Services Policy and Practice, Brown University School of Public Health, Providence, RI, USA
- Warren Alpert Medical School of Brown University, Providence, RI, USA
| | - Issa J Dahabreh
- CAUSALab, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
- Department of Biostatistics, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| |
Collapse
|
3
|
Liu J, Liu L, James AS, Colditz GA. An overview of optimal designs under a given budget in cluster randomized trials with a binary outcome. Stat Methods Med Res 2023; 32:1420-1441. [PMID: 37284817 PMCID: PMC11020688 DOI: 10.1177/09622802231172026] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Cluster randomized trial design may raise financial concerns because the cost to recruit an additional cluster is much higher than to enroll an additional subject in subject-level randomized trials. Therefore, it is desirable to develop an optimal design. For local optimal designs, optimization means the minimum variance of the estimated treatment effect under the total budget. The local optimal design derived from the variance needs the input of an association parameter ρ in terms of a "working" correlation structure R ( ρ ) in the generalized estimating equation models. When the range of ρ instead of an exact value is available, the parameter space is defined as the range of ρ and the design space is defined as enrollment feasibility, for example, the number of clusters or cluster size. For any value ρ within the range, the optimal design and relative efficiency for each design in the design space is obtained. Then, for each design in the design space, the minimum relative efficiency within the parameter space is calculated. MaxiMin design is the optimal design that maximizes the minimum relative efficiency among all designs in the design space. Our contributions are threefold. First, for three common measures (risk difference, risk ratio, and odds ratio), we summarize all available local optimal designs and MaxiMin designs utilizing generalized estimating equation models when the group allocation proportion is predetermined for two-level and three-level parallel cluster randomized trials. We then propose the local optimal designs and MaxiMin designs using the same models when the group allocation proportion is undecided. Second, for partially nested designs, we develop the optimal designs for three common measures under the setting of equal number of subjects per cluster and exchangeable working correlation structure in the intervention group. Third, we create three new Statistical Analysis System (SAS) macros and update two existing SAS macros for all the optimal designs. We provide two examples to illustrate our methods.
Collapse
Affiliation(s)
- Jingxia Liu
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine (WUSM), St Louis, Missouri, USA
- Division of Biostatistics, Washington University School of Medicine (WUSM), St Louis, Missouri, USA
| | - Lei Liu
- Division of Biostatistics, Washington University School of Medicine (WUSM), St Louis, Missouri, USA
| | - Aimee S James
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine (WUSM), St Louis, Missouri, USA
| | - Graham A Colditz
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine (WUSM), St Louis, Missouri, USA
| |
Collapse
|
4
|
Nix HP, Largent EA, Taljaard M, Mitchell SL, Weijer C. Ethical analysis of vulnerabilities in cluster randomized trials involving people living with dementia in long-term care homes. J Am Geriatr Soc 2023; 71:588-598. [PMID: 36435175 PMCID: PMC9957897 DOI: 10.1111/jgs.18128] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Revised: 10/27/2022] [Accepted: 10/29/2022] [Indexed: 11/28/2022]
Abstract
Cluster randomized trials (CRT) of non-pharmacological interventions are an important means of improving the quality of care and quality of life of people living with dementia (PLWD) in long-term care (LTC) homes. PLWD in LTC homes are, however, vulnerable in manifold ways. Therefore, researchers require guidance to ensure that the rights and welfare of PLWD are protected in the course of this valuable research. In this article, we introduce a framework for identifying vulnerabilities in randomized trials and apply it to three CRTs involving PLWD in LTC homes. CRTs may render PLWD in LTC homes vulnerable to three autonomy wrongs: inadequately informed consent, inadequately voluntary consent, and invasions of privacy; two welfare wrongs: risks of therapeutic procedure exceed potential benefits, and excessive risk of non-therapeutic procedures; and one justice wrong: unjust impact of research activities on care. We then discuss appropriate, feasible additional protections that can be implemented to mitigate vulnerability while preserving the scientific validity of the CRT. Corresponding additional protections that can be feasibly implemented include capacity assessments, substitute decision-makers, assent, insulation from LTC home employees during the consent process, patient advocates, utilizing LTC home employees for data collection, stakeholder engagement, additional supervision during study procedures, using caregivers to complete questionnaires by proxy, and gatekeeper permission. Reassuringly, many of these additional protections promote, rather than imperil, the scientific validity of these trials.
Collapse
Affiliation(s)
- Hayden P Nix
- Schulich School of Medicine & Dentistry, Western University, London, Canada
- Oxford Uehiro Center for Practical Ethics, Oxford University, Oxford, UK
| | - Emily A Largent
- Department of Medical Ethics and Health Policy, University of Pennsylvania Perelman School of Medicine, Philadelphia, Pennsylvania, USA
| | - Monica Taljaard
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Canada
| | - Susan L Mitchell
- Hebrew SeniorLife Hinda and Arthur Marcus Institute for Aging Research, Boston, Massachusetts, USA
- Department of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts, USA
| | - Charles Weijer
- Department of Medicine, Western University, London, Canada
- Department of Epidemiology and Biostatistics, Western University, London, Canada
- Department of Philosophy, Western University, London, Canada
| |
Collapse
|
5
|
Resnick B, Zimmerman S, Gaugler J, Ouslander J, Abrahamson K, Brandt N, Colón-Emeric C, Galik E, Gravenstein S, Mody L, Sloane PD, Unroe K, Verbeek H. Pragmatic Trials in Long-Term Care: Research Challenges and Potential Solutions in Relation to Key Areas of Care. J Am Med Dir Assoc 2022; 23:330-338. [PMID: 35219505 PMCID: PMC9446464 DOI: 10.1016/j.jamda.2021.12.011] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2021] [Revised: 12/01/2021] [Accepted: 12/05/2021] [Indexed: 01/12/2023]
Abstract
As a method of research, pragmatic trials are recommended so as to generate results that are applicable to real-world care. This intent is especially important for the millions of older adults who receive long-term care in thousands of nursing homes and assisted living communities across the country-and many millions more around the globe. This article presents key points raised by experts participating in a conference funded by the National Institute of Aging held at the 2021 conference of the Society for Post-Acute and Long-term Care Medicine. The purpose of the conference was to convene leading clinicians, researchers, and industry partners to address special considerations of pragmatic trials in long-term care. Cross-cutting and unique challenges and solutions to conducting pragmatic trials were discussed focusing on 3 areas of clinical relevance to long-term care: (1) functional care and outcomes, (2) psychosocial care and quality of life, and (3) medical care and outcomes, with a special focus on persons with dementia. Challenges and innovative solutions were organized across the 9 domains of the revised Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) Tool, and future research recommendations for pragmatic trials in long-term care were identified.
Collapse
Affiliation(s)
- Barbara Resnick
- University of Maryland School of Nursing, Baltimore, MD, USA.
| | - Sheryl Zimmerman
- Cecil G. Sheps Center for Health Services Research and Schools of Social Work and Pubic Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Joseph Gaugler
- Division of Health Policy & Management, School of Public Health, University of Minnesota, Minneapolis, MN, USA
| | - Joseph Ouslander
- Department of Integrated Medical Sciences, Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, FL, USA
| | | | - Nicole Brandt
- University of Maryland School of Pharmacy, Baltimore, MD, USA
| | | | - Elizabeth Galik
- University of Maryland School of Nursing, Baltimore, MD, USA
| | - Stefan Gravenstein
- Brown University and Providence Veterans Administration Medical Center, Providence, RI, USA
| | - Lona Mody
- University of Michigan and Veterans Affair, Ann Arbor Healthcare System, Ann Arbor, MI, USA
| | - Philip D. Sloane
- Cecil G. Sheps Center for Health Services Research and Schools of Social Work and Pubic Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Kathleen Unroe
- Indiana University School of Medicine and Regenstrief Institute, Inc, Center for Aging Research, Indianapolis, IN, USA
| | - Hilde Verbeek
- Maastricht University and Living Lab in Ageing and Long-Term Care, Maastricht, the Netherlands
| |
Collapse
|
6
|
Resnick B, Zimmerman S, Gaugler J, Ouslander J, Abrahamson K, Brandt N, Colón-Emeric C, Galik E, Gravenstein S, Mody L, Sloane PD, Unroe K, Verbeek H. Pragmatic Trials in Long-Term Care: Research Challenges and Potential Solutions in Relation to Key Areas of Care. J Am Geriatr Soc 2022; 70:718-730. [PMID: 35195283 PMCID: PMC8904288 DOI: 10.1111/jgs.17699] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Accepted: 02/01/2022] [Indexed: 12/01/2022]
Abstract
As a method of research, pragmatic trials are recommended so as to generate results that are applicable to real-world care. This intent is especially important for the millions of older adults who receive long-term care in thousands of nursing homes and assisted living communities across the country-and many millions more around the globe. This article presents key points raised by experts participating in a conference funded by the National Institute of Aging held at the 2021 conference of the Society for Post-Acute and Long-term Care Medicine. The purpose of the conference was to convene leading clinicians, researchers, and industry partners to address special considerations of pragmatic trials in long-term care. Cross-cutting and unique challenges and solutions to conducting pragmatic trials were discussed focusing on 3 areas of clinical relevance to long-term care: (1) functional care and outcomes, (2) psychosocial care and quality of life, and (3) medical care and outcomes, with a special focus on persons with dementia. Challenges and innovative solutions were organized across the 9 domains of the revised Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) Tool, and future research recommendations for pragmatic trials in long-term care were identified.
Collapse
Affiliation(s)
- Barbara Resnick
- University of Maryland School of Nursing, Baltimore, MD, USA,Address correspondence to Barbara Resnick, PhD, CRNP, University of Maryland School of Nursing, 655 W Lombard St, Baltimore, MD 21201, USA. (B. Resnick)
| | - Sheryl Zimmerman
- Cecil G. Sheps Center for Health Services Research and Schools of Social Work and Pubic Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Joseph Gaugler
- Division of Health Policy & Management, School of Public Health, University of Minnesota, Minneapolis, MN, USA
| | - Joseph Ouslander
- Department of Integrated Medical Sciences, Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, FL, USA
| | | | - Nicole Brandt
- University of Maryland School of Pharmacy, Baltimore, MD, USA
| | | | - Elizabeth Galik
- University of Maryland School of Nursing, Baltimore, MD, USA
| | - Stefan Gravenstein
- Brown University and Providence Veterans Administration Medical Center, Providence, RI, USA
| | - Lona Mody
- University of Michigan and Veterans Affair, Ann Arbor Healthcare System, Ann Arbor, MI, USA
| | - Philip D. Sloane
- Cecil G. Sheps Center for Health Services Research and Schools of Social Work and Pubic Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Kathleen Unroe
- Indiana University School of Medicine and Regenstrief Institute, Inc, Center for Aging Research, Indianapolis, IN, USA
| | - Hilde Verbeek
- Maastricht University and Living Lab in Ageing and Long-Term Care, Maastricht, the Netherlands
| |
Collapse
|
7
|
Resnick B, Zimmerman S, Gaugler J, Ouslander J, Abrahamson K, Brandt N, Colón-Emeric C, Galik E, Gravenstein S, Mody L, Sloane PD, Unroe K, Verbeek H. Pragmatic trials in long-term care: Research challenges and potential solutions in relation to key areas of care. Geriatr Nurs 2022; 44:293-301. [PMID: 35219534 PMCID: PMC9446463 DOI: 10.1016/j.gerinurse.2022.02.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
As a method of research, pragmatic trials are recommended so as to generate results that are applicable to real-world care. This intent is especially important for the millions of older adults who receive long-term care in thousands of nursing homes and assisted living communities across the country-and many millions more around the globe. This article presents key points raised by experts participating in a conference funded by the National Institute of Aging held at the 2021 conference of the Society for Post-Acute and Long-term Care Medicine. The purpose of the conference was to convene leading clinicians, researchers, and industry partners to address special considerations of pragmatic trials in long-term care. Cross-cutting and unique challenges and solutions to conducting pragmatic trials were discussed focusing on 3 areas of clinical relevance to long-term care: (1) functional care and outcomes, (2) psychosocial care and quality of life, and (3) medical care and outcomes, with a special focus on persons with dementia. Challenges and innovative solutions were organized across the 9 domains of the revised Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) Tool, and future research recommendations for pragmatic trials in long-term care were identified.
Collapse
Affiliation(s)
- Barbara Resnick
- University of Maryland School of Nursing, Baltimore, MD, USA.
| | - Sheryl Zimmerman
- Cecil G. Sheps Center for Health Services Research and Schools of Social Work and Pubic Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Joseph Gaugler
- Division of Health Policy & Management, School of Public Health, University of Minnesota, Minneapolis, MN, USA
| | - Joseph Ouslander
- Department of Integrated Medical Sciences, Charles E. Schmidt College of Medicine, Florida Atlantic University, Boca Raton, FL, USA
| | | | - Nicole Brandt
- University of Maryland School of Pharmacy, Baltimore, MD, USA
| | | | - Elizabeth Galik
- University of Maryland School of Nursing, Baltimore, MD, USA
| | - Stefan Gravenstein
- Brown University and Providence Veterans Administration Medical Center, Providence, RI, USA
| | - Lona Mody
- University of Michigan and Veterans Affair, Ann Arbor Healthcare System, Ann Arbor, MI, USA
| | - Philip D Sloane
- Cecil G. Sheps Center for Health Services Research and Schools of Social Work and Pubic Health, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Kathleen Unroe
- Indiana University School of Medicine and Regenstrief Institute, Inc, Center for Aging Research, Indianapolis, IN, USA
| | - Hilde Verbeek
- Maastricht University and Living Lab in Ageing and Long-Term Care, Maastricht, the Netherlands
| |
Collapse
|
8
|
Liu J, Colditz GA. Sample size calculation in three-level cluster randomized trials using generalized estimating equation models. Stat Med 2020; 39:3347-3372. [PMID: 32720717 PMCID: PMC8351402 DOI: 10.1002/sim.8670] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2018] [Revised: 05/28/2020] [Accepted: 05/29/2020] [Indexed: 11/22/2022]
Abstract
Three-level cluster randomized trials (CRTs) are increasingly used in implementation science, where 2fold-nested-correlated data arise. For example, interventions are randomly assigned to practices, and providers within the same practice who provide care to participants are trained with the assigned intervention. Teerenstra et al proposed a nested exchangeable correlation structure that accounts for two levels of clustering within the generalized estimating equations (GEE) approach. In this article, we utilize GEE models to test the treatment effect in a two-group comparison for continuous, binary, or count data in three-level CRTs. Given the nested exchangeable correlation structure, we derive the asymptotic variances of the estimator of the treatment effect for different types of outcomes. When the number of clusters is small, researchers have proposed bias-corrected sandwich estimators to improve performance in two-level CRTs. We extend the variances of two bias-corrected sandwich estimators to three-level CRTs. The equal provider and practice sizes were assumed to calculate number of practices for simplicity. However, they are not guaranteed in practice. Relative efficiency (RE) is defined as the ratio of variance of the estimator of the treatment effect for equal to unequal provider and practice sizes. The expressions of REs are obtained from both asymptotic variance estimation and bias-corrected sandwich estimators. Their performances are evaluated for different scenarios of provider and practice size distributions through simulation studies. Finally, a percentage increase in the number of practices is proposed due to efficiency loss from unequal provider and/or practice sizes.
Collapse
Affiliation(s)
- Jingxia Liu
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine (WUSM), St. Louis, Missouri, USA.,Division of Biostatistics, Washington University School of Medicine (WUSM), St. Louis, Missouri, USA
| | - Graham A Colditz
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine (WUSM), St. Louis, Missouri, USA
| |
Collapse
|
9
|
Liu J, Liu L, Colditz GA. Optimal designs in three-level cluster randomized trials with a binary outcome. Stat Med 2019; 38:3733-3746. [PMID: 31162709 DOI: 10.1002/sim.8153] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2018] [Revised: 03/06/2019] [Accepted: 03/09/2019] [Indexed: 12/26/2022]
Abstract
Cluster randomized trials (CRTs) were originally proposed for use when randomization at the subject level is practically infeasible or may lead to a severe estimation bias of the treatment effect. However, recruiting an additional cluster costs more than enrolling an additional subject in an individually randomized trial. Under budget constraints, researchers have proposed the optimal sample sizes in two-level CRTs. CRTs may have a three-level structure, in which two levels of clustering should be considered. In this paper, we propose optimal designs in three-level CRTs with a binary outcome, assuming a nested exchangeable correlation structure in generalized estimating equation models. We provide the variance of estimators of three commonly used measures: risk difference, risk ratio, and odds ratio. For a given sampling budget, we discuss how many clusters and how many subjects per cluster are necessary to minimize the variance of each measure estimator. For known association parameters, the locally optimal design is proposed. When association parameters are unknown but within predetermined ranges, the MaxiMin design is proposed to maximize the minimum of relative efficiency over the possible ranges, that is, to minimize the risk of the worst scenario.
Collapse
Affiliation(s)
- Jingxia Liu
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine, St. Louis, Missouri.,Division of Biostatistics, Washington University School of Medicine, St. Louis, Missouri
| | - Lei Liu
- Division of Biostatistics, Washington University School of Medicine, St. Louis, Missouri
| | - Graham A Colditz
- Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine, St. Louis, Missouri
| |
Collapse
|
10
|
Shireman TI, Ogarek J, Gozalo P, Zhang T, Mor V, Davidson HE, Han L, Taljaard M, Gravenstein S. Cost Benefit of High-Dose vs Standard-Dose Influenza Vaccine in a Long-Term Care Population During an A/H1N1-Predominant Influenza Season. J Am Med Dir Assoc 2019; 20:874-878. [DOI: 10.1016/j.jamda.2018.12.003] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2018] [Revised: 12/07/2018] [Accepted: 12/09/2018] [Indexed: 10/27/2022]
|
11
|
Crowcroft NS, Klein NP. A framework for research on vaccine effectiveness. Vaccine 2018; 36:7286-7293. [DOI: 10.1016/j.vaccine.2018.04.016] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2017] [Revised: 03/07/2018] [Accepted: 04/04/2018] [Indexed: 01/20/2023]
|
12
|
Liu J, Colditz GA. Relative efficiency of unequal versus equal cluster sizes in cluster randomized trials using generalized estimating equation models. Biom J 2018; 60:616-638. [PMID: 29577363 PMCID: PMC6760674 DOI: 10.1002/bimj.201600262] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2016] [Revised: 02/06/2018] [Accepted: 02/07/2018] [Indexed: 11/11/2022]
Abstract
There is growing interest in conducting cluster randomized trials (CRTs). For simplicity in sample size calculation, the cluster sizes are assumed to be identical across all clusters. However, equal cluster sizes are not guaranteed in practice. Therefore, the relative efficiency (RE) of unequal versus equal cluster sizes has been investigated when testing the treatment effect. One of the most important approaches to analyze a set of correlated data is the generalized estimating equation (GEE) proposed by Liang and Zeger, in which the "working correlation structure" is introduced and the association pattern depends on a vector of association parameters denoted by ρ. In this paper, we utilize GEE models to test the treatment effect in a two-group comparison for continuous, binary, or count data in CRTs. The variances of the estimator of the treatment effect are derived for the different types of outcome. RE is defined as the ratio of variance of the estimator of the treatment effect for equal to unequal cluster sizes. We discuss a commonly used structure in CRTs-exchangeable, and derive the simpler formula of RE with continuous, binary, and count outcomes. Finally, REs are investigated for several scenarios of cluster size distributions through simulation studies. We propose an adjusted sample size due to efficiency loss. Additionally, we also propose an optimal sample size estimation based on the GEE models under a fixed budget for known and unknown association parameter (ρ) in the working correlation structure within the cluster.
Collapse
Affiliation(s)
- Jingxia Liu
- Division of Public Health Sciences, Department of Surgery, Washington University in Saint Louis (WUSTL), St Louis, Missouri, 63110, USA
| | - Graham A Colditz
- Department of Surgery, Washington University in Saint Louis (WUSTL), St Louis, Missouri, 63110, USA
| |
Collapse
|
13
|
Cheung ENM, Benjamin S, Heckman G, Ho JMW, Lee L, Sinha SK, Costa AP. Clinical characteristics associated with the onset of delirium among long-term nursing home residents. BMC Geriatr 2018; 18:39. [PMID: 29394886 PMCID: PMC5797375 DOI: 10.1186/s12877-018-0733-3] [Citation(s) in RCA: 45] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2017] [Accepted: 01/25/2018] [Indexed: 01/28/2023] Open
Abstract
Background Nursing home residents are frail, have multiple medical comorbidities, and are at high risk for delirium. Most of the existing evidence base on delirium is derived from studies in the acute in-patient population. We examine the association between clinical characteristics and medication use with the incidence of delirium during the nursing home stay. Methods This is a retrospective cohort study of 1571 residents from 12 nursing homes operated by a single care provider in Ontario, Canada. Residents were over the age of 55 and admitted between February 2010 and December 2015 with no baseline delirium and a minimum stay of 180 days. Residents with moderate or worse cognitive impairment at baseline were excluded. The baseline and follow-up characteristics of residents were collected from the Resident Assessment Instrument-Minimal Data Set 2.0 completed at admission and repeated quarterly until death or discharge. Multivariate logistic regression was used to identify characteristics and medication use associated with the onset of delirium. Results The incidence of delirium was 40.4% over the nursing home stay (mean LOS: 32 months). A diagnosis of dementia (OR: 2.54, p < .001), the presence of pain (OR: 1.64, p < .001), and the use of antipsychotics (OR: 1.87, p < .001) were significantly associated with the onset of delirium. Compared to residents who did not develop delirium, residents who developed a delirium had a greater increase in the use of antipsychotics and antidepressants over the nursing home stay. Conclusions Dementia, the presence of pain, and the use of antipsychotics were associated with the onset of delirium. Pain monitoring and treatment may be important to decrease delirium in nursing homes. Future studies are necessary to examine the prescribing patterns in nursing homes and their association with delirium. Electronic supplementary material The online version of this article (10.1186/s12877-018-0733-3) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Evelyn Ning Man Cheung
- Department of Medicine, McMaster University, IHB/HSC-McMaster 3016, Victoria 10B St. S., Kitchener, ON, N2G 1C5, Canada.
| | - Sophiya Benjamin
- Department of Psychiatry & Behavioural Neurosciences, McMaster University, Hamilton, ON, Canada
| | - George Heckman
- Schlegel Research Institute for Aging, Waterloo, ON, Canada.,School of Public Health and Health Systems, University of Waterloo, Waterloo, ON, Canada
| | - Joanne Man-Wai Ho
- Department of Medicine, McMaster University, IHB/HSC-McMaster 3016, Victoria 10B St. S., Kitchener, ON, N2G 1C5, Canada.,Schlegel Research Institute for Aging, Waterloo, ON, Canada.,Big Data and Geriatric Models of Care, McMaster University, Hamilton, ON, Canada
| | - Linda Lee
- Big Data and Geriatric Models of Care, McMaster University, Hamilton, ON, Canada.,Department of Family Medicine, McMaster University, Hamilton, ON, Canada
| | | | - Andrew P Costa
- Department of Medicine, McMaster University, IHB/HSC-McMaster 3016, Victoria 10B St. S., Kitchener, ON, N2G 1C5, Canada.,Schlegel Research Institute for Aging, Waterloo, ON, Canada.,Big Data and Geriatric Models of Care, McMaster University, Hamilton, ON, Canada.,Department of Health Research Methods, Evidence, and Impact, McMaster University, Hamilton, ON, Canada
| |
Collapse
|
14
|
Comparative effectiveness of high-dose versus standard-dose influenza vaccination on numbers of US nursing home residents admitted to hospital: a cluster-randomised trial. THE LANCET RESPIRATORY MEDICINE 2017; 5:738-746. [DOI: 10.1016/s2213-2600(17)30235-7] [Citation(s) in RCA: 103] [Impact Index Per Article: 14.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/21/2017] [Revised: 05/23/2017] [Accepted: 05/30/2017] [Indexed: 02/04/2023]
|
15
|
Baier RR, Mor V. Pragmatic trials may help to identify effective strategies to reduce nursing home antipsychotic medication use. Isr J Health Policy Res 2017; 6:5. [PMID: 28149500 PMCID: PMC5270358 DOI: 10.1186/s13584-016-0130-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2016] [Accepted: 12/19/2016] [Indexed: 11/10/2022] Open
Abstract
Despite widespread agreement that nursing homes’ use of antipsychotic medications for residents without specific psychiatric diagnoses is a marker of poor quality of care, prevalence remains high. Additionally, variation suggests continued opportunity to improve care even in countries, like the United States, that have long-standing policies designed to decrease antipsychotic medication use. In a recent Israel Journal of Health Policy Research article, Frankenthal et al. presented results linking increased antipsychotic medication use prevalence in Tel Aviv nursing homes with facility characteristics, including some that “undermine quality of care,” and called for increased national focus on this area. While we agree with the authors that government focus can help to decrease antipsychotic medication use, experience in the United States shows that such efforts may not be sufficient: we present data showing significant variation among United States nursing homes’ antipsychotic medication use prevalence after more than ten years of national warnings and programs. This suggests that United States nursing home clinicians and caregivers continue to need effective non-pharmacologic interventions to substitute for antipsychotic medications. We suggest expanded use of cluster-randomized trials to test strategies to withdraw residents from antipsychotic medications and to implement alternate, non-pharmacological approaches for addressing the behavioral and psychological symptoms of dementia.
Collapse
Affiliation(s)
- Rosa R Baier
- Brown University School of Public Health, Box G-S121-6, 121 S. Main Street, Providence, RI 02912 USA
| | - Vincent Mor
- Brown University School of Public Health, Box G-S121-6, 121 S. Main Street, Providence, RI 02912 USA
| |
Collapse
|
16
|
Liu J, Colditz GA. Optimal design of longitudinal data analysis using generalized estimating equation models. Biom J 2016; 59:315-330. [PMID: 27878852 DOI: 10.1002/bimj.201600107] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2016] [Revised: 08/18/2016] [Accepted: 09/22/2016] [Indexed: 11/10/2022]
Abstract
Longitudinal studies are often applied in biomedical research and clinical trials to evaluate the treatment effect. The association pattern within the subject must be considered in both sample size calculation and the analysis. One of the most important approaches to analyze such a study is the generalized estimating equation (GEE) proposed by Liang and Zeger, in which "working correlation structure" is introduced and the association pattern within the subject depends on a vector of association parameters denoted by ρ. The explicit sample size formulas for two-group comparison in linear and logistic regression models are obtained based on the GEE method by Liu and Liang. For cluster randomized trials (CRTs), researchers proposed the optimal sample sizes at both the cluster and individual level as a function of sampling costs and the intracluster correlation coefficient (ICC). In these approaches, the optimal sample sizes depend strongly on the ICC. However, the ICC is usually unknown for CRTs and multicenter trials. To overcome this shortcoming, Van Breukelen et al. consider a range of possible ICC values identified from literature reviews and present Maximin designs (MMDs) based on relative efficiency (RE) and efficiency under budget and cost constraints. In this paper, the optimal sample size and number of repeated measurements using GEE models with an exchangeable working correlation matrix is proposed under the considerations of fixed budget, where "optimal" refers to maximum power for a given sampling budget. The equations of sample size and number of repeated measurements for a known parameter value ρ are derived and a straightforward algorithm for unknown ρ is developed. Applications in practice are discussed. We also discuss the existence of the optimal design when an AR(1) working correlation matrix is assumed. Our proposed method can be extended under the scenarios when the true and working correlation matrix are different.
Collapse
Affiliation(s)
- Jingxia Liu
- Division of Public Health Sciences, Department of Surgery, Washington University in Saint Louis (WUSTL), St Louis, MO, 63110, USA
| | - Graham A Colditz
- Department of Surgery, Washington University in Saint Louis (WUSTL), St Louis, MO, 63110, USA
| |
Collapse
|
17
|
Robertson CA, DiazGranados CA, Decker MD, Chit A, Mercer M, Greenberg DP. Fluzone® High-Dose Influenza Vaccine. Expert Rev Vaccines 2016; 15:1495-1505. [PMID: 27813430 DOI: 10.1080/14760584.2016.1254044] [Citation(s) in RCA: 42] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
INTRODUCTION Fluzone® High-Dose (IIV3-HD) is a trivalent, inactivated, split-virus influenza vaccine indicated for use in older adults (≥65 years of age). It contains 60 µg hemagglutinin of each influenza strain, which is four times the hemagglutinin content of standard-dose influenza vaccines, including Fluzone (IIV3-SD). IIV3-HD has been licensed for use in older adults in the US since December 2009 and in Canada since February 2016. Areas covered: In this review, we summarize postlicensure studies on the immunogenicity, safety, and effectiveness of IIV3-HD and estimates of its cost-effectiveness in older adults. We also discuss the potential application of IIV3-HD in adults 50-64 years of age and in individuals who may respond poorly to standard-dose influenza vaccines. Expert commentary: Multiple studies conducted since 2004 have consistently shown that, in older adults, IIV3-HD induces substantially greater antibody responses and better protection against influenza and influenza-associated hospitalization than IIV3-SD. Health economic analyses suggest that IIV3-HD can be a cost-effective alternative to standard-dose trivalent or quadrivalent inactivated influenza vaccines and can even be cost-saving compared to IIV3-SD in older adults. Further investigation of IIV3-HD vaccination as a way to improve immune responses and protection against influenza in immunocompromised individuals is warranted.
Collapse
Affiliation(s)
| | | | - Michael D Decker
- a Sanofi Pasteur Inc. , Swiftwater , PA , USA.,b Department of Health Policy , Vanderbilt University School of Medicine , Nashville , TN , USA
| | - Ayman Chit
- a Sanofi Pasteur Inc. , Swiftwater , PA , USA.,c Leslie Dan Faculty of Pharmacy , University of Toronto , Toronto , Canada
| | | | - David P Greenberg
- a Sanofi Pasteur Inc. , Swiftwater , PA , USA.,d Department of Pediatrics , University of Pittsburgh School of Medicine , Pittsburgh , PA , USA
| |
Collapse
|