1
|
Chaneliere M, Buchet-Poyau K, Keriel-Gascou M, Rabilloud M, Colin C, Langlois-Jacques C, Touzet S. A multifaceted risk management program to improve the reporting rate of patient safety incidents in primary care: a cluster-randomised controlled trial. BMC PRIMARY CARE 2024; 25:244. [PMID: 38971743 PMCID: PMC11227140 DOI: 10.1186/s12875-024-02476-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Accepted: 06/11/2024] [Indexed: 07/08/2024]
Abstract
BACKGROUND While patient safety incident reporting is of key importance for patient safety in primary care, the reporting rate by healthcare professionals remains low. This study aimed to assess the effectiveness of a risk management program in increasing the reporting rate within multiprofessional primary care facilities. METHODS A nation-wide cluster-randomised controlled trial was performed in France, with each cluster defined as a primary care facility. The intervention included professional e-learning training, identification of a risk management advisor, and multidisciplinary meetings to address incident analysis. In the first observational period, a patient safety incident reporting system for professionals was implemented in all facilities. Then, facilities were randomised, and the program was implemented. Incidents were reported over the 15-month study period. Quasi-Poisson models were used to compare reporting rates. RESULTS Thirty-five facilities (intervention, n = 17; control, n = 18) were included, with 169 and 232 healthcare professionals, respectively, involved. Overall, 7 out of 17 facilities carried out the entire program (41.2%), while 6 did not hold meetings (35.3%); 48.5% of professionals logged on to the e-learning website. The relative rate of incidents reported was 2.7 (95% CI = [0.84-11.0]; p = 0.12). However, a statistically significant decrease in the incident rate between the pre-intervention and post-intervention periods was observed for the control arm (HR = 0.2; 95% CI = [0.05-0.54]; p = 0.02), but not for the intervention arm (HR = 0.54; 95% CI = [0.2-1.54]; p = 0.23). CONCLUSION This program didn't lead to a significant improvement in the patient safety incident reporting rate by professionals but seemed to sustain reporting over time. Considering that the program was fully implemented in only 41% of facilities, this highlights the difficulty of implementing such multidisciplinary programs in primary care despite its adaptation to the setting. A better understanding of how risk management is currently organized in these multiprofessional facilities is of key importance to improve patient safety in primary care. TRIAL REGISTRATIONS The study has been registered at clinicaltrials.gov (NCT02403388) on 30 March 2015.
Collapse
Affiliation(s)
- Marc Chaneliere
- Family Medicine Department, Université Claude Bernard Lyon 1, 8 Avenue Rockefeller, Lyon, 69008, France.
- Service Recherche Et Épidémiologie Clinique, Hospices Civils de Lyon, Pole de Santé Publique, 162 Avenue Lacassagne, Lyon, 69003, France.
- Research On Healthcare Performance (RESHAPE), Université Claude Bernard Lyon 1, INSERM U1290, Lyon, France.
| | - Karine Buchet-Poyau
- Service Recherche Et Épidémiologie Clinique, Hospices Civils de Lyon, Pole de Santé Publique, 162 Avenue Lacassagne, Lyon, 69003, France
- Research On Healthcare Performance (RESHAPE), Université Claude Bernard Lyon 1, INSERM U1290, Lyon, France
| | - Maud Keriel-Gascou
- Family Medicine Department, Université Claude Bernard Lyon 1, 8 Avenue Rockefeller, Lyon, 69008, France
- Service Recherche Et Épidémiologie Clinique, Hospices Civils de Lyon, Pole de Santé Publique, 162 Avenue Lacassagne, Lyon, 69003, France
| | - Muriel Rabilloud
- Service de Biostatistique Et Bioinformatique, Hospices Civils de Lyon, Pôle Santé Publique, Lyon, 69003, France
- UMR 5558, Laboratoire de Biométrie Et Biologie Évolutive, CNRS, Équipe Biostatistique-Santé, Villeurbanne, 69100, France
| | - Cyrille Colin
- Service Recherche Et Épidémiologie Clinique, Hospices Civils de Lyon, Pole de Santé Publique, 162 Avenue Lacassagne, Lyon, 69003, France
- Research On Healthcare Performance (RESHAPE), Université Claude Bernard Lyon 1, INSERM U1290, Lyon, France
| | - Carole Langlois-Jacques
- Service de Biostatistique Et Bioinformatique, Hospices Civils de Lyon, Pôle Santé Publique, Lyon, 69003, France
- UMR 5558, Laboratoire de Biométrie Et Biologie Évolutive, CNRS, Équipe Biostatistique-Santé, Villeurbanne, 69100, France
| | - Sandrine Touzet
- Service Recherche Et Épidémiologie Clinique, Hospices Civils de Lyon, Pole de Santé Publique, 162 Avenue Lacassagne, Lyon, 69003, France
- Research On Healthcare Performance (RESHAPE), Université Claude Bernard Lyon 1, INSERM U1290, Lyon, France
| |
Collapse
|
2
|
Talal AH, Markatou M, Liu A, Perumalswami PV, Dinani AM, Tobin JN, Brown LS. Integrated Hepatitis C-Opioid Use Disorder Care Through Facilitated Telemedicine: A Randomized Trial. JAMA 2024; 331:1369-1378. [PMID: 38568601 PMCID: PMC10993166 DOI: 10.1001/jama.2024.2452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Accepted: 02/13/2024] [Indexed: 04/06/2024]
Abstract
Importance Facilitated telemedicine may promote hepatitis C virus elimination by mitigating geographic and temporal barriers. Objective To compare sustained virologic responses for hepatitis C virus among persons with opioid use disorder treated through facilitated telemedicine integrated into opioid treatment programs compared with off-site hepatitis specialist referral. Design, Setting, and Participants Prospective, cluster randomized clinical trial using a stepped wedge design. Twelve programs throughout New York State included hepatitis C-infected participants (n = 602) enrolled between March 1, 2017, and February 29, 2020. Data were analyzed from December 1, 2022, through September 1, 2023. Intervention Hepatitis C treatment with direct-acting antivirals through comanagement with a hepatitis specialist either through facilitated telemedicine integrated into opioid treatment programs (n = 290) or standard-of-care off-site referral (n = 312). Main Outcomes and Measures The primary outcome was hepatitis C virus cure. Twelve programs began with off-site referral, and every 9 months, 4 randomly selected sites transitioned to facilitated telemedicine during 3 steps without participant crossover. Participants completed 2-year follow-up for reinfection assessment. Inclusion criteria required 6-month enrollment in opioid treatment and insurance coverage of hepatitis C medications. Generalized linear mixed-effects models were used to test for the intervention effect, adjusted for time, clustering, and effect modification in individual-based intention-to-treat analysis. Results Among 602 participants, 369 were male (61.3%); 296 (49.2%) were American Indian or Alaska Native, Asian, Black or African American, multiracial, or other (ie, no race category was selected, with race data collected according to the 5 standard National Institutes of Health categories); and 306 (50.8%) were White. The mean (SD) age of the enrolled participants in the telemedicine group was 47.1 (13.1) years; that of the referral group was 48.9 (12.8) years. In telemedicine, 268 of 290 participants (92.4%) initiated treatment compared with 126 of 312 participants (40.4%) in referral. Intention-to-treat cure percentages were 90.3% (262 of 290) in telemedicine and 39.4% (123 of 312) in referral, with an estimated logarithmic odds ratio of the study group effect of 2.9 (95% CI, 2.0-3.5; P < .001) with no effect modification. Observed cure percentages were 246 of 290 participants (84.8%) in telemedicine vs 106 of 312 participants (34.0%) in referral. Subgroup effects were not significant, including fibrosis stage, urban or rural participant residence location, or mental health (anxiety or depression) comorbid conditions. Illicit drug use decreased significantly (referral: 95% CI, 1.2-4.8; P = .001; telemedicine: 95% CI, 0.3-1.0; P < .001) among cured participants. Minimal reinfections (n = 13) occurred, with hepatitis C virus reinfection incidence of 2.5 per 100 person-years. Participants in both groups rated health care delivery satisfaction as high or very high. Conclusions and Relevance Opioid treatment program-integrated facilitated telemedicine resulted in significantly higher hepatitis C virus cure rates compared with off-site referral, with high participant satisfaction. Illicit drug use declined significantly among cured participants with minimal reinfections. Trial Registration ClinicalTrials.gov Identifier: NCT02933970.
Collapse
Affiliation(s)
- Andrew H. Talal
- Division of Gastroenterology, Hepatology, and Nutrition, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, New York
| | | | - Anran Liu
- Department of Biostatistics, University at Buffalo, Buffalo, New York
| | - Ponni V. Perumalswami
- Division of Liver Diseases, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York
- Division of Gastroenterology and Hepatology, University of Michigan, Ann Arbor
| | - Amreen M. Dinani
- Division of Liver Diseases, Department of Medicine, Icahn School of Medicine at Mount Sinai, New York, New York
| | - Jonathan N. Tobin
- Clinical Directors Network, Inc (CDN), New York, New York
- The Rockefeller University Center for Clinical and Translational Science, New York, New York
| | - Lawrence S. Brown
- START Treatment & Recovery Centers, Brooklyn, New York
- Weill Cornell Medicine, New York, New York
| |
Collapse
|
3
|
Newman AR, Moody KM, Becktell K, Connelly E, Holladay C, Parisio K, Powell JL, Steineck A, Hendricks-Ferguson VL. Ensuring Intervention Fidelity of an Attention Control Arm in a Multisite Randomized Controlled Trial. Nurs Res 2024; 73:166-171. [PMID: 38112626 PMCID: PMC10922234 DOI: 10.1097/nnr.0000000000000710] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/21/2023]
Abstract
BACKGROUND Intervention fidelity is a critical element of randomized controlled trials, yet reporting of intervention fidelity among attention control arms is limited. Lack of fidelity to attention control procedures can affect study outcomes by either overestimating or underestimating the efficacy of the intervention under examination. OBJECTIVES This brief report describes the approach researchers took to promote fidelity to the attention control arm of a pediatric palliative care randomized controlled trial funded by the National Institutes of Health. METHODS The Informational Meetings for Planning and Coordinating Treatment trial aims to determine the efficacy of a communication intervention that uses care team dyads (i.e., physicians partnered with nurses or advanced practice providers) to engage parents of children with cancer who have a poor prognosis in structured conversations about prognostic information, goals of care, and care planning. The intervention is compared with an attention control arm, which provides parents with structured conversations on common pediatric cancer education topics, such as talking to their child about their cancer, clinical trials, cancer treatment, side effects, and so forth. National Institutes of Health guidelines for assessing and implementing strategies to promote intervention fidelity were used to design (a) the attention control arm of a randomized controlled trial, (b) related attention control arm training, and (c) quality assurance monitoring. RESULTS Attention control study procedures were designed to mirror that of the intervention arm (i.e., same number, frequency, and time spent in study visits). Cluster randomization was used to allocate care team dyads to one arm of the randomized controlled trial. Care team dyads assigned to the attention control arm participated in online training sessions to learn attention control procedures, the different roles of research team members, and quality assurance methods. Fidelity to attention control procedures is assessed by both the interveners themselves and a quality assurance team. DISCUSSION Study design, training, and delivery are all critical to attention control fidelity. Baseline training often needs to be supplemented with booster training when time gaps occur between study start-up and implementation. Quality assurance procedures are essential to determine whether interveners consistently deliver attention control procedures correctly.
Collapse
|
4
|
Zhang T, Phillips B, Karp N, Wang J, Novick S. Whole-cage randomization for animal studies with unequal cage or group sizes. J Biopharm Stat 2023:1-11. [PMID: 37724802 DOI: 10.1080/10543406.2023.2256834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Accepted: 09/04/2023] [Indexed: 09/21/2023]
Abstract
Following good statistical practice, in vivo study investigators allocate animals into two or more treatment groups using a randomization routine to eliminate selection bias and balance known and unknown confounding factors. For some studies, however, randomization at the individual animal level cannot be implemented. For example, for studies that involve co-housed male mice, an animal-level randomization can place unfamiliar mice together in the same cage, which can trigger fighting. To meet the ethical obligations to enhance the welfare of an animal used in science, the experimental procedures are, therefore, often modified, and male mice, possibly from the same brood, may be housed together. It follows that animal allocation into groups must proceed at the whole-cage level. Given the small sample sizes in animal studies, controlling baseline variables can be quite challenging. The difficulty greatly increases with a whole-cage randomization restriction. When the number of animals per cage or the treatment group sizes are unequal, there is no algorithm in the literature to perform the task. We propose a novel, fast, and reliable algorithm to provide a whole-cage randomization that balances one or more baseline variables across groups. The algorithm was applied to a realistic example dataset.
Collapse
Affiliation(s)
- Tianhui Zhang
- Data Sciences and Quantitative Biology, Discovery Sciences, Biopharmaceuticals R&D, AstraZeneca, Gaithersburg, Maryland, USA
| | - Benjamin Phillips
- Data Sciences and Quantitative Biology, Discovery Sciences, Biopharmaceuticals R&D, AstraZeneca, Cambridge, UK
| | - Natasha Karp
- Data Sciences and Quantitative Biology, Discovery Sciences, Biopharmaceuticals R&D, AstraZeneca, Cambridge, UK
| | - Junmin Wang
- Dynamic Omics, Center for Genomics Research, Biopharmaceuticals R&D, AstraZeneca, Gaithersburg, Maryland, USA
| | - Steven Novick
- Data Sciences and Quantitative Biology, Discovery Sciences, Biopharmaceuticals R&D, AstraZeneca, Gaithersburg, Maryland, USA
| |
Collapse
|
5
|
O’Grady MA, Kapoor S, Harrison L, Kwon N, Suleiman AO, Muench FJ. Implementing a text-messaging intervention for unhealthy alcohol use in emergency departments: protocol for implementation strategy development and a pilot cluster randomized implementation trial. Implement Sci Commun 2022; 3:86. [PMID: 35933560 PMCID: PMC9356403 DOI: 10.1186/s43058-022-00333-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2022] [Accepted: 07/25/2022] [Indexed: 01/09/2023] Open
Abstract
BACKGROUND Unhealthy alcohol use (UAU) is a leading cause of premature mortality among adults in the USA. Emergency departments (EDs) are key intervention settings for UAU but often have limited time and resources. One low-burden, scalable approach to address UAU is text-messaging interventions. Despite strong research support and promise for scalability, there is little research on how to implement such interventions in healthcare settings. The process of providers making them available to patients in an efficient way within already busy and overburdened ED workflows and patients adopting them remains a new area of research. The purpose of this three-phase study is to develop and test an implementation strategy for UAU text-messaging interventions in EDs. METHOD Our first aim is to examine barriers and facilitators to staff offering and patients accepting a text-messaging intervention in the ED using an explanatory, sequential mixed methods approach. We will examine alcohol screening data in the electronic health records of 17 EDs within a large integrated health system in the Northeast and conduct surveys among chairpersons in each. This data will be used to purposively sample 4 EDs for semi-structured interviews among 20 clinical staff, 20 patients, and 4 chairpersons. Our second aim is to conduct a stakeholder-engaged intervention mapping process to develop a multi-component implementation strategy for EDs. Our third aim is to conduct a mixed method 2-arm cluster randomized pilot study in 4 EDs that serve ~11,000 UAU patients per year to assess the feasibility, acceptability, and preliminary effectiveness of the implementation strategy. The Integrated Promoting Action on Research Implementation in Health Services framework will guide study activities. DISCUSSION Low-burden technology, like text messaging, along with targeted implementation support and strategies driven by identified barriers and facilitators could sustain large-scale ED-based alcohol screening programs and provide much needed support to patients who screen positive while reducing burden on EDs. The proposed study would be the first to develop and test this targeted implementation strategy and will prepare for a larger, fully powered hybrid effectiveness-implementation trial. Findings may also be broadly applicable to implementation of patient-facing mobile health technologies. TRIAL REGISTRATION This study was registered at ClinicalTrials.gov (NCT05350878) on 4/28/2022.
Collapse
Affiliation(s)
- Megan A. O’Grady
- grid.208078.50000000419370394Department of Public Health Sciences, School of Medicine, University of Connecticut, 263 Farmington Ave, Farmington, CT 06030-6325 USA
| | - Sandeep Kapoor
- grid.416477.70000 0001 2168 3646Northwell Health, 350 Community Drive, Manhasset, NY 11030 USA ,grid.512756.20000 0004 0370 4759Zucker School of Medicine at Hofstra/Northwell, 500 Hofstra Blvd, Hempstead, NY 11549 USA
| | - Laura Harrison
- grid.416477.70000 0001 2168 3646Northwell Health, 350 Community Drive, Manhasset, NY 11030 USA
| | - Nancy Kwon
- grid.416477.70000 0001 2168 3646Northwell Health, 350 Community Drive, Manhasset, NY 11030 USA ,grid.512756.20000 0004 0370 4759Zucker School of Medicine at Hofstra/Northwell, 500 Hofstra Blvd, Hempstead, NY 11549 USA
| | - Adekemi O. Suleiman
- grid.208078.50000000419370394Department of Public Health Sciences, School of Medicine, University of Connecticut, 263 Farmington Ave, Farmington, CT 06030-6325 USA
| | - Frederick J. Muench
- grid.475801.fPartnership to End Addiction, 711 Third Avenue, 5th Floor, Suite 500, New York, NY 10017 USA
| |
Collapse
|
6
|
Moulton LH. Randomization: Beyond the closurization principle. Clin Trials 2022; 19:396-401. [PMID: 35232309 DOI: 10.1177/17407745221080714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Many cluster randomized trials have relatively few numbers of clusters to be randomized. When baseline cluster-level covariates are available prior to randomization, the set of potential allocations can be restricted so as to ensure balance across study arms. This article discusses why and how restrictions can be made, and the ramifications of so doing. The Fisher-Bailey validity is explained, and examples are given regarding the tradeoff between balance and validity.
Collapse
Affiliation(s)
- Lawrence H Moulton
- Departments of International Health and Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| |
Collapse
|
7
|
Talal AH, Markatou M, Sofikitou EM, Brown LS, Perumalswami P, Dinani A, Tobin JN. Patient-centered HCV care via telemedicine for individuals on medication for opioid use disorder: Telemedicine for Evaluation, Adherence and Medication for Hepatitis C (TEAM-C). Contemp Clin Trials 2021; 112:106632. [PMID: 34813962 DOI: 10.1016/j.cct.2021.106632] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2021] [Revised: 11/15/2021] [Accepted: 11/17/2021] [Indexed: 01/08/2023]
Abstract
BACKGROUND Telemedicine has the potential to increase healthcare access especially for vulnerable populations. Telemedicine for Evaluation, Adherence, and Medication for Hepatitis C (TEAM-C) is comparing telemedicine access to specialty medical care to usual care for management of hepatitis C virus (HCV) infection among persons with opioid use disorder (PWOUD). PWOUD have the highest hepatitis C virus (HCV) prevalence and incidence, yet they infrequently receive HCV care. The study objectives are to compare access to specialty care via telemedicine to offsite specialty referral (usual care) on 1) treatment initiation, completion, and sustained virological response, 2) patient satisfaction with health care delivery, and 3) HCV reinfection after successful HCV cure. METHODS TEAM-C is a multi-site, non-blinded, randomized pragmatic clinical trial conducted at 12 opioid treatment programs (OTP) throughout New York State that utilizes the stepped-wedge design. The unit of randomization is the OTP with a total sample size of 624 participants. HCV-infected PWOUD were treated via telemedicine or referral. Telemedicine encounters are conducted onsite in the OTP with co-administration of direct acting antivirals for HCV with medications for opioid use disorder. The primary outcome is undetectable HCV RNA obtained 12 weeks post-treatment cessation. We also follow participants for two years to assess for reinfection. CONCLUSIONS The study utilizes a rigorous study design to evaluate the effectiveness and implementation of virtual treatment for HCV integrated into behavioral treatment. We demonstrate the feasibility, engagement principles and lessons learned from the initial prospective randomized trial of telemedicine targeted to a vulnerable population.
Collapse
Affiliation(s)
- Andrew H Talal
- Division of Gastroenterology, Hepatology, and Nutrition, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, 875 Ellicot Street, Suite 6090, Buffalo, NY 14203, USA.
| | - Marianthi Markatou
- Department of Biostatistics, University at Buffalo, 726 Kimball Tower, Buffalo, NY 14214, USA.
| | - Elisavet M Sofikitou
- Department of Biostatistics, University at Buffalo, 726 Kimball Tower, Buffalo, NY 14214, USA.
| | - Lawrence S Brown
- START Treatment & Recovery Centers, 22 Chapel Street, Brooklyn, NY 11201, USA.
| | - Ponni Perumalswami
- Division of Liver Diseases, Icahn School of Medicine at Mount Sinai, 17 East 102nd Street 8th Floor, New York, NY 10029, USA.
| | - Amreen Dinani
- Division of Liver Diseases, Icahn School of Medicine at Mount Sinai, 17 East 102nd Street 8th Floor, New York, NY 10029, USA.
| | - Jonathan N Tobin
- Clinical Directors Network, Inc. (CDN), New York, NY, USA; The Rockefeller University, 5 West 37th Street, 10(th) floor, New York, NY 10018, USA.
| |
Collapse
|
8
|
Dibley MJ, Alam A, Fahmida U, Ariawan I, Titaley CR, Htet MK, Damayanti R, Li M, Sutrisna A, Ferguson E. Evaluation of a Package of Behaviour Change Interventions (Baduta Program) to Improve Maternal and Child Nutrition in East Java, Indonesia: Protocol for an Impact Study. JMIR Res Protoc 2020; 9:e18521. [PMID: 32897234 PMCID: PMC7509610 DOI: 10.2196/18521] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2020] [Revised: 06/25/2020] [Accepted: 06/30/2020] [Indexed: 12/26/2022] Open
Abstract
BACKGROUND Over the past decade, the prevalence of stunting has been close to 37% in children aged <5 years in Indonesia. The Baduta program, a multicomponent package of interventions developed by the Global Alliance for Improved Nutrition, aims to improve maternal and infant nutrition in Indonesia. OBJECTIVE This study aims to assess the impact of the Baduta program, a package of health system strengthening and behavior change interventions, compared with the standard village health services on maternal and child nutrition. METHODS The impact evaluation uses a cluster randomized controlled trial design with 2 outcome assessments. The first uses cross-sectional surveys of mothers of children aged 0-23 months and pregnant women before and after the interventions. The second is a cohort study of pregnant women followed until their child is 18 months from a subset of clusters. We will also conduct a process evaluation guided by the program impact pathway to assess coverage, fidelity, and acceptance. The study will be conducted in the Malang and Sidoarjo districts of East Java, Indonesia. The unit of randomization is the subdistricts. As random allocation of interventions to only 6 subdistricts is feasible, we will use constrained randomization to ensure balance of baseline covariates. The first intervention will be health system strengthening, including the Baby-Friendly Hospital Initiative, and training on counseling for appropriate infant and young child feeding (IYCF). The second intervention will be nutrition behavior change that includes Emo-Demos; a national television (TV) advertising campaign; local screening TV spots; a free, text message service; and promotion of low-cost water filters and hygiene practices. The primary study outcome is child stunting (low length-for-age), and secondary outcomes include length-for-age Z scores, wasting (low weight-for-length), anemia, child morbidity, IYCF indicators, and maternal and child nutrient intakes. The sample size for each cross-sectional survey is 1400 mothers and their children aged <2 years and 200 pregnant women in each treatment group. The cohort evaluation requires a sample size of 340 mother-infant pairs in each treatment group. We will seek Gatekeeper consent and written informed consent from the participants. The intention-to-treat principle will guide our data analysis, and we will apply Consolidated Standards of Reporting Trials guidelines for clustered randomized trials in the analysis. RESULTS In February 2015, we conducted a baseline cross-sectional survey on 2435 women with children aged <2 years and 409 pregnant women. In February 2017, we conducted an end-line survey on 2740 mothers with children aged <2 years and 642 pregnant women. The cohort evaluation began in February 2015, with 729 pregnant women, and was completed in December 2016. CONCLUSIONS The results of the program evaluation will help guide policies to support effective packages of behavior change interventions to prevent child stunting in Indonesia. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) RR1-10.2196/18521.
Collapse
Affiliation(s)
| | - Ashraful Alam
- Sydney School of Public Health, The University of Sydney, Australia
| | - Umi Fahmida
- SEAMEO RECFON-Pusat Kajian Gizi Regional, Universitas Indonesia, Jakarta, Indonesia
| | - Iwan Ariawan
- Center for Health Research, Faculty of Public Health, Universitas Indonesia, Jakarta, Indonesia
| | | | - Min Kyaw Htet
- SEAMEO RECFON-Pusat Kajian Gizi Regional, Universitas Indonesia, Jakarta, Indonesia
| | - Rita Damayanti
- Center for Health Research, Faculty of Public Health, Universitas Indonesia, Jakarta, Indonesia
| | - Mu Li
- Sydney School of Public Health, The University of Sydney, Australia
| | - Aang Sutrisna
- Indonesia Office, Global Alliance for Improved Nutrition, Jakarta, Indonesia
| | - Elaine Ferguson
- Department of Population Health, London School of Hygiene & Tropical Medicine (LSHTM), London, United Kingdom
| |
Collapse
|
9
|
Opel DJ, Robinson JD, Spielvogle H, Spina C, Garrett K, Dempsey AF, Perreira C, Dickinson M, Zhou C, Pahud B, Taylor JA, O'Leary ST. 'Presumptively Initiating Vaccines and Optimizing Talk with Motivational Interviewing' (PIVOT with MI) trial: a protocol for a cluster randomised controlled trial of a clinician vaccine communication intervention. BMJ Open 2020; 10:e039299. [PMID: 32784263 PMCID: PMC7418671 DOI: 10.1136/bmjopen-2020-039299] [Citation(s) in RCA: 25] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/07/2023] Open
Abstract
INTRODUCTION A key contributor to underimmunisation is parental refusal or delay of vaccines due to vaccine concerns. Many clinicians lack confidence in communicating with vaccine-hesitant parents (VHP) and perceive that their discussions will do little to change parents' minds. Improving clinician communication with VHPs is critical to increasing childhood vaccine uptake. METHODS AND ANALYSIS We describe the protocol for a cluster randomised controlled trial to test the impact of a novel, multifaceted clinician vaccine communication strategy on child immunisation status. The trial will be conducted in 24 primary care practices in two US states (Washington and Colorado). The strategy is called Presumptively Initiating Vaccines and Optimizing Talk with Motivational Interviewing (PIVOT with MI), and involves clinicians initiating the vaccine conversation with all parents of young children using the presumptive format, and among those parents who resist vaccines, pivoting to using MI. Our primary outcome is the immunisation status of children of VHPs at 19 months, 0 day of age expressed as the percentage of days underimmunised from birth to 19 months for 22 doses of eight vaccines recommended during this interval. Secondary outcomes include clinician experience communicating with VHPs, parent visit experience and clinician adherence to the PIVOT with MI communication strategy. ETHICS AND DISSEMINATION This study is approved by the following institutional review boards: Colorado Multiple Institutional Review Board, Washington State Institutional Review Board and Swedish Health Services Institutional Review Board. Results will be disseminated through peer-reviewed manuscripts and conference presentations. TRIAL REGISTRATION NUMBER NCT03885232.
Collapse
Affiliation(s)
- Douglas J Opel
- Seattle Children's Research Institute, Seattle, Washington, USA
- Department of Pediatrics, University of Washington School of Medicine, Seattle, Washington, USA
| | - Jeffrey D Robinson
- Department of Communication, Portland State University, Portland, Oregon, USA
| | | | - Christine Spina
- Children's Hospital Colorado, Aurora, Colorado, USA
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado, Denver, CO, USA
| | - Kathleen Garrett
- Children's Hospital Colorado, Aurora, Colorado, USA
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado, Denver, CO, USA
| | - Amanda F Dempsey
- Children's Hospital Colorado, Aurora, Colorado, USA
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado, Denver, CO, USA
- Department of Pediatrics, University of Colorado, Denver, Colorado, USA
| | - Cathryn Perreira
- Children's Hospital Colorado, Aurora, Colorado, USA
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado, Denver, CO, USA
| | - Miriam Dickinson
- Children's Hospital Colorado, Aurora, Colorado, USA
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado, Denver, CO, USA
| | - Chuan Zhou
- Seattle Children's Research Institute, Seattle, Washington, USA
- Department of Pediatrics, University of Washington School of Medicine, Seattle, Washington, USA
| | - Barbara Pahud
- Department of Pediatrics, University of Missouri-Kansas City, Kansas City, Missouri, USA
| | - James A Taylor
- Department of Pediatrics, University of Washington School of Medicine, Seattle, Washington, USA
| | - Sean T O'Leary
- Children's Hospital Colorado, Aurora, Colorado, USA
- Adult and Child Consortium for Health Outcomes Research and Delivery Science, University of Colorado, Denver, CO, USA
- Department of Pediatrics, University of Colorado, Denver, Colorado, USA
| |
Collapse
|
10
|
Ara G, Khanam M, Papri N, Nahar B, Kabir I, Sanin KI, Khan SS, Sarker MSA, Dibley MJ. Peer Counseling Promotes Appropriate Infant Feeding Practices and Improves Infant Growth and Development in an Urban Slum in Bangladesh: A Community-Based Cluster Randomized Controlled Trial. Curr Dev Nutr 2019; 3:nzz072. [PMID: 31334480 PMCID: PMC6635820 DOI: 10.1093/cdn/nzz072] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2019] [Revised: 05/14/2019] [Accepted: 06/12/2019] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Undernutrition and poor cognitive development affect many children in developing countries. Good nutrition and health care are essential for optimal child development and growth. OBJECTIVES We assessed the impact of peer counseling combined with psychosocial stimulation on feeding practices and child growth and development in slums in Bangladesh. METHODS We performed a community-based cluster randomized controlled trial in selected slums; 350 mother-infant pairs were allocated to receive peer counseling on feeding practices plus psychosocial stimulation (PC + PCS; n = 175) or usual health messages (control; n = 175) using restricted randomization. Data were collected at enrollment and 1, 3, 5, 7, 9, and 12 mo after delivery. We collected data on infant and young child feeding practices and anthropometric measurements from birth until 12 mo to assess the main outcomes, including feeding practices and growth. We used the Bayley Scale III at 12 mo to assess child development. The effects of the PC + PCS intervention were assessed by using regression models. RESULTS More mothers in the PC + PCS group than in the control group reported early initiation of breastfeeding (in the first hour: 89% compared with 78%, respectively; P < 0.05) and exclusive breastfeeding at 5 mo (73% compared with 27%, respectively; P < 0.001). Peer counseling had positively impacted infant length gain at 12 mo (P < 0.005). Children in the PC + PCS group were found to be more socially and emotionally active compared with controls at 12 mo (standardized score: 0.165 compared with -0.219, respectively; P < 0.05). CONCLUSION Combining peer counseling with psychosocial stimulation had positive effects on infant feeding practices and growth at 12 mo and on the social-emotional development of young children. This trial was registered at clinicaltrial.gov as NCT03040375.
Collapse
Affiliation(s)
- Gulshan Ara
- International Centre for Diarrhoeal Disease Research, Bangladesh, Dhaka, Bangladesh
| | - Mansura Khanam
- International Centre for Diarrhoeal Disease Research, Bangladesh, Dhaka, Bangladesh
| | - Nowshin Papri
- International Centre for Diarrhoeal Disease Research, Bangladesh, Dhaka, Bangladesh
| | - Baitun Nahar
- International Centre for Diarrhoeal Disease Research, Bangladesh, Dhaka, Bangladesh
| | - Iqbal Kabir
- Bangladesh Breastfeeding Foundation, Institute of Public Health, Dhaka, Bangladesh
| | - Kazi Istiaque Sanin
- International Centre for Diarrhoeal Disease Research, Bangladesh, Dhaka, Bangladesh
| | - Sihan Sadat Khan
- International Centre for Diarrhoeal Disease Research, Bangladesh, Dhaka, Bangladesh
| | | | - Michael J Dibley
- Sydney School of Public Health, University of Sydney, Sydney, Australia
| |
Collapse
|
11
|
Dinov ID, Palanimalai S, Khare A, Christou N. Randomization-Based Statistical Inference: A Resampling and Simulation Infrastructure. TEACHING STATISTICS 2018; 40:64-73. [PMID: 30270947 PMCID: PMC6155997 DOI: 10.1111/test.12156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Statistical inference involves drawing scientifically-based conclusions describing natural processes or observable phenomena from datasets with intrinsic random variation. There are parametric and non-parametric approaches for studying the data or sampling distributions, yet few resources are available to provide integrated views of data (observed or simulated), theoretical concepts, computational mechanisms and hands-on utilization via flexible graphical user interfaces. We designed, implemented and validated a new portable randomization-based statistical inference infrastructure (http://socr.umich.edu/HTML5/Resampling_Webapp) that blends research-driven data analytics and interactive learning, and provides a backend computational library for managing large amounts of simulated or user-provided data. The core of this framework is a modern randomization webapp, which may be invoked on any device supporting a JavaScript-enabled web-browser. We demonstrate the use of these resources to analyze proportion, mean, and other statistics using simulated (virtual experiments) and observed (e.g., Acute Myocardial Infarction, Job Rankings) data. Finally, we draw parallels between parametric inference methods and their distribution-free alternatives. The Randomization and Resampling webapp can be used for data analytics, as well as for formal, in-class and informal, out-of-the-classroom learning and teaching of different scientific concepts. Such concepts include sampling, random variation, computational statistical inference and data-driven analytics. The entire scientific community may utilize, test, expand, modify or embed these resources (data, source-code, learning activity, webapp) without any restrictions.
Collapse
Affiliation(s)
- Ivo D. Dinov
- Statistics Online Computational Resource, University of California, Los Angeles, Los Angeles, CA 90095
- Statistics Online Computational Resource, University of Michigan, UMSN, Ann Arbor, Michigan 48109-5482
- Michigan Institute for Data Science, University of Michigan, Ann Arbor, Michigan 48109
| | - Selvam Palanimalai
- Statistics Online Computational Resource, University of California, Los Angeles, Los Angeles, CA 90095
| | - Ashwini Khare
- Statistics Online Computational Resource, University of California, Los Angeles, Los Angeles, CA 90095
| | - Nicolas Christou
- Statistics Online Computational Resource, University of California, Los Angeles, Los Angeles, CA 90095
| |
Collapse
|
12
|
Greene EJ. A SAS Macro for Covariate-Constrained Randomization of General Cluster-Randomized and Unstratified Designs. J Stat Softw 2017. [PMID: 28649186 DOI: 10.18637/jss.v077.c01] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
Abstract
Ivers et al. (2012) have recently stressed the importance to both statistical power and face validity of balancing allocations to study arms on relevant covariates. While several techniques exist (e.g., minimization, pair-matching, stratification), the covariate-constrained randomization (CCR) approach proposed by Moulton (2004) is favored when clusters can be recruited prior to randomization. CCRA V1.0, a macro published by Chaudhary and Moulton (2006), provides a SAS implementation of CCR for a particular subset of possible designs (those with two arms, small numbers of strata and clusters, an equal number of clusters within each stratum, and constraints that can be expressed as absolute mean differences between arms). This paper presents a more comprehensive macro, CCR, that is applicable across a wider variety of designs and provides statistics describing the range of possible allocations meeting the constraints in addition to performing the actual random assignment.
Collapse
|
13
|
Kempe A, O’Leary ST, Shoup JA, Stokley S, Lockhart S, Furniss A, Dickinson LM, Barnard J, Daley MF. Parental Choice of Recall Method for HPV Vaccination: A Pragmatic Trial. Pediatrics 2016; 137:e20152857. [PMID: 26921286 PMCID: PMC5884084 DOI: 10.1542/peds.2015-2857] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/19/2015] [Indexed: 11/24/2022] Open
Abstract
OBJECTIVES Completion rates for the human papillomavirus vaccine (HPV) series among adolescents remain low. Effectiveness of recall with parents choosing the method (preference-based recall) for increasing HPV series completion is unstudied. Within a cluster-randomized trial, we examined effectiveness of preference-based recall compared with usual care for increasing series completion and the association of recall choices with completion. METHODS All Kaiser Permanente Colorado pediatric practices (n = 7) were randomized to intervention (n = 4) or control (n = 3) by using covariate-constrained randomization. From January to June 2013, parents at intervention practices whose adolescents received HPV 1 were asked the recall method they preferred for subsequent doses and if they also wanted their child reminded. Completion rates were assessed 1 year after HPV 1. RESULTS At intervention practices, 374 (43%) of 867 patients were enrolled; 39% preferred text, 18% e-mail, 9% auto-dialer, and 34% 2-methods; 19% chose to have adolescent also recalled. Intervention adolescents were more likely to complete (63% vs 38%) than were controls (adjusted risk ratio 1.47 [1.38-1.57]) and less likely to be late in completing the series (45% vs 57%, P = .02). Rates of completion were similar between different recall methods, but significantly higher for those preferring e-mail and phone compared withother methods (90% vs 60%. P = .008). Completion rates were similar for adolescents who also received recalls (62%) versus those who did not (63%). CONCLUSIONS Preference-based recall was effective in increasing HPV series completion rates, with point estimates substantially higher than for most published studies of reminder/recall.
Collapse
Affiliation(s)
- Allison Kempe
- Adult and Child Center for Outcomes Research and Delivery Science (ACCORDS), University of Colorado Anschutz Medical Campus and Children's Hospital Colorado, Aurora, Colorado; Departments of Pediatrics, and
| | - Sean T. O’Leary
- Adult and Child Center for Outcomes Research and Delivery Science (ACCORDS), University of Colorado Anschutz Medical Campus and Children’s Hospital Colorado, Aurora, Colorado,Department of Pediatrics, University of Colorado, Aurora, Colorado
| | - Jo Ann Shoup
- Institute for Health Research, Kaiser Permanente Colorado, Denver, Colorado
| | - Shannon Stokley
- National Center for Immunizations and Respiratory Diseases, Centers for Disease Control and Prevention, Atlanta, Georgia
| | - Steven Lockhart
- Adult and Child Center for Outcomes Research and Delivery Science (ACCORDS), University of Colorado Anschutz Medical Campus and Children’s Hospital Colorado, Aurora, Colorado
| | - Anna Furniss
- Adult and Child Center for Outcomes Research and Delivery Science (ACCORDS), University of Colorado Anschutz Medical Campus and Children’s Hospital Colorado, Aurora, Colorado
| | - L. Miriam Dickinson
- Adult and Child Center for Outcomes Research and Delivery Science (ACCORDS), University of Colorado Anschutz Medical Campus and Children’s Hospital Colorado, Aurora, Colorado,Department of Family Medicine, University of Colorado, Aurora, Colorado
| | - Juliana Barnard
- Adult and Child Center for Outcomes Research and Delivery Science (ACCORDS), University of Colorado Anschutz Medical Campus and Children’s Hospital Colorado, Aurora, Colorado
| | - Matthew F. Daley
- Department of Pediatrics, University of Colorado, Aurora, Colorado,Institute for Health Research, Kaiser Permanente Colorado, Denver, Colorado
| |
Collapse
|
14
|
Esserman D, Allore HG, Travison TG. The Method of Randomization for Cluster-Randomized Trials: Challenges of Including Patients with Multiple Chronic Conditions. ACTA ACUST UNITED AC 2016; 5:2-7. [PMID: 27478520 PMCID: PMC4963011 DOI: 10.6000/1929-6029.2016.05.01.1] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Cluster-randomized clinical trials (CRT) are trials in which the unit of randomization is not a participant but a group (e.g. healthcare systems or community centers). They are suitable when the intervention applies naturally to the cluster (e.g. healthcare policy); when lack of independence among participants may occur (e.g. nursing home hygiene); or when it is most ethical to apply an intervention to all within a group (e.g. school-level immunization). Because participants in the same cluster receive the same intervention, CRT may approximate clinical practice, and may produce generalizable findings. However, when not properly designed or interpreted, CRT may induce biased results. CRT designs have features that add complexity to statistical estimation and inference. Chief among these is the cluster-level correlation in response measurements induced by the randomization. A critical consideration is the experimental unit of inference; often it is desirable to consider intervention effects at the level of the individual rather than the cluster. Finally, given that the number of clusters available may be limited, simple forms of randomization may not achieve balance between intervention and control arms at either the cluster- or participant-level. In non-clustered clinical trials, balance of key factors may be easier to achieve because the sample can be homogenous by exclusion of participants with multiple chronic conditions (MCC). CRTs, which are often pragmatic, may eschew such restrictions. Failure to account for imbalance may induce bias and reducing validity. This article focuses on the complexities of randomization in the design of CRTs, such as the inclusion of patients with MCC, and imbalances in covariate factors across clusters.
Collapse
Affiliation(s)
- Denise Esserman
- Department of Biostatistics, Yale School of Public Health, New Haven, Connecticut, USA
| | - Heather G Allore
- Department of Biostatistics, Yale School of Public Health, New Haven, Connecticut, USA; Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut, USA
| | - Thomas G Travison
- Department of Medicine, Harvard Medical School, Cambridge, Massachusetts, USA; Hebrew SeniorLife Institute for Aging Research, Roslindale, Massachusetts, USA
| |
Collapse
|
15
|
A randomized trial of two coverage targets for mass treatment with azithromycin for trachoma. PLoS Negl Trop Dis 2013; 7:e2415. [PMID: 24009792 PMCID: PMC3757067 DOI: 10.1371/journal.pntd.0002415] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2013] [Accepted: 07/28/2013] [Indexed: 11/29/2022] Open
Abstract
Background The World Health Organization recommends at least 3 annual antibiotic mass drug administrations (MDA) where the prevalence of trachoma is >10% in children ages 1–9 years, with coverage at least at 80%. However, the additional value of higher coverage targeted at children with multiple rounds is unknown. Trial Design 2×2 factorial community randomized, double blind, trial. Trial methods 32 communities with prevalence of trachoma ≥20% were randomized to: annual MDA aiming for coverage of children between 80%–90% (usual target) versus aiming for coverage>90% (enhanced target); and to: MDA for three years versus a rule of cessation of MDA early if the estimated prevalence of ocular C. trachomatis infection was less than 5%. The primary outcome was the community prevalence of infection with C. trachomatis at 36 months. Results Over the trial's course, no community met the MDA cessation rule, so all communities had the full 3 rounds of MDA. At 36 months, there was no significant difference in the prevalence of infection, 4.0 versus 5.4 (mean adjusted difference = 1.4%, 95% CI = −1.0% to 3.8%), nor in the prevalence of trachoma, 6.1 versus 9.0 (mean adjusted difference = 2.6%, 95% CI = −0.3% to 5.3%) comparing the usual target to the enhanced target group. There was no difference if analyzed using coverage as a continuous variable. Conclusion In communities that had pre-treatment prevalence of follicular trachoma of 20% or greater, there is no evidence that MDA can be stopped before 3 annual rounds, even with high coverage. Increasing coverage in children above 90% does not appear to confer additional benefit. The World Health Organization recommends at least 3 annual antibiotic mass drug administrations (MDA) where the prevalence of trachoma is >10% in children ages 1–9 years, with coverage at least at 80%. However, the additional value of higher coverage targeted at children with multiple rounds is unknown. We randomized 32 communities in Kongwa, Tanzania, with starting prevalence estimated at >20% to four arms: annual MDA aiming for coverage of children between 80%–90% (usual target) versus aiming for coverage>90% (enhanced target); and to: MDA for three years versus a rule of cessation of MDA early if the estimated prevalence of ocular C. trachomatis infection was less than 5%. After three rounds of MDA, infection with C. trachomatis and trachoma had declined significantly from baseline but no communities had treatment stopped. There was no difference in infection or in trachoma at three years comparing the usual coverage communities to the enhanced coverage communities. We conclude that in communities that had pre-treatment prevalence of follicular trachoma of 20% or greater, there is no evidence that MDA can be stopped before 3 annual rounds, even with high coverage. Increasing coverage in children above 90% does not appear to confer additional benefit.
Collapse
|
16
|
Jabbour M, Curran J, Scott SD, Guttman A, Rotter T, Ducharme FM, Lougheed MD, McNaughton-Filion ML, Newton A, Shafir M, Paprica A, Klassen T, Taljaard M, Grimshaw J, Johnson DW. Best strategies to implement clinical pathways in an emergency department setting: study protocol for a cluster randomized controlled trial. Implement Sci 2013; 8:55. [PMID: 23692634 PMCID: PMC3674906 DOI: 10.1186/1748-5908-8-55] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2013] [Accepted: 05/15/2013] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND The clinical pathway is a tool that operationalizes best evidence recommendations and clinical practice guidelines in an accessible format for 'point of care' management by multidisciplinary health teams in hospital settings. While high-quality, expert-developed clinical pathways have many potential benefits, their impact has been limited by variable implementation strategies and suboptimal research designs. Best strategies for implementing pathways into hospital settings remain unknown. This study will seek to develop and comprehensively evaluate best strategies for effective local implementation of externally developed expert clinical pathways. DESIGN/METHODS We will develop a theory-based and knowledge user-informed intervention strategy to implement two pediatric clinical pathways: asthma and gastroenteritis. Using a balanced incomplete block design, we will randomize 16 community emergency departments to receive the intervention for one clinical pathway and serve as control for the alternate clinical pathway, thus conducting two cluster randomized controlled trials to evaluate this implementation intervention. A minimization procedure will be used to randomize sites. Intervention sites will receive a tailored strategy to support full clinical pathway implementation. We will evaluate implementation strategy effectiveness through measurement of relevant process and clinical outcomes. The primary process outcome will be the presence of an appropriately completed clinical pathway on the chart for relevant patients. Primary clinical outcomes for each clinical pathway include the following: Asthma--the proportion of asthmatic patients treated appropriately with corticosteroids in the emergency department and at discharge; and Gastroenteritis--the proportion of relevant patients appropriately treated with oral rehydration therapy. Data sources include chart audits, administrative databases, environmental scans, and qualitative interviews. We will also conduct an overall process evaluation to assess the implementation strategy and an economic analysis to evaluate implementation costs and benefits. DISCUSSION This study will contribute to the body of evidence supporting effective strategies for clinical pathway implementation, and ultimately reducing the research to practice gaps by operationalizing best evidence care recommendations through effective use of clinical pathways. TRIAL REGISTRATION ClinicalTrials.gov: NCT01815710.
Collapse
Affiliation(s)
- Mona Jabbour
- Division of Emergency Medicine, Children’s Hospital of Eastern Ontario, Ottawa, Canada
- Departments of Pediatrics and Emergency Medicine, University of Ottawa, Ottawa, Canada
- Children’s Hospital of Eastern Ontario Research Institute, Ottawa, Canada
| | - Janet Curran
- IWK Health Centre, Halifax, Canada, School of Nursing, Dalhousie University, Halifax, Canada
| | | | - Astrid Guttman
- Institute for Clinical Evaluative Sciences, Toronto, Canada
- Division of Paediatric Medicine, Hospital for Sick Children, Toronto, Canada
- Department of Paediatrics and Health Policy, Management and Evaluation, University of Toronto, Toronto, Canada
| | - Thomas Rotter
- College of Pharmacy and Nutrition, University of Saskatchewan, Saskatoon, Canada
| | - Francine M Ducharme
- Departments of Pediatrics and of Social and Preventive Medicine, University of Montreal, Montreal, Canada
- Research Centre, CHU Sainte-Justine, Montreal, Canada
| | - M Diane Lougheed
- Departments of Medicine (Respirology), Biomedical and Molecular Sciences (Physiology) and Community Health and Epidemiology, Queen’s University, Kingston, Canada
- ICES-Queen’s University, Kingston, Canada
| | - M Louise McNaughton-Filion
- University of Ottawa, Ottawa, Canada
- Montfort Hospital, Ottawa, Canada
- Champlain Local Health Integrated Network, Ottawa, Canada
| | - Amanda Newton
- Department of Pediatrics, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, Canada
| | - Mark Shafir
- Department of Emergency Medicine, Cambridge Memorial Hospital, Cambridge, Canada
- Michael G. DeGroote School of Medicine, McMaster University, Hamilton, Canada
| | - Alison Paprica
- Ontario Ministry of Health and Long-Term Care, Toronto, Canada
| | - Terry Klassen
- Faculty of Medicine, University of Manitoba, Winnipeg, Canada
- Manitoba Institute of Child Health, Winnipeg, Canada
| | - Monica Taljaard
- Department of Epidemiology and Community Medicine, University of Ottawa, Ottawa, Canada
- Ottawa Hospital Research Institute, Clinical Epidemiology Program, Ottawa, Canada
| | - Jeremy Grimshaw
- Ottawa Hospital Research Institute, Ottawa, Canada
- Department of Medicine, University of Ottawa, Ottawa, Canada
| | - David W Johnson
- Division of Emergency Medicine, Alberta Children’s Hospital, Calgary, Canada
- Alberta Children’s Hospital Research Institute, Calgary, Canada
- Department of Pediatrics, Physiology and Pharmacology, University of Calgary, Calgary, Canada
| |
Collapse
|
17
|
Yohannan J, Munoz B, Mkocha H, Gaydos CA, Bailey R, Lietman TA, Quinn T, West SK. Can we stop mass drug administration prior to 3 annual rounds in communities with low prevalence of trachoma?: PRET Ziada trial results. JAMA Ophthalmol 2013; 131:431-6. [PMID: 23392481 PMCID: PMC3790327 DOI: 10.1001/jamaophthalmol.2013.2356] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
IMPORTANCE The World Health Organization recommends at least 3 annual mass drug administrations (MDAs) of azithromycin in places where the prevalence of follicular trachoma (FT) is greater than 10%. However, stopping MDA prior to 3 rounds, if monitoring indicates an absence of infection with Chlamydia trachomatis even if FT persists, may be more cost-effective. OBJECTIVE To determine the prevalence of infection in communities randomized to 3 rounds of annual MDAs with azithromycin compared with communities randomized to a stopping rule, where MDA could cease if the infection rate was low. DESIGN A 1:1 community randomized trial comparing usual care with a cessation rule. The Partnership for the Rapid Elimination of Trachoma-Ziada Trial was conducted from February 1, 2010, through September 1, 2011. SETTING Sixteen communities in Tanzania with trachoma prevalence rates between 10% and 20%. PARTICIPANTS A total of 100 children aged 5 years or younger randomly drawn from each community. Children had to reside in an eligible community, have no ocular condition that prevented trachoma grading or ocular specimen collection, and have a guardian who could provide consent for participation. INTERVENTIONS Cessation of MDA with azithromycin if the community had no infection in their sample at 6 months or 18 months. MAIN OUTCOME MEASURE The prevalence of C trachomatis at 18 months. RESULTS None of the intervention communities met criteria to stop MDA based on the 6-month or 18-month survey; all, as well as the usual care communities, were scheduled for a third MDA round. There was no difference in infection (2.9% vs 4.7%; P = .25) between the usual care and cessation rule communities at 18 months. CONCLUSIONS AND RELEVANCE In this setting, communities with low (10%-20%) initial prevalence of active trachoma did not have MDA stopped before 3 annual rounds on the basis of monitoring for infection. Infection with C trachomatis in communities with average trachoma rates at 12% to 13% cannot be eliminated before 3 rounds of MDA with azithromycin. TRIAL REGISTRATION clinicaltrials.gov Identifier: NCT00792922.
Collapse
|
18
|
The effect of grade on compliance using nonpharmaceutical interventions to reduce influenza in an urban elementary school setting. JOURNAL OF PUBLIC HEALTH MANAGEMENT AND PRACTICE 2013; 17:65-71. [PMID: 21135663 DOI: 10.1097/phh.0b013e3181e83f42] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
OBJECTIVES The Pittsburgh Influenza Prevention Project (PIPP) has previously shown that school-aged children in grades K-5 can learn hygiene-based, nonpharmaceutical interventions (NPIs) and persist in these behaviors over the duration of an influenza season. The purpose of this study was to determine whether age (as estimated by grade) plays any role in this ability. METHODS The Pittsburgh Influenza Prevention Project is a prospective, controlled, randomized trial of the effectiveness of a suite of NPIs in 10 elementary schools. The project measured adoption of NPIs by students through surveys of intervention homeroom teachers before, during, and after the influenza season and control home-room teachers after influenza season. RESULTS There were large, statistically significant improvements and persistence over time across all grade levels, in students' concern about influenza and their daily practice of NPIs that promote health behaviors-"wash or sanitize your hands often" and "cover your coughs and sneezes." Nonpharmaceutical interventions characterized as extinguishing unhealthy behaviors, such as "avoid touching your eyes, nose, and mouth" or "home is where you stay when you are sick," showed no reliable improvement. CONCLUSIONS The study provides evidence that elementary school-aged children, across all grades, can understand and implement protective NPIs and maintain these activities throughout influenza season and beyond. Improvements were most prominent when teaching students to engage in health-promoting behaviors. Habitual behaviors (unconscious touching) and changing family behaviors (staying home) seem less susceptible to intervention. These results will be useful to public health policy makers and health care practitioners considering methods of infectious disease prevention in school-based settings.
Collapse
|
19
|
Ivers NM, Halperin IJ, Barnsley J, Grimshaw JM, Shah BR, Tu K, Upshur R, Zwarenstein M. Allocation techniques for balance at baseline in cluster randomized trials: a methodological review. Trials 2012; 13:120. [PMID: 22853820 PMCID: PMC3503622 DOI: 10.1186/1745-6215-13-120] [Citation(s) in RCA: 146] [Impact Index Per Article: 12.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2011] [Accepted: 07/09/2012] [Indexed: 12/30/2022] Open
Abstract
Reviews have repeatedly noted important methodological issues in the conduct and reporting of cluster randomized controlled trials (C-RCTs). These reviews usually focus on whether the intracluster correlation was explicitly considered in the design and analysis of the C-RCT. However, another important aspect requiring special attention in C-RCTs is the risk for imbalance of covariates at baseline. Imbalance of important covariates at baseline decreases statistical power and precision of the results. Imbalance also reduces face validity and credibility of the trial results. The risk of imbalance is elevated in C-RCTs compared to trials randomizing individuals because of the difficulties in recruiting clusters and the nested nature of correlated patient-level data. A variety of restricted randomization methods have been proposed as way to minimize risk of imbalance. However, there is little guidance regarding how to best restrict randomization for any given C-RCT. The advantages and limitations of different allocation techniques, including stratification, matching, minimization, and covariate-constrained randomization are reviewed as they pertain to C-RCTs to provide investigators with guidance for choosing the best allocation technique for their trial.
Collapse
Affiliation(s)
- Noah M Ivers
- Family Practice Health Centre, Women's College Hospital, 76 Grenville Street, Toronto, ON, M5S1B2, Canada.
| | | | | | | | | | | | | | | |
Collapse
|
20
|
Reduction in the incidence of influenza A but not influenza B associated with use of hand sanitizer and cough hygiene in schools: a randomized controlled trial. Pediatr Infect Dis J 2011; 30:921-6. [PMID: 21691245 PMCID: PMC3470868 DOI: 10.1097/inf.0b013e3182218656] [Citation(s) in RCA: 63] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
BACKGROUND Laboratory-based evidence is lacking regarding the efficacy of nonpharmaceutical interventions (NPIs) such as alcohol-based hand sanitizer and respiratory hygiene to reduce the spread of influenza. METHODS The Pittsburgh Influenza Prevention Project was a cluster-randomized trial conducted in 10 elementary schools in Pittsburgh, PA, during the 2007 to 2008 influenza season. Children in 5 intervention schools received training in hand and respiratory hygiene, and were provided and encouraged to use hand sanitizer regularly. Children in 5 schools acted as controls. Children with influenza-like illness were tested for influenza A and B by reverse-transcriptase polymerase chain reaction. RESULTS A total of 3360 children participated in this study. Using reverse-transcriptase polymerase chain reaction, 54 cases of influenza A and 50 cases of influenza B were detected. We found no significant effect of the intervention on the primary study outcome of all laboratory-confirmed influenza cases (incidence rate ratio [IRR]: 0.81; 95% confidence interval [CI]: 0.54, 1.23). However, we did find statistically significant differences in protocol-specified ancillary outcomes. Children in intervention schools had significantly fewer laboratory-confirmed influenza A infections than children in control schools, with an adjusted IRR of 0.48 (95% CI: 0.26, 0.87). Total absent episodes were also significantly lower among the intervention group than among the control group; adjusted IRR 0.74 (95% CI: 0.56, 0.97). CONCLUSIONS NPIs (respiratory hygiene education and the regular use of hand sanitizer) did not reduce total laboratory-confirmed influenza. However, the interventions did reduce school total absence episodes by 26% and laboratory-confirmed influenza A infections by 52%. Our results suggest that NPIs can be an important adjunct to influenza vaccination programs to reduce the number of influenza A infections among children.
Collapse
|
21
|
Stare D, Harding-Esch E, Munoz B, Bailey R, Mabey D, Holland M, Gaydos C, West S. Design and baseline data of a randomized trial to evaluate coverage and frequency of mass treatment with azithromycin: the Partnership for Rapid Elimination of Trachoma (PRET) in Tanzania and The Gambia. Ophthalmic Epidemiol 2011; 18:20-9. [PMID: 21275593 DOI: 10.3109/09286586.2010.545500] [Citation(s) in RCA: 68] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
OBJECTIVES Trachoma is the principal cause of infectious blindness. As part of its strategy to eliminate trachoma, the World Health Organization recommends annual mass antibiotic treatment for at least 3 years with an 80% population coverage target. However, to date, ideal population coverage and mass treatment duration have not been determined and further evaluation of treatment recommendations in areas of varying endemicity is warranted. The studies presented here evaluate the impact of coverage level and frequency of mass treatment with single dose azithromycin on trachoma and ocular C. trachomatis infection. METHODS The Partnership for the Rapid Elimination of Trachoma supervises 2 randomized, community-based clinical trials in Tanzania and The Gambia. Although each trial is a stand-alone effort, protocols, data collection, and analytic approaches have been harmonized to permit generalizations. Communities in each site were randomized using a 2X2 factorial design to standard (80%-90.0%) versus high (over 90.0%) treatment coverage; communities were further randomized to annual treatment for 3 years versus a "graduation" rule where evidence indicates an absence of follicular trachoma or infection and annual treatment is halted. RESULTS Average prevalence of follicular trachoma in children age less than 5 years was 32.2% in Tanzania and 5.96% in The Gambia. Randomization appeared to be effective, as prevalence was not statistically different between the arms within each country. CONCLUSIONS There are challenges in harmonizing 2, large trials in Africa. Study outcomes will provide critical data to national trachoma control programs on treatment methodology and resource allocation toward elimination of the disease.
Collapse
Affiliation(s)
- Dianne Stare
- Dana Center for Preventive Ophthalmology, Johns Hopkins University, Baltimore, MD, USA.
| | | | | | | | | | | | | | | |
Collapse
|
22
|
Nietert PJ, Jenkins RG, Nemeth LS, Ornstein SM. An application of a modified constrained randomization process to a practice-based cluster randomized trial to improve colorectal cancer screening. Contemp Clin Trials 2008; 30:129-32. [PMID: 18977314 DOI: 10.1016/j.cct.2008.10.002] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2008] [Revised: 10/13/2008] [Accepted: 10/16/2008] [Indexed: 10/21/2022]
Abstract
BACKGROUND When designing cluster randomized trials, it is important for researchers to be familiar with strategies to achieve valid study designs given limited resources. Constrained randomization is a technique to help ensure balance on pre-specified baseline covariates. METHODS The goal was to develop a randomization scheme that balanced 16 intervention and 16 control practices with respect to 7 factors that may influence improvement in study outcomes during a 4-year cluster randomized trial to improve colorectal cancer screening within a primary care practice-based research network. We used a novel approach that included simulating 30,000 randomization schemes, removing duplicates, identifying which schemes were sufficiently balanced, and randomly selecting one scheme for use in the trial. For a given factor, balance was considered achieved when the frequency of each factor's sub-classifications differed by no more than 1 between intervention and control groups. The population being studied includes approximately 32 primary care practices located in 19 states within the U.S. that care for approximately 56,000 patients at least 50 years old. RESULTS Of 29,782 unique simulated randomization schemes, 116 were determined to be balanced according to pre-specified criteria for all 7 baseline covariates. The final randomization scheme was randomly selected from these 116 acceptable schemes. CONCLUSIONS Using this technique, we were successfully able to find a randomization scheme that allocated 32 primary care practices into intervention and control groups in a way that preserved balance across 7 baseline covariates. This process may be a useful tool for ensuring covariate balance within moderately large cluster randomized trials.
Collapse
Affiliation(s)
- Paul J Nietert
- Department of Biostatistics, Bioinformatics, and Epidemiology, Medical University of South Carolina, Charleston, SC 29425, United States.
| | | | | | | |
Collapse
|
23
|
A cluster-randomized trial of provider-initiated (opt-out) HIV counseling and testing of tuberculosis patients in South Africa. J Acquir Immune Defic Syndr 2008; 48:190-5. [PMID: 18520677 DOI: 10.1097/qai.0b013e3181775926] [Citation(s) in RCA: 36] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
OBJECTIVE To determine whether implementation of provider-initiated human immunodeficiency virus (HIV) counseling would increase the proportion of tuberculosis (TB) patients who received HIV counseling and testing. DESIGN Cluster-randomized trial with clinic as the unit of randomization. SETTING Twenty, medium-sized primary care TB clinics in the Nelson Mandela Metropolitan Municipality, Port Elizabeth, Eastern Cape Province, South Africa. SUBJECTS A total of 754 adults (18 years and older) newly registered as TB patients in the 20 study clinics. INTERVENTION Implementation of provider-initiated HIV counseling and testing. MAIN OUTCOME MEASURES Percentage of TB patients HIV counseled and tested. SECONDARY: Percentage of patients with HIV test positive, and percentage of those who received cotrimoxazole and who were referred for HIV care. RESULTS : A total of 754 adults newly registered as TB patients were enrolled. In clinics randomly assigned to implement provider-initiated HIV counseling and testing, 20.7% (73/352) patients were counseled versus 7.7% (31/402) in the control clinics (P = 0.011), and 20.2% (n = 71) versus 6.5% (n = 26) underwent HIV testing (P = 0.009). Of those patients counseled, 97% in the intervention clinics accepted testing versus 79% in control clinics (P = 0.12). The proportion of patients identified as HIV infected in intervention clinics was 8.5% versus 2.5% in control clinics (P = 0.044). Fewer than 40% of patients with a positive HIV test were prescribed cotrimoxazole or referred for HIV care in either study arm. CONCLUSIONS Provider-initiated HIV counseling significantly increased the proportion of adult TB patients who received HIV counseling and testing, but the magnitude of the effect was small. Additional interventions to optimize HIV testing for TB patients urgently need to be evaluated.
Collapse
|