1
|
Green T, Bosworth HB, Coronado GD, DeBar L, Green BB, Huang SS, Jarvik JG, Mor V, Zatzick D, Weinfurt KP, Check DK. Factors Affecting Post-trial Sustainment or De-implementation of Study Interventions: A Narrative Review. J Gen Intern Med 2024; 39:1029-1036. [PMID: 38216853 PMCID: PMC11074060 DOI: 10.1007/s11606-023-08593-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 12/28/2023] [Indexed: 01/14/2024]
Abstract
In contrast to traditional randomized controlled trials, embedded pragmatic clinical trials (ePCTs) are conducted within healthcare settings with real-world patient populations. ePCTs are intentionally designed to align with health system priorities leveraging existing healthcare system infrastructure and resources to ease intervention implementation and increase the likelihood that effective interventions translate into routine practice following the trial. The NIH Pragmatic Trials Collaboratory, funded by the National Institutes of Health (NIH), supports the conduct of large-scale ePCT Demonstration Projects that address major public health issues within healthcare systems. The Collaboratory has a unique opportunity to draw on the Demonstration Project experiences to generate lessons learned related to ePCTs and the dissemination and implementation of interventions tested in ePCTs. In this article, we use case studies from six completed Demonstration Projects to summarize the Collaboratory's experience with post-trial interpretation of results, and implications for sustainment (or de-implementation) of tested interventions. We highlight three key lessons learned. First, ineffective interventions (i.e., ePCT is null for the primary outcome) may be sustained if they have other measured benefits (e.g., secondary outcome or subgroup) or even perceived benefits (e.g., staff like the intervention). Second, effective interventions-even those solicited by the health system and/or designed with significant health system partner buy-in-may not be sustained if they require significant resources. Third, alignment with policy incentives is essential for achieving sustainment and scale-up of effective interventions. Our experiences point to several recommendations to aid in considering post-trial sustainment or de-implementation of interventions tested in ePCTs: (1) include secondary outcome measures that are salient to health system partners; (2) collect all appropriate data to allow for post hoc analysis of subgroups; (3) collect experience data from clinicians and staff; (4) engage policy-makers before starting the trial.
Collapse
Affiliation(s)
- Terren Green
- Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC, USA
| | - Hayden B Bosworth
- Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC, USA
- Department of Population Health Sciences, Duke University School of Medicine, Duke University, 215 Morris St., Suite 210, Durham, NC, 27708, USA
- Department of Medicine, Duke University School of Medicine, Duke University, Durham, NC, USA
- Center of Innovation to Accelerate Discovery and Practice Transformation, Durham Veterans Affairs Health Care System, Durham, NC, USA
| | | | - Lynn DeBar
- Kaiser Permanente Center for Health Research, Portland, OR, USA
| | - Beverly B Green
- Kaiser Permanente Washington Health Research Institute, Seattle, WA, USA
| | - Susan S Huang
- Irvine School of Medicine, University of California, Irvine, CA, USA
| | - Jeffrey G Jarvik
- Department of Radiology, University of Washington School of Medicine, University of Washington, Seattle, WA, USA
| | - Vincent Mor
- Department of Health Services, Policy, and Practice, School of Public Health, Brown University and Providence Veterans Administration Medical Center, Providence, RI, USA
| | - Douglas Zatzick
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, University of Washington, Seattle, WA, USA
| | - Kevin P Weinfurt
- Duke Clinical Research Institute, Duke University School of Medicine, Durham, NC, USA
- Department of Population Health Sciences, Duke University School of Medicine, Duke University, 215 Morris St., Suite 210, Durham, NC, 27708, USA
| | - Devon K Check
- Department of Population Health Sciences, Duke University School of Medicine, Duke University, 215 Morris St., Suite 210, Durham, NC, 27708, USA.
| |
Collapse
|
2
|
Knutzen T, Bulger E, Iles-Shih M, Hernandez A, Engstrom A, Whiteside L, Birk N, Abu K, Shoyer J, Conde C, Ryan P, Wang J, Russo J, Heagerty P, Palinkas L, Zatzick D. Stepped collaborative care versus American College of Surgeons Committee on Trauma required screening and referral for posttraumatic stress disorder: Clinical trial protocol. Contemp Clin Trials 2024; 136:107380. [PMID: 37952714 PMCID: PMC11025340 DOI: 10.1016/j.cct.2023.107380] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 10/13/2023] [Accepted: 11/03/2023] [Indexed: 11/14/2023]
Abstract
BACKGROUND Each year in the US, approximately 1.5-2.5 million individuals are so severely injured that they require inpatient hospital admissions. The American College of Surgeons Committee on Trauma (College) now requires that trauma centers have in place protocols to identify and refer hospitalized patients at risk injury psychological sequelae. Literature review revealed no investigations that have identified optimal screening, intervention, and referral procedures in the wake of the College requirement. METHODS The single-site pragmatic trial investigation will individually randomize 424 patients (212 intervention and 212 control) to a brief stepped care intervention versus College required mental health screening and referral control conditions. Blinded follow-up interviews at 1-, 3-, 6-, and 12-months post-injury will assess the symptoms of PTSD and related comorbidity for all patients. The emergency department information exchange (EDIE) will be used to capture population-level automated emergency department and inpatient utilization data for the intent-to-treat sample. The investigation aims to test the primary hypotheses that intervention patients will demonstrate significant reductions in PTSD symptoms and emergency department/inpatient utilization when compared to control patients. The study incorporates a Rapid Assessment Procedure-Informed Clinical Ethnography (RAPICE) implementation process assessment. CONCLUSIONS The overarching goal of the investigation is to advance the sustainable delivery of high-quality trauma center mental health screening, intervention, and referral procedures for diverse injury survivors. An end-of-study policy summit will harness pragmatic trial data to inform the capacity for US trauma centers to implement high-quality acute care mental health screening, intervention and referral services for diverse injured patient populations. TRIAL REGISTRATION Clinicaltrials.govNCT05632770.
Collapse
Affiliation(s)
- Tanya Knutzen
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Eileen Bulger
- Department of Surgery, University of Washington School of Medicine, Seattle, USA.
| | - Matt Iles-Shih
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Alexandra Hernandez
- Department of Surgery, University of Washington School of Medicine, Seattle, USA.
| | - Allison Engstrom
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Lauren Whiteside
- Department of Emergency Medicine, University of Washington School of Medicine, Seattle, Washington, USA.
| | - Navneet Birk
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Khadija Abu
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Jake Shoyer
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Cristina Conde
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Paige Ryan
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Jin Wang
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Joan Russo
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Patrick Heagerty
- Department of Biostatistics, University of Washington School of Public Health, Seattle, USA.
| | - Larry Palinkas
- Herbert Wertheim School of Public Health and Longevity Science, University of California, San Diego, USA.
| | - Douglas Zatzick
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| |
Collapse
|
3
|
Zatzick D, Palinkas L, Chambers DA, Whiteside L, Moloney K, Engstrom A, Prater L, Russo J, Wang J, Abu K, Iles-Shih M, Bulger E. Integrating pragmatic and implementation science randomized clinical trial approaches: a PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) analysis. Trials 2023; 24:288. [PMID: 37085877 PMCID: PMC10122352 DOI: 10.1186/s13063-023-07313-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 04/17/2023] [Indexed: 04/23/2023] Open
Abstract
BACKGROUND Over the past two decades, pragmatic and implementation science clinical trial research methods have advanced substantially. Pragmatic and implementation studies have natural areas of overlap, particularly relating to the goal of using clinical trial data to leverage health care system policy changes. Few investigations have addressed pragmatic and implementation science randomized trial methods development while also considering policy impact. METHODS The investigation used the PRagmatic Explanatory Continuum Indicator Summary-2 (PRECIS-2) and PRECIS-2-Provider Strategies (PRECIS-2-PS) tools to evaluate the design of two multisite randomized clinical trials that targeted patient-level effectiveness outcomes, provider-level practice changes and health care system policy. Seven raters received PRECIS-2 training and applied the tools in the coding of the two trials. Descriptive statistics were produced for both trials, and PRECIS-2 wheel diagrams were constructed. Interrater agreement was assessed with the Intraclass Correlation (ICC) and Kappa statistics. The Rapid Assessment Procedure Informed Clinical Ethnography (RAPICE) qualitative approach was applied to understanding integrative themes derived from the PRECIS-2 ratings and an end-of-study policy summit. RESULTS The ICCs for the composite ratings across the patient and provider-focused PRECIS-2 domains ranged from 0.77 to 0.87, and the Kappa values ranged from 0.25 to 0.37, reflecting overall fair-to-good interrater agreement for both trials. All four PRECIS-2 wheels were rated more pragmatic than explanatory, with composite mean and median scores ≥ 4. Across trials, the primary intent-to-treat analysis domain was consistently rated most pragmatic (mean = 5.0, SD = 0), while the follow-up/data collection domain was rated most explanatory (mean range = 3.14-3.43, SD range = 0.49-0.69). RAPICE field notes identified themes related to potential PRECIS-2 training improvements, as well as policy themes related to using trial data to inform US trauma care system practice change; the policy themes were not captured by the PRECIS-2 ratings. CONCLUSIONS The investigation documents that the PRECIS-2 and PRECIS-2-PS can be simultaneously used to feasibly and reliably characterize clinical trials with patient and provider-level targets. The integration of pragmatic and implementation science clinical trial research methods can be furthered by using common metrics such as the PRECIS-2 and PRECIS-2-PS. Future study could focus on clinical trial policy research methods development. TRIAL REGISTRATION DO-SBIS ClinicalTrials.gov NCT00607620. registered on January 29, 2008. TSOS ClinicalTrials.gov NCT02655354, registered on July 27, 2015.
Collapse
Affiliation(s)
- Douglas Zatzick
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA.
| | - Lawrence Palinkas
- Department of Children, Youth, and Families, California School of Social Work, University of Southern, Los Angeles, CA, USA
| | - David A Chambers
- Implementation Science, Division of Cancer Control and Population Sciences, National Cancer Institute, Rockville, MD, USA
| | - Lauren Whiteside
- Department of Emergency Medicine, University of Washington School of Medicine, Seattle, USA
| | - Kathleen Moloney
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA
| | - Allison Engstrom
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA
| | - Laura Prater
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA
| | - Joan Russo
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA
| | - Jin Wang
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA
| | - Khadija Abu
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA
| | - Matt Iles-Shih
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, USA
| | - Eileen Bulger
- Department of Emergency Medicine, University of Washington School of Medicine, Seattle, USA
- Department of Surgery, University of Washington School of Medicine, Seattle, USA
| |
Collapse
|
4
|
Baldwin LM, Katers LA, Sullivan MD, Gordon DB, James A, Tauben DJ, Arbabi S. Lessons from the implementation of a trauma center-based program to support primary care providers in managing opioids and pain after trauma hospitalization. Trauma Surg Acute Care Open 2023; 8:e001038. [PMID: 36844370 PMCID: PMC9944266 DOI: 10.1136/tsaco-2022-001038] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Accepted: 01/07/2023] [Indexed: 02/22/2023] Open
Abstract
Background Decreasing exposure to prescription opioids is critical to lowering risk of opioid misuse, overdose and opioid use disorder. This study reports a secondary analysis of a randomized controlled trial implementing an opioid taper support program directed to primary care providers (PCPs) of patients discharged from a level I trauma center to their homes distant from the center, and shares lessons for trauma centers in supporting these patients. Methods This longitudinal descriptive mixed-methods study uses quantitative/qualitative data from trial intervention arm patients to examine implementation challenges and outcomes: adoption, acceptability, appropriateness, feasibility, fidelity. In the intervention, a physician assistant (PA) contacted patients after discharge to review their discharge instructions and pain management plan, confirm their PCP's identity and encourage PCP follow-up. The PA reached out to the PCP to review the discharge instructions and offer ongoing opioid taper and pain management support. Results The PA reached 32 of 37 patients randomized to the program. Of these 32, 81% discussed topics not targeted by the intervention (eg, social/financial). The PA identified and reached a PCP's office for only 51% of patients. Of these, all PCP offices (100% adoption) received one to four consults (mean 1.9) per patient (fidelity). Few consults were with PCPs (22%); most were with medical assistants (56%) or nurses (22%). The PA reported that it was not routinely clear to patients or PCPs who was responsible for post-trauma care and opioid taper, and what the taper instructions were. Conclusions This level I trauma center successfully implemented a telephonic opioid taper support program during COVID-19 but adapted the program to allow nurses and medical assistants to receive it. This study demonstrates a critical need to improve care transition from hospitalization to home for patients discharged after trauma. Level of evidence Level IV.
Collapse
Affiliation(s)
- Laura-Mae Baldwin
- Department of Family Medicine and the Harborview Injury Prevention & Research Center, University of Washington, Seattle, Washington, USA
| | - Laura A Katers
- Department of Anesthesiology & Pain Medicine, University of Washington, Seattle, Washington, USA
| | - Mark D Sullivan
- Department of Psychiatry & Behavioral Sciences, University of Washington, Seattle, Washington, USA
| | - Debra B Gordon
- Department of Anesthesiology & Pain Medicine, University of Washington, Seattle, Washington, USA
| | - Adrienne James
- Department of Anesthesiology & Pain Medicine, University of Washington, Seattle, Washington, USA
| | - David J Tauben
- Department of Anesthesiology & Pain Medicine, University of Washington, Seattle, Washington, USA,Department of Medicine, University of Washington, Seattle, Washington, USA
| | - Saman Arbabi
- Department of Surgery, University of Washington, Seattle, Washington, USA
| |
Collapse
|
5
|
Bulger E, Johnson P, Parker L, Moloney KE, Roberts MK, Vaziri N, Seo S, Nehra D, Thomas P, Zatzick D. Nationwide Survey of Trauma Center Screening and Intervention Practices for Posttraumatic Stress Disorder, Firearm Violence, Mental Health, and Substance Use Disorders. J Am Coll Surg 2022; 234:274-287. [PMID: 35213489 PMCID: PMC10234338 DOI: 10.1097/xcs.0000000000000064] [Citation(s) in RCA: 30] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
BACKGROUND Posttraumatic stress disorder (PTSD) symptoms, firearm violence events, alcohol and drug use problems, and major depression and suicidal ideation are endemic among patients admitted to US trauma centers. Despite increasing policy importance, the current availability of screening and intervention services for this constellation of conditions in US trauma centers is unknown. STUDY DESIGN Trauma program staff at all Level I and Level II trauma centers in the US. (N = 627) were contacted to complete a survey describing screening and intervention procedures for alcohol and drug use problems, PTSD symptoms, depression and suicidality, and firearm violence. Additional questions asked trauma centers about the delivery of peer interventions and information technology capacity for screening and intervention procedures. RESULTS Fifty-one percent of trauma centers (n = 322) responded to the survey. More than 95% of responding sites endorsed routinely screening and/or intervening for alcohol use problems. Routine services addressing PTSD were less common, with 28% of centers reporting routine screening. More than 50% of sites that screened for PTSD used previously established trauma center alcohol use services. Programmatic screening and intervention for firearm injury sequelae was occurring at 30% of sites. CONCLUSION Alcohol screening and intervention is occurring frequently at US trauma centers and appears to be responsive to American College of Surgeons Committee on Trauma verification requirements. Routine screening and intervention services for PTSD and firearm injury were occurring less frequently. Regular national surveys may be a key element of tracking progress in national mental health and substance use screening, intervention, and referral policy.
Collapse
Affiliation(s)
- Eileen Bulger
- Department of Surgery, University of Washington School of Medicine, Seattle, WA
| | - Peyton Johnson
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA
| | - Lea Parker
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA
- Department of Psychology, Drexel University College of Arts and Sciences, Philadelphia, PA
| | - Kathleen E Moloney
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA
| | - Michelle K Roberts
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA
- Department of Rehabilitation Medicine, University of Washington School of Medicine, Seattle, WA
- Department of Anthropology, University of Kentucky College of Arts and Sciences, Lexington, KY
| | - Natalie Vaziri
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA
| | - Sara Seo
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA
| | - Deepika Nehra
- Department of Surgery, University of Washington School of Medicine, Seattle, WA
| | - Peter Thomas
- Powers Pyles Sutter & Verville PC, Washington, DC
| | - Douglas Zatzick
- Department of Psychiatry and Behavioral Sciences, University of Washington School of Medicine, Seattle, WA
- Harborview Injury Prevention and Research Center, University of Washington School of Medicine, Seattle, WA
| |
Collapse
|
6
|
Stanworth S, Callum J. The Paradox of Choice in Hemostatic Resuscitation: Still More Options Than Evidence, But a Good Start. Transfus Med Rev 2021; 35:71-72. [PMID: 34598875 DOI: 10.1016/j.tmrv.2021.08.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2021] [Accepted: 08/19/2021] [Indexed: 12/15/2022]
Affiliation(s)
- Simon Stanworth
- Transfusion Medicine, NHS Blood and Transplant (NHSBT), Oxford, United Kingdom; Department of Haematology, Oxford University Hospitals NHS Foundation Trust, Oxford, United Kingdom; Radcliffe Department of Medicine, University of Oxford, Oxford, United Kingdom; NIHR Oxford Biomedical Research Centre, Oxford, United Kingdom
| | - Jeannie Callum
- Department of Pathology and Molecular Medicine, Kingston Health Sciences Centre and Queen's University, Kingston, Ontario, Canada; Sunnybrook Research Institute, Toronto, Ontario, Canada.
| |
Collapse
|
7
|
Parry C, Johnston-Fleece M, Johnson MC, Shifreen A, Clauser SB. Patient-Centered Approaches to Transitional Care Research and Implementation: Overview and Insights From Patient-Centered Outcomes Research Institute's Transitional Care Portfolio. Med Care 2021; 59:S330-S335. [PMID: 34228014 PMCID: PMC8263147 DOI: 10.1097/mlr.0000000000001593] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
BACKGROUND This Special Issue, Future Directions in Transitional Care Research, focuses on the approaches used and lessons learned by researchers conducting care transitions studies funded by the Patient-Centered Outcomes Research Institute (PCORI). PCORI's approach to transitional care research augments prior research by encouraging researchers to focus on head-to-head comparisons of interventions, the use of patient-centered outcomes, and the engagement of stakeholders throughout the research process. OBJECTIVES This paper introduces the themes and topics addressed by the articles that follow, which are focused on opportunities and challenges involved in conducting patient-centered clinical comparative effectiveness research in transitional care. It provides an overview of the state of the care transitions field, a description of PCORI's programmatic objectives, highlights of the patient and stakeholder engagement activities that have taken place during the course of these studies, and a brief overview of PCORI's Transitional Care Evidence to Action Network, a learning community designed to foster collaboration between investigators and their research teams and enhance the collective impact of this body of work. CONCLUSIONS The papers in this Special Issue articulate challenges, lessons learned, and new directions for measurement, stakeholder engagement, implementation, and methodological and design approaches that reflect the complexity of transitional care comparative effectiveness research and seek to move the field toward a more holistic understanding of transitional care that integrates social needs and lifespan development into our approaches to improving care transitions.
Collapse
Affiliation(s)
- Carly Parry
- Patient-Centered Outcomes Research Institute, Washington, DC
| | | | | | - Aaron Shifreen
- Patient-Centered Outcomes Research Institute, Washington, DC
| | | |
Collapse
|