Impact of Local Tailoring on Acute Stroke Care in 21 Disparate Emergency Departments: A Prospective Stepped Wedge Type III Hybrid Effectiveness-Implementation Study

BACKGROUND

Faster delivery of tPA (tissue-type plasminogen activator) results in better health outcomes for eligible patients with stroke. Standardization of stroke protocols in emergency departments (EDs) has been difficult, especially in nonstroke centers. We measured the effectiveness of a centrally led implementation strategy with local site tailoring to sustain adherence to an acute stroke protocol to improve door-to-needle (DTN) times across disparate EDs in a multihospital health system.

METHODS

Prospective, type III hybrid effectiveness-implementation cohort study measuring performance at 21 EDs in Utah and Idaho (stroke centers [4]/nonstroke centers [17]) from January 2018 to February 2020 using a nonrandomized stepped-wedge design, monthly repeated site measures and multilevel hierarchical modeling. Each site received the implementation strategies in 1 of 6 steps providing control and intervention data. Co-primary outcomes were percentage of DTN times ≤60 minutes and median DTN time. Secondary outcomes included percentage of door-to-activation of neurological consult times ≤10 minutes and clinical effectiveness outcomes. Results were stratified between stroke and nonstroke centers.

RESULTS

A total of 855 474 ED patient encounters occurred with 5325 code stroke activations (median age, 69 [IQR, 56-79] years; 51.8% female patients]. Percentage of door-to-activation times ≤10 minutes increased from 47.5% to 59.9% (adjusted odds ratio, 1.93 [95% CI, 1.40-2.67]). A total of 615 patients received tPA of ≤3 hours from symptom onset (median age, 71 [IQR, 58-80] years; 49.6% female patients). The percentage of DTN times ≤60 minutes increased from 72.5% to 86.1% (adjusted odds ratio, 3.38, [95% CI, 1.47-7.78]; stroke centers (77.4%-90.0%); nonstroke centers [59.3%-72.1%]). Median DTN time declined from 46 to 38 minutes (adjusted median difference, -9.68 [95% CI, -17.17 to -2.20]; stroke centers [41-35 minutes]; nonstroke centers [55-52 minutes]). No differences were observed in clinical effectiveness outcomes.

CONCLUSIONS

A centrally led implementation strategy with local site tailoring led to faster delivery of tPA across disparate EDs in a multihospital system with no change in clinical effectiveness outcomes including rates of complication. Disparities in performance persisted between stroke and nonstroke centers.

Implementing a Family-Centered Rounds Intervention Using Novel Mentor-Trios

BACKGROUND AND OBJECTIVES

Patient and Family Centered I-PASS (PFC I-PASS) emphasizes family and nurse engagement, health literacy, and structured communication on family-centered rounds organized around the I-PASS framework (Illness severity-Patient summary-Action items-Situational awareness-Synthesis by receiver). We assessed adherence, safety, and experience after implementing PFC I-PASS using a novel "Mentor-Trio" implementation approach with multidisciplinary parent-nurse-physician teams coaching sites.

METHODS

Hybrid Type II effectiveness-implementation study from 2/29/19-3/13/22 with ≥3 months of baseline and 12 months of postimplementation data collection/site across 21 US community and tertiary pediatric teaching hospitals. We conducted rounds observations and surveyed nurses, physicians, and Arabic/Chinese/English/Spanish-speaking patients/parents.

RESULTS

We conducted 4557 rounds observations and received 2285 patient/family, 1240 resident, 819 nurse, and 378 attending surveys. Adherence to all I-PASS components, bedside rounding, written rounds summaries, family and nurse engagement, and plain language improved post-implementation (13.0%-60.8% absolute increase by item), all P < .05. Except for written summary, improvements sustained 12 months post-implementation. Resident-reported harms/1000-resident-days were unchanged overall but decreased in larger hospitals (116.9 to 86.3 to 72.3 pre versus early- versus late-implementation, P = .006), hospitals with greater nurse engagement on rounds (110.6 to 73.3 to 65.3, P < .001), and greater adherence to I-PASS structure (95.3 to 73.6 to 72.3, P < .05). Twelve of 12 measures of staff safety climate improved (eg, "excellent"/"very good" safety grade improved from 80.4% to 86.3% to 88.0%), all P < .05. Patient/family experience and teaching were unchanged.

CONCLUSIONS

Hospitals successfully used Mentor-Trios to implement PFC I-PASS. Family/nurse engagement, safety climate, and harms improved in larger hospitals and hospitals with better nurse engagement and intervention adherence. Patient/family experience and teaching were not affected.

Awakening and Breathing Coordination: A Mixed-Methods Analysis of Determinants of Implementation

Rationale: Routine spontaneous awakening and breathing trial coordination (SAT/SBT) improves outcomes for mechanically ventilated patients, but adherence varies. Understanding barriers to and facilitators of consistent daily use of SAT/SBT (implementation determinants) can guide the development of implementation strategies to increase adherence to these evidence-based interventions. Objectives: We conducted an explanatory, sequential mixed-methods study to measure variation in the routine daily use of SAT/SBT and to identify implementation determinants that might explain variation in SAT/SBT use across 15 intensive care units (ICUs) in urban and rural locations within an integrated, community-based health system. Methods: We described the patient population and measured adherence to daily use of coordinated SAT/SBT from January to June 2021, selecting four sites with varied adherence levels for semistructured field interviews. We conducted key informant interviews with critical care nurses, respiratory therapists, and physicians/advanced practice clinicians (n = 55) from these four sites between October and December 2021 and performed content analysis to identify implementation determinants of SAT/SBT use. Results: The 15 sites had 1,901 ICU admissions receiving invasive mechanical ventilation (IMV) for ⩾24 hours during the measurement period. The mean IMV patient age was 58 years, and the median IMV duration was 5.3 days (interquartile range, 2.5-11.9). Coordinated SAT/SBT adherence (within 2 h) was estimated at 21% systemwide (site range, 9-68%). ICU clinicians were generally familiar with SAT/SBT but varied in their knowledge and beliefs about what constituted an evidence-based SAT/SBT. Clinicians reported that SAT/SBT coordination was difficult in the context of existing ICU workflows, and existing protocols did not explicitly define how coordination should be performed. The lack of an agreed-upon system-level measure for tracking daily use of SAT/SBT led to uncertainty regarding what constituted adherence. The effects of the COVID-19 pandemic increased clinician workloads, impacting performance. Conclusions: Coordinated SAT/SBT adherence varied substantially across 15 ICUs within an integrated, community-based health system. Implementation strategies that address barriers identified by this study, including knowledge deficits, challenges regarding workflow coordination, and the lack of performance measurement, should be tested in future hybrid implementation-effectiveness trials to increase adherence to daily use of coordinated SAT/SBT and minimize harm related to the prolonged use of mechanical ventilation and sedation.

Implementation of coordinated spontaneous awakening and breathing trials using telehealth-enabled, real-time audit and feedback for clinician adherence (TEACH): a type II hybrid effectiveness-implementation cluster-randomized trial

BACKGROUND

Intensive care unit (ICU) patients on mechanical ventilation often require sedation and analgesia to improve comfort and decrease pain. Prolonged sedation and analgesia, however, may increase time on mechanical ventilation, risk for ventilator associated pneumonia, and delirium. Coordinated interruptions in sedation [spontaneous awakening trials (SATs)] and spontaneous breathing trials (SBTs) increase ventilator-free days and improve mortality. Coordination of SATs and SBTs is difficult with substantial implementation barriers due to difficult-to-execute sequencing between nurses and respiratory therapists. Telehealth-enabled remote care has the potential to overcome these barriers and improve coordinated SAT and SBT adherence by enabling proactive high-risk patient monitoring, surveillance, and real-time assistance to frontline ICU teams.

METHODS

The telehealth-enabled, real-time audit and feedback for clinician adherence (TEACH) study will determine whether adding a telehealth augmented real-time audit and feedback to a usual supervisor-led audit and feedback intervention will yield higher coordinated SAT and SBT adherence and more ventilator-free days in mechanically ventilated patients than a usual supervisor-led audit and feedback intervention alone in a type II hybrid effectiveness-implementation cluster-randomized clinical trial in 12 Intermountain Health hospitals with 15 ICUs. In the active comparator control group (six hospitals), the only intervention is the usual supervisor-led audit and feedback implementation. The telehealth-enabled support (TEACH) intervention in six hospitals adds real-time identification of patients eligible for a coordinated SAT and SBT and consultative input from telehealth respiratory therapists, nurses, and physicians to the bedside clinicians to promote adherence including real-time assistance with execution. All intubated and mechanically ventilated patients ≥ 16 years of age are eligible for enrollment except for patients who die on the day of intubation or have preexisting brain death. Based on preliminary power analyses, we plan a 36-month intervention period that includes a 90-day run-in period. Estimated enrollment in the final analysis is up to 9900 mechanically ventilated patients over 33 months.

DISCUSSION

The TEACH study will enhance implementation science by providing insight into how a telehealth intervention augmenting a usual audit and feedback implementation may improve adherence to coordinated SAT and SBT and increase ventilator-free days.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT05141396 , registered 12/02/2021.

Delivery of Lung-protective Ventilation for Acute Respiratory Distress Syndrome: A Hybrid Implementation-Effectiveness Trial

Rationale: Lung-protective ventilation (LPV) improves outcomes for patients with acute respiratory distress syndrome (ARDS), but adherence remains inadequate. Objectives: To measure the process and clinical impacts of implementation of a science-based intervention to improve LPV adherence for patients with ARDS, in part by increased use of clinical decision support (CDS). Methods: We conducted a type III hybrid implementation/effectiveness pilot trial enrolling adult patients with ARDS admitted to three hospitals before and after the launch of a multimodal implementation intervention to increase the use of mechanical ventilation CDS and improve LPV adherence. The primary outcome was patients' percentage of time adherent to low tidal volume (⩽6.5 ml/kg predicted body weight) ventilation (LTVV). Secondary outcomes included adherence to prescribed oxygenation settings, the use of the CDS tool's independent oxygenation and ventilation components, ventilator-free days, and mortality. Analyses employed multivariable regression to compare adjusted pre- versus postintervention outcomes after the exclusion of a postintervention wash-in period. A sensitivity analysis measured process outcomes' level and trend change postintervention using segmented regression. Results: The 446 included patients had a mean age of 60 years, and 43% were female. Demographic and clinical characteristics were similar pre- versus postintervention. The adjusted proportion of adherent time increased postintervention for LTVV (9.2%; 95% confidence interval [CI], 3.8-14.5%) and prescribed oxygenation settings (11.9%; 95% CI, 7.2-16.5%), as did the probability patients spent ⩾90% of ventilated time on LTVV (adjusted odds ratio [aOR] 2.58; 95% CI, 1.64-4.10) and use of ventilation CDS (aOR, 41.3%; 95% CI, 35.9-46.7%) and oxygenation CDS (aOR, 54.3%; 95% CI, 50.9-57.7%). Ventilator-free days (aOR, 1.15; 95% CI, 0.81-1.62) and 28-day mortality (aOR, 0.78; 95% CI, 0.50-1.20) did not change significantly after intervention. Segmented regression analysis supported a causal relationship between the intervention and improved CDS usage but suggested trends before intervention rather than the studied intervention could explain increased LPV adherence after the intervention. Conclusions: In this pilot trial, a multimodal implementation intervention was associated with increased use of ventilator management CDS for patients with ARDS but was not associated with differences in clinical outcomes and may not have independently caused the observed postintervention improvements in LPV adherence. Clinical trial registered with www.clinicaltrials.gov (NCT03984175).

Intervention, individual, and contextual determinants to high adherence to structured family-centered rounds: a national multi-site mixed methods study

Background

Effective communication in transitions between healthcare team members is associated with improved patient safety and experience through a clinically meaningful reduction in serious safety events. Family-centered rounds (FCR) can serve a critical role in interprofessional and patient-family communication. Despite widespread support, FCRs are not utilized consistently in many institutions. Structured FCR approaches may prove beneficial in increasing FCR use but should address organizational challenges. The purpose of this study was to identify intervention, individual, and contextual determinants of high adherence to common elements of structured FCR in pediatric inpatient units during the implementation phase of a large multi-site study implementing a structured FCR approach.

Methods

We performed an explanatory sequential mixed methods study from September 2019 to October 2020 to evaluate the variation in structured FCR adherence across 21 pediatric inpatient units. We analyzed 24 key informant interviews of supervising physician faculty, physician learners, nurses, site administrators, and project leaders at 3 sites using a qualitative content analysis paradigm to investigate site variation in FCR use. We classified implementation determinants based on the Consolidated Framework for Implementation Research.

Results

Provisional measurements of adherence demonstrated considerable variation in structured FCR use across sites at a median time of 5 months into the implementation. Consistent findings across all three sites included generally positive clinician beliefs regarding the use of FCR and structured rounding approaches, benefits to learner self-efficacy, and potential efficiency gains derived through greater rounds standardization, as well as persistent challenges with nurse engagement and interaction on rounds and coordination and use of resources for families with limited English proficiency.

Conclusions

Studies during implementation to identify determinants to high adherence can provide generalizable knowledge regarding implementation determinants that may be difficult to predict prior to implementation, guide adaptation during the implementation, and inform sustainment strategies.

Family, nurse, and physician beliefs on family-centered rounds: A 21-site study

BACKGROUND

Variation exists in family-centered rounds (FCR).

OBJECTIVE

We sought to understand patient/family and clinician FCR beliefs/attitudes and practices to support implementation efforts.

DESIGNS, SETTINGS AND PARTICIPANTS

Patients/families and clinicians at 21 geographically diverse US community/academic pediatric teaching hospitals participated in a prospective cohort dissemination and implementation study.

INTERVENTION

We inquired about rounding beliefs/attitudes, practices, and demographics using a 26-question survey coproduced with family/nurse/attending-physician collaborators, informed by prior research and the Consolidated Framework for Implementation Research.

MAIN OUTCOME AND MEASURES

Out of 2578 individuals, 1647 (64%) responded to the survey; of these, 1313 respondents participated in FCR and were included in analyses (616 patients/families, 243 nurses, 285 resident physicians, and 169 attending physicians). Beliefs/attitudes regarding the importance of FCR elements varied by role, with resident physicians rating the importance of several FCR elements lower than others. For example, on adjusted multivariable analysis, attending physicians (odds ratio [OR] 3.0, 95% confidence interval [95% CI] 1.2-7.8) and nurses (OR 3.1, 95% CI 1.3-7.4) were much more likely than resident physicians to report family participation on rounds as very/extremely important. Clinician support for key FCR elements was higher than self-reported practice (e.g., 88% believed family participation was important on rounds; 68% reported it often/always occurred). In practice, key elements of FCR were reported to often/always occur only 23%-70% of the time.

RESULT

Support for nurse and family participation in FCR is high among clinicians but varies by role. Physicians, particularly resident physicians, endorse several FCR elements as less important than nurses and patients/families. The gap between attitudes and practice and between clinician types suggests that attitudinal, structural, and cultural barriers impede FCR.

Improving Head CT Scan Decisions for Pediatric Minor Head Trauma in General Emergency Departments: A Pragmatic Implementation Study

STUDY OBJECTIVE

To measure the effectiveness of a multimodal strategy, including simultaneous implementation of a clinical decision support system, to sustain adherence to a clinical pathway for care of children with minor head trauma treated in general emergency departments (EDs).

METHODS

Prospective, type III hybrid effectiveness-implementation cohort study with a nonrandomized stepped-wedge design and monthly repeated site measures. The study population included pediatric minor head trauma encounters from July 2018 to December 2020 at 21 urban and rural general ED sites in an integrated health care system. Sites received the intervention in 1 of 2 steps, with each site providing control and intervention observations. Measures included guideline adherence, the computed tomography (CT) scan rate, and 72-hour readmissions with clinically important traumatic brain injury. Analysis was performed using multilevel hierarchical modeling with random intercepts for the site and physician.

RESULTS

During the study, 12,670 pediatric minor head trauma encounters were cared for by 339 clinicians. The implementation of the clinical pathway resulted in higher odds of guideline adherence (adjusted odds ratio 1.12 [95% confidence interval 1.03 to 1.22]) and lower odds of a CT scan (adjusted odds ratio 0.96 [95% confidence interval 0.93 to 0.98]) in intervention versus control months. Absolute risk difference was observed in both guideline adherence (site median: +2.3% improvement) and the CT scan rate (site median: -6.6% reduction). No 72-hour readmissions with confirmed clinically important traumatic brain injury were identified.

CONCLUSION

Implementation of a minor head trauma clinical pathway using a multimodal approach, including a clinical decision support system, led to sustained improvements in adherence and a modest, yet safe, reduction in CT scans among generally low-risk patients in diverse general EDs.

Association of Patient and Family Reports of Hospital Safety Climate With Language Proficiency in the US

IMPORTANCE

Patients with language barriers have a higher risk of experiencing hospital safety events. This study hypothesized that language barriers would be associated with poorer perceptions of hospital safety climate relating to communication openness.

OBJECTIVE

To examine disparities in reported hospital safety climate by language proficiency in a cohort of hospitalized children and their families.

DESIGN, SETTING, AND PARTICIPANTS

This cohort study conducted from April 29, 2019, through March 1, 2020, included pediatric patients and parents or caregivers of hospitalized children at general and subspecialty units at 21 US hospitals. Randomly selected Arabic-, Chinese-, English-, and Spanish-speaking hospitalized patients and families were approached before hospital discharge and were included in the analysis if they provided both language proficiency and health literacy data. Participants self-rated language proficiency via surveys. Limited English proficiency was defined as an answer of anything other than "very well" to the question "how well do you speak English?"

MAIN OUTCOMES AND MEASURES

Primary outcomes were top-box (top most; eg, strongly agree) 5-point Likert scale ratings for 3 Children's Hospital Safety Climate Questionnaire communication openness items: (1) freely speaking up if you see something that may negatively affect care (top-box response: strongly agree), (2) questioning decisions or actions of health care providers (top-box response: strongly agree), and (3) being afraid to ask questions when something does not seem right (top-box response: strongly disagree [reverse-coded item]). Covariates included health literacy and sociodemographic characteristics. Logistic regression was used with generalized estimating equations to control for clustering by site to model associations between openness items and language proficiency, adjusting for health literacy and sociodemographic characteristics.

RESULTS

Of 813 patients, parents, and caregivers who were approached to participate in the study, 608 completed surveys (74.8% response rate). A total of 87.7% (533 of 608) of participants (434 [82.0%] female individuals) completed language proficiency and health literacy items and were included in the analyses; of these, 14.1% (75) had limited English proficiency. Participants with limited English proficiency had lower odds of freely speaking up if they see something that may negatively affect care (adjusted odds ratio [aOR], 0.26; 95% CI, 0.15-0.43), questioning decisions or actions of health care providers (aOR, 0.19; 95% CI, 0.09-0.41), and being unafraid to ask questions when something does not seem right (aOR, 0.44; 95% CI, 0.27-0.71). Individuals with limited health literacy (aOR, 0.66; 95% CI, 0.48-0.91) and a lower level of educational attainment (aOR, 0.59; 95% CI, 0.36-0.95) were also less likely to question decisions or actions.

CONCLUSIONS AND RELEVANCE

This cohort study found that limited English proficiency was associated with lower odds of speaking up, questioning decisions or actions of providers, and being unafraid to ask questions when something does not seem right. This disparity may contribute to higher hospital safety risk for patients with limited English proficiency. Dedicated efforts to improve communication with patients and families with limited English proficiency are necessary to improve hospital safety and reduce disparities.

An alert tool to promote lung protective ventilation for possible acute respiratory distress syndrome

Objective

Computer-aided decision tools may speed recognition of acute respiratory distress syndrome (ARDS) and promote consistent, timely treatment using lung-protective ventilation (LPV). This study evaluated implementation and service (process) outcomes with deployment and use of a clinical decision support (CDS) synchronous alert tool associated with existing computerized ventilator protocols and targeted patients with possible ARDS not receiving LPV.

Materials and Methods

We performed an explanatory mixed methods study from December 2019 to November 2020 to evaluate CDS alert implementation outcomes across 13 intensive care units (ICU) in an integrated healthcare system with >4000 mechanically ventilated patients annually. We utilized quantitative methods to measure service outcomes including CDS alert tool utilization, accuracy, and implementation effectiveness. Attitudes regarding the appropriateness and acceptability of the CDS tool were assessed via an electronic field survey of physicians and advanced practice providers.

Results

Thirty-eight percent of study encounters had at least one episode of LPV nonadherence. Addition of LPV treatment detection logic prevented an estimated 1812 alert messages (41%) over use of disease detection logic alone. Forty-eight percent of alert recommendations were implemented within 2 h. Alert accuracy was estimated at 63% when compared to gold standard ARDS adjudication, with sensitivity of 85% and positive predictive value of 62%. Fifty-seven percent of survey respondents observed one or more benefits associated with the alert.

Conclusion

Introduction of a CDS alert tool based upon ARDS risk factors and integrated with computerized ventilator protocol instructions increased visibility to gaps in LPV use and promoted increased adherence to LPV.

Antithrombotic Therapy for VTE Disease: Second Update of the CHEST Guideline and Expert Panel Report - Executive Summary

BACKGROUND

This is the second update to the 9^th edition of these guidelines. We provide recommendations on 17 PICO (Patients, Interventions, Comparators, Outcomes) questions, four of which have not been addressed previously.

METHODS

We generate strong and weak recommendations based on high, moderate, and low-certainty evidence, using GRADE methodology.

RESULTS

The panel generated 29 guidance statements, 13 of which are graded as strong recommendations, covering aspects of antithrombotic management of venous thromboembolism from initial management through secondary prevention and risk reduction of post-thrombotic syndrome. Four new guidance statements are added that did not appear in the 9^th edition (2012) or first update (2016). Eight statements have been substantially modified from the first update.

CONCLUSION

New evidence has emerged since 2016 which further informs the standard of care for patients with venous thromboembolism. Substantial uncertainty remains regarding important management questions, particularly in limited disease and special patient populations.

Implementing Family-Centered Rounds in Hospital Pediatric Settings: A Scoping Review

CONTEXT

The American Academy of Pediatrics and Institute for Patient and Family-Centered Care issued a joint policy statement in 2012 recommending family and nurse participation in rounds as a standard practice.

OBJECTIVE

To synthesize available evidence on the state of the implementation of family-centered rounds (FCRs), including identified barriers to stakeholder acceptance and participation in FCRs in pediatric inpatient settings and implementation strategies to increase adherence and related outcomes.

DATA SOURCES

PubMed and Medline and the Cochrane Database of Systematic Reviews.

STUDY SELECTION

Observational and experimental studies from January 2009 to July 2020.

DATA EXTRACTON

Two reviewers independently screened each study to determine eligibility and extract data. Initial evidence quality was evaluated on the basis of study design.

RESULTS

A total of 53 studies were included in the final synthesis. FCRs are increasingly accepted by stakeholders, although participation lags. Structural barriers to nurse and family attendance persist. Limited high-quality evidence exists regarding the effectiveness of FCRs and related implementation strategies in improving patient outcomes. The lack of a clear, consistent definition of the elements that combine for a successful FCR encounter remains a significant barrier to measuring its effect.

CONCLUSIONS

Standardized research methods for improving the quality and comparability of FCR studies are needed to enhance the existing guidelines for FCR use. Structural changes in care delivery may be required to ensure the rounding process remains amenable to the needs of patients and their families.

Recommendations for strengthening the role of embedded researchers to accelerate implementation in health systems: Findings from a state-of-the-art (SOTA) conference workgroup

BACKGROUND

Traditional research approaches do not promote timely implementation of evidence-based innovations (EBIs) to benefit patients. Embedding research within health systems can accelerate EBI implementation by blending rigorous methods with practical considerations in real-world settings. A state-of-the-art (SOTA) conference was convened in February 2019 with five workgroups that addressed five facets of embedded research and its potential to impact healthcare. This article reports on results from the workgroup focused on how embedded research programs can be implemented into heath systems for greatest impact.

METHODS

Based on a pre-conference survey, participants indicating interest in accelerating implementation were invited to participate in the SOTA workgroup. Workgroup participants (N = 26) developed recommendations using consensus-building methods. Ideas were grouped by thematic clusters and voted on to identify top recommendations. A summary was presented to the full SOTA membership. Following the conference, the workgroup facilitators (LJD, CDH, NR) summarized workgroup findings, member-checked with workgroup members, and were used to develop recommendations.

RESULTS

The workgroup developed 12 recommendations to optimize impact of embedded researchers within health systems. The group highlighted the tension between "ROI vs. R01" goals-where health systems focus on achieving return on their investments (ROI) while embedded researchers focus on obtaining research funding (R01). Recommendations are targeted to three key stakeholder groups: researchers, funders, and health systems. Consensus for an ideal foundation to support optimal embedded research is one that (1) maximizes learning; (2) aligns goals across all 3 stakeholders; and (3) implements EBIs in a consistent and timely fashion.

CONCLUSIONS

Four cases illustrate a variety of ways that embedded research can be structured and conducted within systems, by demonstrating key embedded research values to enable collaborations with academic affiliates to generate actionable knowledge and meaningfully accelerate implementation of EBIs to benefit patients.

IMPLICATIONS

Embedded research approaches have potential for transforming health systems and impacting patient health. Accelerating embedded research should be a focused priority for funding agencies to maximize a collective return on investment.

Trends in Abstinence and Retention Associated with a Medication-Assisted Treatment Program for People with Opioid Use Disorders

BACKGROUND

Medication-assisted treatment (MAT) is an evidence-based program for patients with opioid use disorders. Yet, within the state of Utah, MAT had not been widely available, promoted, or adopted within the public sector. Recognizing the potential benefit, a collective impact approach was used to promote social change and increase the use of MAT in the community for treatment of opioid use disorders.

OBJECTIVE

Conduct a retrospective, observational case series study to measure the effect of a community-based, collective impact approach implementing the MAT program to improve the rate of abstinence and retention among individuals identified with an opioid use disorder in three Utah counties.

METHODS

The study was designed and implemented by the Utah Opioid Community Collaborative (OCC) using a collective impact approach, which included broad sector coordination (public-private collaboration), a common agenda, participation in mutually reinforcing activities, continuous communication, consistent measurement of results, and identification of a backbone organization. The MAT intervention program includes use of medications approved by the U.S. Food and Drug Administration in combination with counseling and behavioral therapies delivered within two community sites. Analysis was performed over time to describe the rate of abstinence and retention associated with participation in the MAT program during 2015 through 2017.

RESULTS

Of the 339 identified with risk of an opioid use disorders, 228 enrolled in the MAT Program. At MAT enrollment, average age was 32.6 ± 8.2 years old and 58.0% were female. At 365 days after MAT enrollment, 84% of participants were abstinent from opioid substances and 62% from all illicit substances.

CONCLUSIONS

Use of a collective impact approach provides a successful mobilization framework in Utah for increasing community engagement and expanding patient access to underresourced MAT programs while suggesting a high rate of abstinence from illicit substances at 12 months.

Rapid Implementation of a Complex, Multimodal Technology Response to COVID-19 at an Integrated Community-Based Health Care System

BACKGROUND

The rapid spread of severe acute respiratory syndrome coronavirus-2 or SARS-CoV-2 necessitated a scaled treatment response to the novel coronavirus disease 2019 (COVID-19).

OBJECTIVE

This study aimed to characterize the design and rapid implementation of a complex, multimodal, technology response to COVID-19 led by the Intermountain Healthcare's (Intermountain's) Care Transformation Information Systems (CTIS) organization to build pandemic surge capacity.

METHODS

Intermountain has active community-spread cases of COVID-19 that are increasing. We used the Centers for Disease Control and Prevention Pandemic Intervals Framework (the Framework) to characterize CTIS leadership's multimodal technology response to COVID-19 at Intermountain. We provide results on implementation feasibility and sustainability of health information technology (HIT) interventions as of June 30, 2020, characterize lessons learned and identify persistent barriers to sustained deployment.

RESULTS

We characterize the CTIS organization's multimodal technology response to COVID-19 in five relevant areas of the Framework enabling (1) incident management, (2) surveillance, (3) laboratory testing, (4) community mitigation, and (5) medical care and countermeasures. We are seeing increased use of traditionally slow-to-adopt technologies that create additional surge capacity while sustaining patient safety and care quality. CTIS leadership recognized early that a multimodal technology intervention could enable additional surge capacity for health care delivery systems with a broad geographic and service scope. A statewide central tracking system to coordinate capacity planning and management response is needed. Order interoperability between health care systems remains a barrier to an integrated response.

CONCLUSION

The rate of future pandemics is estimated to increase. The pandemic response of health care systems, like Intermountain, offers a blueprint for the leadership role that HIT organizations can play in mainstream care delivery, enabling a nimbler, virtual health care delivery system that is more responsive to current and future needs.

Multi-factorial barriers and facilitators to high adherence to lung-protective ventilation using a computerized protocol: a mixed methods study

Background

Lung-protective ventilation (LPV) improves outcomes for patients with acute respiratory distress syndrome (ARDS) through the administration of low tidal volumes (≤ 6.5 ml/kg predicted body weight [PBW]) with co-titration of positive end-expiratory pressure and fraction of inspired oxygen. Many patients with ARDS, however, are not managed with LPV. The purpose of this study was to understand the implementation barriers and facilitators to the use of LPV and a computerized LPV clinical decision support (CDS) tool in intensive care units (ICUs) in preparation for a pilot hybrid implementation-effectiveness clinical trial.

Methods

We performed an explanatory sequential mixed methods study from June 2018 to March 2019 to evaluate the variation in LPV adherence across 17 ICUs in an integrated healthcare system with > 4000 mechanically ventilated patients annually. We analyzed 47 key informant interviews of ICU physicians, respiratory therapists (RTs), and nurses in 3 of the ICUs using a qualitative content analysis paradigm to investigate site variation as defined by adherence level (low, medium, high) and to identify barriers and facilitators to LPV and LPV CDS tool use.

Results

Forty-two percent of patients had an initial set tidal volume of ≤ 6.5 ml/kg PBW during the measurement period (site range 21-80%). LPV CDS tool use was 28% (site range 6-91%). This study's main findings revealed multi-factorial facilitators and barriers to use that varied by ICU site adherence level. The primary facilitator was that LPV and the LPV CDS tool could be used on all mechanically ventilated patients. Barriers included a persistent gap between clinician attitudes regarding the use of LPV and actual use, the perceived loss of autonomy associated with using a computerized protocol, the nature of physician-RT interaction in ventilation management, and the lack of clear organization measures of success.

Conclusions

Variation in adherence to LPV persists in ICUs within a healthcare delivery system that was an early adopter of LPV. Potentially promising strategies to increase adherence to LPV and the LPV CDS tool for ARDS patients include initiating low tidal ventilation on all mechanically ventilated patients, establishing and measuring adherence measures, and focused education addressing the physician-RT interaction. These strategies represent a blueprint for a future hybrid implementation-effectiveness trial.

Disparities in Pediatric Epilepsy Remission Are Associated With Race and Ethnicity

OBJECTIVE

The purpose of our study was to assess whether race/ethnicity was associated with seizure remission in pediatric epilepsy.

METHODS

This was a retrospective population-based cohort study of children who were evaluated for new-onset epilepsy in the clinic, emergency department, and/or hospital by a pediatric neurologist in an integrated health care delivery system. Children were between ages 6 months and 15 years at their initial presentation of epilepsy. The cohort, identified through an electronic database, was assembled over 6 years, with no less than 5 years of follow-up. All children were evaluated for race, ethnicity, insurance type, and socioeconomic background. Patient outcome was determined at the conclusion of the study period and categorized according to their epilepsy control as either drug resistant (pharmacoresistant and intractable) or drug responsive (controlled, probable remission, and terminal remission).

RESULTS

In the final cohort of 776 patients, 63% were drug responsive (control or seizure remission). After controlling for confounding socioeconomic and demographic factors, children of Hispanic ethnicity experienced reduced likelihood (hazard) of drug-responsive epilepsy (hazard ratio 0.6, P < .001), and had longer median time to remission (8 years; 95% CI 5.9-9.6 years) compared to white non-Hispanic patients (5.6 years; 95% CI 4.9-6.1 years). Among Hispanic patients, higher health care costs were associated with reduced likelihood of drug responsiveness.

SIGNIFICANCE

We found that Hispanic ethnicity is associated with a reduced likelihood of achieving seizure control and remission. This study suggests that factors associated with the race/ethnicity of patients contributes to their likelihood of achieving seizure freedom.

Is a Patient's Current Address of Record a Reasonable Measure of Neighborhood Deprivation Exposure? A Case for the Use of Point in Time Measures of Residence in Clinical Care

Purpose: Interest is increasing in the use of geocoded patient address data to understand the effects that social determinants of health have on healthcare outcomes. Use of a patient's current address of record is often problematic given population mobility. Intragenerational economic mobility research suggests that patients will reside within neighborhoods with similar relative deprivation over time despite geographic mobility. The purpose of this study was to measure evidence of patient neighborhood deprivation persistence given a change in address of record.

Methods: A retrospective cohort study of patients receiving active care in an integrated delivery system in a high-mobility United States region. Neighborhood deprivation was measured using a block-group level area deprivation index. Neighborhood deprivation persistence was measured as the probability that an individual with an address of record change remained within a neighborhood with a similar deprivation score. Logistic regression was used to conduct multivariate analysis.

Results: Geographic mobility was highest among patients living in the most deprived neighborhoods versus least-deprived (odds ratio 1.75; 95% confidence interval: 1.71–1.79). Seventy-eight percent of all patients with a change of address did so to a neighborhood with a similar deprivation quintile. The probability that a random patient selected from the study had a change of address outside the same or neighboring quintile within a 1-year period ranged from 2% to 13%.

Conclusions: Neighborhood deprivation persistence was high among this population of patients from a high mobility region. A current address of record is a reasonable indicator of patient exposure to neighborhood deprivation within a 1–3-year timeframe that is useful in evaluating healthcare disparities.

Neighborhood Deprivation and Childhood Asthma Outcomes, Accounting for Insurance Coverage

OBJECTIVES

Collecting social determinants data is challenging. We assigned patients a neighborhood-level social determinant measure, the area of deprivation index (ADI), by using census data. We then assessed the association between neighborhood deprivation and asthma hospitalization outcomes and tested the influence of insurance coverage.

METHODS

A retrospective cohort study of children 2 to 17 years old admitted for asthma at 8 hospitals. An administrative database was used to collect patient data, including hospitalization outcomes and neighborhood deprivation status (ADI scores), which were grouped into quintiles (ADI 1, the least deprived neighborhoods; ADI 5, the most deprived neighborhoods). We used multivariable models, adjusting for covariates, to assess the associations and added a neighborhood deprivation status and insurance coverage interaction term.

RESULTS

A total of 2270 children (median age 5 years; 40.6% girls) were admitted for asthma. We noted that higher ADI quintiles were associated with greater length of stay, higher cost, and more asthma readmissions (P < .05 for most quintiles). Having public insurance was independently associated with greater length of stay (β: 1.171; 95% confidence interval [CI]: 1.117-1.228; P < .001), higher cost (β: 1.147; 95% CI: 1.093-1.203; P < .001), and higher readmission odds (odds ratio: 1.81; 95% CI: 1.46-2.24; P < .001). There was a significant deprivation-insurance effect modification, with public insurance associated with worse outcomes and private insurance with better outcomes across ADI quintiles (P < .05 for most combinations).

CONCLUSIONS

Neighborhood-level ADI measure is associated with asthma hospitalization outcomes. However, insurance coverage modifies this relationship and needs to be considered when using the ADI to identify and address health care disparities.

It takes a village: Exploring the impact of social determinants on delivery system outcomes for heart failure patients

BACKGROUND

Local social determinants may act as effect modifiers for the impact of neighborhood material deprivation on patient-level healthcare outcomes. The objective of this study was to understand the mediating effect of local social determinants on neighborhood material deprivation and delivery outcomes in heart failure (HF) patients.

MATERIAL AND METHODS

A retrospective cohort study was conducted using 4737 HF patients receiving inpatient care (n=6065 encounters) from an integrated healthcare delivery system from 2010 to 2014. Outcomes included post-discharge mortality, readmission risk and length of stay. Deprivation was measured using an area deprivation index by address of residence. Effect modifications measured included urban-rural residency and faith identification using generalized linear regression models. Patient-level data was drawn from the delivery system data warehouse.

RESULTS

Faith identification had a significant protective effect on HF patients from deprived areas, lowering 30-day mortality odds by one-third over patients who did not identify with a faith (OR 0.35 95%CI:0.12-0.98;p=0.05). Significant effects persisted at the 90 and 180-day timeframes. In rural areas, lack of faith identification had a multiplicative effect on 30-day mortality for deprived patients (OR 14.0 95%CI:1.47-132.7;p=0.02). No significant effects were noted for other healthcare outcomes.

CONCLUSIONS

The lack of expected association between area deprivation and healthcare outcomes in some communities may be explained by the presence of effect modifiers.

IMPLICATIONS

Understanding existing effect modifiers for area deprivation in local communities that delivery systems serve can inform targeted quality improvement. These factors should also be considered when comparing delivery system performance for reimbursement and in population health management.

A Retrospective Analysis of Precision Medicine Outcomes in Patients With Advanced Cancer Reveals Improved Progression-Free Survival Without Increased Health Care Costs

Purpose:

The advent of genomic diagnostic technologies such as next-generation sequencing has recently enabled the use of genomic information to guide targeted treatment in patients with cancer, an approach known as precision medicine. However, clinical outcomes, including survival and the cost of health care associated with precision cancer medicine, have been challenging to measure and remain largely unreported.

Patients and Methods:

We conducted a matched cohort study of 72 patients with metastatic cancer of diverse subtypes in the setting of a large, integrated health care delivery system. We analyzed the outcomes of 36 patients who received genomic testing and targeted therapy (precision cancer medicine) between July 1, 2013, and January 31, 2015, compared with 36 historical control patients who received standard chemotherapy (n = 29) or best supportive care (n = 7).

Results:

The average progression-free survival was 22.9 weeks for the precision medicine group and 12.0 weeks for the control group (P = .002) with a hazard ratio of 0.47 (95% CI, 0.29 to 0.75) when matching on age, sex, histologic diagnosis, and previous lines of treatment. In a subset analysis of patients who received all care within the Intermountain Healthcare system (n = 44), per patient charges per week were $4,665 in the precision treatment group and $5,000 in the control group (P = .126).

Conclusion:

These findings suggest that precision cancer medicine may improve survival for patients with refractory cancer without increasing health care costs. Although the results of this study warrant further validation, this precision medicine approach may be a viable option for patients with advanced cancer.

Introduction of an Area Deprivation Index Measuring Patient Socioeconomic Status in an Integrated Health System: Implications for Population Health

INTRODUCTION

Intermountain Healthcare is a fully integrated delivery system based in Salt Lake City, Utah. As a learning healthcare system with a mission of performance excellence, it became apparent that population health management and our efforts to move towards shared accountability would require additional patient-centric metrics in order to provide the right care to the right patients at the right time. Several European countries have adopted social deprivation indices in measuring the impact that social determinants can have on health. Such indices provide a geographic, area-based measure of how socioeconomically deprived residents of that area are on average. Intermountain's approach was to identify a proxy measure that did not require front-line data collection and could be standardized for our patient population, leading us to the area deprivation index or ADI. This paper describes the specifications and calculation of an ADI for the state of Utah. Results are presented along with introduction of three use cases demonstrating the potential for application of an ADI in quality improvement in a learning healthcare system.

CASE DESCRIPTION

The Utah ADI shows promise in providing a proxy for patient-reported measures reflecting key socio-economic indicators useful for tailoring patient interventions to improve health care delivery and patient outcomes. Strengths of this approach include a consistent standardized measurement of social determinants, use of more granular block group level measures and a limited data capture burden for front-line teams. While the methodology is generalizable to other communities, results of this index are limited to block groups within the state of Utah and will differ from national calculations or calculations for other states. The use of composite measures to evaluate individual characteristics must also be approached with care. Other limitations with the use of U.S. Census data include use of estimates and missing data.

CONCLUSION

Initial applications in three meaningfully different areas of an integrated health system provide initial evidence of its broad applicability in addressing the impact of social determinants on health. The variation in socio-economic status by quintile also has potential for clinical significance, though more research is needed to link variation in ADI with variation in health outcomes overall and by disease type.

Using Electronic Health Record Data to Identify Prostate Cancer Patients That May Qualify for Active Surveillance

Introduction:

The introduction of the protein-specific antigen (PSA) test in care means that prostate cancer (PCa) is being detected earlier and more frequently. The result of increased screening using PSA, digital rectal examination and awareness of prostate was an increase in the number of men with low risk cancers. Active surveillance has become a viable alternative to immediate treatment with surgery, radiation and other forms of localized treatment. Evidence suggests that there is no significant difference in mortality rates between AS and surgery. In addition, patients may potentially delay other complications associated with surgery, radiation or deprivation therapy.

Methods:

This quality improvement study using a delivery system science framework describes the electronic identification of AS candidates given an evidence-based identification criteria based upon national guidelines and clinical judgement. The study population (n=649) was drawn from health records of all patients who received a prostate biopsy (n=1731) at Intermountain Healthcare from 1/1/2013 to 12/31/2014. Automated and manual abstraction was performed. Receiver operating characteristic (ROC) analysis was used to compare AS-eligible patients to the actual treatment received to identify potential care improvement opportunities.

Among those with complete data, 24.7% of this population (n=160) met “AS-eligible” criteria. 39.1% of the population had not received surgery, radiation or androgen deprivation therapy and were considered as being treated using an AS approach. 9% of AS-eligible patients did not receive AS; 27% of patients who did not meet AS-eligible criteria received AS. Estimated guideline adherence measured using area under the curve was 0.70 (95% CI: 0.66–0.73). Modest variation in criteria parameters for identifying AS-eligible patients did not significantly change estimated adherence levels.

Conclusion:

Implementation of evidence-based criteria for detection of AS candidates is feasible using electronic health record data and provides a reasonable basis for delivery system evaluation of practice patterns and for quality improvement.

Do Pediatric Patients Who Receive Care Across Multiple Health Systems Have Higher Levels of Repeat Testing?

Repetition by clinicians of the same tests for a given patient is common. However, not all repeat tests are necessary for optimal care and can result in unnecessary hardship. Limited evidence suggests that an electronic health record may reduce redundant laboratory testing and imaging by making previous results accessible to physicians. The purpose of this study is to establish a baseline by characterizing repeat testing in a pediatric population and to identify significant risk factors associated with repeated tests, including the impact of using multiple health systems. A population-based retrospective cross-sectional design was used to examine initial and repeat test instances, defined as a second test following an initial test of the same type for the same patient. The study population consisted of 8760 children with 1-25 test claims over a 1-year period. The study setting included all health care service organizations in Minnesota that generated these claims. In all, 17.2% of tests met the definition of repeat test instances, with several risk factors associated with per patient repeat test levels. The incidence of repeat test instances per patient was significantly higher when patients received care from more than 1 health system (adjusted incidence rate ratio 1.4; 95% confidence interval: 1.3-1.5). Repeat test levels are significant in pediatric populations and potentially actionable. Interoperable health information technology may reduce the incidence of repeat test instances in pediatric populations by making prior test results readily accessible. (Population Health Management 2016;19:102-108).

A novel method for detecting inpatient pediatric asthma encounters using administrative data

Multiple methods for detecting asthma encounters are used today in public surveillance, quality reporting, and clinical research. Failure to detect asthma encounters can make it difficult to measure the scope and effectiveness of hospital or community-based interventions important in comparative effectiveness research and accountable care. Given the pairing of asthma with certain respiratory conditions, the objective of this study was to develop and test an asthma detection algorithm with specificity and sensitivity using 2 criteria: (1) principal discharge diagnosis and (2) asthma diagnosis code position. A medical record review was conducted (n=191) as the gold standard for identifying asthma encounters given objective criteria. The study team observed that for certain principal respiratory diagnoses (n=110), the observed odds ratio that encounters were for asthma when asthma was coded in the second or third code position was not significantly different than when asthma was coded as the principal diagnosis, 0.36 (P=0.42) and 0.18 (P=0.14), respectively. In contrast, the observed odds ratio was significantly different when asthma was coded in the fourth or fifth positions (P<.001). This difference remained after adjusting for covariates. Including encounters with asthma in 1 of the 3 first positions increased the detection sensitivity to 0.84 [95% confidence interval (CI): 0.76-0.92] while increasing the false positive rate to 0.19 [95% CI: 0.07-0.31]. Use of the proposed algorithm significantly improved the reporting accuracy [0.83 95%CI:0.76-0.90] over use of (1) the principal diagnosis alone [0.55 95% CI:0.46-0.64] or (2) all encounters with asthma 0.66 [95% CI:0.57-0.75]. Bed days resulting from asthma encounters increased 64% over use of the principal diagnosis alone. Given these findings, an algorithm using certain respiratory principal diagnoses and asthma diagnosis code position can reliably improve asthma encounter detection for population-based health impact measurement.

Does initial length of stay impact 30-day readmission risk in pediatric asthma patients?

OBJECTIVES

Accountable care puts pressure on hospitals to manage care episodes. Initial length of stay (ILOS) and readmission risk are important elements of a care episode and measures of care quality. Understanding the association between these two measures can guide hospital efforts in managing care episodes. This study was designed to explore the association between ILOS and readmission risk in a cohort of pediatric asthma patients.

MATERIALS AND METHODS

The sample cohort (n = 4965) consisted of all asthma patients discharged from Children's Hospitals and Clinics of Minnesota (CHC MN) from January 2008 through August 2012. Asthma discharges included cases with a principal diagnosis of asthma or certain respiratory cases with asthma listed as a secondary diagnosis. Multiple logistic regression was used to test associations, adjusting for covariates.

RESULTS

Adjusting for covariates, we found no significant association between ILOS and readmission (OR: 1.04 [95% CI: 0.98-1.10]). Analyzing ILOS categorically by length of stay, one-day stays did not have a significantly higher readmission risk (OR:1.27 [95% CI: 0.87-1.85]) than two-day stays, which had the lowest observed readmission risk. Risk increased as ILOS exceeded two days but was not significantly different by day. We found no association when comparing the difference in actual versus expected ILOS and readmission risk (shorter than expected OR: 1.13 [95% CI: 0.74-1.71]; longer than expected OR: 0.97 [95% CI: 0.69-1.38]).

CONCLUSIONS

Attempts to prolong ILOS would dramatically increase costs with little impact on readmissions. For example, increasing one-day visits to two-day visits would increase hospital patient days 38% (1870 d) in this cohort while decreasing total readmissions by 3.8% [95% CI: 3.6-4.0%]. Understanding the mechanisms that impact readmissions is essential in evaluating cost-effective approaches to improving patient outcomes and lowering the cost of care.