The Enhancing Quality of Prescribing Practices for Older Veterans Discharged From the Emergency Department (EQUIPPED) Potentially Inappropriate Medication Dashboard: A Suitable Alternative to the In-person Academic Detailing and Standardized Feedback Reports of Traditional EQUIPPED?

Scaling the EQUIPPED medication safety program: Traditional and hub-and-spoke implementation models

BACKGROUND

The EQUIPPED (Enhancing Quality of Prescribing Practices for Older Adults Discharged from the Emergency Department) medication safety program is an evidence-informed quality improvement initiative to reduce potentially inappropriate medications (PIMs) prescribed by Emergency Department (ED) providers to adults aged 65 and older at discharge. We aimed to scale-up this successful program using (1) a traditional implementation model at an ED with a novel electronic medical record and (2) a new hub-and-spoke implementation model at three new EDs within a health system that had previously implemented EQUIPPED (hub). We hypothesized that implementation speed would increase under the hub-and-spoke model without cost to PIM reduction or site engagement.

METHODS

We evaluated the effect of the EQUIPPED program on PIMs for each ED, comparing their 12-month baseline to 12-month post-implementation period prescribing data, number of months to implement EQUIPPED, and facilitators and barriers to implementation.

RESULTS

The proportion of PIMs at all four sites declined significantly from pre- to post-EQUIPPED: at traditional site 1 from 8.9% (8.1-9.6) to 3.6% (3.6-9.6) (p < 0.001); at spread site 1 from 12.2% (11.2-13.2) to 7.1% (6.1-8.1) (p < 0.001); at spread site 2 from 11.3% (10.1-12.6) to 7.9% (6.4-8.8) (p = 0.045); and at spread site 3 from 16.2% (14.9-17.4) to 11.7% (10.3-13.0) (p < 0.001). Time to implement was equivalent at all sites across both models. Interview data, reflecting a wide scope of responsibilities for the champion at the traditional site and a narrow scope at the spoke sites, indicated disproportionate barriers to engagement at the spoke sites.

CONCLUSIONS

EQUIPPED was successfully implemented under both implementation models at four new sites during the COVID-19 pandemic, indicating the feasibility of adapting EQUIPPED to complex, real-world conditions. The hub-and-spoke model offers an effective way to scale-up EQUIPPED though a speed or quality advantage could not be shown.

Clin-STAR corner: Practice changing advances in prescribing for geriatric emergency department patients

Reducing adverse drug events among older adults in heterogeneous and often chaotic emergency department (ED) settings requires a multidisciplinary approach. Recent research evaluates the impact of multicomponent protocols designed to reduce ED physician prescribing of potentially inappropriate medications (PIMs), including transdisciplinary training and leveraging electronic health records to provide real-time alternative safer pharmaceuticals while providing personalized feedback to prescribers. Most new research is not randomized trial data. Although this current research does not consistently demonstrate a reduction in the prescribing of PIMs, these studies provide a foundation for emergency medicine healthcare teams, geriatricians, and pharmacists to collaborate with health informatics to continue advancing the frontiers of safer medication prescribing during episodes of acute care.

Use of a Medication Safety Audit and Feedback Tool in the Emergency Department Is Affected by Prescribing Characteristics

BACKGROUND

The Enhancing Quality of Prescribing Practices for Older Veterans Discharged from the Emergency Department (EQUIPPED) program developed an audit and feedback health information technology (IT) solution with the intent to replace the in-person academic detailing service provided by the program. The EQUIPPED dashboard provides emergency department (ED) providers with a personalized view of their prescribing performance.

OBJECTIVES

Here, we analyze the association between ED provider characteristics and viewership of the EQUIPPED dashboard, adding insight into strategies for addressing barriers to initial use.

METHODS

We performed a retrospective analysis of EQUIPPED dashboard viewership among four Veterans Affairs (VA) EDs. We extracted quantitative data from user interaction logs to determine evidence of dashboard use. Provider characteristics and baseline potentially inappropriate medication (PIM) prescribing rate were extracted from the VA's Corporate Data Warehouse. Logistic regression was used to examine the association between dashboard use and provider characteristics.

RESULTS

A total of 82 providers were invited to receive audit and feedback via the EQUIPPED dashboard. Among invited providers, 40 (48.7%) had evidence of at least 1 dashboard view during the 1-year feedback period. Adjusted analyses suggest that providers with a higher baseline PIM prescribing rate were more likely to use the dashboard (odds ratio [OR]: 1.22; 95% confidence interval [CI]: 1.01-1.47). Furthermore, providers at ED site D were more likely to use the dashboard in comparison to the other sites (OR: 9.99; 95% CI: 1.72-58.04) and reportedly had the highest site-level baseline PIM rate.

CONCLUSION

Providers with lower PIM prescribing rates (i.e., <5%) receive communication from an integrated dashboard reminder system that they are "optimal prescribers" which may have discouraged initial attempts to view the dashboard. Site D had the highest baseline PIM rate, but further qualitative investigation is warranted to better understand why site D had the greatest users of the dashboard.

Designing audit and feedback dashboards for dentists to monitor their opioid prescribing

BACKGROUND AND OBJECTIVE

Prescription drug abuse is a major factor leading to drug overdose deaths in the US and dentists are one of the leading prescribers of opioid pain medication. Knowing that Audit & Feedback (A&F) dashboards are an effective tool and are used as quality improvement interventions, we aimed to develop such dashboards personalized for dental providers which could allow them to monitor their own opioid prescribing performance.

METHODS

In this paper we report on the process for designing the A&F dashboards for dentists which were developed by using an iterative human-centered design process. The results obtained from each iteration were used to enrich the information needs analyses, provide function testing, and guide the design decisions of the next iteration.

RESULTS

Engaging dentists in the development and refinement of the dashboards while using the think-aloud protocol for user-testing, provided rapid feedback and identified areas that were confusing and needed either a redesign or additional explanatory content. The final version of dashboards consisted of displaying necessary information through easy to interpret visualizations and interactive features. These included providing access to current national and organizational prescribing guidelines, displaying changes in individual prescribing behavior over time, comparing individual prescribing rate to peer group rate and target rate, displaying procedure specific prescribing, integrating patient reported post-operative dental pain experience and providing navigation and interpretation tips for users. The dashboards were easy to learn and understand for the dentists and were deemed as worth using often in dental practice.

CONCLUSION

Our research was able to demonstrate the creation of useful and usable A&F dashboards using data from electronic dental records and patient surveys, for dentists to effectively monitor their opioid prescribing behavior. Efficacy of the dashboards will be tested in future work.

An Electronic Dashboard to Improve Dosing of Hydroxychloroquine Within the Veterans Health Care System: Time Series Analysis

BACKGROUND

Hydroxychloroquine (HCQ) is commonly used for patients with autoimmune conditions. Long-term use of HCQ can cause retinal toxicity, but this risk can be reduced if high doses are avoided.

OBJECTIVE

We developed and piloted an electronic health record-based dashboard to improve the safe prescribing of HCQ within the Veterans Health Administration (VHA). We observed pilot facilities over a 1-year period to determine whether they were able to improve the proportion of patients receiving inappropriate doses of HCQ.

METHODS

Patients receiving HCQ were identified from the VHA corporate data warehouse. Using PowerBI (Microsoft Corp), we constructed a dashboard to display patient identifiers and the most recent HCQ dose and weight (flagged if ≥5.2 mg/kg/day). Six VHA pilot facilities were enlisted to test the dashboard and invited to participate in monthly webinars. We performed an interrupted time series analysis using synthetic controls to assess changes in the proportion of patients receiving HCQ ≥5.2 mg/kg/day between October 2020 and November 2021.

RESULTS

At the start of the study period, we identified 18,525 total users of HCQ nationwide at 128 facilities in the VHA, including 1365 patients at the 6 pilot facilities. Nationwide, at baseline, 19.8% (3671/18,525) of patients were receiving high doses of HCQ. We observed significant improvements in the proportion of HCQ prescribed at doses ≥5.2 mg/kg/day among pilot facilities after the dashboard was deployed (-0.06; 95% CI -0.08 to -0.04). The difference in the postintervention linear trend for pilot versus synthetic controls was also significant (-0.06; 95% CI -0.08 to -0.05).

CONCLUSIONS

The use of an electronic health record-based dashboard reduced the proportion of patients receiving higher than recommended doses of HCQ and significantly improved performance at 6 VHA facilities. National roll-out of the dashboard will enable further improvements in the safe prescribing of HCQ.

A cluster-randomized trial of two implementation strategies to deliver audit and feedback in the EQUIPPED medication safety program

OBJECTIVES

The Enhancing the Quality of Prescribing Practices for Older Adults Discharged from the Emergency Department (EQUIPPED) medication safety program involves three core components including provider education, clinical decision support, and audit and feedback using the American Geriatrics Society Beers Criteria to determine potentially inappropriate medications (PIMs). This study evaluated implementation of audit and feedback through a centralized informatics-based dashboard compared to academic detailing delivered one on one by an EQUIPPED champion.

METHODS

In a cluster-randomized study (October 2019-September 2021), eight VA emergency department (EDs) implemented either the academic detailing (n = 4) or the dashboard (n = 4) strategy for the audit and feedback component of EQUIPPED. The primary outcome was the monthly proportion of PIMs prescribed to Veterans 65 years or older at ED discharge. Poisson regression was used to evaluate the proportion of PIMs prescribed 6 months prior to EQUIPPED implementation compared to 12 months following implementation.

RESULTS

Eight VA ED sites successfully implemented the EQUIPPED program. During the 6-month baseline period, the academic detailing and dashboard sites had similar PIM prescribing rates of 8.01% for academic detailing versus 8.04% for dashboard (p = 0.90). Comparing 12 months of prescribing data after EQUIPPED implementation, the academic detailing group significantly improved PIM prescribing (7.07%) compared to the dashboard group (8.10%; odds ratio 1.14, 95% confidence interval 1.08-1.22, p ≤ 0.0001). Within the groups, two of the four academic detailing sites demonstrated statistically significant reductions in PIM prescribing. One of the four dashboard sites achieved nearly 50% relative reduction in PIM prescribing.

CONCLUSIONS

Eight VA EDs successfully implemented the core components of the EQUIPPED program amid the unprecedented challenges posed by the COVID-19 pandemic. While the academic detailing approach to EQUIPPED audit and feedback was more effective at the group level to improve safe prescribing for older Veterans discharged from the ED, the trial suggests that dashboard-based audit and feedback is a reasonable strategy in resource-limited settings.

Challenges and opportunities in creating a deprescribing program in the emergency department: A qualitative study

BACKGROUND

As the population of older adults increases, appropriate deprescribing becomes increasingly important for emergency geriatric care. Older adults represent the sickest patients with chronic medical conditions, and they are often exposed to high-risk medications. We need to provide an evidence-based, standardized deprescribing program in the acute care setting, yet the evidence base is lacking and standardized medication programs are needed.

METHODS

We conducted a qualitative study with the goal to understand the perspective of healthcare workers, patients, and caregivers on deprescribing high-risk medications in the context of emergency care practices, provider preferences, and practice variability, along with the facilitators and barriers to an effective deprescribing program in the emergency department (ED). To ensure rich, contextual data, the study utilized two qualitative methods: (1) a focus group with physicians, advanced practice providers, nurses, pharmacists, and geriatricians involved in care of older adults and their prescriptions in the acute care setting; (2) semi-structured interviews with patients and caregivers involved in treatment and emergency care. Transcriptions were coded using thematic content analysis, and the principal investigator (S.L.) and trained research staff categorized each code into themes.

RESULTS

Data collection from a focus group with healthcare workers (n = 8) and semi-structured interviews with patients and caregivers (n = 20) provided evidence of a potentially promising ED medication program, aligned with the vision of comprehensive care of older adults, that can be used to evaluate practices and develop interventions. We identified four themes: (1) Challenges in medication history taking, (2) missed opportunities in identifying high-risk medications, (3) facilitators and barriers to deprescribing recommendations, and (4) how to coordinate deprescribing recommendations.

CONCLUSIONS

Our focus group and semi-structured interviews resulted in a framework for an ED medication program to screen, identify, and deprescribe high-risk medications for older adults and coordinate their care with primary care providers.

Enhancing the quality of prescribing practices for older adults discharged from the emergency department in Rhode Island

BACKGROUND

We sought to examine the effectiveness of the Enhancing the Quality of Prescribing Practices for Older Adults Discharged from the Emergency Department (EQUiPPED) medication safety program in three emergency departments (EDs) within the largest health system in Rhode Island (RI) with funding through a quality incentive payment by a private insurance partner.

METHODS

This study utilized a quasi-experimental interrupted time series design to implement EQUiPPED, a three-prong intervention aimed at reducing potentially inappropriate medication (PIM) prescriptions to 5% or less per month. We included clinicians who prescribed medications to older ED patients during the pre-and post-intervention periods from July 2018 to January 2021. We determined the monthly rate of PIM prescribing among older adults discharged from the ED, according to the American Geriatrics Society Beers Criteria, using Poisson regression.

RESULTS

247 ED clinicians (48% attendings [n = 119], 27% residents [n = 67], 25% advanced practice providers [n = 61]) were included in EQUiPPED, of which 92% prescribed a PIM during the study period. In the pre-implementation period (July 2018-July 2019) the average monthly rate of PIM prescribing was 9.30% (95% CI: 8.82%, 9.78%). In the post-implementation period (October 2019-January 2021) the PIM prescribing rate decreased significantly to 8.62% (95% CI: 8.14%, 9.10%, p < 0.01). During pre-implementation, 1325 of the 14,193 prescribed medications were considered inappropriate, while only 1108 of the 13,213 prescribed medications in post-implementation were considered inappropriate. The greatest reduction was observed among antihistamines, skeletal muscle relaxants, and benzodiazepines.

CONCLUSIONS

EQUiPPED contributed to a modest improvement in PIM prescribing to older adults among clinicians in these RI EDs even in the midst of the COVID-19 pandemic. The quality incentive funding model demonstrates a successful strategy for implementation and, with greater replication, could shape national policy regarding health care delivery and quality of care for older adults.

Developing the VA Geriatric Scholars Programs' Clinical Dashboards Using the PDSA Framework for Quality Improvement

Background  Involving clinician end users in the development process of clinical dashboards is important to ensure that user needs are adequately met prior to releasing the dashboard for use. The challenge with following this approach is that clinician end users can undergo periodic turnover, meaning, the clinicians that played a role in the initial development process may not be the same individuals that use the dashboard in future.

Objectives  Here, we summarize our Plan, Do, Study, Act (PDSA)-guided clinical dashboard development process for the VA Geriatric Scholars Program (GSP) and the value of continuous, iterative development. We summarize dashboard adaptations that resulted from two PDSA cycles of improvement for the potentially inappropriate medication dashboard (PIMD), one of many Geriatric Scholars clinical dashboards. We also present the evaluative performance of the PIMD.

Methods  Evaluation of the PIMD was performed using the system usability scale (SUS) and through review of user interaction logs. Routine end users that were Geriatric Scholars and had evidence of 5 or more dashboard views were invited to complete an electronic form that contained the 10-item SUS.

Results  The proportion of Geriatric Scholars that utilized the PIMD increased for each iterative dashboard version that was produced as a byproduct from feedback (31.0% in 2017 to 60.2% in 2019). The overall usability of the PIMD among routine users was found to be above average (SUS score: 75.2 [95% CI 70.5–79.8]) in comparison to the recommended standard of acceptability (SUS score: 68)

Conclusion  The solicitation of feedback during dashboard orientations led to iterative adaptations of the PIMD that broadened its intended use. The presented PDSA-guided process to clinical dashboard development for the VA GSP can serve as a valuable framework for development teams seeking to produce well-adopted and usable health information technology (IT) innovations.

Maintaining Implementation through Dynamic Adaptations (MIDAS): protocol for a cluster-randomized trial of implementation strategies to optimize and sustain use of evidence-based practices in Veteran Health Administration (VHA) patients

Background

The adoption and sustainment of evidence-based practices (EBPs) is a challenge within many healthcare systems, especially in settings that have already strived but failed to achieve longer-term goals. The Veterans Affairs (VA) Maintaining Implementation through Dynamic Adaptations (MIDAS) Quality Enhancement Research Initiative (QUERI) program was funded as a series of trials to test multi-component implementation strategies to sustain optimal use of three EBPs: (1) a deprescribing approach intended to reduce potentially inappropriate polypharmacy; (2) appropriate dosing and drug selection of direct oral anticoagulants (DOACs); and (3) use of cognitive behavioral therapy as first-line treatment for insomnia before pharmacologic treatment. We describe the design and methods for a harmonized series of cluster-randomized control trials comparing two implementation strategies.

Methods

For each trial, we will recruit 8–12 clinics (24–36 total). All will have access to relevant clinical data to identify patients who may benefit from the target EBP at that clinic and provider. For each trial, clinics will be randomized to one of two implementation strategies to improve the use of the EBPs: (1) individual-level academic detailing (AD) or (2) AD plus the team-based Learn. Engage. Act. Process. (LEAP) quality improvement (QI) learning program. The primary outcomes will be operationalized across the three trials as a patient-level dichotomous response (yes/no) indicating patients with potentially inappropriate medications (PIMs) among those who may benefit from the EBP. This outcome will be computed using month-by-month administrative data. Primary comparison between the two implementation strategies will be analyzed using generalized estimating equations (GEE) with clinic-level monthly (13 to 36 months) percent of PIMs as the dependent variable. Primary comparative endpoint will be at 18 months post-baseline. Each trial will also be analyzed independently.

Discussion

MIDAS QUERI trials will focus on fostering sustained use of EBPs that previously had targeted but incomplete implementation. Our implementation approaches are designed to engage frontline clinicians in a dynamic optimization process that integrates the use of actional clinical data and making incremental changes, designed to be feasible within busy clinical settings.

Trial registration

ClinicalTrials.gov: NCT05065502. Registered October 4, 2021—retrospectively registered.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00297-z.

Balancing Vision With Pragmatism: The Geriatric Emergency Department Guidelines-Realistic Expectations From Emergency Medicine and Geriatric Medicine

BACKGROUND

In 2014, the Geriatric Emergency Department (GED) Guidelines were published and endorsed by four major medical organizations. The multidisciplinary GED Guidelines characterized the complex needs of the older emergency department (ED) patient and current best practices, with the goal of promoting more cost-effective and patient-centered care. The recommendations are extensive and most EDs then and now have neither the resources nor the hospital administrative support to provide this additional service.

DISCUSSION

At the 2021 American Academy of Emergency Medicine's Scientific Assembly, a panel of emergency physicians and geriatricians discussed the GED Guidelines and the current realities of EDs' capacity to provide best practice and guideline-recommended care of GED patients. This article is a synthesis of the panel's presentation and discussion. With the substantial challenges in providing guideline-recommended care in EDs, this article will explore three high-impact GED clinical conditions to highlight guideline recommendations, challenges, and opportunities, and discuss realistically achievable expectations for non-GED-accredited institutions.

CONCLUSIONS

In 2014, the GED Guidelines were published, describing the current best practices for GED patients. Unfortunately, most of the EDs worldwide do not provide the level of service recommended by the GED Guidelines. The GED Guidelines can best be termed aspirational for U.S. EDs at the present time.

Dashboards to reduce inappropriate prescribing of metformin and aspirin: A quality assurance programme in a primary care sentinel network

AIMS

To pilot two dashboards to monitor prescribing of metformin and aspirin according to the National Institute for Health and Care Excellence (NICE) 'Do-Not-Do' recommendations.

METHODS

This quality assurance programme was conducted in twelve general practices of the Oxford-Royal College of General Practitioners (RCGP) Research and Surveillance Centre (RSC) network. We developed dashboards to flag inappropriate prescribing of metformin and aspirin to people with type 2 diabetes mellitus (T2DM). In Phase 1, six practices (Group A) received a dashboard flagging suboptimal metformin prescriptions in people with reduced renal function. The other six practices (Group B) were controls. In Phase 2, Group B were provided a dashboard to flag inappropriate aspirin prescribing and Group A were controls. We used logistic regression to explore associations between dashboard exposure and inappropriate prescribing.

RESULTS

The cohort comprised 5644 individuals (Group A, n = 2656; Group B, n = 2988). Half (51.6%, n = 2991) were prescribed metformin of which 15 (0.5%) were inappropriate (Group A, n = 10; Group B, n = 5). A fifth (17.6%, n = 986) were prescribed aspirin of which 828 (84.0%) were inappropriate. During Phase 1, metformin was stopped in 50% (n = 5) of people in Group A, compared with 20% (n = 1) in the control group (Group B); in Phase 2, the odds ratio of inappropriate aspirin prescribing was significantly lower in practices that received the dashboard versus control (0.44, 95%CI 0.27-0.72).

CONCLUSIONS

It was feasible to use a dashboard to flag inappropriate prescribing. Whilst underpowered to report a change in metformin, we demonstrated a reduction in inappropriate aspirin prescribing.

Early prescribing outcomes after exporting the EQUIPPED medication safety improvement programme

Enhancing quality of prescribing practices for older adults discharged from the Emergency Department (EQUIPPED) aims to reduce the monthly proportion of potentially inappropriate medications (PIMs) prescribed to older adults discharged from the ED to 5% or less. We describe prescribing outcomes at three academic health systems adapting and sequentially implementing the EQUIPPED medication safety programme.

EQUIPPED was adapted from a model developed in the Veterans Health Administration (VA) and sequentially implemented in one academic health system per year over a 3-year period. The monthly proportion of PIMs, as defined by the 2015 American Geriatrics Beers Criteria, of all medications prescribed to adults aged 65 years and older at discharge was assessed for 6 months preimplementation until 12 months postimplementation using a generalised linear time series model with a Poisson distribution.

The EQUIPPED programme was translated from the VA health system and its electronic medical record into three health systems each using a version of the Epic electronic medical record. Adaptation occurred through local modification of order sets and in the generation and delivery of provider prescribing reports by local champions. Baseline monthly PIM proportions 6 months prior to implementation at the three sites were 5.6% (95% CI 5.0% to 6.3%), 5.8% (95% CI 5.0% to 6.6%) and 7.3% (95% CI 6.4% to 9.2%), respectively. Evaluation of monthly prescribing including the twelve months post-EQUIPPED implementation demonstrated significant reduction in PIMs at one of the three sites. In exploratory analyses, the proportion of benzodiazepine prescriptions decreased across all sites from approximately 17% of PIMs at baseline to 9.5%–12% postimplementation, although not all reached statistical significance.

EQUIPPED is feasible to implement outside the VA system. While the impact of the EQUIPPED model may vary across different health systems, results from this initial translation suggest significant reduction in specific high-risk drug classes may be an appropriate target for improvement at sites with relatively low baseline PIM prescribing rates.