Impact of large scale, multicomponent intervention to reduce proton pump inhibitor overuse in integrated healthcare system: difference-in-difference study

OBJECTIVE

To determine how a large scale, multicomponent, pharmacy based intervention to reduce proton pump inhibitor (PPI) overuse affected prescribing patterns, healthcare utilization, and clinical outcomes.

DESIGN

Difference-in-difference study.

SETTING

US Veterans Affairs Healthcare System, in which one regional network implemented the overuse intervention and all 17 others served as controls.

PARTICIPANTS

All individuals receiving primary care from 2009 to 2019.

INTERVENTION

Limits on PPI refills for patients without a documented indication for long term use, voiding of PPI prescriptions not recently filled, facilitated electronic prescribing of H2 receptor antagonists, and education for patients and clinicians.

MAIN OUTCOME MEASURES

The primary outcome was the percentage of patients who filled a PPI prescription per 6 months. Secondary outcomes included percentage of days PPI gastroprotection was prescribed in patients at high risk for upper gastrointestinal bleeding, percentage of patients who filled either a PPI or H2 receptor antagonist prescription, hospital admission for acid peptic disease in older adults appropriate for PPI gastroprotection, primary care visits for an upper gastrointestinal diagnosis, upper endoscopies, and PPI associated clinical conditions.

RESULTS

The number of patients analyzed per interval ranged from 192 607 to 250 349 in intervention sites and from 3 775 953 to 4 360 868 in control sites, with 26% of patients receiving PPIs before the intervention. The intervention was associated with an absolute reduction of 7.3% (95% confidence interval -7.6% to -7.0%) in patients who filled PPI prescriptions, an absolute reduction of 11.3% (-12.0% to -10.5%) in PPI use among patients appropriate for gastroprotection, and an absolute reduction of 5.72% (-6.08% to -5.36%) in patients who filled a PPI or H2 receptor antagonist prescription. No increases were seen in primary care visits for upper gastrointestinal diagnoses, upper endoscopies, or hospital admissions for acid peptic disease in older patients appropriate for gastroprotection. No clinically significant changes were seen in any PPI associated clinical conditions.

CONCLUSIONS

The multicomponent intervention was associated with reduced PPI use overall but also in patients appropriate for gastroprotection, with minimal evidence of either clinical benefits or harms.

Protocol for a pragmatic trial testing a self-directed lifestyle program targeting weight loss among patients with obstructive sleep apnea (POWER Trial)

BACKGROUND

Obesity comprises the single greatest reversible risk factor for obstructive sleep apnea (OSA). Despite the potential of lifestyle-based weight loss services to improve OSA severity and symptoms, these programs have limited reach. POWER is a pragmatic trial of a remote self-directed weight loss care among patients with OSA.

METHODS

POWER randomizes 696 patients with obesity (BMI 30-45 kg/m2) and recent diagnosis or re-confirmation of OSA 1:1 to either a self-directed weight loss intervention or usual care. POWER tests whether such an intervention improves co-primary outcomes of weight and sleep-related quality of life at 12 months. Secondary outcomes include sleep symptoms, global ratings of change, and cardiovascular risk scores. Finally, consistent with a hybrid type 1 approach, the trial embeds an implementation process evaluation. We will use quantitative and qualitative methods including budget impact analyses and qualitative interviews to assess barriers to implementation.

CONCLUSIONS

The results of POWER will inform population health approaches to the delivery of weight loss care. A remote self-directed program has the potential to be disseminated widely with limited health system resources and likely low-cost.

Bridging language barriers in developing valid health policy research tools: insights from the translation and validation process of the SHEMESH questionnaire

BACKGROUND

The use of research tools developed and validated in one cultural and linguistic context to another often faces challenges. One major challenge is poor performance of the tool in the new context. This potentially impact the legitimacy of health policy research conducted with informal adaptations of existing tools which have not been subjected to formal validation. Best practices exist to guide researchers in adapting and validating research tools effectively. We present here, as an extended example, our validation of the SHEMESH questionnaire ('Organizational Readiness to Change Assessment'; In Hebrew: 'SHE'elon Muchanut Ergunit le'SHinuy'), a Hebrew-language version of the Organizational Readiness to Change Assessment (ORCA). SHEMESH is tailored to support implementation science projects, whose aim is to promote a more rapid and complete adoption of evidence-based health policies and practices.

METHODS

The SHEMESH included originally eleven questions from the Evidence (item 1-4) and Context (items 5-11) domains. We validated SHEMESH through the following steps: 1. Professional translation to Hebrew and discussion of the translation by multidisciplinary committee; 2. Back-translation into English by a different translator to detect discrepancies; 3. Eleven cognitive interviews with psychiatric emergency department physicians and nurses; and 4. Pilot testing and psychometric analyses, including Cronbach's alpha for subscales and factor analyses.

RESULTS

Following translation and cognitive interviews, SHEMESH was administered to 222 psychiatrists and nurses. Pearson correlation showed significant and strong correlations of items 1-4 to the Evidence construct and items 6-11 to the Context construct. Item 5 did not correlate with the other items, and therefore was removed from the other psychometric procedures and eventually from the SHEMESH. Factor analysis with the remaining 10 items yielded two factors, which together explained a total of 69.7% of variance. Cronbach's Alpha scores for the two subscales were high (Evidence, 0.887, and Context, 0.852).

CONCLUSIONS

This multi-step validation process of the SHEMESH questionnaire may serve as a comprehensive guideline for others who are willing to adapt research tools that were developed in other languages. Practically, SHEMESH has been validated for use in implementation science research projects in Israel.

Full practice authority and burnout among primary care nurse practitioners

BACKGROUND

Full practice authority (FPA) improves clinical autonomy for nurse practitioners (NPs). Autonomy may reduce burnout.

PURPOSE

Estimate the effect of changing from reduced or restricted practice authority to FPA on NP burnout.

METHODS

In this quasi-experimental study, we compared NP burnout before (2016) and after (2018) a Veterans Health Administration (VHA) regulation authorized NP FPA. Burnout proportions were estimated for VHA facilities by aggregating responses to the VHA's All Employee Survey from 1,352 primary care NPs.

DISCUSSION

Seventy-seven percent of facilities changed to FPA postregulation. Burnout was six points lower among NPs in facilities that changed to FPA compared to facilities that had FPA prior to the regulation; however, this association was not statistically significant.

CONCLUSION

NPs are increasingly working under independent practice. While changing to FPA did not reduce NP burnout, this association may vary by health care setting or when burnout is measured for individuals or teams.

Design and methods of a randomized trial testing "Advancing care for COPD in people living with HIV by implementing evidence-based management through proactive E-consults (ACHIEVE)"

Chronic obstructive pulmonary disease (COPD) is one of the most common comorbid diseases among aging people with HIV (PWH) and is often mismanaged. To address this gap, we are conducting the study, "Advancing care for COPD in people living with HIV by Implementing Evidence-based management through proactive E-consults (ACHIEVE)." This intervention optimizes COPD management by promoting effective, evidence-based care and de-implementing inappropriate therapies for COPD in PWH receiving care at Veteran Affairs (VA) medical centers. Study pulmonologists are proactively supporting ID providers managing a population of PWH who have COPD, offering real-time evidence-based recommendations tailored to each patient. We are leveraging VA clinical and informatics infrastructures to communicate recommendations between the study team and clinical providers through the electronic health record (EHR) as an E-consult. If effective, ACHIEVE could serve as a model of effective, efficient COPD management among PWH receiving care in VA. This paper outlines the rationale and methodology of the ACHIEVE trial, one of a series of studies funded by the National Heart, Lung, and Blood Institute (NHLBI) within the ImPlementation REsearCh to DEvelop Interventions for People Living with HIV (PRECluDE) consortium to study chronic disease comorbidities in HIV populations.

Patient Enrollment Growth and Burnout in Primary Care at the Veterans Health Administration

BACKGROUND

Patient enrollment levels at Veterans Health Administration (VHA) facilities change based on Veteran demand for care, potentially affecting demands on staff. Effects on burnout in the primary care workforce associated with increases or decreases in enrollment are unknown.

OBJECTIVE

Estimate associations between patient enrollment and burnout.

DESIGN

In this serial cross-sectional study, VHA patient enrollment and workforce data from 2014 to 2018 were linked to burnout estimates for 138 VHA facilities. The VHA's annual All Employee Survey provided burnout estimates.

PARTICIPANTS

A total of 82,421 responses to the 2014-2018 All Employee Surveys by primary care providers (PCPs), including physicians, nurse practitioners, and physician assistants; nurses; clinical associates; and administrative clerks were included. Respondents identified as patient-aligned care team members.

MAIN MEASURES

Independent variables were (1) the ratio of enrollment to PCPs at VHA facilities and (2) the year-over-year change in enrollment per PCP. Burnout was measured as the annual proportion of staff at VHA facilities who reported emotional exhaustion and/or depersonalization. Each primary care role was analyzed independently.

KEY RESULTS

Overall enrollment decreased from 1553 enrollees per PCP in 2014 to 1442 enrollees per PCP in 2018 across VHA facilities. Forty-three facilities experienced increased enrollment (mean of 1524 enrollees/PCP in 2014 to 1668 in 2018) and 95 facilities experienced decreased enrollment (mean of 1566 enrollees/PCP in 2014 to 1339 in 2018). Burnout decreased for all primary care roles. PCP burnout was highest, decreasing from a facility-level mean of 51.7% in 2014 to 43.8% in 2018. Enrollment was not significantly associated with burnout for any role except nurses, for whom a 1% year-over-year increase in enrollment was associated with a 0.2 percentage point increase in burnout (95% CI: 0.1 to 0.3).

CONCLUSIONS

Studies assessing changes in organizational-level predictors are rare in burnout research. Patient enrollment predicted burnout only among nurses in primary care.

Practice Pattern Variation in Adoption of New and Evolving Percutaneous Coronary Intervention Procedures

Objective

Assess factors contributing to variation in the use of new and evolving diagnostic and interventional procedures for percutaneous coronary intervention (PCI).

Background

Evidence-based practices for PCI have the potential to improve outcomes but are variably adopted. Finding possible drivers of PCI procedure-use variability is key for efforts aimed at establishing more uniform practice.

Methods

Veterans Affairs Clinical Assessment, Reporting, and Tracking Program data were used to estimate a proportion of variation attributable to hospital-, operator-, and patient-level factors across (a) radial arterial access, (b) intravascular imaging/optical coherence tomography, and (c) atherectomy for PCI. We used random-effects models with hospital, operator, and patient random effects. Overlap between levels generated cumulative variability estimates greater than 100%.

Results

A total of 445 operators performed 95,391 PCI procedures across 73 hospitals from 2011 to 2018. The rates of all procedures increased over this time. 24.45% of variability in the use of radial access was attributable to the hospital, 53.04% to the operator, and 57.83% to patient-level characteristics. 9.06% of the variability in intravascular imaging use was attributable to the hospital, 43.92% to the operator, and 21.20% to the patient. Lastly, 20.16% of the variability in use of atherectomy was attributed to the hospital, 34.63% to the operator, and 57.50% to the patient.

Conclusions

The use of radial access, intracoronary imaging, and atherectomy is influenced by patient, operator, and hospital factors, but patient and operator-level effects predominate. Efforts to increase the use of evidence-based practices for PCI should consider interventions at these levels.

Changes in electronic notification volume and primary care provider burnout

OBJECTIVES

Electronic health record (EHR) inbox notifications can be burdensome for primary care providers (PCPs), potentially contributing to burnout. We estimated the association between changes in the quantities of EHR inbox notifications and PCP burnout.

STUDY DESIGN

In this observational study, we tested the association between the percent change in daily inbox notification volumes and PCP burnout after an initiative to reduce low-value notifications at the Veterans Health Administration (VHA).

METHODS

The VHA initiative resulted in increases and decreases in notification volumes for PCPs. For each facility, the proportion of PCPs reporting burnout was estimated using VHA All Employee Survey responses before and after the initiative in 2016 and 2018, respectively. Survey responses were aggregated for 6459 PCPs (physicians, nurse practitioners, and physician assistants) at 138 VHA facilities. Fixed effects regression models estimated the association of small and large increases and small and large decreases in notifications on burnout.

RESULTS

Daily inbox notifications per PCP decreased by a mean (SD) of 5.9% (30.1%) across study facilities, from a mean (SD) of 128 (52) notifications to 114 (44) notifications after the initiative. Fifty-one percent of facilities experienced reductions in notifications, 30% experienced no change, and 20% experienced increased notifications. PCP burnout was not significantly associated with any level of increase or decrease in notifications.

CONCLUSIONS

Changes in notification volumes alone did not predict PCP burnout. Future research to reduce burnout might still address EHR notification volumes, but as part of a broader set of strategies that consider the other stressors that PCPs experience.

Applying the behavior change wheel to design de-implementation strategies to reduce low-value statin prescription in primary prevention of cardiovascular disease in primary care

Introduction

A substantial proportion of individuals with low cardiovascular risk receive inappropriate statin prescription for primary prevention of cardiovascular disease (CVD) instead of the evidence-based recommendations to promote healthy lifestyle behaviors. This study reports on the structured process performed to design targeted de-implementation strategies to reduce inappropriate prescription of statins and to increase healthy lifestyle promotion in low cardiovascular risk patients in Primary Care (PC).

Methods

A formative study was conducted based on the Theoretical Domains Framework and the Behavior Change Wheel (BCW). It comprised semi-structured interviews with PC professionals to define the problem in behavioral terms; focus groups with Family Physicians and patients to identify the determinants (barriers and facilitators) of inappropriate statin prescription and of healthy lifestyle promotion practice; mapping of behavioral change interventions operationalized as de-implementation strategies for addressing identified determinants; and consensus techniques for prioritization of strategies based on perceived effectiveness, feasibility and acceptability.

Results

Identified key determinants of statin prescription and healthy lifestyle promotion were: the lack of time and clinical inertia, external resources, patients' preferences and characteristics, limitation of available clinical tools and guidelines, social pressures, fears about negative consequences of not treating, and lack of skills and training of professionals. Fourteen potential de-implementation strategies were mapped to the identified determinants and the following were prioritized: 1) non-reflective decision assistance strategies based on reminders and decision support tools for helping clinical decision-making; 2) decision information strategies based on the principles of knowledge dissemination (e.g., corporative diffusion of evidence-based Clinical Practice Guidelines and Pathways for CVD primary prevention); 3) reflective decision-making restructuring strategies (i.e., audit and feedback provided along with intention formation interventions).

Conclusions

This study supports the usefulness of the BCW to guide the design and development of de-implementation strategies targeting the determinants of clinicians' decision-making processes to favor the abandonment of low-value practices and the uptake of those recommended for CVD primary prevention in low-risk patients. Further research to evaluate the feasibility and effectiveness of selected strategies is warranted.

Clinical trial registration

Sanchez A. De-implementation of Low-value Pharmacological Prescriptions (De-imFAR). ClinicalTrials.gov, Identifier: NCT04022850. Registered July 17, 2019. In: ClinicalTrials.gov. Bethesda (MD): U.S. National Library of Medicine (NLM). Available from: https://www.clinicaltrials.gov/ct2/show/NCT04022850.

Effect of Implementation Facilitation to Promote Adoption of Medications for Addiction Treatment in US HIV Clinics: A Randomized Clinical Trial

Importance

Medications for addiction treatment (MAT) are inconsistently offered in HIV clinics.

Objective

To evaluate the impact of implementation facilitation (hereafter referred to as "facilitation"), a multicomponent implementation strategy, on increasing provision of MAT for opioid use disorder (MOUD), alcohol use disorder (MAUD), and tobacco use disorder (MTUD).

Design, Setting, and Participants

Conducted from July 26, 2016, through July 25, 2020, the Working with HIV Clinics to adopt Addiction Treatment using Implementation Facilitation (WHAT-IF?) study used an unblinded, stepped wedge design to sequentially assign each of 4 HIV clinics in the northeastern US to cross over from control (ie, baseline practices) to facilitation (ie, intervention) and then evaluation and maintenance periods every 6 months. Participants were adult patients with opioid, alcohol, or tobacco use disorder. Data analysis was performed from August 2020 to September 2022.

Interventions

Multicomponent facilitation.

Main Outcomes and Measures

Outcomes, assessed using electronic health record data, were provision of MAT among patients with opioid, alcohol, or tobacco use disorder during the evaluation (primary outcome) and maintenance periods compared with the control period.

Results

Among 3647 patients, the mean (SD) age was 49 (12) years, 1814 (50%) were Black, 781 (22%) were Hispanic, and 1407 (39%) were female; 121 (3%) had opioid use disorder, 126 (3%) had alcohol use disorder, and 420 (12%) had tobacco use disorder. Compared with the control period, there was no increase in provision of MOUD with facilitation during the evaluation period (243 patients [27%; 95% CI, 22%-32%] vs 135 patients [28%; 95% CI, 22%-35%]; P = .59) or maintenance period (198 patients [29%; 95% CI, 22%-36%]; P = .48). The change in provision of MAUD from the control period to the evaluation period was not statistically significant (251 patients [8%; 95% CI, 5%-12%] vs 112 patients [13%; 95% CI, 8%-21%]; P = .11); however, the difference increased and became significant during the maintenance period (180 patients [17%; 95% CI, 12%-24%]; P = .009). There were significant increases in provision of MTUD with facilitation during both the evaluation (810 patients [33%; 95% CI, 30%-36%] vs 471 patients [40%; 95% CI, 36%-45%]; P = .005) and maintenance (643 patients [38%; 95% CI, 34%-41%]; P = .047) periods.

Conclusions and Relevance

In this randomized clinical trial, facilitation led to increased provision of MTUD, delayed improvements in MAUD, and no improvements in MOUD in HIV clinics. Enhanced strategies, potentially including clinic and patient incentives, especially for MOUD, may be needed to further increase provision of MAT in HIV clinics.

Trial Registration

ClinicalTrials.gov Identifier: NCT02907944.

Development and Feasibility Testing of the Clinical-Community Linkage Self-Assessment Survey for Community Organizations

Introduction

Clinical-community linkages (CCLs) can improve health, but few instruments exist to evaluate these partnerships. To address this gap, we develop and test the Clinical-Community Linkage Self-Assessment Survey (CCL Self-Assessment).

Materials and Methods

We built on an existing framework and conducted a literature review to guide the design of our survey, and obtained feedback from academic, clinical, and community-based experts. To pretest the instrument, we conducted 10 think-aloud interviews with community-based health-promotion organizations. We performed feasibility testing with 38 staff from 20 community organizations, followed by criterion-validity testing.

Results

The 15-item final instrument includes five domains: Nature of the Relationship, Communication, Referral Process, Feedback Loop, and Timeliness. Expert feedback included keeping the CCL Self-Assessment brief and actionable. Think-aloud interviews produced a range of revisions related to item wording, instructions, brevity, and formatting. Feasibility testing showed high response rate and ease of administration. Sites scoring high on the CCL Self-Assessment also scored high on the criterion measure.

Discussion

We demonstrate feasibility, as well as face, content, construct, and criterion validity. Initial results suggest the CCL Self-Assessment survey may be used by community organizations to identify strengths and weaknesses of their linkages. Next steps include additional statistical validation and testing to determine how the CCL Self-Assessment survey works in the field as well as providing specific tools to improve linkages.

Pathways to Employee Outcomes in a Workplace Health Promotion Program

PURPOSE

This study examined the relationship between employee outcomes and employer implementation of evidence-based interventions (EBIs) for chronic disease prevention.

DESIGN

Cross-sectional samples collected at 3 time points in a cluster-randomized, controlled trial of a workplace health promotion program to promote 12 EBIs.

SETTING

King County, WA.

SAMPLE

Employees of 63 small, low-wage workplaces.

MEASURES

Employer EBI implementation; 3 types of employee outcomes: perceived implementation of EBIs; perceived employer support for health; and health-related behaviors, perceived stress, depression risk, and presenteeism.

ANALYSIS

Intent-to-treat and correlation analyses using generalized estimating equations. We tested bivariate associations along potential paths from EBI implementation, through perceived EBI implementation and perceived support for health, to several employee health-related outcomes.

RESULTS

The intent-to-treat analysis found similar employee health-related behaviors in intervention and control workplaces at 15 and 24 months. Workplaces implemented varying combinations of EBIs, however, and bivariate associations were significant for 4 of the 6 indicators of physical activity and healthy eating, as well as perceived stress, depression risk, and presenteeism. We did not find significant positive associations for cancer screening and tobacco cessation.

CONCLUSION

Our findings support broader dissemination of EBIs for physical activity and healthy eating, as well as more focus on improving employer support for employee health. They also suggest we need better interventions for cancer screening and tobacco cessation.

Trends in Arterial Access Site Selection and Bleeding Outcomes Following Coronary Procedures, 2011-2018

BACKGROUND

Prior studies of radial access for cardiac catheterization have focused on early adopters of the technique, and some have described a risk/treatment paradox of low radial access use among high bleeding risk patients. This study aimed to determine (1) trends in radial access use over time, (2) if increasing use of radial access is driven by new invasive and interventional cardiologists (operators) or existing operators changing their practice, and (3) if increasing radial rates are associated with lower bleeding rates and elimination of the risk/treatment paradox.

METHODS

In this cross-sectional study using data from the Clinical Assessment, Reporting, and Tracking Program, we calculated radial access rates and risk-adjusted postprocedural bleeding rates of patients undergoing diagnostic angiography or percutaneous coronary intervention (PCI) between 2011 and 2018 in Veterans Affairs hospitals. We used separate bleeding risk models for diagnostic angiography and PCI and assessed temporal trends with the Kendall Tau-b test.

RESULTS

Among 253 179 diagnostic angiograms and 93 614 PCIs, radial access rates increased over time for both diagnostic (17.5%-60.4%; P<0.01)) and PCI procedures (14.0%-51.8%; P<0.01). Existing operators and new operators increased their use at similar rates, but new operators entered practice with higher baseline rates. Nearly all operators used radial access at least once in 2018. Overall adjusted rates of bleeding declined, a trend that was significant for diagnostic angiography (2.4%-1.4%, P=0.02) but not PCI (3.4%-2.5%, P=0.20). Femoral access patients had a higher predicted risk for bleeding.

CONCLUSIONS

A steady rise in radial access for diagnostic angiography and PCI was driven by increasing use among existing operators and high use by new operators. While this was associated with decreasing bleeding rates, a risk/treatment paradox for access site selection persists; patients at higher bleeding risk were still more likely to receive femoral access.

Identifying and Prioritizing Workplace Climate Predictors of Burnout Among VHA Primary Care Physicians

OBJECTIVE

Burnout, or job-related stress, affects more than half of all US physicians, with primary care physicians (PCPs) experiencing some of the highest rates in medicine. Our study analyzes national survey data to identify and prioritize workplace climate predictors of burnout among PCPs within a large integrated health system.

DESIGN

Observational study of annual survey data from the Veterans Health Administration (VHA) All Employee Survey (AES) for 2013-2017. AES response rate ranged from 56 to 60% during the study period. Independent and dependent variables were measured from separate random samples. In total, 8,456 individual-level responses among PCPs at 110 VHA practice sites were aggregated at the facility level by reporting year. We used the semi-automated LASSO procedure to identify workplace climate measures that were more influential in predicting burnout and assessed relative importance using the Shapely value decomposition.

PARTICIPANTS

VHA employees that self-identify as PCPs.

MAIN MEASURES

Dependent variables included two dichotomous measures of burnout: emotional exhaustion and depersonalization. Independent measures included 30 survey measures related to dimensions of workplace climate (e.g., workload, leadership, satisfaction).

RESULTS

We identified seven influential workplace climate predictors of emotional exhaustion and nine predictors of depersonalization. With few exceptions, higher agreement/satisfaction scores for predictors were associated with a lower likelihood of burnout. The majority of explained variation in emotional exhaustion was attributable to perceptions of workload (32.6%), organization satisfaction (28.2%), and organization support (19.4%). The majority of explained variation in depersonalization was attributable to workload (25.3%), organization satisfaction (22.9%), and connection to VHA mission (20.7%).

CONCLUSION

Identifying the relative importance of workplace climate is important for the allocation of health organization resources to mitigate and prevent burnout within the PCP workplace. In a context of limited resources, efforts to reduce perceived workload and improve organization satisfaction may represent the biggest leverage points for health organizations to address physician burnout.

Cost analysis of a coaching intervention to increase use of transradial percutaneous coronary intervention

BACKGROUND

The transradial approach (TRA) to cardiac catheterization is safer than the traditional transfemoral approach (TFA), with similar clinical effectiveness. However, adoption of TRA remains low, representing less than 50% of catheterization procedures in 2015. Peer coaching is one approach to facilitate implementation; however, the costs of this strategy for cardiac procedures such as TRA are unclear.

METHODS

We conducted an activity-based costing analysis (ABC) of a multi-center, hybrid type III implementation trial of a coaching intervention designed to increase the use of TRA. We identified the key activities of the intervention and determined the personnel, resources, and time needed to complete each activity. The personnel cost per hour and the activity duration were then used to estimate the cost of each activity and the total variable cost of the implementation. Fixed costs related to designing and running the implementation were calculated separately. All costs are reported in 2019 constant US dollars.

RESULTS

The total cost of the coaching intervention implementation was $374,863. Of the total cost, $367,752 were variable costs due to travel, preparatory work, in-person coaching, post-intervention evaluation, and administrative time. We estimated fixed costs of $7112. The mean marginal cost of implementing the intervention at only one additional medical center was $52,536.

CONCLUSIONS

We provide granular cost estimates of a conceptually rooted implementation strategy designed to increase the uptake of TRA for cardiac catheterization. We estimate that implementation costs stemming from the coaching approach would be offset after the conversion of approximately 409 to 1363 catheterizations from TFA to TRA. Our estimates provide benchmarks of the expected costs of implementing evidence-based, but expertise-intensive, cardiac procedures.

TRIAL REGISTRATION

ISRCTN, ISRCTN66341299 . Registered 7 July 2020-retrospectively registered.

Design and baseline results of a coaching intervention for implementation of trans-radial access in percutaneous coronary intervention

Trans-radial artery access (TRA) for cardiac catheterization and percutaneous coronary intervention has many advantages over trans-femoral artery access (TFA), but implementation has been slow. The steep learning curve, logistical issues, and radiation exposure have been documented as barriers to implementation. Although many cardiac catheterization laboratories have overcome these barriers, we lack evidence on effective implementation strategies. Our objective is to test a team-based coaching intervention that targets the learning curve and other barriers to increase use of TRA. We use a stepped-wedge cluster-randomized trial to test a coaching intervention in Department of Veterans Affairs cardiac catheterization laboratories. The coaching intervention comprises team-based didactic instruction with live observation at a TRA-proficient lab, followed by a visit from a cardiologist and catheterization laboratory nurse coaching team. Interview and survey data are collected from participants to test and adapt an implementation science framework known as the Promoting Action on Research Implementation in Health Services (PARIHS) framework. This study is designed to test the effectiveness of the coaching intervention on TRA implementation, inform changes to the coaching intervention itself, and test and adapt the PARIHS framework in practice. While the benefits of TRA, including increased clinical efficiency, patient comfort, and reduced patient complications, are well understood, the underlying drivers of TRA adoption and sustained practice are not. Findings from this trial can inform future research to facilitate change in the cardiac catheterization laboratory.

Factors Associated With Low-Value Cancer Screenings in the Veterans Health Administration

IMPORTANCE

Most clinical practice guidelines recommend stopping cancer screenings when risks exceed benefits, yet low-value screenings persist. The Veterans Health Administration focuses on improving the value and quality of care, using a patient-centered medical home model that may affect cancer screening behavior.

OBJECTIVE

To understand rates and factors associated with outpatient low-value cancer screenings.

DESIGN, SETTING, AND PARTICIPANTS

This cohort study assessed the receipt of low-value cancer screening and associated factors among 5 993 010 veterans. Four measures of low-value cancer screening defined by validated recommendations of practices to avoid were constructed using administrative data. Patients with cancer screenings in 2017 at Veterans Health Administration primary care clinics were included. Excluded patients had recent symptoms or historic high-risk diagnoses that may affect test appropriateness (eg, melena preceding colonoscopy). Data were analyzed from December 23, 2019, to June 21, 2021.

EXPOSURES

Receipt of cancer screening test.

MAIN OUTCOMES AND MEASURES

Low-value screenings were defined as occurring for average-risk patients outside of guideline-recommended ages or if the 1-year mortality risk estimated using a previously validated score was at least 50%. Factors evaluated in multivariable regression models included patient, clinician, and clinic characteristics and patient-centered medical home domain performance for team-based care, access, and continuity previously developed from administrative and survey data.

RESULTS

Of 5 993 010 veterans (mean [SD] age, 63.1 [16.8] years; 5 496 976 men [91.7%]; 1 027 836 non-Hispanic Black [17.2%] and 4 539 341 non-Hispanic White [75.7%] race and ethnicity) enrolled in primary care, 903 612 of 4 647 479 men of average risk (19.4%) underwent prostate cancer screening; 299 765 of 5 770 622 patients of average risk (5.2%) underwent colorectal cancer screening; 21 930 of 469 045 women of average risk (4.7%) underwent breast cancer screening; and 65 511 of 458 086 women of average risk (14.3%) underwent cervical cancer screening. Of patients screened, low-value testing was rare for 3 cancers, with receipt of a low-value test in 633 of 21 930 of women screened for breast cancer (2.9%), 630 of 65 511 of women screened for cervical cancer (1.0%), and 6790 of 299 765 of patients screened for colorectal cancer (2.3%). However, 350 705 of 4 647 479 of screened men (7.5%) received a low-value prostate cancer test. Patient race and ethnicity, sociodemographic factors, and illness burden were significantly associated with likelihood of receipt of low-value tests among screened patients. No single patient-, clinician-, or clinic-level factor explained the receipt of a low-value test across cancer screening cohorts.

CONCLUSIONS AND RELEVANCE

This large cohort study found that low-value breast, cervical, and colorectal cancer screenings were rare in the Veterans Health Administration, but more than one-third of patients screened for prostate cancer were tested outside of clinical practice guidelines. Guideline-discordant care has quality implications and is not consistently explained by associated multilevel factors.

Leveraging implementation science to increase the translation of deprescribing evidence into practice

Implementation science may address some of the limitations that impede the translation of deprescribing recommendations into practice and policy. Application of principles and standard terminologies from implementation science could improve understanding and interpretation of deprescribing research findings. As such, in this commentary we propose three main avenues to help achieve this. These include: The application of these concepts derived from implementation science could help inform future deprescribing needs for clinicians and researchers. Ultimately, this could help ensure the quality use of medications and examination of meaningful outcomes in deprescribing studies. This could result in more consistent and widespread translation of deprescribing evidence into practice and policy across various healthcare settings.

Mapping the organizational readiness to change assessment to the Consolidated Framework for Implementation Research

BACKGROUND

Implementation researchers recognize the influential role of organizational factors and, thus, seek to assess these factors using quantitative measurement instruments. However, researchers are hindered by instruments that measure similar constructs but rely on different nomenclature and/or definitions. The Consolidated Framework for Implementation Research (CFIR) provides a taxonomy of constructs derived from prior frameworks and empirical studies of implementation-related constructs. The CFIR includes constructs based on the original Promoting Action on Research Implementation in Health Services (PARiHS) framework which highlights the key roles of strength of evidence for a specific evidence-based intervention (EBI), favorability of organizational context for change, and capacities to facilitate implementation of the EBI. Although the CFIR is among the most frequently used implementation frameworks, it does not include quantitative measures. The Organizational Resource and Context Assessment (ORCA) is a quantitative measurement instrument that was developed based on PARiHS, assessing its three domains. Factors within these three domains are conceptually similar to constructs in the CFIR but do not match directly. The aim of this work was to map ORCA survey items to CFIR constructs to enable direct comparisons and syntheses of findings across studies using the CFIR and/or ORCA.

METHODS

Two distinct, independent research teams, each used rigorous constant comparative techniques with deliberation and consensus to map individual items from the ORCA to the five domains and 39 constructs of CFIR.

RESULTS

ORCA items were mapped primarily to three of five CFIR domains: Inner Setting, Process, and Intervention Characteristics. The two research teams agreed on 88% of mappings at the higher domain level; at the lower construct level, their mappings aligned for 62.2% of the ORCA items.

CONCLUSIONS

Mapping results reveal that the ORCA focuses measurement prominently on Inner Setting, Process, and Intervention Characteristics. This mapping guide can help improve consistency in measurement and reporting, enabling more efficient comparison and synthesis of findings that use either the ORCA instrument or the CFIR framework. The guide helps advance implementation science utilizing mixed methods by providing CFIR users with quantitative measures for selected constructs and enables ORCA users to map their findings to CFIR constructs.

Implementation of appropriate use criteria for cardiology tests and procedures: a systematic review and meta-analysis

AIMS

The American College of Cardiology appropriate use criteria (AUC) provide clinicians with evidence-informed recommendations for cardiac care. Adopting AUC into clinical workflows may present challenges, and there may be specific implementation strategies that are effective in promoting effective use of AUC. We sought to assess the effect of implementing AUC in clinical practice.

METHODS AND RESULTS

We conducted a meta-analysis of studies found through a systematic search of the MEDLINE, Web of Science, Cochrane, or CINAHL databases. Peer-reviewed manuscripts published after 2005 that reported on the implementation of AUC for a cardiovascular test or procedure were included. The main outcome was to determine if AUC implementation was associated with a reduction in inappropriate/rarely appropriate care. Of the 18 included studies, the majority used pre/post-cohort designs; few (n = 3) were randomized trials. Most studies used multiple strategies (n = 12, 66.7%). Education was the most common individual intervention strategy (n = 13, 72.2%), followed by audit and feedback (n = 8, 44.4%) and computerized physician order entry (n = 6, 33.3%). No studies reported on formal use of stakeholder engagement or 'nudges'. In meta-analysis, AUC implementation was associated with a reduction in inappropriate/rarely appropriate care (odds ratio 0.62, 95% confidence interval 0.49-0.78). Funnel plot suggests the possibility of publication bias.

CONCLUSION

We found most published efforts to implement AUC observed reductions in inappropriate/rarely appropriate care. Studies rarely explored how or why the implementation strategy was effective. Because interventions were infrequently tested in isolation, it is difficult to make observations about their effectiveness as stand-alone strategies.

STUDY REGISTRATION

PROSPERO 2018 CRD42018091602. Available from https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42018091602.

Organizational readiness assessment in acute and long-term care has important implications for antibiotic stewardship for asymptomatic bacteriuria

BACKGROUND

Prior to implementing an antibiotic stewardship intervention for asymptomatic bacteriuria (ASB), we assessed institutional barriers to change using the Organizational Readiness to Change Assessment.

METHODS

Surveys were self-administered on paper in inpatient medicine and long-term care units at 4 Veterans Affairs facilities. Participants included providers, nurses, and pharmacists. The survey included 7 subscales: evidence (perceived strength of evidence) and six context subscales (favorability of organizational context). Responses were scored on a 5-point Likert-type scale.

RESULTS

One hundred four surveys were completed (response rate = 69.3%). Overall, the evidence subscale had the highest score; the resources subscale (mean 2.8) was significantly lower than other subscales (P < .001). Scores for budget and staffing resources were lower than scores for training and facility resources (P < .001 for both). Pharmacists had lower scores than providers for the staff culture subscale (P = .04). The site with the lowest scores for resources (mean 2.4) also had lower scores for leadership and lower pharmacist effort devoted to stewardship.

CONCLUSIONS

Although healthcare professionals endorsed the evidence about nontreatment of ASB, perceived barriers to antibiotic stewardship included inadequate resources and leadership support. These findings provide targets for tailoring the stewardship intervention to maximize success.

Provider anticipation and experience of patient reaction when deprescribing guideline discordant inhaled corticosteroids

Introduction

Despite evidence of possible patient harm and substantial costs, medication overuse is persistent. Patient reaction is one potential barrier to deprescribing, but little research has assessed this in specific instances of medication discontinuation. We sought to understand Veteran and provider experience when de-implementing guideline-discordant use of inhaled corticosteroids (ICS) in those with mild-to-moderate chronic obstructive pulmonary disease (COPD).

Methods

We conducted a mixed-methods analysis in a provider-randomized quality improvement project testing a proactive electronic-consultation from pulmonologists recommending ICS discontinuation when appropriate. PCPs at two Veterans Health Administration healthcare systems were included. We completed interviews with 16 unexposed providers and 6 intervention-exposed providers. We interviewed 9 patients within 3 months after their PCP proposed ICS discontinuation. We conducted inductive and deductive content analysis of qualitative data to explore an emergent theme of patient reaction. Forty-eight PCPs returned surveys (24 exposed and 24 unexposed, response rate: 35%).

Results

The unexposed providers anticipated their patients might resist ICS discontinuation because it seems counterintuitive to stop something that is working, patient’s fear of worsening symptoms, or if the prescription was initiated by another provider. Intervention-exposed providers reported similar experiences in post-intervention interviews. Unexposed providers anticipated that patients may accept ICS discontinuation, citing tactical use of patient-centered care strategies. This was echoed by intervention-exposed providers who had successfully discontinued an ICS. Veterans reported acceding to their providers out of trust or deference to their advanced training, even after describing an ICS as a ‘security blanket’. Our survey findings supported the subthemes from our interviews. Among providers who proposed discontinuation of an ICS, 76% reported that they were able to discontinue it or switch to another more appropriate medication.

Conclusions

While PCPs anticipated that patients would resist discontinuing an ICS, interviews with patient and intervention-exposed PCPs along with surveys suggest that patients were receptive to this change.

Predictors of Improvement in Physical Function in Older Adults in an Evidence-Based Physical Activity Program (EnhanceFitness)

BACKGROUND AND PURPOSE

Declines in strength, flexibility, and balance in older adults can lead to injuries and loss of independence and are particularly common in those of greater age and in worse health. EnhanceFitness (EF) is a nationally disseminated, evidence-based group exercise program for older adults that has been shown to improve function through cardiovascular, strength, flexibility, and balance exercises. This article examines changes in, and predictors of, participant physical function from baseline through 2 program cycles of EF as measured by 3 physical function tests: arm curls, chair stands, and 8-foot up-and-go.

METHODS

We analyzed data on participants who attended at least 2 consecutive 16-week program cycles between January 2005 and June 2016. We ran 3 random-effects linear regression models, 1 for each physical function test, and accounted for missing data and clustering by class site. Independent variables included attendance, demographics, and health status.

RESULTS AND DISCUSSION

A total of 7483 participants completed baseline and 2 sets of follow-up physical function tests. For all 3 physical function tests, participants showed some degree of improved physical function at each follow-up, and greater program attendance predicted clinically significant improvements. Some participants had less improvement: females, those less active at baseline, older than 75 years, not married or partnered, or in fair or poor health, those who had experienced at least 1 fall, and those with a disability.

CONCLUSION

EnhanceFitness program providers may need to implement additional measures to support the participants who could benefit most from EF, such as targeting messaging, coordinating with referring providers to emphasize attendance and general activity in specific participants, and offering additional support to groups who show less improvement during classes. The evidence presented here may inform clinical decision making for older adult patients and increase health care provider confidence in EF and similar exercise programs, thereby providing a mechanism to maintain and continue functional gains made in clinical or rehabilitation settings.

Development of a Wellness Committee Implementation Index for Workplace Health Promotion Programs in Small Businesses

PURPOSE

To construct a wellness committee (WC) implementation index and determine whether this index was associated with evidence-based intervention implementation in a workplace health promotion program.

DESIGN

Secondary data analysis of the HealthLinks randomized controlled trial.

SETTING

Small businesses assigned to the HealthLinks plus WC study arm.

SAMPLE

Small businesses (20-200 employees, n = 23) from 6 low-wage industries in King County, Washington.

MEASURES

Wellness committee implementation index (0%-100%) and evidence-based intervention implementation (0%-100%).

ANALYSIS

We used descriptive and bivariate statistics to describe worksites' organizational characteristics. For the primary analyses, we used generalized estimating equations with robust standard errors to assess the association between WC implementation index and evidence-based intervention implementation over time.

RESULTS

Average WC implementation index scores were 60% at 15 months and 38% at 24 months. Evidence-based intervention scores among worksites with WCs were 27% points higher at 15 months (64% vs 37%, P < .001) and 36% points higher at 24 months (55% vs 18%, P < .001). Higher WC implementation index scores were positively associated with evidence-based intervention implementation scores over time (P < .001).

CONCLUSION

Wellness committees may play an essential role in supporting evidence-based intervention implementation among small businesses. Furthermore, the degree to which these WCs are engaged and have leadership support, a set plan or goals, and multilevel participation may influence evidence-based intervention implementation and maintenance over time.

ImPlementation REsearCh to DEvelop Interventions for People Living with HIV (the PRECluDE consortium): Combatting chronic disease comorbidities in HIV populations through implementation research

Antiretroviral therapy (ART) prevented premature mortality and improved the quality of life among people living with the human immunodeficiency virus (PLWH), such that now more than half of PLWH in the United States are 50 years of age and older. Increased longevity among PLWH has resulted in a significant rise in chronic, comorbid diseases. However, the implementation of guideline-based interventions for preventing, treating, and managing such age-related, chronic conditions among the HIV population is lacking. The PRECluDE consortium supported by the Center for Translation Research and Implementation Science at the National Heart, Lung, and Blood Institute catalyzes implementation research on proven-effective interventions for co-occurring heart, lung, blood, and sleep diseases and conditions among PLWH. These collaborative research studies use novel implementation frameworks with HIV, mental health, cardiovascular, and pulmonary care to advance comprehensive HIV and chronic disease healthcare in a variety of settings and among diverse populations.

Addressing low-value pharmacological prescribing in primary prevention of CVD through a structured evidence-based and theory-informed process for the design and testing of de-implementation strategies: the DE-imFAR study

BACKGROUND

De-implementation or abandonment of ineffective or low-value healthcare is becoming a priority research field globally due to the growing empirical evidence of the high prevalence of such care and its impact in terms of patient safety and social inefficiency. Little is known, however, about the factors, barriers, and facilitators involved or about interventions that are effective in promoting and accelerating the de-implementation of low-value healthcare. The De-imFAR study seeks to carry out a structured, evidence-based, and theory-informed process involving the main stakeholders (clinicians, managers, patients, and researchers) for the design, deployment, and assessment of de-implementation strategies for reducing low-value pharmacological prescribing.

METHODS

A phase I formative study using a systematic and comprehensive framework based on theory and evidence for the design of implementation strategies-specifically, the Behavior Change Wheel (BCW)-will be conducted to design and model de-implementation strategies to favor reductions in low-value pharmacological prescribing of statins in primary prevention of cardiovascular disease (CVD) by main stakeholders (clinicians, managers, patients, and researchers) in a collegiate way. Subsequently, a phase II comparative hybrid trial will be conducted to assess the feasibility and potential effectiveness of at least one active de-implementation strategy to reduce low-value pharmacological prescribing of statins in primary prevention of CVD compared to the usual procedures for dissemination of clinical practice guidelines ("what-not-to-do" recommendations). A mixed-methods evaluation will be used: quantitative for the results of the implementation at the professional level (e.g., adoption, reach and implementation or execution of the recommended clinical practice); and qualitative to determine the feasibility and perceived impact of the de-implementation strategies from the clinicians' perspective, and patients' experiences related to the clinical care received.

DISCUSSION

The DE-imFAR study aims to generate valid scientific knowledge about the design and development of de-implementation strategies using theory- and evidence-based methodologies suggested by implementation science. It will explore the effectiveness of these strategies and their acceptability among clinicians, policymakers, and patients. Its ultimate goal is to maximize the quality and efficiency of our health system by abandoning low-value pharmacological prescribing.

TRIAL REGISTRATION

Clinicaltrials.gov identifier: NCT04022850. Registered 17 July 2019.

De-implementing Inhaled Corticosteroids to Improve Care and Safety in COPD Treatment: Primary Care Providers' Perspectives

BACKGROUND

Chronic obstructive pulmonary disease (COPD) is among the most common medical diagnoses among Veterans. More than 50% of Veterans diagnosed with mild-to-moderate COPD are prescribed inhaled corticosteroids despite recommendations for use restricted to patients with frequent exacerbations.

OBJECTIVE

We explored primary care providers' experiences prescribing inhaled corticosteroids among patients with mild-to-moderate COPD as part of a quality improvement initiative.

DESIGN

We used a sequential mixed-methods evaluation approach to understand factors influencing primary care providers' inhaled corticosteroid prescribing for patients with mild-to-moderate COPD. Participants were recruited to participate in qualitative interviews and structured surveys.

PARTICIPANTS

We used a purposive sample of primary care providers from 13 primary care clinics affiliated with two urban Veteran Health Administration healthcare systems.

MAIN MEASURES

Interviews were transcribed and analyzed using content analysis. Qualitative findings informed a subsequent survey. Surveys were administered through REDCap and analyzed descriptively. Key qualitative and quantitative findings were compared.

KEY RESULTS

Participants reported they were unaware of current evidence and recommendations for prescribing inhaled corticosteroids; for example, 46% of providers reported they were unaware of risks of pneumonia. Providers reported they are generally unable to keep up with the current literature due to the broad scope of primary care practice. We also found primary care providers may be reluctant to change inherited prescriptions, even if they thought inhaled corticosteroid therapy might not be appropriate.

CONCLUSIONS

Inhaled corticosteroid prescribing in this patient population is partly due to primary care providers' lack of knowledge about the potential harms and availability of alternative therapies. Our findings suggest that efforts to expand access by increasing the number of prescribing providers a patient potentially sees could make it more difficult to de-implement harmful prescriptions. Our findings also corroborate prior findings that awareness of current evidence-based guidelines is likely an important part of medical overuse.

Disseminating Evidence-Based Interventions in Small, Low-Wage Worksites: A Randomized Controlled Trial in King County, Washington (2014-2017)

Objectives. To determine whether (1) participating in HealthLinks, and (2) adding wellness committees to HealthLinks increases worksites' evidence-based intervention (EBI) implementation.Methods. We developed HealthLinks to disseminate EBIs to small, low-wage worksites. From 2014 to 2017, we conducted a site-randomized trial in King County, Washington, with 68 small worksites (20-200 employees). We assigned worksites to 1 of 3 arms: HealthLinks, HealthLinks plus wellness committee (HealthLinks+), or delayed control. At baseline, 15 months, and 24 months, we assessed worksites' EBI implementation on a 0% to 100% scale and employees' perceived support for their health behaviors.Results. Postintervention EBI scores in both intervention arms (HealthLinks and HealthLinks+) were significantly higher than in the control arm at 15 months (51%, 51%, and 23%, respectively) and at 24 months (33%, 37%, and 24%, respectively; P < .001). Employees in the intervention arms perceived greater support for their health at 15 and 24 months than did employees in control worksites.Conclusions. HealthLinks is an effective strategy for disseminating EBIs to small worksites in low-wage industries.Public Health Implications. Future research should focus on scaling up HealthLinks, improving EBI maintenance, and measuring impact of these on health behavior.

Cost-related delay in filling prescriptions and health care ratings among medicare advantage recipients

Despite higher health care needs, older adults often have limited and fixed income. Approximately a quarter of them report not filling or delaying prescription medications due to cost (cost-related prescription delay, CRPD). To ascertain the association between CRPD and satisfaction with health care, secondary analysis of the 2012 Consumer Assessment of Healthcare Providers and Systems (CAHPS) Medicare Advantage Survey was performed.Regression models quantified the association between CRPD and rating of personal doctor, specialist, and overall health care. Models were adjusted for demographic, health-related, and socioeconomic characteristics. 274,996 Medicare Advantage enrollees were mailed the CAHPS survey, of which 101,910 (36.8%) returned a survey that had responses to all the items we analyzed. CRPD was assessed by self-report of delay in filling prescriptions due to cost. Health care ratings were on a 0-10 scale. A score ≤ 5 was considered a poor rating of care.In unadjusted models, CRPD more than doubled the relative risk (RR) for poor ratings of personal doctor (RR 2.34), specialist (RR 2.14), and overall health care (RR 2.40). Adjusting for demographics and health status slightly reduced the RRs to 1.9, but adjusting for low-income subsidy and lack of insurance for medications did not make a difference.CRPD is independently associated with poor ratings of medical care, regardless of health, financial or insurance status. Providers might reduce patients' financial stress and improve patient satisfaction by explicitly discussing prescription cost and incorporating patient priorities when recommending treatments.

Promoting Health Equity through De-Implementation Research

Ensuring equitable access to quality health care historically has focused on gaps in care, where patients fail to receive the high-value care that will benefit them, something termed underuse. But providing high-quality health care sometimes requires reducing low-value care that delivers no benefit or where known harms outweigh expected benefits. These situations represent health care overuse. The process involved in reducing low-value care is known as de-implementation. In this article, we argue that de-implementation is critical for advancing equity for several reasons. First, medical overuse is associated with patient race, ethnicity, and socioeconomic status. In some cases, the result is even double jeopardy, where racial and ethnic minorities are at higher risk of both overuse and underuse. In these cases, more traditional efforts focused exclusively on underuse ignore half of the problem. Second, overuse of preventive care and screening is often greater for more socioeconomically advantaged patients. Within insured populations, this means more socioeconomically disadvantaged patients subsidize overuse. Finally, racial and ethnic minorities may have different experiences of overuse than Whites in the United States. This may make efforts to de-implement overuse particularly fraught. We therefore provide several actions for closing current research gaps, including: adding subgroup analyses in studies of medical overuse; specifying and measuring potential mechanisms related to equity (eg, double jeopardy vs thermostat models of overuse); and testing de-implementation strategies that may mitigate bias.

Readiness to Change Over Time: Change Commitment and Change Efficacy in a Workplace Health-Promotion Trial

Introduction

Organizational readiness to change may be a key determinant of implementation success and a mediator of the effectiveness of implementation interventions. If organizational readiness can be reliably and validly assessed at the outset of a change initiative, it could be used to assess the effectiveness of implementation-support activities by measuring changes in readiness factors over time.

Methods

We analyzed two waves of readiness-to-change survey data collected as part of a three-arm, randomized controlled trial to implement evidence-based health promotion practices in small worksites in low-wage industries. We measured five readiness factors: context (favorable broader conditions); change valence (valuing health promotion); information assessment (demands and resources to implement health promotion); change commitment (an intention to implement health promotion); and change efficacy (a belief in shared ability to implement health promotion). We expected commitment and efficacy to increase at intervention sites along with their self-reported effort to implement health promotion practices, termed wellness-program effort. We compared means between baseline and 15 months, and between intervention and control sites. We used linear regression to test whether intervention and control sites differed in their change-readiness scores over time.

Results

Only context and change commitment met reliability thresholds. Change commitment declined significantly for both control (-0.39) and interventions sites (-0.29) from baseline to 15 months, while context did not change for either. Only wellness program effort at 15 months, but not at baseline, differed significantly between control and intervention sites (1.20 controls, 2.02 intervention). Regression analyses resulted in two significant differences between intervention and control sites in changes from baseline to 15 months: (1) intervention sites exhibited significantly smaller change in context scores relative to control sites over time and (2) intervention sites exhibited significantly higher changes in wellness program effort relative to control sites.

Discussion

Contrary to our hypothesis, change commitment declined significantly at both Healthlinks and control sites, even as wellness-program effort increased significantly at HealthLinks sites. Regression to the mean may explain the decline in change commitment. Future research needs to assess whether baseline commitment is an independent predictor of wellness-program effort or an effect modifier of the HealthLinks intervention.

How the dual process model of human cognition can inform efforts to de-implement ineffective and harmful clinical practices: A preliminary model of unlearning and substitution

RATIONALE AND OBJECTIVES

One way to understand medical overuse at the clinician level is in terms of clinical decision-making processes that are normally adaptive but become maladaptive. In psychology, dual process models of cognition propose 2 decision-making processes. Reflective cognition is a conscious process of evaluating options based on some combination of utility, risk, capabilities, and/or social influences. Automatic cognition is a largely unconscious process occurring in response to environmental or emotive cues based on previously learned, ingrained heuristics. De-implementation strategies directed at clinicians may be conceptualized as corresponding to cognition: (1) a process of unlearning based on reflective cognition and (2) a process of substitution based on automatic cognition.

RESULTS

We define unlearning as a process in which clinicians consciously change their knowledge, beliefs, and intentions about an ineffective practice and alter their behaviour accordingly. Unlearning has been described as "the questioning of established knowledge, habits, beliefs and assumptions as a prerequisite to identifying inappropriate or obsolete knowledge underpinning and/or embedded in existing practices and routines." We hypothesize that as an unintended consequence of unlearning strategies clinicians may experience "reactance," ie, feel their professional prerogative is being violated and, consequently, increase their commitment to the ineffective practice. We define substitution as replacing the ineffective practice with one or more alternatives. A substitute is a specific alternative action or decision that either precludes the ineffective practice or makes it less likely to occur. Both approaches may work independently, eg, a substitute could displace an ineffective practice without changing clinicians' knowledge, and unlearning could occur even if no alternative exists. For some clinical practice, unlearning and substitution strategies may be most effectively used together.

CONCLUSIONS

By taking into account the dual process model of cognition, we may be able to design de-implementation strategies matched to clinicians' decision-making processes and avoid unintended consequence.

Bridging the Gap After Physical Therapy: Clinical-Community Linkages With Older Adult Physical Activity Programs

BACKGROUND AND OBJECTIVES

Many barriers exist to older adult participation in physical activity, despite known benefits. Referrals from physical therapists (PTs) through clinical-community linkages offer novel, promising opportunities to increase older adult engagement in appropriate community-based physical activity programs. We assessed the capacity of PTs to participate in such linkages.

RESEARCH DESIGN AND METHODS

We collected qualitative data using semistructured phone interviews (n = 30) with PTs across 14 states. We conducted thematic analysis using a priori themes based on the 2008 Bridging Model of Etz and colleagues: capacity to assess patient risk, ability to provide brief counseling, capacity and ability to refer, and awareness of community resources.

RESULTS

Risk assessment and counseling were already part of routine practice for our respondents, but counseling could be further facilitated if PTs had more skills to engage less-motivated patients. PTs expressed a desire to refer their patients to community programs; however, barriers to referrals included lack of knowledge of and trust in community programs, and limited infrastructure for communicating with potential partners.

DISCUSSION AND IMPLICATIONS

PTs have the capacity to develop patient referral linkages with community-based physical activity programs. PT session length and content facilitates patient risk assessment and behavioral counseling. Integrating motivational techniques can help PTs engage less-motivated patients in physical activity. Systemic improvements should include innovations in communication infrastructure, identifying clinic-level champions, and in-person outreach initiated by organizations that deliver community physical activity programs.

Primary Care Tasks Associated with Provider Burnout: Findings from a Veterans Health Administration Survey

BACKGROUND

The patient-centered medical home (PCMH) is a primary care delivery model predicated on shared responsibility for patient care among members of an interprofessional team. Effective task sharing may reduce burnout among primary care providers (PCPs). However, little is known about the extent to which PCPs share these responsibilities, and which, if any, of the primary care tasks performed independently by the PCPs (vs. shared with the team) are particularly associated with PCP burnout. A better understanding of the relationship between these tasks and their effects on PCP burnout may help guide focused efforts aimed at reducing burnout.

OBJECTIVE

To investigate (1) the extent to which PCPs share responsibility for 14 discrete primary care tasks with other team members, and (2) which, if any, of the primary care tasks performed by the PCPs (without reliance on team members) are associated with PCP burnout.

DESIGN

Secondary data analysis of Veterans Health Administration (VHA) survey data from two time periods.

PARTICIPANTS

327 providers from 23 VA primary care practices within one VHA regional network.

MAIN MEASURES

The dependent variable was PCP report of burnout. Independent variables included PCP report of the extent to which they performed 14 discrete primary care tasks without reliance on team members; team functioning; and PCP-, clinic-, and system-level variables.

KEY RESULTS

In adjusted models, PCP reports of intervening on patient lifestyle factors and educating patients about disease-specific self-care activities, without reliance on their teams, were significantly associated with burnout (intervening on lifestyle: b = 4.11, 95% CI = 0.39, 7.83, p = 0.03; educating patients: b = 3.83, 95% CI = 0.33, 7.32, p = 0.03).

CONCLUSIONS

Performing behavioral counseling and self-management education tasks without relying on other team members for assistance was associated with PCP burnout. Expanding the roles of nurses and other healthcare professionals to assume responsibility for these tasks may ease PCP burden and reduce burnout.

Working smarter not harder: Coupling implementation to de-implementation

In this paper, we discuss de-implementation as an implicit part of implementation and organizational change, and consider its underlying processes of unlearning to discontinue or deviate from ineffective practice and learning to applying newer, more effective practices. We describe a typology of de-implementation that represents four types of change: partial reduction, complete reversal, substitution with related replacement and substitution with unrelated replacement of existing practice. We also explicate how learning and unlearning needed for effective change vary in these four types of de-implementation. Last, we propose coupling de-implementation and implementation efforts, which serve conceptual and logistical goals of organizational change.

The Association of Team-Specific Workload and Staffing with Odds of Burnout Among VA Primary Care Team Members

BACKGROUND

Work-related burnout is common in primary care and is associated with worse patient safety, patient satisfaction, and employee mental health. Workload, staffing stability, and team completeness may be drivers of burnout. However, few studies have assessed these associations at the team level, and fewer still include members of the team beyond physicians.

OBJECTIVE

To study the associations of burnout among primary care providers (PCPs), nurse care managers, clinical associates (MAs, LPNs), and administrative clerks with the staffing and workload on their teams.

DESIGN

We conducted an individual-level cross-sectional analysis of survey and administrative data in 2014.

PARTICIPANTS

Primary care personnel at VA clinics responding to a national survey.

MAIN MEASURES

Burnout was measured with a validated single-item survey measure dichotomized to indicate the presence of burnout. The independent variables were survey measures of team staffing (having a fully staffed team, serving on multiple teams, and turnover on the team), and workload both from survey items (working extended hours), and administrative data (patient panel overcapacity and average panel comorbidity).

KEY RESULTS

There were 4610 respondents (estimated response rate of 20.9%). The overall prevalence of burnout was 41%. In adjusted analyses, the strongest associations with burnout were having a fully staffed team (odds ratio [OR] = 0.55, 95% CI 0.47-0.65), having turnover on the team (OR = 1.67, 95% CI 1.43-1.94), and having patient panel overcapacity (OR = 1.19, 95% CI 1.01-1.40). The observed burnout prevalence was 30.1% lower (28.5% vs. 58.6%) for respondents working on fully staffed teams with no turnover and caring for a panel within capacity, relative to respondents in the inverse condition.

CONCLUSIONS

Complete team staffing, turnover among team members, and panel overcapacity had strong, cumulative associations with burnout. Further research is needed to understand whether improvements in these factors would lower burnout.

A specialty-specific, multimodality educational quality improvement initiative to deimplement rarely appropriate myocardial perfusion imaging

Objective

Investigations of Appropriate Use Criteria (AUC) education have shown a mixed effect on changing provider behaviour. At our facility, rarely appropriate myocardial perfusion imaging (MPI) differs by specialty; awareness of AUC is low. Our objective is to investigate if specialty-specific, multimodality education could reduce rarely appropriate MPI.

Methods

We designed education focused on the rarely appropriate MPI ordered most often by each specialty. We tracked appropriateness of MPI in three cohorts: pre, post (immediately after) and late-post (4 months after) intervention.

Results

A total of 889 MPI were evaluated (n=287 pre, n=313 post, n=289 late-post), 95.3% were men. Chest pain was the most common symptom (n=530, 59.6%), while 14.1% (n=125) had no symptoms. Rarely appropriate testing decreased from 4.9% to 1.3% and remained at 1.4% in the late-post cohort (p<0.0001). In logistic regression, lack of symptoms (OR 31.3, 95% CI 10.3 to 94.8, p≤0.0001) and being in the post or late-post cohorts (OR 0.27, 95% CI 0.11 to 0.68, p=0.006) were associated with rarely appropriate MPI. Preoperative MPI in patients with good exercise capacity was a common rarely appropriate indication. Ischaemia was not observed among patients with rarely appropriate indication for MPI.

Conclusions

In certain clinical settings, education may be an effective approach for deimplementing rarely appropriate MPI. The effect of education may be enhanced when focused on improving patient care, delivered by a peer, and needs assessment indicates low awareness of guidelines. Lack of symptoms and preoperative MPI continue to be the predominant rarely appropriate MPI ordered.

Abstract 017: Feasibility of Audit and Feedback for Reducing Rarely Appropriate Nuclear Myocardial Perfusion Imaging Among Veterans

Background: Appropriate Use Criteria (AUC) are complex documents which provide great detail on which patients are likely to benefit from a test. For providers who order a low volume of cardiac tests, regular application and navigation through the AUC may be difficult. Audit and feedback (A&F) has been proposed as an effective method for encouraging de-implementation of unnecessary testing. We hypothesized that the volume of myocardial perfusion imaging (MPI) ordered by most providers would make A&F ineffective.

Methods: We performed a secondary analysis of data gathered for the evaluation of a program to reduce rarely appropriate MPI. Patients who underwent nuclear myocardial perfusion imaging (MPI) were rated using the AUC. Appropriateness rating was performed retrospectively by a nurse trained in application of the AUC. We extracted data on both the patient and the ordering provider from the medical record which accompanied the visit where the MPI was ordered. Patients were compared in two cohorts: those with rarely appropriate indications for MPI, and all others. We performed logistic regression to determine which patient and provider characteristics were associated with rarely appropriate MPI. We ranked the most common indications for rarely appropriate testing and calculated the mean number of MPI ordered by our providers.

Results: A total of 889 cases over six months were included; 22 MPI (2.5%) were rated as rarely appropriate. A minority of patients had a prior myocardial infarction (n=127, 143%) or coronary revascularization (n=291, 32.7%). Chest pain was more common among appropriate or maybe appropriate MPI (n=528, 61.1% vs. n=1, 4.5%, P<0.0001) while lack of symptoms was more common among rarely appropriate MPI (n=18, 81.8% vs. 107, 12.4%, P<0.0001). In logistic regression, lack of symptoms was retained in association with rarely appropriate testing (odds ratio 31.6, 95% confidence interval 10.5-95.2, P<0.0001). The majority (59.1%) of rarely appropriate tests were accounted for with only 3 indications (#8, #71, and #67). A total of 219 providers ordered MPI during the study period, with an average of 4.1 MPI per provider, less than one MPI per provider per month. The greatest number of rarely appropriate tests from any single provider was 3.

Conclusions: Within the setting of an educational program to reduce rarely appropriate MPI, the number of rarely appropriate MPI per provider was low. Lack of symptoms and indications including preoperative testing and screening in low risk patients were common drivers of rarely appropriate MPI. These data raise doubt about efficacy of a broadly applied program which provides individualized A&F. Efforts to increase awareness of common reasons for rarely appropriate testing may have greater impact.

Results of a Regional Effort to Improve Warfarin Management

BACKGROUND

Improved anticoagulation control with warfarin reduces adverse events and represents a target for quality improvement. No previous study has described an effort to improve anticoagulation control across a health system.

OBJECTIVE

To describe the results of an effort to improve anticoagulation control in the New England region of the Veterans Health Administration (VA).

METHODS

Our intervention encompassed 8 VA sites managing warfarin for more than 5000 patients in New England (Veterans Integrated Service Network 1 [VISN 1]). We provided sites with a system to measure processes of care, along with targeted audit and feedback. We focused on processes of care associated with site-level anticoagulation control, including prompt follow-up after out-of-range international normalized ratio (INR) values, minimizing loss to follow-up, and use of guideline-concordant INR target ranges. We used a difference-in-differences (DID) model to examine changes in anticoagulation control, measured as percentage time in therapeutic range (TTR), as well as process measures and compared VISN 1 sites with 116 VA sites located outside VISN 1.

RESULTS

VISN 1 sites improved on TTR, our main indicator of quality, from 66.4% to 69.2%, whereas sites outside VISN 1 improved from 65.9% to 66.4% (DID 2.3%, P < 0.001). Improvement in TTR correlated strongly with the extent of improvement on process-of-care measures, which varied widely across VISN 1 sites.

CONCLUSIONS

A regional quality improvement initiative, using performance measurement with audit and feedback, improved TTR by 2.3% more than control sites, which is a clinically important difference. Improving relevant processes of care can improve outcomes for patients receiving warfarin.

Development and Pilot Test of the Workplace Readiness Questionnaire, a Theory-Based Instrument to Measure Small Workplaces' Readiness to Implement Wellness Programs

PURPOSE

To develop a theory-based questionnaire to assess readiness for change in small workplaces adopting wellness programs.

DESIGN

In developing our scale, we first tested items via "think-aloud" interviews. We tested the revised items in a cross-sectional quantitative telephone survey.

SETTING

The study setting comprised small workplaces (20-250 employees) in low-wage industries.

SUBJECTS

Decision-makers representing small workplaces in King County, Washington (think-aloud interviews, n = 9), and the United States (telephone survey, n = 201) served as study subjects.

MEASURES

We generated items for each construct in Weiner's theory of organizational readiness for change. We also measured workplace characteristics and current implementation of workplace wellness programs.

ANALYSIS

We assessed reliability by coefficient alpha for each of the readiness questionnaire subscales. We tested the association of all subscales with employers' current implementation of wellness policies, programs, and communications, and conducted a path analysis to test the associations in the theory of organizational readiness to change.

RESULTS

Each of the readiness subscales exhibited acceptable internal reliability (coefficient alpha range, .75-.88) and was positively associated with wellness program implementation ( p < .05). The path analysis was consistent with the theory of organizational readiness to change, except change efficacy did not predict change-related effort.

CONCLUSION

We developed a new questionnaire to assess small workplaces' readiness to adopt and implement evidence-based wellness programs. Our findings also provide empirical validation of Weiner's theory of readiness for change.

The facilitators and barriers associated with implementation of a patient-centered medical home in VHA

BACKGROUND

The patient-centered medical home (PCMH) is a team-based, comprehensive model of primary care. When effectively implemented, PCMH is associated with higher patient satisfaction, lower staff burnout, and lower hospitalization for ambulatory care-sensitive conditions. However, less is known about what factors contribute to (or hinder) PCMH implementation. We explored the associations of specific facilitators and barriers reported by primary care employees with a previously validated, clinic-level measure of PCMH implementation, the Patient Aligned Care Team Implementation Progress Index (Pi(2)).

METHODS

We used a 2012 survey of primary care employees in the Veterans Health Administration to perform cross-sectional, respondent-level multinomial regressions. The dependent variable was the Pi(2) categorized as high implementation (top decile, 54 clinics, 235 respondents), medium implementation (middle eight deciles, 547 clinics, 4537 respondents), and low implementation (lowest decile, 42 clinics, 297 respondents) among primary care clinics. The independent variables were ordinal survey items rating 19 barriers to patient-centered care and 10 facilitators of PCMH implementation. For facilitators, we explored clinic Pi(2) score decile both as a function of respondent-reported availability of facilitators and of rating of facilitator helpfulness.

RESULTS

The availability of five facilitators was associated with higher odds of a respondent's clinic's Pi(2) scores being in the highest versus lowest decile: teamlet huddles (OR = 3.91), measurement tools (OR = 3.47), regular team meetings (OR = 2.88), information systems (OR = 2.42), and disease registries (OR = 2.01). The helpfulness of four facilitators was associated with higher odds of a respondent's clinic's Pi(2) scores being in the highest versus lowest decile. Six barriers were associated with significantly higher odds of a respondent's clinic's Pi(2) scores being in the lowest versus highest decile, with the strongest associations for the difficulty recruiting and retaining providers (OR = 2.37) and non-provider clinicians (OR = 2.17). Results for medium versus low Pi(2) score clinics were similar, with fewer, smaller significant associations, all in the expected direction.

CONCLUSIONS

A number of specific barriers and facilitators were associated with PCMH implementation, notably recruitment and retention of clinicians, team huddles, and local education. These findings can guide future research, and may help healthcare policy makers and leaders decide where to focus attention and limited resources.

E-consult implementation: lessons learned using consolidated framework for implementation research

OBJECTIVES

In 2011, the Veterans Health Administration (VHA) implemented electronic consults (e-consults) as an alternative to in-person specialty visits to improve access and reduce travel for veterans. We conducted an evaluation to understand variation in the use of the new e-consult mechanism and the causes of variable implementation, guided by the Consolidated Framework for Implementation Research (CFIR).

STUDY DESIGN

Qualitative case studies of 3 high- and 5 low-implementation e-consult pilot sites. Participants included e-consult site leaders, primary care providers, specialists, and support staff identified using a modified snowball sample.

METHODS

We used a 3-step approach, with a structured survey of e-consult site leaders to identify key constructs, based on the CFIR. We then conducted open-ended interviews, focused on key constructs, with all participants. Finally, we produced structured, site-level ratings of CFIR constructs and compared them between high- and low-implementation sites.

RESULTS

Site leaders identified 14 initial constructs. We conducted 37 interviews, from which 4 CFIR constructs distinguished high implementation e-consult sites: compatibility, networks and communications, training, and access to knowledge and information. For example, illustrating compatibility, a specialist at a high-implementation site reported that the site changed the order of consult options so that all specialties listed e-consults first to maintain consistency. High-implementation sites also exhibited greater agreement on constructs.

CONCLUSIONS

By using the CFIR to analyze results, we facilitate future synthesis with other findings, and we better identify common patterns of implementation determinants common across settings.

Evaluation of E-Consults in the VHA: Provider Perspectives

As VHA expands the use of e-consults, this study suggests that they often are more timely than are face-to-face consultations.

Using a single item to measure burnout in primary care staff: a psychometric evaluation

BACKGROUND

Burnout affects nearly half of all U.S. nurses and physicians, and has been linked to poor outcomes such as worse patient safety. The most common measure of burnout is the well-validated Maslach Burnout Inventory (MBI). However, the MBI is proprietary and carries licensing fees, posing challenges to routine or repeated assessment.

OBJECTIVE

To compare a non-proprietary, single-item burnout measure to a single item from the MBI Emotional Exhaustion (MBI:EE) subscale that has been validated as a standalone burnout measure.

DESIGN

Cross-sectional online survey.

PARTICIPANTS

A sample of primary care providers (PCPs), registered nurses, clinical associates (e.g., licensed practical nurses (LPNs), medical technicians), and administrative clerks in the Veterans Health Administration surveyed in 2012.

MAIN METHODS

We compared a validated one-item version of the MBI:EE and a non-proprietary single-item burnout measure used in the Physician Work Life Study. We calculated kappa statistics, sensitivity and specificity, positive predictive (PPV) and negative predictive values (NPV), and area under the receiver operator curve (AUC). We conducted analyses stratified by occupation to determine the stability of the correlation between the two measures.

KEY RESULTS

We analyzed responses from 5,404 participants, including 1,769 providers and 1,380 registered nurses. The prevalence of burnout was 36.7% as measured on the single MBI:EE item and 38.5% as measured on the non-proprietary single-item measure. Relative to the MBI:EE, the non-proprietary single-item measure had a correlation of 0.79, sensitivity of 83.2%, specificity of 87.4%, and AUC of 0.93 (se = 0.004). Results were similar when stratified by respondent occupation.

CONCLUSIONS

A non-proprietary single-item measure served as a reliable substitute for the MBI:EE across occupations. Because it is non-proprietary and easy to interpret, it has logistical advantages over the one-item MBI.

The most used and most helpful facilitators for patient-centered medical home implementation

Background

Like other transformative healthcare initiatives, patient-centered medical home (PCMH) implementation requires substantial investments of time and resources. Even though PCMH and PCMH-like models are being implemented by multiple provider practices and health systems, little is known about what facilitates their implementation. The purpose of this study was to assess which PCMH-implementation resources are most widely used, by whom, and which resources primary care personnel find most helpful.

Methods

This study is an analysis of data from a cross-sectional survey of primary care personnel in the Veterans Health Administration in 2012, in which respondents were asked to rate whether they were aware of and accessed PCMH-implementation resources, and to rate their helpfulness. Logistic regression was used to produce odds ratios for the outcomes (1) resource use and (2) resource helpfulness. Respondents were nested within clinics, nested, in turn, within 135 parent hospitals.

Results

Teamlet huddles were the most widely accessed (80.4% accessed) and most helpful (90.4% rated helpful) resource; quality-improvement methods to conduct small tests of change were the least frequently accessed (42.4% accessed) resource though two-thirds (66.7%) of users reported as helpful. Supervisors were significantly more likely (ORs, 1.46 to 1.86) to use resources than non-supervisors but were less likely to rate the majority (8 out of 10) of resources as “somewhat/very helpful” than non-supervisors (ORs, 0.72 to 0.84). Longer-tenured employees tended to rate resources as more helpful.

Conclusions

These findings are the first in the PCMH literature that we are aware of that systematically assesses primary care staff’s access to and the helpfulness of PCMH implementation resources. Supervisors generally reported greater access to resources, relative to non-supervisors, but rated resources as less helpful, suggesting that information about them may not have been optimally disseminated. Knowing what resources primary care staff use and find helpful can inform administrators’ and policymakers’ investments in PCMH-implementation resources. The implications of our model extend beyond just PCMH implementation but also to considerations when providing implementation resources for other complex quality-improvement initiatives.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-015-0246-9) contains supplementary material, which is available to authorized users.

Association of medical home team-based care functions and perceived improvements in patient-centered care at VHA primary care clinics

INTRODUCTION

Team-based care is central to the patient-centered medical home (PCMH), but most PCMH evaluations measure team structure exclusively. We assessed team-based care in terms of team structure, process and effectiveness, and the association with improvements in teams׳ abilities to deliver patient-centered care.

MATERIAL AND METHODS

We fielded a cross-sectional survey among 913 VA primary care clinics implementing a PCMH model in 2012. The dependent variable was clinic-level respondent-reported improvements in delivery of patient-centered care. Independent variables included three sets of measures: (1) team structure, (2) team process, and (3) team effectiveness. We adjusted for clinic workload and patient comorbidity.

RESULTS

4819 surveys were returned (25% estimated response rate). The highest ratings were for team structure (median of 89% of respondents being assigned to a teamlet, i.e., a PCP working with the same clinical associate, nurse care manager and clerk) and lowest for team process (median of 10% of respondents reporting the lowest level of stress/chaos). In multivariable regression, perceived improvements in patient-centered care were most strongly associated with participatory decision making (β=32, P<0.0001) and history of change in the clinic (β=18, P=0008) (both team processes). A stressful/chaotic clinic environment was associated with higher barriers to patient centered care (β=0.16-0.34, P=<0.0001), and lower improvements in patient-centered care (β=-0.19, P=0.001).

CONCLUSIONS

Team process and effectiveness measures, often omitted from PCMH evaluations, had stronger associations with perceived improvements in patient-centered care than team structure measures.

IMPLICATIONS

Team process and effectiveness measures may facilitate synthesis of evaluation findings and help identify positive outlier clinics.