Multidisciplinary providers' perceptions of care delivery for sleep disorders: A qualitative case study

OBJECTIVES

Sleep disorders are wide-ranging in their causes and impacts on other physical and mental health conditions. Thus, sleep disorders could benefit from a multidisciplinary approach to assessment and treatment. An integrated care model is often recommended but is costly to implement. We sought to understand how, in the absence of an established organizational structure for integrated sleep care, providers from different clinics work together to provide care for sleep disorders.

METHODS

A qualitative case study at one U.S. Department of Veterans Affairs (VA) medical center. We used a purposeful nested sampling strategy, combining maximum variation sampling and snowball sampling to recruit key staff involved in sleep care.

RESULTS

We interviewed providers (N = 10) from sleep medicine, primary care, and mental health services. Providers identified the ubiquity of sleep disorders and a concomitant need for multidisciplinary care. However, they described limited opportunities for multidisciplinary interactions and consequently a negative impact on clinical care. Providers described fragmentation in two areas: among sleep specialists and between sleep specialists and other referring and managing providers.

CONCLUSIONS

A range of interventions, based on setting and resources, could improve care coordination both among sleep specialists and between sleep and nonsleep providers. While integrated sleep specialist clinics could reduce care fragmentation, they may not directly impact coordination with referring providers, like primary care and general mental health, who are essential in managing chronic conditions. Future work should continue to explore improving care coordination for sleep problems to ensure patients receive high-quality, timely, patient-centered care.

Factors affecting the implementation of employee whole health in the veterans health administration: a qualitative evaluation

BACKGROUND

There is increasing recognition of the need to focus on the health and well-being of healthcare employees given high rates of burnout and turnover. Employee wellness programs are effective at addressing these issues; however, participation in these programs is often a challenge and requires large scale organizational transformation. The Veterans Health Administration (VA) has begun to roll out their own employee wellness program-Employee Whole Health (EWH)-focused on the holistic needs of all employees. This evaluation's goal was to use the Lean Enterprise Transformation (LET) model for organizational transformation to identify key factors-facilitators and barriers-affecting the implementation of VA EWH.

METHODS

This cross-sectional qualitative evaluation based on the action research model reflects on the organizational implementation of EWH. Semi-structured 60-minute phone interviews were conducted in February-April 2021 with 27 key informants (e.g., EWH coordinator, wellness/occupational health staff) knowledgeable about EWH implementation across 10 VA medical centers. Operational partner provided a list of potential participants, eligible because of their involvement in EWH implementation at their site. The interview guide was informed by the LET model. Interviews were recorded and professionally transcribed. Constant comparative review with a combination of a priori coding based on the model and emergent thematic analysis was used to identify themes from transcripts. Matrix analysis and rapid turnaround qualitative methods were used to identify cross-site factors to EWH implementation.

RESULTS

Eight common factors in the conceptual model were found to facilitate and/or hinder EWH implementation efforts: [1] EWH initiatives, [2] multilevel leadership support, [3] alignment, [4] integration, [5] employee engagement, [6] communication, [7] staffing, and [8] culture. An emergent factor was [9] the impact of the COVID-19 pandemic on EWH implementation.

CONCLUSIONS

As VA expands its EWH cultural transformation nationwide, evaluation findings can (a) enable existing programs to address known implementation barriers, and (b) inform new sites to capitalize on known facilitators, anticipate and address barriers, and leverage evaluation recommendations through concerted implementation at the organization, process, and employee levels to jump-start their EWH program implementation.

Achieving transformation to lean management systems in health care

OBJECTIVE

To understand what factors and organizational dynamics enable Lean transformation of health care organizations.

DATA SOURCES

Primary data were collected through two waves of interviews in 2016-2017 with leaders and staff at seven veterans affairs medical centers participating in Lean enterprise transformation.

STUDY DESIGN

Using an observational study design, for each site we coded and rated seven potential enablers of transformation. The outcome measure was the extent of Lean transformation, constructed by coding and rating 11 markers of depth and spread of transformation. Using multivalue coincidence analysis (CNA), we identified enablers that distinguished among sites having different levels of transformation. We identified representative quotes for the enablers.

DATA COLLECTION METHODS

We interviewed 121 executive leaders, middle managers, expert consultants, systems redesign staff, frontline supervisors, and staff.

PRINCIPAL FINDINGS

Two sites achieved high Lean transformation, three medium, and two low. Together leadership support and capability development were sufficient for the three-level Lean transformation outcomes with 100% consistency and 100% coverage. High scores on both corresponded to high Lean transformation; medium on either one corresponded to medium transformation; and low on both corresponded to low transformation. Additionally, low scores in communication and availability of data and very low scores in alignment characterized low-transformation sites. Sites with high leadership support also had a high veteran engagement.

CONCLUSIONS

This multisite study develops a novel measure of the extent of organization-wide Lean transformation and uses CNA to identify enablers linked to transformation. It provides insights into why and how some organizations are more successful at transformation than others. Findings support the applicability of the organization transformation model that guided the study and highlight the roles of executive leadership and capability development in the dynamics of transformation.

Engaging Patients in the Veterans Health Administration's Lean Enterprise Transformation: A Qualitative Study

BACKGROUND AND OBJECTIVES

Lean management is a strategy for improving health care experiences of patients. While best practices for engaging patients in quality improvement have solidified in recent years, few reports specifically address patient engagement in Lean activities. This study examines the benefits and challenges of incorporating patient engagement strategies into the Veterans Health Administration's (VA) Lean transformation.

METHODS

We conducted a multisite, mixed-methods evaluation of Lean deployment at 10 VA medical facilities, including 227 semistructured interviews with stakeholders, including patients.

RESULTS

Interviewees noted that a patient-engaged Lean approach is mutually beneficial to patients and health care employees. Benefits included understanding the veteran's point of view, uncovering inefficient aspects of care processes, improved employee participation in Lean events, increased transparency, and improved reputation for the organization. Challenges included a need for focused time and resources to optimize veteran participation, difficulty recruiting a diverse group of veteran stakeholders, and a lack of specific instructions to encourage meaningful participation of veterans.

CONCLUSIONS/IMPLICATIONS

As the first study to focus on patient engagement in Lean transformation efforts at the VA, this study highlights ways to effectively partner with patients in Lean-based improvement efforts. Lessons learned may also help optimize patient input into quality improvement more generally.

Medicaid Expansion and Change in Federally Qualified Health Center Accessibility From 2008 to 2016

BACKGROUND

The Affordable Care Act expanded health coverage for low-income residents through Medicaid expansion and increased funding for Health Center Program New Access Points from 2009 to 2015, improving federally qualified health center (FQHC) accessibility. The extent to which these provisions progressed synergistically as intended when states could opt out of Medicaid expansion is unknown.

OBJECTIVE

To compare change in FQHC accessibility among census tracts in Medicaid expansion and nonexpansion states.

RESEARCH DESIGN

Tract-level FQHC accessibility scores for 2008 and 2016 were estimated applying the 2-step floating catchment area method to American Community Survey and Health Resources and Services Administration data. Multivariable linear regression compared changes in FQHC accessibility between tracts in Medicaid expansion and nonexpansion states, adjusting for sociodemographic and health system factors and accounting for state-level clustering.

SUBJECTS

In total, 7058 census tracts across 10 states.

RESULTS

FQHC accessibility increased comparably among tracts in Medicaid expansion and nonexpansion states (coef: 0.3; 95% CI: -0.3, 0.8; P -value: 0.36). FQHC accessibility increased more in tracts with higher poverty and uninsured rates, and those with lower proportions of non-English speakers and Black or African American residents.

CONCLUSION

Similar gains in FQHC accessibility across Medicaid expansion and nonexpansion states indicate improvements progressed independently from Medicaid expansion, rather than synergistically as expected. Accessibility increases appeared consistent with HRSA's goal to improve access for individuals experiencing economic barriers to health care but not for those experiencing cultural or language barriers to health care.

Understanding barriers to diagnosis in a rare, genetic disease: Delays and errors in diagnosing schwannomatosis

Diagnosis of rare, genetic diseases is challenging, but conceptual frameworks of the diagnostic process can guide quality improvement initiatives. Using the National Academy of Medicine diagnostic framework, we assessed the extent of, and reasons for diagnostic delays and diagnostic errors in schwannomatosis, a neurogenetic syndrome characterized by nerve sheath tumors and chronic pain. We reviewed the medical records of 97 people with confirmed or probable schwannomatosis seen in two US tertiary care clinics. Time-to-event analysis revealed a median time from first symptom to diagnosis of 16.7 years (95% CI, 7.5-26.0 years) and median time from first medical consultation to diagnosis of 9.8 years (95% CI, 3.5-16.2 years). Factors associated with longer times to diagnosis included initial signs/symptoms that were intermittent, non-specific, or occurred at younger ages (p < 0.05). Thirty-six percent of patients were misdiagnosed; misdiagnoses were of underlying genetic condition (18.6%), pain etiology (16.5%), and nerve sheath tumor presence/pathology (11.3%) (non-mutually exclusive categories). One-fifth (19.6%) of patients had a clear missed opportunity for genetics workup that could have led to an earlier schwannomatosis diagnosis. These results suggest that interventions in clinician education, genetic testing availability, expert review of pathology findings, and automatic triggers for genetics referrals may improve diagnosis of schwannomatosis.

Commentary on Burns, Nembhard and Shortell, "Integrating network theory into the study of integrated healthcare": Revisiting and extending research on structural and processual factors affecting coordination

Burns et al.'s innovative recommendation to use social network theory to study integration will contribute to our understanding of how healthcare systems can optimally deliver high quality, coordinated, person-centered care. We discuss three enhancements to this approach. (1) In increasing our attention to social network analysis and processual perspectives, we must not "throw out the baby with the bathwater" and abandon research that includes formal organizational structure. Structure remains an important focus for researchers and healthcare managers, who spend considerable resources on reorganizing. Since there is evidence that formal structure affects social processes and coordination, future research should build on that evidence and investigate how coordination is affected by the segmentation of organizations into units and the structures and processes designed to integrate interdependent work across those units. Conducting network analysis in the context of formal structure can help us better understand how formal structure affects both social networks and coordination. (2) Using multi-level, mixed methods, and qualitative research will be critically important to fully understand how and why formal organizational structure, social networks, and processual dynamics contribute to coordination or fragmentation of care. Because the relationships among these constructs occur not only within, but also across multiple levels, multi-level research is necessary to understand their effects on coordination. In considering the individual level, patients can be studied as a role embedded in networks. In addition, however, we must not lose a focus on patients as people at the center of multi-level networks, whose attitudes, values, preferences and goals may directly affect processual dynamics and coordination of care. (3) Finally, our field lacks precision in nomenclature, specification of levels, and the constructs within them, including ambiguity around even what is meant by "structure" and its variations. Furthermore, different authors use "macro", "meso", and "micro", differently, contributing to confusion in the discourse on organizational phenomena. Greater clarity and consistency in terminology is needed to facilitate research and improve communication across the field.

A Multi-site Case Study of Care Coordination Between Primary Care and Specialty Care

BACKGROUND

Care coordination is critical for patients with multiple chronic conditions, but fragmentation of care persists. Providers' perspectives of facilitators and barriers to coordination are needed to improve care.

OBJECTIVES

We sought to understand providers' perspectives on care coordination for patients having multiple chronic diseases served by multiple providers.

RESEARCH DESIGN

Based upon our earlier survey of patients with multiple chronic conditions, we selected 8 medical centers having high and low coordination. We interviewed providers to identify facilitators and barriers to coordination and compare them between patient-rated high sites and low sites and between primary care (PC)-mental health (MH) and PC-medical/surgical specialty care.

SUBJECTS

Physicians, nurses and other clinicians in PC, cardiology, and MH (N=102) in 8 Veterans Affairs medical centers.

RESULTS

We identified warm handoffs, professional relationships, and physical proximity as facilitators, and service agreements, reporting relationships and staffing as barriers. PC-MH coordination was reported as better than PC-medical/surgical specialty coordination. Facilitators were more prevalent and barriers less prevalent in sites rated high by patients than sites rated low, and between PC-MH than between PC-specialty care.

DISCUSSION

We noted that professional relationships were highly related to coordination and both affected other facilitators and barriers and were affected by them. We suggested actions to improve relationships directly, and to address other facilitators and barriers that affect relationships and coordination. Among these is the use of the Primary Care Mental Health Integration model.

Effective provider-patient communication of a rare disease diagnosis: A qualitative study of people diagnosed with schwannomatosis

OBJECTIVE

To understand diagnostic communication preferences of patients with schwannomatosis, a rare disease.

METHODS

Eighteen adults with schwannomatosis from across the United States participated in semi-structured phone interviews about their diagnostic experiences. Interview transcripts were inductively coded using thematic analysis.

RESULTS

We identified three elements of effective diagnostic communication: education (particularly about etiology, prognosis, and treatment options); psychological support (to cope with the new diagnosis and any prior diagnostic harms); and efforts to develop therapeutic alliance (i.e. feelings of collaboration, trust, and social-emotional rapport). Poor communication was characterized by inadequate or jargon-heavy explanations, perceived disinterest in or disbelief of symptoms, and lack of partnership. Effective communication helped people feel informed and cope with their condition; poor communication could cause significant psychological distress.

CONCLUSIONS

During diagnosis, patients need education and psychosocial support; the presence of therapeutic alliance between clinicians and patients facilitates this assistance. Diagnostic communication that includes these elements helps patients proactively engage in healthcare decision-making and connect with appropriate treatments.

PRACTICE IMPLICATIONS

When disclosing a rare disease diagnosis, clinicians should meaningfully educate patients about the disorder and acknowledge diagnosis-related psychosocial stressors. Approaching diagnosis empathetically and collaboratively helps foster therapeutic alliance. Referrals for psychological and genetic counseling are often warranted.

Identifying Risks and Opportunities in Outpatient Surgical Patient Safety: A Qualitative Analysis of Veterans Health Administration Staff Perceptions

OBJECTIVES

Little is known about patient safety risks in outpatient surgery. Inpatient surgical adverse events (AEs) risk factors include patient- (e.g., advanced age), process- (e.g., inadequate preoperative assessment), or structure-related characteristics (e.g., low surgical volume); however, these factors may differ from outpatient care where surgeries are often elective and in younger/healthier patients. We undertook an exploratory qualitative research project to identify risk factors for AEs in outpatient surgery.

METHODS

We developed a conceptual framework of patient, process, and structure factors associated with surgical AEs on the basis of a literature review. This framework informed our semistructured interview guide with (1) open-ended questions about a specific outpatient AE that the participant experienced and (2) outpatient surgical patient safety risk factors in general. We interviewed nationwide Veterans Health Administration surgical staff. Results were coded on the basis of categories in the conceptual framework, and additional themes were identified using content analysis.

RESULTS

Fourteen providers representing diverse surgical roles participated. Ten reported witnessing an AE, and everyone provided input on risk factors in our conceptual framework. We did not find evidence that patient race/age, surgical technique, or surgical volume affected patient safety. Emerging factors included patient compliance, postoperative patient assessments/instruction, operating room equipment needs, and safety culture.

CONCLUSIONS

Surgical staff are familiar with AEs and patient safety problems in outpatient surgery. Our results show that processes of care undertaken by surgical providers, as opposed to immutable patient characteristics, may affect the occurrence of AEs. The factors we identified may facilitate more targeted research on outpatient surgical AEs.

Applying a Model of Teamwork Processes to Emergency Medical Services

Introduction

Effective teamwork has been shown to optimize patient safety. However, research centered on the critical inputs, processes, and outcomes of team effectiveness in emergency medical services (EMS) has only recently begun to emerge. We conducted a theory-driven qualitative study of teamwork processes—the interdependent actions that convert inputs to outputs—by frontline EMS personnel in order to provide a model for use in EMS education and research.

Methods

We purposively sampled participants from an EMS agency in Houston, TX. Full-time employees with a valid emergency medical technician license were eligible. Using semi-structured format, we queried respondents on task/team functions and enablers/obstacles of teamwork in EMS. Phone interviews were recorded and transcribed. Using a thematic analytic approach, we combined codes into candidate themes through an iterative process. Analytic memos during coding and analysis identified potential themes, which were reviewed/refined and then compared against a model of teamwork processes in emergency medicine.

Results

We reached saturation once 32 respondents completed interviews. Among participants, 30 (94%) were male; the median experience was 15 years. The data demonstrated general support for the framework. Teamwork processes were clustered into four domains: planning; action; reflection; and interpersonal processes. Additionally, we identified six emergent concepts during open coding: leadership; crew familiarity; team cohesion; interpersonal trust; shared mental models; and procedural knowledge.

Conclusion

In this thematic analysis, we outlined a new framework of EMS teamwork processes to describe the procedures that EMS operators employ to convert individual inputs into team performance outputs. The revised framework may be useful in both EMS education and research to empirically evaluate the key planning, action, reflection, and interpersonal processes that are critical to teamwork effectiveness in EMS.

Development and Validation of an Instrument to Measure Staff Perceptions of Recovery Climate and Culture in Mental Health Programs

OBJECTIVE

Few existing instruments measure recovery-oriented organizational climate and culture. This study developed, psychometrically assessed, and validated an instrument to measure recovery climate and culture.

METHODS

Organizational theory and an evidence-based conceptualization of mental health recovery guided instrument development. Items from existing instruments were reviewed and adapted, and new items were developed as needed. All items were rated by recovery experts. A 35-item instrument was pilot-tested and administered to a national sample of mental health staff in U.S. Department of Veterans Affairs Psychosocial Rehabilitation and Recovery Centers (PRRCs). Analysis entailed an exploratory factor analysis (EFA) and inter-item reliability and scale correlation assessment. Blinded site visits to four PRRCs were performed to validate the instrument.

RESULTS

The EFA determined a seven-factor solution for the data. The factors identified were staff expectations, values, leadership, rewards, policies, education and training, and quality improvement. Seven items did not meet retention criteria and were dropped from the final instrument. The instrument exhibited good internal consistency (Cronbach's α=0.81; subscales, α=0.84-0.88). Scale correlations were between 0.16 and 0.61, well below the threshold (α=0.9) for indicating overlapping constructs. Site visitors validated the instrument by correctly identifying high-scoring and low-scoring centers.

CONCLUSIONS

These findings provide a psychometrically tested and validated instrument for measuring recovery climate and culture in mental health programs. This instrument can be used in evaluation of mental health services to determine the extent to which programs possess the organizational precursors that drive recovery-oriented service delivery.

National Burnout Trends Among Physicians Working in the Department of Veterans Affairs

BACKGROUND

Heterogeneity of existing physician burnout studies impairs analyses of longitudinal trends, geographic distribution, and organizational factors impacting physician burnout. The Department of Veterans Affairs (VA) is one of the largest integrated healthcare systems in the USA, offering a unique opportunity to study burnout across VA sites and time.

OBJECTIVE

To characterize longitudinal burnout trends of VA physicians and assess organizational characteristics and geographic distribution associated with physician burnout.

DESIGN

Longitudinal study of the VA All Employee Survey during 2013-2017.

PARTICIPANTS

Self-identified physicians practicing in one of nine clinical service areas at 140 VA sites nationwide.

MAIN MEASURES

We identified burnout using a validated definition adapted from the Maslach Burnout Inventory and characterized burnout trends for physicians in different clinical service areas. We used clustering analysis to categorize sites based on their burnout rates over time, and compared organizational characteristics and geographic distribution of high, medium, and low burnout categories.

KEY RESULTS

We identified 40,382 physician responses from 140 VA sites. Mean burnout rates across all physicians ranged from 34.3% in 2013 to a high of 39.0% in 2014. Primary care physicians had the highest burnout. High burnout sites were more likely to be rural and non-teaching, have lower complexity (i.e., offer fewer advanced clinical services), and have fewer unique patients per site.

CONCLUSIONS

VA physician burnout was lower than previously described in many non-VA studies and was relatively stable over time. These findings may be due to unique characteristics of the VA practice environment. Nonetheless, with over a third of VA physicians reporting burnout, organizational interventions are needed. Primary care physicians and those practicing at small, rural sites have higher rates of burnout and may warrant more focused attention. Our results can guide targeted interventions to promote VA physician well-being and inform efforts to address burnout in diverse clinical settings.

Exploring the Association Between Organizational Culture and Large-Scale Adverse Events: Evidence from the Veterans Health Administration

BACKGROUND

Large-scale adverse events (LSAEs) involve unsafe clinical practices stemming from system issues that may affect multiple patients. Although literature suggests a supportive organizational culture may protect against system-related adverse events, no study has explored such a relationship within the context of LSAEs. This study aimed to identify whether staff perceptions of organizational culture were associated with LSAE incidence.

METHODS

The team conducted an exploratory analysis using the 2008-2010 data from the US Department of Veterans Affairs (VA) All Employee Survey (AES). LSAE incidence was the outcome variable in two facilities where similar infection control practice issues occurred, leading to LSAEs. For comparison, four facilities where LSAEs had not occurred were selected, matched on VA-assigned facility complexity and geography. The AES explanatory factors included workgroup-level (civility, employee engagement, leadership, psychological safety, resources, rewards) and hospital-level Likert-type scales for four cultural factors (group, rational, entrepreneurial, bureaucratic). Bivariate analyses and logistic regressions were performed, with individual staff as the unit of analysis from the anonymous AES data.

RESULTS

Responses from 209 AES participants across the six facilities in the sample indicated that the four comparison facilities had significantly higher mean scores compared to the two LSAE facilities for 9 of 10 explanatory factors. The adjusted analyses identified that employee engagement significantly predicted LSAE incidence (odds ratio = 0.58, 95% confidence interval = 0.37-0.90).

CONCLUSION

Staff at the two exposure facilities in this study described their organizational culture to be less supportive. Lower scores in employee engagement may be a contributing factor for LSAEs.

A site visit protocol for assessing recovery promotion at the program level: An example from the Veterans Health Administration

OBJECTIVE

A site visit protocol was developed to assess recovery promotion in the organizational climate and culture of programs for veterans with serious mental illnesses.

METHOD

The protocol was pilot-tested in 4 programs: 2 that had scored high on the pilot version of a staff survey measure of program-level recovery promotion and 2 that had scored low. Two-person teams conducted onsite visits and assigned global and organizational domain ratings. Interrater agreement was assessed by examining adjacent agreement and computing weighted kappa.

RESULTS

The on-site protocol had good interrater agreement and discriminated between sites that scored high and low on the staff survey.

CONCLUSIONS AND IMPLICATIONS FOR PRACTICE

This site visit protocol and procedure shows promise for evaluating recovery promotion in milieu-based programs. After further refinement of this tool, adaptations could be developed for accreditation protocols or for program self-assessment and quality improvement efforts. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Change in geographic access to community health centers after Health Center Program expansion

OBJECTIVE

To examine geographic access to community health centers (CHC accessibility) before and after Health Center Program expansion in three Southern states.

DATA SOURCES

Community health center data were from the Health Resources and Services Administration (1967-2016). Population estimates and sociodemographic characteristics were from the American Community Survey (2006-2015).

STUDY DESIGN

We used the two-step floating catchment area method to calculate CHC accessibility for census tracts in 2008 and 2016. We mapped census tract-level variation and used spatial regression to assess to what extent indicators of potential CHC need were associated with change in accessibility from 2008 to 2016.

PRINCIPAL FINDINGS

Community health center accessibility increased by 192 percent overall, and the proportion of tracts with no accessibility decreased by 65 percent. Indicators of potential need were not associated with greater gains in CHC accessibility from 2008 to 2016, but census tracts with less accessibility at baseline saw larger accessibility increases.

CONCLUSIONS

Community health center accessibility substantially increased from 2008 to 2016, but increases did not differentially impact groups with greater potential need. This approach for measuring CHC accessibility offers significant improvement in granularity over traditional CHC accessibility measures.

Health Care Coordination Theoretical Frameworks: a Systematic Scoping Review to Increase Their Understanding and Use in Practice

BACKGROUND

Care coordination is crucial to avoid potential risks of care fragmentation in people with complex care needs. While there are many empirical and conceptual approaches to measuring and improving care coordination, use of theory is limited by its complexity and the wide variability of available frameworks. We systematically identified and categorized existing care coordination theoretical frameworks in new ways to make the theory-to-practice link more accessible.

METHODS

To identify relevant frameworks, we searched MEDLINE®, Cochrane, CINAHL, PsycINFO, and SocINDEX from 2010 to May 2018, and various other nonbibliographic sources. We summarized framework characteristics and organized them using categories from the Sustainable intEgrated chronic care modeLs for multi-morbidity: delivery, FInancing, and performancE (SELFIE) framework. Based on expert input, we then categorized available frameworks on consideration of whether they addressed contextual factors, what locus they addressed, and their design elements. We used predefined criteria for study selection and data abstraction.

RESULTS

Among 4389 citations, we identified 37 widely diverse frameworks, including 16 recent frameworks unidentified by previous reviews. Few led to development of measures (39%) or initiatives (6%). We identified 5 that are most relevant to primary care. The 2018 framework by Weaver et al., describing relationships between a wide range of primary care-specific domains, may be the most useful to those investigating the effectiveness of primary care coordination approaches. We also identified 3 frameworks focused on locus and design features of implementation that could prove especially useful to those responsible for implementing care coordination.

DISCUSSION

This review identified the most comprehensive frameworks and their main emphases for several general practice-relevant applications. Greater application of these frameworks in the design and evaluation of coordination approaches may increase their consistent implementation and measurement. Future research should emphasize implementation-focused frameworks that better identify factors and mechanisms through which an initiative achieves impact.

Survey of Patient-Centered Coordination of Care for Diabetes with Cardiovascular and Mental Health Comorbidities in the Department of Veterans Affairs

BACKGROUND

Multiple comorbidities thought to be associated with poor coordination due to the need for shared treatment plans and active involvement of patients, among other factors. Cardiovascular and mental health comorbidities present potential coordination challenges relative to diabetes.

OBJECTIVE

To determine how cardiovascular and mental health comorbidities relate to patient-centered coordinated care in the Department of Veterans Affairs.

DESIGN

This observational study used a 2 × 2 factorial design to determine how cardiovascular and mental health comorbidities are associated with patient perceptions of coordinated care among patients with type 2 diabetes mellitus as a focal condition.

PARTICIPANTS

Five thousand eight hundred six patients attributed to 262 primary care providers, from a national sample of 29 medical centers, who had completed an online survey of patient-centered coordinated care in the Department of Veterans Affairs (VA).

MAIN MEASURES

Eight dimensions from the Patient Perceptions of Integrated Care (PPIC) survey, a state-of-the-art measure of patients' perspective on coordinated and patient-centered care.

KEY RESULTS

Mental health conditions were associated with significantly lower patient experiences of coordinated care. Hypotheses for disease severity were not supported, with associations in the hypothesized direction for only one dimension.

CONCLUSIONS

Results suggest that VA may be adequately addressing coordination needs related to cardiovascular conditions, but more attention could be placed on coordination for mental health conditions. While specialized programs for more severe conditions (e.g., heart failure and serious mental illness) are important, coordination is also needed for more common, less severe conditions (e.g., hypertension, depression, anxiety). Strengthening coordination for common, less severe conditions is particularly important as VA develops alternative models (e.g., community care) that may negatively impact the degree to which care is coordinated.

Organizational Coordination and Patient Experiences of Specialty Care Integration

BACKGROUND

Delivering care to patients with complex healthcare needs benefits from coordination among healthcare providers. Greater levels of care coordination have been associated with more favorable patient experiences, cost management, and lower utilization of services. Organizational approaches consider how systems, practices, and relationships influence coordination and associated outcomes.

OBJECTIVE

Examine measures of organizational coordination and their association with patient experiences of care coordination involving specialists.

DESIGN

Cross-sectional surveys of patients and primary care providers (PCPs).

PARTICIPANTS

Final sample included 3183 patients matched to 233 PCPs from the Veterans Health Administration. All patients had a diagnosis of type 2 diabetes mellitus and one of four other conditions: hypertension; congestive heart failure; depression/anxiety; or severe mental illness/posttraumatic stress disorder.

MAIN MEASURES

Patients completed a survey assessing perceptions of coordinated care. We examined ratings on three domains: specialist knowledge management; knowledge integration across settings and time; and knowledge fragmentation across settings and time. We created care coordination measures involving the PCP and three specialty provider types. PCPs provided ratings on relational coordination for specialists, feedback coordination, and team coordination. We aligned patient's specialty services used with corresponding PCP ratings of that specialty.

KEY RESULTS

Patient ratings were significantly lower on specialist knowledge management and knowledge integration when either PCPs did not use feedback coordination (b = - .20; b = - .17, respectively) or rated feedback coordination lower (b = - .08 for both). Teamwork was significantly related to specialist knowledge management (b = .06), knowledge integration (b = .04); and knowledge fragmentation (b = - .04). Relational coordination was related to coordination between the primary care provider and (i) diabetes specialist (b = .09) and (ii) mental health provider (b = .12).

CONCLUSIONS

Practices to improve provider coordination within and across primary care and specialty care services may improve patient experiences of care coordination. Improvements in these areas may improve care efficiency and effectiveness.

Incorporating Theory into Practice: Reconceptualizing Exemplary Care Coordination Initiatives from the US Veterans Health Delivery System

This perspective paper seeks to lay out an efficient approach for health care providers, researchers, and other stakeholders involved in interventions aimed at improving care coordination to partner in locating and using applicable care coordination theory. The objective is to learn from relevant theory-based literature about fit between intervention options and coordination needs, thereby bringing insights from theory to enhance intervention design, implementation, and troubleshooting. To take this idea from an abstract notion to tangible application, our workgroup on models and measures from the Veterans Health Administration (VA) State of the Art (SOTA) conference on care coordination first summarizes our distillation of care coordination theoretical frameworks (models) into three common conceptual domains-context of an intervention, locus in which an intervention is applied, and specific design features of the intervention. Then we apply these three conceptual domains to four cases of care coordination interventions ("use cases") chosen to represent various scopes and stages of interventions to improve care coordination for veterans. Taken together, these examples make theory more accessible and practical by demonstrating how it can be applied to specific cases. Drawing from theory offers one method to anticipate which intervention options match a particular coordination situation.

Facility type and surgical specialty are associated with suboptimal surgical antimicrobial prophylaxis practice patterns: a multi-center, retrospective cohort study

Background

Guidelines recommend discontinuation of antimicrobial prophylaxis within 24 h after incision closure in uninfected patients. However, how facility and surgical specialty factors affect the implementation of these evidence-based surgical prophylaxis guidelines in outpatient surgery is unknown. Thus, we sought to measure how facility complexity, including ambulatory surgical center (ASC) status and availability of ancillary services, impact adherence to guidelines for timely discontinuation of antimicrobial prophylaxis after outpatient surgery. A secondary aim was to measure the association between surgical specialty and guideline compliance.

Methods

A multi-center, national Veterans Health Administration retrospective cohort from 10/1/2015-9/30/2017 including any Veteran undergoing an outpatient surgical procedure in any of five specialties (general surgery, urology, ophthalmology, ENT, orthopedics) was created. The primary outcome was the association between facility complexity and proportion of surgeries not compliant with discontinuation of antimicrobials within 24 h of incision closure. Data were analyzed using logistic regression with adjustments for patient and procedural factors.

Results

Among 153,097 outpatient surgeries, 7712 (5.0%) received antimicrobial prophylaxis lasting > 24 h after surgery; rates ranged from 0.4% (eye surgeries) to 13.7% (genitourinary surgeries). Cystoscopies and cystoureteroscopy with lithotripsy procedures had the highest rates (16 and 20%), while hernia repair, cataract surgeries, and laparoscopic cholecystectomies had the lowest (0.2-0.3%). In an adjusted logistic regression model, lower complexity ASC and hospital outpatient departments had higher odds of prolonged antimicrobial prophylaxis compared to complex hospitals (OR ASC, 1.3, 95% CI: 1.2-1.5). Patient factors associated with higher odds of noncompliance with antimicrobial discontinuation included younger age, female sex, and white race. Genitourinary and ear/nose/throat surgeries were associated with the highest odds of prolonged antimicrobial prophylaxis.

Conclusions

Facility complexity appears to play a role in adherence to surgical infection prevention guidelines. Lower complexity facilities with limited infection prevention and antimicrobial stewardship resources may be important targets for quality improvement. Such interventions may be especially useful for genitourinary and ear/nose/throat surgical subspecialties. Increasing pharmacy, antimicrobial stewardship and/or infection prevention resources to promote more evidence-based care may support surgical providers in lower complexity ambulatory surgery centers and hospital outpatient departments in their efforts to improve this facet of patient safety.

Lean Enterprise Transformation in VA: a national evaluation framework and study protocol

BACKGROUND

The goal of Lean Enterprise Transformation (LET) is to go beyond simply using Lean tools and instead embed Lean principles and practices in the system so that it becomes a fundamental, collective mindset of the entire enterprise. The Veterans Engineering Resource Center (VERC) launched the Veterans Affairs (VA) LET pilot program to improve quality, safety, and the Veteran's experience. A national evaluation will examine the pilot program sites' implementation processes, outcomes and impacts, and abilities to improve LET adoption and sustainment. This paper describes the evaluation design for the VA LET national evaluation and describes development of a conceptual framework to evaluate LET specifically in healthcare settings.

METHODS

A targeted literature review of Lean evaluation frameworks was performed to inform the development of the conceptual framework. Key domains were identified by a multidisciplinary expert group and then validated with key stakeholders. The national evaluation design will examine LET implementation using qualitative, survey, and quantitative methods at ten VA facilities. Qualitative data include site visits, interviews, and field observation notes. Survey data include an employee engagement survey to be administered to front-line staff at all pilot sites. Quantitative data include site-level quality improvement metrics collected by the Veterans Services Support Center. Qualitative, quantitative, and mixed-methods analyses will be conducted to examine implementation of LET strategic initiatives and variations in implementation success across sites.

DISCUSSION

This national evaluation of a large-scale LET implementation effort will provide insights helpful to other systems interested in embarking on a Lean journey. Additionally, we created a multi-faceted conceptual framework to capture the specific features of a Lean healthcare organization. This framework will guide this evaluation and may be useful as an assessment tool for other organizations interested in implementing Lean principles at an enterprise level.

Association between postoperative opioid use and outpatient surgical adverse events

BACKGROUND

Opioid-related adverse drug events are common following inpatient surgical procedures. Little is known about opioid prescribing after outpatient surgical procedures and if opioid use is associated with short term risks of outpatient surgical adverse events (AEs).

METHODS

VA Corporate Data Warehouse was used to identify opioid use within 48 h for FY2012-14 chart-reviewed cases from a larger VA study of AEs in outpatient surgeries. We estimated a multilevel logistic regression model to determine the effect of opioid exposure on risk of AEs between 2 and 30 days postoperatively.

RESULTS

Of the 1730 outpatient surgical cases, 628 (36%) had postoperative opioid use and 12% had an AE. Opioid use following outpatient surgery was not significantly associated with higher surgical AE rates after controlling for relevant covariates (OR = 1.1 95% CI 0.79-1.54). Only procedure RVUs were associated with higher odds of postoperative AEs.

CONCLUSIONS

Postoperative opioid use following outpatient surgery is not a significant driver of postoperative AEs.

Development of an Adverse Event Surveillance Model for Outpatient Surgery in the Veterans Health Administration

OBJECTIVE

Develop and validate a surveillance model to identify outpatient surgical adverse events (AEs) based on previously developed electronic triggers.

DATA SOURCES

Veterans Health Administration's Corporate Data Warehouse.

STUDY DESIGN

Six surgical AE triggers, including postoperative emergency room visits and hospitalizations, were applied to FY2012-2014 outpatient surgeries (n = 744,355). We randomly sampled trigger-flagged and unflagged cases for nurse chart review to document AEs and measured positive predictive value (PPV) for triggers. Next, we used chart review data to iteratively estimate multilevel logistic regression models to predict the probability of an AE, starting with the six triggers and adding in patient, procedure, and facility characteristics to improve model fit. We validated the final model by applying the coefficients to FY2015 outpatient surgery data (n = 256,690) and reviewing charts for cases at high and moderate probability of an AE.

PRINCIPAL FINDINGS

Of 1,730 FY2012-2014 reviewed surgeries, 350 had an AE (20 percent). The final surveillance model c-statistic was 0.81. In FY2015 surgeries with >0.8 predicted probability of an AE (n = 405, 0.15 percent), PPV was 85 percent; in surgeries with a 0.4-0.5 predicted probability of an AE, PPV was 38 percent.

CONCLUSIONS

The surveillance model performed well, accurately identifying outpatient surgeries with a high probability of an AE.

Main outcomes of an RCT to pilot test reporting and feedback to foster research integrity climates in the VA

BACKGROUND

Assessing the integrity of research climates and sharing such information with research leaders may support research best practices. We report here results of a pilot trial testing the effectiveness of a reporting and feedback intervention using the Survey of Organizational Research Climate (SOuRCe).

METHODS

We randomized 41 Veterans Health Administration (VA) facilities to a phone-based intervention designed to help research leaders understand their survey results (enhanced arm) or to an intervention in which results were simply distributed to research leaders (basic arm). Primary outcomes were (1) whether leaders took action, (2) whether actions taken were consistent with the feedback received, and (3) whether responses differed by receptivity to quality improvement input.

RESULTS

Research leaders from 25 of 42 (59%) VA facilities consented to participate in the study intervention and follow-up, of which 14 were at facilities randomized to the enhanced arm. We completed follow-up interviews with 21 of the 25 leaders (88%), 12 from enhanced arm facilities. While not statistically significant, the proportion of leaders reporting taking some action in response to the feedback was twice as high in the enhanced arm than in the basic arm (67% vs. 33%, p = .20). While also not statistically significant, a higher proportion of actions taken among facilities in the enhanced arm were responsive to the survey results than in the basic arm (42% vs. 22%, p = .64).

CONCLUSIONS

Enhanced feedback of survey results appears to be a promising intervention that may increase the likelihood of responsive action to improve organizational climates. Due to the small sample size of this pilot study, even large percentage-point differences between study arms are not statistically distinguishable. This hypothesis should be tested in a larger trial.

The role of organizational structure in readiness for change: A conceptual integration

The purpose of this review is to extend extant conceptualizations of readiness for change as an individual-level phenomenon. This review-of-reviews focuses on existing conceptual frameworks from the dissemination, implementation, quality improvement, and organizational transformation literatures in order to integrate theoretical rationales for how organization structure, a key dimension of the organizational context, may impact readiness for change. We propose that the organization structure dimensions of differentiation and integration impact readiness for change at the individual level of analysis by influencing four key concepts of relevance, legitimacy, perceived need for change, and resource allocation. We identify future research directions that focus on these four key concepts.

The Role of Organizational Factors in the Provision of Comprehensive Women's Health in the Veterans Health Administration

BACKGROUND

Increasing numbers of women veterans present an organizational challenge to a health care system that historically has served men. Women veterans require comprehensive women's health services traditionally not provided by the Veterans Health Administration.

OBJECTIVE

Examine the association of organizational factors and adoption of comprehensive women's health care.

STUDY DESIGN

Cross-sectional analysis of the 2007 Veterans Health Administration National Survey of Women Veterans Health Programs and Practices.

METHODS

Dependent measures included a) model of women's health care: separate women's health clinic (WHC), designated women's health provider in primary care (DWHP), both (WHC+DWHP), or neither and b) the availability of five women's health services: cervical cancer screening and evaluation and management of vaginitis, menstrual disorders, contraception, and menopause. Exposure variables were organizational factors drawn from the Greenhalgh model of diffusion of innovations including measures of structure, absorptive capacity, and system readiness for innovation.

RESULTS

The organizational factors of a gynecology clinic, an academic affiliation with a medical school, a women's health representative on one or more high-impact committees, and a greater caseload of women veterans were more common at sites with WHCs and WHC+DWHPs, compared with sites relying on general primary care with or without a DWHP. Academic affiliation and high-impact committee involvement remained significant in multivariable analysis. Sites with WHCs or WHC+DWHPs were more likely to offer all five women's health services.

CONCLUSION

Facilities with greater apparent absorptive capacity (academic affiliation and women's health representation on high-impact committees) are more likely to adopt WHCs. Facilities with separate WHCs are more likely to deliver a package of women's health services, promoting comprehensive care for women veterans.

Initial Results from the Survey of Organizational Research Climates (SOuRCe) in the U.S. Department of Veterans Affairs Healthcare System

BACKGROUND

In service to its core mission of improving the health and well-being of veterans, Veterans Affairs (VA) leadership is committed to supporting research best practices in the VA. Recognizing that the behavior of researchers is influenced by the organizational climates in which they work, efforts to assess the integrity of research climates and share such information with research leadership in VA may be one way to support research best practices. The Survey of Organizational Research Climate (SOuRCe) is the first validated survey instrument specifically designed to assess the organizational climate of research integrity in academic research organizations. The current study reports on an initiative to use the SOuRCe in VA facilities to characterize the organizational research climates and pilot test the effectiveness of using SOuRCe data as a reporting and feedback intervention tool.

METHODS

We administered the SOuRCe using a cross-sectional, online survey, with mailed follow-up to non-responders, of research-engaged employees in the research services of a random selection of 42 VA facilities (e.g., Hospitals/Stations) believed to employ 20 or more research staff. We attained a 51% participation rate, yielding more than 5,200 usable surveys.

RESULTS

We found a general consistency in organizational research climates across a variety of sub-groups in this random sample of research services in the VA. We also observed similar SOuRCe scale score means, relative rankings of these scales and their internal reliability, in this VA-based sample as we have previously documented in more traditional academic research settings. Results also showed more substantial variability in research climate scores within than between facilities in the VA research service as reflected in meaningful subgroup differences. These findings suggest that the SOuRCe is suitable as an instrument for assessing the research integrity climates in VA and that the tool has similar patterns of results that have been observed in more traditional academic research settings.

CONCLUSIONS

The local and specific nature of organizational climates in VA research services, as reflected in variability across sub-groups within individual facilities, has important policy implications. Global, "one-size-fits-all" type initiatives are not likely to yield as much benefit as efforts targeted to specific organizational units or sub-groups and tailored to the specific strengths and weaknesses documented in those locations.

Team Process Variation Across Diabetes Quality of Care Trajectories

Conceptual frameworks in health care do not address mechanisms whereby teamwork processes affect quality of care. We seek to fill this gap by applying a framework of teamwork processes to compare different patterns of primary care performance over time. We thematically analyzed 114 primary care staff interviews across 17 primary care clinics. We purposefully selected clinics using diabetes quality of care over 3 years using four categories: consistently high, improving, worsening, and consistently low. Analyses compared participant responses within and between performance categories. Differences were observed among performance categories for action processes (monitoring progress and coordination), transition processes (goal specification and strategy formulation), and interpersonal processes (conflict management and affect management). Analyses also revealed emergent concepts related to psychological and organizational context that were reported to affect team processes. This study is a first step toward a comprehensive model of how teamwork processes might affect quality of care.

How personal and standardized coordination impact implementation of integrated care

BACKGROUND

Integrating health care across specialized work units has the potential to lower costs and increase quality and access to mental health care. However, a key challenge for healthcare managers is how to develop policies, procedures, and practices that coordinate care across specialized units. The purpose of this study was to identify how organizational factors impacted coordination, and how to facilitate implementation of integrated care.

METHODS

Semi-structured interviews were conducted in August 2009 with 30 clinic leaders and 35 frontline staff who were recruited from a convenience sample of 16 primary care and mental health clinics across eight medical centers. Data were drawn from a management evaluation of primary care-mental health integration in the US Department of Veterans Affairs. To protect informant confidentiality, the institutional review board did not allow quotations.

RESULTS

Interviews identified antecedents of organizational coordination processes, and highlighted how these antecedents can impact the implementation of integrated care. Overall, implementing new workflow practices were reported to create conflicts with pre-existing standardized coordination processes. Personal coordination (i.e., interpersonal communication processes) between primary care leaders and staff was reported to be effective in overcoming these barriers both by working around standardized coordination barriers and modifying standardized procedures.

DISCUSSION

This study identifies challenges to integrated care that might be solved with attention to personal and standardized coordination. A key finding was that personal coordination both between primary care and mental health leaders and between frontline staff is important for resolving barriers related to integrated care implementation.

CONCLUSION

Integrated care interventions can involve both new standardized procedures and adjustments to existing procedures. Aligning and integrating procedures between primary care and specialty care requires personal coordination amongst leaders. Interpersonal relationships should be strengthened between staff when personal connections are important for coordinating patient care across clinical settings.

The Effects of Organization Design and Patient Perceptions of Care on Switching Behavior and Reliance on a Health Care System Across Time

Sustaining ongoing relationships with patients is a strategic, clinically relevant goal of health care systems. This study develops and tests a conceptual model that aims to account for the influence of organization design, perceptions of quality of patient care, and other patient-level factors on the extent to which patients sustain reliance on a health care system. We use a longitudinal survey design and structural equation modeling to predict increases or decreases in patient reliance on the Department of Veterans Affairs health care system across a 4-year period for Veterans with Parkinson's Disease. Our findings show that specialized and integrated clinical practices have a positive association with the quality of patient care. Health care systems may be able to foster long-term relations with patients and improve service quality by allocating resources to form integrated, specialized, disease-specific centers of care designed for patients with chronic illnesses.

Leadership for evidence-based practice: strategic and functional behaviors for institutionalizing EBP

Background

Making evidence-based practice (EBP) a reality throughout an organization is a challenging goal in healthcare services. Leadership has been recognized as a critical element in that process. However, little is known about the exact role and function of various levels of leadership in the successful institutionalization of EBP within an organization.

Aims

To uncover what leaders at different levels and in different roles actually do, and what actions they take to develop, enhance, and sustain EBP as the norm.

Methods

Qualitative data from a case study regarding institutionalization of EBP in two contrasting cases (Role Model and Beginner hospitals) were systematically analyzed. Data were obtained from multiple interviews of leaders, both formal and informal, and from staff nurse focus groups. A deductive coding schema, based on concepts of functional leadership, was developed for this in-depth analysis.

Results

Participants’ descriptions reflected a hierarchical array of strategic, functional, and cross-cutting behaviors. Within these macrolevel “themes,” 10 behavioral midlevel themes were identified; for example, Intervening and Role modeling. Each theme is distinctive, yet various themes and their subthemes were interrelated and synergistic. These behaviors and their interrelationships were conceptualized in the framework “Leadership Behaviors Supportive of EBP Institutionalization” (L-EBP). Leaders at multiple levels in the Role Model case, both formal and informal, engaged in most of these behaviors.

Linking Evidence to Action

Supportive leadership behaviors required for organizational institutionalization of EBP reflect a complex set of interactive, multifaceted EBP-focused actions carried out by leaders from the chief nursing officer to staff nurses. A related framework such as L-EBP may provide concrete guidance needed to underpin the often-noted but abstract finding that leaders should “support” EBP.

Sustainability of quality improvement following removal of pay-for-performance incentives

BACKGROUND

Although pay-for-performance (P4P) has become a central strategy for improving quality in US healthcare, questions persist about the effectiveness of these programs. A key question is whether quality improvement that occurs as a result of P4P programs is sustainable, particularly if incentives are removed.

OBJECTIVE

To investigate sustainability of performance levels following removal of performance-based incentives.

DESIGN, SETTING, AND PARTICIPANTS

Observational cohort study that capitalized on a P4P program within the Veterans Health Administration (VA) that included adoption and subsequent removal of performance-based incentives for selected inpatient quality measures. The study sample comprised 128 acute care VA hospitals where performance was assessed between 2004 and 2010.

INTERVENTION

VA system managers set annual performance goals in consultation with clinical leaders, and report performance scores to medical centers on a quarterly basis. These scores inform performance-based incentives for facilities and their managers. Bonuses are distributed based on the attainment of these performance goals.

MEASUREMENTS

Seven quality of care measures for acute coronary syndrome, heart failure, and pneumonia linked to performance-based incentives.

RESULTS

Significant improvements in performance were observed for six of seven quality of care measures following adoption of performance-based incentives and were maintained up to the removal of the incentive; subsequently, the observed performance levels were sustained.

LIMITATIONS

This is a quasi-experimental study without a comparison group; causal conclusions are limited.

CONCLUSION

The maintenance of performance levels after removal of a performance-based incentive has implications for the implementation of Medicare's value-based purchasing initiative and other P4P programs. Additional research is needed to better understand human and system-level factors that mediate sustainability of performance-based incentives.

Mental health provider perspectives regarding integrated medical care for patients with serious mental illness

Integrated care for medical conditions is essential for persons with serious mental illness (SMI). This qualitative study describes mental health provider perspectives regarding barriers and facilitators of integrated care for patients with SMI. We interviewed providers from a national sample of Veterans Health Administration facilities that scored in the top or bottom percentile in medical care quality. Providers from high-performing sites reported substantial in-person contacts with general medical providers, while providers from low-performing sites reported stigma and limited communication with medical providers as major concerns. Interventions to improve mental health and medical provider communication may facilitate integrated care for persons with SMI.

Multilevel interventions: measurement and measures

BACKGROUND

Multilevel intervention research holds the promise of more accurately representing real-life situations and, thus, with proper research design and measurement approaches, facilitating effective and efficient resolution of health-care system challenges. However, taking a multilevel approach to cancer care interventions creates both measurement challenges and opportunities.

METHODS

One-thousand seventy two cancer care articles from 2005 to 2010 were reviewed to examine the state of measurement in the multilevel intervention cancer care literature. Ultimately, 234 multilevel articles, 40 involving cancer care interventions, were identified. Additionally, literature from health services, social psychology, and organizational behavior was reviewed to identify measures that might be useful in multilevel intervention research.

RESULTS

The vast majority of measures used in multilevel cancer intervention studies were individual level measures. Group-, organization-, and community-level measures were rarely used. Discussion of the independence, validity, and reliability of measures was scant.

DISCUSSION

Measurement issues may be especially complex when conducting multilevel intervention research. Measurement considerations that are associated with multilevel intervention research include those related to independence, reliability, validity, sample size, and power. Furthermore, multilevel intervention research requires identification of key constructs and measures by level and consideration of interactions within and across levels. Thus, multilevel intervention research benefits from thoughtful theory-driven planning and design, an interdisciplinary approach, and mixed methods measurement and analysis.

Factors affecting the use of patient survey data for quality improvement in the Veterans Health Administration

Background

Little is known about how to use patient feedback to improve experiences of health care. The Veterans Health Administration (VA) conducts regular patient surveys that have indicated improved care experiences over the past decade. The goal of this study was to assess factors that were barriers to, or promoters of, efforts to improve care experiences in VA facilities.

Methods

We conducted case studies at two VA facilities, one with stable high scores on inpatient reports of emotional support between 2002 and 2006, and one with stable low scores over the same period. A semi-structured interview was used to gather information from staff who worked with patient survey data at the study facilities. Data were analyzed using a previously developed qualitative framework describing organizational, professional and data-related barriers and promoters to data use.

Results

Respondents reported more promoters than barriers to using survey data, and particularly support for improvement efforts. Themes included developing patient-centered cultures, quality improvement structures such as regular data review, and training staff in patient-centered behaviors. The influence of incentives, the role of nursing leadership, and triangulating survey data with other data on patients' views also emerged as important. It was easier to collect data on current organization and practice than those in the past and this made it difficult to deduce which factors might influence differing facility performance.

Conclusions

Interviews with VA staff provided promising examples of how systematic processes for using survey data can be implemented as part of wider quality improvement efforts. However, prospective studies are needed to identify the most effective strategies for using patient feedback to improve specific aspects of patient-centered care.

Quality of general medical care among patients with serious mental illness: does colocation of services matter?

OBJECTIVE

This study was conducted to determine whether patients with serious mental illness receiving care in Veterans Affairs (VA) mental health programs with colocated general medical clinics were more likely to receive adequate medical care than patients in programs without colocated clinics based on a nationally representative sample.

METHODS

The study included all VA patients with diagnoses of serious mental illness in fiscal year (FY) 2006-2007 who were also part of the VA's External Peer Review Program (EPRP) FY 2007 random sample and who received care from VA facilities (N=107 facilities) with organizational data from the VA Mental Health Program Survey (N=7,514). EPRP included patient-level chart review quality indicators for common processes of care (foot and retinal examinations for diabetes complications; screens for colorectal health, breast cancer, and alcohol misuse; and tobacco counseling) and outcomes (hypertension, diabetes blood sugar, and lipid control).

RESULTS

Ten out of 107 (10%) mental health programs had colocated medical clinics. After adjustment for organizational and patient-level factors, analyses showed that patients from colocated clinics compared with those without colocation were more likely to receive foot exams (OR=1.87, p<.05), colorectal cancer screenings (OR=1.54, p<.01), and alcohol misuse screenings (OR=2.92, p<.01). They were also more likely to have good blood pressure control (<140/90 mmHg; OR=1.32, p<.05) but less likely to have glycosylated hemoglobin <9% (OR=.69, p<.05).

CONCLUSIONS

Colocation of medical care was associated with better quality of care for four of nine indicators. Additional strategies, particularly those focused on improving diabetes control and other chronic medical outcomes, might be warranted for patients with serious mental illness.

Financial incentives and accountability for integrated medical care in Department of Veterans Affairs mental health programs

OBJECTIVE

This study assessed the extent to which mental health leaders perceive their programs as being primarily accountable for monitoring general medical conditions among patients with serious mental illness, and it assessed associations with modifiable health system factors.

METHODS

As part of the Department of Veterans Affairs (VA) 2007 national Mental Health Program Survey, 108 mental health program directors were queried regarding program characteristics. Perceived accountability was defined as whether their providers, as opposed to external general medical providers, were primarily responsible for specific clinical tasks related to serious mental illness treatment or high-risk behaviors. Multivariable logistic regression was used to determine whether financial incentives or other system factors were associated with accountability.

RESULTS

Thirty-six percent of programs reported primary accountability for monitoring diabetes and cardiovascular risk after prescription of second-generation antipsychotics, 10% for hepatitis C screening, and 17% for obesity screening and weight management. In addition, 18% and 27% of program leaders, respectively, received financial bonuses for high performance for screening for risk of diabetes and cardiovascular disease and for alcohol misuse. Financial bonuses for diabetes and cardiovascular screening were associated with primary accountability for such screening (odds ratio=5.01, p<.05). Co-location of general medical providers was associated with greater accountability for high-risk behavior screening or treatment.

CONCLUSIONS

Financial incentives to improve quality performance may promote accountability in monitoring diabetes and cardiovascular risk assessment within mental health programs. Integrated care strategies (co-location) might be needed to promote management of high-risk behaviors among patients with serious mental illness.

Institutionalizing evidence-based practice: an organizational case study using a model of strategic change

BACKGROUND

There is a general expectation within healthcare that organizations should use evidence-based practice (EBP) as an approach to improving the quality of care. However, challenges exist regarding how to make EBP a reality, particularly at an organizational level and as a routine, sustained aspect of professional practice.

METHODS

A mixed method explanatory case study was conducted to study context; i.e., in terms of the presence or absence of multiple, inter-related contextual elements and associated strategic approaches required for integrated, routine use of EBP ('institutionalization'). The Pettigrew et al. Content, Context, and Process model was used as the theoretical framework. Two sites in the US were purposively sampled to provide contrasting cases: i.e., a 'role model' site, widely recognized as demonstrating capacity to successfully implement and sustain EBP to a greater degree than others; and a 'beginner' site, self-perceived as early in the journey towards institutionalization.

RESULTS

The two sites were clearly different in terms of their organizational context, level of EBP activity, and degree of institutionalization. For example, the role model site had a pervasive, integrated presence of EBP versus a sporadic, isolated presence in the beginner site. Within the inner context of the role model site, there was also a combination of the Pettigrew and colleagues' receptive elements that, together, appeared to enhance its ability to effectively implement EBP-related change at multiple levels. In contrast, the beginner site, which had been involved for a few years in EBP-related efforts, had primarily non-receptive conditions in several contextual elements and a fairly low overall level of EBP receptivity. The beginner site thus appeared, at the time of data collection, to lack an integrated context to either support or facilitate the institutionalization of EBP.

CONCLUSION

Our findings provide evidence of some of the key contextual elements that may require attention if institutionalization of EBP is to be realized. They also suggest the need for an integrated set of receptive contextual elements to achieve EBP institutionalization; and they further support the importance of specific interactions among these elements, including ways in which leadership affects other contextual elements positively or negatively.

Diabetes-related foot care at 10 Veterans Affairs medical centers: must do's associated with successful microsystems

BACKGROUND

Well-coordinated interdisciplinary preventive foot care has been reported to significantly reduce diabetes-related foot ulcers, amputations, and hospitalization. However, the contribution of the specific components leading to these "successes" is not fully characterized. The microsystem conceptual framework was adapted to foot care to determine which of the microsystem success characteristics were associated with decreased major lower-limb amputation rates at 10 Veterans Affairs (VA) medical centers.

METHODS

Two-day site visits were conducted using standardized interviews at the 10 VA medical centers.

RESULTS

Six "must do's" for foot care in microsystems were correlated at > or = (-.30) with amputation rates: (1) addressing all foot care needs, (2) appropriate referrals, (3) ease in recruiting staff, (4) confidence in staff, (5) available stand alone specialized diabetic foot care services, and (6) providers attending diabetic foot care education in the past three years. Using multiple linear regression, the sum of these items described 59% of the variance (p = 0.006).

DISCUSSION

Clinicians and managers may want to include the must-do's in system modifications to improve foot care for people with diabetes. Many of the sites displayed exemplary features in foot care, such as providing a formal orientation to the foot care clinics.

Impact of policies and performance measurement on development of organizational coordinating strategies for chronic care delivery

OBJECTIVE

To examine the impact of policy directives and performance feedback on the organization (specifically the coordination) of foot care programs for veterans, as mandated by public law within the Department of Veterans Affairs Health Care System (VA).

STUDY DESIGN

Case study of 10 VA medical centers performing diabetes-related amputations.

PATIENTS AND METHODS

Based on expert consensus, we identified 16 recommended foot care delivery coordination strategies. Structured interview protocols developed for primary care, foot care, and surgical providers, as well as administrators, were adapted from a prior study of surgical departments.

RESULTS

Although performance measurement results for foot risk screening and referral were high at all study sites over 2 calendar years (average 85%, range 69% to 92%), the number of coordination strategies implemented by any site was relatively low, averaging only 5.4 or 34% (range 1-12 strategies). No facility had systematically collected data to evaluate whether preventive foot care was provided to patients with high-risk foot conditions, or whether these patients had unmet foot care needs.

CONCLUSIONS

Although foot care policies and data feedback resulted in extremely high rates of adherence to foot-related performance measurement, there remained opportunities for improvement in the development of coordinated, technology-supported, data-driven, patient-centered foot care programs.

The Effects of Organization on Medical Utilization: An Analysis of Service Line Organization

OBJECTIVES

To determine whether clinical service lines in primary care and mental health reduces inpatient and urgent care utilization.

METHODS

All VHA medical centers were surveyed to determine whether service lines had been established in primary care or mental health care prior to the beginning of fiscal year 1997 (FY97). Facility-level data on medical utilization from Veterans Health Affairs (VHA) administrative databases were used for descriptive and multivariate regression analyses of utilization and of changes in measures between FY97 and FY98. Nine primary care-related and 5 mental health-related variables were analyzed.

PRINCIPAL FINDINGS

Primary care and mental health service lines had been established in approximately half of all facilities. Service lines varied in duration and extent of restructuring. Mere presence of a service line had no positive and several negative effects on measured outcome variables. More detailed analyses showed that some types of service lines have statistically significant and mostly negative effects on both mental health and primary care-related measures. Newly implemented service lines had significantly less improvement in measures over time than facilities with no service line.

CONCLUSIONS

Health care organizations are implementing innovative organizational structures in hopes of improving quality of care and reducing resource utilization. We found that service lines in primary care and mental health may lead to an initial period of disruption, with little evidence of a beneficial effect on performance for longer duration service lines.