Survey Instruments to Assess Patient Experiences With Access and Coordination Across Health Care Settings: Available and Needed Measures

Content validity of patient-reported measures evaluating experiences of the quality of transitions in healthcare settings-a scoping review

No reviews so far have been conducted to define the constructs of patient-experienced quality in healthcare transitions or to identify existing generic measures of patients' experience of the quality within healthcare transitions. Our aim was to identify domains relevant for people experiencing healthcare transitions when evaluating the quality of care they have received, map the comprehensiveness of existing patient-reported experience measures (PREM), and evaluate the PREMs' content validity. The method was guided by the Joanna Briggs Institutes' guidance for scoping reviews. The search was performed on 07 December 2021 and updated 27 May 2024, in the electronic databases Medline (Ovid), Embase (Ovid), and Cinahl (EBSCO). The search identified 20,422 publications, and 190 studies were included for review. We identified 30 PREMs assessing at least one aspect of adults' experience of transitions in healthcare. Summarising the content, we consider a model with two domains, organisational and human-relational, likely to be adequate. However, a more comprehensive analysis and adequate definition of the construct is needed. None of the PREMs were considered content valid.

Validation of the Amharic version of perceived access to healthcare services for patients with cervical cancer in Ethiopia: A second-order confirmatory factor analysis

BACKGROUND

Accessing healthcare services is a multifaceted phenomenon involving various elements, encompassing the demand, identification, reach, and utilization of healthcare needs. The literature offers methods for capturing patients' perceptions of healthcare access. However, to accurately measure patient perceptions, it is imperative to ensure the validity and reliability of such instruments by designing and implementing localized language versions.

AIM

The primary aim of this study was to validate the Amharic version of the perceived access to health-care services among patients diagnosed with cervical cancer in Ethiopia.

METHOD

A cross-sectional study was conducted among cervical cancer patients at oncology centers in Addis Ababa, Ethiopia. A consecutive sampling approach was used and data collection took place from January 1 to March 30, 2023. Following initial validation and pretesting, a KoboCollect mobile phone application was employed for data collection. Subsequently, the collected data underwent cleaning in Microsoft Excel and analysis through Amos software v.26 and R programming. Various validity and reliability tests, such as content validity, convergent validity, face validity, divergent validity, known-group validity, and reliability tests, were executed. A second-order confirmatory factor analysis was developed to calculate incremental model fit indices, including CFI and TLI, along with absolute measures, namely SRMR and RMSEA.

RESULTS

A total of 308 participants were involved in the study, with 202 (65.6%) being patients referred from outside Addis Ababa. The initial evaluation of content validity by expert panels indicated that all criteria were met, with a CVR range of 0.5 to 1, I-CVI values ranging from 0.75 to 1, an S-CVI value of 0.91, and face validity values ranging from 2.4 to 4.8. The internal consistency of items within the final constructs varied from 0.76 to 0.93. Convergent, known-group, and most divergent validity tests fell within acceptable fit ranges. Common incremental fit measures for CFI and TLI were achieved with corresponding values of 0.95 and 0.94, respectively. The absolute fit measures of SRMR and RMSEA were 0.04 and 0.07, indicating good and moderate fit, respectively.

CONCLUSION

The study indicated a high internal consistency and validity of items with good fit to the data, suggesting potential accuracy of the domains. A five-domain structure was developed which enables adequate assessment of perceived access to health-care services of patients with cervical cancer in Ethiopia. We suggest that the tool can be utilized in other patient populations with a consideration of additional constructs, such as geographic accessibility.

Understanding Hawaiian Identity and Well-being to Improve Mental Health Outcomes for Hawaiian Young Adults

The mental health crisis among Native Hawaiian young adults is exacerbated by colonization-related risk factors, yet cultural identity stands as a key protective element. This study explored the link between cultural identity and stress, employing cultural reclamation theory, and surveyed 37 Native Hawaiians aged 18-24 through the Native Hawaiian Young Adult Well-being Survey. Engagement with culture, the significance of Hawaiian identity, and stress were assessed, revealing significant correlations between cultural and demographic factors and stress levels. Participants displayed high cultural engagement and valued their Hawaiian identity, with gender and education levels playing a notable role in stress. These findings highlight the importance of including Native Hawaiian perspectives in mental health research and may guide the development of targeted interventions.

Healthcare access and health equity: intricate challenges for rare diseases

No abstract available.

Development and calibration data for the Healthcare Access Item Bank: a new computer adaptive test for persons with type 2 diabetes mellitus

PURPOSE

The purpose of this study was to develop a new measure to evaluate the ability to receive medical services when needed among persons with type 2 diabetes mellitus.

METHODS

The Healthcare Access measure was developed using data from 225 persons with type 2 diabetes mellitus who completed an item pool comprised of 54 questions pertaining to their experience accessing healthcare services.

RESULTS

Exploratory and confirmatory factor analyses supported the retention of 45 items. In addition, a constrained graded response model (GRM), as well as analyses that examined item misfit and differential item functioning (investigated for age, sex, education, race, and socioeconomic status), supported the retention of 44 items in the final item bank. Expert review and GRM item calibration products were used to inform the selection of a 6-item static short form and to program the Healthcare Access computer adaptive test (CAT). Preliminary data supported the reliability (i.e., internal consistency and test-retest reliability) and validity (i.e., convergent, discriminant, and known-groups) of the new measure.

CONCLUSIONS

The new Healthcare Access item bank can be used to examine the experiences that persons with type 2 diabetes mellitus have with healthcare access, to better target treatment improvements and mitigate disparities; it will be available as a part of the Neuro-Qol measurement system through healthmeasures.net and the PROMIS Application Programmable Interface (API) in early 2023.

Psychometric Properties of the Access of Older Adults to Outpatient Primary-Care Health Services Scale

This study evaluates the psychometric properties of the Access of Older Adults to Outpatient Primary-Care Health Services Scale (AOAOPHSS), in research conducted among 707 Mexican older adults selected by convenience from 14 rural and one urban locations. The AOAOPHSS explores 10 dimensions of two integrated subscales: Accessibility and Personal Abilities. Data analysis was performed in five phases. First, potentially biased responses were identified. Second, the response efficiency of the items and their association with external variables were evaluated. Third, the basic properties of the scores for the subscales' dimensions of the AOAOPHSS were identified using non-parametric Mokken Scaling Analysis (MSA). Fourth, the Structural Equation Modeling methodology was used to identify the properties of the internal structure of the latent construct. Finally, reliability and internal consistency were evaluated at both score and item levels. The following findings emerged. 13 items with inefficient response options were removed, and 24 were retained using the MSA. The latent structure of the latter was defined based on 21 items of five Accessibility Subscale dimensions. Its internal consistency reliability ranged between 0.67 and 0.81 (omega coefficients) and between 0.61 and 0.78 (alpha coefficients). Accordingly, this paper discusses the overall implications of using the Accessibility Subscale.

Development and psychometric properties of a short version of the Patient Continuity of Care Questionnaire

INTRODUCTION

Hospitalization due to cardiac conditions is increasing worldwide, and follow-up after hospitalization usually occurs in a different healthcare setting than the one providing treatment during hospitalization. This leads to a risk of fragmented care and increases the need for coordination and continuity of care after hospitalization. Furthermore, international reports highlight the importance of improving continuity of care and state that it is an essential indicator of the quality of care. Patients' perceptions of continuity of care can be evaluated using the Patient Continuity of Care Questionnaire (PCCQ). However, the original version is extensive and may prove burdensome to complete; therefore, we aimed to develop and evaluate a short version of the PCCQ.

METHODS

This was a psychometric validation study. Content validity was evaluated among user groups, including patients (n = 7), healthcare personnel (n = 15), and researchers (n = 7). Based on the results of the content validity and conceptual discussions among the authors, 12 items were included in the short version. Data from patients were collected using a consecutive sampling procedure involving patients 6 weeks after hospitalization due to cardiac conditions. Rasch analysis was used to evaluate the psychometric properties of the short version of the PCCQ.

RESULTS

A total of 1000 patients were included [mean age 72 (SD = 10), 66% males]. The PCCQ-12 presented a satisfactory overall model fit and a person separation index of 0.79 (Cronbach's α: .91, ordinal α: .94). However, three items presented individual item misfits. No evidence of multidimensionality was found, meaning that a total score can be calculated. A total of four items presented evidence of response dependence but, according to the analysis, this did not seem to affect the measurement properties or reliability of the PCCQ-12. We found that the first two response options were disordered in all items. However, the reliability remained the same when these response options were amended. In future research, the benefits of the four response options could be evaluated.

CONCLUSION

The PCCQ-12 has sound psychometric properties and is ready to be used in clinical and research settings to measure patients' perceptions of continuity of care after hospitalization.

PATIENT OR PUBLIC CONTRIBUTION

Patients, healthcare personnel and researchers were involved in the study because they were invited to select items relevant to the short version of the questionnaire.

Long drives and red tape: mapping rural veteran access to primary care using causal-loop diagramming

Background

Rural veterans experience more challenges than their urban peers in accessing primary care services, which can negatively impact their health and wellbeing. The factors driving this disparity are complex and involve patient, clinic, health system, community and policy influences. Federal policies over the last decade have relaxed requirements for some veterans to receive primary care services from community providers through their VA benefits, known as community care.

Methods

We used a participatory systems mapping approach involving causal-loop diagramming to identify interrelationships between variables underlying challenges to veteran access to primary care and potential opportunities for change—known as leverage points in systems science. Our methods involved a secondary analysis of semi-structured qualitative interviews with rural veterans, VA staff, non-VA clinic staff and providers who serve rural veterans, and veteran service officers (VSOs) in the Northwest region of the US, followed by a two-part participatory modeling session with a study advisory board. We then applied Meadows’s leverage point framework to identify and categorize potential interventions to improve rural veteran access to primary care.

Results

The final model illustrated challenges at the veteran, clinic, and system levels as experienced by stakeholders. Main components of the diagram pertained to the choice of VA or non-VA primary care, veteran satisfaction with the VA, enrollment in VA benefits and other insurance, community care authorization, reimbursement of non-VA care, referrals to specialty care, record sharing and communication between VA and non-VA providers, institutional stability of the VA, and staffing challenges. Fourteen interventions, including administrative and communications changes, were identified by analyzing the model using the leverage points framework.

Conclusions

Our findings illustrate how challenges rural veterans face accessing health care are interconnected and persist despite recent changes to federal law pertaining to the VA health care system in recent years. Systems mapping and modeling approaches such as causal-loop diagramming have potential for engaging stakeholders and supporting intervention and implementation planning.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08318-2.

Content Validity of a Scale Designed to Measure the Access of Older Adults to Outpatient Health Services

The objective of this work was to validate the content of a scale formulated in Spanish for older adults in Mexico, with the aim of comprehensively measuring the access of this population group to outpatient primary-care services. To this end, we carried out a methodological content-validity study in four stages: (1) construction of the scale; (2) evaluation of item legibility; (3) quantitative content evaluation by two groups of judges selected by convenience: participant-judges including older adults with adequate reading comprehension, surveyed in person (n = 23), and expert-judges comprised of researchers specialized in the fields of health services, psychometrics and aging, surveyed online (n = 7); and (4) collection of qualitative feedback from several of the participant-judges (older adults, n = 4). The content was validated both by sequentially examining the level of consensus in the responses of both groups of judges, using the Tastle and Wierman method, and by calculating Aiken's Validity Coefficient with a 90% confidence interval. The scale contained 65 items pertaining to 10 dimensions of two major constructs: accessibility (n = 39) and personal abilities (n = 26). Five items were eliminated in accordance with the minimum-consensus criterion (0.5). This is the first psychometric scale to be developed in Mexico with the view of integrating the characteristics of health-care services and the abilities of the older adults in a single questionnaire designed to measure the access of this population group to outpatient primary-care services.

Patients' Perspectives on Determinants Avoidable Hospitalizations: Development and Validation of a Questionnaire

Ambulatory care sensitive conditions (ACSC) can be avoided through effective care in the ambulatory setting. Patients are the most qualified individuals to express the social and individual contexts of their own experience. Thus, understanding why potentially preventable hospitalizations occur is important to develop patient-centred policies or interventions that may reduce them. This study aims to develop and validate a questionnaire to capture the patients’ perspective on the causes of the hospitalizations for ACSC. The development of a new questionnaire involved four phases: a literature review, face validity, pre-test, and validation. We conducted a three-step face validity verification to confirm the relevance of the identified determinants and to collect determinants not previously identified by interviewing healthcare providers, representatives of patients’ associations, and patients. Determinants were identified through the literature review predominantly in the “Healthcare Access”, “Disease self-management”, and “Social Support” domains. The validated resulting questionnaire comprises 25 questions, distributed by two dimensions (individual/contextual) covering seven domains and 20 determinants of ACSC hospitalization. Currently, there are no validated instruments as comprehensive and easy to use as the one described in this paper. This questionnaire should provide a base for further language/context validations.

Aligning quality improvement efforts and policy goals in a national integrated health system

OBJECTIVE

To describe the design and impact of a systematic, enterprise-wide process for engaging US Department of Veterans Affairs (VA) leadership in prioritizing scarce implementation and evaluation resources.

DATA SOURCES

From 2017 to 2021, the VA Quality Enhancement Research Initiative (QUERI) identified priorities from local, regional, and national leaders through qualitative discussions and a national survey and tracked impacts via reports generated from competitively funded initiatives addressing these priorities.

STUDY DESIGN

Guided by the Learning Health System framework and QUERI Implementation Roadmap, QUERI engaged stakeholders to nominate and rank-order priorities, peer-reviewed and funded initiatives to scale up and spread evidence-based practices (EBPs) using theory-based implementation strategies, and evaluated the impact of these initiatives using the QUERI Impact Framework.

DATA COLLECTION/EXTRACTION METHODS

QUERI collected priority nominations through qualitative discussions and a web-based survey, and live voting was used to rank-order priorities. QUERI-funded teams regularly submitted progress reports describing the key activities, findings, and impacts of the quality improvement (QI) initiatives using a standardized form created in the VA Research Electronic Data Capture (REDCap).

PRINCIPAL FINDINGS

QUERI launched five QI initiatives to address priorities selected by VA leadership. In partnership with 28 health system leaders, these initiatives are implementing 10 EBPs across 53 sites, supporting 1055 VA employees in delivering evidence-based care. The success of these initiatives led to an expansion of QUERI's process to address 2021 VA leadership priorities: virtual care, health disparities, delayed or suppressed care due to COVID-19, employee burnout, long-term and home care options, and quality and cost of community care.

CONCLUSIONS

QUERI, a unique program embedded in a national integrated health system, deployed a novel approach to inform policy making and enhance the real-world impact of research through prioritization of limited resources, rigorous peer-review, and assessment of impacts on the health system, employees, and Veterans.

Revisiting the four core functions (4Cs) of primary care: operational definitions and complexities

BACKGROUND

The four primary care (PC) core functions (the '4Cs', ie, first contact, comprehensiveness, coordination and continuity) are essential for good quality primary healthcare and their achievement leads to lower costs, less inequality and better population health. However, their broad definitions have led to variations in their assessment, in the innovations implemented to improve these functions and ultimately in their performance.

OBJECTIVES

To update and operationalise the 4Cs' definitions by using a literature review and analysis of enhancement strategies, and to identify innovations that may lead to their enhancement.

METHODS

Narrative, descriptive analysis of the 4Cs definitions, coming from PC international reports and organisations, to identify measurable features for each of these functions. Additionally, we performed an electronic search and analysis of enhancement strategies to improve these four Cs, to explore how the 4Cs inter-relate.

RESULTS

Specific operational elements for first contact include modality of contact, and conditions for which PC should be approached; for comprehensiveness, scope of services and spectrum of population needs; for coordination, links between PC and higher levels of care and social/community-based services, and workforce managing transitions and for continuity, type, level and context of continuity. Several innovations like enrolment, digital health technologies and new or enhanced PC provider's roles, simultaneously influenced two or more of the 4Cs.

CONCLUSION

Providing clear, well-defined operational elements for these 4Cs to measure their achievement and improve the way they function, and identifying the complex network of interactions among them, should contribute to the field in a way that supports efforts at practice innovation to optimise the processes and outcomes in PC.

Psychometric evaluation of the perceived access to health care questionnaire

BACKGROUND AND OBJECTIVE

Access to health care is a universal concern. Therefore, this study was conducted to develop a questionnaire to assess the Perceived Access to Health care based on Penchansky and Thomas's definition of access and the assessment of its psychometric properties.

METHOD

The initial questionnaire contains 31 items developed based on a deductive approach with an extensive review of the related literature. Content validity, face validity, construct validity, internal consistency, and instrument reliability were further examined. Data analysis was conducted using SPSS software version 24, R software version 4, and lavaan package.

RESULTS

The initial questionnaire was examined using qualitative content validity, and the necessary modifications were applied to each item. The content validity ratio (CVR) was approved in 30 items with a value greater than 0.78, and one item with a CVR value lower than 0.78 was removed. In the case of the content validity index (CVI), 29 items were approved with a CVI value of greater than 0.79, and one item with a CVI value between 0.70 and 0.79 was revised. In qualitative face validity, all items were approved by a panel of experts and the participants. All 30 items with an impact score index higher than 1.5 were approved for the next steps. The confirmatory factor analysis results showed that the six-factor model of access to health care has an appropriate fit. Cronbach's alpha coefficient for the questionnaire was calculated 0.86. The value of Cronbach's alpha for the dimensions of availability, accessibility, affordability, accommodation, acceptability, and awareness were 0.61, 0.76, 0.66, 0.60, 0.80, and 0.76, respectively. The Intraclass Correlation Index (ICC) value for reliability (test-retest) of the whole instrument was calculated 0.94 using the two-way mixed absolute agreement method.

CONCLUSION

The success of health programs depends on eliminating barriers to access to provided health care services. One of the most critical barriers to understanding access is a perception of limited access. This questionnaire might be used further to understand perceived health care access in different global contexts.

Development of a specialty intensity score to estimate a patient's need for care coordination across physician specialties

BACKGROUNDS AND AIMS

This article develops a Specialty Intensity Score, which uses patient diagnosis codes to estimate the number of specialist physicians a patient will need to access. Conceptually, the score can serve as a proxy for a patient's need for care coordination across doctors. Such a measure may be valuable to researchers studying care coordination practices for complex patients. In contrast with previous comorbidity scores, which focus primarily on mortality and utilization, this comorbidity score approximates the complexity of a patient's the interaction with the health care system.

METHODS

We use 2015 inpatient claims data from the Centers for Medicare and Medicaid Services to model the relationship between a patient's diagnoses and physician specialty usage. We estimate usage of specialist doctors by using a least absolute shrinkage and selection operator Poisson model. The Specialty Intensity Score is then constructed using this predicted specialty usage. To validate our score, we test its power to predict the occurrence of patient safety incidents and compare that with the predictive power of the Charlson comorbidity index.

RESULTS

Our model uses 127 of the 279 International Classification of Disease, 10th Revision, Clinical Modification (ICD-10-CM) diagnosis subchapters to predict specialty usage, thus creating the Specialty Intensity Score. This score has significantly greater power in predicting patient safety complications than the widely used Charlson comorbidity index.

CONCLUSION

The Specialty Intensity Score developed in this article can be used by health services researchers and administrators to approximate a patient's need for care coordination across multiple specialist doctors. It, therefore, can help with evaluation of care coordination practices by allowing researchers to restrict their analysis of outcomes to the patients most impacted by those practices.

Factors Associated With Patient Ratings of Timeliness of Primary Care Appointments

As access is the lowest rated dimension in surveys of outpatient experience, we sought to identify patient, practice, and provider factors associated with positive ratings of timeliness of primary care appointments. A cross-sectional study with multivariable, multilevel logistic regression was performed using survey responses from 236 695 individuals receiving care in the Veterans Health Administration (VA). Top box ratings (response of "always") for whether the patient reported receiving an appointment as soon as they needed in primary care for routine care and for care needed right away were the main outcomes. Independent variables capturing patient, practice, and provider factors were obtained from survey responses and VA databases. Degree of continuity with primary care provider and duration of relationship were strongly associated with higher ratings. Shorter primary care appointment wait times for both new and returning patients were associated with higher ratings. Independent wait times for mental health and specialty appointments had no effect. Older age, better self-reported physical and mental health, lower disease complexity, and rural residence were patient factors associated with higher ratings while gender, race, ethnicity, and education had little effect. Measures of continuity with primary care provider as well as appointment wait times have strong association with positive patient ratings of appointment timeliness. Patients treated in Veterans Affairs clinics may value continuity with their primary care provider over longer times. Initiatives to improve access could focus on improving continuity and ensuring efforts to improve access do not impact continuity.

Psychometric Properties of the Assessment of Perceived Access to Care (APAC) Instrument

Valid measures of perceived access are needed to measure whether health care systems are providing adequate access. This research reports on the psychometric properties of the Assessment of Perceived Access to Care (APAC), which was administered to 1004 Community Health Center patients screening positive for psychiatric disorders. Known-group validity was good, with 6 of the 8 hypothesized associations between social determinants of access and perceived access being significant (P < .01). Better access was significantly (P < .01) correlated with more outpatient mental health visits, indicating good convergent validity. The test-retest Pearson correlation coefficient (0.64) was statistically significant (P < .01). The APAC has acceptable psychometric properties.

Veteran Perspectives on Care Coordination Between Veterans Affairs and Community Providers: A Qualitative Analysis

OBJECTIVE

To investigate veteran perspectives on challenges in care coordination between US Department of Veterans Affairs (VA) clinics and community providers in rural areas.

METHODS

We completed qualitative interviews with a geographically diverse sample of 51 veterans who had used both VA and community health care services. Interviews were audio-recorded and transcribed verbatim. We used directed content analysis (informed by previous work with VA and community staff) to elucidate findings, while remaining attentive to emergent themes.

RESULTS

We report results in 5 key domains related to interorganizational care coordination: organizational mechanisms, organizational culture, relational practices, contextual factors, and the role of the Third-Party Administrators responsible for scheduling and payment for community services. Veterans described successes and challenges in interorganizational coordination across these domains, while also reporting a variety of workarounds and mitigation strategies.

CONCLUSIONS

Veterans living in rural areas face myriad challenges when using health care services both within and outside of VA. In the absence of strong mechanisms for ensuring coordination and communication between health care providers at different institutions, veterans themselves may carry the primary burden for coordinating their care. Our results suggest the utility of both structural and relational approaches to enhancing interorganizational care coordination in these settings.

Patterns of patient experience with primary care access in Australia, Canada, New Zealand and Switzerland: a comparative study

OBJECTIVE

Access to primary care (PC) is vital, but complex to define and compare between settings. We aimed to generate a typology of patients' access patterns across countries using a novel inductive approach.

DESIGN

Cross-sectional surveys.

SETTING

Australia, Canada, New Zealand and Switzerland between 2012 and 2014 as part of the QUALICO-PC project.

PARTICIPANTS

Data were collected from 1306 general practices and 10 000+ patients, with nine patients per practice.

INTERVENTION(S)

None.

MAIN OUTCOME MEASURE(S)

Typology of access.

RESULTS

Three axes were retained, explaining 23% of the total variance: (i) 'temporal and geographical access'; (ii) 'frequency of access and unmet healthcare needs'; and (iii) 'affordability and frequency of access'.Based on the three axes, we identified four clusters of patients: (i) patients reporting overall good access to PC; (ii) frequent users with unmet healthcare needs; (iii) under-users with financial barriers; and (iv) users with poor time/geographical access.Better access to PC was experienced in Switzerland and New Zealand, while worst access was reported in Canada, where most of the time and geographical barriers were reported. Most financial barriers were observed in Australia and New Zealand. Frequent users with some level of unmet healthcare needs are prevalent in all four countries.

CONCLUSIONS

Four main groups of patients with different patterns of access were identified: (i) good access; (ii) geographical and time barriers; (iii) financial barriers; and (iv) frequent users with unmet healthcare needs. Differences in access between the four countries are substantial.

Patient experience of health care system hassles: Dual-system vs single-system users

OBJECTIVE

To compare health care system problems or "hassles" experienced by Veterans receiving VA health care only versus those receiving dual care from both VA and non-VA community providers.

DATA SOURCES

We collected survey data in 2017-2018 from 2444 randomly selected Veterans with four or more primary care visits in the prior year at one of 12 VA primary care clinics located in four geographically diverse regions of the United States.

STUDY DESIGN

We used baseline surveys from the Coordination Toolkit and Coaching quality improvement project to explore Veterans' experience of hassles (dependent variable), source of health care, self-rated physical and mental health, and sociodemographics.

DATA COLLECTION

Participants responded to mailed surveys by mail, telephone, or online.

PRINCIPAL FINDINGS

The number of reported hassles ranged from 0 to 16; 79 percent of Veterans reported experiencing one or more hassles. Controlling for sociodemographic characteristics and self-rated physical and mental health, zero-inflated negative binominal regression indicated that dual care users experienced more hassles than VA-only users (adjusted predicted average 5.5 [CI: 5.2, 5.8] vs 4.3 [CI: 4.1, 4.6] hassles [P < .0001]).

CONCLUSIONS

Anticipated increases in Veterans accessing community-based care may require new strategies to help VA primary care teams optimize care coordination for dual care users.

Combining Surgical Outcomes and Patient Experiences to Evaluate Hospital Gastrointestinal Cancer Surgery Quality

BACKGROUND

Assessments of surgical quality should consider both surgeon and patient perspectives simultaneously. Focusing on patients undergoing major gastrointestinal cancer surgery, we sought to characterize hospitals, and their patients, on both these axes of quality.

METHODS

Using the American College of Surgeons' National Surgical Quality Improvement Program registry, hospitals were profiled on a risk-adjusted composite measure of death or serious morbidity (DSM) generated from patients who underwent colectomy, esophagectomy, hepatectomy, pancreatectomy, or proctectomy for cancer between January 1, 2015 and December 31, 2016. These hospitals were also profiled using the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey. Highest-performing hospitals on both quality axes, and their respective patients, were compared to the lowest-performing hospitals.

RESULTS

Overall, 60,526 patients underwent their cancer operation at 530 hospitals. There were 38 highest- and 48 lowest-performing hospitals. The correlation between quality axes was poor (ρ = 0.10). Compared to the lowest-performing hospitals, the highest-performing hospitals were more often NCI-designated cancer centers (29.0% vs. 4.2%, p = 0.002) and cared for a lower proportion of Medicaid patients (0.14 vs. 0.23, p < 0.001). Patients who had their operations at the lowest- versus highest-performing hospitals were more often black (17.2% vs. 8.4%, p < 0.001), Hispanic (8.3% vs. 3.5%, p < 0.001), functionally dependent (3.8% vs. 0.9%, p < 0.001), and not admitted from home (4.4% vs. 2.4%, p < 0.001).

CONCLUSIONS

Hospital performance varied when assessed by both risk-adjusted surgical outcomes and patient experiences. In this study, poor-performing hospitals appeared to be disproportionately serving disadvantaged and minority cancer patients.

Recommendations for the Evaluation of Cross-System Care Coordination from the VA State-of-the-art Working Group on VA/Non-VA Care

In response to widespread concerns regarding Veterans' access to VA care, Congress enacted the Veterans Access, Choice and Accountability Act of 2014, which required VA to establish the Veterans Choice Program (VCP). Since the inception of VCP, more than two million Veterans have received care from community providers, representing approximately 25% of Veterans enrolled in VA care. However, expanded access to non-VA care has created challenges in care coordination between VA and community health systems. In March 2018, the VA Health Services Research & Development Service hosted a VA State of the Art conference (SOTA) focused on care coordination. The SOTA convened VA researchers, program directors, clinicians, and policy makers to identify knowledge gaps regarding care coordination within the VA and between VA and community systems of care. This article provides a summary and synthesis of relevant literature and provides recommendations generated from the SOTA about how to evaluate cross-system care coordination. Care coordination is typically evaluated using health outcomes including hospital readmissions and death; however, in cross-system evaluations of care coordination, measures such as access, cost, Veteran/patient and provider satisfaction (including with cross-system communication), comparable quality metrics, context (urban vs. rural), and patient complexity (medical and mental health conditions) need to be included to fully evaluate care coordination effectiveness. Future research should examine the role of multiple individuals coordinating VA and non-VA care, and how these coordinators work together to optimize coordination.

Adaptation and psychometric properties of the Norwegian version of the heart continuity of care questionnaire (HCCQ)

BACKGROUND

Continuity of cardiac care after hospital discharge is a priority, especially as healthcare systems become increasingly complex and fragmented. There are few available instruments to measure continuity of cardiac care, especially from the patient perspective. The aim of this study was (1) to translate and adapt the Heart Continuity of Care Questionnaire (HCCQ) to conditions in Norway, and (2) to determine its psychometric properties in self-report format administered to patients after percutaneous coronary intervention (PCI).

METHODS

The HCCQ was first translated into Norwegian from the original English version, following a widely used cross-cultural adaptation process. Data were collected before hospital discharge and in a follow-up after 2 months. To assess psychometric properties, a confirmatory factor analysis (CFA) was performed and three aspects of construct validity were evaluated: structural validity, hypotheses testing and cross-cultural validation. Internal consistency of the HCCQ subscales was calculated using Cronbach's alpha, while intra-class correlation (ICC) was used to assess test-retest reliability. Additionally, socio-demographic and patient-reported data were collected to correlate with HCCQ scores.

RESULTS

Of those included at baseline, 436 (76%) completed the questionnaires after 2 months. CFA suggested that the fit of the HCCQ data to a 3-factor model was modest (RMSEA = 0.11, CFI = 0.90, TLI = 0.90). However, convergent validity was satisfactory, based on existing research. Internal consistency was good, as indicated by its Cronbach's alphas: total continuity of care (0.95); informational (0.93), relational (0.87), and management (0.89) continuity. The ICC for the total HCCQ score was 0.80 (95% CI [0.71, 0.87] p < 0.001). As indicated by negative care experiences (rated as 1 or 2 on the five-point scale), patients seemed to have limited knowledge about medical treatment, lifestyle modification and follow-up after PCI. Participation in cardiac rehabilitation and longer consultations with the general practitioner after hospital discharge were positively correlated with better continuity of care.

CONCLUSIONS

Implementation of the HCCQ will likely support healthcare providers and researchers in identifying problem areas of continuity of cardiac care and in evaluating interventions aimed at improving continuity of care.

Pay-for-Performance and Veteran Care in the VHA and the Community: a Systematic Review

BACKGROUND

Although pay-for-performance (P4P) strategies have been used by the Veterans Health Administration (VHA) for over a decade, the long-term benefits of P4P are unclear. The use of P4P is further complicated by the increased use of non-VHA healthcare providers as part of the Veterans Choice Program. We conducted a systematic review and key informant interviews to better understand the effectiveness and potential unintended consequences of P4P, as well as the implementation factors and design features important in both VHA and non-VHA/community settings.

METHODS

We searched PubMed, PsycINFO, and CINAHL through March 2017 and reviewed reference lists. We included trials and observational studies of P4P targeting Veteran health. Two investigators abstracted data and assessed study quality. We interviewed VHA stakeholders to gain further insight.

RESULTS

The literature search yielded 1031 titles and abstracts, of which 30 studies met pre-specified inclusion criteria. Twenty-five examined P4P in VHA settings and 5 in community settings. There was no strong evidence supporting the effectiveness of P4P in VHA settings. Interviews with 17 key informants were consistent with studies that identified the potential for overtreatment associated with performance metrics in the VHA. Key informants' views on P4P in community settings included the need to develop relationships with providers and health systems with records of strong performance, to improve coordination by targeting documentation and data sharing processes, and to troubleshoot the limited impact of P4P among practices where Veterans make up a small fraction of the patient population.

DISCUSSION

The evidence to support the effectiveness of P4P on Veteran health is limited. Key informants recognize the potential for unintended consequences, such as overtreatment in VHA settings, and suggest that implementation of P4P in the community focus on relationship building and target areas such as documentation and coordination of care.