Racial/ethnic differences in reporting versus rating of healthcare experiences

Understanding Patients' Negative Experiences with Telehealth: A Content Analysis of Survey Data

Understanding differences in how demographic groups experience telehealth may be relevant in addressing potential disparities in telehealth usage. We seek to identify and examine themes most pertinent to patients' negative telehealth experiences by age and race in order to inform interventions to improve patients' future telehealth experiences. We performed a content analysis of Press Ganey patient experience surveys from adult patients at 17 primary care sites of a large, public healthcare system with visits from April 30, 2020 to August 27, 2021. We used sentiment analysis to identify negative comments. We coded for content themes and analyzed their frequency, stratifying by age and race. We analyzed 745 negative comments. Most frequent themes differed by demographic categories, but overall, the most commonly applied codes were "Contacting the Clinic" (n = 97), "Connectivity" (n = 84), and "Webside Manner" (n = 79). The top three codes accounted for >40% of the negative codes in each race category and >35% of the negative codes in each age category. While there were common negative experiences among groups, patients of different demographics highlighted different aspects of their telehealth experiences for potential improvement.

Race, Ethnicity, and Other Patient and Clinical Encounter Characteristics Associated with Patient Experiences of Access to Care

The Press Ganey (PG) Outpatient Medical Practice Survey measures patients' experiences of healthcare access in the U.S. We aimed to identify differences in experiences of access to care by patient race, ethnicity, and other sociodemographic characteristics, an important first step in informing health policy and ensuring equitable healthcare delivery. We performed a cross-sectional analysis of PG surveys for adult outpatient visits within the University of Pennsylvania Health System from 2014-2017, including 119,373 unique patients. Compared with White patients, Black (odds ratio [OR] 0.84; 95% confidence interval [CI] 0.80-0.87), Asian (OR 0.62; 95% CI 0.58-0.66), and other/unknown race patients (OR 0.83; 95% CI 0.72-0.94) were each less likely to report the maximum score for timely access to care. Patients of all minoritized groups, as well as those whose primary language was not English, reported lower scores in secondary access measures related to communication and respect, compared to White and primarily English-speaking patients, respectively. Efforts to improve the experience of access to care among racial and ethnic minoritized patients are imperative to achieve equity in healthcare delivery.

Patient Experiences With Telehealth During Versus After a System-Wide Telehealth Mandate During the COVID-19 Pandemic

This study examines whether patients' telehealth experiences differed during a health system mandate for telehealth encounters due to the COVID-19 pandemic versus after the mandate was relaxed. Patient experience surveys from telehealth visits across 17 adult (age 18+) primary care sites at a large, urban public health system were analyzed during two periods: when a mandate was active (March 1, 2020-June 30, 2020) and when the mandate was relaxed and any appointment modality was available (July 1, 2020-November 30, 2021). Primary outcomes were odds ratios (ORs) comparing top-box percentages of survey responses at multiple levels: individual questions, four domains, and all questions together as a composite. Key findings: Patients had higher odds of selecting top-box answers in the elective telehealth period for the Care Provider (1.09 [95% confidence interval 1.03, 1.16]) and General Assessment (1.13 [1.02, 1.24]) domains and the survey composite (1.08 [1.04, 1.13]), but there was no difference for individual questions.Women reported more positive experiences during the elective telehealth period in the Access (1.22 [1.01, 1.47]), Care Provider (1.32 [1.17, 1.50]), and Telemedicine Technology (1.24 [1.04, 1.50]) domains.Our findings suggest that patients had better telehealth experiences when mandates were relaxed.

Telehepatology Satisfaction Is Associated with Ethnicity: The Real-World Experience of a Vulnerable Population with Fatty Liver Disease

BACKGROUND

Since the coronavirus disease 2019 (COVID-19) pandemic began, telemedicine use has transformed healthcare delivery. Yet there is concern that telemedicine may widen care disparities for vulnerable populations, and patient experience data are limited.

AIMS

We aimed to assess patient satisfaction with hepatology-related telemedicine (telehepatology) for delivery of fatty liver disease (FLD) care in a safety-net healthcare system.

METHODS

Adult patients with FLD were surveyed regarding satisfaction with telehepatology. Clinical, demographic, resources, and social determinants of health (SDoH) data were collected to identify factors associated with satisfaction through multivariable modeling.

RESULTS

From June 2020 to March 2022, 220 participants were enrolled: the median age was 52 years, 37% were men, and 68% were Hispanic. One hundred nineteen (54%) had prior telehepatology experience. Overall, satisfaction was high; 70% reported being somewhat or very satisfied. On univariate analysis, Hispanic ethnicity (versus non-Hispanic, OR 0.34, 95% CI 0.1-0.9, p = 0.03) and limited access to personal cellphone/internet (OR 0.16, 95% CI 0.04-0.6, p = 0.01) were associated with lower satisfaction. On multivariable logistic regression modeling adjusted for pandemic duration, age, sex, severity of liver disease, and coexisting liver disease, Hispanic ethnicity and lack of personal cellphone/internet remained independently associated with lower telehepatology satisfaction (OR 0.24, 95% CI 0.07-0.9, p = 0.03 and OR 0.2, 95% CI 0.04-0.9, p = 0.04, respectively). The association remained statistically significant after inclusion of various SDoH in the multivariable model.

CONCLUSIONS

Satisfaction with telehepatology among FLD patients in a safety-net clinical setting was high overall. However, Hispanic ethnicity and lack of personal cellphone/internet were independently associated with lower telehepatology satisfaction. A better understanding of patients' experience with telehepatology is needed to identify reasons for dissatisfaction, and in-person visits should remain an option for patients to ensure equitable care.

Patient satisfaction with telehealth versus in-person visits during COVID-19 at a large, public healthcare system

RATIONALE

During the coronavirus disease pandemic, audio-only and video telehealth visits became more widely available, but the relative patient satisfaction between telehealth and in-person modalities is not well-described.

AIMS AND OBJECTIVES

Our objective was to compare patient satisfaction with audio-only, video, and in-person adult primary care visits at a large, urban public healthcare system.

METHODS

In this cross-sectional study, we used aggregated data from Press Ganey patient satisfaction surveys at 17 primary care facilities at New York City Health + Hospitals for visits between 1 June 2021 to 30 November 2021. We compared mean scores for questions common to surveys for each modality in domains of Access, Care Provider, and Overall Assessment using pairwise comparisons with two-tailed t-tests.

RESULTS

There were 7,183/79,562 (9.0%) respondents for in-person visits and 1,009/15,092 (6.7%) respondents for telehealth visits. Compared to respondents for in-person visits, respondents for telehealth visits were more likely to be aged 35-64 years, Asian, and speak English as their primary language, and less likely to be ≥65 years old, Black or other race, and speak Spanish or another language as their primary language (p < 0.001). Patients reported higher mean satisfaction for Access measures for telehealth visits than in-person visits (p < 0.001). For Care Provider satisfaction questions, video visits generally had higher mean scores than in-person and, in turn, audio-only visits. For Overall Assessment questions, video visits had higher mean scores than in-person and, subsequently, audio-only visits.

CONCLUSION

Of the visit modalities, video visits had the highest mean satisfaction scores across all domains. Telehealth may improve experiences with access, but audio-only visits may provide poorer visit experiences.

Relationship between Patient Experience Scores and Health Insurance

(1) Background: the patient experience may be a performance indicator in value-based reimbursement. Accordingly, providers have an incentive to understand factors that affect their patients’ experiences. This study evaluated the relationship between health insurance type and patient experience ratings. (2) Methods: individual-level demographic, health/healthcare, and patient experience data were extracted from the Full-Year Consolidated Data File of the 2019 Medical Expenditure Panel Surveys. A logistic regression was used to evaluate whether how persons—included in this study’s analytic sample (aged 18 and over with complete covariate information)—rated the healthcare they received from all their providers was associated with their health insurance types controlling for covariates. (3) Results: relative to people 18−64 years of age with private health insurance, people 18−64 years of age without health insurance were less likely to rank their healthcare as a 9 or 10—where a 10 indicates the best possible care—(OR: 0.69; p = 0.015) while people aged 65 years or over with Medicare (OR: 1.34; p = 0.002) or with Medicare/private health insurance (OR: 1.48; p < 0.001) were more likely to rank their healthcare as a 9 or 10. (4) Conclusions: Select health insurance types were associated with how patients rate their healthcare. Stakeholders could use this information to create programs aimed to improve patient experience.

Patient Experience Scores for Radiologists: Comparison With Nonradiologist Physicians and Changes After Public Posting in an Institutional Online Provider Directory

BACKGROUND. Patients are increasingly using online information regarding patient experiences to guide care decisions. OBJECTIVE. The purpose of our study was to compare patient experience scores between radiologists and nonradiologist physicians and to assess changes in scores after their public posting in an online physician directory. METHODS. This retrospective study included data collected from May 1, 2017, to November 30, 2018, at a single large academic medical center. After all institutional outpatient visits, patients were e-mailed the Press Ganey Medical Practice Survey, which included 10 questions (answered using a Likert scale and converted to 100-point range) relating to the patient's experience with the specific provider for the encounter. Surveys were distributed to patients after radiology encounters if involving an image-guided invasive procedure. Mean scores for each question and the mean weighted overall score were displayed on each physician's publicly available profile on the hospital's online physician directory and were updated monthly. Scores were compared between radiologists and nonradiologist physicians; temporal changes were assessed. RESULTS. The response rate was 18.0% (96,057/533,983). After exclusions (23,989 surveys completed without provider ratings; 183 surveys evaluating physician assistants), 71,885 physician surveys were evaluated: 2703 surveys for 65 radiologists, 49,403 surveys for 916 physicians in 17 nonsurgical specialties, and 19,779 surveys for 262 physicians in 13 surgical specialties. Over the study period, the mean overall score was 95.6 for radiologists and 95.9 for nonradiologists (94.6 for surgical specialties, 96.4 for nonsurgical specialties). For the 10 individual questions, scores ranged for radiologists from 94.6 (time spent with patient) to 96.8 (friendliness/courtesy) and for nonradiologists from 94.6 (time spent with patient) to 97.0 (friendliness/courtesy). The mean overall score increased from the first month to the final month for radiologists from 94.2 to 97.1 and for nonradiologists from 95.7 to 96.3. For radiologists, the largest improvement was for instructions regarding postprocedure follow-up care (increased from 91.4 to 97.4). CONCLUSION. Radiologists received high scores on patient experience surveys when evaluated on encounters involving invasive procedures, achieving scores similar to those for other physicians. Scores improved over time, possibly related to online posting of survey results. CLINICAL IMPACT. The findings support the utility of implementing patient experience surveys in radiology.

Do Patients Continue to Use Video Visits? Factors Related to Continued Video Visit Use

Many studies have assessed the factors associated with overall video visit use during the COVID-19 pandemic, but little is known about who is most likely to continue to use video visits and why. The authors combined a survey with electronic health record data to identify factors affecting the continued use of video visit. In August 2020, a stratified random sample of 20,000 active patients from a large health care system were invited to complete an email survey on health care seeking preferences during the COVID. Weighted logistic regression models were applied, adjusting for sampling frame and response bias, to identify factors associated with video visit experience, and separately for preference of continued use of video visits. Actual video visit utilization was also estimated within 12 months after the survey. Three thousand three hundred fifty-one (17.2%) patients completed the survey. Of these, 1208 (36%) reported having at least 1 video visit in the past, lowest for African American (33%) and highest for Hispanic (41%). Of these, 38% would prefer a video visit in the future. The strongest predictors of future video visit use were comfort using video interactions (odds ratio [OR] = 5.30, 95% confidence interval [95% CI]: 3.57-7.85) and satisfaction with the overall quality (OR = 3.94, 95% CI: 2.66-5.86). Interestingly, despite a significantly higher satisfaction for Hispanic (40%-55%) and African American (40%-50%) compared with Asian (29%-39%), Hispanic (OR = 0.46, 95% CI: 0.12-0.88) and African American (OR = 0.54, 95% CI: 0.16-0.90) were less likely to prefer a future video visit. Disparity exists in the use of video visit. The association between patient satisfaction and continued video visit varies by race/ethnicity, which may change the future long-term video visit use among race/ethnicity groups.

Impact of an Interprofessional Health Student Education Program on Older Adult Participants

Training health professional students to work with older adults will improve future workforce capacity to meet growing needs. Additionally, older adults may benefit from health education and interactions with health professional students. We analyzed survey responses from older adults who had participated in an interprofessional health student education program regarding their experiences. Qualitative data were summed and averaged, and quantitative survey data were analyzed with Fisher’s Exact Test. At least 60% of participants reported receiving information for health needs or making changes to physical activity, dental care, or diet. The most significant differences in lifestyle modifications were noted among racial and ethnic minorities and among speakers of different primary languages. 64% of the qualitative responses reflected positive affirmation of the program. Our data suggest that interactions with health students are meaningful experiences for older adults, are associated with healthy habit changes, and reflect demographic differences in response to health education.

The Gaps of Healthcare Service Quality in Nurse Practitioner Practice and Its Associated Factors From the Patients' Perspective

PURPOSE

This study investigates the expectations, perceptions, and gaps of the healthcare service quality (HSQ) from the patients' perspective, and explores the significant demographic and clinical factors associated with the HSQ in nurse practitioner practice (NPP).

DESIGN

A cross-sectional design was carried out, with convenience sampling performed under the NPP in Taiwan, from June to November 2016.

METHODS

The Nurse Practitioner Healthcare Service Quality Scale was used to assess the expectations, perceptions, and gaps of the HSQ. The demographics, clinical characteristics, and symptom severity of patients were collected, and the Importance-Performance Analysis was applied to identify the priority of ranking items for the improvement of nurse practitioners (NPs). The Generalized Estimating Equation was used to explore the factors associated with the HSQ in NPP.

FINDINGS

A total of 200 patients completed the questionnaires. The results revealed that the patients had overall high expectations (M = 6.35, SD = 0.46), moderate perceptions (M = 4.21, SD = 0.95), and a mild HSQ gap (M = -2.14, SD = 0.69), with statistically significant differences (p < .001). In NPP, the largest gap in the HSQ dimensions was reliable responsiveness, followed by empathy, assurance, and tangibility. Patients with greater symptom severity and a longer in-hospital stay were associated with larger HSQ gaps; however, patients who were transferred from the emergency department had smaller gaps than those in the outpatient department.

CONCLUSIONS

The patients' expectations were not fully satisfied in the NPP, especially for the dimensions of reliable responsiveness and empathy. The patients' symptom severity was a significant factor related to the gaps in the HSQ. The awareness of unmet needs, from the patients' perspective, could guide the convergence of a rational policy to promote healthcare delivery in the NPP.

CLINICAL RELEVANCE

The managers of NPP need to pay attention to increasing NPs' reliable responsiveness and empathy, by setting the appropriate scope of practice, regulating the NP-to-patient ratio, applying for certification programs in prescribing training, and cultivating patient-centered care with shared decision making. In addition, building up the knowledge and competency of symptom management is also suggested for NP training.

Relationship of Press Ganey Satisfaction and PROMIS Function and Pain in Foot and Ankle Patients

BACKGROUND

Patient satisfaction has garnered interest as a tool to measure health care quality. However, orthopedic studies in total joint arthroplasty, spine, and hand patients have offered conflicting relationships between Press Ganey (PG) satisfaction metrics and patient-reported outcome (PRO) measures. No prior study has assessed the relationship between PG and PROs in foot and ankle patients. Whether satisfaction and outcomes instruments, though, measure similar or differing aspects of the patient experience is unclear. Here, we tested if there was an association between Patient-Reported Outcomes Measurement Information System (PROMIS) outcomes and PG satisfaction scores.

METHODS

PG and PROMIS outcomes data for new patient visits to an orthopedic foot and ankle clinic between 2015 and 2017 were retrospectively analyzed. Patients that completed PG satisfaction surveys were included for study. All patients who completed PG surveys and completed one or both PROMIS physical function (PF) or pain interference (PI) metrics administered by computerized adaptive testing were included. Negative binomial regressions were used to compare PRO scores to PG overall satisfaction and PG satisfaction with care provider, adjusting for patient characteristics. Results were reported as dissatisfaction score ratios, which represented the amount of PG dissatisfaction associated with a 10-point increase in PROMIS PF or PI. Of the 3984 new patient visits, only 441 completed the PG survey (11.3% response rate).

RESULTS

Ceiling effects were seen with PG data: 64% of patients reported perfect satisfaction with care provider and 27% had perfect overall satisfaction. Higher function on the PROMIS PF was weakly associated with increased overall satisfaction (ratio = 0.82, 95% CI: 0.68-0.99, P = .039) and increased satisfaction with care provider (ratio = 0.60, 95% CI: 0.40-0.92, P = .019). However, pain (PROMIS PI) was not associated with overall satisfaction or with satisfaction with care provider.

CONCLUSIONS

Based on our data here, patient satisfaction was weakly related to patient-reported function but not pain interference among this subset of new patients presenting to a foot and ankle clinic. Given our essentially negative findings, further study is needed to determine which aspects of the PG satisfaction and PROMIS scores track similarly. Further, our findings add to the growing literature showcasing limitations of the PG tool, including low response rates and notable ceiling effects. If satisfaction metrics and patient-reported outcomes capture differing aspects of the patient experience, we need to better understand how that influences the measurement of health care quality and value.

LEVEL OF EVIDENCE

Level III, comparative study.

The Relationship Between Primary Care Physician Burnout and Patient-Reported Care Experiences: a Cross-sectional Study

BACKGROUND

Primary care physician (PCP) burnout is prevalent and on the rise. Physician burnout may negatively affect patient experience of care.

OBJECTIVE

To identify the direct impact of PCP burnout on patient experience in various domains of care.

DESIGN

A cross-sectional observational study using physician well-being (PWB) surveys collected in 2016-2017, linked to responses from patient experience of care surveys. Patient demographics and practice characteristics were derived from the electronic health record. Linked data were analyzed at the physician level.

SETTING

A large non-profit multi-specialty ambulatory healthcare organization in northern California.

PARTICIPANTS

A total of 244 physicians practicing internal medicine or family medicine who responded to the PWB survey (response rate 72%), and 30,701 completed experience surveys from patients seeing these physicians.

MEASUREMENTS

Burnout was measured with a validated single-item question with a 5-point scale ranging from (1) enjoy work to (5) completely burned out and seeking help. Patient experience of patient-provider communication, access, and overall rating of provider was measured with Clinician & Group Consumer Assessment of Healthcare Providers & Systems (CG-CAHPS) survey. Patient experience scores (0-100 scale) were adjusted for age, gender, race/ethnicity, and English proficiency.

RESULTS

Physician burnout had a negative impact on patient-reported experience of patient-provider communication but not on access or overall rating of providers. A one-level increase in burnout was associated with 0.43 decrease in adjusted patient-provider communication experience score (P < 0.01).

LIMITATIONS

Data came from a single large healthcare organization. Patterns may differ for small- and mid-sized practices.

CONCLUSION

Physician burnout adversely affects patient-provider communication in primary care visits. Efforts to improve physician work environments could have a meaningful positive impact on patient experience as well as physician well-being.

Patient Satisfaction Surveys in the Outpatient Clinic Setting: The Variability of Response With Positively or Negatively Toned Questions

The purpose of this study was to determine whether a patient satisfaction survey in the outpatient clinic setting using questions with either a positive or negative tone would produce consistent responses. This was a prospective study using a 20-question paper survey delivered to medical students who were asked to rate on a scale of 1 to 10 to what degree they either agree or disagree with statements regarding their most recent personal outpatient clinic health care visit (any medical specialty). The same survey was administered again through an e-mail link 1 week later. One hundred fifty (77%) students completed the 20-item survey and 53 (35%) of the participating students completed the follow-up e-mail survey. Seven of the 10 question pairs on the paper survey revealed statistically significant differences in responses based on tone, with greater values for disagreement with negatively toned questions than values representing agreement with positive-toned questions. The match rates for similar questions posed on the paper survey and then the e-mail survey 1 week later ranged between 27.8% and 56.6%. This study demonstrated that, with an outpatient health care patient satisfaction survey, disagreement with a negative-toned question was stronger than agreement with a positive-toned question. There was poor correlation between survey responses when first posed on a paper survey and then repeated on a digital survey 1 week later. These findings suggest that the wording of survey questions may affect responses and that survey answers change with time and across delivery platforms.