Assessing patient activation and health literacy in the ED

Completeness and readability of GPT-4-generated multilingual discharge instructions in the pediatric emergency department

Objectives

The aim of this study was to assess the completeness and readability of generative pre-trained transformer-4 (GPT-4)-generated discharge instructions at prespecified reading levels for common pediatric emergency room complaints.

Materials and Methods

The outputs for 6 discharge scenarios stratified by reading level (fifth or eighth grade) and language (English, Spanish) were generated fivefold using GPT-4. Specifically, 120 discharge instructions were produced and analyzed (6 scenarios: 60 in English, 60 in Spanish; 60 at a fifth-grade reading level, 60 at an eighth-grade reading level) and compared for completeness and readability (between language, between reading level, and stratified by group and reading level). Completeness was defined as the proportion of literature-derived key points included in discharge instructions. Readability was quantified using Flesch-Kincaid (English) and Fernandez-Huerta (Spanish) readability scores.

Results

English-language GPT-generated discharge instructions contained a significantly higher proportion of must-include discharge instructions than those in Spanish (English: mean (standard error of the mean) = 62% (3%), Spanish: 53% (3%), P = .02). In the fifth-grade and eighth-grade level conditions, there was no significant difference between English and Spanish outputs in completeness. Readability did not differ across languages.

Discussion

GPT-4 produced readable discharge instructions in English and Spanish while modulating document reading level. Discharge instructions in English tended to have higher completeness than those in Spanish.

Conclusion

Future research in prompt engineering and GPT-4 performance, both generally and in multiple languages, is needed to reduce potential for health disparities by language and reading level.

Assessment Tools for Measuring Health Literacy and Digital Health Literacy in a Hospital Setting: A Scoping Review

Assessment of (digital) health literacy in the hospital can raise staff awareness and facilitate tailored communication, leading to improved health outcomes. Assessment tools should ideally address multiple domains of health literacy, fit to the complex hospital context and have a short administration time, to enable routine assessment. This review aims to create an overview of tools for measuring (digital) health literacy in hospitals. A search in Scopus, PubMed, WoS and CINAHL, following PRISMA guidelines, generated 7252 hits; 251 studies were included in which 44 assessment tools were used. Most tools (57%) were self-reported and 27% reported an administration time of <5 min. Almost all tools addressed the domain 'understanding' (98%), followed by 'access' (52%), 'apply' (50%), 'appraise' (32%), 'numeracy' (18%), and 'digital' (18%). Only four tools were frequently used: the Newest Vital Sign (NVS), the Short Test of Functional Health Literacy for Adults ((S)TOFHLA), the Brief Health Literacy Screener (BHLS), and the Health Literacy Questionnaire (HLQ). While the NVS and BHLS have a low administration time, they cover only two domains. HLQ covers the most domains: access, understanding, appraise, and apply. None of these four most frequently used tools measured digital skills. This review can guide health professionals in choosing an instrument that is feasible in their daily practice, and measures the required domains.

Universal Precautions Plus: Physician-Directed Strategies for Improving Patient Health Literacy in the Emergency Department

Working on the frontlines with safety-net populations, emergency physicians are uniquely positioned to take on a greater role in addressing the current health literacy crisis and specific barriers that may exist. Here, we review the concept of universal health literacy precautions and explore the application of these universal precautions in conjunction with other patient-centered strategies. More specifically, to improve patient understanding and outcomes, emergency physicians can pair universal health literacy precautions with strategies including multiple learning techniques, dual-code theory, empowerment counseling, family buy-in, and hands-on practice. We provide two examples of emergency department encounters where this combined approach was used differently yet successfully and efficiently. Ultimately, we aim to highlight the value of emergency physicians being equipped with basic skills in health literacy educational strategies.

Improving Communication with Patients Discharged from the Emergency Department with Noncardiac Chest Pain: A Scoping Review with Narrative Synthesis

Background

This scoping review with narrative synthesis aimed to analyze scholarly peer-reviewed articles reporting on improving communication with patients discharged from the emergency department with noncardiac chest pain and qualitatively narrate on and summarize items that can be used in guiding communication with patients discharged from the emergency department with noncardiac chest pain.

Methods

The databases of EMBASE/PubMed, Scopus, COCHRANE, CInAHL/EBESCO, UW libraries, and Google Scholar were searched using relevant MeSH and key terms up to February 06, 2020. The selected articles were analyzed for their contents. Items guiding discharge communication were summarized qualitatively.

Results

Twenty-five articles were eligible for full review. These were published in between 1994 and 2020. Of those, 16 (64.0%) originated from the United States and 4 (16%) used some interventional design. A total of 45 different items that could be used in guiding discharge communication with patients presenting to the emergency department with chest pain were identified from the studies included in this review. Items were grouped under 6 categories that were related to initial assessment (8 items), information on diagnosis (7 items), information on discharge (9 items), follow-up suggestions (7 items), symptoms that promote return to the emergency department (7 items), and treatment plan (7 items).

Conclusion

Communication with patients discharged from the emergency department with noncardiac chest pain can be improved. Results of this investigation might be helpful in guiding quality improvement projects aimed for further improvement of communication with patients discharged from the emergency department with noncardiac chest pain.

Are Health Literacy and Patient Activation Related to Health Outcomes in Breast Cancer Patients?

Background:

Assessing health literacy and patient activation at the beginning of care could facilitate the provision of appropriate information to patients with breast cancer and increase the effectiveness of interventions geared toward improving patient involvement in self-managing their health and, consequently, their quality of life.

Objective:

The aim of this study was to evaluate cancer health literacy and patient activation in patients with breast cancer as well as examine their relationships to health-related quality of life (HRQoL) and resource use.

Methods:

Patients with breast cancer positive for human epidermal growth factor receptor 2 (HER2+) receiving care at 12 oncology clinics in Texas were offered participation in the study via convenience sampling. The survey consisted of the 6-item Cancer Health Literacy Tool, the 13-item Patient Activation Measure, the 27-item Functional Assessment of Cancer Therapy – General (version 4), and single-item measures for number of emergency department visits and hospitalizations as well as clinical and demographic characteristics.

Key Results:

The mean age of the 146 study participants was 57.1 ± 10.8 years; 92% (n = 134) had a high probability (≥0.7) of adequate cancer health literacy whereas 68% percent (n = 99) had high patient activation (level 3 or 4). Cancer health literacy had significant positive relationships with education and household income. Patient activation, education, and number of treatment types received explained 23% of the variation in HRQoL, and all except cancer health literacy were positive and significant predictors. No bivariate/multivariate analysis was conducted for emergency department visits and hospitalizations because there were few reported incidents.

Conclusions:

Interventions that aim to improve HRQoL in patients with breast cancer could target modifiable factors like patient activation. The homogeneity of cancer health literacy among study participants might have influenced its nonsignificant relationship with HRQoL and patient activation. Further assessments of health literacy and patient activation in larger and more diverse populations of patients with breast cancer are warranted. [HLRP: Health Literacy Research and Practice. 2021;5(3):e171–e178.]

Plain Language Summary:

In this study, the majority of patients with breast cancer were found to have high levels of cancer health literacy, patient activation, and health-related quality of life (HRQoL). The significant relationship between patient activation and HRQoL implies that patients with breast cancer who are able to actively participate in managing their health and health care are more likely to have higher HRQoL. Interventions that aim to improve HRQoL in patients with breast cancer could target modifiable factors like patient activation.

Health literacy and patient activation among adults with chronic diseases in Singapore: A cross-sectional study

AIMS

Increased patient activation levels can improve health outcomes. Hence, this study aims to examine the relationships between sociodemographic variables and domain-specific health literacies with patient activation.

DESIGN

A cross-sectional design.

METHODS

200 outpatient adults with chronic diseases completed a survey that assessed their domain-specific health literacy and patient activation levels. Univariate and multivariate analysis of the variables were conducted on patient activation with 95% confidence interval (CI).

RESULTS

Multiple linear regression analyses observed a positive linear relationship between the following domain-specific health literacy variables-"actively manage my health" (p < .0001, 95% CI: 0.89-2.29), "understanding health information" (p = .008, 95% CI: 0.28-1.85), and "finding good health information" (p = .02, 95% CI 0.13-1.51) with patient activation. The other sociodemographic and clinical variables were not statistically significant. Increased focus from healthcare professionals is needed on helping patients better find and understand health information and encouraging them to actively manage their health; elements which would raise their activation levels.

Development and psychometric study of a simple instrument to assess patient communication and comprehension skills: the AsCkS

BACKGROUND

Instruments to examine patients' communication skills are impractical for daily clinical practice in primary health care, and it is assumed that health care professionals are always aware of the communication and comprehension status of patients.

OBJECTIVE

To design and examine the psychometric properties of a new questionnaire (AsCkS) to screen patients' risk of low communication and comprehension skills.

METHODS

Designing the new questionnaire involved: (i) a content validity study to generate a set of items, (ii) administration of a questionnaire in a sample of patients and (iii) study of the psychometric properties using a Rasch probabilistic model. The test probability function was used to detect patients at risk of having low communication and comprehension skills, and the associated factors were studied using multivariate logistic regression.

RESULTS

Five items were generated and 369 patients screened. In the Rasch analysis, one item was removed due to a lack of goodness-of-fit (Outfit = 3.64). The final set of four items showed good reliability (person separation index = 0.90). Convergent validity was moderate for the health literacy construct (r = 0.53) and low for the patient activation (r = 0.38): 77 patients (20.86%) were at risk of having low communication and comprehension skills. After adjustment, the associated factors were age (p < 0.001) and lower educational level (p < 0.001).

CONCLUSION

The AsCkS is a reliable and valid instrument and may be used to detect patients requiring a greater effort by the physician to communicate health care messages.

Factors Associated with High Patient Activation Level among Individuals with Metabolic Syndrome at a Primary Care Teaching Clinic

Background: High activation level has been associated with higher education background, better self-rated health status, and having adequate health literacy. However, there is a gap in the literature regarding the level of activation and the factors associated with it among patients with metabolic syndrome (MetS) in the Malaysian primary care setting. Objectives: This study aims to determine activation levels and the factors associated with high activation among individuals with MetS in primary care. Methods: A cross-sectional study was conducted at a university primary care clinic. Patient activation was measured using the Patient Activation Measure®-13 Malay version. Activation levels were dichotomized into "low activation" (levels 1 and 2) and "high activation" (levels 3 and 4). To determine the factors associated with high activation, simple logistic regressions (SLogR) followed by multiple logistic regressions (MLogR) were performed. Results: Of 333 participants, 280 (84.1%) were included in the final analysis. The mean activation score was 59.4 (SD ±10.20) and 61.8% had high activation level. Two variables were found to be significant on MLogR. Those who were employed have the odds of 3.135 (95% CI 1.442-6.816) of having high activation compared with those who were unemployed. Those with good self-reported health status have the odds of 6.482 (95% CI 1.243-33.792) of having high activation compared to those with poor self-reported health status. Conclusions: The majority of participants had high activation levels. Those who were employed and those who had good self-reported health status were more likely to have high activation levels. Findings of this study could be used to develop patient activation interventions to improve self-management skills among individuals with MetS in primary care. These may include problem solving support, individualized care plans, peer or family support, and skill building. Those in high activation group can be trained to become mentors to support their peers who have low activation level.

Patient-reported Outcome Measures in Emergency Care Research: A Primer for Researchers, Peer Reviewers, and Readers

Patient-reported outcomes (PROs) are of increasing importance in clinical research because they capture patients' experience with well-being, illness, and their interactions with health care. Because PROs tend to focus on specific symptoms (e.g., pain, anxiety) or general assessments of patient functioning and quality of life that offer unique advantages compared to traditional clinical outcomes (e.g., mortality, emergency department revisits), emergency care researchers may benefit from incorporation of PRO measures into their research design as a primary or secondary outcome. Patients may also benefit from the ability of PROs to inform clinical practice and facilitate patient decision making, as PROs are obtained directly from the lived experience of other patients with similar conditions or health status. This review article introduces and defines key terminology relating to PROs, discusses reasons for utilizing PROs in clinical research, outlines basic psychometric and practical assessments that can be used to select a specific PRO measure, and highlights examples of commonly utilized PRO measures in emergency care research.

Limited Ability of Three Health Literacy Screening Items to Identify Adult English- and Spanish-Speaking Emergency Department Patients With Lower Health Literacy

STUDY OBJECTIVE

Brief, easily administered, and valid health literacy assessment tools are needed to optimize health care delivery in the emergency medicine setting. Three health literacy screening items have been proposed to assess health literacy in outpatient settings. We investigated their ability to identify English- and Spanish-speaking adult emergency department (ED) patients with lower health literacy.

METHODS

Participants were Spanish- or English-speaking adult patients randomly selected from 4 geographically spread, US, urban, safety-net EDs. Participants completed the 3 health literacy screening items, as well as the Short Assessment of Health Literacy-Spanish and English (SAHL-S&E). Test performance characteristics, including receiver operating characteristics area under the curve, of the 3 health literacy screening items were estimated, as compared with the SAHL-S&E.

RESULTS

According to the SAHL-S&E, 36% of the 1,165 English speakers and 35% of the 1,605 Spanish speakers had lower health literacy. Areas under the curve for each health literacy screening item individually were: needing others to help read materials (English 0.59, 95% confidence interval [CI] 0.56 to 0.62; Spanish 0.58, 95% CI 0.56 to 0.61), problems learning because of difficulty reading (English 0.63, 95% CI 0.60 to 0.66; Spanish 0.59, 95% CI 0.56 to 0.62), and confidence with completing forms (English 0.62, 95% CI 0.59 to 0.65; Spanish 0.60, 95% CI 0.57 to 0.63). Areas under the curve for the 3 screening items combined were: English 0.66 (95% CI 0.63 to 0.70) and Spanish 0.62 (95% CI 0.59 to 0.64).

CONCLUSION

The 3 health literacy screening items performed poorly in identifying adult ED patients with lower health literacy. Higher-validity screening measures are needed to better serve the health care needs of this vulnerable population in the ED setting.

Patient Activation: A Key Component of Successful Advance Care Planning

Background: Patient activation-or knowledge, confidence, and skill managing overall health-is associated with improved health behaviors such as exercise; it is unknown whether it is associated with advance care planning (ACP). Objective: To determine whether patient activation is associated with ACP. Design: This is a cross-sectional study. Setting/Subjects: A total of 414 veterans (≥60 years) with serious and chronic illness enrolled in an ACP trial. Measures: Patient characteristics and self-report surveys included the validated 13-item patient activation measure (PAM, five-point Likert) (e.g., "Taking an active role in your own healthcare is the most important factor…") categorized into four levels (e.g., Level 1: "disengaged and overwhelmed" to Level 4: "maintaining behaviors"). ACP was measured with the ACP Engagement Survey including 57-item process scores (i.e., knowledge, contemplation, self-efficacy, readiness, 5-point Likert scale) and 25-item action scores (i.e., surrogate designation, yes/no items). Associations were determined with linear regression. Results: Participants were 71.1 ± 7.8 years of age, 43% were non-white, 9% were women, and 20% had limited health literacy. Higher PAM levels were associated with higher finances, having adult children, lower comorbidity, and more social support (p < 0.05). After adjusting for these characteristics, higher PAM (Level 4 vs. Level 1) was associated with higher ACP engagement (ACP process scores, 2.8 ± 0.7 vs. 3.8 ± 0.7 and action scores 9.7 ± 4.4 vs. 15.1 ± 6.0, p < 0.001). Conclusions: Higher patient activation to manage one's overall healthcare is associated with higher engagement in ACP. Interventions designed to foster general patient activation and self-efficacy to engage in health behaviors and disease management may also improve engagement in the ACP process.

The relationship between health literacy and patient activation among frequent users of healthcare services: a cross-sectional study

BACKGROUND

Frequent users of healthcare services are a vulnerable population that deserves attention due to high costs and negative outcomes such as lower quality of life and higher mortality. Healthcare systems should offer interventions tailored to their needs and to their level of health literacy, including strategies to promote activation. The relationship between health literacy and patient activation remains to be explored. The aim of this study was to examine the association between health literacy and patient activation in a population of frequent users of healthcare services with chronic diseases.

METHODS

Cross-sectional data were collected (before randomization) through a clinical trial evaluating a case management intervention in primary care. Participants (n = 247) were recruited from the list of frequent users of 4 Family Medicine Groups (FMG) in the Saguenay-Lac-St-Jean region of Québec (Canada). They completed questionnaires by self-report during an encounter with a research assistant: (1) the Newest Vital Sign (NVS) to evaluate health literacy (independent variable); and (2) the Patient Activation Measure-13 (PAM-13) to evaluate patient activation (dependent variable). The relationship between health literacy and activation was examined using biserial correlations.

RESULTS

No association was found between health literacy (independent variable) and patient activation (rb = 0.075, ρ = 0.07) for this population of frequent users of healthcare services.

CONCLUSIONS

This study suggests that there is no relationship between health literacy and patient activation among frequent users of healthcare services.

TRIAL REGISTRATION

NCT01719991 . Registered October 25, 2012.

Development and Validation of the Consumer Health Activation Index

BACKGROUND

Although there has been increasing interest in patient engagement, few measures are publicly available and suitable for patients with limited health literacy.

OBJECTIVE

We sought to develop a Consumer Health Activation Index (CHAI) for use among diverse patients.

METHODS

Expert opinion, a systematic literature review, focus groups, and cognitive interviews with patients were used to create and revise a potential set of items. Psychometric testing guided by item response theory was then conducted among 301 English-speaking, community-dwelling adults. This included differential item functioning analyses to evaluate item performance across participant health literacy levels. To determine construct validity, CHAI scores were compared to scales measuring similar personality constructs. Associations between the CHAI and physical and mental health established predictive validity. A second study among 9,478 adults was used to confirm CHAI associations with health outcomes.

RESULTS

Exploratory factor analyses revealed a single-factor solution with a 10-item scale. The CHAI showed good internal consistency (alpha = 0.81) and moderate test-retest reliability (ICC = 0.53). Reading grade level was found to be at the 6^th grade. Moderate to strong correlations were found with similar constructs (Multidimensional Health Locus of Control, r = 0.38, P < 0.001; Conscientiousness, r = 0.41, P < 0.001). Predictive validity was demonstrated through associations with functional health status measures (depression, r = -0.28, P < 0.001; anxiety, r = -0.22, P < 0.001; and physical functioning, r = 0.22, P < 0.001). In the validation sample, the CHAI was significantly associated with self-reported physical and mental health ( r = 0.31 and 0.32 respectively; both P < 0.001).

CONCLUSIONS

The CHAI appears to be a valid, reliable, and easily administered tool that can be used to assess health activation among adults, including those with limited health literacy. Future studies should test the tool in actual use and explore further applications.