Using the Evaluative Linguistic Framework for Questionnaires to Assess Comprehensibility of Self-Report Health Questionnaires

An effort to improve the collection of patient-generated data: readability and understandability of patient-reported outcomes measures in a survivorship cohort

PURPOSE

In this study, we evaluated readability and understandability of nine French-language Patient-Reported Outcome Measures (PROMs) that are currently used in a contemporary longitudinal cohort of breast cancer survivors as part of an effort to improve equity in cancer care and research.

METHODS

Readability of PROMs was assessed using the Flesh Reading Ease Score (FRES), the Gunning's Fog Index (FOG), and the FRY graphics. Readability was considered ideal if mean score ≤ 6th-grade level and acceptable if between 6th and 8th grade. Understandability was evaluated using the Patient Education Materials Assessment Tool and defined as ideal if PEMAT ≥ 80%. The Evaluative Linguistic Framework for Questionnaires (ELF-Q) provided additional qualitative elements to assess understandability. Plain-language best practice was met if both readability and understandability were ideal.

RESULTS

None of the 9 PROMs evaluated had ideal readability scores and only 1 had an acceptable score. Understandability ranged from 55% to 91%, and only 3 PROMs had ideal scores. ELF-Q identified points for improvement in several understandability dimensions of the PROMs. None of the instruments met the definition of plain-language best practice.

CONCLUSION

None of the studied PROMs met the standards of readability and understandability. Future development and translation of PROMs should follow comprehensive linguistic and cultural frameworks to ensure plain-language standards and enhance equitable patient-centered care and research.

The health promoting sports club model: an intervention planning framework

Researchers and policymakers acknowledge sports clubs (SCs) as health promoting settings. Limited research links the health promoting sports club (HPSC) concept with evidence-driven strategies to provide SCs guidance to develop health promotion (HP) interventions. As implementation science insists on theoretically grounded interventions, the present work's objective was to provide SCs an evidence-driven intervention framework for planning, developing and implementing HP initiatives. Four iteratively sequenced steps were undertaken: (i) investigation of 'health promoting' indicators, (ii) adaptation of the HPSC concept to create the HPSC model, (iii) formulation of published evidence-driven guidelines into strategies and implementable intervention components (ICs) and (iv) merging the HPSC model with the ICs to create an intervention planning framework for SCs. First, researchers drafted five HPSC indicators. Second, they defined three SC levels (macro, meso and micro) and four health determinants (organizational, environmental, economic and social) to create an HPSC model. Third, researchers used published guidelines to develop 14 strategies with 55 ICs. Fourth, three workshops (one each with French master-level sport students, French sport and health professionals and Swedish sport and health professionals) had participants classify the ICs into the model. The HPSC model and intervention framework are starting points to plan, select and deliver interventions to increase SC HP. This planning framework is usable in several ways: (i) clubs can apply strategies to achieve specific goals, (ii) clubs can target specific levels with corresponding ICs and (iii) ICs can be used to address particular health determinants.

Considering Low Health Literacy: How Do the Pelvic Floor Distress Inventory-Short Form 20 and Pelvic Floor Impact Questionnaire-Short Form 7 Measure Up?

OBJECTIVE

The objective of this study was to evaluate the readability and understandability of 2 commonly used pelvic floor disorder questionnaires, Pelvic Floor Distress Inventory-Short Form 20 (PFDI-20) and Pelvic Floor Impact Questionnaire-Short Form 7 (PFIQ-7), in a low health literacy patient population.

METHODS

Flesh-Kincaid, SMOG, Fry, and FORCAST readability assessment tools were used to assign US grade levels to each questionnaire (PFDI-20, PFIQ-7). Two health literacy experts used PEMAT and ELF-Q tools to determine understandability, organization, content, and quality of each form. A focus group of women with low health literacy used Stop Light Coding and a facilitator-prompted discussion to further evaluate understandability and critique the forms.

RESULTS

The PFIQ-7 required higher reading ability compared with PFDI-20 (ninth to 11th vs sixth to eighth mean grade level equivalents). Expert and focus group reviews identified concerns regarding purpose, formatting, and word choice in both forms. Focus group participants recommended assistance with questionnaire completion from clinical staff and gave mean overall ratings of 5.4 (0-10/worst to best) for PFDI-20 and 8.0 for PFIQ-7.

CONCLUSIONS

Knowledge of potential barriers to understanding and completion may improve utilization of and accuracy of patient responses to PFDI-20 and PFIQ-7 in women with low health literacy.

A Linguistic Analysis of Health Literacy Demands of Chronic Kidney Disease Patient Education Materials

Background:

Instruments to assess the quality and comprehensibility of printed patient education materials may lack proper consideration of how readers derive meaning from text. The Evaluative Linguistic Framework (ELF) considers how factors that influence readers' expectations about health care texts also affect their ability to understand them. The ELF has demonstrated value in improving the quality of patient materials about medication, consent, and self-reported questionnaires, but has not yet been used to evaluate a corpus of patient education materials about chronic disease self-management.

Objective:

This study sought to apply the ELF to examine specific elements of printed self-management patient education materials for chronic kidney disease (CKD) not captured by other tools.

Methods:

From a previously published systematic review, we identified 14 patient education materials (eight self-management, six diet and nutrition) for people with CKD. We used the ELF to identify the different ways the text could be structured, its intended purpose, the relationship established between reader and writer, presence of signposting, its complexity and technicality of language, and factual content.

Key Results:

Our analysis identified nine possible structural units, of which “introducing the problem” and “instructing the reader to self-manage” were common to all materials. However, there was no consistency or common sequence to these units of text. The intended readership and aims of the author(s) were not always clear; many materials made assumptions about what the reader knew, the language was often complex and dense, and the meta-discourse was sometimes distracting.

Conclusions:

Our analysis suggests CKD document developers can benefit from a theoretically grounded linguistic tool that focuses on the intended audience and their specific needs. The ELF identified structural units of text, aligned with rhetorical elements that can be uniformly applied for developing self-management education materials for CKD, and provided checks for language complexity. Further work can determine its usefulness for other (e.g., electronic) formats and other chronic diseases. [HLRP: Health Literacy Research and Practice. 2018;2(1):e1–e14.]

Plain Language Summary:

Helping patients make meaning from information about their condition is a key goal of health care organizations. We analyzed chronic kidney disease patient education materials on self-management using the Evaluative Linguistic Framework. The purpose and intended audience were frequently unclear. We identified nine structural units of text that may assist information providers to plan and structure content.