Assessment of online patient education materials designed for people with age-related macular degeneration

Search engine optimization and its association with readability and accessibility of diabetic retinopathy websites

PURPOSE

This study investigated whether websites regarding diabetic retinopathy are readable for patients, and adequately designed to be found by search engines.

METHODS

The term "diabetic retinopathy" was queried in the Google search engine. Patient-oriented websites from the first 10 pages were categorized by search result page number and website organization type. Metrics of search engine optimization (SEO) and readability were then calculated.

RESULTS

Among the 71 sites meeting inclusion criteria, informational and organizational sites were best optimized for search engines, and informational sites were the most visited. Better optimization as measured by authority score was correlated with lower Flesch Kincaid Grade Level (r = 0.267, P = 0.024). There was a significant increase in Flesch Kincaid Grade Level with successive search result pages (r = 0.275, P = 0.020). Only 2 sites met the 6th grade reading level AMA recommendation by Flesch Kincaid Grade Level; the average reading level was 10.5. There was no significant difference in readability between website categories.

CONCLUSION

While the readability of diabetic retinopathy patient information was poor, better readability was correlated to better SEO metrics. While we cannot assess causality, we recommend websites improve their readability, which may increase uptake of their resources.

Low Literacy Levels Among U.S. Adults and Difficult Ballot Propositions

High-level literacy skills are required for full participation in the democratic process through voting. Consequently, adults with low-level literacy skills are at a disadvantage. This work investigated the disparity between the readability of U.S. ballot propositions for year 2022 state elections and grade level reading estimates (≤eighth grade) for adults. Educational attainment was also examined. Propositions (n = 140) from 38 states were included. Mean readability was 18 (range 7.0-64.0). Only four measures (3%) fell within range of national estimates for adult reading ability. Thirty-nine percent of adults completed high school or less, yet 74% of ballots were written well above a high school reading level. There is a discrepancy between the literacy skills of the average voter and the readability of most propositions. The findings of this study have important implications for individuals with learning disabilities. Policy changes and educational support efforts should be initiated.

Assessing the Readability of Online Patient Education Materials in Obstetrics and Gynecology Using Traditional Measures: Comparative Analysis and Limitations

BACKGROUND

Patient education materials (PEMs) can be vital sources of information for the general population. However, despite American Medical Association (AMA) and National Institutes of Health (NIH) recommendations to make PEMs easier to read for patients with low health literacy, they often do not adhere to these recommendations. The readability of online PEMs in the obstetrics and gynecology (OB/GYN) field, in particular, has not been thoroughly investigated.

OBJECTIVE

The study sampled online OB/GYN PEMs and aimed to examine (1) agreeability across traditional readability measures (TRMs), (2) adherence of online PEMs to AMA and NIH recommendations, and (3) whether the readability level of online PEMs varied by web-based source and medical topic. This study is not a scoping review, rather, it focused on scoring the readability of OB/GYN PEMs using the traditional measures to add empirical evidence to the literature.

METHODS

A total of 1576 online OB/GYN PEMs were collected via 3 major search engines. In total 93 were excluded due to shorter content (less than 100 words), yielding 1483 PEMs for analysis. Each PEM was scored by 4 TRMs, including Flesch-Kincaid grade level, Gunning fog index, Simple Measure of Gobbledygook, and the Dale-Chall. The PEMs were categorized based on publication source and medical topic by 2 research team members. The readability scores of the categories were compared statistically.

RESULTS

Results indicated that the 4 TRMs did not agree with each other, leading to the use of an averaged readability (composite) score for comparison. The composite scores across all online PEMs were not normally distributed and had a median at the 11th grade. Governmental PEMs were the easiest to read amongst source categorizations and PEMs about menstruation were the most difficult to read. However, the differences in the readability scores among the sources and the topics were small.

CONCLUSIONS

This study found that online OB/GYN PEMs did not meet the AMA and NIH readability recommendations and would be difficult to read and comprehend for patients with low health literacy. Both findings connected well to the literature. This study highlights the need to improve the readability of OB/GYN PEMs to help patients make informed decisions. Research has been done to create more sophisticated readability measures for medical and health documents. Once validated, these tools need to be used by web-based content creators of health education materials.

Survey of perspectives of people with inherited retinal diseases on ocular gene therapy in Australia

Many gene therapies are in development for treating people with inherited retinal diseases (IRD). We hypothesized that potential recipients of gene therapy would have knowledge gaps regarding treatment. We aimed to assess knowledge, attitudes, and perceptions of genetic therapies among potential recipients with IRD, using a novel instrument we designed (Attitudes to Gene Therapy-Eye (AGT-Eye)) and their associations with demographic data, self-reported visual status, and tools assessing quality of life and attitudes toward clinical trials using a community-based cross-sectional survey of Australian adults with IRD. AGT-Eye, overall quality of life EQ-5D-5L, National Eye Institute Visual Functioning Questionnaire (NEI-VFQ-25) and Patient Attitudes to Clinical Trials (PACT-22) instruments were administered. Six hundred and eighty-one people completed the study, 51.7% women of mean age 53.5 years (SD ± 15.8). Most participants (91.6%) indicated they would likely accept gene therapy if it was available to them or family members. However, only 28.3% agreed that they had good knowledge of gene therapy. Most obtained information about gene therapy from the internet (49.3%). Respondents with post-graduate degrees scored highest compared to other educational levels on methods (p < 0.001) and outcomes (p = 0.003) and were more likely to see economic value of treatment (p = 0.043). Knowledge gaps were present regarding methods and outcomes of gene therapy. This survey has shown high level of interest in the IRD community for gene therapies, and highlights areas for improved clinician and patient education.

Patient Education Materials Found via Google Search for Shoulder Arthroscopy Are Written at Too-High of a Reading Level

Purpose

To evaluate the quality and correlation of readability on actionability and understandability of shoulder arthroscopy-related patient education materials (PEMs) found via a routine Google search.

Methods

Two independent authors performed an online Google search with the term “shoulder arthroscopy.” The first 5 pages of search results were then screened for PEMs. Journal articles, news articles, nontext materials, and unrelated websites were excluded. The readability of included resources was calculated using objective metrics: Flesch–Kincaid Grade Score, Simple Measure of Gobbledygook index, Coleman–Liau Index, and the Gunning Fog Index. Patient Education Material Assessment Tool for Printed Materials assessed for understandability and actionability. Associations between readability and actionability and understandability were determined using Spearman correlation and linear regression.

Results

The searches returned 53 websites related to shoulder arthroscopy. A total of 34 (64%) met inclusion criteria. A high school reading level or greater was required to read the average PEM according to all scales used. The average PEM received a Patient Education Material Assessment Tool for Printed Materials score of 61.33 in understandability (range 18.75-89.47) and 55.59 points in actionability (range 16.67-83.33). An easily understood or actionable article would score at least 70 points. A moderate correlation was observed between readability and actionability on three of the scales used (r = 0.5, r = 0.59, r = 0.61).

Conclusions

Most shoulder arthroscopy PEMs identified on Google are not written at a level that the average patient can read, understand, or act on (actionability).

Clinical Relevance

Orthopaedic surgeons should be aware of the resources that patients use to obtain medical information. More accessible PEMs should be developed for patients undergoing shoulder arthroscopy to enhance comprehension of their condition and improve shared decision-making.

Assessment of patient education materials for age-related macular degeneration

Purpose

Age‐related macular degeneration (AMD) is a leading cause of vision loss. It is helpful for patients living with AMD to understand the prognosis, risk factors and management of their condition. Online education materials are a popular and promising channel for conveying this knowledge to patients with AMD. However, the quality of these materials—particularly with respect to qualities such as ‘understandability’ and ‘actionability’—is not yet known. This study assessed a collection of online materials about AMD based on these qualities of ‘understandability’ and ‘actionability’.

Methods

Online education materials about AMD were sourced through Google from six English‐speaking nations: Australia, New Zealand, USA, UK, Ireland and Canada. Three Australian/New Zealand trained and registered optometrists participated in the grading of the ‘understandability’ and ‘actionability’ of online education materials using the Patient Education Materials Assessment Tool (PEMAT).

Results

This study analysed a total of 75 online materials. The mean ‘understandability’ score was 74% (range: 38%–94%). The ‘understandability’ PEMAT criterion U11 (calling for a summary of the key points) scored most poorly across all materials. The mean ‘actionability’ score was 49% (range: 0%–83%). The ‘actionability’ PEMAT criterion A26 (using ‘visual aids’ to make instructions easier to act on) scored most poorly across all materials.

Conclusion

Most education materials about AMD are easy to understand, but difficult to act on, because of a lack of meaningful visual aids. We propose future enhancements to AMD education materials—including the use of summaries, visual aids and a habit tracker—to help patients with AMD improve their understanding of disease prognosis, risk factors and eye assessment schedule requirements.

Assessment of the readability and quality of online patient education materials for the medical treatment of open-angle glaucoma

Objective

Patient adherence to glaucoma medications is poor, and is linked to low literacy levels. Patients commonly use the internet to access health information, and it is recommended that patient information is written at an 11-year-old reading level. The aim of this study is to assess the readability and quality of online patient education materials for the medical management of open angle glaucoma.

Methods and analysis

The top 10 relevant Google searches for nine glaucoma medications (timolol, brimonidine, apraclonidine, dorzolamide, latanoprost, bimatoprost, travoprost, tafluprost and brinzolamide) and three generic searches were analysed for readability and accountability. Readability was assessed using Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Gunning Fog Index (GFI) and Simple Measure of Gobbledygook Index (SMOG). Webpages were classified by source and assessed using Journal of the American Medical Association (JAMA) benchmarks of accountability.

Results

111 articles were included in the analysis. Mean readability scores were: FRES 55.5 (95% CI 53.4 to 57.5); FKGL 9.7 (95% CI 9.3 to 10.0); GFI 12 (95% CI 11.6 to 12.4) and SMOG 9.3 (95% CI 8.9 to 9.6). One-way analysis of variance demonstrated no significant difference in readability score between source type. 9% of the webpages satisfied all 4 JAMA benchmarks. Pearson’s correlation coefficient showed a correlation between the FRES and accountability score (r=0.19, p=0.045).

Conclusion

The majority of online patient education materials for the medical treatment of glaucoma are written at a level too difficult for the general population and fail to meet accountability standards.

Readability of Online Materials Related to Vocal Cord Leukoplakia

Objectives

To assess readability and understandability of online materials for vocal cord leukoplakia.

Study Design

Review of online materials.

Setting

Academic medical center.

Methods

A Google search of "vocal cord leukoplakia" was performed, and the first 50 websites were considered for analysis. Readability was measured by the Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), and Simple Measure of Gobbledygook (SMOG). Understandability and actionability were assessed by 2 independent reviewers with the PEMAT-P (Patient Education Materials Assessment Tool for Printable Materials). Unpaired t tests compared scores between sites aimed at physicians and those at patients, and a Cohen's kappa was calculated to measure interrater reliability.

Results

Twenty-two websites (17 patient oriented, 5 physician oriented) met inclusion criteria. For the entire cohort, FRES, FKGL, and SMOG scores (mean ± SD) were 36.90 ± 20.65, 12.96 ± 3.28, and 15.65 ± 3.57, respectively, indicating that materials were difficult to read at a >12th-grade level. PEMAT-P understandability and actionability scores were 73.65% ± 7.05% and 13.63% ± 22.47%. Statistically, patient-oriented sites were more easily read than physician-oriented sites (P < .02 for each of the FRES, FKGL, and SMOG comparisons); there were no differences in understandability or actionability scores between these categories of sites.

Conclusion

Online materials for vocal cord leukoplakia are written at a level more advanced than what is recommended for patient education materials. Awareness of the current ways that these online materials are failing our patients may lead to improved education materials in the future.