Evaluating the complexity of online patient education materials about brain aneurysms published by major academic institutions

Readability of cerebrovascular diseases online educational material from major cerebrovascular organizations

INTRODUCTION

The internet is an essential resource for patients and their loved ones to understand their medical conditions, and professional medical organizations have taken great strides to develop educational material targeting patients. The average American reads at a seventh to eighth grade reading level, hence it is important to understand the readability of this medical information to ensure patients comprehend what is being presented.

METHODS

In January 2023, online patient education material was downloaded from major cerebrovascular healthcare organizations and assessed using eight assessments, including Bormuth Cloze Mean, Bormuth Grade Placement, Coleman-Liau (grade levels), Coleman-Liau (predictive cloze scores), Flesch Reading Ease (FRE), and Fry.

RESULTS

A total of 32 files were extracted from six organizations and analyzed across 15 readability measures. None of the organizations met the federal government guidelines for grade-level readability. This held constant across all measured tests. Two organizations had above a postgraduate level. The FRE graphs do not identify any organizations with material below a ninth grade reading level, while the American Association of Neurological Surgeons (AANS) and the Society of Interventional Radiology (SIR) have a postgraduate readability level. The Fry graphs show similar results, with AANS/CNS Cerebrovascular Section, Society of NeuroInterventional Surgery (SNIS), SIR, and AANS having college-level readability. The lowest readability across all measures is only at an early seventh grade reading level.

CONCLUSIONS

Current health literacy content for cerebrovascular patients is far above the recommended readability level. We provide straightforward suggestions for how major professional organizations should improve their informational material on cerebrovascular diseases to improve patient understanding.

The Complexity of Online Patient Education Materials About Interventional Neuroradiology Procedures Published by Major Academic Institutions

Introduction Health literacy is an independent predictor of population health status and is directly related to the readability of available patient education material. The National Institutes of Health (NIH) and the American Medical Association have recommended that patient education materials (PEMs) be written between a fourth- and a sixth-grade education level. The authors assessed the readability of online PEMs about neurointerventional procedures that have been published by several academic institutions across the US. Methods Online PEMs regarding five common neurointerventional procedures, including mechanical thrombectomy for large vessel occlusion, cerebral diagnostic angiography, carotid artery stenting, endovascular aneurysm embolization, and epidural steroid injection collected from the websites of 20 top institutions in Neurology and Neurosurgery. The materials were assessed via five readability scales and then were statistically analyzed and compared to non-institutional education websites (Wikipedia.com and WebMD.com). Results None of the PEMs were written at or below the NIH's recommended 6th-grade reading level. The average educational level required to comprehend the texts across all institutions, as assessed by the readability scales, was 10-11^th grade level. Some materials required a college-level education or higher. Material from non-institutional websites had significantly lower readability scores compared to the 20 institutions. Conclusions Current PEMs related to neurointerventional procedures are not written at or below the NIH's recommended fourth- to sixth-grade education level. Given the complexity of those procedures, significant attention should be pointed toward an improvement in the available online materials.

Academics versus the Internet: Evaluating the readability of patient education materials for cerebrovascular conditions from major academic centers

Background:

Health literacy profoundly impacts patient outcomes as patients with decreased health literacy are less likely to understand their illness and adhere to treatment regimens. Patient education materials supplement in-person patient education, especially in cerebrovascular diseases that may require a multidisciplinary care team. This study aims to assess the readability of online patient education materials related to cerebrovascular diseases and to contrast the readability of those materials produced by academic institutions with those of non-academic sources.

Methods:

The readability of online patient education materials was analyzed using Flesch-Kincaid Grade Level (FKGL) and Flesch Reading Ease (FRE) assessments. Readability of academic-based online patient education materials was compared to nonacademic online patient education materials. Online patient education materials from 20 academic institutions and five sources from the web were included in the analysis.

Results:

Overall median FKGL for neurovascular-related patient online education documents was 11.9 (95% CI: 10.8–13.1), reflecting that they are written at a 12th grade level, while the median FRE was 40.6 (95% CI: 34.1–47.1), indicating a rating as “difficult” to read. When comparing academic-based online patient education materials to other internet sources, there was no significant difference in FRE and FKGL scores (P = 0.63 and P = 0.26 for FKGL and FRE, respectively).

Conclusion:

This study demonstrates that online patient education materials pertaining to cerebrovascular diseases from major academic centers and other nonacademic internet sites are difficult to understand and written at levels significantly higher than that recommended by national agencies. Both academic and nonacademic sources reflect this finding equally. Further study and implementation are warranted to investigate how improvements can be made.

Evaluating the Readability of Online Patient Education Materials Related to Orthopedic Oncology

The internet is increasingly used to access patient education materials. The average American reading level has been found to be that of a 7th- to 8th-grade student, prompting the National Institutes of Health (NIH) and the American Medical Association (AMA) to advise that patient education materials be written between the 4th- to 6th-grade reading level. The purpose of this study was to evaluate the reading level of current patient education materials for the most common musculoskeletal oncological tumors. A Google search was performed with all location filters off to account for geographic variability for patient education materials related to 28 orthopedic primary or secondary tumors. All patient education articles from the first 10 website hits for each tumor type were analyzed. Patient education materials from these websites were evaluated using 8 validated readability scales. Patient resources were found to be written at an average grade level nearly double the NIH and AMA recommendation. Patient education materials for soft tissue chondromas were written at the highest level (14.8±1.9), whereas education materials for chordomas (10.1±1.0) most closely approached national recommendations, despite still being written at a readability level nearly 4 grade levels higher than has been recommended. The Flesch Reading Ease assessment provided a mean score of 46.5±7.7, corresponding with a "difficult to read" result. Current patient education materials regarding oncological musculoskeletal-related patient education materials are written significantly above the recommended reading level. Further modification of these resources is warranted to ensure adequate comprehension and informed decision making in the clinical setting. [Orthopedics. 2021;44(1):38-42.].

Readability Assessment of Online Patient Education Materials on Atrial Fibrillation

Health literacy is emerging as an important factor for medical outcomes as more patients turn to the internet for information about their disease. However educational materials on complex conditions such as atrial fibrillation tend to still be esoteric and result in compromised patient autonomy. We add to the current literature by examining the reading level of websites of major healthcare intuitions and general medicine websites. An online Google search using the term "atrial fibrillation" was used to collect patient educational material from the first 20 academic health institutions (AHI) and 20 non-affiliated general medicine websites (GMW). The materials were assessed for readability using nine (9) tests from the analysis software Readability Studio (Oleander Software Solutions Ltd., Maharashtra, India). The patient education materials from the AHI and GMW websites were written at a college freshman reading grade level (13.050 ± 0.845) and high school junior year reading level (11.64 ± 0.789) respectively. The GMW tend to have a wider range of readability levels, and many were scored at the 6th-grade level. In conclusion, the readability levels of patient education materials on atrial fibrillation from both the AHI and GMW are well above the 6th-grade level recommended by the NIH and AMA, posing a risk to the patients' understanding of the materials. The high readability scores found across all websites and the differences between the groups have been attributed to the various goals and target audiences of the material.

Health literacy among neurosurgery and other surgical subspecialties: Readability of online patient materials found with Google

OBJECTIVE

To both determine whether the most high-yield online patient materials for surgical specialties meet the 6th grade readability level recommended by the National Institutes of Health (NIH) and American Medical Association (AMA), and to discover differences in readability across specialties. We hypothesize average readability scores will exceed an 11th grade level.

METHODS

The top five most common procedures for each of seven surgical specialties (neurological, orthopedic, plastic, general, thoracic, pediatric, and vascular) were searched using an incognito Google query to minimize location bias. The text from the top five patient-relevant links per procedure, excluding Wikipedia, journal articles, and videos, was extracted and inserted into Readability Studio Software for analysis.

RESULTS

The combined average grade level of materials (± standard deviation) was: 10.47 ± 2.51 Flesh-Kincaid Grade Level (FKGL), 11-12 New Dale-Chall (NDC), 10.09 ± 1.97 Simple Measure of Gobbledygook (SMOG), 12 Fry Graph (FG). Thoracic, neurologic, vascular, plastic, and orthopedic were least readable (grade level 10+ by all metrics).

CONCLUSIONS

High readability of procedure materials for patients is not unique to neurosurgery: all specialties exceeded the recommended 6th grade level by three or more grades. Online patient education materials related to surgical subspecialties must be written more comprehensibly.

Evaluation of patient education materials for stereotactic radiosurgery from high-performing neurosurgery hospitals and professional societies

Background

Little is known about the readability and utility of patient education materials for stereotactic radiosurgery (SRS). Therefore, the goal of this investigation was to evaluate such materials from high-performing neurosurgery hospitals and professional societies through an analysis of readability and educational content.

Methods

In this cross-cross sectional study, 61 websites associated with the top 50 neurosurgery and neurology hospitals according to U.S. News & World Report (USNWR) and 11 predetermined professional medical societies were queried. Identified SRS education materials were analyzed by 6 readability indices. Educational content was assessed by 10 criteria based on surveys of patients' perspectives about SRS.

Results

Fifty-four materials were identified from the target population (45 from USNWR hospital websites and 9 from professional society websites). Mean readability of materials ranged from 11.7 to 15.3 grade level, far more difficult than national recommendations of sixth and eighth grade. Materials were found to have deficiencies in educational content. Compared with high-performing hospitals, materials from websites of professional societies were longer (P = .002), and more likely to discuss risks and benefits specific to SRS (P = .008), alternative treatment options (P = .05) and expected outcomes or postprocedure descriptions (P = .004). Hospital materials were also more likely to favor brand-specific terminology (eg, GammaKnife) over generic terminology (eg, radiosurgery; P = .019).

Conclusion

Publicly available online patient educational materials for SRS are written at reading levels above national recommendations. Furthermore, many lack information identified as important by patients. Reevaluation and improvement of online SRS educational materials on a national scale are warranted.

Comprehension of Online Educational Material Regarding Orofacial Clefts

BACKGROUND

Cleft lip and palate are among the common birth defects in the United States. Management is complex and may be difficult for parents and patients to understand. The goal of this study was to evaluate the readability of online educational material provided by the American Society of Plastic Surgeons (ASPS) and the American Cleft Palate-Craniofacial Association (ACPA) websites regarding cleft lip and palate and to assess parents' comprehension.

METHODS

Parents of children younger than 10 years of age presenting to the plastic and reconstructive surgery clinic at Johns Hopkins All Children's Hospital for conditions other than cleft lip and palate were recruited for participation. Parents were given the literature published on the ASPS and ACPA web sites to review and were asked to complete a 5-question test specifically targeted to the content of the passage they reviewed. We tested the readability of the 2 online passages using Readability Studio software (Oleander Software Solutions Ltd).

RESULTS

Sixty parents completed the study. Across all groups, the mean score was 4.35 of a possible 5. The mean score was 4.4 for the ASPS web site and 4.29 for the ACPA web site. Fifty-three percent of participants answered all questions correctly. No significant difference in scores was noted between web sites (P = .48).

CONCLUSIONS

Despite containing content of varying reading-level difficulty, the literature posted on the ACPA and ASPS web sites concerning cleft lip and palate conveyed information equally well to the target parent demographic with high levels of comprehension.