1
|
Lam MR, Manion GN, Young BK. Search engine optimization and its association with readability and accessibility of diabetic retinopathy websites. Graefes Arch Clin Exp Ophthalmol 2024; 262:3047-3052. [PMID: 38639789 PMCID: PMC11377497 DOI: 10.1007/s00417-024-06472-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Revised: 03/22/2024] [Accepted: 03/28/2024] [Indexed: 04/20/2024] Open
Abstract
PURPOSE This study investigated whether websites regarding diabetic retinopathy are readable for patients, and adequately designed to be found by search engines. METHODS The term "diabetic retinopathy" was queried in the Google search engine. Patient-oriented websites from the first 10 pages were categorized by search result page number and website organization type. Metrics of search engine optimization (SEO) and readability were then calculated. RESULTS Among the 71 sites meeting inclusion criteria, informational and organizational sites were best optimized for search engines, and informational sites were the most visited. Better optimization as measured by authority score was correlated with lower Flesch Kincaid Grade Level (r = 0.267, P = 0.024). There was a significant increase in Flesch Kincaid Grade Level with successive search result pages (r = 0.275, P = 0.020). Only 2 sites met the 6th grade reading level AMA recommendation by Flesch Kincaid Grade Level; the average reading level was 10.5. There was no significant difference in readability between website categories. CONCLUSION While the readability of diabetic retinopathy patient information was poor, better readability was correlated to better SEO metrics. While we cannot assess causality, we recommend websites improve their readability, which may increase uptake of their resources.
Collapse
Affiliation(s)
- Matthew R Lam
- Creighton University School of Medicine-Phoenix Regional Campus, Phoenix, AZ, USA.
| | | | - Benjamin K Young
- Department of Ophthalmology, Casey Eye Institute, Oregon Health & Science University, Portland, OR, USA
| |
Collapse
|
2
|
Parker RL. Low Literacy Levels Among U.S. Adults and Difficult Ballot Propositions. JOURNAL OF LEARNING DISABILITIES 2024:222194241249958. [PMID: 38712805 DOI: 10.1177/00222194241249958] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/08/2024]
Abstract
High-level literacy skills are required for full participation in the democratic process through voting. Consequently, adults with low-level literacy skills are at a disadvantage. This work investigated the disparity between the readability of U.S. ballot propositions for year 2022 state elections and grade level reading estimates (≤eighth grade) for adults. Educational attainment was also examined. Propositions (n = 140) from 38 states were included. Mean readability was 18 (range 7.0-64.0). Only four measures (3%) fell within range of national estimates for adult reading ability. Thirty-nine percent of adults completed high school or less, yet 74% of ballots were written well above a high school reading level. There is a discrepancy between the literacy skills of the average voter and the readability of most propositions. The findings of this study have important implications for individuals with learning disabilities. Policy changes and educational support efforts should be initiated.
Collapse
|
3
|
Nattam A, Vithala T, Wu TC, Bindhu S, Bond G, Liu H, Thompson A, Wu DTY. Assessing the Readability of Online Patient Education Materials in Obstetrics and Gynecology Using Traditional Measures: Comparative Analysis and Limitations. J Med Internet Res 2023; 25:e46346. [PMID: 37647115 PMCID: PMC10500363 DOI: 10.2196/46346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 06/06/2023] [Accepted: 07/04/2023] [Indexed: 09/01/2023] Open
Abstract
BACKGROUND Patient education materials (PEMs) can be vital sources of information for the general population. However, despite American Medical Association (AMA) and National Institutes of Health (NIH) recommendations to make PEMs easier to read for patients with low health literacy, they often do not adhere to these recommendations. The readability of online PEMs in the obstetrics and gynecology (OB/GYN) field, in particular, has not been thoroughly investigated. OBJECTIVE The study sampled online OB/GYN PEMs and aimed to examine (1) agreeability across traditional readability measures (TRMs), (2) adherence of online PEMs to AMA and NIH recommendations, and (3) whether the readability level of online PEMs varied by web-based source and medical topic. This study is not a scoping review, rather, it focused on scoring the readability of OB/GYN PEMs using the traditional measures to add empirical evidence to the literature. METHODS A total of 1576 online OB/GYN PEMs were collected via 3 major search engines. In total 93 were excluded due to shorter content (less than 100 words), yielding 1483 PEMs for analysis. Each PEM was scored by 4 TRMs, including Flesch-Kincaid grade level, Gunning fog index, Simple Measure of Gobbledygook, and the Dale-Chall. The PEMs were categorized based on publication source and medical topic by 2 research team members. The readability scores of the categories were compared statistically. RESULTS Results indicated that the 4 TRMs did not agree with each other, leading to the use of an averaged readability (composite) score for comparison. The composite scores across all online PEMs were not normally distributed and had a median at the 11th grade. Governmental PEMs were the easiest to read amongst source categorizations and PEMs about menstruation were the most difficult to read. However, the differences in the readability scores among the sources and the topics were small. CONCLUSIONS This study found that online OB/GYN PEMs did not meet the AMA and NIH readability recommendations and would be difficult to read and comprehend for patients with low health literacy. Both findings connected well to the literature. This study highlights the need to improve the readability of OB/GYN PEMs to help patients make informed decisions. Research has been done to create more sophisticated readability measures for medical and health documents. Once validated, these tools need to be used by web-based content creators of health education materials.
Collapse
Affiliation(s)
- Anunita Nattam
- College of Medicine, University of Cincinnati, Cincinnati, OH, United States
| | - Tripura Vithala
- College of Medicine, University of Cincinnati, Cincinnati, OH, United States
| | - Tzu-Chun Wu
- College of Medicine, University of Cincinnati, Cincinnati, OH, United States
| | - Shwetha Bindhu
- College of Medicine, University of Cincinnati, Cincinnati, OH, United States
| | - Gregory Bond
- Department of Computer Science, University of Cincinnati, Cincinnati, OH, United States
| | - Hexuan Liu
- School of Criminal Justice, University of Cincinnati, Cincinnati, OH, United States
| | - Amy Thompson
- College of Medicine, University of Cincinnati, Cincinnati, OH, United States
| | - Danny T Y Wu
- College of Medicine, University of Cincinnati, Cincinnati, OH, United States
- Department of Computer Science, University of Cincinnati, Cincinnati, OH, United States
| |
Collapse
|
4
|
Mack HG, Britten-Jones AC, McGuinness MB, Chen FK, Grigg JR, Jamieson RV, Edwards TL, De Roach J, O'Hare F, Martin KR, Ayton LN. Survey of perspectives of people with inherited retinal diseases on ocular gene therapy in Australia. Gene Ther 2022; 30:336-346. [PMID: 36183012 PMCID: PMC10113139 DOI: 10.1038/s41434-022-00364-z] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2022] [Revised: 08/16/2022] [Accepted: 08/26/2022] [Indexed: 11/09/2022]
Abstract
Many gene therapies are in development for treating people with inherited retinal diseases (IRD). We hypothesized that potential recipients of gene therapy would have knowledge gaps regarding treatment. We aimed to assess knowledge, attitudes, and perceptions of genetic therapies among potential recipients with IRD, using a novel instrument we designed (Attitudes to Gene Therapy-Eye (AGT-Eye)) and their associations with demographic data, self-reported visual status, and tools assessing quality of life and attitudes toward clinical trials using a community-based cross-sectional survey of Australian adults with IRD. AGT-Eye, overall quality of life EQ-5D-5L, National Eye Institute Visual Functioning Questionnaire (NEI-VFQ-25) and Patient Attitudes to Clinical Trials (PACT-22) instruments were administered. Six hundred and eighty-one people completed the study, 51.7% women of mean age 53.5 years (SD ± 15.8). Most participants (91.6%) indicated they would likely accept gene therapy if it was available to them or family members. However, only 28.3% agreed that they had good knowledge of gene therapy. Most obtained information about gene therapy from the internet (49.3%). Respondents with post-graduate degrees scored highest compared to other educational levels on methods (p < 0.001) and outcomes (p = 0.003) and were more likely to see economic value of treatment (p = 0.043). Knowledge gaps were present regarding methods and outcomes of gene therapy. This survey has shown high level of interest in the IRD community for gene therapies, and highlights areas for improved clinician and patient education.
Collapse
Affiliation(s)
- Heather G Mack
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, VIC, Australia. .,Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, VIC, Australia.
| | - Alexis Ceecee Britten-Jones
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, VIC, Australia.,Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, VIC, Australia.,Department of Optometry and Vision Sciences, University of Melbourne, Melbourne, VIC, Australia
| | - Myra B McGuinness
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, VIC, Australia.,Centre for Epidemiology and Biostatistics, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, VIC, Australia
| | - Fred K Chen
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, VIC, Australia.,Centre for Ophthalmology and Visual Sciences (incorporating Lions Eye Institute), The University of Western Australia, Perth, WA, Australia.,Royal Perth Hospital and Perth Children's Hospital, Perth, WA, Australia
| | - John R Grigg
- Save Sight Institute, Faculty of Medicine and Health, The University of Sydney, Sydney, NSW, Australia.,Eye Genetics Research Unit, Sydney Children's Hospitals Network, Save Sight Institute, Children's Medical Research Institute, University of Sydney, Sydney, NSW, Australia
| | - Robyn V Jamieson
- Eye Genetics Research Unit, Sydney Children's Hospitals Network, Save Sight Institute, Children's Medical Research Institute, University of Sydney, Sydney, NSW, Australia
| | - Thomas L Edwards
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, VIC, Australia.,Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, VIC, Australia
| | - John De Roach
- Centre for Ophthalmology and Visual Sciences (incorporating Lions Eye Institute), The University of Western Australia, Perth, WA, Australia.,The Australian Inherited Retinal Disease Registry and DNA Bank, Perth, WA, Australia
| | - Fleur O'Hare
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, VIC, Australia.,Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, VIC, Australia.,Department of Optometry and Vision Sciences, University of Melbourne, Melbourne, VIC, Australia
| | - Keith R Martin
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, VIC, Australia.,Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, VIC, Australia
| | - Lauren N Ayton
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, VIC, Australia.,Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, VIC, Australia.,Department of Optometry and Vision Sciences, University of Melbourne, Melbourne, VIC, Australia
| |
Collapse
|
5
|
Abdullah Y, Alokozai A, Mathew AJ, Stamm MA, Mulcahey MK. Patient Education Materials Found via Google Search for Shoulder Arthroscopy Are Written at Too-High of a Reading Level. Arthrosc Sports Med Rehabil 2022; 4:e1575-e1579. [PMID: 36033169 PMCID: PMC9402457 DOI: 10.1016/j.asmr.2022.04.034] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Accepted: 04/27/2022] [Indexed: 12/02/2022] Open
Abstract
Purpose To evaluate the quality and correlation of readability on actionability and understandability of shoulder arthroscopy-related patient education materials (PEMs) found via a routine Google search. Methods Two independent authors performed an online Google search with the term “shoulder arthroscopy.” The first 5 pages of search results were then screened for PEMs. Journal articles, news articles, nontext materials, and unrelated websites were excluded. The readability of included resources was calculated using objective metrics: Flesch–Kincaid Grade Score, Simple Measure of Gobbledygook index, Coleman–Liau Index, and the Gunning Fog Index. Patient Education Material Assessment Tool for Printed Materials assessed for understandability and actionability. Associations between readability and actionability and understandability were determined using Spearman correlation and linear regression. Results The searches returned 53 websites related to shoulder arthroscopy. A total of 34 (64%) met inclusion criteria. A high school reading level or greater was required to read the average PEM according to all scales used. The average PEM received a Patient Education Material Assessment Tool for Printed Materials score of 61.33 in understandability (range 18.75-89.47) and 55.59 points in actionability (range 16.67-83.33). An easily understood or actionable article would score at least 70 points. A moderate correlation was observed between readability and actionability on three of the scales used (r = 0.5, r = 0.59, r = 0.61). Conclusions Most shoulder arthroscopy PEMs identified on Google are not written at a level that the average patient can read, understand, or act on (actionability). Clinical Relevance Orthopaedic surgeons should be aware of the resources that patients use to obtain medical information. More accessible PEMs should be developed for patients undergoing shoulder arthroscopy to enhance comprehension of their condition and improve shared decision-making.
Collapse
Affiliation(s)
| | | | | | | | - Mary K. Mulcahey
- Address correspondence to Mary K. Mulcahey, M.D., F.A.A.O.S., F.A.O.A., Department of Orthopaedic Surgery, Tulane University School of Medicine, 1430 Tulane Ave., New Orleans, LA, 70112.
| |
Collapse
|
6
|
Wang E, Kalloniatis M, Ly A. Assessment of patient education materials for age-related macular degeneration. Ophthalmic Physiol Opt 2022; 42:839-848. [PMID: 35521818 PMCID: PMC9325046 DOI: 10.1111/opo.12991] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Revised: 04/10/2022] [Accepted: 04/11/2022] [Indexed: 11/30/2022]
Abstract
Purpose Age‐related macular degeneration (AMD) is a leading cause of vision loss. It is helpful for patients living with AMD to understand the prognosis, risk factors and management of their condition. Online education materials are a popular and promising channel for conveying this knowledge to patients with AMD. However, the quality of these materials—particularly with respect to qualities such as ‘understandability’ and ‘actionability’—is not yet known. This study assessed a collection of online materials about AMD based on these qualities of ‘understandability’ and ‘actionability’. Methods Online education materials about AMD were sourced through Google from six English‐speaking nations: Australia, New Zealand, USA, UK, Ireland and Canada. Three Australian/New Zealand trained and registered optometrists participated in the grading of the ‘understandability’ and ‘actionability’ of online education materials using the Patient Education Materials Assessment Tool (PEMAT). Results This study analysed a total of 75 online materials. The mean ‘understandability’ score was 74% (range: 38%–94%). The ‘understandability’ PEMAT criterion U11 (calling for a summary of the key points) scored most poorly across all materials. The mean ‘actionability’ score was 49% (range: 0%–83%). The ‘actionability’ PEMAT criterion A26 (using ‘visual aids’ to make instructions easier to act on) scored most poorly across all materials. Conclusion Most education materials about AMD are easy to understand, but difficult to act on, because of a lack of meaningful visual aids. We propose future enhancements to AMD education materials—including the use of summaries, visual aids and a habit tracker—to help patients with AMD improve their understanding of disease prognosis, risk factors and eye assessment schedule requirements.
Collapse
Affiliation(s)
- Elisa Wang
- Centre for Eye Health, The University of New South Wales Sydney, Kensington, New South Wales, Australia.,School of Optometry and Vision Science, The University of New South Wales Sydney, Kensington, New South Wales, Australia
| | - Michael Kalloniatis
- Centre for Eye Health, The University of New South Wales Sydney, Kensington, New South Wales, Australia.,School of Optometry and Vision Science, The University of New South Wales Sydney, Kensington, New South Wales, Australia
| | - Angelica Ly
- Centre for Eye Health, The University of New South Wales Sydney, Kensington, New South Wales, Australia.,School of Optometry and Vision Science, The University of New South Wales Sydney, Kensington, New South Wales, Australia
| |
Collapse
|
7
|
Crabtree L, Lee E. Assessment of the readability and quality of online patient education materials for the medical treatment of open-angle glaucoma. BMJ Open Ophthalmol 2022; 7:e000966. [PMID: 35415266 PMCID: PMC8961144 DOI: 10.1136/bmjophth-2021-000966] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2021] [Accepted: 02/17/2022] [Indexed: 11/04/2022] Open
Abstract
ObjectivePatient adherence to glaucoma medications is poor, and is linked to low literacy levels. Patients commonly use the internet to access health information, and it is recommended that patient information is written at an 11-year-old reading level. The aim of this study is to assess the readability and quality of online patient education materials for the medical management of open angle glaucoma.Methods and analysisThe top 10 relevant Google searches for nine glaucoma medications (timolol, brimonidine, apraclonidine, dorzolamide, latanoprost, bimatoprost, travoprost, tafluprost and brinzolamide) and three generic searches were analysed for readability and accountability. Readability was assessed using Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Gunning Fog Index (GFI) and Simple Measure of Gobbledygook Index (SMOG). Webpages were classified by source and assessed using Journal of the American Medical Association (JAMA) benchmarks of accountability.Results111 articles were included in the analysis. Mean readability scores were: FRES 55.5 (95% CI 53.4 to 57.5); FKGL 9.7 (95% CI 9.3 to 10.0); GFI 12 (95% CI 11.6 to 12.4) and SMOG 9.3 (95% CI 8.9 to 9.6). One-way analysis of variance demonstrated no significant difference in readability score between source type. 9% of the webpages satisfied all 4 JAMA benchmarks. Pearson’s correlation coefficient showed a correlation between the FRES and accountability score (r=0.19, p=0.045).ConclusionThe majority of online patient education materials for the medical treatment of glaucoma are written at a level too difficult for the general population and fail to meet accountability standards.
Collapse
Affiliation(s)
- Lois Crabtree
- Medicine and Surgery, Epsom and Saint Helier University Hospitals NHS Trust Epsom Hospital, Epsom, UK
| | - Edward Lee
- Department of Ophthalmology, Epsom and Saint Helier University Hospitals NHS Trust Epsom Hospital, Epsom, UK
| |
Collapse
|
8
|
Shneyderman M, Snow GE, Davis R, Best S, Akst LM. Readability of Online Materials Related to Vocal Cord Leukoplakia. OTO Open 2021; 5:2473974X211032644. [PMID: 34396027 PMCID: PMC8358515 DOI: 10.1177/2473974x211032644] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2021] [Accepted: 06/26/2021] [Indexed: 11/15/2022] Open
Abstract
Objectives To assess readability and understandability of online materials for vocal cord leukoplakia. Study Design Review of online materials. Setting Academic medical center. Methods A Google search of "vocal cord leukoplakia" was performed, and the first 50 websites were considered for analysis. Readability was measured by the Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), and Simple Measure of Gobbledygook (SMOG). Understandability and actionability were assessed by 2 independent reviewers with the PEMAT-P (Patient Education Materials Assessment Tool for Printable Materials). Unpaired t tests compared scores between sites aimed at physicians and those at patients, and a Cohen's kappa was calculated to measure interrater reliability. Results Twenty-two websites (17 patient oriented, 5 physician oriented) met inclusion criteria. For the entire cohort, FRES, FKGL, and SMOG scores (mean ± SD) were 36.90 ± 20.65, 12.96 ± 3.28, and 15.65 ± 3.57, respectively, indicating that materials were difficult to read at a >12th-grade level. PEMAT-P understandability and actionability scores were 73.65% ± 7.05% and 13.63% ± 22.47%. Statistically, patient-oriented sites were more easily read than physician-oriented sites (P < .02 for each of the FRES, FKGL, and SMOG comparisons); there were no differences in understandability or actionability scores between these categories of sites. Conclusion Online materials for vocal cord leukoplakia are written at a level more advanced than what is recommended for patient education materials. Awareness of the current ways that these online materials are failing our patients may lead to improved education materials in the future.
Collapse
Affiliation(s)
| | - Grace E Snow
- Department of Otolaryngology-Head and Neck Surgery, School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
| | - Ruth Davis
- Department of Otolaryngology-Head and Neck Surgery, School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
| | - Simon Best
- Department of Otolaryngology-Head and Neck Surgery, School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
| | - Lee M Akst
- Department of Otolaryngology-Head and Neck Surgery, School of Medicine, Johns Hopkins University, Baltimore, Maryland, USA
| |
Collapse
|