The association of caregiver attitudes, information sources, and trust with HPV vaccine initiation among adolescents

This study described caregiver attitudes and the information sources they access about HPV vaccination for adolescents and determined their influence on human papillomavirus (HPV) vaccination initiation. An online survey was administered to 1,016 adults in July 2021. Participants were eligible if they were the caregiver of a child aged 9-17 residing in Mississippi, Arkansas, Tennessee, Missouri, and select counties in Southern Illinois. Multivariate logistic regression was used to estimate the association of caregiver attitudes and information sources with HPV vaccination. Information from doctors or healthcare providers (87.4%) and internet sources other than social media (31.0%) were the most used sources for HPV vaccine information. The highest proportion of caregivers trusted their doctor or healthcare providers (92.4%) and family or friends (68.5%) as sources of information. The HPV vaccine series was more likely to be initiated in children whose caregivers agreed that the vaccine is beneficial (AOR = 4.39, 95% CI = 2.05, 9.39), but less likely with caregivers who were concerned about side effects (AOR = 0.61, 95% CI = 0.42, 0.88) and who received HPV vaccination information from family or friends (AOR = 0.57, 95% CI = 0.35, 0.93). This study found that caregivers' attitudes, information sources, and trust in those sources were associated with their adolescent's HPV vaccination status. These findings highlight the need to address attitudes and information sources and suggest that tailored interventions considering these factors could increase HPV vaccination rates.

Oral cancer: analysis of the clarity of publications in Instagram profiles of official health agencies in Brazil

This article aims to analyze the clarity and engagement measures of publications on oral cancer in the Instagram profiles of official health agencies in Brazil. An infodemiological study was conducted with 81 profiles. Data collected concerned content classification, account and media, manner of addressing the topic, number of posts, likes, comments, views and hashtags. The clarity of the educational publications was assessed with the Brazilian version of the Clear Communication Index (BR-CDC-CCI). Data analysis involved Spearman's correlation and the Mann-Whitney test (α = 5%). A total of 775 publications on oral cancer were found. The average BR-CDC-CCI score was 69.8 (SD = 15.5). The clarity of the information was adequate in 9.5% of the educational publications. Positive correlations were found between the number of likes and engagement (comments [r = 0.49], views [r = 0.96]), number of hashtags (r = 0.13) and year of publication (r = 0.21). Publications from the Health Ministry had a significantly higher BR-CDC-CCI score compared to the other profiles. Publications on oral cancer were correlated with engagement, year of publication and number of hashtags. Public agencies increased publications to reach the population, but the clarity of the content was low.

Assessing Credibility: Quality Criteria for Patients, Caregivers, and the Public in Online Health Information-A Qualitative Study

The increasing reliance on the Internet for health information has raised concerns about patients using unreliable and potentially harmful content. This study aimed to establish quality criteria to assist patients, caregivers, and the public in evaluating the reliability of online health information. We conducted focus group workshops with 25 participants recruited across Canada, proficient in either English or French. The participants included 13 females and 12 males, with the majority having a college or higher level of education. Through an in-depth analysis comparing various aspects, the participants determined 6 quality criteria: authorship, reliability, usefulness, accessibility, readability, and privacy & confidentiality. The findings from this study present a comprehensive list of quality criteria that will contribute to developing evidence-based quality benchmarks and policy frameworks in multiple languages. These criteria are not only valid but also well-suited to the diverse needs and preferences of patients and the public, providing a reliable framework for evaluating online health information through an evidence-based approach.

Dr. Google to Dr. ChatGPT: assessing the content and quality of artificial intelligence-generated medical information on appendicitis

INTRODUCTION

Generative artificial intelligence (AI) chatbots have recently been posited as potential sources of online medical information for patients making medical decisions. Existing online patient-oriented medical information has repeatedly been shown to be of variable quality and difficult readability. Therefore, we sought to evaluate the content and quality of AI-generated medical information on acute appendicitis.

METHODS

A modified DISCERN assessment tool, comprising 16 distinct criteria each scored on a 5-point Likert scale (score range 16-80), was used to assess AI-generated content. Readability was determined using the Flesch Reading Ease (FRE) and Flesch-Kincaid Grade Level (FKGL) scores. Four popular chatbots, ChatGPT-3.5 and ChatGPT-4, Bard, and Claude-2, were prompted to generate medical information about appendicitis. Three investigators independently scored the generated texts blinded to the identity of the AI platforms.

RESULTS

ChatGPT-3.5, ChatGPT-4, Bard, and Claude-2 had overall mean (SD) quality scores of 60.7 (1.2), 62.0 (1.0), 62.3 (1.2), and 51.3 (2.3), respectively, on a scale of 16-80. Inter-rater reliability was 0.81, 0.75, 0.81, and 0.72, respectively, indicating substantial agreement. Claude-2 demonstrated a significantly lower mean quality score compared to ChatGPT-4 (p = 0.001), ChatGPT-3.5 (p = 0.005), and Bard (p = 0.001). Bard was the only AI platform that listed verifiable sources, while Claude-2 provided fabricated sources. All chatbots except for Claude-2 advised readers to consult a physician if experiencing symptoms. Regarding readability, FKGL and FRE scores of ChatGPT-3.5, ChatGPT-4, Bard, and Claude-2 were 14.6 and 23.8, 11.9 and 33.9, 8.6 and 52.8, 11.0 and 36.6, respectively, indicating difficulty readability at a college reading skill level.

CONCLUSION

AI-generated medical information on appendicitis scored favorably upon quality assessment, but most either fabricated sources or did not provide any altogether. Additionally, overall readability far exceeded recommended levels for the public. Generative AI platforms demonstrate measured potential for patient education and engagement about appendicitis.

Assessing Patterns in Childhood Obesity Patient Education: A Quality of Online Health Information and Google Trends Analysis

Background: Childhood obesity (CO) is rapidly increasing in prevalence and developing into a health crisis of developed nations. The condition is associated with increased risk of developing various comorbidities later in life. Current treatment algorithms primarily target family education. Thus, this study aims to understand the quality of information online regarding CO and common comorbidities, determine the readability of online information, and report patterns in public interest over time using Google Trends. Methods: Four validated quality of information tools and 6 readability tools were implemented across 36 websites derived from 4 Google searches. Pearson's correlation coefficient was used to determine the associations between Google Trends' relative search volumes (RSVs) and biennial BMI-based cumulative proportion of CO. Results: Results showed variable information quality among the websites as scores ranged from "fair" to "very poor." Using six readability formulas, no website scored at or below the sixth grade reading level recommended by the American Medical Association. Google Trends' RSVs for the term "Childhood Obesity" were repeatedly increased in the months that fall in the US academic school year (October-November and February-May), and decreased within months in the US vacation periods (December-January and June-September). Search volumes were also negatively correlated with CO and pediatric type 2 diabetes prevalence. Conclusions: In summary, while Google Trends analysis showed that schools may play a role in increasing interest and awareness online, quality of information and readability analysis displayed that the information and its accessibility are far too variable to be reliable.

Ostomy Information on the Internet-Is It Good Enough?

PURPOSE

The aim of this study was to determine which internet search engines and keywords patients with ostomies utilize, to identify the common websites using these terms, to determine what aspects of information they wanted, and to perform a quality and readability assessment for these websites.

DESIGN

A cross-sectional survey of persons with ostomies to identify search engines and terms, followed by a structured assessment of the quality and readability of the identified web pages.

SUBJECT AND SETTINGS

The sample comprised 20 hospitalized patients with ostomies cared for on a colorectal surgical ward of a tertiary care hospital located in Melbourne, Australia. There were 15 (75%) adult males and 5 (25%) adult females; their mean age was 52.2 years. Participants were surveyed between August and December 2020.

METHODS

Patients with newly formed ostomies were surveyed about which search engines and keywords they would use to look for information and for which questions regarding ostomies they wanted answers. In addition, 2 researchers then performed independent searches using the search terms identified by patient participants. These searches were conducted in August 2021, with the geographical location set to Australia. The quality of the websites was graded using the DISCERN, Ensuring Quality Information for Patients, and Quality Evaluation Scoring Tool scoring assessments, and their readability was graded using the Flesch Reading Ease Score tool.

RESULTS

Participants used Google as their primary search engine. Four keywords/phrases were identified: stoma for bowel surgery, ileostomy, colostomy, and caring for stoma. Multiple web pages were identified, 8 (21%) originated from Australia, 7 (18%) were from the United Kingdom, and 23 (61%) were from the United States. Most web pages lacked recent updates; only 18% had been undated within the last 12 months. The overall quality of the online information on ostomies was moderate with an average level of readability, deemed suitable for patient educational purposes.

CONCLUSIONS

Information for persons living with an ostomy can be obtained from multiple web pages, and many sites have reasonable quality and are written at a suitable level. Unfortunately, these websites are rarely up-to-date and may contain advice that may not be applicable to individual patients.

A Cross-Sectional Analysis of the Readability of Online Information Regarding Hip Osteoarthritis

Introduction Osteoarthritis (OA) is an age-related degenerative joint disease. There is a 25% risk of symptomatic hip OA in patients who live up to 85 years of age. It can impair a person's daily activities and increase their reliance on healthcare services. It is primarily managed with education, weight loss and exercise, supplemented with pharmacological interventions. Poor health literacy is associated with negative treatment outcomes and patient dissatisfaction. A literature search found there are no previously published studies examining the readability of online information about hip OA. Objectives To assess the readability of healthcare websites regarding hip OA. Methods The terms "hip pain", "hip osteoarthritis", "hip arthritis", and "hip OA" were searched on Google and Bing. Of 240 websites initially considered, 74 unique websites underwent evaluation using the WebFX online readability software (WebFX®, Harrisburg, USA). Readability was determined using the Flesch Reading Ease Score (FRES), Flesch-Kincaid Reading Grade Level (FKGL), Gunning Fog Index (GFI), Simple Measure of Gobbledygook (SMOG), Coleman-Liau Index (CLI), and Automated Readability Index (ARI). In line with recommended guidelines and previous studies, FRES >65 or a grade level score of sixth grade and under was considered acceptable. Results The average FRES was 56.74±8.18 (range 29.5-79.4). Only nine (12.16%) websites had a FRES score >65. The average FKGL score was 7.62±1.69 (range 4.2-12.9). Only seven (9.46%) websites were written at or below a sixth-grade level according to the FKGL score. The average GFI score was 9.20±2.09 (range 5.6-16.5). Only one (1.35%) website was written at or below a sixth-grade level according to the GFI score. The average SMOG score was 7.29±1.41 (range 5.4-12.0). Only eight (10.81%) websites were written at or below a sixth-grade level according to the SMOG score. The average CLI score was 13.86±1.75 (range 9.6-19.7). All 36 websites were written above a sixth-grade level according to the CLI score. The average ARI score was 6.91±2.06 (range 3.1-14.0). Twenty-eight (37.84%) websites were written at or below a sixth-grade level according to the ARI score. One-sample t-tests showed that FRES (p<0.001, CI -10.2 to -6.37), FKGL (p<0.001, CI 1.23 to 2.01), GFI (p<0.001, CI 2.72 to 3.69), SMOG (p<0.001, CI 0.97 to 1.62), CLI (p<0.001, CI 7.46 to 8.27), and ARI (p<0.001, CI 0.43 to 1.39) scores were significantly different from the accepted standard. One-way analysis of variance (ANOVA) testing of FRES scores (p=0.009) and CLI scores (p=0.009) showed a significant difference between categories. Post hoc testing showed a significant difference between academic and non-profit categories for FRES scores (p=0.010, CI -15.17 to -1.47) and CLI scores (p=0.008, CI 0.35 to 3.29). Conclusions Most websites regarding hip OA are written above recommended reading levels, hence exceeding the comprehension levels of the average patient. Readability of these resources must be improved to improve patient access to online healthcare information which can lead to improved patient understanding of their own condition and treatment outcomes.

Assessing Patients Perception: Analyzing the Quality, Reliability, Comprehensibility, and the Mentioned Medical Concepts of Traumatic Brain Injury Videos on YouTube

OBJECTIVE

The aim of this study is to analyze the quality, reliability, comprehensibility, and the mentioned medical concepts of traumatic brain injury (TBI) related videos on YouTube.

METHODS

"Traumatic brain injury (TBI)" and Google Trends related queries were used, and 328 videos were included. Categorization, quality assessment via a 5-point Global Quality Scale, reliability evaluation using a modified DISCERN scale, comprehensibility assessment using Flesch-Kincaid Reading Ease and Flesch-Kincaid Grade Level, and consensus-based classification for usefulness were performed. Target audience categorization was content-based. Text mining techniques were used to identify biomedical terms in video transcripts.

RESULTS

Most of the videos were intended for nonhealthcare professionals and deemed useful. The videos had intermediate quality and a moderate level of reliability. The comprehensibility of the videos exceeded the recommended levels. Videos predominantly covered TBI symptoms, the severity of the condition, its impact on individuals, and possibly strategies related to diagnosis and treatment.

CONCLUSIONS

Results suggest the requirement for higher quality and reliability in YouTube content about TBI. Emphasis should be placed on clear and accurate language to promote comprehensibility. Continued research, guidelines, education, and platform oversight can enhance the spread of reliable health information on social media, benefiting creators, and consumers in this field.

Responses of Five Different Artificial Intelligence Chatbots to the Top Searched Queries About Erectile Dysfunction: A Comparative Analysis

The aim of the study is to evaluate and compare the quality and readability of responses generated by five different artificial intelligence (AI) chatbots-ChatGPT, Bard, Bing, Ernie, and Copilot-to the top searched queries of erectile dysfunction (ED). Google Trends was used to identify ED-related relevant phrases. Each AI chatbot received a specific sequence of 25 frequently searched terms as input. Responses were evaluated using DISCERN, Ensuring Quality Information for Patients (EQIP), and Flesch-Kincaid Grade Level (FKGL) and Reading Ease (FKRE) metrics. The top three most frequently searched phrases were "erectile dysfunction cause", "how to erectile dysfunction," and "erectile dysfunction treatment." Zimbabwe, Zambia, and Ghana exhibited the highest level of interest in ED. None of the AI chatbots achieved the necessary degree of readability. However, Bard exhibited significantly higher FKRE and FKGL ratings (p = 0.001), and Copilot achieved better EQIP and DISCERN ratings than the other chatbots (p = 0.001). Bard exhibited the simplest linguistic framework and posed the least challenge in terms of readability and comprehension, and Copilot's text quality on ED was superior to the other chatbots. As new chatbots are introduced, their understandability and text quality increase, providing better guidance to patients.

Analysis of the Most Popular Online Ankle Fracture-Related Patient Education Materials

Background

Given the increasing accessibility of Internet access, it is critical to ensure that the informational material available online for patient education is both accurate and readable to promote a greater degree of health literacy. This study sought to investigate the quality and readability of the most popular online resources for ankle fractures.

Methods

After conducting a Google search using 6 terms related to ankle fractures, we collected the first 20 nonsponsored results for each term. Readability was evaluated using the Flesch Reading Ease (FRE), Flesch-Kincaid Grade Level (FKGL), and Gunning Fog Index (GFI) instruments. Quality was evaluated using custom created Ankle Fracture Index (AFI).

Results

A total of 46 of 120 articles met the inclusion criteria. The mean FKGL, FRE, and GFI scores were 8.4 ± 0.5, 57.5 ± 3.2, and 10.5 ± 0.5, respectively. The average AFI score was 15.4 ± 1.4, corresponding to an "acceptable" quality rating. Almost 70% of articles (n = 32) were written at or below the recommended eighth-grade reading level. Most articles discussed the need for imaging in diagnosis and treatment planning while neglecting to discuss the risks of surgery or potential future operations.

Conclusion

We found that online patient-facing materials on ankle fractures demonstrated an eighth-grade average reading grade level and an acceptable quality on content analysis. Further work should surround increasing information regarding risk factors, complications for surgery, and long-term recovery while ensuring that readability levels remain below at least the eighth-grade level.

Readability and Health Literacy Scores for ChatGPT-Generated Dermatology Public Education Materials: Cross-Sectional Analysis of Sunscreen and Melanoma Questions

Collapse

New Frontiers in Health Literacy: Using ChatGPT to Simplify Health Information for People in the Community

BACKGROUND

Most health information does not meet the health literacy needs of our communities. Writing health information in plain language is time-consuming but the release of tools like ChatGPT may make it easier to produce reliable plain language health information.

OBJECTIVE

To investigate the capacity for ChatGPT to produce plain language versions of health texts.

DESIGN

Observational study of 26 health texts from reputable websites.

METHODS

ChatGPT was prompted to 'rewrite the text for people with low literacy'. Researchers captured three revised versions of each original text.

MAIN MEASURES

Objective health literacy assessment, including Simple Measure of Gobbledygook (SMOG), proportion of the text that contains complex language (%), number of instances of passive voice and subjective ratings of key messages retained (%).

KEY RESULTS

On average, original texts were written at grade 12.8 (SD = 2.2) and revised to grade 11.0 (SD = 1.2), p < 0.001. Original texts were on average 22.8% complex (SD = 7.5%) compared to 14.4% (SD = 5.6%) in revised texts, p < 0.001. Original texts had on average 4.7 instances (SD = 3.2) of passive text compared to 1.7 (SD = 1.2) in revised texts, p < 0.001. On average 80% of key messages were retained (SD = 15.0). The more complex original texts showed more improvements than less complex original texts. For example, when original texts were ≥ grade 13, revised versions improved by an average 3.3 grades (SD = 2.2), p < 0.001. Simpler original texts (< grade 11) improved by an average 0.5 grades (SD = 1.4), p < 0.001.

CONCLUSIONS

This study used multiple objective assessments of health literacy to demonstrate that ChatGPT can simplify health information while retaining most key messages. However, the revised texts typically did not meet health literacy targets for grade reading score, and improvements were marginal for texts that were already relatively simple.

Can Artificial Intelligence Improve the Readability of Patient Education Materials on Aortic Stenosis? A Pilot Study

INTRODUCTION

The advent of generative artificial intelligence (AI) dialogue platforms and large language models (LLMs) may help facilitate ongoing efforts to improve health literacy. Additionally, recent studies have highlighted inadequate health literacy among patients with cardiac disease. The aim of the present study was to ascertain whether two freely available generative AI dialogue platforms could rewrite online aortic stenosis (AS) patient education materials (PEMs) to meet recommended reading skill levels for the public.

METHODS

Online PEMs were gathered from a professional cardiothoracic surgical society and academic institutions in the USA. PEMs were then inputted into two AI-powered LLMs, ChatGPT-3.5 and Bard, with the prompt "translate to 5th-grade reading level". Readability of PEMs before and after AI conversion was measured using the validated Flesch Reading Ease (FRE), Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook Index (SMOGI), and Gunning-Fog Index (GFI) scores.

RESULTS

Overall, 21 PEMs on AS were gathered. Original readability measures indicated difficult readability at the 10th-12th grade reading level. ChatGPT-3.5 successfully improved readability across all four measures (p < 0.001) to the approximately 6th-7th grade reading level. Bard successfully improved readability across all measures (p < 0.001) except for SMOGI (p = 0.729) to the approximately 8th-9th grade level. Neither platform generated PEMs written below the recommended 6th-grade reading level. ChatGPT-3.5 demonstrated significantly more favorable post-conversion readability scores, percentage change in readability scores, and conversion time compared to Bard (all p < 0.001).

CONCLUSION

AI dialogue platforms can enhance the readability of PEMs for patients with AS but may not fully meet recommended reading skill levels, highlighting potential tools to help strengthen cardiac health literacy in the future.

The Evaluation of the Suitability, Quality, and Readability of Publicly Available Online Resources for the Self-Management of Fear of Cancer Recurrence

Cancer survivors often rely on the internet for health information, which has varying levels of readability, suitability, and quality. There is a need for high-quality online self-management resources for cancer survivors with fear of cancer recurrence (FCR). This study evaluated the readability, suitability, and quality of publicly available online FCR self-management resources. A Google search using FCR-related keywords identified freely available FCR self-management resources for cancer survivors in English. Resource readability (reading grade level), suitability, and quality were evaluated using relevant assessment tools. Descriptive statistics and cluster analysis identified resources with higher suitability and quality scores. Mean resource (n = 23) readability score was grade 11 (SD = 1.6, Range = 9-14). The mean suitability score was 56.0% (SD = 11.4%, Range = 31.0-76.3%), indicating average suitability and the mean quality score was 53% (SD = 11.7%, Range = 27-80%), indicating fair quality. A cluster of 15 (65%) resources with higher suitability and quality scores was identified. There were no significant associations between suitability or quality scores and the type of organisation that published the resources. Online FCR self-management resources varied in readability, suitability and quality. Resources with higher quality and suitability scores relative to other resources are identified for use by healthcare professionals and cancer survivors. Resources that are more culturally appropriate, with lower reading grade levels and detailed self-management strategies are needed.

Readability and content gaps in online epilepsy surgery materials as potential health literacy and shared-decision-making barriers

OBJECTIVE

Epilepsy surgery is an effective albeit underused treatment for refractory epilepsy, and online materials are vital to patient understanding of the complex process. Our goal is to analyze the readability and content inclusion of online patient health education materials designed for epilepsy surgery.

METHODS

A private browser setting was used on Google and Bing to identify the top 100 search results for the terms "epilepsy+surgery". Scientific papers, insurance pages, pay-wall access sites, and non-text content were excluded. The website text was reformatted to exclude graphics, contact information, links, and headers. Readability metrics were calculated using an online tool. Text content was analyzed for inclusion of important concepts (pre-surgical evaluation, complications, risks of continued seizures, types of surgery, complimentary diagrams/audiovisual material). Comparison of readability and content inclusion was performed as a function of organization types (epilepsy center, community health organization, pediatric-specific) and location (region, country).

RESULTS

Browser search yielded 82 distinct websites with information regarding epilepsy surgery, with 98.7% of websites exceeding the recommended 6th-grade reading level for health information. Epilepsy centers had significantly worse readability (Flesch-Kincaid Grade Level (FKGL) P < 0.01 and Flesch Reading Ease (FRE) P < 0.05). Content analysis showed that only 37% of websites discuss surgical side effects and only 23% mention the risks of continued seizures. Epilepsy centers were less likely to report information on surgical side effects (P < 0.001). UK-based websites had better readability (FKGL P < 0.01 and FRE P < 0.01) and were more likely to discuss side effects (P = 0.01) compared to US-based websites.

SIGNIFICANCE

The majority of online health content is overly complex and relatively incomplete in multiple key areas important to health literacy and understanding of surgical candidacy. Our findings suggest academic organizations, including level 4 epilepsy centers, need to simplify and broaden online education resources. More comprehensive, publicly accessible, and readable information may lead to better-shared decision-making.

Patient education about breathlessness

PURPOSE OF THE REVIEW

Effective education enables people to modify the distress and impact of breathlessness by integrating evidence-informed breathlessness-related behaviours (knowledge, skill, attitude) into everyday life. This review considers recent studies of educational approaches focussed on chronic breathlessness as a modifiable, noxious and debilitating multidimensional experience.

RECENT FINDINGS

Systematic assessments of text-based patient education materials and mobile phone applications specific to breathlessness indicate that while these resources are readily available, issues continue to persist with quality, readability, usefulness and availability of non-English language versions. Various forms of educational interventions for breathlessness have proven feasible and valued by people living with breathlessness and their significant others (uptake/completion, personal benefit, ripple effect on health professionals). Health professional knowledge about the impact of chronic breathlessness and effective management can be altered through structured, educational interventions.

SUMMARY

Empiric studies of patient education for breathlessness are scarce despite persistent calls for better breathlessness education for people living with or providing care for someone living with this noxious symptom. In clinical practice, it is highly likely that there are effective and ineffective educational practices, both of which, if publicly disseminated, would inform future educational strategies to advance breathlessness self-management.

The Readability and Quality of Web-Based Patient Information on Nasopharyngeal Carcinoma: Quantitative Content Analysis

BACKGROUND

Nasopharyngeal carcinoma (NPC) is a rare disease that is strongly associated with exposure to the Epstein-Barr virus and is characterized by the formation of malignant cells in nasopharynx tissues. Early diagnosis of NPC is often difficult owing to the location of initial tumor sites and the nonspecificity of initial symptoms, resulting in a higher frequency of advanced-stage diagnoses and a poorer prognosis. Access to high-quality, readable information could improve the early detection of the disease and provide support to patients during disease management.

OBJECTIVE

This study aims to assess the quality and readability of publicly available web-based information in the English language about NPC, using the most popular search engines.

METHODS

Key terms relevant to NPC were searched across 3 of the most popular internet search engines: Google, Yahoo, and Bing. The top 25 results from each search engine were included in the analysis. Websites that contained text written in languages other than English, required paywall access, targeted medical professionals, or included nontext content were excluded. Readability for each website was assessed using the Flesch Reading Ease score and the Flesch-Kincaid grade level. Website quality was assessed using the Journal of the American Medical Association (JAMA) and DISCERN tools as well as the presence of a Health on the Net Foundation seal.

RESULTS

Overall, 57 suitable websites were included in this study; 26% (15/57) of the websites were academic. The mean JAMA and DISCERN scores of all websites were 2.80 (IQR 3) and 57.60 (IQR 19), respectively, with a median of 3 (IQR 2-4) and 61 (IQR 49-68), respectively. Health care industry websites (n=3) had the highest mean JAMA score of 4 (SD 0). Academic websites (15/57, 26%) had the highest mean DISCERN score of 77.5. The Health on the Net Foundation seal was present on only 1 website, which also achieved a JAMA score of 3 and a DISCERN score of 50. Significant differences were observed between the JAMA score of hospital websites and the scores of industry websites (P=.04), news service websites (P<.048), charity and nongovernmental organization websites (P=.03). Despite being a vital source for patients, general practitioner websites were found to have significantly lower JAMA scores compared with charity websites (P=.05). The overall mean readability scores reflected an average reading age of 14.3 (SD 1.1) years.

CONCLUSIONS

The results of this study suggest an inconsistent and suboptimal quality of information related to NPC on the internet. On average, websites presented readability challenges, as written information about NPC was above the recommended reading level of sixth grade. As such, web-based information requires improvement in both quality and accessibility, and healthcare providers should be selective about information recommended to patients, ensuring they are reliable and readable.

When Positive is Negative: Health Literacy Barriers to Patient Access to Clinical Laboratory Test Results

BACKGROUND

Health literacy is a multidimensional set of skills (e.g., narrative, numeracy, digital, medication) that patients need to access and understand health information timely and accurately to make evidence-based informed decisions.

CONTENT

Multiple barriers prevent patients from effectively interacting with health information. The most salient barriers are poor overall health literacy skills and linguistic proficiency in English. As patients prefer direct access to laboratory test results, especially those of routine tests, contextualization and provider-directed interpretation of results are required to foster shared decision-making to address their healthcare issues and improve health outcomes.

SUMMARY

The use of systematic approaches that account for poor health literacy skills and include culturally and linguistically appropriate planning and availability of resources is warranted at individual and population health levels (e.g., human-centered design of patient portals).

A Cross-Sectional Study of Graduate Medical Education in Radiological Fellowships using Accessible Content

Graduate medical education in radiology serves an imperative role in training the next generation of specialists. Given the regularity of virtual interviews, the website of a fellowship programs remains a critical first-line source of information of applicants. The aim of this study is to systematically evaluate 7 radiology fellowship programs utilizing a systematic process. A cross-sectional descriptive 286 graduate medical education fellowship programs in radiology were screened from the Fellowship and Residency Electronic Interactive Database (FREIDA). Extracted data was evaluated for comprehensiveness using 20 content criteria, and a readability score is calculated. The mean comprehensiveness among all fellowship program websites was 55.8% (n = 286), and the average FRE among the program overview sections was 11.9 (n = 214). ANOVA revealed no statistical significance in program website comprehensiveness between radiology fellowships (P = 0.33). The quality of a program's website data continues to serve an important role in an applicant's decision-making. Fellowship programs have improved in their content availability overtime, but content reevaluation needs to be continued for tangible improvement.

The quality and reliability of the Internet as a source of information for hypodontia patients

OBJECTIVES

The aim of this study was to determine the quality, reliability and usability of information on the Internet regarding hypodontia.

METHOD

A survey of patients with hypodontia revealed seven key search terms favoured by patients: Hypodontia; Congenitally missing teeth; Missing teeth; Gaps in teeth; Cure of missing teeth; Information on missing teeth; and Treatment of missing teeth. These were entered into four search engines: Google; Ask; Wikipedia; and NHS Choices. Relevant websites were assessed for their overall demographics, author type, country of origin and rank within the search engine. They were then analysed using five validated assessment tools. Intra-examiner reliability was assessed, and statistical analysis of the data was undertaken.

RESULTS

Good intra-examiner reliability was observed. A total of 48 websites were included for analysis from an initial 1718. There was no relationship between the ranking of a website on a search engine and the quality of information it contained. When medical search terminology was used, it resulted in websites of better quality than layperson search terms. Most websites were produced by general dental or specialist dental practices but the quality of these was poorer than those developed by private companies and medical organisations. The country of origin was primarily the USA and UK; however, this had no relationship to website quality. Overall, the majority of websites scored poorly for the validated tools and none scored well across multiple tools. A statistical analysis showed a positive relationship between the LIDA and DISCERN instruments but no other correlation between other validated tools was found.

CONCLUSION

The quality and reliability of information on the Internet regarding hypodontia is generally poor. There is a need for a reliable online hypodontia resource that can be recommended for patient use.

Evaluating the Quality, Readability, and Activity of Online Information on Brain Arteriovenous Malformations

Introduction Brain arteriovenous malformations (AVMs) are vascular deformities created by improper connections between arteries and veins, most commonly in the brain and spinal cord. The management is complex and patient-dependent; further understanding of patient education activities is imperative. Internet access has become more ubiquitous, allowing patients to utilize a large database of medical information online. Using Google Trends (GT) (Google LLC, Mountain View, CA, USA), one can see the public interest in a particular topic over time. Further, when presented with numerous search results, patients may not be able to identify the highest-yielding resources, making objective measures of information quality and readability imperative. Methods A GT analysis was conducted for "hereditary hemorrhagic telangiectasia," "cerebral aneurysm," and "arteriovenous malformation". These relative search volumes (RSV) were compared with the 2017 to 2019 annual USA AVM diagnosis quantity for correlation. These RSVs were also compared with the 2017 to 2019 annual USA deaths due to cerebral hemorrhagic conditions. One search was conducted for "brain arteriovenous malformation". Since most users looking for health information online use only the first page of sources, the quality and readability analyses were limited to the first page of results on Google search. Five quality tools and six readability formulas were used. Results Pearson's correlation coefficients showed positive correlations between USA AVM RSVs and annual AVM deaths per capita from 2017 to 2019 (R2=0.932). The AVM annual diagnosis quantity and AVM RSVs showed a strong positive correlation as well (R2=0.998). Hereditary hemorrhagic telangiectasia and cerebral aneurysms had strong positive correlations between their RSVs and their corresponding annual diagnoses in the 2017 to 2019 time period (R2=0.982, R2=0.709). One-way ANOVA, for USA's 2004 to 2021 AVM RSVs and 2004 to 2019 deaths per capita, displayed no month-specific statistically significant repeating pattern (all p>0.483). The DISCERN tool had four websites that qualified as "poor" and five as "good." The average score for the tool was "good." The Journal of the American Medical Association (JAMA) benchmark scores were very low on average, as four websites achieved zero points. There was a wide variance in the currency, relevance, authority, accuracy, and purpose (CRAAP) scores, indicating an inconsistent level of webpage reliability across results. The patient education materials assessment tool (PEMAT) understandability (86.6%) showed much higher scores than the PEMAT actionability (54.6%). No readability score averaged at or below the American Medical Association (AMA)-recommended sixth-grade reading level. Conclusion These GT correlations may be due to patients and families with new diagnoses researching those same conditions online. The seasonality results reflect that no prior research has detected seasonality for AVM diagnosis or presentation. The quality study showed a wide variance in website ethics, treatment information quality, website/author qualifications, and actionable next steps regarding AVMs. Overall, this study showed that patients are routinely attempting to access information regarding these intracranial conditions, but the information available, specifically regarding AVMs, is not routinely reliable and the reading level required to understand them is too high.

Accessing publicly funded donor insemination treatment in the UK: is funding information available on fertility clinic websites?

We sought to find out if information about public funding for regulated donor insemination (DI) was available on UK fertility clinic websites, and if so, what information was provided for same-sex couples and single women; and if the available information was easily readable. The 'Choose a fertility clinic' pages of the Human Fertilisation and Embryology Authority (HFEA) website were used to identify all licensed fertility clinics in the UK, and any available text on public funding for DI treatment was extracted. The Flesch reading ease scores were calculated to determine the readability of the extracted text. Of the 52 clinics included in the synthesis, 23 mentioned public funding, and for 16 of these, it was unclear whether public funding was available. Six of the 23 clinics mentioned public funding for same-sex couples, and two mentioned public funding for single women. The Flesch reading ease scores indicated that none of the text about funding for DI treatment on any of the clinic websites met the NHS-advised level of readability for health information. Fertility clinic websites should specify whether they offer publicly funded treatment, and to whom, as well as clearly stating the eligibility criteria, using suitably readable language to communicate this.

Readability of publicly available mental health information: A systematic review

OBJECTIVE

Relatively little research has examined the health literacy demand of public communication (e.g. websites, pamphlets, and posters) about mental disorders. This study describes characteristics of existing research and summarizes what is known about the readability of such information.

METHODS

A search of eight data bases yielded 33 studies that met inclusion criteria. Studies were screened for relevance at each stage and then coded for key characteristics and appraised for quality by both authors working independently.

RESULTS

Grade-level readability scores as measured by the Flesch-Kincaid, SMOG, and other indices ranged from 6th to 17th grade. Most Flesch Reading Ease scores fell within the 30-50 range. Results of accessibility measures were inconsistent.

CONCLUSION

With the recommended readability level for health communication set at sixth grade, most publicly available information about mental disorders uses vocabulary and sentence structure that is too complex for the general public. Mixed evidence indicated that accessibility issues are also problematic.

PRACTICE IMPLICATIONS

Developers of health information need to decrease health literacy demand in written mental health information to ensure patients and their families may benefit from this information.

Readability and beyond - Health literacy and numeracy and COVID-19 communications in early childhood education: Are we communicating effectively?

OBJECTIVE

Analyse the linguistic and numerical complexity of COVID-19-related health information communicated from Australian national and state governments and health agencies to national and local early childhood education (ECE) settings.

METHODS

Publicly available health information (n = 630) was collected from Australian national and state governments and health agencies, and ECE agencies and service providers. A purposive sample of documents (n = 33) from 2020 to 2021 was analysed inductively and deductively combining readability, health numeracy and linguistic analyses and focusing on the most frequent actionable health advice topics.

RESULTS

COVID-19 health advice most frequently related to hygiene, distancing and exclusion. Readability scores in 79% (n = 23) of documents were above the recommended grade 6 reading level for the public. Advice was delivered using direct linguistic strategies (n = 288), indirect strategies (n = 73), and frequent mitigating hedges (n = 142). Most numerical concepts were relatively simple, but lacked elaborative features (e.g., analogies) and/or required subjective interpretation.

CONCLUSION

COVID-19 health advice available to the ECE sector included linguistic and numerical information open to mis/interpretation making it difficult to understand and implement.

PRACTICE IMPLICATIONS

Combining readability scores with measures of linguistic and numerical complexity offers a more holistic approach to assessing accessibility of health advice and improving health literacy among its recipients.

Evaluation of quality, readability, suitability, and usefulness of online resources available to cancer survivors

PURPOSE

The aim of this study was to evaluate the quality, readability, suitability, and usefulness of resources publicly available to adult cancer survivors (aged 18 +) who have completed primary treatment.

METHODS

Resources were identified in July 2021 through Google. Search completeness was verified using Yahoo, Bing, and MedlinePlus. Retrieved resources were assessed for quality using the DISCERN, readability, suitability using the Suitability Assessment Measure (SAM), and usefulness based on a list of unmet needs and self-management skills derived from the literature. Descriptive analyses were conducted, and a cluster analysis identified the highest-scoring resources.

RESULTS

Forty-five resources were included. The mean DISCERN score was fair at 63.3% (SD 13.7%) with low-rated items being sources, publication date, and risks and mechanisms of treatment. The mean reading grade level was 11.19 (SD 1.61, range 8-16) with only one resource scoring an 8. The mean SAM score was in the adequate range at 48.2% (SD 10.6%), with graphics being the lowest-rated section. On average, included resources addressed 57.7% (SD 27.3%) of the unmet needs and 48.4% (SD 20.9%) of the self-management skills, the least addressed being problem-solving.

CONCLUSION

Quality and suitability were fair, whereas readability exceeded recommended levels. Only one resource had a superior score in both quality and suitability.

IMPLICATIONS FOR CANCER SURVIVORS

The most pressing need is to develop resources for cancer survivors that address their unmet needs and are accessible in terms of literacy. Study findings outline the highest-scoring resources currently available to survivors, families, and clinicians.

Accessibility of State and Territory Public Health Department Website Information on COVID-19 Outpatient Treatments in the US

This cross-sectional study assesses the reading level and accessibility of information on COVID-19 treatments posted on US public health websites for states, territories, and Washington, DC.

Evaluation of accuracy, reliability, quality, and readability of online patient information materials on coccyx injury

The aim of this research is to evaluate the websites containing "coccydynia, coccyx trauma or fracture" in terms of readability, reliability, accuracy, and quality. Searches for "coccydynia, coccyx trauma, coccyx fracture" were carried out in the 3 most used search engines in the USA: Google, Yahoo, and Bing in February 2022. A total of 141 websites were rated by 2 different neurosurgeons for the "Global Quality Score" and "Alexa Popularity Rank." 97.2% of the sites examined include the definition of the disease, 66% include the importance of the disease, 92.9% include the symptoms of the disease, 88.7% include the treatment of the disease, 78% include the signs of the disease, 77.3% include the mechanism of the disease It has been determined that the websites examined within the scope of the research have high global quality score (GQS) and APR and are enriched with images to a large extent.

A critical appraisal of web-based information on shoulder pain comparing biomedical vs. psychosocial information

BACKGROUND

Websites have become a primary way for patients to access health-related information, which allows patients to not only understand their condition better but also to engage in better decision making with their health care provider. However, this can be a double-edged sword, as information patients access may not be of high quality, easily readable, or could be biased based on website authorship. This study examines the readability and content quality of common websites about shoulder pain, with a specific focus on biomedical vs. psychosocial information.

METHODS

The Flesch reading-ease score (FRES) and Flesch-Kincaid grade level (FKGL) instruments were used to assess website readability. Health on the net code of conduct (HONcode) certification and the DISCERN tool were used to evaluate the reliability and quality of information. Lastly, shoulder-specific content quality and focus was gauged using a Shoulder-specific Website Appraisal Tool (SWAT) created for this study. A systematic search protocol was used to identify popular shoulder injury websites. The websites were identified using 5 search terms (shoulder pain, shoulder muscle pain, shoulder impingement, shoulder rotator cuff pain, and shoulder pain diagnosis) across 5 English-speaking regions (United States, Canada, United Kingdom, Australia, and New Zealand) using the Google search engine. The top 10 websites for each term and region combination were included and combined, yielding 41 original websites for appraisal; several (6) websites were omitted as duplicates, behind paywalls, or nontext (video) for a total of 35 websites appraised.

RESULTS

On average, the FRES shoulder pain websites readability was 55.37, which is categorized as "fairly difficult" to read, and a seventh- or eighth-grade reading level based on the FKGL. For trustworthiness and bias, 57% (20 of 35) of the websites were HONcode certified. The quality of health care information using the DISCERN score averaged 50.92%. Examining shoulder-specific content quality, the average SWAT score was 10.54 out of 14 possible points, with only 1 website reporting information on psychosocial aspects of shoulder pain.

CONCLUSIONS

This study suggests that shoulder pain websites present information that is at too high of a reading level for public consumption, has a strong bias toward biomedical causes of shoulder pain, and would benefit from implementation of website screening tools to improve evidence-based content.

Use of the Internet for Health Purposes-A National Web-Based Cross-Sectional Survey among Adults in Poland

The Internet is one of the most popular information sources. This study aimed to assess the public attitudes towards the use of the Internet for health purposes as well as to identify factors associated with the use of the Internet for health purposes among adults in Poland. A web-based cross-sectional survey was carried out between 9 and 12 September 2022 on a nationwide random-quota sample of 1092 adults in Poland. The study questionnaire included 10 questions on Internet use for health purposes. The most common reason for the use of the Internet for health purposes was searching for information on drugs and their effects (69.9%). Almost two-thirds of participants used the Internet for searching for health information (64.9%), for doctors/medical services (63.4%), or for medical facilities (65.3%). Over half of the participants used the Internet for checking online reviews of doctors (55.2%) and 43.5% of the participants ordered drugs or dietary supplements online. Out of 9 different socioeconomic factors analyzed in this study, having higher education, being female, as well as living in cities from 100,000 to 499,999 residents were the most important factors (p < 0.05) associated with the use of the Internet for health purposes. This study confirmed a high level of adoption of medical Internet in Poland.

Development of an inflammatory bowel disease (IBD) Patient-Reported Experience Measure (PREM): A patient-led consensus work and 'think aloud' study for a quality improvement programme

BACKGROUND

Patient-Reported Experience Measures (PREMs) are key in improving healthcare quality, but no PREM exists for inflammatory bowel disease (IBD). This study aimed to co-produce a PREM with IBD service users for IBD service evaluation and quality improvement programme.

METHODS

A pool of 75 items was drawn from published survey instruments covering interactions with services and aspects of living with IBD. In Stage 1, during two workshops, eight expert service users reduced candidate items through a ranked-choice voting exercise and suggested further items. During Stage 2, 18 previously uninvolved people with IBD assessed the face and content validity of the candidate items in 'Think Aloud' interviews. During two final workshops (Stage 3), the expert service users removed, modified and added items based on the interview findings to produce a final version of the PREM.

RESULTS

Stage 1 generated a draft working PREM mapped to the following four domains: Patient-Centred Care; Quality; Accessibility; Communication and Involvement. The PREM included a set of nine items created by the expert group which shifted the emphasis from 'self-management' to 'living with IBD'. Stage 2 interviews showed that comprehension of the PREM was very good, although there were concerns about the wording, IBD-relevance and ambiguity of some items. During the final two workshops in Stage 3, the expert service users removed 7 items, modified 15 items and added seven new ones based on the interview findings, resulting in a 38-item PREM.

CONCLUSIONS

This study demonstrates how extensive service user involvement can inform PREM development.

PATIENT OR PUBLIC CONTRIBUTION

Patients were involved as active members of the research team and as research participants to co-produce and validate a PREM for IBD services. In Stage 1, eight expert service users ('the expert group') reduced candidate items for the PREM through a voting exercise and suggested new items. During Stage 2, 18 previously uninvolved people with IBD (the 'think aloud' participants) assessed the validity of the candidate items in 'Think Aloud' interviews as research participants. In Stage 3, the expert group removed, changed and added items based on the interview findings to produce a final version of the 38-item PREM. This study shows how service user involvement can meaningfully inform PREM development.

Readability of online health information pertaining to migraine and headache in the UK

An estimated 46% of the worldwide adult population live with an active headache disorder, and it is thought that there is a proportion of headache and migraine sufferers who do not attend for medical care, instead choosing to manage their symptoms at home. The internet continues to act as a source of online health information for self-management, however, it is important that this information can be understood by the user. Research indicates that most health information online is written at a level too difficult for much of the UK population to understand. The aim of this study was to investigate the readability of online health information pertaining to headache and migraine for a UK-based internet user accessing the top four search engines. Searches for ‘headache’ and ‘migraine’ were performed on each search engine and results from the first page were selected for analysis. Five validated readability tests were used to analyse readability; Flesch-Kincaid Grade Level, Flesch Reading Ease, Gunning Fog Index, Coleman-Liau Index and Simple Measure of Gobbledygook Index. We found that the majority of online health information about migraine and headache is too difficult for the UK adult population to read. Findings highlight work is required to ensure that information from a wider variety of sources is easier to comprehend for much of the population in order for individuals to make informed decisions about health seeking and self-management of headache and migraine. Health information providers should weave readability analysis into their content design process, incorporating shorter sentences and simpler words in their description of conditions and treatment.

Quality of web-based information about the coronavirus disease 2019: a rapid systematic review of infodemiology studies published during the first year of the pandemic

BACKGROUND

Following the outbreak of the coronavirus disease 2019, adequate public information was of outmost importance. The public used the Web extensively to read information about the pandemic, which placed significant responsibility in, for many, an unfamiliar situation as the disease spread across the globe. The aim of this review was to synthesize the quality of web-based information concerning the coronavirus disease 2019 published during the first year of the pandemic.

MATERIALS AND METHODS

A rapid systematic review was undertaken by searching five electronic databases (CINAHL, Communication & Mass Media Complete, PsycINFO, PubMed, Scopus). Empirical infodemiology reports assessing quality of information were included (n = 22). Methodological quality and risk of bias was appraised with tools modified from previous research, while quality assessment scores were synthesized with descriptive statistics. Topics illustrating comprehensiveness were categorized with content analysis.

RESULTS

The included reports assessed text-based content (n = 13) and videos (n = 9). Most were rated good overall methodological quality (n = 17). In total, the reports evaluated 2,654 websites or videos and utilized 46 assessors. The majority of the reports concluded that websites and videos had poor quality (n = 20). Collectively, readability levels exceeded the recommended sixth grade level. There were large variations in ranges of the reported mean or median quality scores, with 13 of 15 total sample scores being classified as poor or moderate quality. Four studies reported that ≥ 28% of websites contained inaccurate statements. There were large variations in prevalence for the six categories illustrating comprehensiveness.

CONCLUSION

The results highlight quality deficits of web-based information about COVID-19 published during the first year of the pandemic, suggesting a high probability that this hindered the general population from being adequately informed when faced with the new and unfamiliar situation. Future research should address the highlighted quality deficits, identify methods that aid citizens in their information retrieval, and identify interventions that aim to improve the quality of information in the online landscape.

Evaluating the readability, quality and reliability of online information on Behçet’s disease

There are concerns over the reliability and comprehensibility of health-related information on the internet. The goal of our research was to analyze the readability, reliability, and quality of information obtained from websites associated with Behçet’s disease (BD). On September 20, 2021, the term BD was used to perform a search on Google, and 100 eligible websites were identified. The Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), and Gunning Fog (GFOG) were used to evaluate the readability of the website. The JAMA score was used to assess the websites’ reliability, the DISCERN score and the Health on the Net Foundation code of conduct (HONcode) were used to assess quality, and Alexa was used to analyze their popularity. Sections of the text were evaluated, and the results revealed that the mean FRES was 35.49±14.42 (difficult) and the mean GFOG was 14.93±3.13 years (very difficult). According to the JAMA scores, 36% of the websites had a high reliability rating and 20% adhered to the HONcode. The readability was found to significantly differ from the reliability of the websites (p<0.05). Moreover, websites with scientific content were found to have higher readability and reliability (p<0.05). The readability of BD-related information on the Internet was found to be considerably higher than that recommended by the National Health Institute’s Grade 6, with moderate reliability and good quality. We believe that online information should have some level of readability and must have reliable content that is appropriate to educate the public, particularly for websites that provide with patient education material.

Evaluating the readability, quality and reliability of online patient education materials on post-covid pain

Background

The use of the Internet to access healthcare-related information is increasing day by day. However, there are concerns regarding the reliability and comprehensibility of this information. This study aimed to investigate the readability, reliability, and quality of Internet-based patient educational materials (PEM) related to "post-COVID-19 pain."

Methods

One-hundred websites that fit the purposes of the study were identified by searching for the terms "post-COVID-19 pain" and "pain after COVID-19" using the Google search engine on February 24, 2022. The website readability was assessed using the Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Gunning FOG (GFOG). The reliability, quality, and popularity of the websites were assessed using the JAMA score, DISCERN score/Health on the Net Foundation code of conduct, and Alexa, respectively.

Results

Upon investigation of the textual contents, the mean FRES was 51.40 ± 10.65 (difficult), the mean FKGL and SMOG were 10.93 ± 2.17 and 9.83 ± 1.66 years, respectively, and the mean GFOG was 13.14 ± 2.16 (very difficult). Furthermore, 24.5% of the websites were highly reliable according to JAMA scores, 8% were of high quality according to GQS values, and 10% were HONcode-compliant. There was a statistically significant difference between the website types and reliability (p = 0.003) and quality scores (p = 0.002).

Conclusion

The readability level of PEM on post-COVID-19 pain was considerably higher than grade 6 educational level, as recommended by the National Institutes of Health, and had low reliability and poor quality. We suggest that Internet-based PEM should have a certain degree of readability that is in accordance with the educational level of the general public and feature reliable content.

Readability of online e-cigarette cessation information

INTRODUCTION

Given the growing awareness of the health risks associated with e-cigarettes, many users will access information about how to effectively quit using e-cigarettes, and the internet likely will be a popular source of information. However, little is known about the readability of online e-cigarette cessation information. Therefore, the goal of the current study was to assess the readability of webpage information about e-cigarette cessation.

METHODS

A search of webpages was conducted using the following search terms: vaping addiction, quit vaping, quit Juul, stop vaping, stop Juul, and vaping cessation. The 464 webpages identified were coded for target audience, message valence, and source, and then assessed for reading level with the Flesch-Kincaid Grade Level assessment.

RESULTS

On average, webpage content was written at a 7th grade reading level (Flesch-Kincaid Grade Level Mean=7.34, SD=2.22) and less than 25% of webpages met readability guidelines (i.e. ≤6th grade reading level). There were no differences in readability by target audience, message valence, or webpage source.

CONCLUSIONS

The results suggest that most online content related to e-cigarette cessation is not written at a level that is easily understood by general audiences. Thus, tobacco control advocates should assess the reading level of their messaging to ensure wide accessibility of information.

Evaluation of an online text simplification editor using manual and automated metrics for perceived and actual text difficulty

Objective

Simplifying healthcare text to improve understanding is difficult but critical to improve health literacy. Unfortunately, few tools exist that have been shown objectively to improve text and understanding. We developed an online editor that integrates simplification algorithms that suggest concrete simplifications, all of which have been shown individually to affect text difficulty.

Materials and Methods

The editor was used by a health educator at a local community health center to simplify 4 texts. A controlled experiment was conducted with community center members to measure perceived and actual difficulty of the original and simplified texts. Perceived difficulty was measured using a Likert scale; actual difficulty with multiple-choice questions and with free recall of information evaluated by the educator and 2 sets of automated metrics.

Results

The results show that perceived difficulty improved with simplification. Several multiple-choice questions, measuring actual difficulty, were answered more correctly with the simplified text. Free recall of information showed no improvement based on the educator evaluation but was better for simplified texts when measured with automated metrics. Two follow-up analyses showed that self-reported education level and the amount of English spoken at home positively correlated with question accuracy for original texts and the effect disappears with simplified text.

Discussion

Simplifying text is difficult and the results are subtle. However, using a variety of different metrics helps quantify the effects of changes.

Conclusion

Text simplification can be supported by algorithmic tools. Without requiring tool training or linguistic knowledge, our simplification editor helped simplify healthcare related texts.

Online Readability Analysis: Mohs Micrographic Surgery Postsurgical Wound Care

OBJECTIVE

Although various treatment modalities exist for skin cancer care, Mohs micrographic surgery (MMS) is one of the most effective and cosmetically sensitive surgical techniques. The readability of online informational materials specifically related to MMS postsurgical wound care is extremely relevant for patients given the high rates of skin cancer in the US and the number of patients utilizing the internet for information.

METHODS

Investigators conducted Google searches to evaluate the current state of readability on MMS postsurgical wound care using the specific keywords "healing after Mohs surgery" and "wound care Mohs surgery." The readabilities of individual websites were analyzed using the WebFX online software. Health-specific click-through rate was used to select the number of samples assessed.

RESULTS

Based on the 33 unique websites evaluated, the aggregate readability of online MMS postsurgical wound care materials was 11.3, corresponding to an 11th-grade reading level by US standards.

CONCLUSIONS

Although this level of readability is an improvement in online MMS postsurgical wound care information relative to prior literature, there is still considerable work to be done by the dermatologic community in improving the readability of online patient materials regarding MMS.

Assessment of the Readability of Web-Based Patient Education Material From Major Canadian Pediatric Associations: Cross-sectional Study

BACKGROUND

Web-based patient education materials (PEMs) are frequently written above the recommended reading level in North America. Poor PEM readability limits the accessibility of medical information for individuals with average literacy levels or lower. Pediatric hospital and association websites have not only been shown to be a preferred source of information among caregivers but have also become a necessity during the COVID-19 pandemic. The readability of Canadian pediatric association websites has not yet been assessed.

OBJECTIVE

The aim of this study is to determine if the content of PEMs from Canadian pediatric associations is written at a reading level that the majority of Canadians can understand.

METHODS

A total of 258 PEMs were extracted from 10 Canadian pediatric associations and evaluated for their reading level using 10 validated readability scales. The PEMs underwent a difficult word analysis and comparisons between PEMs from different associations were conducted.

RESULTS

Web-based PEMs were identified from 3 pediatric association websites, where the reading level (calculated as a grade level) was found to be an average of 8.8 (SD 1.8) for the Caring for Kids website, 9.5 (SD 2.2) for the Pediatric Endocrine Group website, and 13.1 (SD 2.1) for the Atlantic Pediatric Society website. The difficult word analysis identified that 19.9% (SD 6.6%) of words were unfamiliar, with 13.3% (SD 5.3%) and 31.9% (SD 6.1%) of words being considered complex (≥3 syllables) and long (≥6 letters), respectively.

CONCLUSIONS

The web-based PEMs were found to be written above the recommended seventh-grade reading level for Canadians. Consideration should be made to create PEMs at an appropriate reading level for both patients and their caregivers to encourage health literacy and ultimately promote preventative health behaviors and improve child health outcomes.

Readability and Suitability of Online Glaucoma Patient Education Materials

PURPOSE

To assess the quality, content, readability, and accountability of information found online for glaucoma.

DESIGN

Cross-sectional study.

PARTICIPANTS

13 websites containing glaucoma patient education materials were analyzed for this study.

METHODS

An online Google search was conducted using the keyword glaucoma. 13 medical website results were selected for analysis. Each website was assessed by three independent reviewers for suitability, readability, and accountability. The standardized Suitability Assessment of Materials (SAM) tool was used to evaluate the quality and content of information on each website. The Flesch reading ease (FRE), Flesch-Kincaid Grade Level (FKGL), Coleman-Liau Index (CLI), Simple Measure of Gobbledygook Index (SMOG), Automated Readability Index (ARI), and Linsear Write Formula (LWF) scores were used to assess readability of the websites. The Journal of the American Medical Association (JAMA) Accountability Benchmarks were used to evaluate each website's accountability.

MAIN OUTCOME MEASURES

SAM score, FRE, FKGL, CLI, SMOG, ARI, LWF scores, and JAMA Accountability Benchmarks.

RESULTS

The average SAM score for all the websites included in this study was 18 points out of a possible 34 points. Eyewiki.org was the lowest scoring website (11.7 ± 0.6 points), while aao.org and nei.nih.gov were the highest scoring websites (26.0 ± 1.0 points and 26.0 ± 2.6 points, respectively). Three content graders in this study were in moderate agreement (kappa statistic = 0.59). The average Flesch Reading Ease (FRE) scores among all websites was 47.0 (95% confidence interval (CI), 39.3 - 54.7). The average reading grade score among all websites was 11.2 (95% CI, 10.0 - 12.4). Two of the thirteen websites (15.4%) satisfied all 4 JAMA accountability criteria.

CONCLUSIONS

There is significant variation in the content and quality of freely available online glaucoma education material. The material is generally either not suitable or only adequate for use. Most websites reviewed are written at a reading grade level higher than that recommended for patient education materials.

Readability of Korean-Language COVID-19 Information from the South Korean National COVID-19 Portal Intended for the General Public: Cross-sectional Infodemiology Study

BACKGROUND

The coronavirus pandemic has increased reliance on the internet as a tool for disseminating information; however, information is useful only when it can be understood. Prior research has shown that web-based health information is not always easy to understand. It is not yet known whether the Korean-language COVID-19 information from the internet is easy for the general public to understand.

OBJECTIVE

We aimed to evaluate the readability of Korean-language COVID-19 information intended for the general public from the national COVID-19 portal of South Korea.

METHODS

A total of 122 publicly available COVID-19 information documents written in Korean were obtained from the South Korean national COVID-19 portal. We determined the level of readability (at or below ninth grade, 10th to 12th grade, college, or professional) of each document using a readability tool for Korean-language text. We measured the reading time, character count, word count, sentence count, and paragraph count for each document. We also evaluated the characteristics of difficult-to-read documents to modify the readability from difficult to easy.

RESULTS

The median readability level was at a professional level; 90.2% (110/122) of the information was difficult to read. In all 4 topics, few documents were easy to read (overview: 5/12, 41.7%; prevention: 6/97, 6.2%; test: 0/5, 0%; treatment: 1/8, 12.5%; P=.006), with a median 11th-grade readability level for overview, a median professional readability level for prevention, and median college readability levels for test and treatment. Difficult-to-read information had the following characteristics in common: literacy style, medical jargon, and unnecessary detail.

CONCLUSIONS

In all 4 topics, most of the Korean-language COVID-19 web-based information intended for the general public provided by the national COVID-19 portal of South Korea was difficult to read; the median readability levels exceeded the recommended ninth-grade level. Readability should be a key consideration in developing public health documents, which play an important role in disease prevention and health promotion.

Assessing COVID-19 Health Information on Google Using the Quality Evaluation Scoring Tool (QUEST): Cross-sectional and Readability Analysis

BACKGROUND

The COVID-19 pandemic spurred an increase in online information regarding disease spread and symptomatology.

OBJECTIVE

Our purpose is to systematically assess the quality and readability of articles resulting from frequently Google-searched COVID-19 terms in the United States.

METHODS

We used Google Trends to determine the 25 most commonly searched health-related phrases between February 29 and April 30, 2020. The first 30 search results for each term were collected, and articles were analyzed using the Quality Evaluation Scoring Tool (QUEST). Three raters scored each article in authorship, attribution, conflict of interest, currency, complementarity, and tone. A readability analysis was conducted.

RESULTS

Exactly 709 articles were screened, and 195 fulfilled inclusion criteria. The mean article score was 18.4 (SD 2.6) of 28, with 7% (14/189) scoring in the top quartile. National news outlets published the largest share (70/189, 36%) of articles. Peer-reviewed journals attained the highest average QUEST score compared to national/regional news outlets, national/state government sites, and global health organizations (all P<.05). The average reading level was 11.7 (SD 1.9, range 5.4-16.9). Only 3 (1.6%) articles were written at the recommended sixth grade level.

CONCLUSIONS

COVID-19-related articles are vastly varied in their attributes and levels of bias, and would benefit from revisions for increased readability.

Perpetuating Health Disparities of Minority Groups: The Role of U.S. Newspapers in the COVID-19 Pandemic

During the COVID-19 pandemic, news media are expected to play a critical role in reducing health disparities. However, we know little about whether and how disparities in COVID-19 have been covered in national and local U.S. newspapers. This study examined whether minority health gained news attention and whether partisan bias affected related coverage in the early stages of the pandemic. Results indicate that minority groups have been underrepresented in COVID-19 news articles. Left-leaning newspapers were more likely to discuss minorities in COVID-19 news than least biased media. Left-leaning and right-leaning newspapers did not differ in the number of articles mentioning racial/ethnic minorities. COVID-19 news exceeded the average U.S. reading comprehension level and require some college education to understand but did not differ in readability levels among partisan newspapers. Left-leaning newspapers used significantly more medical terms and affiliated scientific facts to describe COVID-19 than right-leaning newspapers. Implications include avoiding potential failures in informing the public (especially the racial/ethnic minorities) essential scientific facts about disease prevention and increasing public trust in health news coverage.

Factors influencing fake news rebuttal acceptance during the COVID-19 pandemic and the moderating effect of cognitive ability

Fake news is spreading rapidly on social media and poses a serious threat to the COVID-19 outbreak response. This study thus aims to reveal the factors influencing the acceptance of fake news rebuttals on Sina Weibo. Drawing on the elaboration likelihood model (ELM), we used text mining and the econometrics method to investigate the relationships among the central route (rebuttal's information readability and argument quality), peripheral route (rebuttal's source credibility, including authority and influence), and rebuttal acceptance, as well as the moderating effect of receiver's cognitive ability on these relationships. Our findings suggest that source authority had a negative effect on rebuttal acceptance, while source influence had a positive effect. Second, both information readability and argument quality had positive effects on rebuttal acceptance. In addition, individuals with low cognitive abilities relied more on source credibility and argument quality to accept rebuttals, while individuals with high cognitive abilities relied more on information readability. This study can provide decision support for practitioners to establish more effective fake news rebuttal strategies; it is especially valuable to reduce the negative impact of fake news related to major public health emergencies and safeguard the implementation of anti-epidemic strategies.