Evaluation of Quality and Readability of Health Information Websites Identified through India's Major Search Engines

Thematic coverage and readability of online patient information on cochlear implant care

INTRODUCTION

The treatment of patients with a cochlear implant (CI) is usually an elective, complex and interdisciplinary process. As an important source of information, patients often access the internet prior to treatment. The quality of internet-based information regarding thematic coverage has not yet been analysed in detail. Therefore, the aim of this study was to analyse the information on CI care available on the internet regarding its thematic coverage and readability.

MATERIAL METHODS

Eight search phrases related to CI care were defined as part of the study. A checklist for completeness of thematic coverage was then created for each search phrase. The current German CI clinical practice guideline and the white paper on CI care in Germany were used as a basis. As a further parameter, readability was assessed using Flesch Reading Ease Scores. The search phrases were used for an internet search with Google. The first ten results were then analysed with regard to thematic coverage, readability and the provider of the website.

RESULTS

A total of 80 websites were identified, which were set up by 54 different providers (16 providers were found in multiple entries) from eight different provider groups. The average completeness of thematic coverage was 41.6 ± 28.2%. Readability according to the Flesch Reading Ease Score was categorised as "hard to read" on average (34.7 ± 14.2 points, range: 0-72). There was a negative statistically significant correlation between the thematic coverage of content and readability (Spearman's rank correlation: r = - 0.413, p = 0.00014). The completeness of thematic coverage of information on CI care available on the internet was highly heterogeneous and had a significant negative correlation with the readability. This result should be taken into account by both the providers of internet information and by patients when using internet-based information on CI care and help to further improve the quality of web-based information.

Comparative assessment of the information available on the treatment of depression over websites in English and Hindi language

Background

The study aimed to perform a cross-sectional comparative assessment of the content and quality of information available on the treatment of depression over websites in English and Hindi language.

Materials and Methods

We screened the first 50 links obtained on searching for depression treatment on Google, and selected 72 (44 in English; 28 in Hindi) websites. They were evaluated for coverage of different aspects of depression, quality of treatments mentioned, esthetics, and interactivity.

Results

A significantly lesser number of Hindi websites discussed the minimum duration of treatment needed for a depressive episode (36% vs. 79%), possible side effects of treatment (18% vs. 77%), discussed suicidality in depression explicitly (25% vs. 57%), or recommended consultation with a mental health professional (11% vs. 43%). English websites more commonly mentioned psychotherapy (86% vs. 64%), electroconvulsive therapy (64% vs. 21%), and social support measures (59% vs. 32%) for depression treatment. Whereas, Hindi websites more commonly mentioned Ayurvedic/herbal medicines (46% vs. 16%), and yoga (29% vs. 4%) for treatment. Lastly, the esthetics score for English websites was significantly higher than for Hindi websites. A significantly greater number of Hindi websites were owned by commercial entities.

Conclusion

This is the first study to systematically compare online information on depression treatment in English and Hindi language websites, and identify areas for further improvement in the overall quality of online information in Hindi. There is a need for the creation of credible and accessible online resources in regional languages like Hindi for the promotion of depression literacy among the general public by government and non-profit professional organizations.

Quality and accuracy of patient-oriented Web-based information regarding tooth avulsion

BACKGROUND/AIM

Tooth avulsion (TA) is a severe form of traumatic dental injury. The tooth's prognosis depends on the immediate measures taken. First responders are often laypeople, and the Internet is a favored platform to access health-related information. The aim of this descriptive study was to evaluate the accuracy, quality, readability, and popularity of patient-oriented web information regarding the emergency management of TA.

METHODS

Three search engines (Google, Bing, and Yahoo.com) were browsed with six VPNs using "knocked out tooth," "fallen out tooth," and "tooth avulsion" as keywords. The top 20 results for each were evaluated. Webpages were included if they had information oriented to caregivers. They were analyzed for accuracy (cutoff ≥95%). Quality of web pages was assessed using DISCERN and the Journal of the American Medical Association (JAMA) benchmark. Readability was evaluated using Flesch-Kincaid Grade Level (FKGL), Gunning Fog (FOG), Coleman-Liau Index (CLI), and Simple Measure of Gobbledygook (SMOG). Popularity was assessed by Alexa Popularity Rank (APR). Accurate and inaccurate webpages were compared using chi-square analysis and the Mann-Whitney U test. Spearman's correlation between the studied metrics was established. A p < .05 was considered significant.

RESULTS

Seventy-two webpages were included, of which 23 (32%) were accurate. The median DISCERN ratings for accurate and inaccurate webpages were 3.0 [2.5-3.0] and 3.0 [2.0-3.0], respectively (p = .331). Ten (44%) accurate and 12 (24.5%) inaccurate webpages had high-quality JAMA (p = .089). The median readability scores for accurate webpages were FKGL (8 [6.75-9.2]), FOG (10.6 [9.55-12.3]), CLI (7 [6-7]), SMOG (6.7 [6.15-7.5]), while scores for the inaccurate webpages were FKGL (7.85 [6.275-8.525]), FOG (10.55 [8.875-11.425]), CLI (7 [7-8.25]), and SMOG (7 [6.2-7.925]), with a higher CLI score for inaccurate webpages (p = .0035). The median APRs for accurate and inaccurate webpages were 1,02,538 [26,852-14,43,755] and 7,63,190 [2,19,799-29,92,067], respectively (p = .163). Accuracy had a positive correlation with quality (DISCERN: rho = .293, p = .013; JAMA: rho = .249, p = .036), while popularity (APR) was negatively correlated with quality (DISCERN: rho = -.330, p = .013; JAMA: rho = -.287, p = .032).

CONCLUSION

Relevant webpages were limited and had low accuracy. This can impact the emergency management by laypeople and adversely affect the prognosis following avulsion.

Evaluation of readability and reliability of online patient information for intracranial aneurysms

INTRODUCTION

Intracranial aneurysms are common. Receiving this diagnosis can have a profound impact on patients and their families and this is compounded by the nuanced complexities around their management. An overwhelming majority of patients research health information using the internet. Patient-centred care and informed consent requires patients to have access to information that is readable and reliable. The aim of this study was to assess the readability and reliability of online health information about intracranial aneurysms.

METHOD

A Google search was conducted using the terms 'brain aneurysm', 'cerebral aneurysm', and 'intracranial aneurysm' and the first 75 websites were screened for assessment. The readability of each website was assessed using the Flesch reading ease score (FRE), the Flesch-Kincaid grade level (FKGL), the gunning fog index (GFI) and the simple measure of gobbledygook (SMOG) indices. Reliability was assessed using the DISCERN instrument and the Journal of the American Medical Association benchmark criteria (JAMA).

RESULTS

Following exclusion, 36 websites were analyzed. The websites collectively scored as 'difficult' readability and 'poor' reliability on average. Statistically significant differences in readability were observed between websites categorized as patient health information and commercial compared with academic and physician. Differences in readability were also observed between search results of 'brain aneurysm' compared with 'intracranial aneurysm'.

CONCLUSION

The readability and reliability of online health information about intracranial aneurysms is suboptimal. Health professionals must ensure their patients are well informed which includes directing them to high quality resources which are readable and reliable and use layperson-oriented language during the consultation.

Development and validation of education materials to reduce childhood blindness due to retinopathy of prematurity

BACKGROUND

Timely and appropriate follow-up appointments for infants at risk for retinopathy of prematurity (ROP) are very important to prevent blindness. Caregivers are important members of the ROP team, and their involvement is essential in ensuring optimal visual outcomes. This paper aimed to develop health information materials on ROP by a systematic process for better comprehensibility by the target audience of low literacy.

MATERIALS AND METHODS

It was a methodological study conducted at the neonatal intensive care unit of a tertiary care hospital, North India. The development and validation of educational materials was conducted in six steps. The study focused on both the knowledge of the target audience and on the validation of the educational materials by experts and caregivers of ROP eligible infants.

RESULTS

Most of the items (content, language, layout, motivation, and cultural appropriateness) were in either a suitable or adequate category. Only one item illustration was in the nonsuitable category. The mean final score of the leaflet after revision by experts was 9 (maximum score = 10). Regarding readability, The Flesch Reading Ease Score, Flesch-Kincaid Grade Level, and gunning fog index were found to be 72.5, 7.4, and 6.2, respectively. The leaflet was found to be suitable for the seventh grader. The mean knowledge score of the parents was 4 (maximum score-5).

CONCLUSION

The study showed satisfactory acceptance of the developed ROP information materials by caregivers and experts. A similar approach could be adopted for the development of other health information materials.

Help or hinder? An assessment of the accessibility, usability, reliability and readability of disability funding website information for Australian mental health consumers

This study aimed to assess the accessibility, usability, reliability and readability of those websites most likely encountered by Australian mental health consumers when using the internet to find information regarding the National Disability Insurance Scheme (NDIS). Websites were systematically identified with 127 deemed relevant for assessment in 2018. The LIDA instrument, the Simple Measure of Gobbledygook and Flesch-Kincaid Grade Level were used to evaluate the quality of information provided to mental health consumers. The study identified mediocre results for the accessibility, usability, reliability and readability of websites as they pertain to the needs of mental health consumers. Furthermore, it was identified that mental health support websites did not provide a more appropriate online experience for mental health consumers than general information websites, despite their focus on this demographic. These findings suggest a lack of understanding regarding the needs of mental health consumers and their experience of the online environment, which may in turn affect their access to information, agency and, ultimately, their uptake of the NDIS. The establishment of guidelines around enhancements to the online environment for mental health consumers would provide an experience that instils confidence, returns dignity and aids this group in realising their personal recovery journey.

Evaluation of open health data portals for COVID-19 from the perspective of the user experience

Purpose

The purpose of this paper is to construct an indicator framework for evaluating open health data portals from the perspective of user experience (UX) to reduce users’ learning costs, save their time and energy and strengthen the emotional connection with users, thereby encouraging them to actively use open health data.

Design/methodology/approach

This study uses card sorting, Delphi and analytic hierarchy process to determine the weights of indicators for evaluating open health data portals. Then, this study uses a coding method to score, evaluate and compare the selection of more than 120 open health data portals supported by organizations in more than 100 countries or regions that are in the World's top confirmed cases of COVID-19 as released by the World Health Organization.

Findings

At present, open health data portals have shortcomings with regard to UX. Different types of open health data portals vary significantly in the dimensions of technical experience and functional experience, but the differences in the dimensions of aesthetic experience, emotional experience and content experience are not significant.

Originality/value

The constructed open health data portal evaluation indicator framework introduces users' actual application needs and proposes optimization suggestions for the portal to meet the needs of users to quickly obtain, reliable and accurate health data.

Readability, understandability, and quality of retinopathy of prematurity information on the web

BACKGROUND

The purpose of this study is to assess the readability, understandability, and quality of information on retinopathy of prematurity presented at websites frequently visited by parents.

METHODS

A total of 220 websites were assessed, which were recruited by searching for "retinopathy of prematurity" at the Google search engine. The readability of each web page was assessed by Flesch Reading Ease Score, Gobbledygook's Gunning Frequency, Flesch Kincaid Grade Level, Coleman Liau score, The Simple Measure of Gobbledygook, Fry Graph Readability Formula, and Automated readability score. The understandability of the web pages included in the study was measured by using the Patient Education Materials Assessment Tool. Quality was evaluated using Health in Net code and JAMA. The ALEXA traffic tool was used to reference the domains' popularity and visibility.

RESULTS

Sixty-four websites were included to the study. The average Flesch Reading Ease Score was 50.1 ± 11.4, Gunning Frequency of Gobbledygook level was 13.4 ± 2.5, The Flesch-Kincaid Grade level was 10.7 ± 2.2, Coleman Liau level was 10.8 ± 1.7, Simple Measure of Gobbledygook level was 10.0 ± 1.9, and Fry Graph Readability Formula 11.9 ± 2.7, Automated readability score 10.4 ± 2.5. The average understandability score for all website-based patient education materials was 76.9 ± 15.2. Total JAMA Benchmark score is 2.27 ± 1.14 (range from 1 to 4). The quality of information at most websites were determined by our chosen assessments to not to be good.

CONCLUSION

Websites addressed to parents for retinopathy of prematurity had found to have high understandability. It was concluded based on this study that readability and quality of presented written materials at online sources need to be improved.

Health websites on COVID-19: are they readable and credible enough to help public self-care?

Objective

There are concerns about nonscientific and/or unclear information on the coronavirus disease 2019 (COVID-19) that is available on the Internet. Furthermore, people's ability to understand health information varies and depends on their skills in reading and interpreting information. This study aims to evaluate the readability and creditability of websites with COVID-19-related information.

Methods

The search terms "coronavirus," "COVID," and "COVID-19" were input into Google. The websites of the first thirty results for each search term were evaluated in terms of their credibility and readability using the Health On the Net Foundation code of conduct (HONcode) and Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), Gunning Fog, and Flesch Reading Ease Score (FRE) scales, respectively.

Results

The readability of COVID-19-related health information on websites was suitable for high school graduates or college students and, thus, was far above the recommended readability level. Most websites that were examined (87.2%) had not been officially certified by HONcode. There was no significant difference in the readability scores of websites with and without HONcode certification.

Conclusion

These results suggest that organizations should improve the readability of their websites and provide information that more people can understand. This could lead to greater health literacy, less health anxiety, and the provision of better preventive information about the disease.

Readability of Printed Online Education Materials on Pituitary Tumors: Untangling a Web of Complexity

BACKGROUND

Patients are increasingly turning to the internet for health education. Due to the complex pathophysiology, clinic-diagnostic profile, and management spectrum of pituitary tumors, an evaluation of the readability of printed online education materials (POEMs) regarding this entity is warranted.

OBJECTIVE

(1) To apply established readability assessment tools to internet search results on the topic of pituitary tumors. (2) To identify sources of complexity in order to guide the creation POEMs that are in line with the reading level of the target audience.Methodology: After independent, neutral internet search for the phrase "pituitary tumor," the first 100 results were subjected to inclusion criteria matching. Analysis was performed using 5 readability assessment tools including Flesch Reading Ease (FRE), Flesch-Kincaid Grade Level (FKGL), Gunning-Fog Score (GFS), Coleman-Liau Index (CLI), and Simple Measure of Gobbledygook (SMOG).

RESULTS

A total of 82 websites met inclusion criteria. All websites were found to be at a higher reading level (P < .01) than the United States Department of Health and Human Services (USDHHS) recommended sixth-grade level. Mean readability scores were as follows: FRE, 38.79; FKGL, 11.27; GFS, 12.83; CLI, 17.31; SMOG, 12.12. Intergroup comparison between FKGL, GFS, CLI, and SMOG yielded that CLI was significantly higher (P < .03). No significant differences in readability were noted between academic and other websites.

CONCLUSION

There is a significant misalignment between the reading level of patients and the readability of pituitary tumor POEMs. This may lead patients to misconceive their diagnoses, management options, and prognosis.

Readability of Information on Smartphone Apps for Total Hip Replacement and Total Knee Replacement Surgery Patients

Background:

Readability is a vital component of health information and providing this material at an appropriate literacy level may positively influence patient experience.

Objective:

To assess the readability of the information provided within total hip replacement and total knee replacement apps to understand more about the impact this could have on patients.

Method:

A systematic search was conducted across the 5 most popular smartphone app stores: iTunes, Google Play, Windows Mobile, Blackberry App World, and Nokia Ovi. Apps were identified for screening if they: targeted total hip replacement or total knee replacement patients; were free of charge; and were in English. App readability assessment was conducted independently by 3 reviewers using the Gunning Fog Index, the Flesch Reading Ease Score, and the Flesch-Kincaid Grade Level.

Results:

Fifteen apps met the inclusion criteria. Only one app was found “easy to read” (My THR).

Conclusion:

Findings suggest that the overall readability of information provided is written at a level which is difficult for patients to comprehend. App developers should engage patients in the design process of their apps, in order to enhance patient experience and for the potential impact of these innovative health technologies to be truly realized.

Evaluating hospital websites in Kuwait to improve consumer engagement and access to health information: a cross-sectional analytical study

BACKGROUND

Current advances in information and communication technology have made accessing and obtaining health-related information easier than ever before. Today, many hospital websites use a patient-centric approach to promote engagement and encourage learning for better health-related decision making. However, little is known about the current state of hospital websites in the State of Kuwait. This study aims to evaluate hospital websites in Kuwait and offer recommendations to improve patient engagement and access to health information.

METHODS

This study employs a cross-sectional analytical approach to evaluate hospital websites in Kuwait in 2017. The websites of hospitals that provide in-patient services were identified through a structured search. Only active websites that were available in either English or Arabic were considered. The evaluation of the websites involved a combination of automated and expert- based evaluation methods and was performed across four dimensions: Accessibility, Usability, Presence, and Content.

RESULTS

Nine hospitals met the inclusion criteria. Most of the websites fell short in all four dimensions. None of the websites passed the accessibility guidelines. The usability of websites varied between hospitals. Overall, the majority of hospitals in Kuwait have rudimentary online presence and their websites require careful reassessment with respect to design, content, and user experience. The websites focus primarily on promoting services provided by the hospital rather than engaging and communicating with patients or providing evidence-based information.

CONCLUSIONS

Healthcare organization and website developers should follow best-practices to improve their websites taking into consideration the quality, readability, objectivity, coverage and currency of the information as well as the design of their websites. Hospitals should leverage social media to gain outreach and better engagement with consumers. The websites should be offered in additional languages commonly spoken by people living in Kuwait. Efforts should be made to ensure that health information on hospital websites are evidence-based and checked by healthcare professionals.

Readability Assessment of Online Patient Education Material on Congestive Heart Failure

BACKGROUND

Online health information is being used more ubiquitously by the general population. However, this information typically favors only a small percentage of readers, which can result in suboptimal medical outcomes for patients.

OBJECTIVE

The readability of online patient education materials regarding the topic of congestive heart failure was assessed through six readability assessment tools.

METHODS

The search phrase "congestive heart failure" was employed into the search engine Google. Out of the first 100 websites, only 70 were included attending to compliance with selection and exclusion criteria. These were then assessed through six readability assessment tools.

RESULTS

Only 5 out of 70 websites were within the limits of the recommended sixth-grade readability level. The mean readability scores were as follows: the Flesch-Kincaid Grade Level (9.79), Gunning-Fog Score (11.95), Coleman-Liau Index (15.17), Simple Measure of Gobbledygook (SMOG) index (11.39), and the Flesch Reading Ease (48.87).

CONCLUSION

Most of the analyzed websites were found to be above the sixth-grade readability level recommendations. Efforts need to be made to better tailor online patient education materials to the general population.