Evaluating the reliability and readability of online information on osteoporosis

Content Analysis of Arabic Websites As Patient Resources for Osteoporosis

BACKGROUND

Osteoporosis is a prevalent metabolic bone disease in the Middle East. Middle Easterners rely on the Internet as a source of information about osteoporosis and its treatment. Adequate awareness can help to prevent osteoporosis and its complications. Websites covering osteoporosis in Arabic must be of good quality and readability to be beneficial for people in the Middle East.

METHODS

Two Arabic terms for osteoporosis were searched on Google.com (Google Inc., Mountainview, CA), and the first 100 results for each term were examined for eligibility. Two independent raters evaluated the websites using DISCERN and the Journal of the American Medical Association (JAMA) criteria for quality and reliability. The Flesch Kincaid grade level (FKGL), Simple Measure of Gobbledygook (SMOG), and Flesch Reading Ease (FRE) scale were used to evaluate the readability of each website's content.

RESULTS

Twenty-five websites were included and evaluated in our study. The average DISCERN score was 28.36±12.18 out of 80 possible scores. The average JAMA score was 1.05±1.15 out of four total scores. The readability scores of all websites were, on average, 50.71±21.96 on the FRE scale, 9.25±4.89 on the FKGL, and 9.74±2.94 on the SMOG. There was a significant difference (p = 0.026 and 0.044) in the DISCERN and JAMA scores, respectively, between the websites on the first Google page and the websites seen on later pages.

CONCLUSION

The study found Arabic websites covering osteoporosis to be of low quality and difficult readability. Because these websites are a major source for patient education, improving their quality and readability is a must. The use of simpler language is needed, as is covering more aspects of the diseases, such as prevention.

Evaluating the readability, quality and reliability of online patient education materials on chronic low back pain

Background There are concerns over the reliability and comprehensibility of health-related information on the internet. We analyzed the readability, reliability and quality of online patient education materials obtained from websites associated with chronic low back pain (cLBP). Methods On 26 April 2022, the term 'cLBP' was used to perform a search on Google, and 95 eligible websites were identified. The Flesch Reading Ease Score (FRES) and Gunning Fog (GFOG) index were used to evaluate the readability. The Journal of the American Medical Association (JAMA) score was used to assess the reliability and the Health on the Net Foundation code of conduct (HONcode) was used to assess quality. Results The mean (SD) FRES was 55.74 (13.57) (very difficult) and the mean (SD) GFOG was 12.76 (2.8) (very difficult) of the websites reviwed. According to the JAMA scores, 28.4% of the websites had a high reliability rating and 33.7% adhered to the HONcode. Websites of different typologies were found to significantly differ in their reliability and the quality scores (p<0.05). Conclusion The reading ability required for cLBP-related information on the internet was found to be considerably higher than that recommended by the National Health Institute and had low reliability and poor quality. We believe that online information should have readability appropriate for most readers and must have reliable content that is appropriate to educate the public, particularly for websites that provide patient education material.

Artificial intelligence insights into osteoporosis: assessing ChatGPT's information quality and readability

Accessible, accurate information, and readability play crucial role in empowering individuals managing osteoporosis. This study showed that the responses generated by ChatGPT regarding osteoporosis had serious problems with quality and were at a level of complexity that that necessitates an educational background of approximately 17 years.

PURPOSE

The use of artificial intelligence (AI) applications as a source of information in the field of health is increasing. Readable and accurate information plays a critical role in empowering patients to make decisions about their disease. The aim was to examine the quality and readability of responses provided by ChatGPT, an AI chatbot, to commonly asked questions regarding osteoporosis, representing a major public health problem.

METHODS

"Osteoporosis," "female osteoporosis," and "male osteoporosis" were identified by using Google trends for the 25 most frequently searched keywords on Google. A selected set of 38 keywords was sequentially inputted into the chat interface of the ChatGPT. The responses were evaluated with tools of the Ensuring Quality Information for Patients (EQIP), the Flesch-Kincaid Grade Level (FKGL), and the Flesch-Kincaid Reading Ease (FKRE).

RESULTS

The EQIP score of the texts ranged from a minimum of 36.36 to a maximum of 61.76 with a mean value of 48.71 as having "serious problems with quality." The FKRE scores spanned from 13.71 to 56.06 with a mean value of 28.71 and the FKGL varied between 8.48 and 17.63, with a mean value of 13.25. There were no statistically significant correlations between the EQIP score and the FKGL or FKRE scores.

CONCLUSIONS

Although ChatGPT is easily accessible for patients to obtain information about osteoporosis, its current quality and readability fall short of meeting comprehensive healthcare standards.

Evaluating the readability, quality and reliability of online information on Behçet’s disease

There are concerns over the reliability and comprehensibility of health-related information on the internet. The goal of our research was to analyze the readability, reliability, and quality of information obtained from websites associated with Behçet’s disease (BD). On September 20, 2021, the term BD was used to perform a search on Google, and 100 eligible websites were identified. The Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), and Gunning Fog (GFOG) were used to evaluate the readability of the website. The JAMA score was used to assess the websites’ reliability, the DISCERN score and the Health on the Net Foundation code of conduct (HONcode) were used to assess quality, and Alexa was used to analyze their popularity. Sections of the text were evaluated, and the results revealed that the mean FRES was 35.49±14.42 (difficult) and the mean GFOG was 14.93±3.13 years (very difficult). According to the JAMA scores, 36% of the websites had a high reliability rating and 20% adhered to the HONcode. The readability was found to significantly differ from the reliability of the websites (p<0.05). Moreover, websites with scientific content were found to have higher readability and reliability (p<0.05). The readability of BD-related information on the Internet was found to be considerably higher than that recommended by the National Health Institute’s Grade 6, with moderate reliability and good quality. We believe that online information should have some level of readability and must have reliable content that is appropriate to educate the public, particularly for websites that provide with patient education material.

Evaluating the readability, quality and reliability of online patient education materials on post-covid pain

Background

The use of the Internet to access healthcare-related information is increasing day by day. However, there are concerns regarding the reliability and comprehensibility of this information. This study aimed to investigate the readability, reliability, and quality of Internet-based patient educational materials (PEM) related to "post-COVID-19 pain."

Methods

One-hundred websites that fit the purposes of the study were identified by searching for the terms "post-COVID-19 pain" and "pain after COVID-19" using the Google search engine on February 24, 2022. The website readability was assessed using the Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Gunning FOG (GFOG). The reliability, quality, and popularity of the websites were assessed using the JAMA score, DISCERN score/Health on the Net Foundation code of conduct, and Alexa, respectively.

Results

Upon investigation of the textual contents, the mean FRES was 51.40 ± 10.65 (difficult), the mean FKGL and SMOG were 10.93 ± 2.17 and 9.83 ± 1.66 years, respectively, and the mean GFOG was 13.14 ± 2.16 (very difficult). Furthermore, 24.5% of the websites were highly reliable according to JAMA scores, 8% were of high quality according to GQS values, and 10% were HONcode-compliant. There was a statistically significant difference between the website types and reliability (p = 0.003) and quality scores (p = 0.002).

Conclusion

The readability level of PEM on post-COVID-19 pain was considerably higher than grade 6 educational level, as recommended by the National Institutes of Health, and had low reliability and poor quality. We suggest that Internet-based PEM should have a certain degree of readability that is in accordance with the educational level of the general public and feature reliable content.