Assessing the quality, reliability and readability of online health information regarding systemic lupus erythematosus

An Analysis of the Readability of Online Sarcoidosis Resources

Introduction Sarcoidosis is an inflammatory disease characterized by the formation of noncaseating granulomas in multiple organ systems. The presentation can vary widely; although some patients with sarcoidosis can be asymptomatic, sarcoidosis can also present in others with symptomatic multiorgan system involvement. Considering the potential severity of the disease, patients need to be well-informed about sarcoidosis to better manage their health. This study aims to assess the readability levels of online resources about sarcoidosis. Methods We conducted a retrospective cross-sectional study. The term "sarcoidosis" was searched online using both Google and Bing to find websites written in English. Each website was categorized by type: academic, commercial, government, nonprofit, and physician. The readability scores for each website were calculated using six different readability tests: the Flesch-Kincaid reading ease (FKRE), Flesch-Kincaid grade level (FKGL), Gunning fog score (GFS), Simple Measure of Gobbledygook (SMOG), automated readability index (ARI), and Coleman-Liau index (CLI). FKRE gives a score that corresponds to the difficulty of the text, while the remaining tests give a score that corresponds to a grade level in terms of reading ability. A one-sample t-test was used to compare all test scores with the national recommended standard of a sixth-grade reading level. Our null hypothesis was that the readability scores of the websites searched would not differ statistically significantly from the sixth-grade reading level and that there would be no significant differences across website categories. To evaluate the difference between the categories of websites, ANOVA testing was used. Results Thirty-four websites were analyzed. Each of the six readability tests for the websites had an average score, which corresponded to being significantly harder to read than the nationally recommended sixth-grade reading level (p<0.001). None of the mean readability scores showed a statistically significant difference across the five different website categories. Conclusions This is the first study, to our knowledge, to examine the readability of online English resources on sarcoidosis and calculate standardized readability scores for them. It implies that the online English material for sarcoidosis is above the health literacy recommended reading levels for patients. There is a need to simplify the material to be easier to read for patients.

Quality of Online Information for Esophageal Cancer

The Internet is a readily available source of information, and patients in North America frequently access it. Esophageal cancer is the 7th most common cancer worldwide, but there is a lack of studies examining esophageal cancer website quality. This current study looks to systematically analyze the quality of websites accessed by patients with esophageal cancer. A previously validated website evaluation tool was used to analyze the quality of online esophageal cancer resources for patients. The term "esophagus cancer" was used to retrieve hits from the search engine Google and the meta-search engines Dogpile and Yippy. A 100 website list was compiled using pre-specified inclusion and exclusion criteria. Websites were evaluated regarding administration, accountability, authorship, organization, readability, content, and accuracy. The term "esophagus cancer" returned over 500 websites from the search engines. Of the 100 websites included for analysis, 97% disclosed ownership, sponsorship, and advertising. Only 35% identified an author and even fewer (31%) gave the author's credentials. Only 31% declared updates to their information within the past 2 years. Readability scores revealed only 9%, and 12% of sites scored at an elementary level, according to the Flesch-Kincaid (FK) and SMOG scoring scales, respectively. The average FK and SMOG scores were 12.6 and 11.0, respectively. Detection was the most accurately described (70%). However, few websites provided accurate incidence/prevalence (28%), stage-specific prognosis (27%), or preventative information (17%). The quality of websites offering information on esophageal cancer is variable. While they overwhelmingly disclose website ownership interests, most do not identify authors, poorly describe important domains of esophageal cancer, and overall readability exceeds the commonly accepted level for non-healthcare professionals.

Evaluating the readability, quality and reliability of online information on Behçet’s disease

There are concerns over the reliability and comprehensibility of health-related information on the internet. The goal of our research was to analyze the readability, reliability, and quality of information obtained from websites associated with Behçet’s disease (BD). On September 20, 2021, the term BD was used to perform a search on Google, and 100 eligible websites were identified. The Flesch Reading Ease Score (FRES), Flesch-Kincaid Grade Level (FKGL), and Gunning Fog (GFOG) were used to evaluate the readability of the website. The JAMA score was used to assess the websites’ reliability, the DISCERN score and the Health on the Net Foundation code of conduct (HONcode) were used to assess quality, and Alexa was used to analyze their popularity. Sections of the text were evaluated, and the results revealed that the mean FRES was 35.49±14.42 (difficult) and the mean GFOG was 14.93±3.13 years (very difficult). According to the JAMA scores, 36% of the websites had a high reliability rating and 20% adhered to the HONcode. The readability was found to significantly differ from the reliability of the websites (p<0.05). Moreover, websites with scientific content were found to have higher readability and reliability (p<0.05). The readability of BD-related information on the Internet was found to be considerably higher than that recommended by the National Health Institute’s Grade 6, with moderate reliability and good quality. We believe that online information should have some level of readability and must have reliable content that is appropriate to educate the public, particularly for websites that provide with patient education material.

Quality of Online Information on Multiple Myeloma Available for Laypersons

Online information can increase patients’ competence and engagement. However, there are concerns regarding invalid information. Overall, 300 websites and 50 YouTube videos on multiple myeloma (MM) were evaluated. The websites did not differ between the search engines or search ranks. The median time since the last update was 9 months. The 63 unique websites showed a poor general quality (median JAMA score 2 of 4, only 18% with a valid HON certificate). The patient- (user-) focused quality was medium to poor (median sum DISCERN score 41 out of 80 points). The overall reading level was difficult requiring at least a 12th US school grade. The content level was low (median 24 out of 73 points). Sixteen percent contained misleading/wrong facts. Websites provided by foundation/advocacies showed a significantly higher general and patient- (user-) focused quality. For videos, the median time since upload was 18 months. Judged by the HON foundation score ~80% of videos showed a medium general quality. The patient- (user-) focused quality was medium to poor (median sum DISCERN score 43 points). The content level was very low (median 8 points). MM relevant websites and videos showed a medium to low general, patient- (user-) focused and content quality. Therefore, incorporation of quality indices and regular review is warranted.

Evaluation of readability and reliability of online patient information for intracranial aneurysms

INTRODUCTION

Intracranial aneurysms are common. Receiving this diagnosis can have a profound impact on patients and their families and this is compounded by the nuanced complexities around their management. An overwhelming majority of patients research health information using the internet. Patient-centred care and informed consent requires patients to have access to information that is readable and reliable. The aim of this study was to assess the readability and reliability of online health information about intracranial aneurysms.

METHOD

A Google search was conducted using the terms 'brain aneurysm', 'cerebral aneurysm', and 'intracranial aneurysm' and the first 75 websites were screened for assessment. The readability of each website was assessed using the Flesch reading ease score (FRE), the Flesch-Kincaid grade level (FKGL), the gunning fog index (GFI) and the simple measure of gobbledygook (SMOG) indices. Reliability was assessed using the DISCERN instrument and the Journal of the American Medical Association benchmark criteria (JAMA).

RESULTS

Following exclusion, 36 websites were analyzed. The websites collectively scored as 'difficult' readability and 'poor' reliability on average. Statistically significant differences in readability were observed between websites categorized as patient health information and commercial compared with academic and physician. Differences in readability were also observed between search results of 'brain aneurysm' compared with 'intracranial aneurysm'.

CONCLUSION

The readability and reliability of online health information about intracranial aneurysms is suboptimal. Health professionals must ensure their patients are well informed which includes directing them to high quality resources which are readable and reliable and use layperson-oriented language during the consultation.

Accuracy and Reliability of Internet Resources for Information on Monoclonal Gammopathy of Undetermined Significance-What Information Is out There for Our Patients?

BACKGROUND

Online information gathering can increase patients' engagement in decision-making. The quality of online resources available for monoclonal gammopathy of undetermined significance (MGUS) was evaluated.

METHODS

900 websites from Google, Bing, Yahoo, and 150 YouTube videos were assessed.

RESULTS

The websites did not differ regarding their search rank or between the search engines. The median time since last update was 24 months. The 86 unique websites showed a medium to poor general quality (JAMA score 3/4, only 8.1% websites with a valid HON certificate). The patient- (user-) focused quality was poor (sum DISCERN score 27/80 points). The reading level was difficult (11th US school grade). The content level was very low (13/50 points). 12.8% of websites contained misleading/wrong facts. Websites provided by scientific/governmental organizations had a higher content level. For the 61 unique videos, the median time since upload was 34 months. The videos showed a medium general quality (HON Foundation score). The patient- (user-) focused quality was poor (sum DISCERN score 24 points). The content level was very low (6 points).

CONCLUSION

MGUS-relevant online sources showed a low quality that was provided on a high reading level. Incorporation of quality indices and regular review of online content is warranted.

Readability in printed education materials for Chinese patients with systemic lupus erythematosus: a mixed-method design

OBJECTIVES

To assess the readability of printed education materials (PEMs) for patients with systemic lupus erythematosus (SLE) and to explore the perceptions of patients with SLE with different health literacy regarding the readability of PEMs.

DESIGN

A mixed-methods study, including a cross-sectional survey and semistructured interviews.

SETTING

The SLE PEMs were collected from 13 hospitals in China. The interviews were conducted in the Department of Rheumatology of a hospital in Hefei, China.

PARTICIPANTS

In the cross-sectional survey, convenience sampling was used to select the Chinese SLE PEMs, with 20 PEMs included. In the qualitative study, the patients with SLE were divided into two groups based on their health literacy. Then, purposive sampling was used to select participants in each group, with 18 patients recruited.

OUTCOME MEASURES

The readability of PEMs was assessed by the language analysis technology and the Chinese version of the Suitability Assessment of Materials (SAM-C) instrument.

RESULTS

For text factors of readability, the mean Chinese language difficulty coefficient was 67.09±8.03, which indicates that the text of PEMs was difficult to read. For non-text factors, the mean SAM-C score was 45.62±9.51. Eight PEMs were rated not suitable, 12 were adequate and none were superior. In the interviews, eight categories were identified: information source, content, actionability, plain language, pictures, tables, numbers and layout. Patients with different health literacy had discrepant views on the detail of basic information, the necessity of question list, the location of functional pictures and the application of mathematical symbols.

CONCLUSIONS

The readability of Chinese SLE PEMs does not perform well, and it is necessary to reduce the difficulty of words, shorten the length of sentences and improve the picture design and actionability. To develop PEMs tailored to patients' level of health literacy, patients' unique view of readability should be integrated into the design of PEMs.

Mobile health technologies for the management of systemic lupus erythematosus: a systematic review

OBJECTIVE

We aimed to perform a standardized review of available mobile health (mHealth) applications (apps) for systemic lupus erythematosus (SLE) and to conduct a systematic review of the literature on mHealth technologies in SLE.

METHODS

Google Play and AppStore in the United States of America were queried and the quality of eligible mHealth apps was assessed using the Mobile App Rating Scale (MARS). Web of Science, EMBASE, Medline, and Cochrane databases were systematically searched from inception through June 2019.

RESULTS

Of 324 mHealth apps found, 20 were eligible for inclusion; 10 focused on education, 7 offered tools to track patient-reported symptoms, 5 included interactive online communities, and 1 enabled emoji sharing. The reviewed apps scored poorly on the MARS quality scale with a mean score 2.3 (0.6) out of 5. Of 1147 studies identified in the literature review, 21 were eligible for inclusion; 11 studies (52.4%) focused on the development and use of mHealth for providing patient information, while only 2 (9.5%) were randomized trials of mHealth interventions.

CONCLUSIONS

Although there is growing interest in the development of mHealth technologies to support SLE patients, currently available tools are of poor quality and limited functionality, and the literature examining this area is sparse.

Evaluating the Quality and Reliability of Online Information on Social Fertility Preservation

OBJECTIVE

With the rising trend of postponing motherhood, there has been an increasing rate of infertility. Social fertility preservation offers the potential to overcome this age-related infertility, and many women are turning to the Internet to seek medical information. The aim of this study was to evaluate online information on social fertility preservation.

METHODS

This study used five search terms-"egg freezing," "fertility preservation," "social egg freezing," "social fertility preservation," and "oocyte cryopreservation"-to identify the most popular sites as rated by Google. Accuracy of information and quality of websites were rated on the basis of four categories: Silberg's accountability criteria, Abbott's aesthetic criteria, Flesch-Kincaid readability score, and the Canadian Fertility and Andrology Society (CFAS) and the Society of Obstetricians and Gynaecologists of Canada (SOGC) recommendations (Canadian Task Force classification III).

RESULTS

Study investigators identified the 21 most used websites. The average Silberg score was 6.57, with 85.7% of websites meeting the criteria for adequate accountability. Only one website (4.8%) did not meet the criteria for appropriate aesthetic appeal. The average Flesch-Kincaid readability score was 11.39, equivalent to a grade 11 reading level, which is significantly higher than the reading level of the general population. A total of 57% of websites contained less than half of the evidence-based recommendations provided in CFAS and SOGC recommendations.

CONCLUSION

Online information on social fertility preservation is easily accessible and aesthetically pleasing, but information is not easily readable and does not reflect evidence-based recommendations. Hence, health care professionals must fill the knowledge gaps and adequately counsel their patients to optimize a woman's chance at a successful pregnancy.