Accuracy and Readability of Websites on Kidney and Bladder Cancers

Patient education information material assessment criteria: A scoping review

BACKGROUND

Patient education information material (PEIM) is an essential component of patient education programs in increasing patients' ability to cope with their diseases. Therefore, it is essential to consider the criteria that will be used to prepare and evaluate these resources.

OBJECTIVE

This paper aims to identify these criteria and recognize the tools or methods used to evaluate them.

METHODS

National and international databases and indexing banks, including PubMed, Scopus, Web of Science, ProQuest, the Cochrane Library, Magiran, SID and ISC, were searched for this review. Original or review articles, theses, short surveys, and conference papers published between January 1990 and June 2022 were included.

RESULTS

Overall, 4688 documents were retrieved, of which 298 documents met the inclusion criteria. The criteria were grouped into 24 overarching criteria. The most frequently used criteria were readability, quality, suitability, comprehensibility and understandability.

CONCLUSION

This review has provided empirical evidence to identify criteria, tools, techniques or methods for developing or evaluating a PEIM. The authors suggest that developing a comprehensive tool based on these findings is critical for evaluating the overall efficiency of PEIM using effective criteria.

Quality Assessment of Hypertension Treatment–Related Information on WeChat: Cross-sectional Study

Background

The WeChat platform has become a primary source for medical information in China. However, no study has been conducted to explore the quality of information on WeChat for the treatment of hypertension, the leading chronic condition.

Objective

This study aimed to explore the quality of information in articles on WeChat that are related to hypertension treatment from the aspects of credibility, concreteness, accuracy, and completeness.

Methods

We searched for all information related to hypertension treatment on WeChat based on several inclusion and exclusion criteria. We used 2 tools to evaluate information quality, and 2 independent reviewers performed the assessment with the 2 tools separately. First, we adopted the DISCERN instrument to assess the credibility and concreteness of the treatment information, with the outcomes classified into five grades: excellent, good, fair, poor, and very poor. Second, we applied the Chinese Guidelines for Prevention and Treatment of Hypertension (2018 edition) to evaluate the accuracy and completeness of the article information with regard to specific medical content. Third, we combined the results from the 2 assessments to arrive at the overall quality of the articles and explored the differences between, and associations of, the 2 independent assessments.

Results

Of the 223 articles that were retrieved, 130 (58.3%) full texts were included. Of these 130 articles, 81 (62.3%) described therapeutic measures for hypertension. The assessment based on the DISCERN instrument reported a mean score of 31.22 (SD 8.46). There were no articles rated excellent (mean score >63); most (111/130, 85.4%) of the articles did not refer to the consequences—in particular, quality of life—of no treatment. For specific medical content, adherence to the Chinese Guidelines for Prevention and Treatment of Hypertension was generally low in terms of accuracy and completeness, and there was much erroneous information. The overall mean quality score was 10.18 (SD 2.22) for the 130 articles, and the scores differed significantly across the 3 types (P=.03) and 5 sources (P=.02). Articles with references achieved higher scores for quality than those reporting none (P<.001). The results from the DISCERN assessment and the medical content scores were highly correlated (ρ=0.58; P<.001).

Conclusions

The quality of hypertension treatment–related information on the WeChat platform is low. Future work is warranted to regulate information sources and strengthen references. For the treatment of hypertension, crucial information on the consequences of no treatment is urgently needed.

Oral Healthcare Implications of Dedicated Online Communities: A Computational Content Analysis of the r/Dentistry Subreddit

The current study explores communication expressed by participants in a subreddit surrounding oral health care, moderated by dentists and dental hygienists. The corpus was analyzed through Leximancer, a computer-assisted program used for computational content analyses of large data sets. Users' personal disclosures about ongoing dental concerns, advice about others' self-care, and the role of interpersonal communication with and among health care providers emerged as dominant themes. The findings suggest that online communities may serve an important role that dentists are unable to fill in their limited interactions with individual patients. Such interaction spaces may therefore offer a fertile environment for future interventions to promote beneficial practices and achieve positive health-related outcomes.

Bladder Cancer Health Literacy: Assessing Readability of Online Patient Education Materials

BACKGROUND

Understanding of health-related materials, termed health literacy, affects decision makings and outcomes in the treatment of bladder cancer. The National Institutes of Health recommend writing education materials at a sixth-seventh grade reading level. The goal of this study is to assess readability of bladder cancer materials available online.

OBJECTIVE

The goal of this study is to characterize available information about bladder cancer online and evaluate readability.

METHODS

Materials on bladder cancer were collected from the American Urological Association's Urology Care Foundation (AUA-UCF) and compared to top 50 websites by search engine results. Resources were analyzed using four different validated readability assessment scales. The mean and standard deviation of the materials was calculated, and a two-tailed t test for used to assess for significance between the two sets of patient education materials.

RESULTS

The average readability of AUA materials was 8.5 (8th-9th grade reading level). For the top 50 websites, average readability was 11.7 (11-12th grade reading level). A two-tailed t test between the AUA and top 50 websites demonstrated statistical significance between the readability of the two sets of resources (P = 0.0001), with the top search engine results being several grade levels higher than the recommended 6-7th grade reading level.

CONCLUSIONS

Most health information provided by the AUA on bladder cancer is written at a reading ability that aligns with most US adults, with top websites for search engine results exceeding the average reading level by several grade levels. By focusing on health literacy, urologists may contribute lowering barriers to health literacy, improving health care expenditure and perioperative complications.

Evaluation of the Liver Disease Information in Baidu Encyclopedia and Wikipedia: Longitudinal Study

Background

The internet has changed the way of people acquiring health information. Previous studies have shown that Wikipedia is a reasonably reliable medical resource, and it has been ranked higher than other general websites in various search engines. Baidu Encyclopedia is one of the most popular encyclopedia websites in China. However, no studies have shown the quality of the content provided in the Baidu Encyclopedia.

Objective

This study aimed to evaluate the quality of liver disease information provided by Wikipedia (in English) and Baidu Encyclopedia (in Chinese) and to perform a comparison of the quality and timeliness of the articles published in these two encyclopedias. Moreover, a 3-year follow-up study was conducted to compare if the information in both these websites was updated regularly over this period.

Methods

We searched for information on liver diseases by using the International Statistical Classification of Diseases and Related Health Problems 10th Revision Version 2016 codes on Wikipedia (in English) and Baidu Encyclopedia (in Chinese). The quality of the articles was assessed using the DISCERN instrument, which consists of 3 sections. We recorded the latest editing date of the webpages and calculated the date interval to evaluate the update timeliness of these websites.

Results

We found 22 entries on liver diseases in Baidu Encyclopedia and 15 articles in Wikipedia between September 15, 2016, and September 30, 2016, and we found 25 entries in Baidu Encyclopedia and 16 articles in Wikipedia between September 15, 2019, and September 30, 2019. In section 1 of the DISCERN instrument, the mean (SE) scores of Baidu Encyclopedia entries were significantly lower than those of Wikipedia articles. In section 2 and section 3 of the DISCERN instrument, the DISCERN scores of Baidu Encyclopedia entries were lower than those of Wikipedia articles, but the differences were not statistically significant. The total DISCERN scores of Baidu Encyclopedia entries were significantly lower than those of Wikipedia articles. The update interval of the entries in Baidu Encyclopedia was found to be significantly longer than that of the articles in Wikipedia.

Conclusions

This study shows that the quality of articles and the reliability of the research content on liver diseases in Wikipedia are better than those of the entries in Baidu Encyclopedia. However, the quality of the treatment choices provided in both Wikipedia and Baidu Encyclopedia is not satisfactory. Wikipedia is updated more frequently than Baidu Encyclopedia, thereby ensuring that the information presented has the most recent research findings. The findings of our study suggest that in order to find accurate health information, it is important to seek the help of medical professionals instead of looking for a prescription amid the confusing information provided on the internet.

The Quality of Infectious Disease Hospital Websites in Poland in Light of the COVID-19 Pandemic

The quality of healthcare service websites gains particular importance in the time of the pandemic, asthe popularity of electronic services grows. This applies to infectious disease hospitals as well, often on the front line of the effort against COVID-19. The paper aims to assess the quality of infectious disease hospital websites in Poland in light of the COVID-19 pandemic. The research covered 91 websites. The first stage was an analysis of selected technical attributes of the websites (including website performance, SEO quality, website availability, and mobile-friendliness) with selected online tools, such as Google PageSpeed Insights, Blink Audit Tool, Backlink Checker, andwebsite accessibility evaluation tool (WAVE). The data were then analyzed with statistical methods. The next step was to analyze the content of the websites. The research has shown that most of the websites were of satisfactory quality, apart from those that were not mobile-ready. The following keywords were found most often on the hospital websites: SARS-CoV-2, COVID-19, smear, specialist care clinic, isolation, telephone consultations, sample collection center, support, coronavirus, recommendations, patient registration, signs of disease. The research suggests that the quality of infectious disease hospital websites in Poland is significantly diversified in search engine optimization, mobile-friendliness, and needs of people at risk of digital exclusion.

Readability of Cancer Clinical Trials Websites

Clinical trials are critically important for the development of new cancer treatments. According to recent estimates, however, clinical trial enrollment is only about 8%. Lack of patient understanding or awareness of clinical trials is one reason for the low rate of participation. The purpose of this observational study was to evaluate the readability of cancer clinical trial websites designed to educate the general public and patients about clinical trials. Nearly 90% of Americans use Google to search for health-related information. We conducted a Google Chrome Incognito search in 2018 using the keywords “cancer clinical trial” and “cancer clinical trials.” Content of the 100 cancer clinical trial websites was analyzed using an online readability panel consisting of Flesch-Kincaid Grade Level, Flesch Reading Ease, Gunning-Fog Index, Coleman-Liau Index, and Simple Measure of Gobbledygook scales. Reading level difficulty was assessed and compared between commercial versus non-commercial URL extensions. Content readability was found to be “difficult” (10.7 grade level). No significant difference in readability, overall, and between commercial and non-commercial URL extensions was found using 4/5 measures of readability; 90.9% of commercial versus 49.4% of non-commercial websites were written at a >10th grade (P = .013) using Gunning-Fog Index. Written cancer clinical trials content on the Internet is written at a reading level beyond the literacy capabilities of the average American reader. Improving readability to accommodate readers with basic literacy skills will provide an opportunity for greater comprehension that could potentially result in higher rates of clinical trial enrollment.

Quality, Readability, and Understandability of German Booklets Addressing Melanoma Patients

Booklets are the preferably used form among patient education materials and are often handed out during medical consultations in dermatological oncology settings. However, little is known about how beneficial they are and whether they correspond to essential quality characteristics. To assess the quality, readability, and understandability of currently freely available booklets written in German addressing melanoma patients (MP). Melanoma booklets in accordance with predefined criteria were searched and analyzed. Three reviewers independently assessed their quality and understandability by applying the DISCERN tool and PEMAT-P. The Flesch Reading Ease Score (FRES) was calculated to determine readability. Nine booklets addressing MP were analyzed. The overall median DISCERN score was 3.6 (interquartile range (IQR) 2.9-4.1), median PEMAT-P score was 91% (IQR 83-94.5), and median FRES was 43 (IQR 33.5-47.5), indicating a medium quality, a high application of understandability elements, but low readability in at least half of the booklets. Incomplete reporting on treatments and insufficient meta-information caused the main quality deficits. There is a need of content and didactic revision of German booklets for MP to raise their quality and to make them beneficial and understandable for more patients. An adaption in accordance with evidence-based criteria and an even stronger involvement of MP in assessment and development of patient education material are considered to be the best approaches.

Content and Quality of Websites for Patients With Chronic Kidney Disease: An Environmental Scan

BACKGROUND

Although numerous websites for patients with chronic kidney disease (CKD) are available, little is known about their content and quality.

OBJECTIVE

To evaluate the quality of CKD websites, and the degree to which they align with information needs identified by patients with CKD.

METHODS

We identified websites by entering "chronic kidney disease" in 3 search engines: Google.com (with regional variants for Australia, Canada, the United Kingdom, and the United States), Bing.com, and Yahoo.com. We included the first 50 unique English-language sites from each search. We evaluated website content using a 30-point scale comprising 8 priority content domains identified by patients with CKD (understanding CKD, diet, symptoms, medications, mental/physical health, finances, travel, and work/school). We used standardized tools to evaluate usability, reliability, and readability (DISCERN, HONcode, LIDA, Reading Ease, and Reading Grade Level). Two reviewers independently conducted the search, screen, and evaluation.

RESULTS

Of the 2093 websites identified, 115 were included. Overall, sites covered a mean (SD) of 29% (17.8) of the CKD content areas. The proportion of sites covering content related to understanding CKD, symptoms, and diet was highest (97%, 80%, and 72%, respectively). The proportion of sites covering travel, finances, and work/school content was lowest (22%, 12%, and 12%, respectively). The mean (SD) scores for DISCERN, LIDA and HONcode were 68% (14.6), 71% (14.4), and 75% (17.2), respectively, considered above average for usability and reliability. The mean (SD) Reading Grade Level was 10.6 (2.8) and Reading Ease was 49.8 (14.4), suggesting poor readability.

CONCLUSIONS

Although many CKD web sites were of reasonable quality, their readability was poor. Furthermore, most sites covered less than 30% of the content patients identified as important for CKD self-management. These results will inform content gaps in internet-accessible information on CKD self-management that should be addressed by future eHealth web-based tools.

Exploring the Most Visible German Websites on Melanoma Immunotherapy: A Web-Based Analysis

Background

Patients diagnosed with melanoma frequently search the internet for treatment information, including novel and complex immunotherapy. However, health literacy is limited among half of the German population, and no assessment of websites on melanoma treatment has been performed so far.

Objective

The aim of this study was to identify and assess the most visible websites in German language on melanoma immunotherapy.

Methods

In accordance with the common Web-based information-seeking behavior of patients with cancer, the first 20 hits on Google, Yahoo, and Bing were searched for combinations of German synonyms for “melanoma” and “immunotherapy” in July 2017. Websites that met our predefined eligibility criteria were considered for assessment. Three reviewers independently assessed their quality by using the established DISCERN tool and by checking the presence of quality certification. Usability and reliability were evaluated by the LIDA tool and understandability by the Patient Education Materials Assessment Tool (PEMAT). The Flesch Reading Ease Score (FRES) was calculated to estimate the readability. The ALEXA and SISTRIX tools were used to investigate the websites’ popularity and visibility. The interrater agreement was determined by calculating Cronbach alpha. Subgroup differences were identified by t test, U test, or one-way analysis of variance.

Results

Of 480 hits, 45 single websites from 30 domains were assessed. Only 2 website domains displayed a German quality certification. The average assessment scores, mean (SD), were as follows: DISCERN, 48 (7.6); LIDA (usability), 40 (2.0); LIDA (reliability), 10 (1.6); PEMAT, 69% (16%); and FRES, 17 (14), indicating mediocre quality, good usability, and understandability but low reliability and an even very low readability of the included individual websites. SISTRIX scores ranged from 0 to 6872 and ALEXA scores ranged from 17 to 192,675, indicating heterogeneity of the visibility and popularity of German website domains providing information on melanoma immunotherapy.

Conclusions

Optimization of the most accessible German websites on melanoma immunotherapy is desirable. Especially, simplification of the readability of information and further adaption to reliability criteria are required to support the education of patients with melanoma and laypersons, and to enhance transparency.