Evaluation of the quality and readability of online information about breast cancer in China

From Online to Offline: How Different Sources of Online Health Information Seeking Affect Patient-Centered Communication in Chinese Older Adults? The Roles of Patient Activation and Patient-Provider Discussion of Online Health Information

Despite the increasing prevalence of online health information seeking (OHIS) among older adults, its impact on patient-centered communication (PCC) outcomes remains unclear. Drawing from Street's ecological framework of communication in medical encounters, the present study examined the mediation role of patient activation in the relationship between OHIS across three media channels - social media, search engines, and mobile health applications (mHealth apps) - and PCC. Furthermore, it examines the moderation effect of patient-provider discussions of online health information. A national survey of 916 older Chinese adults aged 60-78 was conducted. The findings indicate that OHIS across the three channels can indirectly enhance PCC through patient activation. Moreover, OHIS via mHealth apps is positively associated with PCC, while the relationship between OHIS via social media/search engines and PCC is not significant. The interaction between patients and healthcare providers regarding online health information positively moderated all indirect paths. Notably, a great proportion of older adults (77.7%) engaged in discussions about online health information with healthcare providers. These findings emphasize the importance of considering various media channels and highlight the pivotal role of patient activation in bridging the gap between OHIS and satisfactory healthcare interactions, especially in the Chinese context.

Quality of Chronic Obstructive Pulmonary Disease Information on the Chinese Internet: Website Evaluation Study

BACKGROUND

The development of internet technology has greatly increased the ability of patients with chronic obstructive pulmonary disease (COPD) to obtain health information, giving patients more initiative in the patient-physician decision-making process. However, concerns about the quality of website health information will affect the enthusiasm of patients' website search behavior. Therefore, it is necessary to evaluate the current situation of Chinese internet information on COPD.

OBJECTIVE

This study aims to evaluate the quality of COPD treatment information on the Chinese internet.

METHODS

Using the standard disease name "" ("chronic obstructive pulmonary disease" in Chinese) and the commonly used public search terms "" ("COPD") and "" ("emphysema") combined with the keyword "" ("treatment"), we searched the PC client web page of Baidu, Sogou, and 360 search engines and screened the first 50 links of the website from July to August 2021. The language was restricted to Chinese for all the websites. The DISCERN tool was used to evaluate the websites.

RESULTS

A total of 96 websites were included and analyzed. The mean overall DISCERN score for all websites was 30.4 (SD 10.3; range 17.3-58.7; low quality), no website reached the maximum DISCERN score of 75, and the mean score for each item was 2.0 (SD 0.7; range 1.2-3.9). There were significant differences in mean DISCERN scores between terms, with "chronic obstructive pulmonary disease" having the highest mean score.

CONCLUSIONS

The quality of COPD information on the Chinese internet is poor, which is mainly reflected in the low reliability and relevance of COPD treatment information, which can easily lead consumers to make inappropriate treatment choices. The term "chronic obstructive pulmonary disease" has the highest DISCERN score among commonly used disease search terms. It is recommended that consumers use standard disease names when searching for website information, as the information obtained is relatively reliable.

Lost in Translation: Multilingual Analysis of Online Breast Cancer Information

INTRODUCTION

Patients use the internet to learn more about health conditions. Non-English-speaking patients may face additional challenges. The quality of online breast cancer information, the most common cancer in women, is uncertain. This study aims to examine the quality of online breast cancer information for English and non-English-speaking patients.

METHODS

Three search engines were queried using the terms: "how to do a breast examination," "when do I need a mammogram," and "what are the treatment options for breast cancer" in English, Spanish, and Chinese. For each language, 60 unique websites were included and classified by type and information source. Two language-fluent reviewers evaluated website quality using the Journal of American Medical Association benchmark criteria (0-4) and the DISCERN tool (1-5), with higher scores representing higher quality. Scores were averaged for each language. Health On the Net code presence was noted. Inter-rater reliability between reviewers was assessed.

RESULTS

English and Spanish websites most commonly originated from US sources (92% and 80%, respectively) compared to Chinese websites (33%, P < 0.001). The most common website type was hospital-affiliated for English (43%) and foundation/advocacy for Spanish and Chinese (43% and 45%, respectively). English websites had the highest and Chinese websites the lowest mean the Journal of American Medical Association (2.2 ± 1.4 versus 1.0 ± 0.8, P = 0.002) and DISCERN scores (3.5 ± 0.9 versus 2.3 ± 0.6, P < 0.001). Health On the Net code was present on 16 (8.9%) websites. Inter-rater reliability ranged from moderate to substantial agreement.

CONCLUSIONS

The quality of online information on breast cancer across all three languages is poor. Information quality was poorest for Chinese websites. Improvements to enhance the reliability of breast cancer information across languages are needed.

Current status of electronic health literacy among pregnant women with gestational diabetes mellitus and their perceptions of online health information: a mixed-methods study

BACKGROUND

Women diagnosed with gestational diabetes mellitus often rely on internet-based health information for managing their condition. This study aims to investigate the present state of electronic health literacy among women with gestational diabetes mellitus, analyze the influencing factors, and explore their experiences regarding accessing, comprehending, evaluating, and applying online health information pertinent to gestational diabetes mellitus.

METHODS

A sequential explanatory mixed methods research design was adopted in this study. Initially, 235 women with gestational diabetes mellitus participated in a cross-sectional survey. The research tools included general information and the Chinese version of the electronic Health Literacy Scale (eHEALS). Descriptive analyses were conducted to describe the characteristics of the sample, and multiple linear regression analyses were used to explore the factors influencing electronic health literacy among women with gestational diabetes mellitus. Secondly, 11 women with gestational diabetes mellitus joined semi-structured in-depth interviews to obtain their perceptions about online health information. The data were analyzed using inductive content analysis to develop themes.

RESULTS

The median score of eHEALS in the Chinese version among 235 women diagnosed with gestational diabetes mellitus was 29 (interquartile range [IQR], 26 to 32). Factors influencing electronic health literacy among these women included accessing health information from medical professionals (β = 0.137, p = 0.029) and utilizing health information from applications (β = 0.159, p = 0.013). From the qualitative phase of the study, four thematic categories emerged: reasons and basis for accessing health information from the Internet; address barriers to accessing and applying online health information; desires for a higher level of online health information services; outcomes of accessing and applying online health information.

CONCLUSION

The electronic health literacy of women diagnosed with gestational diabetes mellitus remains suboptimal and warrants improvement. The sources of access to health information affect electronic health literacy in women with gestational diabetes mellitus. Moreover, women facing gestational diabetes encounter numerous impediments when attempting to access health-related information online, underscoring the necessity for enhanced online health information services to meet their needs.

A novel system to provide information via online YouTube videos and an evaluation of current online information about hereditary breast cancer

BACKGROUND

The internet, especially YouTube, has become a prominent source of health information. However, the quality and accuracy of medical content on YouTube vary, posing concerns about misinformation. This study focuses on providing reliable information about hereditary breast cancer on YouTube, given its importance for decision-making among patients and families. The study examines the quality and accessibility of such content in Japanese, where limited research has been conducted.

METHODS

A nonprofit organization called BC Tube was established in May 2020 to create informative videos about breast cancer. The study analyzed 85 YouTube videos selected using the Japanese keywords "hereditary breast cancer" and "HBOC", categorized into six groups based on the source of upload: BC Tube, hospitals/governments, individual physicians, public-interest organizations/companies, breast cancer survivors, and others. The videos were evaluated based on various factors, including content length, view counts, likes, comments, and the presence of advertisements. The content was evaluated using the PEMAT and DISCERN quality criteria.

RESULTS

BC Tube created high-quality videos with high scores on PEMAT understandability, significantly outperforming other sources. Videos from public-interest organizations/companies received the most views and likes, despite their lower quality. Videos from medical institutions and governments were of superior quality but attracted less attention.

CONCLUSIONS

Our study emphasizes the importance of promoting accessible, easy-to-understand, and widely recognized medical information online. The popularity of videos does not always correspond to their quality, emphasizing the importance of quality evaluation. BC Tube provides a peer-reviewed platform to disseminate high-quality health information. We need to develop high-quality online health information and encourage the promotion of evidence-based information on YouTube.

Evaluation of the quality and readability of ChatGPT responses to frequently asked questions about myopia in traditional Chinese language

Introduction

ChatGPT can serve as an adjunct informational tool for ophthalmologists and their patients. However, the reliability and readability of its responses to myopia-related queries in the Chinese language remain underexplored.

Purpose

This study aimed to evaluate the ability of ChatGPT to address frequently asked questions (FAQs) about myopia by parents and caregivers.

Method

Myopia-related FAQs were input three times into fresh ChatGPT sessions, and the responses were evaluated by 10 ophthalmologists using a Likert scale for appropriateness, usability, and clarity. The Chinese Readability Index Explorer (CRIE) was used to evaluate the readability of each response. Inter-rater reliability among the reviewers was examined using Cohen's kappa coefficient, and Spearman's rank correlation analysis and one-way analysis of variance were used to investigate the relationship between CRIE scores and each criterion.

Results

Forty-five percent of the responses of ChatGPT in Chinese language were appropriate and usable and only 35% met all the set criteria. The CRIE scores for 20 ChatGPT responses ranged from 7.29 to 12.09, indicating that the readability level was equivalent to a middle-to-high school level. Responses about the treatment efficacy and side effects were deficient for all three criteria.

Conclusions

The performance of ChatGPT in addressing pediatric myopia-related questions is currently suboptimal. As parents increasingly utilize digital resources to obtain health information, it has become crucial for eye care professionals to familiarize themselves with artificial intelligence-driven information on pediatric myopia.

Assessment of the quality of online information on dietary recommendations for inflammatory bowel disease

Objective

The internet has become a preferred source for people seeking health information, including diet recommendations which are pivotal in the management of inflammatory bowel disease (IBD). Hence, we aimed to assess the quality of online information in China regarding IBD dietary recommendations.

Methods

The search engines Baidu and Bing were used to screen for their top 25 webpages using the keywords "inflammatory bowel disease diet," "ulcerative colitis diet," "Crohn's disease diet," "inflammatory bowel disease nutrition," "ulcerative colitis nutrition," and "Crohn's disease nutrition." The quality of information was assessed by two physicians according to the Journal of the American Medical Association (JAMA) benchmark, the Global Quality Score (GQS), and the DISCERN instrument.

Results

One hundred and eight webpages were selected for evaluation. The mean scores for JAMA, GQS, and DISCERN were 1.48, 3.11, and 36.20, respectively. Articles from professionals and non-profit organizations demonstrated superior quality compared to those from commercial and health portal websites. Many webpages failed to provide an explicit source of information or support for shared decision-making. The information on several pages lacked comprehensive descriptions of food types for IBD, with some pages even containing inaccuracies. No statistically significant differences in scores were observed between Baidu and Bing.

Conclusions

The quality of online information on IBD dietary recommendations in China is moderate to low and exhibits significant variation across different sources. This warrants joint efforts from online authors, internet platforms, and regulators, to improve the quality of popular medical information.

Evaluation of the Quality and Readability of Online Information about Alzheimer's Disease in China

Background

With the increasing popularity of the internet, a growing number of patients and their companions are actively seeking health-related information online.

Objective

The aim of this study was to assess the quality and readability of online information about Alzheimer's disease (AD) in China.

Methods

A total of 263 qualified AD-related web pages from different businesses, governments, and hospitals were obtained. The quality of the web pages was assessed using the DISCERN tool, and the readability of the web pages was assessed using a readability measurement website suitable for the Chinese language. The differences in readability and quality between different types of web pages were investigated, and the correlation between quality and readability was analyzed.

Results

The mean overall DISCERN score was 40.93±7.5. The government group scored significantly higher than the commercial and hospital groups. The mean readability score was 12.74±1.27, and the commercial group had the lowest readability score. There was a positive correlation between DISCERN scores and readability scores.

Conclusions

This study presents an evaluation of the quality and readability of health information pertaining to AD in China. The findings indicate that there is a need to enhance the quality and readability of web pages about AD in China. Recommendations for improvement are proposed in light of these findings.

An evaluation of the quality of COVID-19 websites in terms of HON principles and using DISCERN tool

BACKGROUND

As many people relied on information from the Internet for official scientific or academically affiliated information during the COVID-19 pandemic, the quality of information on those websites should be good.

OBJECTIVE

The main purpose of this study was to evaluate a selection of COVID-19-related websites for the quality of health information provided.

METHOD

Using Google and Yahoo, 36 English language websites were selected, in accordance with the inclusion criteria. The two tools were selected for evaluation were the Health on the Net (HON) Code and the 16-item DISCERN tool.

RESULTS

Most websites (39%) were related to information for the public, and a small number of them (3%) concerned screening websites in which people could be informed of their possible condition by entering their symptoms. The result of the evaluation by the HON tool showed that most websites were reliable (53%), and 44% of them were very reliable. Based on the assessment results of the Likert-based 16-item DISCERN tool, the maximum and minimum values for the average scores of each website were calculated as 2.44 and 4.25, respectively.

CONCLUSION

Evaluation using two widely accepted tools shows that most websites related to COVID-19 are reliable and useful for physicians, researchers and the public.

Quality evaluation of health information about breast cancer treatment found on WeChat public accounts

BACKGROUND

With growing cases of breast cancer, WeChat public account, an important information publishing platform of WeChat, has become a breast cancer treatment health information provider to a huge audience. It is essential for health information to possess high-level accuracy and reliability. This work evaluates the quality of health information on breast cancer treatment in WeChat public accounts (WPAs), to benefit the patients while making treatment decisions and provide WPA authors with suggestions on publishing high-quality treatment health information.

METHODS

With "breast cancer" as keywords, searches were implemented on weixin.sogou.com and the WeChat app. The WPAs oriented to patients with breast cancer were selected, and the four latest articles of each WPA were included in a set to be evaluated with DISCERN.

RESULTS

A total of 37 WPAs and 136 articles published by them were included. The accounts operated by individual users were 54%. The median of overall quality of 136 articles was 44 (interquartile range = 10.75) and ranked as "fair", of which only 28 (21%) were of "good" or higher quality. Among these articles, 74 (54%) were related to medical treatments, and 13 of them mentioned clinical trials; 36 (27%) dealt with surgery. 101 (74.26%) omitted additional sources of information; 102 (75%) did not explicitly suggest shared decision-making. A significant difference was not found in the dimensions "reliability of the articles" and "specific details of information on treatment choices" between the distinct categories of account subjects and various treatment options (P > 0.05).

CONCLUSIONS

The quality of the articles on breast cancer treatment health information in WPAs was moderate. WPA producers should focus on improving the reliability of information and providing more details on treatment options, to assist patients in making optimal decisions during treatment.

Analysis of Trustworthiness and Readability of English and Spanish Hypo- and Hyperthyroid-Related Online Patient Education Information

This study aims to determine the readability and trustworthiness of English and Spanish hypo- and hyperthyroid-related online information. Google searches were conducted for four search terms: hypothyroidism, Hashimoto's Disease, hyperthyroidism, and Graves' Disease. For each search term, the first 10 websites were analyzed with a total of 40 websites analyzed. Readability formulas were used to determine English and Spanish readability. Trustworthiness was determined using HONcode status, JAMA Benchmark Criteria, and NLM Trustworthy Score. Overall readability largely exceeded recommended grade levels. Only 1 website (2.5%) presented information below the eighth-grade reading level based on overall Readability Consensus score, while 31 websites (77.5%) exceeded this threshold for all measures. The mean (SD) English readability grade level was 9.6 (3.44); the mean (SD) Spanish grade was 8.5 (4.58). No significant relationships were found between the JAMA Benchmark Criteria, NLM Trustworthy Score, HONcode status, and readability. 67.5% of websites analyzed (n = 27) were certified with the Health on the Net Foundation's code of conduct. Websites about common thyroid-related conditions have overall poor readability. The availability of resources for Spanish-speaking patients is also poor. Steps should be taken to ensure that online health-related materials are comprehensible. Physicians should recognize that patients may have few trustworthy and easy-to-understand sources to access information. The readability and trustworthiness of sources should be considered when providing patients suggested sources for further reading. It may be particularly helpful for physicians to utilize websites with favorable readability scores such as the American Thyroid Association website.

An evaluation of the suitability, readability, quality, and usefulness of online resources for patients with cancer receiving immunotherapy

OBJECTIVE

To evaluate the suitability, readability, quality, and usefulness of available online resources about the side effects of immunotherapy.

METHODS

Resources were identified through online searches (Google, Microsoft Bing, and Yahoo search engines) and evaluated using the Suitability Assessment Materials (SAM), three readability formulae, the DISCERN tool (quality), and a checklist of symptom management strategies and self-management skills (usefulness). Hierarchical cluster analysis identified resources scoring highly for suitability and quality. Factors associated with the clusters were identified using Fischer's exact tests.

RESULTS

The 51 resources retained for evaluation were of low suitability and quality and exceeded recommended reading levels. Resources were lacking key features to support learning (e.g., illustrations) as well as information about the risks of treatments and the effect of treatments on quality of life. Few resources addressed key self-management skills of problem-solving and taking action. The cluster analysis identified "low" and "moderate" clusters for suitability and quality, and pamphlets and booklets were more likely to be in the moderate cluster as compared to webpages.

CONCLUSION

There is a lack of high-quality resources to support patients' learning to self-manage side effects of immunotherapy.

PRACTICE IMPLICATIONS

Results identify the best available online resources for self-managing side effects of immunotherapy and gaps for future work. Based on findings, a template for patient education materials was developed.

Developing Machine Learning and Statistical Tools to Evaluate the Accessibility of Public Health Advice on Infectious Diseases among Vulnerable People

Background

From Ebola, Zika, to the latest COVID-19 pandemic, outbreaks of highly infectious diseases continue to reveal severe consequences of social and health inequalities. People from low socioeconomic and educational backgrounds as well as low health literacy tend to be affected by the uncertainty, complexity, volatility, and progressiveness of public health crises and emergencies. A key lesson that governments have taken from the ongoing coronavirus pandemic is the importance of developing and disseminating highly accessible, actionable, inclusive, coherent public health advice, which represent a critical tool to help people with diverse cultural, educational backgrounds and varying abilities to effectively implement health policies at the grassroots level.

Objective

We aimed to translate the best practices of accessible, inclusive public health advice (purposefully designed for people with low socioeconomic and educational background, health literacy levels, limited English proficiency, and cognitive/functional impairments) on COVID-19 from health authorities in English-speaking multicultural countries (USA, Australia, and UK) to adaptive tools for the evaluation of the accessibility of public health advice in other languages.

Methods

We developed an optimised Bayesian classifier to produce probabilistic prediction of the accessibility of official health advice among vulnerable people including migrants and foreigners living in China. We developed an adaptive statistical formula for the rapid evaluation of the accessibility of health advice among vulnerable people in China.

Results

Our study provides needed research tools to fill in a persistent gap in Chinese public health research on accessible, inclusive communication of infectious diseases' prevention and management. For the probabilistic prediction, using the optimised Bayesian machine learning classifier (GNB), the largest positive likelihood ratio (LR+) 16.685 (95% confidence interval: 4.35, 64.04) was identified when the probability threshold was set at 0.2 (sensitivity: 0.98; specificity: 0.94).

Conclusion

Effective communication of health risks through accessible, inclusive, actionable public advice represents a powerful tool to reduce health inequalities amidst health crises and emergencies. Our study translated the best-practice public health advice developed during the pandemic into intuitive machine learning classifiers for health authorities to develop evidence-based guidelines of accessible health advice. In addition, we developed adaptive statistical tools for frontline health professionals to assess accessibility of public health advice for people from non-English speaking backgrounds.