Wikipedia in Vascular Surgery Medical Education: Comparative Study

Video quality of nonalcoholic fatty liver disease on TikTok: A cross-sectional study

The short-video application TikTok shows great potential for disseminating health information. We assessed the content, sources, and quality of information in videos related to nonalcoholic fatty liver disease (NAFLD) on TikTok. Our study aims to identify upload sources, content, and characteristic information for NAFLD videos on TikTok and further evaluate factors related to video quality. We investigated the top 100 videos related to NAFLD on TikTok and analyzed the upload sources, content, and characteristics of these videos. Evaluate video quality using the DISCERN tool and Global Quality Score (GQS). In addition, the correlation between video quality and video characteristics is further studied. In terms of video sources, the majority of NAFLD videos on TikTok (85/100, 85%) were posted by doctors, ensuring the professionalism of the content, and among the video content, disease knowledge was the most dominant video content, accounting for 57% (57/100) of all videos, and the average DISCERN and GQS scores of all 100 videos were 39.59 (SD 3.31) and 2.99 (SD 0.95), respectively. DISCERN and GQS data show that videos related to NAFLD do not have high-quality scores on TikTok, mainly fair (68/100, 68%) and moderate (49/100, 49%). In general, the quality of NAFLD video information from professional content and professional sources was higher than that of nonprofessional sources and nonprofessional content, the video quality of general surgeons was better than that of other department physicians, and the video quality of junior physicians was better than that of senior physicians. In terms of video correlation, durations, the number of fans, and the total number of works were negatively correlated with DISCERN scores (R < 0, P < .05), while likes, comments, collections, shares, and days since upload were not significantly correlated with DISCERN and GQS scores (P > .05). The medical information on TikTok is not rigorous enough to guide patients to make accurate judgments, platforms should monitor and guide publishers to help promote and disseminate quality content.

Assessment of medical information on irritable bowel syndrome information in Wikipedia and Baidu Encyclopedia: comparative study

Background

Irritable bowel syndrome (IBS) is a functional gastrointestinal disorder (FGID) with heterogeneous clinical presentations. There are no clear testing parameters for its diagnosis, and the complex pathophysiology of IBS and the limited time that doctors have to spend with patients makes it difficult to adequately educate patients in the outpatient setting. An increased awareness of IBS means that patients are more likely to self-diagnose and self-manage IBS based on their own symptoms. These factors may make patients more likely to turn to Internet resources. Wikipedia is the most popular online encyclopedia among English-speaking users, with numerous validations. However, in Mandarin-speaking regions, the Baidu Encyclopedia is most commonly used. There have been no studies on the reliability, readability, and objectivity of IBS information on the two sites. This is an urgent issue as these platforms are accessed by approximately 1.45 billion people.

Objective

We compared the IBS content on Wikipedia (in English) and Baidu Baike (in Chinese), two online encyclopedias, in terms of reliability, readability, and objectivity.

Methods

The Baidu Encyclopedia (in Chinese) and Wikipedia (in English) were evaluated based on the Rome IV IBS definitions and diagnoses. All possible synonyms and derivatives for IBS and IBS-related FGIDs were screened and identified. Two gastroenterology experts evaluated the scores of articles for both sites using the DISCERN instrument, the Journal of the American Medical Association scoring system (JAMA), and the Global Quality Score (GQS).

Results

Wikipedia scored higher overall with DISCERN (p < .0001), JAMA (p < .0001) and GQS (p < .05) than the Baidu Encyclopedia. Specifically, Wikipedia scored higher in DISCERN Section 1 (p < .0001), DISCERN Section 2 (p < .01), DISCERN Section 3 (p < .001), and the General DISCERN score (p < .0001) than the Baidu Encyclopedia. Both sites had low DISCERN Section 2 scores (p = .18). Wikipedia also had a larger percentage of high quality scores in total DISCERN, DISCERN Section 1, and DISCERN Section 3 (p < .0001, P < .0001, P < .0004, respectively, based on the above 3 (60%) rule).

Conclusions

Wikipedia provides more reliable, higher quality, and more objective IBS-related health information than the Baidu Encyclopedia. However, there should be improvements in the information quality for both sites. Medical professionals and institutions should collaborate with these online platforms to offer better health information for IBS.

Information quality of videos related to Helicobacter pylori infection on TikTok: Cross-sectional study

BACKGROUND

Helicobacter pylori (H. pylori) poses serious threats to human health. TikTok (Douyin in Chinese), a major social media platform focused on sharing short videos, has demonstrated great potential in spreading health information, including information related to H. pylori infection. This study aims to evaluate the content and quality of the information shared in TikTok videos about H. pylori infection in mainland China.

METHODS

We collected a sample of 116 videos in Chinese related to H. pylori infection from TikTok. Video contents were evaluated by the coding schema proposed by Goobie et al., and the Hexagonal Radar Schema was used to intuitively display the spotlight and weight of each aspect of the videos. The DISCERN questionnaire was used to evaluate the quality of the videos.

RESULTS

We identified two major sources of videos related to H. pylori: individual users (n = 89) and organizational users (n = 27). Regarding content, the Hexagonal Radar Charts showed that more than 35% of the videos delivered moderate to high quality content (>1 point) in terms of definition, symptoms and management of the disease, whereas risk factors, evaluation and outcomes of the disease were less discussed. The DISCERN classification data showed that 0.9% of the videos were "very poor," 5.2% "poor," 68.7% "fair," 20.0% "good," and only 5.2% "excellent". Regarding total DISCERN scores, videos published by nonprofit organizations had the highest scores, followed by videos uploaded by health professionals.

CONCLUSION

Although the overall quality of TikTok videos related to H. pylori infection was medium, users should be careful when obtaining information related to H. pylori infection on TikTok and opt for videos uploaded by nonprofit organizations and health professionals.

The quality of information provided by the most popular dementia videos on TikTok

Summary of background

Dementia is among the leading causes of death and disability worldwide, having a major impact not only on the affected person but also on all of society. The Internet is a popular and growing source of health-related information for patients, family members, carriers, and physicians. TikTok, one of the most popular social media platforms, is an important source for knowledge access and adoption. However, the quality of health information on TikTok has not been sufficiently studied.

Objective

To evaluate the quality of the information provided in the most popular videos on dementia shared on TikTok.

Study design

A cross-sectional study.

Methods

The top 100 most popular videos on TikTok obtained by searching the hashtag "dementia" were included in the study and grouped based on their source and content. The popularity of the videos was estimated based on the numbers of likes, comments, and shares. The quality of health-related information was evaluated using the DISCERN score and the Global Quality Score (GQS).

Results

Videos had a median duration of 33.29 s; the median number of likes was 635,100, with a total of 93,698,200 likes, 903,859 comments, and 5,310,912 shares. The source (uploader) of 65% of the videos was family members, while only 4% were uploaded by doctors. The content was lifestyle-related in 62% of the videos, while 12% of the videos were for fun. Videos had a median DISCERN score of 22.5 (IQR 20-27) and a median GQS of 2 (IQR 1-3). The videos uploaded by doctors had the highest quality scores and the lowest popularity.

Conclusion

The most popular dementia videos on TikTok are mostly shared by family members and are of poor quality. Given the major public health issues associated with dementia, experts must provide appropriate and active assistance to patients in interpreting the information identified.

Public Awareness of the Fencing Response as an Indicator of Traumatic Brain Injury: Quantitative Study of Twitter and Wikipedia Data

BACKGROUND

Traumatic brain injury (TBI) is a disruption in normal brain function caused by an impact of external forces on the head. TBI affects millions of individuals per year, many potentially experiencing chronic symptoms and long-term disability, creating a public health crisis and an economic burden on society. The public discourse around sport-related TBIs has increased in recent decades; however, recognition of a possible TBI remains a challenge. The fencing response is an immediate posturing of the limbs, which can occur in individuals who sustain a TBI and can be used as an overt indicator of TBI. Typically, an individual demonstrating the fencing response exhibits extension in 1 arm and flexion in the contralateral arm immediately upon impact to the head; variations of forearm posturing among each limb have been observed. The tonic posturing is retained for several seconds, sufficient for observation and recognition of a TBI. Since the publication of the original peer-reviewed article on the fencing response, there have been efforts to raise awareness of the fencing response as a visible sign of TBI through publicly available web-based platforms, such as Twitter and Wikipedia.

OBJECTIVE

We aimed to quantify trends that demonstrate levels of public discussion and awareness of the fencing response over time using data from Twitter and Wikipedia.

METHODS

Raw Twitter data from January 1, 2010, to December 31, 2019, were accessed using the RStudio package academictwitteR and queried for the text "fencing response." Data for page views of the Fencing Response Wikipedia article from January 1, 2010, to December 31, 2019, were accessed using the RStudio packages wikipediatrend and pageviews. Data were clustered by weekday, month, half-year (to represent the American football season vs off-season), and year to identify trends over time. Seasonal regression analysis was used to analyze the relationship between the number of fencing response tweets and page views and month of the year.

RESULTS

Twitter mentions of the fencing response and Wikipedia page views increased overall from 2010 to 2019, with hundreds of tweets and hundreds of thousands of Wikipedia page views per year. Twitter mentions peaked during the American football season, especially on and following game days. Wikipedia page views did not demonstrate a clear weekday or seasonal pattern, but instead had multiple peaks across various months and years, with January having more page views than May.

CONCLUSIONS

Here, we demonstrated increased awareness of the fencing response over time using public data from Twitter and Wikipedia. Effective scientific communication through free public platforms can help spread awareness of clinical indicators of TBI, such as the fencing response. Greater awareness of the fencing response as a "red-flag" sign of TBI among coaches, athletic trainers, and sports organizations can help with medical care and return-to-play decisions.

Quality of Information in Gallstone Disease Videos on TikTok: Cross-sectional Study

BACKGROUND

TikTok was an important channel for consumers to access and adopt health information. But the quality of health content in TikTok remains underinvestigated.

OBJECTIVE

Our study aimed to identify upload sources, contents, and feature information of gallstone disease videos on TikTok and further evaluated the factors related to video quality.

METHODS

We investigated the first 100 gallstone-related videos on TikTok and analyzed these videos' upload sources, content, and characteristics. The quality of videos was evaluated using quantitative scoring tools such as DISCERN instrument, the Journal of American Medical Association (JAMA) benchmark criteria, and Global Quality Scores (GQS). Moreover, the correlation between video quality and video characteristics, including duration, likes, comments, and shares, was further investigated.

RESULTS

According to video sources, 81% of the videos were posted by doctors. Furthermore, disease knowledge was the most dominant video content, accounting for 56% of all the videos. The mean DISCERN, JAMA, and GQS scores of all 100 videos are 39.61 (SD 11.36), 2.00 (SD 0.40), and 2.76 (SD 0.95), respectively. According to DISCERN and GQS, gallstone-related videos' quality score on TikTok is not high, mainly at fair (43/100, 43%,) and moderate (46/100, 46%). The total DISCERN scores of doctors were significantly higher than that of individuals and news agencies, surgery techniques were significantly higher than lifestyle and news, and disease knowledge was significantly higher than news, respectively. DISCERN scores and video duration were positively correlated. Negative correlations were found between DISCERN scores and likes and shares of videos. In GQS analysis, no significant differences were found between groups based on different sources or different contents. JAMA was excluded in the video quality and correlation analysis due to a lack of discrimination and inability to evaluate the video quality accurately.

CONCLUSIONS

Although the videos of gallstones on TikTok are mainly provided by doctors and contain disease knowledge, they are of low quality. We found a positive correlation between video duration and video quality. High-quality videos received low attention, and popular videos were of low quality. Medical information on TikTok is currently not rigorous enough to guide patients to make accurate judgments. TikTok was not an appropriate source of knowledge to educate patients due to the low quality and reliability of the information.

Translating and Adapting the DISCERN Instrument Into a Simplified Chinese Version and Validating Its Reliability: Development and Usability Study

BACKGROUND

There is a wide variation in the quality of information available to patients on the treatment of the diseases afflicting them. To help patients find clear and accessible information, many scales have been designed to evaluate the quality of health information, including the Patient Education Materials Assessment Tool; the Suitability Assessment of Materials for evaluation of health-related information for adults; and DISCERN, an instrument for judging the quality of written consumer health information on treatment choices. These instruments are primarily in English. Few of them have been translated and adapted into simplified Chinese tools for health information assessment in China.

OBJECTIVE

This study aimed to translate and adapt DISCERN into the first simplified Chinese version and validate the psychometric properties of this newly developed scale for judging the quality of patient-oriented health information on treatment choices.

METHODS

First, we translated DISCERN into simplified Chinese using rigorous guidelines for translation and validation studies. We tested the translation equivalence and measured the content validity index. We then presented the simplified Chinese instrument to 3 health educators and asked them to use it to assess the quality of 15 lung cancer-related materials. We calculated the Cohen κ coefficient and Cronbach α for all items and for the entire scale to determine the reliability of the new tool.

RESULTS

We decided on the simplified Chinese version of the DISCERN instrument (C-DISCERN) after resolving all problems in translation, adaptation, and content validation. The C-DISCERN was valid and reliable: the content validity index was 0.98 (47/48, 98% of the items) for clarity and 0.94 (45/48, 94% of the items) for relevance, the Cronbach α for internal consistency was .93 (95% CI 0.699-1.428) for the whole translated scale, and the Cohen κ coefficient for internal consistency was 0.53 (95% CI 0.417-0.698).

CONCLUSIONS

C-DISCERN is the first simplified Chinese version of the DISCERN instrument. Its validity and reliability have been attested to assess the quality of patient-targeted information for treatment choices.

Accuracy and Utility of Internet Image Search as a Learning Tool for Retinal Pathology

Purpose  Ophthalmology residency training heavily relies on visual and pattern recognition-based learning. In parallel with traditional reference texts, online internet search via Google Image Search (GIS) is commonly used and offers an accessible fund of reference images for ophthalmology trainees seeking rapid exposure to images of retinal pathology. However, the accuracy and quality of this tool within this context is unknown. We aim to evaluate the accuracy and quality of GIS images of selected retinal pathologies. Methods  A cross-sectional study was performed of GIS of 15 common and 15 rare retinal diseases drawn from the American Academy of Ophthalmology residency textbook series. A total of 300 evaluable image results were assessed for accuracy of images and image source accountability in consultation with a vitreoretinal surgeon. Results  A total of 377 images were reviewed with 77 excluded prior to final analysis. A total of 288 (96%) search results accurately portrayed the retinal disease being searched, whereas 12 (4%) were of an erroneous diagnosis. More images of common retinal diseases were from patient education Web sites than were images of rare diseases ( p  < 0.01). Significantly more images of rare retinal diseases were found in peer-reviewed sources ( p  = 0.01). Conclusions  GIS search results yielded a modest level of accuracy for the purposes of ophthalmic education. Despite the ease and rapidity of accessing multimodal retinal imaging examples, this tool may best be suited as a supplementary resource for learning among residents due to limited accuracy, lack of sufficient supporting information, and the source Web site's focus on patient education.

Google Images Search Results as a Resource in the Anatomy Laboratory: Rating of Educational Value

BACKGROUND

Preclinical medical learners are embedded in technology-rich environments, allowing them rapid access to a large volume of information. The anatomy laboratory is an environment in which faculty can assess the development of professional skills such as information literacy in preclinical medical learners. In the anatomy laboratory, many students use Google Images searches in addition to or in place of other course materials as a resource to locate and identify anatomical structures. However, the most frequent sources as well as the educational quality of these images are unknown.

OBJECTIVE

This study was designed to assess the sources and educational value of Google Images search results for commonly searched anatomical structures.

METHODS

The top 10 Google Images search results were collected for 39 anatomical structures. Image source websites were recorded and categorized based on the purpose and target audience of the site publishing the image. Educational value was determined through assessment of relevance (is the searched structure depicted in the image?), accuracy (does the image contain errors?), and usefulness (will the image assist a learner in locating the structure on an anatomical donor?). A reliable scoring rubric was developed to assess an image's usefulness.

RESULTS

A total of 390 images were analyzed. Most often, images were sourced from websites targeting health care professionals and health care professions students (38% of images), while Wikipedia was the most frequent single source of image results (62/390 results). Of the 390 total images, 363 (93.1%) depicted the searched structure and were therefore considered relevant. However, only 43.0% (156/363) of relevant images met the threshold to be deemed useful in identifying the searched structure in an anatomical donor. The usefulness of images did not significantly differ across source categories.

CONCLUSIONS

Anatomy faculty may use these results to develop interventions for gaps in information literacy in preclinical medical learners in the context of image searches in the anatomy laboratory.

Wikipedia provides better quality medical information on male sexual dysfunctions than Baidu Encyclopedia (Preprint)

Background

Sexual dysfunction is a private set of disorders that may cause stigma for patients when discussing their private problems with doctors. They might also feel reluctant to initiate a face-to-face consultation. Internet searches are gradually becoming the first choice for people with sexual dysfunction to obtain health information. Globally, Wikipedia is the most popular and consulted validated encyclopedia website in the English-speaking world. Baidu Encyclopedia is becoming the dominant source in Chinese-speaking regions; however, the objectivity and readability of the content are yet to be evaluated.

Objective

Hence, we aimed to evaluate the reliability, readability, and objectivity of male sexual dysfunction content on Wikipedia and Baidu Encyclopedia.

Methods

The Chinese Baidu Encyclopedia and English Wikipedia were investigated. All possible synonymous and derivative keywords for the most common male sexual dysfunction, erectile dysfunction, premature ejaculation, and their most common complication, chronic prostatitis/chronic pelvic pain syndrome, were screened. Two doctors evaluated the articles on Chinese Baidu Encyclopedia and English Wikipedia. The Journal of the American Medical Association (JAMA) scoring system, DISCERN instrument, and Global Quality Score (GQS) were used to assess the quality of disease-related articles.

Results

The total DISCERN scores (P=.002) and JAMA scores (P=.001) for Wikipedia were significantly higher than those of Baidu Encyclopedia; there was no statistical difference between the GQS scores (P=.31) for these websites. Specifically, the DISCERN Section 1 score (P<.001) for Wikipedia was significantly higher than that of Baidu Encyclopedia, while the differences between the DISCERN Section 2 and 3 scores (P=.14 and P=.17, respectively) were minor. Furthermore, Wikipedia had a higher proportion of high total DISCERN scores (P<.001) and DISCERN Section 1 scores (P<.001) than Baidu Encyclopedia. Baidu Encyclopedia and Wikipedia both had low DISCERN Section 2 and 3 scores (P=.49 and P=.99, respectively), and most of these scores were low quality.

Conclusions

Wikipedia provides more reliable, higher quality, and more objective information than Baidu Encyclopedia. Yet, there are opportunities for both platforms to vastly improve their content quality. Moreover, both sites had similar poor quality content on treatment options. Joint efforts of physicians, physician associations, medical institutions, and internet platforms are needed to provide reliable, readable, and objective knowledge about diseases.

Evaluation of the Liver Disease Information in Baidu Encyclopedia and Wikipedia: Longitudinal Study

Background

The internet has changed the way of people acquiring health information. Previous studies have shown that Wikipedia is a reasonably reliable medical resource, and it has been ranked higher than other general websites in various search engines. Baidu Encyclopedia is one of the most popular encyclopedia websites in China. However, no studies have shown the quality of the content provided in the Baidu Encyclopedia.

Objective

This study aimed to evaluate the quality of liver disease information provided by Wikipedia (in English) and Baidu Encyclopedia (in Chinese) and to perform a comparison of the quality and timeliness of the articles published in these two encyclopedias. Moreover, a 3-year follow-up study was conducted to compare if the information in both these websites was updated regularly over this period.

Methods

We searched for information on liver diseases by using the International Statistical Classification of Diseases and Related Health Problems 10th Revision Version 2016 codes on Wikipedia (in English) and Baidu Encyclopedia (in Chinese). The quality of the articles was assessed using the DISCERN instrument, which consists of 3 sections. We recorded the latest editing date of the webpages and calculated the date interval to evaluate the update timeliness of these websites.

Results

We found 22 entries on liver diseases in Baidu Encyclopedia and 15 articles in Wikipedia between September 15, 2016, and September 30, 2016, and we found 25 entries in Baidu Encyclopedia and 16 articles in Wikipedia between September 15, 2019, and September 30, 2019. In section 1 of the DISCERN instrument, the mean (SE) scores of Baidu Encyclopedia entries were significantly lower than those of Wikipedia articles. In section 2 and section 3 of the DISCERN instrument, the DISCERN scores of Baidu Encyclopedia entries were lower than those of Wikipedia articles, but the differences were not statistically significant. The total DISCERN scores of Baidu Encyclopedia entries were significantly lower than those of Wikipedia articles. The update interval of the entries in Baidu Encyclopedia was found to be significantly longer than that of the articles in Wikipedia.

Conclusions

This study shows that the quality of articles and the reliability of the research content on liver diseases in Wikipedia are better than those of the entries in Baidu Encyclopedia. However, the quality of the treatment choices provided in both Wikipedia and Baidu Encyclopedia is not satisfactory. Wikipedia is updated more frequently than Baidu Encyclopedia, thereby ensuring that the information presented has the most recent research findings. The findings of our study suggest that in order to find accurate health information, it is important to seek the help of medical professionals instead of looking for a prescription amid the confusing information provided on the internet.