Is TikTok a high-quality source of information on thyroid cancer?

YouTube/ Bilibili/ TikTok videos as sources of medical information on laryngeal carcinoma: cross-sectional content analysis study

BACKGROUND

YouTube, a widely recognized global video platform, is inaccessible in China, whereas Bilibili and TikTok are popular platforms for long and short videos, respectively. There are many videos related to laryngeal carcinoma on these platforms. This study aims to identify upload sources, contents, and feature information of these videos on YouTube, Bilibili, and TikTok, and further evaluate the video quality.

METHODS

On January 1, 2024, we searched the top 100 videos by default sort order (300 videos in total) with the terms "laryngeal carcinoma" and "throat cancer" on YouTube, "" on Bilibili and TikTok. Videos were screened for relevance and similarity. Video characteristics were documented, and quality was assessed by using the Patient Education Materials Assessment Tool (PEMAT), Video Information and Quality Index (VIQI), Global Quality Score (GQS), and modified DISCERN (mDISCERN).

RESULTS

The analysis included 99 YouTube videos, 76 from Bilibili, and 73 from TikTok. Median video lengths were 193 s (YouTube), 136 s (Bilibili), and 42 s (TikTok). TikTok videos demonstrated higher audience interaction. Bilibili had the lowest ratio of original contents (69.7%). Treatment was the most popular topic on YouTube and Bilibili, while that was the prognosis on TikTok. Solo narration was the most common video style across all platforms. Video uploaders were predominantly non-profit organizations (YouTube), self-media (Bilibili), and doctors (TikTok), with TikTok authors having the highest certification rate (83.3%). Video quality, assessed using PEMAT, VIQI, GQS, and mDISCERN, varied across platforms, with YouTube generally showing the highest scores. Videos from professional authors performed better than videos from non-professionals based on the GQS and mDISCERN scores. Spearman correlation analysis showed no strong relationships between the video quality and the audience interaction.

CONCLUSIONS

Videos on social media platforms can help the public learn about the knowledge of laryngeal cancer to some extent. TikTok achieves the best flow, but videos on YouTube are of the best quality. However, the video quality across all platforms still needs enhancement. We need more professional uploaders to ameliorate the video quality related to laryngeal carcinoma. Content creators also should be aware of the certification, the originality, and the style of video shooting. As for the platforms, refining the algorithm will allow users to receive more high-quality videos.

Myopia information on TikTok: analysis factors that impact video quality and audience engagement

BACKGROUND

TikTok is emerging as a vital platform for health information dissemination. Despite myopia being a global public health issue, the high-quality myopia information shared by health educators often fails to go viral. It is imperative to analyze the factors influencing video quality and popularity, especially from diverse perspectives of researchers, health educators, and audiences.

METHODS

TikTok myopia-related videos were retrieved using TikTok's default comprehensive search (DCS) and most liked search (MLS) strategies. Venn diagrams were employed to illustrate the relationships and commonalities between the two strategies across four sample sizes (top 200, 150, 100, and 50). Video metadata, including details such as creator information, production properties, upload time, video duration, and viewer engagement, were collected. Video quality was assessed using the DISCERN tool. Video content covering six aspects of myopia were evaluated. The impact of search strategies, video sample sizes, production properties, and myopia content on video quality and audience engagement was analyzed through single-factor or multi-factor analysis.

RESULTS

DCS and MLS retrieval strategies, as well as varying sample sizes, resulted in differences in audience engagement for myopia videos (P < 0.039), while The DISCERN quality scores remained comparable (P > 0.221). Videos published by healthcare professionals (HCPs) and non-profit organizations (NPOs) were associated with high-quality (P ≤ 0.014) but comparatively lower popularity (P < 0.033). Videos that reported contents of risk factors, management, and outcomes showed high popularity (P < 0.018), while longer video duration (> 60s) exhibited the opposite trend (P < 0.032). Content on myopia evaluation (P ≤ 0.001) and management (P ≤ 0.022) and video duration were positively correlated with higher DISCERN quality.

CONCLUSION

Videos created by HCPs and NPOs deserve greater attention. Rather than pursuing entertaining effects, professional educators should emphasize producing concise, and high-quality myopia content that readily resonates with the audience and has the potential to go viral on the platform.

Assessment of the reliability and quality of breast cancer related videos on TikTok and Bilibili: cross-sectional study in China

Background

As the most common malignant tumor in the world, breast cancer also brings a huge disease burden to China. Ordinary people are increasingly inclined to use the Internet, especially video social platforms, as a source of health information. Educating the public to obtain correct information is important to reduce the incidence of breast cancer and improve the prognosis. However, the quality and reliability of breast cancer-related video content have not been fully studied.

Objective

This study aims to evaluate the quality of the information of breast cancer-related videos on TikTok and Bilibili video sharing platforms and factors related to video quality.

Methods

We collected the top 100 videos about breast cancer on TikTok and Bilibili, respectively. Categorize videos according to video source and video content. Video quality and reliability were assessed using Global Quality Score (GQS) and modified DISCERN (mDISCERN) tools. We also analyzed the correlation between video quality and video likes, comments, saves, and shares.

Results

Although the quality and reliability of Bilibili's breast cancer videos were higher than TikTok (p = 0.002 and p = 0.001, respectively), the video quality of both video sharing platforms was not satisfactory, with a median GQS scores of 2.00 and 3.00 and mDISCERN scores of 1.00 and 2.00, respectively. In general, the quality and reliability of videos released by medical practitioners were higher than those of non-medical practitioners, and the quality and reliability of videos covering disease-related knowledge were higher than those of news reports (all p < 0.001). Among medical practitioners, the quality of videos uploaded by doctors in breast disease was significantly lower than that of doctors in other areas (p < 0.05). There was a significant positive correlation between video quality and duration (r = 0.240, p < 0.001), a weak negative correlation between video quality and likes (r = 0.191, p < 0.01), video quality and comments (r = 0.256, p < 0.001), video reliability and likes (r = 0.198, p < 0.001), video reliability and comments (r = 0.243, p < 0.01).

Conclusion

Our study shows that the quality and reliability of breast cancer-related videos on TikTok and Bilibili are poor, and the overall quality is unsatisfactory. But videos uploaded by medical practitioners covering disease knowledge, prevention and treatment are of higher quality. Medical practitioners are encouraged to publish more high-quality videos, while video social platforms should formulate relevant policies to censor and supervise health education videos, so as to enable the public to obtain reliable health information.

The status quo of short videos as a health information source of Helicobacter pylori: a cross-sectional study

Background

Health education about Helicobacter pylori (H. pylori) is one of the most effective methods to prevent H. pylori infection and standardize H. pylori eradication treatment. Short videos enable people to absorb and remember information more easily and are an important source of health education. This study aimed to assess the information quality of H. pylori-related videos on Chinese short video-sharing platforms.

Methods

A total of 242 H. pylori-related videos from three Chinese short video-sharing platforms with the most users, TikTok, Bilibili, and Kwai, were retrieved. The Global Quality Score (GQS) and the modified DISCERN tool were used to assess the quality and content of videos, respectively. Additionally, comparative analyzes of videos based on different sources and common H. pylori issues were also conducted.

Results

The median GQS score and DISCERN score was 2 for H. pylori-related videos analyzed in this study. Non-gastroenterologists posted the most H. pylori-related videos (136/242, 56.2%). Videos from gastroenterologists (51/242, 21.0%) had the highest GQS and DISCERN scores, with a median of 3. Few videos had content on family-based H. pylori infection control and management (5.8%), whether all H. pylori-positive patients need to undergo eradication treatment (27.7%), and the adverse effects of H. pylori eradication therapy (16.1%).

Conclusion

Generally, the content and quality of the information in H. pylori-related videos were unsatisfactory, and the quality of the video correlated with the source of the video. Videos from gastroenterologists provided more correct guidance with higher-quality information on the prevention and treatment of H. pylori infection.

Education and Misinformation: Exploring Ophthalmology Content on TikTok

INTRODUCTION

With the continuous rise of social media usage, more patients are looking online for health-related information. TikTok is one of the fastest-growing video-based social media platforms, but the quality of its ophthalmologic content, at a comprehensive level, has not been previously analyzed. We aim to explore and characterize popular ophthalmology content on TikTok, including the presence of misinformation.

METHODS

Between April 16 and May 22, 2023, 37 different ophthalmology-relevant hashtags were queried on TikTok, and the top 20 most-liked videos per hashtag were analyzed. The quality of educational videos was graded on understandability and actionability using the Patient Education Materials Assessment Tool for Audiovisual Materials (PEMAT-A/V). Trends in creator identity, content type, engagement metrics, misinformation presence, and TikTok verification status were also assessed.

RESULTS

The 37 ophthalmology-related hashtags yielded 723 videos comprising 3.806 billion views. A minority of videos were created by ophthalmologists (16.9%) and eyecare providers (35.1%), while the majority were created by non-healthcare providers (55.0%). The most common types of videos identified were primarily related to personal experiences (35.8%) and education (38.0%). Amongst educational videos, mean PEMAT-A/V understandability and actionability scores were 88.1% and 50.6%, respectively. Misinformation was found in 5.4% of all videos, comprising 4.8% of all likes, 4.7% of all comments, and 11.7% of all bookmarks. Its presence was significantly correlated with content created by non-healthcare providers (p < 0.001) and received a disproportionately higher percentage of bookmarks.

CONCLUSIONS

This was the largest, most comprehensive evaluation of ophthalmologic content on TikTok. A significant portion of popular ophthalmologic content on TikTok is created by non-eyecare providers and contains misinformation. Our findings confirm the need for ophthalmologists to create more engaging, actionable, and factual educational content to combat misinformation adoption.

Quality and educational content of Douyin and TikTok short videos on early screening of rectal cancer

Background and Aim

The aim of this study was to assess the quality and content of videos on Douyin and TikTok for their educational role on early screening of rectal cancer (RC).

Methods

We conducted a search for videos related to RC on the Douyin and TikTok applications on 20 April 2023. The search was conducted in Chinese on Douyin and in English and Japanese on TikTok. A sample of the first 100 videos recommended by the software was selected for each language group. The content of the videos was evaluated using a content scorecard, while the quality of the videos was assessed using DISCERN. Subsequently, we conducted two partial correlations: one between the DISCERN score and the number of likes, and another between the video content score and the number of likes.

Results

This study encompassed a total of 89 Chinese, 54 English, and 51 Japanese videos. After selection, 78 Chinese, 38 English, and 25 Japanese videos were identified to contain content related to early screening for RC, prompting further quality assessment. Notably, videos in the Chinese language showed the highest DISCERN score (P < 0.05). In terms of partial correlation analysis, it was observed that both the content score and DISCERN score did not show a significant correlation with the number of likes (P > 0.05).

Conclusion

In terms of quality score and content score, the Chinese videos on Douyin show superiority over the English and Japanese videos on TikTok. However, there is potential for improving the overall appeal of the Chinese videos.

A Novel Approach: Evaluating ChatGPT's Utility for the Management of Thyroid Nodules

Background and objective Artificial intelligence (AI) applications such as Chat Generative Pre-Trained Transformer (ChatGPT) created by OpenAI, which represent the revolutionary aspects of today's technology, have benefitted professionals in many fields and society at large. In this study, we aimed to assess how effective is ChatGPT in helping both the patient and the physician manage thyroid nodules, a very common pathology. Methods Fifty-five questions frequently asked by patients were identified and asked to ChatGPT. Subsequently, three cases of thyroid nodules were progressively presented to ChatGPT. The answers to patient questions were scored for correctness and reliability by two endocrinologists. As for the cases, diagnostic and therapeutic approaches provided by ChatGPT were analyzed and scored by two endocrinologists for correctness, safety, and usability. The responses were evaluated by using 7-point Likert-type scales designed by us. Results The answers to patient questions were found to be mostly correct and reliable by both raters (Rater #1: 6.47 ± 0.50 and 6.27 ± 0.52; Rater #2: 6.18 ± 0.92 and 6.09 ± 0.96). Regarding the management of cases, ChatGPT's approach was found to be largely correct, safe, and usable by Rater #1, while Rater #2 evaluated the approaches as partially or mostly correct, safe, and usable. Conclusion Based on our findings, ChatGPT can be used as an informative and reliable resource for managing patients with thyroid nodules. While it is not suitable to be used as a primary resource for physicians, it has the potential to be a helpful and supportive tool.

"More than a song and dance": Exploration of patient perspectives and educational quality of gynecologic cancer content on TikTok

OBJECTIVE

To investigate themes, quality, and reliability of gynecologic cancer-related content on the social media application TikTok.

METHODS

TikTok was systematically searched for the 100 most popular posts for ovarian cancer (OC), endometrial cancer (EC), cervical cancer (CC), vulvar cancer (VC), and gestational trophoblastic disease (GTD) in August 2022. Data was collected for demographics, tone, and themes. Educational videos were rated for quality and reliability utilizing the modified DISCERN scale. Relationships between content demographics, disease sites, and themes were assessed.

RESULTS

As of August 2022, the top five hashtags for each gynecologic cancer on TikTok had 466.7 million views. 430 of the top 500 posts were eligible for inclusion (OC: n = 86, CC: n = 93, EC: n = 98, GTD: n = 63, VC: n = 90). The majority of creators (n = 323, 75.1%) were White, 33 (7.7%) were Black, 20 (4.6%) were Asian/Pacific Islander (API), 10 (2.3%) were South Asian, 20 (4.7%) were Hispanic/Latino/a, 24 (5.5%) were unable to determine. Eleven central themes were identified, with significant differences when analyzed by disease site and race. The median DISCERN score for all posts was 1.0, indicating poor educational quality and reliability. When compared by race, South Asian/API posters received the highest scores (3, IQR 2.5) versus Black (2: IQR 3), Hispanic/Latino/a (2: IQR 0), and White posters (1, IQR 2) (p = 0.0013).

CONCLUSION(S)

Gynecologic cancer-related content on TikTok is of poor educational quality, and racial disparities in gynecologic cancer extend to social media. Opportunities exist to create more diverse content to support racial and cultural experiences in gynecologic cancer treatment.

Quality and Reliability of Liver Cancer-Related Short Chinese Videos on TikTok and Bilibili: Cross-Sectional Content Analysis Study

BACKGROUND

Liver cancer incidence has been increasing in China in the recent years, leading to increased public concern regarding the burden of this disease. Short videos on liver cancer are disseminated through TikTok and Bilibili apps, which have gained popularity in recent years as an easily accessible source of health information. However, the credibility, quality, and usefulness of the information in these short videos and the professional knowledge of the individuals uploading health information-based videos in these platforms have not yet been evaluated.

OBJECTIVE

Our study aims to assess the quality of the information in Chinese short videos on liver cancer shared on the TikTok and Bilibili short video-sharing platforms.

METHODS

In March 2023, we assessed the top 100 Chinese short videos on liver cancer in TikTok and Bilibili (200 videos in total) for their information quality and reliability by using 2 rating tools, namely, global quality score (GQS) and the DISCERN instrument. Correlation and Poisson regression analyses were applied to discuss the factors that could impact video quality.

RESULTS

Compared to Bilibili, TikTok is more popular, although the length of the videos on TikTok is shorter than that of the videos on Bilibili (P<.001). The quality of the short videos on liver cancer in TikTok and Bilibili was not satisfactory, with median GQS of 3 (IQR 2-4) and 2 (IQR 1-5) and median DISCERN scores of 5 (IQR 4-6) and 4 (IQR 2-7), respectively. In general, the quality of videos sourced from professional institutions and individuals was better than that of those sourced from nonprofessionals, and videos involving disease-related knowledge were of better quality than those covering news and reports. No significant differences were found in the quality of videos uploaded by individuals from different professions, with the exception of those uploaded by traditional Chinese medicine professionals, which demonstrated poorer quality. Only video shares were positively correlated with the GQS (r=0.17, P=.01), and no video variables could predict the video quality.

CONCLUSIONS

Our study shows that the quality of short videos on health information related to liver cancer is poor on Bilibili and TikTok, but videos uploaded by health care professionals can be considered reliable in terms of comprehensiveness and content quality. Thus, short videos providing medical information on TikTok and Bilibili must be carefully considered for scientific soundness by active information seekers before they make decisions on their health care management.