TikTok and YouTube as sources of information on anal fissure: A comparative analysis

Douyin and Bilibili as sources of information on lung cancer in China through assessment and analysis of the content and quality

Lung cancer has emerged as a major global public health concern. With growing public interest in lung cancer, online searches for related information have surged. However, a comprehensive evaluation of the credibility, quality, and value of lung cancer-related videos on digital media platforms remains unexamined. This study aimed to assess the informational quality and content of lung cancer-related videos on Douyin and Bilibili. A total of 200 lung cancer-related videos that met the criteria were selected from Douyin and Bilibili for evaluation and analysis. The first step involved recording and analyzing the basic information provided in the videos. Subsequently, the source and type of content for each video were identified. All videos' educational content and quality were then evaluated using JAMA, GQS, and Modified DISCERN. Douyin videos were found to be more popular in terms of likes, comments, favorites, and shares, whereas Bilibili videos were longer in duration (P < .001). The majority of video content on both platforms comprised lung cancer introductions (31/100, 31%), with medical professionals being the primary source of uploaded videos (Douyin, n = 55, 55%; Bilibili, n = 43, 43%). General users on Douyin scored the lowest on the JAMA scale, whereas for-profit businesses scored the highest (2.50 points). The results indicated that the videos' informational quality was insufficient. Videos from science communications and health professionals were deemed more reliable regarding completeness and content quality compared to videos from other sources. The public should exercise caution and consider the scientific validity when seeking healthcare information on short video platforms.

The Quality of Short Videos as a Source of Coronary Heart Disease Information on TikTok: Cross-Sectional Study

BACKGROUND

Coronary heart disease (CHD) is a leading cause of death worldwide and imposes a significant economic burden. TikTok has risen as a favored platform within the social media sphere for disseminating CHD-related information and stands as a pivotal resource for patients seeking knowledge about CHD. However, the quality of such content on TikTok remains largely unexplored.

OBJECTIVE

This study aims to assess the quality of information conveyed in TikTok CHD-related videos.

METHODS

A comprehensive cross-sectional study was undertaken on TikTok videos related to CHD. The sources of the videos were identified and analyzed. The comprehensiveness of content was assessed through 6 questions addressing the definition, signs and symptoms, risk factors, evaluation, management, and outcomes. The quality of the videos was assessed using 3 standardized evaluative instruments: DISCERN, the Journal of the American Medical Association (JAMA) benchmarks, and the Global Quality Scale (GQS). Furthermore, correlative analyses between video quality and characteristics of the uploaders and the videos themselves were conducted.

RESULTS

The search yielded 145 CHD-related videos from TikTok, predominantly uploaded by health professionals (n=128, 88.3%), followed by news agencies (n=6, 4.1%), nonprofit organizations (n=10, 6.9%), and for-profit organizations (n=1, 0.7%). Content comprehensiveness achieved a median score of 3 (IQR 2-4). Median values for the DISCERN, JAMA, and GQS evaluations across all videos stood at 27 (IQR 24-32), 2 (IQR 2-2), and 2 (IQR 2-3), respectively. Videos from health professionals and nonprofit organizations attained significantly superior JAMA scores in comparison to those of news agencies (P<.001 and P=.02, respectively), whereas GQS scores for videos from health professionals were also notably higher than those from news agencies (P=.048). Within health professionals, cardiologists demonstrated discernibly enhanced performance over noncardiologists in both DISCERN and GQS assessments (P=.02). Correlative analyses unveiled positive correlations between video quality and uploader metrics, encompassing the positive correlations between the number of followers; total likes; average likes per video; and established quality indices such as DISCERN, JAMA, or GQS scores. Similar investigations relating to video attributes showed correlations between user engagement factors-likes, comments, collections, shares-and the aforementioned quality indicators. In contrast, a negative correlation emerged between the number of days since upload and quality indices, while a longer video duration corresponded positively with higher DISCERN and GQS scores.

CONCLUSIONS

The quality of the videos was generally poor, with significant disparities based on source category. The content comprehensiveness coverage proved insufficient, casting doubts on the reliability and quality of the information relayed through these videos. Among health professionals, video contributions from cardiologists exhibited superior quality compared to noncardiologists. As TikTok's role in health information dissemination expands, ensuring accurate and reliable content is crucial to better meet patients' needs for CHD information that conventional health education fails to fulfill.

YouTube/ Bilibili/ TikTok videos as sources of medical information on laryngeal carcinoma: cross-sectional content analysis study

BACKGROUND

YouTube, a widely recognized global video platform, is inaccessible in China, whereas Bilibili and TikTok are popular platforms for long and short videos, respectively. There are many videos related to laryngeal carcinoma on these platforms. This study aims to identify upload sources, contents, and feature information of these videos on YouTube, Bilibili, and TikTok, and further evaluate the video quality.

METHODS

On January 1, 2024, we searched the top 100 videos by default sort order (300 videos in total) with the terms "laryngeal carcinoma" and "throat cancer" on YouTube, "" on Bilibili and TikTok. Videos were screened for relevance and similarity. Video characteristics were documented, and quality was assessed by using the Patient Education Materials Assessment Tool (PEMAT), Video Information and Quality Index (VIQI), Global Quality Score (GQS), and modified DISCERN (mDISCERN).

RESULTS

The analysis included 99 YouTube videos, 76 from Bilibili, and 73 from TikTok. Median video lengths were 193 s (YouTube), 136 s (Bilibili), and 42 s (TikTok). TikTok videos demonstrated higher audience interaction. Bilibili had the lowest ratio of original contents (69.7%). Treatment was the most popular topic on YouTube and Bilibili, while that was the prognosis on TikTok. Solo narration was the most common video style across all platforms. Video uploaders were predominantly non-profit organizations (YouTube), self-media (Bilibili), and doctors (TikTok), with TikTok authors having the highest certification rate (83.3%). Video quality, assessed using PEMAT, VIQI, GQS, and mDISCERN, varied across platforms, with YouTube generally showing the highest scores. Videos from professional authors performed better than videos from non-professionals based on the GQS and mDISCERN scores. Spearman correlation analysis showed no strong relationships between the video quality and the audience interaction.

CONCLUSIONS

Videos on social media platforms can help the public learn about the knowledge of laryngeal cancer to some extent. TikTok achieves the best flow, but videos on YouTube are of the best quality. However, the video quality across all platforms still needs enhancement. We need more professional uploaders to ameliorate the video quality related to laryngeal carcinoma. Content creators also should be aware of the certification, the originality, and the style of video shooting. As for the platforms, refining the algorithm will allow users to receive more high-quality videos.

Health information in short videos about metabolic dysfunction-associated steatotic liver disease: Analysing quality and reliability

BACKGROUND & AIMS

Short videos, crucial for disseminating health information on metabolic dysfunction-associated steatotic liver disease (MASLD), lack a clear evaluation of quality and reliability. This study aimed to assess the quality and reliability of MASLD-related videos on Chinese platforms.

METHODS

Video samples were collected from three platforms (TikTok, Kwai and Bilibili) during the period from November 2019 to July 2023. Two independent reviewers evaluated the integrity of the information contained therein by scoring six key aspects of its content: definition, epidemiology, risk factors, outcomes, diagnosis and treatment. The quality and reliability of the videos were assessed using the Journal of the American Medical Association (JAMA) criteria, the Global Quality Score (GQS) and the modified DISCERN score.

RESULTS

A total of 198 videos were included. The video content exhibited an overall unsatisfactory quality, with a primary emphasis on risk factors and treatment, while diagnosis and epidemiology were seldom addressed. Regarding the sources of the videos, the GQS and modified DISCERN scores varied significantly between the platforms (p = .003), although they had generally similar JAMA scores (p = .251). Videos created by medical professionals differed significantly in terms of JAMA scores (p = .046) compared to those created by nonmedical professionals, but there were no statistically significant differences in GQS (p = .923) or modified DISCERN scores (p = .317).

CONCLUSIONS

The overall quality and reliability of the videos were poor and varied between platforms and uploaders. Platforms and healthcare professionals should strive to provide more reliable health-related information regarding MASLD.

Evaluation of TikTok videos on acute pancreatitis: content quality and reliability analysis

BACKGROUND

Acute pancreatitis (AP) is a common acute digestive system disorder, with patients often turning to TikTok for AP-related information. However, the platform's video quality on AP has not been thoroughly investigated.

OBJECTIVE

The main purpose of this study is to evaluate the quality of videos about AP on TikTok, and the secondary purpose is to study the related factors of video quality.

METHODS

This study involved retrieving AP-related videos from TikTok, determining, and analyzing them based on predefined inclusion and exclusion criteria. Relevant data were extracted and compiled for evaluation. Video quality was scored using the DISCERN instrument and the Health on the Net (HONcode) score, complemented by introducing the Acute Pancreatitis Content Score (APCS). Pearson correlation analysis was used to assess the correlation between video quality scores and user engagement metrics such as likes, comments, favorites, retweets, and video duration.

RESULTS

A total of 111 TikTok videos were included for analysis, and video publishers were composed of physicians (89.18%), news media organizations (13.51%), individual users (5.41%), and medical institutions (0.9%). The majority of videos focused on AP-related educational content (64.87%), followed by physicians' diagnostic and treatment records (15.32%), and personal experiences (19.81%). The mean scores for DISCERN, HONcode, and APCS were 33.05 ± 7.87, 3.09 ± 0.93, and 1.86 ± 1.30, respectively. The highest video scores were those posted by physicians (35.17 ± 7.02 for DISCERN, 3.31 ± 0.56 for HONcode, and 1.94 ± 1.34 for APCS, respectively). According to the APCS, the main contents focused on etiology (n = 55, 49.5%) and clinical presentations (n = 36, 32.4%), followed by treatment (n = 24, 21.6%), severity (n = 20, 18.0%), prevention (n = 19, 17.1%), pathophysiology (n = 17, 15.3%), definitions (n = 13, 11.7%), examinations (n = 10, 9%), and other related content. There was no correlation between the scores of the three evaluation tools and the number of followers, likes, comments, favorites, and retweets of the video. However, DISCERN (r = 0.309) and APCS (r = 0.407) showed a significant positive correlation with video duration, while HONcode showed no correlation with the duration of the video.

CONCLUSIONS

The general quality of TikTok videos related to AP is poor; however, the content posted by medical professionals shows relatively higher quality, predominantly focusing on clinical presentations and etiologies. There is a discernible correlation between video duration and quality ratings, indicating that a combined approach incorporating the guideline can comprehensively evaluate AP-related content on TikTok.

Current Quality of Videos on Colorectal Cancer Screening for General Public

BACKGROUND

One-third of American adults encompassed by current colorectal cancer screening guidelines fail to obtain recommended screening evaluations. Educational videos are a valuable medium through which to educate and encourage recommended health behaviors in patients.

METHODS

A cross-sectional study reviewing the quality of patient education videos addressing colorectal cancer screening. Video quality was assessed in 3 domains: accountability, content, and production.

RESULTS

Forty-four videos met inclusion criteria. Out of 33 possible points, videos scored a median of 15.0 (interquartile range 12.9-16.6). Videos scored 1.0 (interquartile range .8-1.0) out of 4.0 for accountability, 6.0 (interquartile range 4.4-8.0) out of 20 for content, and 8.0 (interquartile range 7.4-8.0) out of 9.0 for production. Colonoscopy was the most frequently discussed method of screening (38, 86%). While 13 (34%) videos discussed the risk of colorectal cancer in the general population and 15 (32%) discussed the risk in those with a family history, few videos addressed those with other risk factors. Most (31, 70%) videos discussed the medical consequences of not receiving screening, but only 1 (2%) video discussed the social consequences. Similarly, medical benefits were discussed in 34 (77%) videos while other benefits were not discussed by any video. Only one-fifth of the videos address three or more barriers to screening.

CONCLUSIONS

Videos on colorectal cancer screening have excellent production quality but need improvement in the domains of accountability and content. The videos included in this analysis did not adequately address the concerns of viewers nor the benefits of colorectal cancer screening.

Evaluating the understandability and actionability of online CKD educational materials

BACKGROUND

Previous studies have not fully determined whether online education materials on chronic kidney disease (CKD) for Japanese patients are easy to understand and help change their behavior. Therefore, this study quantitatively assessed the understandability and actionability of online CKD education materials.

METHODS

In September 2021, we searched Google and Yahoo Japan using the keywords "kidney," "kidney disease," "CKD," "chronic kidney disease," and "renal failure" to identify 538 webpages. We used the Japanese version of the Patient Education Materials Assessment Tool (PEMAT), ranging from 0 to 100%, to evaluate the understandability and actionability of webpages. We set the cutoff point to 70%.

RESULTS

Of the 186 materials included, the overall understandability and actionability were 61.5% (± 16.3%) and 38.7% (± 30.6%), respectively. The materials were highly technical in their terminology and lacked clear and concise charts and illustrations to encourage action. Compared to lifestyle modification materials on CKD overview, symptoms/signs, examination, and treatment scored significantly lower on the PEMAT. In addition, the materials produced by medical institutions and academic organizations scored significantly lower than those produced by for-profit companies.

CONCLUSION

Medical institutions and academic organizations are encouraged to use plain language and to attach explanations of medical terms when preparing materials for patients. They are also expected to improve visual aids to promote healthy behaviors.

TikTok video as a health education source of information on heart failure in China: a content analysis

Background

Heart failure (HF) is a complex and life-threatening syndrome associated with significant morbidity and mortality. While TikTok has gained popularity as a social media platform for sharing HF-related information, the quality of such content on TikTok remains unexplored.

Methods

A cross-sectional analysis was conducted on TikTok videos related to HF in China. The sources of the videos were identified and analyzed. The content comprehensiveness of the videos was evaluated using six questions that covered definition, signs and symptoms, risk factors, evaluation, management, and outcomes. The reliability and quality of the videos were assessed using three standardized evaluation instruments: DISCERN, JAMA benchmarks, and the Global Quality Scale. Additionally, the correlation between video quality and video characteristics was further investigated.

Results

Among the video sources, 92.2% were attributed to health professionals, while news agencies and non-profit organizations accounted for 5.7% and 2.1%, respectively. The content comprehensiveness score for the videos was 3.36 (SD 3.56), with news agencies receiving the highest scores of 4.06 (SD 3.31). The median DISCERN, JAMA, and GQS scores for all 141 videos were 26.50 (IQR 25.00-28.750), 2.00 (IQR 2.00-2.00), and 2.00 (IQR 2.00-2.00), respectively. Videos from health professionals had significantly higher JAMA scores compared to those from non-profit organizations (P < 0.01). Correlation analysis between video quality and video characteristics showed positive correlations between content comprehensiveness scores and video duration (r = 0.420, P < 0.001), number of comments (r = 0.195, P < 0.05), and number of shares (r = 0.174, P < 0.05). GQS scores were negatively or positively correlated with the number of days since upload (r = -0.212, P < 0.05) and video duration (r = 0.442, P < 0.001).

Conclusion

The overall quality of the videos was found to be unsatisfactory, with variations in quality scores observed across different video sources. Content comprehensiveness was inadequate, the reliability and quality of the information presented in the videos was questionable. As TikTok continues to grow as a platform for health information, it is essential to prioritize accuracy and reliability to enhance patients' self-care abilities and promote public health.

Quality and educational content of Douyin and TikTok short videos on early screening of rectal cancer

Background and Aim

The aim of this study was to assess the quality and content of videos on Douyin and TikTok for their educational role on early screening of rectal cancer (RC).

Methods

We conducted a search for videos related to RC on the Douyin and TikTok applications on 20 April 2023. The search was conducted in Chinese on Douyin and in English and Japanese on TikTok. A sample of the first 100 videos recommended by the software was selected for each language group. The content of the videos was evaluated using a content scorecard, while the quality of the videos was assessed using DISCERN. Subsequently, we conducted two partial correlations: one between the DISCERN score and the number of likes, and another between the video content score and the number of likes.

Results

This study encompassed a total of 89 Chinese, 54 English, and 51 Japanese videos. After selection, 78 Chinese, 38 English, and 25 Japanese videos were identified to contain content related to early screening for RC, prompting further quality assessment. Notably, videos in the Chinese language showed the highest DISCERN score (P < 0.05). In terms of partial correlation analysis, it was observed that both the content score and DISCERN score did not show a significant correlation with the number of likes (P > 0.05).

Conclusion

In terms of quality score and content score, the Chinese videos on Douyin show superiority over the English and Japanese videos on TikTok. However, there is potential for improving the overall appeal of the Chinese videos.

#implantology: A content analysis of the implant-related hashtags on Instagram

STATEMENT OF PROBLEM

Social media platforms such as Instagram have recently become popular among dentists, dental interest groups, and patients for sharing dental-related information. However, a study that dissects and analyzes implant-related posts on Instagram is lacking.

PURPOSE

The purpose of this study was to analyze the type of implant-related information on Instagram by highlighting the characteristics of the top-performing posts and assessing their usefulness as educational content.

MATERIAL AND METHODS

A list of 12 implantology-related hashtags on Instagram was searched, and, for each hashtag, data were acquired for the "Top 12 posts" listed by the Instagram search algorithm. The contents of each post, including the number of likes and followers, content type, poster role, post content, theme and type, account type, and accuracy of claims, were collected. Descriptive statistics were calculated, and comparisons were performed by using the Mann-Whitney U and Kruskal Wallis tests (α=.05).

RESULTS

The search identified 4 541 867 implant-related posts. The 2 most used hashtags were #dentalimplants (n=1 478 770) and #implant (n=1 303 575). Authorship and content analysis showed that dentists, including specialists, posted about 42% of the posts. More than half of the posts were in the form of pictures (62.5%), self-promotional (77.8%), and used for marketing purposes (61.8%). Most posts were not supported by evidence, and only 27.8% shared clinical facts. However, compared with self-promotional posts, most educational posts shared clinical facts with more likes, views, and followers (P<.001).

CONCLUSIONS

More than 4 million posts related to implant dentistry were identified on Instagram. Dental interest groups and patients authored most posts, with less contribution from dentists and specialists. Social media awareness among dentists may enhance the number of educational posts and provide a novel platform for networking and communication.

Evaluating the understandability and actionability of online educational videos on pre-dialysis chronic kidney disease

AIM

It remains undetermined whether online education videos for Japanese patients with chronic kidney disease (CKD) are easy to understand and allow adoption of behavioural changes. This study quantitatively assessed the understandability and applicability of online education videos for patients with CKD.

METHODS

In September 2021, we identified 200 videos on YouTube using the Japanese translations of the keywords 'kidney,' 'kidney disease,' 'CKD,' and 'chronic kidney disease.' We used the Japanese version of the Patient Education Materials Assessment Tool to evaluate the understandability and usability of webpages on a scale of 0% to 100%. The cut-off was set at 70%.

RESULTS

A total of 54 videos were evaluated. The overall understandability and actionability of the materials were 57.6 (SD = 22.6) and 53.7 (SD = 33.4), respectively. Approximately 70% and 60% of the materials were considered insufficiently understandable and actionable, respectively. Most videos lacked a summary and had difficulty in using only everyday language. Most videos included at least one action for the audience to take. However, many failed to break down the action into sequential steps. They also lack visual aids to encourage the audience to take action.

CONCLUSION

Our results suggest that current information on pre-dialysis chronic kidney disease was not presented in a manner that can be applied by laypeople.

TikTok as an Educational Tool for Kidney Stone Prevention

INTRODUCTION

The incidence of kidney stones in the United States continues to increase. Although dietary interventions have shown to be effective in reducing stone events, adherence to medical management continues to be a limiting factor. For that reason, patient education has become a focus of many physicians. TikTok, a social media application with over one billion users worldwide, has emerged as an online center for medical knowledge sharing by physicians and non-physicians alike. TikTok users share kidney stone prevention information through short informational videos directly to the general public. Little is known regarding the quality of medical advice provided in these videos. The purpose of this study was to evaluate the reach and quality of kidney stone prevention information on TikTok.

METHODS

We conducted a cross-sectional analysis of renal stone prevention content on TikTok utilizing the search term #kidneystoneprevention to assess all the videos appearing on October 10th, 2022. Only videos in English, related to the topic, and with >1000 views were included. Videos were analyzed for descriptive statistics, including views, uploader profession, and stone prevention recommendations. Videos were assessed utilizing Denver International Study Center of Evaluative Rating of Information (DISCERN), a questionnaire used to appraise the quality of consumer health information (maximum score of 80 per video). The one-way analysis of variance (ANOVA) was used to determine statistical significance groups.

RESULTS

Out of a total of 131 videos, 87 fit the inclusion criteria, resulting in a total of 8.75 million views. An average DISCERN score of 27.0 was observed. Only eight videos were published by physicians, of which the average DISCERN score of 35.3 was significantly greater than an average score of 26.2 for non-physicians (p<0.05). The most common recommendation was increased fluid intake (38.0%) followed by monitoring calcium levels (9.02%) and decreasing oxalate-rich foods (9.2%).

CONCLUSIONS

Kidney stone prevention content on TikTok has a wide reach with millions of consumers. The majority of videos fail to match American Urological Association recommendations regarding diet therapies for stone prevention. Further research is needed to understand the extent of kidney stone prevention misinformation on social media and how it contributes to patient outcomes. Increased engagement in TikTok by urologists and health organizations may improve public education.

Evaluating understandability and actionability of online education materials for home-care patients with COVID-19 in Japan

OBJECTIVE

In Japan, educational materials on the home care of coronavirus disease 2019 (COVID-19) were developed owing to limited access to medical care during the pandemic. This study quantitatively evaluated the understandability, actionability, natural flow, and readability of 87 materials published by local governments in Japan for patients with COVID-19. Their understandability and actionability were rated using the Japanese version of the Patient Education Material Evaluation Tool for Printed Materials (PEMAT-P). Natural flow and readability were rated using Global Quality Score (GQS) and jReadability, respectively.

RESULTS

Of the 87 materials, 55 (62.1%) were understandable and 33 (37.9%) were actionable according to the PEMAT-P. Regarding understandability, the materials used medical terms without providing definitions and lacked summaries. Regarding actionability, the materials did not demonstrate explicit steps or utilize visual aids to help the readers take action. The mean (SD) of GQS was 3.44 (0.98), indicating a moderate level of naturalness and comprehensiveness of the materials. The mean (SD) score for readability was 2.4 (0.6), indicating a "lower advanced" level. However, challenges regarding the materials' plain language remained, such as defining medical terms, summarizing the content for understandability, and using charts and tables that encourage patients to act.

Psychometric Testing of the Turkish Version of the Patient Education Materials Assessment Tool

AIM

The aim of this study was to test the psychometric properties of the Turkish version of the Patient Education Materials Assessment Tool METHODS: The study was carried out with intern nurses receiving education at a Nursing Faculty in Turkey between July 2019 and June 2020. 248 intern nurses participated in PEMAT-P and 223 in PEMAT-A/V in this study. Five audio-visual and five printed materials were used. The Patient Education Materials Assessment Tool and the Patient Education Materials Assessment Tool User's Guide were translated into Turkish and culturally adapted using standard guidelines. Content and construct validity analyses were performed for the validity of the Turkish version of the Patient Education Materials Assessment Tool, and internal consistency, invariability, and external consistency analyses were performed for its reliability.

RESULTS

The content validity index was 1.00 for all the scale items. At the conclusion of the factor analyses, the scale has composed a twodimension construct of understandability and actionability. The Cronbach's alpha coefficients were observed to be 0.901 of the Turkish version of the Patient Education Materials Assessment Tool for Printable Materials and 0.897 of the Turkish version of the Patient Education Materials Assessment Tool for Audiovisual Materials. The Pearson Product-Moment Correlation Coefficient (rxy) was high (Turkish version of the Patient Education Materials Assessment Tool for Printable Materials rxy=0.815, Turkish version of the Patient Education Materials Assessment Tool for Audiovisual Materials rxy=0.804). Cohen's kappa coefficients were obtained as 0.736 of the Turkish version of the Patient Education Materials Assessment Tool for Printable Materials and 0.781 of the Turkish version of the Patient Education Materials Assessment Tool for Audiovisual Materials.

CONCLUSION

The Turkish version of the Patient Education Materials Assessment Tool is a valid and reliable measurement tool in the evaluation of both printed and audiovisual patient education materials.