Is the information about orthodontics on Youtube and TikTok reliable for the oral health of the public? A cross sectional comparative study

Quality assessment of health science-related short videos on TikTok: A scoping review

OBJECTIVE

The aims of this review are to clarify the current state of research in terms of assessment tools and assessors of the quality of health science-related short videos on TikTok, to identify limitations in existing research; and to provide a reference for future studies.

METHODS

A scoping review was conducted. The Cochrane Library, PubMed, MEDLINE, Web of Science, Embase, Scopus, EBSCO, CNKI, VIP, Wanfang Data, and CBM databases were searched from September 2016 to November 2022. Manual searching was also performed to identify additional eligible studies. A total of 2620 documents were initially retrieved, and 29 were ultimately included. The literature was screened and collected, and data were extracted and summarized by 2 researchers.

RESULTS

(1) The quality evaluation tools used in the 29 papers included the DISCERN, PEMAT(A/V), GQS, JAMA, HONcode, guidelines and self-developed tools. Twenty-four of the included articles used the DISCERN for quality assessment, which was the most frequently used evaluation tool. However, most of these tools were not developed to assess health science-related short videos, lacked credibility tests, and had poor applicability; therefore, the accuracy of the evaluation results might be biased. (2) The assessors of the quality of health science-related short videos on TikTok were mainly experts in related fields and medical students, with doctors (12/14) being the most common evaluators. Fifteen studies did not report the identity of the evaluators, and 12 studies did not report interrater reliability.

CONCLUSION

This scoping review found that there is a lack of specific quality assessment tools for health science-related short videos on TikTok. Second, the current quality assessors of health science-related short videos on TikTok are limited. Future research should focus on the development of reliable, scientific quality assessment tools for health science-related short videos; unifying the evaluation standards; inviting users with different backgrounds and different health literacy levels to conduct quality assessments; exploring the quality assessment of health science-related short videos on TikTok from different perspectives.

Assessment of the reliability and quality of breast cancer related videos on TikTok and Bilibili: cross-sectional study in China

Background

As the most common malignant tumor in the world, breast cancer also brings a huge disease burden to China. Ordinary people are increasingly inclined to use the Internet, especially video social platforms, as a source of health information. Educating the public to obtain correct information is important to reduce the incidence of breast cancer and improve the prognosis. However, the quality and reliability of breast cancer-related video content have not been fully studied.

Objective

This study aims to evaluate the quality of the information of breast cancer-related videos on TikTok and Bilibili video sharing platforms and factors related to video quality.

Methods

We collected the top 100 videos about breast cancer on TikTok and Bilibili, respectively. Categorize videos according to video source and video content. Video quality and reliability were assessed using Global Quality Score (GQS) and modified DISCERN (mDISCERN) tools. We also analyzed the correlation between video quality and video likes, comments, saves, and shares.

Results

Although the quality and reliability of Bilibili's breast cancer videos were higher than TikTok (p = 0.002 and p = 0.001, respectively), the video quality of both video sharing platforms was not satisfactory, with a median GQS scores of 2.00 and 3.00 and mDISCERN scores of 1.00 and 2.00, respectively. In general, the quality and reliability of videos released by medical practitioners were higher than those of non-medical practitioners, and the quality and reliability of videos covering disease-related knowledge were higher than those of news reports (all p < 0.001). Among medical practitioners, the quality of videos uploaded by doctors in breast disease was significantly lower than that of doctors in other areas (p < 0.05). There was a significant positive correlation between video quality and duration (r = 0.240, p < 0.001), a weak negative correlation between video quality and likes (r = 0.191, p < 0.01), video quality and comments (r = 0.256, p < 0.001), video reliability and likes (r = 0.198, p < 0.001), video reliability and comments (r = 0.243, p < 0.01).

Conclusion

Our study shows that the quality and reliability of breast cancer-related videos on TikTok and Bilibili are poor, and the overall quality is unsatisfactory. But videos uploaded by medical practitioners covering disease knowledge, prevention and treatment are of higher quality. Medical practitioners are encouraged to publish more high-quality videos, while video social platforms should formulate relevant policies to censor and supervise health education videos, so as to enable the public to obtain reliable health information.

How much information regarding gingival enlargement can we get from TikTok and YouTube?

AIMS

This study aimed to evaluate and compare the reliability and quality of the information about gingival enlargements on YouTube and TikTok.

METHODS

Two popular video sites, YouTube and TikTok, were searched for gingival enlargement and gingival hyperplasia. The reliability and quality of the first 300 videos for each search term, which is 1200 videos in total, were evaluated by social media video content evaluation tools: Global Quality Score (GQS) for quality and modified DISCERN for reliability.

RESULTS

Health professionals uploaded 68.6% of the videos on YouTube and 54.5% on TikTok. It was observed that 50% of TikTok videos and 65.9% of YouTube videos were educational. In terms of quality, 2.7% of the videos on YouTube are of excellent quality, while in TikTok there are no videos of perfect quality. TikTok videos had considerably more views, likes, viewing rates, and interaction index scores than YouTube videos (P < 0.01).

CONCLUSIONS

The videos and pieces of information on YouTube are more reliable and accurate in terms of gingival enlargement when compared to TikTok. Nevertheless, it was discovered that videos on both platforms were of poor reliability and quality in general.

Content Quality of Web-Based Short-Form Videos for Fire and Burn Prevention in China: Content Analysis

BACKGROUND

Web-based short-form videos are increasingly popular for disseminating fire and burn prevention information, but their content quality is unknown.

OBJECTIVE

We aimed to systematically assess the characteristics, content quality, and public impact of web-based short-form videos offering primary and secondary (first aid) prevention recommendations for fires and burns in China between 2018 and 2021.

METHODS

We retrieved short-form videos offering both primary and secondary (first aid) information to prevent fire and burn injuries published on the 3 most popular web-based short-form video platforms in China: TikTok, Kwai, and Bilibili. To assess video content quality, we calculated the proportion of short-form videos that included information on each of the 15 recommendations for burn prevention education from the World Health Organization (WHO; P1) and that correctly disseminated each recommendation (P2). High P1 and P2 indicated better content quality. To assess their public impact, we calculated the median (IQR) of 3 indicators: the number of comments, likes, and saves as a favorite by viewers. Chi-square test, trend chi-square test, and Kruskal-Wallis H test examined differences in indicators across the 3 platforms, years, content, and time duration of videos and between videos disseminating correct versus incorrect information.

RESULTS

Overall, 1459 eligible short-form videos were included. The number of short-form videos increased by 16 times between 2018 and 2021. Of them, 93.97% (n=1371) were about secondary prevention (first aid) and 86.02% (n=1255) lasted <2 minutes. The proportion of short-form videos including each of the 15 WHO recommendations ranged from 0% to 77.86% (n=1136). Recommendations 8, 13, and 11 had the highest proportions (n=1136, 77.86%; n=827, 56.68%; and n=801, 54.9%, respectively), whereas recommendations 3 and 5 were never mentioned. Among the short-form videos that included the WHO recommendations, recommendations 1, 2, 4, 6, 9, and 12 were always disseminated correctly, but the other 9 recommendations were correctly disseminated in 59.11% (120/203) to 98.68% (1121/1136) of videos. The proportion of short-form videos including and correctly disseminating the WHO recommendations varied across platforms and years. The public impact of short videos varied greatly across videos, with a median (IQR) of 5 (0-34) comments, 62 (7-841) likes, and 4 (0-27) saves as a favorite. Short-form videos disseminating correct recommendations had larger public impact than those disseminating either partially correct or incorrect knowledge (median 5 vs 4 comments, 68 vs 51 likes, and 5 vs 3 saves as a favorite, respectively; all P<.05).

CONCLUSIONS

Despite the rapid increase in the number of web-based short-form videos about fire and burn prevention available in China, their content quality and public impact were generally low. Systematic efforts are recommended to improve the content quality and public impact of short-form videos on injury prevention topics such as fire and burn prevention.

What do TikTok videos offer us about dental implants treatment?

OBJECTIVE

To evaluate the quality, source, popularity, visibility and reliability of Tiktok videos on dental implants.

MATERIALS AND METHODS

A Tiktok search for dental implants was performed English language setting. Search hashtags were determined as "#dentalimplants," "#dentalimplantsurgery," "#dentalimplantstreatment," and "#implantdentistry." 148 of the 300 videos watched were included the study. Two periodontologists scored the videos for quality, reliability, utility, visibility and popularity. Videos' quality was evaluated using the Global Quality Scale (GQS) and the DISCERN tools, by categorizing them through quality of communication, duration, likes and dislikes, views, source and video type of each video were recorded.

RESULTS

There was significant positive correlation between "GQS" and "Total DISCERN" (Rho: 0.636) and "Duration in seconds" (Rho: 0.343) (p<0.05). For Total DISCERN, averages of the 31-45 seconds (p=0.010) and 46 seconds and above (p=.018) groups were higher than the averages of the 0-15 seconds group and average of the Educational group was higher than the average of the Testimonial, Product Advertisement and Entertainment groups (p=0.001, p=0.033 and p=0.041). Healthcare professionals mostly upload GQS 2 score videos and Hospital/Universities mostly upload GQS 2 and 3 score videos (p<0.05). Testimonial videos mostly receive GQS2 score videos and the 'Videos rich in supplementary visuals' quality also receives the most GQS4 score videos (p<0.05).

CONCLUSIONS

The results of this study demonstrate that TikTok videos provide low to moderate quality information about dental implants and that TikTok may not provide reliable information about dental implants.

Orthodontics in an online community: A computational analysis of r/Braces subreddit

BACKROUND

This study aimed to analyze the semantic network and content analyses of the posts published in a subreddit related to orthodontic treatment on Reddit (Advance Publications, Inc., San Francisco, California).

METHODS

The eight threads in the r/Braces subreddit were divided into two categories: 1) "treatment process" (Braces are off!!!, Braces progress, Before and after!, and Day 1!) and 2) "question/problem" (Question, Discussion!, Need advice! and Rant!). For both categories, a semantic network analysis was performed using the Leximancer software (Leximancer Pty Ltd., Brisbane, Australia). In addition, the quality of the posts published in the "question" thread and the usefulness of the replies provided to these questions (useful, misleading, or neutral) were analyzed.

RESULTS

Seven themes (braces, teeth, months, day, worth, started, and result) that mostly emphasized orthodontic treatment and treatment duration were elicited from the "treatment process" category, and seven themes (teeth, orthodontist, braces, week, bands, brush, and extractions) that mostly emphasized orthodontic treatment, orthodontists, and time were elicited from the "question/problem" category. It was also revealed that users voted on the posts related to the "treatment process" category and moved the posts to the list of top posts on the platform. In the "question" thread, 47.79% of the posts asked for advice and 21.11% of them were related to failures. In addition, 69% of the replies were categorized as "useful."

CONCLUSIONS

Reddit is a successful data mining platform, and the users provide highly useful replies to the questions posted on Reddit regarding orthodontic treatment.