Evaluation of TikTok videos on acute pancreatitis: content quality and reliability analysis

BACKGROUND

Acute pancreatitis (AP) is a common acute digestive system disorder, with patients often turning to TikTok for AP-related information. However, the platform's video quality on AP has not been thoroughly investigated.

OBJECTIVE

The main purpose of this study is to evaluate the quality of videos about AP on TikTok, and the secondary purpose is to study the related factors of video quality.

METHODS

This study involved retrieving AP-related videos from TikTok, determining, and analyzing them based on predefined inclusion and exclusion criteria. Relevant data were extracted and compiled for evaluation. Video quality was scored using the DISCERN instrument and the Health on the Net (HONcode) score, complemented by introducing the Acute Pancreatitis Content Score (APCS). Pearson correlation analysis was used to assess the correlation between video quality scores and user engagement metrics such as likes, comments, favorites, retweets, and video duration.

RESULTS

A total of 111 TikTok videos were included for analysis, and video publishers were composed of physicians (89.18%), news media organizations (13.51%), individual users (5.41%), and medical institutions (0.9%). The majority of videos focused on AP-related educational content (64.87%), followed by physicians' diagnostic and treatment records (15.32%), and personal experiences (19.81%). The mean scores for DISCERN, HONcode, and APCS were 33.05 ± 7.87, 3.09 ± 0.93, and 1.86 ± 1.30, respectively. The highest video scores were those posted by physicians (35.17 ± 7.02 for DISCERN, 3.31 ± 0.56 for HONcode, and 1.94 ± 1.34 for APCS, respectively). According to the APCS, the main contents focused on etiology (n = 55, 49.5%) and clinical presentations (n = 36, 32.4%), followed by treatment (n = 24, 21.6%), severity (n = 20, 18.0%), prevention (n = 19, 17.1%), pathophysiology (n = 17, 15.3%), definitions (n = 13, 11.7%), examinations (n = 10, 9%), and other related content. There was no correlation between the scores of the three evaluation tools and the number of followers, likes, comments, favorites, and retweets of the video. However, DISCERN (r = 0.309) and APCS (r = 0.407) showed a significant positive correlation with video duration, while HONcode showed no correlation with the duration of the video.

CONCLUSIONS

The general quality of TikTok videos related to AP is poor; however, the content posted by medical professionals shows relatively higher quality, predominantly focusing on clinical presentations and etiologies. There is a discernible correlation between video duration and quality ratings, indicating that a combined approach incorporating the guideline can comprehensively evaluate AP-related content on TikTok.

[Evaluation of the GeSRU-Steps educational video concept (German Society of Residents in Urology e. V.)]

BACKGROUND

Surgical educational videos represent a contemporary, multimedia supplement to surgical education and training. The German Society of Residents in Urology e. V. (GeSRU) developed an educational video platform (steps.GeSRU.de) with free, quality-assured educational videos for urologists, especially for residents.

OBJECTIVES

The purpose of this study was to evaluate the GeSRU Steps teaching videos.

MATERIALS AND METHODS

Prospectively, 29 GeSRU Steps training videos were made available (03/2019-05/2023) via amboss.com, and an online questionnaire was inserted following the videos. This comprised 12 items on medical, technical, and didactic quality, usefulness for own knowledge acquisition, and sociodemographic data of respondents. Aspects of video quality were assessed with the Acceptability E‑scale and the Global Quality Score.

RESULTS

During the survey period, the GeSRU Steps videos implemented on the amboss.com website were viewed 49,698 times. A total of 474 questionnaires were answered (rate 0.25%). The collective of respondents consisted of 419 (88%) students, 47 (10%) physicians in training, and 5 (1%) specialists; 351 (74%) were female, 107 (23%) were male, and 4 (1%) were diverse. Each educational video was rated a median of 10 times (range 5-65). The six questions of the Acceptability E‑scale and the Global Quality Score were rated good and very good (81.6-95.8%), respectively.

CONCLUSIONS

GeSRU teaching videos achieved a very good rating with high user satisfaction. By specific promotion of these teaching videos, which are quality-assured through supervision, the portfolio of surgical videos available at a low threshold can be expanded and can serve as a contemporary education tool.