Quality of Information for Post-Prostatectomy Incontinence Treatments on YouTube

Urological Cancers and ChatGPT: Assessing the Quality of Information and Possible Risks for Patients

INTRODUCTION

OpenAI has created ChatGPT, an artificial intelligence language model that has gained considerable recognition for its capacity to produce text responses resembling human language. Consequently, this study seeks to evaluate the effectiveness of ChatGPT's responses in addressing publicly accessible queries related to prostate, kidney, bladder, and testicular cancers.

MATERIAL AND METHODS

A comprehensive compilation of frequently asked questions (FAQs) pertaining to prostate, bladder, kidney, and testicular cancers was gathered from diverse sources. Additionally, the recommendations outlined in the European Association of Urology (EAU) 2023 Guideline Oncology were consulted. The chosen questions for evaluation were presented to the ChatGPT 4.0 premium version. The quality of ChatGPT responses was appraised using the global quality score (GQS). Each ChatGPT response was independently reviewed by a panel of physicians, who assigned a GQS score to assess its overall quality.

RESULTS

For prostate cancer, 64.6% of the questions had a GQS score of 5, compared to 62.9 % for bladder, 68.1% for kidney, and 63.9% for testicular cancers, whereas none of the responses had a GQS score of 1. Meanwhile, the category with the lowest proportion of responses, with a GQS score of 5 for each disease, was prognosis and follow-up. The mean GQS score of the answers given to EAU guideline questions was statistically significantly lower than the average score of the answers given to FAQs.

CONCLUSION

ChatGPT is a valuable tool for addressing general inquiries regarding urological cancers, boasting commendable accuracy rates. Nonetheless, its performance in responding to questions aligned with the EAU guideline was deemed unsatisfactory.

Comparison of Educational and Academic Quality of Laparoscopic Distal Pancreatectomy Videos on WebSurg® and YouTube® Platforms

BACKGROUND

The aim of this study was to compare the educational and academic quality of laparoscopic distal pancreatectomy (LDP) videos on YouTube® and WebSurg® platforms.

MATERIAL AND METHODS

YouTube and WebSurg platforms were searched with the keyword "laparoscopic distal pancreatectomy". According to the exclusion criteria, 12 videos were found on WebSurg. To ensure a 1:1 ratio, the first 12 videos that met the criteria on YouTube were also analyzed. Journal of American Medical Association (JAMA) benchmark criteria were used to evaluate the reliability of the videos. The non-educational quality of the videos was calculated using the Global Quality Score (GQS), the educational and academic quality of videos was calculated using Laparoscopic Distal Pancreatectomy-specific score (LDP-SS) and Laparoscopic Surgery Video Educational Guidelines scoring system (LAP-VEGaS).

RESULTS

The mean JAMA score was 1.58 on YouTube and 2.83 on WebSurg (P < .001). The median GQS was 2 on YouTube and 5 on WebSurg (P < .001). The median LAP-VEGaS score was 8 on YouTube and 14.5 on WebSurg (P < .001). The median LDP-SS score was 6 on YouTube and 9.5 on WebSurg (P = .001). According to the LAP-VEGaS, eleven (91.7%) of the WebSurg videos had a high score of 11 or more (P = .04). According to Spearman correlation analysis, there was a statistically significant positive correlation between LDP-SS and JAMA, GQS and LAP-VEGaS (r: .589, P = .002; r: .648, P = .001; r: .848, P < .001 respectively).

CONCLUSIONS

The WebSurg is superior to the YouTube in terms of educational and academic value, quality, accuracy, reliability and usability in scientific meetings for LDP videos.

Female urinary incontinence on TikTok and YouTube: is online video content sufficient?

INTRODUCTION AND HYPOTHESIS

The objective of the study is to evaluate the reliability and quality of the most-viewed female urinary incontinence-related TikTok and YouTube posts. Our second goal is to analyze the differences in the quality and content of videos between these platforms.

METHODS

We searched for the keyword "female urinary incontinence" on TikTok and YouTube on 1 March 2023. We sorted the videos that appeared out of searches for this keyword by "top" results on TikTok and by "relevance" on YouTube. We excluded the videos that were not in English, whose narrator was unclear, unrelated videos, advertising videos, and duplicate videos. In this study, we included the top 50 videos on both platforms that were directly related to female urinary incontinence. The characteristics of the videos, such as likes, video duration, views, and type of narrator (patient, physician, nonphysician practitioner, and health care company), and DISCERN scores were analyzed.

RESULTS

We observed that the median view count (p<0.001) and the median video duration (p<0.001) were higher and longer respectively on YouTube than on TikTok. In addition, the median DISCERN score of these videos was higher on YouTube than on TikTok (p<0.001). Similarly, the overall quality of videos was higher on YouTube than on TikTok (p=0.002). Only in two TikTok and two YouTube videos have the narrators cited a reference.

CONCLUSIONS

Our findings emphasize the present lack of high-quality content available on TikTok and YouTube from both health care and nonhealth care experts. To address this lack of information, health care providers, especially urologists, should take an active role in creating video content.