Assessing Vasectomy-Related Information on YouTube: An Analysis of the Quality, Understandability, and Actionability of Information

Size matters: characterizing penile augmentation content from the 100 most popular YouTube videos

Aesthetic penile augmentation is considered investigational and not shown to be safe or efficacious. This study sought to characterize the quality and reliability of YouTube videos on the topic of penile augmentation. A systematic search identifying the 100 most viewed YouTube videos on penile augmentation was conducted. The videos were then evaluated by two independent urologists for reliability and quality using a modified DISCERN scoring system and Global Quality Scale (GQS). The median total views were 530,612 (range 123,478-32,914,713). The median DISCERN and GQS scores for all 100 videos were generally poor at 1.75 (IQR 1-2.63) and 2.5 (IQR 1.5-3.5), respectively. A little under half of the videos had a physician present (44.7%). DISCERN and GQS scores were significantly higher in videos with physicians compared to those without one (p < 0.001 for both). The majority of videos discussed nonsurgical methods of penile augmentation (65.1%) with penile traction devices being the most frequently discussed (19.2%). Urologists and medical organizations should strive to have more of a presence in this space to ensure patients are appropriately educated and counseled before pursuing potentially ineffective or harmful treatments.

Critical Appraisal of Content Quality of YouTube Videos on the Whipple Pancreaticoduodenectomy

INTRODUCTION

The coronavirus pandemic has demonstrated profound issues with using the Internet to research health information. For patients recommended a complex operation, such as the Whipple pancreaticoduodenectomy, the quality of health information online has not been appraised. The objective of this study was to define the readability and content quality of YouTube search results for the Whipple pancreaticoduodenectomy.

METHODS

The first 100 search results for "whipple procedure" less than 10 min long in English with audio and or text were transcribed. The Flesch-Kincaid Grade defined the reading grade level. High content quality videos were accredited by YouTube in accordance with principles specified by the National Academy of Medicine or mentioned the standard components for a surgical consent. The Anderson-Lau score is a composite of these consent criteria out of a maximum of 8/8. The simplicity of videos for patient education was defined by the DISCERN tool.

RESULTS

The reading level of 23% of the top 100 search results met the American average (8th grade). Accreditation was present for 45% and associated with an earlier median search ranking (36 versus 68, P = 0.002) and more 5th-8th grade level material (70% versus 38%, P = 0.014). The median Anderson-Lau score was 3/8 (range = 0/8-7/8) with only 5% achieving 7/8. Only 4% were high quality per DISCERN.

CONCLUSIONS

Although accredited videos were more readable, most videos, especially those targeting patients, were beyond the comprehension of the average American. Simpler and higher quality educational materials are needed to inform patients on Whipple pancreaticoduodenectomy beyond their date of clinical diagnosis or surgical consenting.

Improving the design of patient-generated health data visualizations: design considerations from a Fitbit sleep study

Interactive data visualization can be a viable way to discover patterns in patient-generated health data and enable health behavior changes. However, very few studies have investigated the design and usability of such data visualization. The present study aimed to (1) explore user experiences with sleep data visualizations in the Fitbit app, and (2) focus on end users' perspectives to identify areas of improvement and potential solutions. The study recruited eighteen pre-medicine college students, who wore Fitbit watches for a two-week sleep data collection period and participated in an exit semi-structured interview to share their experience. A focus group was conducted subsequently to ideate potential solutions. The qualitative analysis identified six pain points (PPs) from the interview data using affinity mapping. Four design solutions were proposed by the focus group to address these PPs and illustrated by a set of mock-ups. The study findings informed four design considerations: (1) usability, (2) transparency and explainability, (3) understandability and actionability, and (4) individualized benchmarking. Further research is needed to examine the design guidelines and best practices of sleep data visualization, to create well-designed visualizations for the general population that enables health behavior changes.

Evaluation of the Quality and Comprehensiveness of YouTube Videos Discussing Pancreatic Cancer

Pancreatic cancer is one of the most lethal diseases worldwide and incidence continues to rise, resulting in increased deaths each year. In the modern era, patients often turn to online sources like YouTube for information regarding their disease, which may be subject to a high degree of bias and misinformation; previous analyses have demonstrated low quality of other cancer-related YouTube videos. Thus, we sought to determine if patients can rely on educational YouTube videos for accurate and comprehensive information about pancreatic cancer diagnosis and treatment. We designed a search query and inclusion/exclusion criteria based on published studies evaluating YouTube user tendencies, which were used to identify videos most likely watched by patients. Videos were evaluated based on two well-known criteria, the DISCERN and JAMA tools, as well as a tool published by Sahin et al. to evaluate the comprehensiveness of YouTube videos. Statistical analyses were performed using Chi-square analysis to compare categorical variables. We used linear regression to assess for correlations between quantitative variables. Kruskal-Wallis and independent samples t-test were used to compare means between groups. We assessed inter-rater reliability using Cronbach's alpha. After the initial search query, 39 videos were retrieved that met inclusion criteria. The comprehensiveness and quality of these materials was generally low to moderate, with only 7 videos being considered comprehensive. Pearson's R demonstrated strong correlations between video length and both comprehensiveness and quality. Higher-quality videos also tended to be newer. YouTube videos regarding pancreatic cancer are generally of low to moderate quality and lack comprehensiveness, which could affect patients' perceptions of their disease or understanding of treatment options. These videos, which have collectively been viewed over 6 million times, should be subject to some form of expert review before upload, and producers of this content should consider citing the sources used in the video.

[Contraception on YouTube, Instagram, and TikTok : A content and quality analysis]

BACKGROUND

Young people and adults increasingly obtain information about contraception via social media.

RESEARCH AIM

Against this background, the aim of this study is to investigate for the first time the content and quality of German-language contraceptive posts on YouTube, Instagram, and TikTok. Research questions on providers (F1), content (F2), and quality of contraceptive posts (F3) as well as audience reactions (F4) will be answered.

MATERIALS AND METHODS

A sample of N = 1000 contraceptive posts from YouTube (500), Instagram (250), and TikTok (250) was drawn. A maximum of 20 contraception-related audience comments per post were included in the comment sample (N = 12,454). Posts and comments were analyzed using reliability-tested codebooks. SPSS was used for data analysis. The study is preregistered and all data, materials, and analysis scripts are publicly available.

RESULTS

The majority of contraceptive posts were found to be from health laypersons (52%), followed by media professionals and health professionals (F1). In terms of content, contraceptive posts covered all available contraceptive methods, with the pill (69%) and condoms (40%) dominating (F2). According to common quality criteria, there were clear deficits, with YouTube videos scoring best in comparison (F3). TikTok videos, on the other hand, were top performers in terms of audience interaction, attracting the most views, likes, and comments. Comment columns were often used by the audience to share their own contraceptive experiences or ask follow-up questions (F4).

DISCUSSION

Future research as well as practice interventions are needed to further assess the quality of contraceptive information in social media and improve it in a more targeted way.

Longitudinal analysis of YouTube videos discussing post-prostatectomy erectile dysfunction

BACKGROUND

YouTube is heavily utilized by patients as an educational resource, but this content can be fraught with misinformation. We sought to characterize the quality of videos on YouTube discussing postprostatectomy erectile dysfunction and to evaluate metrics associated with retaining a top position in search results over time.

METHODS

In October 2019, we watched the first 100 YouTube videos using the search query "radical prostatectomy erectile dysfunction." Videos not relevant to the topic were excluded. Video metrics were collected, and content quality was evaluated using the DISCERN instrument. In June 2022, the search was repeated and video metrics were updated. Video characteristics were associated with search rank and the ability to remain in the top 100 spots using the Pearson correlation coefficient (r) and logistic regression, respectively.

RESULTS

We included 81 videos which amassed 529,428 views in 2019. The median total DISCERN score was 29 (IQR 21-42), which is interpreted as a poor quality video. Self-promotion or commercial bias was present in 42 videos (51.9%); false claims were present in 16 (19.8%). There was no correlation between DISCERN score and search rank (r = 0.08, p = 0.49). In 2022, 15 videos remained in the top 100 search results and had a higher median DISCERN score than videos no longer in the top 100 (46 vs. 28.5, p = 0.01). Each additional DISCERN point was associated with a 7% higher odds of remaining in the top 100 (OR 1.07, 95% CI 1.01-1.11, p = 0.003).

CONCLUSIONS

The quality of the top 100 YouTube videos discussing postprostatectomy erectile dysfunction is low. Higher quality videos had a higher odds of remaining in the top 100 search results over time but do not correlate with the order in which they are ranked.

Accuracy of prostate cancer screening recommendations for high-risk populations on YouTube and TikTok

Objectives

This study aimed to evaluate content quality and racial/ethnic representation, particularly of high-risk cohorts, of prostate cancer screening videos on YouTube (YT) and TikTok (TK).

Materials and Methods

The top 50 videos populated for the search term 'prostate cancer screening' on YT and TK that met inclusion criteria were retrieved in a cache-cleared browser. Three reviewers analysed all videos using validated criteria for the quality of consumer health information (DISCERN and Patient Education Materials Assessment Tool [PEMAT]). High quality was defined as follows: DISCERN ≥ 4, PEMAT understandability ≥75% and PEMAT actionability ≥75%. A 5-point Likert scale was used to demonstrate the level of misinformation compared to American Urological Association and National Comprehensive Cancer Network guidelines. Perceived race and ethnicity of people in the videos were assessed by consensus approach.

Results

TK videos were shorter (median 3.7 vs. 0.5 min, p < 0.001) and had more views per month (5437.5 vs. 19.3, p = 0.03) than YT videos. Perceived Black and Hispanic representation was present in 10% and 6% of YT videos and 20% and 12% of TK videos, respectively. High-risk racial/ethnic groups were explicitly discussed in 46% of YT videos and 8% of TK videos. A total of 98% of YT videos and 100% of TK videos had low- to moderate-quality consumer health information, and 88% of YT videos and 100% of TK videos had moderate to high levels of misinformation based on screening guidelines.

Conclusions

YT and TK videos about prostate cancer screening are widely viewed but do not provide quality consumer health information. Black and Hispanic men remain under-represented on both platforms, and high-risk racial groups were not discussed in most videos despite the importance for screening criteria. The low understandability and actionability, significant misinformation and lack of diversity in online videos support the need for higher quality videos with adequate attention to high-risk ethnic cohorts.