The Assessment of TikTok as a Source of Quality Health Information on Varicoceles

TikTok and pediatric nephrology: content quality assessment of videos related to pediatric kidney disease and kidney transplant

BACKGROUND

Social media platforms such as TikTok™ are key sources of health information for young patients and caregivers. Misinformation is prevalent on TikTok™ across healthcare fields, which can perpetuate false beliefs about medical care. Limited data exists on the reliability of pediatric nephrology TikTok™ content. This study aimed to describe the quality of medical content of TikTok™ Videos (TTVs), related to pediatric kidney disease and transplant.

METHODS

TTVs were selected using specific search terms and categorized into pediatric kidney disease and kidney transplant, excluding duplicate and adult-related content. The top 100 TTVs in each category, based on views, were analyzed. TTV characteristics were stratified by account type (physician, non-physician healthcare professional (HCP), non-HCP) and video aim (personal story, education, entertainment). DISCERN scoring, a validated questionnaire evaluating health information reliability, was conducted by 4 independent raters. Inter-rater reliability was assessed using a 2-way random effects model, and differences between content creator types were evaluated using one-way ANOVA and post-Hoc Tukey test.

RESULTS

TTVs had a total of 12.5 million likes and 113.1 million views. Over 70% of videos were created by non-HCPs (n = 147/200). DISCERN scoring revealed low reliability of medical information across content creator types. TTVs created by physicians and non-physician HCPs about kidney disease had significantly higher mean DISCERN scores compared to those created by non-HCPs (2.85, p < 0.001 and 2.48, p = 0.005, respectively).

CONCLUSIONS

Educators within the pediatric nephrology community must keep in mind the lack of reliability of medical information available on TikTok™ and coordinate collective efforts to consider utilizing TikTok™ for patient education.

Could be better: adolescent access to health information and care

Many adolescents must overcome a broad range of barriers to access health information and care and are consequently reluctant to pursue assistance for their health concerns. In this review, we examine from whom and how adolescents seek help (for example, by consulting with friends and family members and by searching for health information using online platforms) and how adolescents treat symptoms without consulting with a clinician by engaging in self-medication. Next, we suggest ways to help adolescents receive accurate health information and access to healthcare through school-based health education programs and health centers. We also discuss how to improve the experience of care for adolescents by collaboratively engaging young patients with their physicians and caregivers using shared decision-making. Finally, we propose developing and posting accurate and engaging multilingual materials on popular online platforms to improve adolescent access to accurate health information and knowledge of how to engage with the healthcare system.

CONCLUSION

The purpose of this review is to examine how adolescents seek, and propose ways to help adolescents access, health information and care despite the many barriers they face.

WHAT IS KNOWN

• Adolescents encounter a broad range of barriers to access health information and care and turn to family members and friends, and search online, for health information. In addition, adolescents benefit from school-based health education programs and health centers that reduce barriers to healthcare access.

WHAT IS NEW

• Adolescents engage in self-medication, including with cannabis use, to treat self-diagnosed illness or symptoms in a potentially harmful manner. • While many adolescents distrust health information shared on social media, recent evidence suggests adolescents are receptive to, and will change some beliefs, in response to health information posted on social media platforms.

Reliability and Educational Suitability of TikTok Videos as a Source of Information on Sleep and Awake Bruxism: A Cross-Sectional Analysis

BACKGROUND

TikTok contains many videos about bruxism that may help raise the level of awareness on the topic. However, the quality of these videos' information represents the greatest concern.

OBJECTIVE

The present cross-sectional analysis aimed to systematically assess the reliability and educational suitability of TikTok videos as a source of information on bruxism.

METHODS

TikTok was searched for relevant videos uploaded until 6 March 2024, using the hashtags #bruxism, #grindingteeth and #jawclenching. Independent pre-calibrated operators conducted video inclusion and data collection, noting videos' characteristics, source, popularity, content, reliability (assessed through the DISCERN scoring system) and educational value (assessed through the Global Quality Score [GQS]). The Kruskal-Wallis test was adopted to compare videos from different sources. Videos with low and high educational value were compared using the Mann-Whitney U-test. Tests were considered significant when the p-value was < 0.05.

RESULTS

A total of 105 bruxism videos were analysed. Most videos covered bruxism management and clinical features, and more than 60% were uploaded by healthcare professionals. According to the DISCERN and GQS scoring, the videos' reliability and educational value were judged to be very poor and low, respectively, but on average they were higher for videos uploaded by healthcare professionals compared to those uploaded by laypeople. When comparing videos with high educational value to those with low educational value, differences were found in popularity, content and reliability.

CONCLUSION

The present results suggest the need for greater control of information disseminated on social media to fulfil its potential role in educating laypeople about bruxism.

Patient perspectives on vasectomy: findings from a TikTok® content analysis

Social media is increasingly used as a platform for patients to explore health care information. Our objective was to study the content on TikTok® in order to gain insight into the perspectives shared by the public on vasectomy. A search was performed using the hashtag ´#vasectomy´ on 12.20.2023 and the top 100 video posts from persons self-identifying as patients were included. Using an adaptation of a previously published system, a framework was created for organising and categorising the data related to vasectomy. Domains covered included reason for vasectomy, complications, vasectomy as a controversial topic in society and reference to the 2022 Dobbs v. Jackson ruling. Most content originated from the United States (85.0%) and the median number of views per video was 261 200 (interquartile range (IQR) 8416-1 800 000). In 12.0% of posts, the individual clearly stated that they were under 30 years of age. Two of the commonest topics to be addressed in the videos were recovery (41.0%) and pain (40.0%). 30.0% discussed the reason for undergoing vasectomy. Reasons included women's rights (12%), safety over tubal ligation (5.0%) and desire to be childless (4.0%). 9.0% referred to the Dobbs v. Jackson ruling. Complications were discussed in 19.0% including vasectomy failure (12.0%). 23.0% contained factually incorrect medical information. 31.0% of videos included the user voicing that vasectomy was considered to be a controversial subject. More than half of the videos (61.0%) were positive regarding the vasectomy process. Our findings reveal that vasectomy receives very high engagement on social media. This study confirms that patients do use it to share their experiences, both positive and negative. Misconceptions regarding this contraception method are common among the public and the urological community should work to address this.

LASIK Videos on TikTok: A Content Analysis of the Top 100 Videos

Introduction

Social media has increasingly become a prominent source of health information. Platforms like TikTok that allow for videos to reach millions of viewers have become among the most common platforms to share and receive health information. Laser in situ keratomileusis (LASIK) videos and patients' experiences are commonly discussed on social media. The quality of these videos remains to be assessed. The aim of this study is to evaluate the content, quality, and reach of the top 100 videos related to LASIK eye surgery on TikTok.

Methods

Video quality was assessed using the DISCERN, JAMA, and GQS instruments which have all been proven to be both reliable and valid.

Results

100 videos were included in the study. Results showed that the videos have an immense reach with a total view count of 245 million views and 21.9 million likes. Two thirds of the videos were posted by personal accounts as compared ophthalmologists that only constituted 26% of the content. Healthcare professionals produced higher quality videos compared to nonhealthcare professionals (p < 0.0001) although there was no significant difference in video duration (p=0.18). Increased duration, view count, comments, shares, saves, and views/day were all associated with increased DISCERN score and quality of the videos. Educational videos were of higher quality compared to entertainment videos, and videos outlining the procedure details had the highest quality score.

Conclusions

LASIK videos on TikTok have established a wide reach, whereby viewers are highly interacting and viewing these videos. It appeared that viewers interacted more with the higher quality videos. Ophthalmologists approximately only contributed to a quarter of the videos analyzed in this study. This highlights the need for ophthalmologists to establish a presence on TikTok and produce high quality videos.

Prejuvenation: What Social Media Tells Us About the Rising Trend

BACKGROUND

"Prejuvenation," a practice gaining enormous popularity among younger adults, can largely attribute its explosive growth to TikTok, the platform on which many first encounter this trend. Despite the rising usage of prejuvenation, however, there is a lack of clarity regarding its clinical practice and efficacy.

OBJECTIVES

To investigate the understandability, reliability, and actionability of prejuvenation-related TikTok content.

METHODS

TikTok was queried using 13 hashtags consisting of popular colloquial terms associated with prejuvenation treatments, and the top 25 videos meeting inclusion criteria for each hashtag were analyzed. For each video, poster credentials and video type were determined. Videos considered "educational" were analyzed using the validated modified DISCERN score and the Patient Education Materials Assessment Tool scales. Creator's prejuvenation recommendations were recorded. Univariate and linear regression models were utilized for analysis.

RESULTS

A total of 303 videos amassed over 61,000,000 million views, 3,957,091 likes, 24,455 comments, and 71,697 shares. Nonphysicians posted the most videos (n = 257, 84.8%) and had significantly higher median views, likes, comments, and engagement than physician videos. Analysis of "educational" videos showed that most videos (50, 67%) supported the use of prejuvenation treatments, 18 (24%) were neutral, and 6 (8%) were opposed.

CONCLUSIONS

Prejuvenation content on TikTok varies widely in terms of quality and recommendations, calling for more standardization regarding the practice. Physician-generated prejuvenation content was more reliable, but distinguishing it from nonphysician content was challenging, underscoring the need for platform-specific verification tools.

Inter-disciplinary provider development of an online, interactive adolescent varicocele decision aid prototype

BACKGROUND

Decision-making regarding varicocele management can be a complex process for patients and families. However, to date, no studies have presented ways to mitigate the decisional conflict surrounding varicoceles.

OBJECTIVE

To facilitate a discussion among physicians in order to develop a framework of the decision-making process regarding adolescent varicocele management, which will inform the development of the first online, interactive decision aid.

MATERIALS AND METHODS

Semi-structured interviews with pediatric urologists and interventional radiologists were conducted to discuss their rationale for varicocele decision-making. Interviews were audio recorded, transcribed, and coded. Key themes were identified, grouped, and then qualitatively analyzed using thematic analysis. Utilizing the common themes identified and the Ottawa Decision Support Framework, a decision aid prototype was developed and transformed into a user-friendly website: varicoceledecisionaid.com.

RESULTS

Pediatric urologists (n = 10) and interventional radiologists (n = 2) were interviewed. Key themes identified included: (1) definition/epidemiology; (2) observation as an appropriate management choice; (3) reasons to recommend repair; (4) types of repair; (5) reasons to recommend one repair over another; (6) shared decision-making; and (7) appropriate counseling. With this insight, a varicocele decision aid prototype was developed that engages patients and parents in the decision-making process.

DISCUSSION AND CONCLUSIONS

This is the first interactive and easily accessible varicocele decision aid prototype developed by inter-disciplinary physicians for patients. This tool aids in decision-making surrounding varicocele surgery. It can be used before or after consultation to help families understand more about varicoceles and their repair, and why intervention may or may not be offered. It also considers a patient and family's personal values. Future studies will incorporate the patient and family perspective into the decision-making aid as well as implement and test the usability of this decision aid prototype in practice and in the wider urologic community.

Quality and educational content of Douyin and TikTok short videos on early screening of rectal cancer

Background and Aim

The aim of this study was to assess the quality and content of videos on Douyin and TikTok for their educational role on early screening of rectal cancer (RC).

Methods

We conducted a search for videos related to RC on the Douyin and TikTok applications on 20 April 2023. The search was conducted in Chinese on Douyin and in English and Japanese on TikTok. A sample of the first 100 videos recommended by the software was selected for each language group. The content of the videos was evaluated using a content scorecard, while the quality of the videos was assessed using DISCERN. Subsequently, we conducted two partial correlations: one between the DISCERN score and the number of likes, and another between the video content score and the number of likes.

Results

This study encompassed a total of 89 Chinese, 54 English, and 51 Japanese videos. After selection, 78 Chinese, 38 English, and 25 Japanese videos were identified to contain content related to early screening for RC, prompting further quality assessment. Notably, videos in the Chinese language showed the highest DISCERN score (P < 0.05). In terms of partial correlation analysis, it was observed that both the content score and DISCERN score did not show a significant correlation with the number of likes (P > 0.05).

Conclusion

In terms of quality score and content score, the Chinese videos on Douyin show superiority over the English and Japanese videos on TikTok. However, there is potential for improving the overall appeal of the Chinese videos.

Female urinary incontinence on TikTok and YouTube: is online video content sufficient?

INTRODUCTION AND HYPOTHESIS

The objective of the study is to evaluate the reliability and quality of the most-viewed female urinary incontinence-related TikTok and YouTube posts. Our second goal is to analyze the differences in the quality and content of videos between these platforms.

METHODS

We searched for the keyword "female urinary incontinence" on TikTok and YouTube on 1 March 2023. We sorted the videos that appeared out of searches for this keyword by "top" results on TikTok and by "relevance" on YouTube. We excluded the videos that were not in English, whose narrator was unclear, unrelated videos, advertising videos, and duplicate videos. In this study, we included the top 50 videos on both platforms that were directly related to female urinary incontinence. The characteristics of the videos, such as likes, video duration, views, and type of narrator (patient, physician, nonphysician practitioner, and health care company), and DISCERN scores were analyzed.

RESULTS

We observed that the median view count (p<0.001) and the median video duration (p<0.001) were higher and longer respectively on YouTube than on TikTok. In addition, the median DISCERN score of these videos was higher on YouTube than on TikTok (p<0.001). Similarly, the overall quality of videos was higher on YouTube than on TikTok (p=0.002). Only in two TikTok and two YouTube videos have the narrators cited a reference.

CONCLUSIONS

Our findings emphasize the present lack of high-quality content available on TikTok and YouTube from both health care and nonhealth care experts. To address this lack of information, health care providers, especially urologists, should take an active role in creating video content.

TikTok as an Educational Tool for Kidney Stone Prevention

INTRODUCTION

The incidence of kidney stones in the United States continues to increase. Although dietary interventions have shown to be effective in reducing stone events, adherence to medical management continues to be a limiting factor. For that reason, patient education has become a focus of many physicians. TikTok, a social media application with over one billion users worldwide, has emerged as an online center for medical knowledge sharing by physicians and non-physicians alike. TikTok users share kidney stone prevention information through short informational videos directly to the general public. Little is known regarding the quality of medical advice provided in these videos. The purpose of this study was to evaluate the reach and quality of kidney stone prevention information on TikTok.

METHODS

We conducted a cross-sectional analysis of renal stone prevention content on TikTok utilizing the search term #kidneystoneprevention to assess all the videos appearing on October 10th, 2022. Only videos in English, related to the topic, and with >1000 views were included. Videos were analyzed for descriptive statistics, including views, uploader profession, and stone prevention recommendations. Videos were assessed utilizing Denver International Study Center of Evaluative Rating of Information (DISCERN), a questionnaire used to appraise the quality of consumer health information (maximum score of 80 per video). The one-way analysis of variance (ANOVA) was used to determine statistical significance groups.

RESULTS

Out of a total of 131 videos, 87 fit the inclusion criteria, resulting in a total of 8.75 million views. An average DISCERN score of 27.0 was observed. Only eight videos were published by physicians, of which the average DISCERN score of 35.3 was significantly greater than an average score of 26.2 for non-physicians (p<0.05). The most common recommendation was increased fluid intake (38.0%) followed by monitoring calcium levels (9.02%) and decreasing oxalate-rich foods (9.2%).

CONCLUSIONS

Kidney stone prevention content on TikTok has a wide reach with millions of consumers. The majority of videos fail to match American Urological Association recommendations regarding diet therapies for stone prevention. Further research is needed to understand the extent of kidney stone prevention misinformation on social media and how it contributes to patient outcomes. Increased engagement in TikTok by urologists and health organizations may improve public education.

ChatGPT's Ability to Assess Quality and Readability of Online Medical Information: Evidence From a Cross-Sectional Study

Introduction Artificial Intelligence (AI) platforms have gained widespread attention for their distinct ability to generate automated responses to various prompts. However, its role in assessing the quality and readability of a provided text remains unclear. Thus, the purpose of this study is to evaluate the proficiency of the conversational generative pre-trained transformer (ChatGPT) in utilizing the DISCERN tool to evaluate the quality of online content regarding shock wave therapy for erectile dysfunction. Methods Websites were generated using a Google search of "shock wave therapy for erectile dysfunction" with location filters disabled. Readability was analyzed using Readable software (Readable.com, Horsham, United Kingdom). Quality was assessed independently by three reviewers using the DISCERN tool. The same plain text files collected were inputted into ChatGPT to determine whether they produced comparable metrics for readability and quality. Results The study results revealed a notable disparity between ChatGPT's readability assessment and that obtained from a reliable tool, Readable.com (p<0.05). This indicates a lack of alignment between ChatGPT's algorithm and that of established tools, such as Readable.com. Similarly, the DISCERN score generated by ChatGPT differed significantly from the scores generated manually by human evaluators (p<0.05), suggesting that ChatGPT may not be capable of accurately identifying poor-quality information sources regarding shock wave therapy as a treatment for erectile dysfunction. Conclusion ChatGPT's evaluation of the quality and readability of online text regarding shockwave therapy for erectile dysfunction differs from that of human raters and trusted tools. Therefore, ChatGPT's current capabilities were not sufficient for reliably assessing the quality and readability of textual content. Further research is needed to elucidate the role of AI in the objective evaluation of online medical content in other fields. Continued development in AI and incorporation of tools such as DISCERN into AI software may enhance the way patients navigate the web in search of high-quality medical content in the future.