TikTok as a Health Information Source: Assessment of the Quality of Information in Diabetes-Related Videos

"Does My Kid Have an Ear Infection?" An Analysis of Pediatric Acute Otitis Media Videos on TikTok

INTRODUCTION

With the rise of social media, online platforms have become a common way to access healthcare information. This study examines the quality of pediatric acute otitis media (AOM) videos on TikTok, a popular short-form video social media platform.

METHODS

A TikTok search was conducted between 8/18 and 8/19/2023 using pediatric AOM hashtags: #pediatric acute otitis media management, #kid ear infections remedy, #child ear infections treatment, and #kid ear infection. Data collected include number of views/shares per day, uploader type (nonmedical influencer, lay individual, and medical professional), and content categories. The Patient Education Materials Assessment Tool for Audiovisual Material (PEMAT-AV) and DISCERN questionnaire measured understandability, actionability, and quality of videos. Multivariable linear regression models were used (significance set at ≤0.05).

RESULTS

Of 166 videos, 38.6% (64) of uploaders were medical professionals, and 32.5% (54) were nonmedical influencers. Nonmedical influencer videos were viewed and shared significantly more than those by medical professionals (p < 0.05). Controlling for covariates, physicians were more likely to produce more beneficial and higher quality videos as compared with nonmedical influencers (β = 2.4 and 1.3, p < 0.01, respectively). However, physicians did not have significantly different ratings for understandability compared with nonmedical influencers (β = 0.45, p > 0.05).

DISCUSSION

AOM content on TikTok is often geared toward caretakers of symptomatic children. Although physician-created AOM content was significantly higher quality, these videos reached a statistically smaller audience than those from nonmedical influencers. Addressing misinformation on social media platforms requires physicians to reach larger audiences by producing more actionable and understandable content.

LEVEL OF EVIDENCE

NA Laryngoscope, 2024.

Development and Validation of a Measure for Seeking Health Information in the Diabetes Online Community: Mixed Methods Study

BACKGROUND

Individuals with chronic diseases often search for health information online. The Diabetes Online Community (DOC) is an active community with members who exchange health information; however, few studies have examined health information brokering in the DOC.

OBJECTIVE

The aim of this study was to develop and validate the Attitudes Toward Seeking Health Information Online (ATSHIO) scale in a sample of adults with type 1 diabetes (T1D).

METHODS

People with T1D were recruited through the DOC, specifically Facebook and Twitter. They were provided with a Qualtrics link to complete the survey. This was a mixed methods study that used thematic analysis along with existing theory and formative research to design the quantitative ATSHIO scale.

RESULTS

A total of 166 people with T1D participated in this study. Confirmatory factor analyses determined a 2-factor scale (Trusting and Evaluating Online Health Information in the DOC and Engaging With Online Health Information in the DOC) with good convergent validity and discriminant validity. Correlations were found between social support, online health information-seeking, diabetes distress, and disease management.

CONCLUSIONS

The ATSHIO scale can be used to investigate how people with diabetes are using the internet for obtaining health information, which is especially relevant in the age of telehealth and Health 2.0.

Assessment of the quality, content, and reliability of YouTube® videos on diabetes mellitus and polycystic ovary syndrome: a systematic review with cross-sectional analysis comparing peer-reviewed videos

YouTube® is one of the leading platforms for health information. However, the lack of regulation of content and quality raises concerns about accuracy and reliability. CoMICs (Concise Medical Information Cines) are evidence-based short videos created by medical students and junior doctors and reviewed by experts to ensure clinical accuracy. We performed a systematic review to understand the impact of videos on knowledge and awareness about diabetes and PCOS. We then evaluated the quality of YouTube® videos about diabetes and PCOS using various validated quality assessment tools and compared these with CoMICs videos on the same topics. Quality assessment tools like DISCERN, JAMA benchmark criteria, and global quality scale (GQS) score were employed. Some of the authors of this study also co-authored the creation of some of the CoMICs evaluated. Our study revealed that while videos effectively improve understanding of diabetes and PCOS, there are notable differences in quality and reliability of the videos on YouTube®. For diabetes, CoMICs videos had higher DISCERN scores (CoMICs vs YouTube®: 2.4 vs 1.6), superior reliability (P < 0.01), and treatment quality (P < 0.01) and met JAMA criteria for authorship (100% vs 30.6%) and currency (100% vs 53.1%). For PCOS, CoMICs had higher DISCERN scores (2.9 vs 1.9), reliability (P < 0.01), and treatment quality (P < 0.01); met JAMA criteria for authorship (100% vs 34.0%) and currency (100% vs 54.0%); and had higher GQS scores (4.0 vs 3.0). In conclusion, CoMICs outperformed other similar sources on YouTube® in providing reliable evidence-based medical information which may be used for patient education.

Mediterranean Diet Information on TikTok and Implications for Digital Health Promotion Research: Social Media Content Analysis

BACKGROUND

The Mediterranean diet has been linked to reduced risk for several cardiometabolic diseases. The lack of a clear definition of the Mediterranean diet in the scientific literature and the documented proliferation of nutrition misinformation on the internet suggest the potential for confusion among consumers seeking web-based Mediterranean diet information.

OBJECTIVE

We conducted a social media content analysis of information about the Mediterranean diet on the influential social media platform, TikTok, to examine public discourse about the diet and identify potential areas of misinformation. We then analyzed these findings in the context of health promotion to identify potential challenges and opportunities for the use of TikTok in promoting the Mediterranean diet for healthy living.

METHODS

The first-appearing 202 TikTok posts that resulted from a search of the hashtag #mediterraneandiet were downloaded and qualitatively examined. Post features and characteristics, poster information, and engagement metrics were extracted and synthesized across posts. Posts were categorized as those created by health professionals and those created by nonhealth professionals based on poster-reported credentials. In addition to descriptive statistics of the entire sample, we compared posts created by professionals and nonprofessionals for content using chi-square tests.

RESULTS

TikTok posts varied in content, but posts that were developed by health professionals versus nonprofessionals were more likely to offer a definition of the Mediterranean diet (16/106, 15.1% vs 2/96, 2.1%; P=.001), use scientific citations to support claims (26/106, 24.5% vs 0/96, 0%; P<.001), and discuss specific nutrients (33/106, 31.1% vs 6/96, 6.3%; P<.001) and diseases related to the diet (27/106, 25.5% vs 5/96, 5.2%; P<.001) compared to posts created by nonhealth professionals.

CONCLUSIONS

Social media holds promise as a venue to promote the Mediterranean diet, but the variability in information found in this study highlights the need to create clear definitions about the diet and its components when developing Mediterranean diet interventions that use new media structures.

YouTube/ Bilibili/ TikTok videos as sources of medical information on laryngeal carcinoma: cross-sectional content analysis study

BACKGROUND

YouTube, a widely recognized global video platform, is inaccessible in China, whereas Bilibili and TikTok are popular platforms for long and short videos, respectively. There are many videos related to laryngeal carcinoma on these platforms. This study aims to identify upload sources, contents, and feature information of these videos on YouTube, Bilibili, and TikTok, and further evaluate the video quality.

METHODS

On January 1, 2024, we searched the top 100 videos by default sort order (300 videos in total) with the terms "laryngeal carcinoma" and "throat cancer" on YouTube, "" on Bilibili and TikTok. Videos were screened for relevance and similarity. Video characteristics were documented, and quality was assessed by using the Patient Education Materials Assessment Tool (PEMAT), Video Information and Quality Index (VIQI), Global Quality Score (GQS), and modified DISCERN (mDISCERN).

RESULTS

The analysis included 99 YouTube videos, 76 from Bilibili, and 73 from TikTok. Median video lengths were 193 s (YouTube), 136 s (Bilibili), and 42 s (TikTok). TikTok videos demonstrated higher audience interaction. Bilibili had the lowest ratio of original contents (69.7%). Treatment was the most popular topic on YouTube and Bilibili, while that was the prognosis on TikTok. Solo narration was the most common video style across all platforms. Video uploaders were predominantly non-profit organizations (YouTube), self-media (Bilibili), and doctors (TikTok), with TikTok authors having the highest certification rate (83.3%). Video quality, assessed using PEMAT, VIQI, GQS, and mDISCERN, varied across platforms, with YouTube generally showing the highest scores. Videos from professional authors performed better than videos from non-professionals based on the GQS and mDISCERN scores. Spearman correlation analysis showed no strong relationships between the video quality and the audience interaction.

CONCLUSIONS

Videos on social media platforms can help the public learn about the knowledge of laryngeal cancer to some extent. TikTok achieves the best flow, but videos on YouTube are of the best quality. However, the video quality across all platforms still needs enhancement. We need more professional uploaders to ameliorate the video quality related to laryngeal carcinoma. Content creators also should be aware of the certification, the originality, and the style of video shooting. As for the platforms, refining the algorithm will allow users to receive more high-quality videos.

"Addiction is Not a Choice." #narcansaveslives: Collective Voice in Harm Reduction on TikTok

Using 100 videos posted to TikTok by harm reduction creators with the hashtags #narcansaveslives and #naloxonesaveslives, this study examines who is posting, what they are saying, and how they are explaining Narcan/naloxone to their followers. Incorporating the concept of reverse agenda setting, we examine how, through hashtags, TikTok creators can set the agenda for what is important to discuss in the harm reduction space. Findings demonstrate that harm reduction creators have developed a collective voice and created an affective public, attempting to educate others, shed stigma, and normalize the conversation around harm reduction. These creators are using TikTok to educate followers about the prevalence of opioid use, the availability of Narcan/naloxone, correcting misinformation, and discussing the reality of recovery. Echoing prior studies, this research illustrates how TikTok has become an essential resource for health questions, including opioid use. Practical implications are also discussed.

Health information in short videos about metabolic dysfunction-associated steatotic liver disease: Analysing quality and reliability

BACKGROUND & AIMS

Short videos, crucial for disseminating health information on metabolic dysfunction-associated steatotic liver disease (MASLD), lack a clear evaluation of quality and reliability. This study aimed to assess the quality and reliability of MASLD-related videos on Chinese platforms.

METHODS

Video samples were collected from three platforms (TikTok, Kwai and Bilibili) during the period from November 2019 to July 2023. Two independent reviewers evaluated the integrity of the information contained therein by scoring six key aspects of its content: definition, epidemiology, risk factors, outcomes, diagnosis and treatment. The quality and reliability of the videos were assessed using the Journal of the American Medical Association (JAMA) criteria, the Global Quality Score (GQS) and the modified DISCERN score.

RESULTS

A total of 198 videos were included. The video content exhibited an overall unsatisfactory quality, with a primary emphasis on risk factors and treatment, while diagnosis and epidemiology were seldom addressed. Regarding the sources of the videos, the GQS and modified DISCERN scores varied significantly between the platforms (p = .003), although they had generally similar JAMA scores (p = .251). Videos created by medical professionals differed significantly in terms of JAMA scores (p = .046) compared to those created by nonmedical professionals, but there were no statistically significant differences in GQS (p = .923) or modified DISCERN scores (p = .317).

CONCLUSIONS

The overall quality and reliability of the videos were poor and varied between platforms and uploaders. Platforms and healthcare professionals should strive to provide more reliable health-related information regarding MASLD.

Quality assessment of health science-related short videos on TikTok: A scoping review

OBJECTIVE

The aims of this review are to clarify the current state of research in terms of assessment tools and assessors of the quality of health science-related short videos on TikTok, to identify limitations in existing research; and to provide a reference for future studies.

METHODS

A scoping review was conducted. The Cochrane Library, PubMed, MEDLINE, Web of Science, Embase, Scopus, EBSCO, CNKI, VIP, Wanfang Data, and CBM databases were searched from September 2016 to November 2022. Manual searching was also performed to identify additional eligible studies. A total of 2620 documents were initially retrieved, and 29 were ultimately included. The literature was screened and collected, and data were extracted and summarized by 2 researchers.

RESULTS

(1) The quality evaluation tools used in the 29 papers included the DISCERN, PEMAT(A/V), GQS, JAMA, HONcode, guidelines and self-developed tools. Twenty-four of the included articles used the DISCERN for quality assessment, which was the most frequently used evaluation tool. However, most of these tools were not developed to assess health science-related short videos, lacked credibility tests, and had poor applicability; therefore, the accuracy of the evaluation results might be biased. (2) The assessors of the quality of health science-related short videos on TikTok were mainly experts in related fields and medical students, with doctors (12/14) being the most common evaluators. Fifteen studies did not report the identity of the evaluators, and 12 studies did not report interrater reliability.

CONCLUSION

This scoping review found that there is a lack of specific quality assessment tools for health science-related short videos on TikTok. Second, the current quality assessors of health science-related short videos on TikTok are limited. Future research should focus on the development of reliable, scientific quality assessment tools for health science-related short videos; unifying the evaluation standards; inviting users with different backgrounds and different health literacy levels to conduct quality assessments; exploring the quality assessment of health science-related short videos on TikTok from different perspectives.

Enabling Health Information Recommendation Using Crowdsourced Refinement in Web-Based Health Information Applications: User-Centered Design Approach and EndoZone Informatics Case Study

BACKGROUND

In the digital age, search engines and social media platforms are primary sources for health information, yet their commercial interests-focused algorithms often prioritize irrelevant content. Web-based health applications by reputable sources offer a solution to circumvent these biased algorithms. Despite this advantage, there remains a significant gap in research on the effective integration of content-ranking algorithms within these specialized health applications to ensure the delivery of personalized and relevant health information.

OBJECTIVE

This study introduces a generic methodology designed to facilitate the development and implementation of health information recommendation features within web-based health applications.

METHODS

We detail our proposed methodology, covering conceptual foundation and practical considerations through the stages of design, development, operation, review, and optimization in the software development life cycle. Using a case study, we demonstrate the practical application of the proposed methodology through the implementation of recommendation functionalities in the EndoZone platform, a platform dedicated to providing targeted health information on endometriosis.

RESULTS

Application of the proposed methodology in the EndoZone platform led to the creation of a tailored health information recommendation system known as EndoZone Informatics. Feedback from EndoZone stakeholders as well as insights from the implementation process validate the methodology's utility in enabling advanced recommendation features in health information applications. Preliminary assessments indicate that the system successfully delivers personalized content, adeptly incorporates user feedback, and exhibits considerable flexibility in adjusting its recommendation logic. While certain project-specific design flaws were not caught in the initial stages, these issues were subsequently identified and rectified in the review and optimization stages.

CONCLUSIONS

We propose a generic methodology to guide the design and implementation of health information recommendation functionality within web-based health information applications. By harnessing user characteristics and feedback for content ranking, this methodology enables the creation of personalized recommendations that align with individual user needs within trusted health applications. The successful application of our methodology in the development of EndoZone Informatics marks a significant progress toward personalized health information delivery at scale, tailored to the specific needs of users.

The status quo of short video as sources of health information on gastroesophageal reflux disease in China: a cross-sectional study

Background

Positive lifestyle adjustments have become effective methods in treating gastroesophageal reflux disease (GERD). Utilizing short video platforms to encourage GERD patients for effective self-disease management is a convenient and cost-effective approach. However, the quality of GERD-related videos on short video platforms is yet to be determined, and these videos may contain misinformation that patients cannot recognize. This study aims to assess the information quality of GERD-related short videos on TikTok and Bilibili in China.

Methods

Search and filter the top 100 GERD-related videos on TikTok and Bilibili based on comprehensive rankings. Two independent gastroenterologists conducted a comprehensive evaluation of the video quality using the Global Quality Score and the modified DISCERN tool. Simultaneously, the content of the videos was analyzed across six aspects: definition, symptoms, risk factors, diagnosis, treatment, and outcomes.

Results

A total of 164 GERD-related videos were collected in this study, and videos from non-gastrointestinal health professionals constitute the majority (56.71%), with only 28.66% originating from gastroenterology health professionals. The overall quality and reliability of the videos were relatively low, with DISCERN and GQS scores of 2 (IQR: 2-3) and 3 (IQR: 2-3), respectively. Relatively speaking, videos from gastrointestinal health professionals exhibit the highest reliability and quality, with DISCERN scores of 3 (IQR: 3-4) and GQS scores of 3 (IQR: 3-4), respectively.

Conclusion

Overall, the information content and quality of GERD-related videos still need improvement. In the future, health professionals are required to provide high-quality videos to facilitate effective self-disease management for GERD patients.

TikTok as a Source of Health Information and Misinformation for Young Women in the United States: Survey Study

BACKGROUND

TikTok is one of the most-used and fastest-growing social media platforms in the world, and recent reports indicate that it has become an increasingly popular source of news and information in the United States. These trends have important implications for public health because an abundance of health information exists on the platform. Women are among the largest group of TikTok users in the United States and may be especially affected by the dissemination of health information on TikTok. Prior research has shown that women are not only more likely to look for information on the internet but are also more likely to have their health-related behaviors and perceptions affected by their involvement with social media.

OBJECTIVE

We conducted a survey of young women in the United States to better understand their use of TikTok for health information as well as their perceptions of TikTok's health information and health communication sources.

METHODS

A web-based survey of US women aged 18 to 29 years (N=1172) was conducted in April-May 2023. The sample was recruited from a Qualtrics research panel and 2 public universities in the United States.

RESULTS

The results indicate that the majority of young women in the United States who have used TikTok have obtained health information from the platform either intentionally (672/1026, 65.5%) or unintentionally (948/1026, 92.4%). Age (959/1026, 93.47%; r=0.30; P<.001), education (959/1026, 93.47%; ρ=0.10; P=.001), and TikTok intensity (ie, participants' emotional connectedness to TikTok and TikTok's integration into their daily lives; 959/1026, 93.47%; r=0.32; P<.001) were positively correlated with overall credibility perceptions of the health information. Nearly the entire sample reported that they think that misinformation is prevalent on TikTok to at least some extent (1007/1026, 98.15%), but a third-person effect was found because the young women reported that they believe that other people are more susceptible to health misinformation on TikTok than they personally are (t1025=21.16; P<.001). Both health professionals and general users were common sources of health information on TikTok: 93.08% (955/1026) of the participants indicated that they had obtained health information from a health professional, and 93.86% (963/1026) indicated that they had obtained health information from a general user. The respondents showed greater preference for health information from health professionals (vs general users; t1025=23.75; P<.001); the respondents also reported obtaining health information from health professionals more often than from general users (t1025=8.13; P<.001), and they were more likely to act on health information from health professionals (vs general users; t1025=12.74; P<.001).

CONCLUSIONS

The findings suggest that health professionals and health communication scholars need to proactively consider using TikTok as a platform for disseminating health information to young women because young women are obtaining health information from TikTok and prefer information from health professionals.

Promoting a healthy lifestyle: exploring the role of social media and fitness applications in the context of social media addiction risk

The popularity of social networks turns them into a legal method for promoting a healthy lifestyle, which benefits not only people but also different countries' governments. This research paper aimed to examine the Keep fitness app integrated into WeChat, Weibo and QQ as regards long-term improvements in health-related behaviors (physical activity, nutrition, health responsibility, spiritual growth, interpersonal relationships and stress management) and assess the associated risk of increased social media addiction. Students from Lishui University in China (N = 300) participated in this study, and they were formed into control and experimental groups. The Healthy Lifestyle Behavior Scale and Social Media Disorder Scale were used as psychometric instruments. The Keep app was found to improve respondents' scores on the parameters of physical activity, nutrition and health responsibility (P = 0.00). However, the level of dependence on social media did not change in either the control or the experimental group during the year of research (P ≥ 0.05). It is concluded that fitness apps can be an effective tool to promote healthy lifestyles among young people in China and other countries. The feasibility of government investment in fitness apps to promote healthy lifestyles is substantiated.

Evaluation of TikTok videos on acute pancreatitis: content quality and reliability analysis

BACKGROUND

Acute pancreatitis (AP) is a common acute digestive system disorder, with patients often turning to TikTok for AP-related information. However, the platform's video quality on AP has not been thoroughly investigated.

OBJECTIVE

The main purpose of this study is to evaluate the quality of videos about AP on TikTok, and the secondary purpose is to study the related factors of video quality.

METHODS

This study involved retrieving AP-related videos from TikTok, determining, and analyzing them based on predefined inclusion and exclusion criteria. Relevant data were extracted and compiled for evaluation. Video quality was scored using the DISCERN instrument and the Health on the Net (HONcode) score, complemented by introducing the Acute Pancreatitis Content Score (APCS). Pearson correlation analysis was used to assess the correlation between video quality scores and user engagement metrics such as likes, comments, favorites, retweets, and video duration.

RESULTS

A total of 111 TikTok videos were included for analysis, and video publishers were composed of physicians (89.18%), news media organizations (13.51%), individual users (5.41%), and medical institutions (0.9%). The majority of videos focused on AP-related educational content (64.87%), followed by physicians' diagnostic and treatment records (15.32%), and personal experiences (19.81%). The mean scores for DISCERN, HONcode, and APCS were 33.05 ± 7.87, 3.09 ± 0.93, and 1.86 ± 1.30, respectively. The highest video scores were those posted by physicians (35.17 ± 7.02 for DISCERN, 3.31 ± 0.56 for HONcode, and 1.94 ± 1.34 for APCS, respectively). According to the APCS, the main contents focused on etiology (n = 55, 49.5%) and clinical presentations (n = 36, 32.4%), followed by treatment (n = 24, 21.6%), severity (n = 20, 18.0%), prevention (n = 19, 17.1%), pathophysiology (n = 17, 15.3%), definitions (n = 13, 11.7%), examinations (n = 10, 9%), and other related content. There was no correlation between the scores of the three evaluation tools and the number of followers, likes, comments, favorites, and retweets of the video. However, DISCERN (r = 0.309) and APCS (r = 0.407) showed a significant positive correlation with video duration, while HONcode showed no correlation with the duration of the video.

CONCLUSIONS

The general quality of TikTok videos related to AP is poor; however, the content posted by medical professionals shows relatively higher quality, predominantly focusing on clinical presentations and etiologies. There is a discernible correlation between video duration and quality ratings, indicating that a combined approach incorporating the guideline can comprehensively evaluate AP-related content on TikTok.

Exploring the capacities of ChatGPT: A comprehensive evaluation of its accuracy and repeatability in addressing helicobacter pylori-related queries

BACKGROUND

Educational initiatives on Helicobacter pylori (H. pylori) constitute a highly effective approach for preventing its infection and establishing standardized protocols for its eradication. ChatGPT, a large language model, is a potentially patient-friendly online tool capable of providing health-related knowledge. This study aims to assess the accuracy and repeatability of ChatGPT in responding to questions related to H. pylori.

MATERIALS AND METHODS

Twenty-one common questions about H. pylori were collected and categorized into four domains: basic knowledge, diagnosis, treatment, and prevention. ChatGPT was utilized to individually answer the aforementioned 21 questions. Its responses were independently assessed by two experts on H. pylori. Questions with divergent ratings were resolved by a third reviewer. Cohen's kappa coefficient was calculated to assess the consistency between the scores of the two reviewers.

RESULTS

The responses of ChatGPT on H. pylori-related questions were generally satisfactory, with 61.9% marked as "completely correct" and 33.33% as "correct but inadequate." The repeatability of the responses of ChatGPT to H. pylori-related questions was 95.23%. Among the responses, those related to prevention (comprehensive: 75%) had the best response, followed by those on treatment (comprehensive: 66.7%), basic knowledge (comprehensive: 60%), and diagnosis (comprehensive: 50%). In the "treatment" domain, 16.6% of the ChatGPT responses were categorized as "mixed with correct or incorrect/outdated data." However, ChatGPT still lacks relevant knowledge regarding H. pylori resistance and the use of sensitive antibiotics.

CONCLUSIONS

ChatGPT can provide correct answers to the majority of H. pylori-related queries. It exhibited good reproducibility and delivered responses that were easily comprehensible to patients. Further enhancement of real-time information updates and correction of inaccurate information will make ChatGPT an essential auxiliary tool for providing accurate H. pylori-related health information to patients.

A Social Media Quality Review of Popular Sinusitis Videos on TikTok

OBJECTIVE

Social media may inform health care decisions among younger patient populations. TikTok is a social media platform that allows users to post short-form videos. This study aimed to assess the quality of sinusitis-related videos on TikTok.

STUDY DESIGN

We searched TikTok on January 29, 2023, for sinusitis-related hashtags: #sinusitis, #sinus, #sinusinfection.

SETTING

Internet.

METHODS

The number of views/shares per day, uploader type (nonmedical influencer, lay individual, and medical professional) content categories (medical advice, marketing, comedy, and lifestyle/acceptability), and content type (educational vs factual) were collected. The Patient Education Materials Assessment Tool for Audiovisual Material and Journal of the American Medical Association criteria score was used to measure understandability, actionability, and reliability. The Global Quality Scale (GQS) was used to evaluate the quality of videos; the harm/benefit score was used to evaluate causative effects. Analyses were performed using analysis of variance (α = .05).

RESULTS

There were 221 videos identified, which garnered over 300 million views and 1 million shares. Almost half of the videos were published by nonmedical influencers. When controlling for covariates, nonmedical influencers and lay uploaders were more likely to have harmful harm/benefit scores, less understandable videos, and lower GQS scores compared to medical professionals. Less than half of videos posted by nonmedical influencers categorized as educational were factual (46.7%); lay individuals and medical professionals had higher rates of factual educational content (79.9% and 83.7%, respectively).

CONCLUSION

Most nonmedical influencer-posted TikTok videos about sinusitis are inaccurate, despite being portrayed as medical advice/educational. Rhinologists must find modern ways to disseminate true disease-related content via social media to combat medical misinformation.

TikTok Tracheostomy Video Analysis of Quality, Credibility, and Readability

Objective The goal of this study is to analyze the quality, credibility, and readability of videos on TikTok related to tracheostomy in order to assess the adequacy of the information for patient and parental education purposes. Study design This was a cross-sectional analysis of online content. Methods The social media platform TikTok was explored for videos related to tracheostomy. The search function was utilized with multiple hashtags related to tracheostomy and videos were reviewed and scored for quality, credibility, and readability. Each of the videos was assessed using the DISCERN criteria, JAMA benchmark, and readability score based on text either presented in the video or written in the caption. Pearson's correlation coefficient was calculated for each of the studied parameters. Results The TikTok search bar was queried using multiple hashtags, including "#trach," "#tracheostomy," "#trachea," and "#tracheotomy" for relevant videos from October 14 to October 15, 2021. Overall, 60 videos were selected for complete review and analysis. The total views for all related videos analyzed was 17,712,281. The total likes were 693,812. The videos were primarily posted by non-healthcare professionals making up approximately 72% of all videos. Videos created by physicians generated 63% of all views. The average DISCERN score for each video was 24.83 out of 75. The average Flesch Reading Ease score was 70.59 and the average Flesch-Kincaid Grade level was 5.5. There was a positive DISCERN score and views with R = 0.255 (p = 0.049), positive correlation between DISCERN and likes R = 0.334 (p = 0.009), positive correlation between DISCERN and JAMA R = 0.56 (p=<0.0001), positive correlation between DISCERN and Flesch-Kincaid Grade Level R = 0.330 (p=0.010) and a negative correlation between DISCERN and Flesch Reading Ease Score R = -0.337 (p=0.009). There was also a statistically significant positive correlation between JAMA and Flesch-Kincaid Grade Level R = 0.260 (p=0.045). Conclusion Overall, the quality of the videos on TikTok regarding tracheostomy rated poorly on the DISCERN quality index but included text that was fairly easy to read. Currently, medical videos on TikTok do not meet the quality metrics needed to properly educate the public and should not be used as a primary resource.

Myopia information on TikTok: analysis factors that impact video quality and audience engagement

BACKGROUND

TikTok is emerging as a vital platform for health information dissemination. Despite myopia being a global public health issue, the high-quality myopia information shared by health educators often fails to go viral. It is imperative to analyze the factors influencing video quality and popularity, especially from diverse perspectives of researchers, health educators, and audiences.

METHODS

TikTok myopia-related videos were retrieved using TikTok's default comprehensive search (DCS) and most liked search (MLS) strategies. Venn diagrams were employed to illustrate the relationships and commonalities between the two strategies across four sample sizes (top 200, 150, 100, and 50). Video metadata, including details such as creator information, production properties, upload time, video duration, and viewer engagement, were collected. Video quality was assessed using the DISCERN tool. Video content covering six aspects of myopia were evaluated. The impact of search strategies, video sample sizes, production properties, and myopia content on video quality and audience engagement was analyzed through single-factor or multi-factor analysis.

RESULTS

DCS and MLS retrieval strategies, as well as varying sample sizes, resulted in differences in audience engagement for myopia videos (P < 0.039), while The DISCERN quality scores remained comparable (P > 0.221). Videos published by healthcare professionals (HCPs) and non-profit organizations (NPOs) were associated with high-quality (P ≤ 0.014) but comparatively lower popularity (P < 0.033). Videos that reported contents of risk factors, management, and outcomes showed high popularity (P < 0.018), while longer video duration (> 60s) exhibited the opposite trend (P < 0.032). Content on myopia evaluation (P ≤ 0.001) and management (P ≤ 0.022) and video duration were positively correlated with higher DISCERN quality.

CONCLUSION

Videos created by HCPs and NPOs deserve greater attention. Rather than pursuing entertaining effects, professional educators should emphasize producing concise, and high-quality myopia content that readily resonates with the audience and has the potential to go viral on the platform.

Quality assessment of videos on social media platforms related to gestational diabetes mellitus in China: A cross-section study

Purpose

This study aimed to systematically evaluate the quality of content and information in videos related to gestational diabetes mellitus on Chinese social media platforms.

Methods

The videos on various platforms, TikTok, Bilibili, and Weibo, were searched with the keyword "gestational diabetes mellitus" in Chinese, and the first 50 videos with a comprehensive ranking on each platform were included for subsequent analysis. Characteristic information of video was collected, such as their duration, number of days online, number of likes, comments, and number of shares. DISCREN, JAMA (The Journal of the American Medical Association) Benchmark Criteria, and GQS (Global Quality Scores) were used to assess the quality of all videos. Finally, the correlation analysis was performed among video features, video sources, DISCERN scores, and JAMA scores.

Results

Ultimately, 135 videos were included in this study. The mean DISCERN total score was 31.84 ± 7.85, the mean JAMA score was 2.33 ± 0.72, and the mean GQS was 2.00 ± 0.40. Most of the videos (52.6%) were uploaded by independent medical professionals, and videos uploaded by professionals had the shortest duration and time online (P < 0.001). The source of the video was associated with numbers of "likes", "comments", and "shares" for JAMA scores (P < 0.001), but there was no correlation with DISCERN scores. Generally, videos on TikTok with the shortest duration received the most numbers of "likes", "comments", and "shares", but the overall quality of videos on Weibo was higher.

Conclusion

Although the majority of the videos were uploaded by independent medical professionals, the overall quality appeared to be poor. Therefore, more efforts and actions should be taken to improve the quality of videos related to gestational diabetes mellitus.

A New Spectrum of Self-Injuries: TikTok-Linked Lesions

The end of childhood and adolescence are two critical periods. Patients' immaturity in making decisions can lead to irreversible health consequences. The use of social media exposing children to a wide variety of content may result in dangerous behavior. This has been seen with the emergence of many challenges such as the "Eraser Challenge," "Salt Ice Challenge," and "Benadryl Challenge." Here, we describe two cases of dermatologic lesions linked to social media challenges.

#lowbackpain on TikTok: A New Frontier for Orthopaedic Medical Education

INTRODUCTION

Low back pain has become a substantial health problem in all developed countries. Many healthcare professionals and content creators have begun sharing their treatment methods and opinions through social media, especially the video-based platform TikTok. TikTok has been downloaded more than 2.6 billion times with over a billion daily users. Its influence on public health makes it imperative that information be accurate and safe. This study aims to analyze TikTok's most popular content on lower back pain and how orthopaedic surgeons contribute on this growing platform.

OBJECTIVES

To analyze TikTok's most popular content on lower back pain and how orthopaedic surgeons are and can contribute on this growing platform.

METHODS

A TikTok search conducted on April 22, 2023, using the terms '#lowerbackpain'and '#lowbackpainrelief,' resulted in numerous videos, 100 of which met inclusion criteria. Videos were included if they were related to the content, had more than 1000 views, were in English, and were not duplicates. Video characteristics were recorded and evaluated for quality by two reviewers using DISCERN. A two-sample t-test was used to assess differences.

RESULTS

Overall, the top videos on lower back pain had an average of 2,061,396 views, with a mean DISCERN score of 34. The mean total DISCERN score was 36 and 34 for physicians and nonphysicians, respectively, while the video by the orthopaedic surgeon (n = 1) scored 31. The most recommended treatments included at-home exercises (n = 75) and visiting a chiropractor (n = 4).

CONCLUSION

We find that the information presented by nonphysicians offered quick, at-home fixes to medical problems without offering any research or proven data to support their claims. We cannot overlook Tiktok's immense influence in the realm of orthopaedic health as it has become a sphere of information dissemination and education. Thus, we suggest that there is not necessarily a need for a greater number of surgeons and/or resident physicians to involve themselves on the platform, but rather the involvement of governing bodies and spine societies to put out position statements for our patients.

Short video platforms as sources of health information about cervical cancer: A content and quality analysis

BACKGROUND

The development of short popular science video platforms helps people obtain health information, but no research has evaluated the information characteristics and quality of short videos related to cervical cancer. The purpose of this study was to evaluate the quality and reliability of short cervical cancer-related videos on TikTok and Kwai.

METHODS

The Chinese keyword "cervical cancer" was used to search for related videos on TikTok and Kwai, and a total of 163 videos were ultimately included. The overall quality of these videos was evaluated by the Global Quality Score (GQS) and the modified DISCERN tool.

RESULTS

A total of 163 videos were included in this study, TikTok and Kwai contributed 82 and 81 videos, respectively. Overall, these videos received much attention; the median number of likes received was 1360 (403-6867), the median number of comments was 147 (40-601), and the median number of collections was 282 (71-1296). In terms of video content, the etiology of cervical cancer was the most frequently discussed topic. Short videos posted on TikTok received more attention than did those posted on Kwai, and the GQS and DISCERN score of videos posted on TikTok were significantly better than those of videos posted on Kwai. In addition, the videos posted by specialists were of the highest quality, with a GQS and DISCERN score of 3 (2-3) and 2 (2-3), respectively. Correlation analysis showed that GQS was significantly correlated with the modified DISCERN scores (p<0.001).

CONCLUSION

In conclusion, the quality and reliability of cervical cancer-related health information provided by short videos were unsatisfactory, and the quality of the videos posted on TikTok was better than that of videos posted on Kwai. Compared with those posted by individual users, short videos posted by specialists provided higher-quality health information.

The internet and various social media platforms as source of information to patients with wounds in Kenya

Background

The internet has led to the realization that the world is a global village. Due to technological advancements, anyone can access the internet and various video sharing platforms and in turn, get access to or share information across the world. One of the most sought-after critical pieces of information on the internet, as well as social media platforms, is information regarding wounds.

Objective

To determine the views of patients with chronic wounds regarding the internet and other social media platforms as a source of information regarding wounds.

Methodology

A descriptive prospective study covering the period between November 1, 2022, and January 30, 2023. All patients with chronic wounds presenting in the plastic outpatient clinic, together with patients presenting themselves in the wound clinic at Kenyatta National Hospital (KNH) during this period, were informed about the study and asked to participate. After consenting, they were then required to sign an informed consent form after agreeing to participate. Data collection was done through interviews and filled out in structured questionnaires. Data points included demographics, information on internet use, and interaction with the various social media platforms.

Results

83.4% of the participants were of the opinion that the contents shared were done so by professionals, compared to 12.5% who indicated that the owners or uploaders of the contents were laymen. 2.6% and 1.5%, on the other hand, opined that the owners or uploaders of the contents were unknown and difficult to tell, respectively.

Discussion

The participants in the current study felt that some aspects regarding content on wounds that is shared on the internet as well as other social media platforms would need further improvement. Such areas included information regarding wound dressing concepts, the etiology and pathophysiology of wounds, complications of wounds, and wound pain management.

The emergence of MedTok: a qualitative analysis of popular medical TikTok videos

Social media is increasingly being used by the public as a medium for health information. Unfortunately, misinformation has become widely available on these sites, often being provided using content that is designed to be more popular and engaging, and it is difficult for the public to differentiate between what is true and what is false. TikTok is one of these platforms and has been rapidly growing over the last few years. As an increasing number of people look to TikTok for their health information, it is important that quality information is accessible and popular on the platform. We conducted a review of TikTok videos using the top 10 videos to show when searching for 13 common conditions. Characteristics of both the creator and video were recorded and analyzed. Videos on conditions commonly diagnosed younger were commonly produced by younger creators with the condition, often based on their own experiences. Conversely, videos on conditions commonly diagnosed older were commonly produced by healthcare professionals providing educational information. Though for conditions affecting older individuals healthcare professionals may be able to create didactic, educational videos, for those affecting younger individuals, it may be beneficial to partner with younger creators, or "influencers," to produce more viral content. Further studies may expand on these ideas to encompass more facets of healthcare. As this study did not analyze the quality of the information in the videos, future research should also focus on determining the quality of popular content on TikTok and other social media platforms.

Characteristics, hotspots, and prospects of short video research: A review of papers published in China from 2012 to 2022

In recent years, due to the increase in their global popularity, short video applications have become an important topic of research. The number of users has now exceeded one billion in China; accordingly, Chinese researchers have conducted many studies on short videos. Their findings can serve as important references for both theoretical research on and the practical development of short videos worldwide. In this study, we used bibliometrics method and the CiteSpace application to analyze the content of 2163 representative research papers on short videos published in China from 2012 to 2022. The number of such papers is increasing annually in China; moreover, several core groups of authors and research institutions focusing on short video research have already been formed. Some popular topics of research on these videos include the main characteristics of short videos, phenomenon of media convergence based on short videos, and application scenarios of short videos. Over the years, research on the popular short video application Douyin has been increasing, as well. The research results indicate that issues such as the marketing of short knowledge videos, standardized management of short video platforms, and impact of these videos on the education of college students are expected to become popular subjects of scholarly research in the near future.

Qualitative Assessment of Vulvovaginal Health Information on Social Media

STUDY OBJECTIVE

Adolescents and young adults use vulvovaginal hygiene practices, products, and treatments. Access to social media platforms allows health information, including gynecologic care, to be easily disseminated and more accessible. Our objective was to characterize and assess vulvovaginal health information available on a popular video-sharing social media platform.

METHODS

In this cross-sectional analysis study, search terms related to vulvovaginal health were included to assess the top videos appearing on June 15, 2022. Descriptive statistics, uploader demographic characteristics, and content characteristics were recorded for each video. Information quality was evaluated using the DISCERN instrument.

RESULTS

One hundred and sixty-four videos met the study criteria with a combined total of over 500 million views, over 1.5 million shares, and nearly 60 million likes. Over 90% of videos consisted of educational content or product advertisements, and nearly 70% of videos provided information on general vulvovaginal hygiene and health. Seventy-five percent of videos were uploaded by private companies and nonmedical individuals. The mean DISCERN score was 1.6 out of 5. Medical providers scored significantly better than other uploaders on 12 of 16 DISCERN items, and mean overall publication quality scores were significantly higher for videos created by medical providers than nonmedical individuals and private companies (P < .0001).

CONCLUSION

Social media platforms are a popular medium for vulvovaginal health information, accumulating over half a billion views within a short timeframe. Although medical providers had fewer shortcomings in their videos, the overall quality of health information shared was low, with serious or extensive shortcomings.

The individual-level effects of social media campaigns related to healthy eating, physical activity, and healthy weight: A narrative review

Objective

Social media are promising channels for health communication promoting positive weight-related behaviors, but no prior studies have synthesized evidence on the independent effects of social media campaigns focused on promoting healthy eating, physical activity (PA), and healthy weight. This study aimed to fill that gap and inform future social media-based obesity-prevention research and practice by reviewing findings from studies testing the effects of such campaigns on individual-level cognitive, behavioral, and anthropometric outcomes.

Method

The Web of Science and PubMed databases were searched for peer-reviewed articles published between 2012 and 2023 that explored the independent effects of social media campaigns related to healthy eating, PA, or weight management. Study characteristics and outcomes were extracted and summarized.

Results

Eleven studies were included in this review describing campaigns targeting healthy eating-related outcomes (e.g., fruit and vegetable consumption, meal preparation, nutrition label reading), PA, or weight management. Most campaigns (n = 7) were developed by universities or research centers. Priority audiences included parents, adult females, adolescents, college students, and adult government employees. The majority (n = 8) of the campaigns used single platforms, with the most common being Facebook, Instagram, blogs, and YouTube. Campaigns had mixed effects on cognitive outcomes (e.g., intention, attitude, knowledge), behavioral outcomes (e.g., food choices, PA), and anthropometric outcomes (e.g., weight, waist circumference).

Conclusion

Social media campaigns focused on promoting healthy eating, PA, and healthy weight had mixed effects on individual-level cognitive, behavioral, and anthropometric outcomes. Various limitations of the included studies make it difficult to ascertain which factors influence campaign effectiveness. Advancing knowledge in this area is important, particularly given social media's widespread use and potential for broad reach. New research with features such as rigorous study designs, larger and more diverse samples, and strong theoretical foundations may provide important insights into what types of interventions are effective or not and under what conditions.

Barriers and Facilitators of Self-Management for Older Adults Living With Type 2 Diabetes Mellitus: A Qualitative Study in China

PURPOSE

The purpose of the study was to explore the barriers to and facilitators of self-management among older adults with type 2 diabetes mellitus (T2DM).

METHODS

This study followed a qualitative descriptive methodology. Older adults with T2DM living in Jinan, Shandong Province, China were recruited using purposive sampling. Information saturation was used to gauge the sample size. Semistructured interviews were conducted with 23 participants. The data analysis was guided using a thematic approach. Themes were inducted from the interview data undergirded by the cumulative complexity model.

RESULTS

The key findings of this study are presented in terms of 2 themes: facilitators of T2DM self-management and barriers to T2DM self-management. Each theme has subthemes, including that having family members with diabetes, having family members who are health care professionals, and visual cues were factors for good self-management practices by older adults with T2DM. Conversely, poor health status (ie, multimorbidity and lower-limb dysfunction and pain) and intergenerational care responsibilities were identified as barriers to effective self-management. Moreover, the use of media resources, especially traditional media, was found to both assist and hinder participants in their self-management practices.

CONCLUSION

The findings from this study can inform new research to build on existing self-management promotion programs and restructure existing services to improve the self-management of older adults with T2DM. With the increase in the number and types of media outlets, our finding implies that researchers or clinical practitioners may develop strategies to leverage media resources to enhance the self-management of diabetes among older adults with T2DM.

Willingness to reduce alcohol consumption predicted by short-form video exposure, media involvement, psychological bias, and cognitive factor

Introduction

Through previous studies, Chinese college students are known to be prone to alcohol consumption, which can lead to health-risk behaviors such as high blood pressure, heart disease, stroke, liver disease, and digestive problems. However, little is known about how popular social media platforms (e.g., short-form video applications) can positively impact their willingness to reduce alcohol consumption. This study was guided by the theory of optimistic bias; we investigated the direct, mediated, and moderating effects of exposure to anti-alcohol consumption short-form videos and short-form video involvement on Chinese college students' willingness to reduce their alcohol consumption.

Methods

The current study has an empirical cross-sectional design and employed an online survey from September 1st, 2022, to November 1st, 2022. The survey specifically targeted Chinese college students, who are the most common users of short-form video applications. The accumulated data underwent rigorous examination, including hierarchical regression, mediation, and moderation analyses, all conducted using the PROCESS macro 4.0 within SPSS version 22.

Results

A total of 434 participants, aged 18-24 years, were included in this study. There were mediating effects regarding Chinese college students' exposure to anti-alcohol consumption short-form videos (β = 0.35, p < 0.01, 95% CI [0.17, 0.63]) and short-form video involvement (β = 0.44, p < 0.001, 95% CI [0.20, 0.65]) on their willingness to reduce alcohol consumption via reversed optimistic bias. Moreover, perceived prevention of heavy drinking control (β = 0.05, p < 0.001, 95% CI [0.01, 0.09]) played mediating roles in the relationship between exposure to anti-alcohol consumption short-form videos and willingness to reduce alcohol consumption.

Conclusion

This study is one of the earliest studies to examine the intricate effects of exposure to anti-alcohol consumption short-form videos and short-form video involvement on the willingness to reduce alcohol consumption among Chinese college students. In addition, this study confirms that regardless of whether Chinese college students are conscientious, exposure to anti-alcohol consumption short-form videos did not increase their level of reversed optimistic bias. The empirical findings of this study are critical and can provide practical insights for Chinese health departments that encourage Chinese college students to minimize alcohol consumption.

The status quo of short videos as a health information source of Helicobacter pylori: a cross-sectional study

Background

Health education about Helicobacter pylori (H. pylori) is one of the most effective methods to prevent H. pylori infection and standardize H. pylori eradication treatment. Short videos enable people to absorb and remember information more easily and are an important source of health education. This study aimed to assess the information quality of H. pylori-related videos on Chinese short video-sharing platforms.

Methods

A total of 242 H. pylori-related videos from three Chinese short video-sharing platforms with the most users, TikTok, Bilibili, and Kwai, were retrieved. The Global Quality Score (GQS) and the modified DISCERN tool were used to assess the quality and content of videos, respectively. Additionally, comparative analyzes of videos based on different sources and common H. pylori issues were also conducted.

Results

The median GQS score and DISCERN score was 2 for H. pylori-related videos analyzed in this study. Non-gastroenterologists posted the most H. pylori-related videos (136/242, 56.2%). Videos from gastroenterologists (51/242, 21.0%) had the highest GQS and DISCERN scores, with a median of 3. Few videos had content on family-based H. pylori infection control and management (5.8%), whether all H. pylori-positive patients need to undergo eradication treatment (27.7%), and the adverse effects of H. pylori eradication therapy (16.1%).

Conclusion

Generally, the content and quality of the information in H. pylori-related videos were unsatisfactory, and the quality of the video correlated with the source of the video. Videos from gastroenterologists provided more correct guidance with higher-quality information on the prevention and treatment of H. pylori infection.

Quality assessment of online osteosarcoma-related videos in Mainland China: A cross-sectional study

BACKGROUND

Information about orthopedics diseases on the Internet has not been extensively assessed. Our purpose was to evaluate the quality of online information of osteosarcoma on current video-sharing platforms in mainland China.

METHOD

TikTok and Bilibili were independently queried from June to July 2023 by four independent researchers using the Microsoft Edge web browser. Information about the videos and creators was recorded, and descriptive analyses were conducted.

RESULTS

After data extraction, a total of 95 videos were included, in which 43 videos were uploaded by certified doctors (45.3%), with 35 videos (36.8%) uploaded by certified orthopedic surgeons. Of the content of these videos, 78.9% were introduction (n = 75), 64.2% were on professional knowledge (n = 61), 28.4% were on treatment (n = 27), while 5.3% were on surgical techniques (n = 5). The mean DISCERN total score was 43.8 ± 13.4, and the mean JAMA score was 3.8 ± 0.3.

CONCLUSIONS

Videos about osteosarcoma on current video-sharing platforms were extensive, but were not comprehensive and professional. Although current online videos have the potential to improve public awareness on osteosarcoma, due to their quality and content, were not assessed to be good sources for medical education.

Gluten-free diet on video platforms: Retrospective infodemiology study

Background

Video platform is an important approach for individuals to access and adopt health information. Online information on gluten-free diet (GFD) videos remains underinvestigated.

Methods

GFD videos were identified by hashtag-based searching strategy. Videos' basic information, engagement metrics, and content were recorded. Mann-Kendall test was performed to examine time trends of submitting videos and engagement metrics. Video quality was evaluated by the DISCERN instrument and the HONcode.

Results

A total of 822 videos were included in the analysis, with the majority focusing on gluten-free food recipes. The number of videos related to GFD was showing an upward trend. Engagement metrics varied between platforms and video types, with non-recipe videos receiving higher user engagement. The average DISCERN score was 50.20 out of 80 and the average HONcode score was 1.93 out of 8. Videos submitted by health professionals demonstrated better quality compared to those submitted by patients or general users.

Conclusion

There was a rise in the number of videos related to GFD on Chinese video platforms. The overall quality of these videos was poor, most of them were not rigorous enough. Highlighting using social media as a health information source has the potential risk of disseminating one-sided messages and misleading. Efforts should be made to enhance the transparency of advertisements and establish clear guidelines for information sharing on social media platforms.

Information quality of videos related to Helicobacter pylori infection on TikTok: Cross-sectional study

BACKGROUND

Helicobacter pylori (H. pylori) poses serious threats to human health. TikTok (Douyin in Chinese), a major social media platform focused on sharing short videos, has demonstrated great potential in spreading health information, including information related to H. pylori infection. This study aims to evaluate the content and quality of the information shared in TikTok videos about H. pylori infection in mainland China.

METHODS

We collected a sample of 116 videos in Chinese related to H. pylori infection from TikTok. Video contents were evaluated by the coding schema proposed by Goobie et al., and the Hexagonal Radar Schema was used to intuitively display the spotlight and weight of each aspect of the videos. The DISCERN questionnaire was used to evaluate the quality of the videos.

RESULTS

We identified two major sources of videos related to H. pylori: individual users (n = 89) and organizational users (n = 27). Regarding content, the Hexagonal Radar Charts showed that more than 35% of the videos delivered moderate to high quality content (>1 point) in terms of definition, symptoms and management of the disease, whereas risk factors, evaluation and outcomes of the disease were less discussed. The DISCERN classification data showed that 0.9% of the videos were "very poor," 5.2% "poor," 68.7% "fair," 20.0% "good," and only 5.2% "excellent". Regarding total DISCERN scores, videos published by nonprofit organizations had the highest scores, followed by videos uploaded by health professionals.

CONCLUSION

Although the overall quality of TikTok videos related to H. pylori infection was medium, users should be careful when obtaining information related to H. pylori infection on TikTok and opt for videos uploaded by nonprofit organizations and health professionals.

TikTok video as a health education source of information on heart failure in China: a content analysis

Background

Heart failure (HF) is a complex and life-threatening syndrome associated with significant morbidity and mortality. While TikTok has gained popularity as a social media platform for sharing HF-related information, the quality of such content on TikTok remains unexplored.

Methods

A cross-sectional analysis was conducted on TikTok videos related to HF in China. The sources of the videos were identified and analyzed. The content comprehensiveness of the videos was evaluated using six questions that covered definition, signs and symptoms, risk factors, evaluation, management, and outcomes. The reliability and quality of the videos were assessed using three standardized evaluation instruments: DISCERN, JAMA benchmarks, and the Global Quality Scale. Additionally, the correlation between video quality and video characteristics was further investigated.

Results

Among the video sources, 92.2% were attributed to health professionals, while news agencies and non-profit organizations accounted for 5.7% and 2.1%, respectively. The content comprehensiveness score for the videos was 3.36 (SD 3.56), with news agencies receiving the highest scores of 4.06 (SD 3.31). The median DISCERN, JAMA, and GQS scores for all 141 videos were 26.50 (IQR 25.00-28.750), 2.00 (IQR 2.00-2.00), and 2.00 (IQR 2.00-2.00), respectively. Videos from health professionals had significantly higher JAMA scores compared to those from non-profit organizations (P < 0.01). Correlation analysis between video quality and video characteristics showed positive correlations between content comprehensiveness scores and video duration (r = 0.420, P < 0.001), number of comments (r = 0.195, P < 0.05), and number of shares (r = 0.174, P < 0.05). GQS scores were negatively or positively correlated with the number of days since upload (r = -0.212, P < 0.05) and video duration (r = 0.442, P < 0.001).

Conclusion

The overall quality of the videos was found to be unsatisfactory, with variations in quality scores observed across different video sources. Content comprehensiveness was inadequate, the reliability and quality of the information presented in the videos was questionable. As TikTok continues to grow as a platform for health information, it is essential to prioritize accuracy and reliability to enhance patients' self-care abilities and promote public health.

Analyzing the Quality, Reliability, and Educational Value of ACL Rehabilitation Exercises on TikTok: A Cross-Sectional Study

Background

Videos relating to rehabilitation exercises for common injuries relevant to younger populations such as anterior cruciate ligament (ACL) tear receive high view counts on social media platforms such as TikTok.

Purpose/Hypothesis

The purpose of this study was to analyze the quality, reliability, and educational value of TikTok videos among the patient population for ACL injury. It was hypothesized that TikTok videos related to ACL rehabilitation exercises would lack quality, reliability, and educational value.

Study Design

Cross-sectional study.

Methods

TikTok was queried for relevant videos using the hashtags "#ACLrehab" and "#ACLexercises." For each included video, the type of uploader (general user or health care professional) was identified. In addition, the number of views, likes, shares, comments, and favorites for each included video was recorded, and the content of each video was graded using the DISCERN (a well-validated informational analysis tool) and the ACL exercise education score (ACLEES - a custom-designed tool for the evaluation of ACL-related exercises).

Results

A total of 111 videos with 5,520,660 cumulative views were included; the median number of views per video was 9801.0 (interquartile range [IQR], 3583.0-28,000.0). Of these videos, 84 and 27 were created by the general public and health care professionals, respectively. The videos collectively received 335,577 likes, 2969 comments, 22,856 favorites, and 6142 shares, with a median of 439 (IQR, 111-1374), 10 (IQR, 2.5-25.5), 54 (IQR, 18-172.5), and 12 (IQR, 2-36), respectively. The tabulated scores for the DISCERN and ACLEES between general users and health care professionals were all statistically nonsignificant. Health care professionals had a higher percentage of videos with a "very poor" DISCERN score in comparison with the general public (66.67% vs 53.57%, respectively).

Conclusion

The overall educational value of the TikTok videos related to ACL rehabilitation exercises was very poor. Health care professionals should be aware of the broad distribution of ACL rehabilitation exercise videos that are accessible on TikTok and raise awareness of the deficiencies of the platform as a medium for educational medical-related information.

Evaluation of the quality of thyroidectomy-related posts on a video-based social media platform

Objective

To evaluate the quality of thyroidectomy-related posts on TikTok, the fastest-growing social media platform worldwide.

Methods

Videos posted from April 2020 to September 2022 were queried on TikTok using the search terms "thyroidsurgery," "thyroidectomy," and "thyroidremoval." Two reviewers recorded thematic, demographic, and performance data of these posts. The DISCERN instrument was used to evaluate the quality and reliability of the information contained in the videos. Descriptive statistics were used to characterize post-submitter demographics and video content. Simple and multiple linear regression analyses were used to evaluate the association between DISCERN scores and video characteristics. Univariate analysis of variance was performed to compare DISCERN scores between author types.

Results

In this study, 228 TikTok videos were included which totaled over 23 million views. On average, each video accumulated more than 6000 "likes," 300 comments, and 70 shares. The average total DISCERN score was 27.46, which is deemed to be of poor overall quality. Upon multiple linear regression, video duration (β = 4.66, p < .001) and educational subject type (β = 3.97, p < .001) significantly positively predicted aggregate DISCERN scores, while journey subject type (β = -3.19, p = .006), and reassurance subject type (β = -2.52, p = .035) significantly negatively predicted aggregate DISCERN scores. Aggregate DISCERN scores varied significantly (p < .05) between author types.

Conclusion

Social media posts on TikTok about thyroidectomy are mostly of poor quality and reliability but vary by authorship, subject type, and video characteristics. Given its widespread popularity, TikTok videos may have an increasing role in shaping patient perception of thyroidectomy and may represent an opportunity to provide education.

Lay summary

TikTok posts about thyroidectomy are mostly of poor quality but vary by authorship, subject, and video characteristics. Given its popularity, TikTok videos may have a role in shaping the patient perception of thyroidectomy and may represent an opportunity to provide education.

Level of evidence

Level 4.

Quality of Spine Surgery Information on Social Media: A DISCERN Analysis of TikTok Videos

OBJECTIVE

The use of social media applications to disseminate information has substantially risen in recent decades. Spine and back pain-related hashtags have garnered several billion views on TikTok. As such, these videos, which share experiences, offer entertainment, and educate users about spinal surgery, have become increasingly influential. Herein, we assess the quality of spine surgery content TikTok from providers and patients.

METHODS

Fifty hashtags encompassing spine surgery ("#spinalfusion," "#scoliosissurgery," and "#spinaldecompression") were searched using TikTok's algorithm and included. Two independent reviewers rated the quality of each video via the DISCERN questionnaire. Video metadata (likes, shares, comments, views, length) were all collected; type of content creator (musculoskeletal, layperson) and content category (educational, patient experience, entertainment) were determined.

RESULTS

The overall DISCERN score was, on average, 24.4. #Spinalfusion videos demonstrated greater engagement, higher average likes (p = 0.02), and more comments (p < 0.001) compared to #spinaldecompression and #scoliosissurgery. #Spinaldecompression had the highest DISCERN score (p < 0.001), likely explained by the higher percentage of videos that were educational (p < 0.001) and created by musculoskeletal (MSK) professionals (p < 0.001). Compared to laypersons, MSK professionals had significantly higher quality videos (p < 0.001). Similarly, the educational category demonstrated higher quality videos (p < 0.001). Video interaction trended lower with MSK videos and educational videos had the lowest interaction of the content categories (likes: p = 0.023, comments: p = 0.005).

CONCLUSION

The quality of spine surgery videos on TikTok is low. As the influence of the new social media landscape governs how the average person consumes information, MSK providers should participate in disseminating high-quality content.

Quality and educational content of Douyin and TikTok short videos on early screening of rectal cancer

Background and Aim

The aim of this study was to assess the quality and content of videos on Douyin and TikTok for their educational role on early screening of rectal cancer (RC).

Methods

We conducted a search for videos related to RC on the Douyin and TikTok applications on 20 April 2023. The search was conducted in Chinese on Douyin and in English and Japanese on TikTok. A sample of the first 100 videos recommended by the software was selected for each language group. The content of the videos was evaluated using a content scorecard, while the quality of the videos was assessed using DISCERN. Subsequently, we conducted two partial correlations: one between the DISCERN score and the number of likes, and another between the video content score and the number of likes.

Results

This study encompassed a total of 89 Chinese, 54 English, and 51 Japanese videos. After selection, 78 Chinese, 38 English, and 25 Japanese videos were identified to contain content related to early screening for RC, prompting further quality assessment. Notably, videos in the Chinese language showed the highest DISCERN score (P < 0.05). In terms of partial correlation analysis, it was observed that both the content score and DISCERN score did not show a significant correlation with the number of likes (P > 0.05).

Conclusion

In terms of quality score and content score, the Chinese videos on Douyin show superiority over the English and Japanese videos on TikTok. However, there is potential for improving the overall appeal of the Chinese videos.

The quality of information provided by the most popular dementia videos on TikTok

Summary of background

Dementia is among the leading causes of death and disability worldwide, having a major impact not only on the affected person but also on all of society. The Internet is a popular and growing source of health-related information for patients, family members, carriers, and physicians. TikTok, one of the most popular social media platforms, is an important source for knowledge access and adoption. However, the quality of health information on TikTok has not been sufficiently studied.

Objective

To evaluate the quality of the information provided in the most popular videos on dementia shared on TikTok.

Study design

A cross-sectional study.

Methods

The top 100 most popular videos on TikTok obtained by searching the hashtag "dementia" were included in the study and grouped based on their source and content. The popularity of the videos was estimated based on the numbers of likes, comments, and shares. The quality of health-related information was evaluated using the DISCERN score and the Global Quality Score (GQS).

Results

Videos had a median duration of 33.29 s; the median number of likes was 635,100, with a total of 93,698,200 likes, 903,859 comments, and 5,310,912 shares. The source (uploader) of 65% of the videos was family members, while only 4% were uploaded by doctors. The content was lifestyle-related in 62% of the videos, while 12% of the videos were for fun. Videos had a median DISCERN score of 22.5 (IQR 20-27) and a median GQS of 2 (IQR 1-3). The videos uploaded by doctors had the highest quality scores and the lowest popularity.

Conclusion

The most popular dementia videos on TikTok are mostly shared by family members and are of poor quality. Given the major public health issues associated with dementia, experts must provide appropriate and active assistance to patients in interpreting the information identified.

Sociocrinology: Impact of Social Media on Endocrine Health - A Review

Social media (SM) refers to social networking sites (SNSs), which are defined as online services that enable individuals to build a public or semi-public profile and give them the opportunity to create a network of contacts and interact. SM affects all aspects of life and may offer new opportunities to explore new experiences and perspectives of life because of its feasibility. But several times, because of feasibility, misinformation is generated intentionally or unintentionally, which spreads rapidly, and such misinformation can affect all aspects of life. However, health-related misinformation can be life-threatening to individuals. Endocrinology is the branch of medicine that deals with endocrine glands and hormones, which regulates mood, growth, development, metabolism and the way our organ works to maintain internal homeostasis. SM usage and endocrine health impact each other in both positive and negative ways. So, in this review, we will discuss about the effect of SM on Endocrine health.

TikTok as an Educational Tool for Kidney Stone Prevention

INTRODUCTION

The incidence of kidney stones in the United States continues to increase. Although dietary interventions have shown to be effective in reducing stone events, adherence to medical management continues to be a limiting factor. For that reason, patient education has become a focus of many physicians. TikTok, a social media application with over one billion users worldwide, has emerged as an online center for medical knowledge sharing by physicians and non-physicians alike. TikTok users share kidney stone prevention information through short informational videos directly to the general public. Little is known regarding the quality of medical advice provided in these videos. The purpose of this study was to evaluate the reach and quality of kidney stone prevention information on TikTok.

METHODS

We conducted a cross-sectional analysis of renal stone prevention content on TikTok utilizing the search term #kidneystoneprevention to assess all the videos appearing on October 10th, 2022. Only videos in English, related to the topic, and with >1000 views were included. Videos were analyzed for descriptive statistics, including views, uploader profession, and stone prevention recommendations. Videos were assessed utilizing Denver International Study Center of Evaluative Rating of Information (DISCERN), a questionnaire used to appraise the quality of consumer health information (maximum score of 80 per video). The one-way analysis of variance (ANOVA) was used to determine statistical significance groups.

RESULTS

Out of a total of 131 videos, 87 fit the inclusion criteria, resulting in a total of 8.75 million views. An average DISCERN score of 27.0 was observed. Only eight videos were published by physicians, of which the average DISCERN score of 35.3 was significantly greater than an average score of 26.2 for non-physicians (p<0.05). The most common recommendation was increased fluid intake (38.0%) followed by monitoring calcium levels (9.02%) and decreasing oxalate-rich foods (9.2%).

CONCLUSIONS

Kidney stone prevention content on TikTok has a wide reach with millions of consumers. The majority of videos fail to match American Urological Association recommendations regarding diet therapies for stone prevention. Further research is needed to understand the extent of kidney stone prevention misinformation on social media and how it contributes to patient outcomes. Increased engagement in TikTok by urologists and health organizations may improve public education.

A cross-sectional quality assessment of TikTok content on benign prostatic hyperplasia

BACKGROUND

With an increasing reliance on online sources for medical information, we studied the quality and completeness of health literacy videos on TikTok regarding BPH.

METHODS

A cross-sectional systematic evaluation of TikTok videos using the search term "Benign Prostatic Hyperplasia" was performed on 14th April 2023, and included 49 patient information and educational videos. The videos were then analysed by two reviewers and scored using two instruments: the DISCERN instrument and a completeness analysis.

RESULTS

Of the 49 videos, 38 were created by healthcare professionals (HCPs). The average length of each video was 62.7 ± 59.3 s, with a large average number of total views (24,990.1 ± 109,534.9 views). The DISCERN score trended higher in every category in videos published by HCPs compared to non-HCPs, with HCPs providing a statistically significant increase in reliability (19.0,14.6, p < 0.05) and total score (29.4,23, p < 0.05). Majority of videos were deemed as poor or worse (91.8%) in quality. The completeness of the videos' content was also evaluated across five categories with an average score of 2.53 ± 2.1 out of the maximum 12. The DISCERN scores did not correlate with the degree of completeness of the videos (r = 0.226).

CONCLUSION

BPH videos on TikTok have a wide reach, but the videos are mostly of low quality and completeness. Future videos should be made with quality and completeness in mind given the large viewership and more can be done to evaluate the extent of BPH misinformation and its impact on patients.

Association between eHealth literacy, diabetic behavior rating, and burden among caregivers of children with type 1 diabetes: Cross-sectional survey study

OBJECTIVE

The purpose of this study was to clarify the relationship between eHealth literacy, diabetic behavior rating, and caregiving burden among caregivers of children with type 1 diabetes mellitus (T1DM).

METHODS

A questionnaire-based cross-sectional study of 143 primary caregivers of T1DM was conducted. Electronic health literacy was quantified using the Chinese version of the eHealth Literacy Scale (eHEALS). Their diabetic management behavior rating and caregiving burden were measured by Diabetes Behavior Rating Scale-Parent Version (DBRS-P) and Zarit Burden Interview (ZBI), respectively. Pearson correlation analysis was used to estimate the relationship between the above variables.

RESULTS

Only 54 (37.76%) caregivers qualified by eHEALS scale, with a total score of 30.07 ± 4.54 out of 40. A positive correlation between DRBS-P scores and the scores of eHEALS (Pearson correlation coefficient r = 0.226, P = 0.007) and a negative correlation between ZBI and eHEALS scores (r = -0.166, P = 0.047) were observed.

CONCLUSIONS

The eHealth literacy level of caregivers of children with T1DM in China remains to be improved. Caregivers with higher eHealth literacy had better diabetic management behaviors and less caregiving burden.

IMPLICATIONS TO PRACTICE

This study suggests that hierarchical electronic health-based interventions should be designed according to the different levels of eHealth literacy of individuals, to enhance the ability of caregivers with different eHealth literacy levels to fully utilize eHealth resources to improve their daily disease management skills and reduce their burden when caring for T1DM children. In addition, improving eHealth literacy of caregivers for children with T1DM can be one of the important ways to enhance the effectiveness of electronic health-based programs designed for them.

Evaluation of the quality and reliability of anal cancer and its precancerous lesions-related content on YouTube: a cross-sectional study

OBJECTIVES

This research aims at evaluating the quality of anal cancer and its precancerous lesions-related videos on YouTube.

DESIGN

Cross-sectional survey design.

SETTING

USA.

PARTICIPANTS

The top 150 videos on YouTube were selected for analysis based on three search terms. The duplicate, irrelevant, commercial, operation-related and audio-free videos were excluded. Finally, 105 relevant videos were included.

METHODS

We assessed the completeness of video content from six dimensions and marked the men having sex with men (MSM)-related videos. To measure the video quality, DISCERN, Journal of the American Medical Association (JAMA) Benchmark Criteria, Patient Education Materials Assessment Tool (PEMAT) and Global Quality Scale (GQS) were used. The correlation between DISCERN classification and duration, JAMA, PEMAT and GQS scores were recorded.

RESULTS

The video content was mainly about the management of the disease (mean score 1.086). Overall, the quality of videos uploaded by the non-profit organisation was relatively high. A correlation existed between each other of the JAMA, DISCERN and GQS scores (p<0.001). Moreover, they were positively correlated with video duration and PEMAT scores (p<0.001).

CONCLUSIONS

Although the overall quality of information about anal cancer and its precancerous lesions videos on YouTube is acceptable, it might not fully meet the health information needs of patients. Therefore, they should exercise caution when using YouTube as a source of anal cancer-related information, especially the MSM population.

COVID-19 vaccine-related misinformation identification among Chinese residents during a regional outbreak

Objectives

Misinformation about the COVID vaccines poses a significant challenge to vaccination efforts in many countries. This study examined Chinese citizens' ability to correctly identify COVID-19 vaccine misinformation in geographic areas with and without a regional outbreak. We also investigated the associations between misinformation identification and information source usage, source trust, perceived information quality, and demographic characteristics.

Setting

The online survey was conducted in four cities from June 8th to 15th, 2021 in Guangdong Province, two of which were experiencing a regional surge of COVID-19 delta variant infections, and four cities in Hunan Province, a neighboring province largely unaffected.

Participants

A total of 4,479 individuals aged 18 and above completed the online questionnaire. Given survey length, those who finished the study under 5 min were excluded, resulting in a final sample of 3,800.

Outcome measurements

Misinformation identification, source exposure, source trust, and perceived information quality.

Results

Results showed slightly higher levels of correct misinformation identification in surge vs. non-surge areas. Trust in official information sources was positively associated with correct misinformation identification in full sample analysis, while trust in informal sources was negatively associated with the same outcome. Perceived information quality was positively associated with correct misinformation identification in the full sample.

Conclusion

Information providers in China should enhance the quality of the vaccine information they provide, and the Chinese public should balance their usage of different sources of information to acquire vaccine knowledge.

The quality and reliability of TikTok videos on non-alcoholic fatty liver disease: a propensity score matching analysis

Background

Lifestyle modification is the cornerstone of non-alcoholic fatty liver disease (NAFLD) prevention and treatment. Short video platforms can facilitate easier access to health information for patients, thereby influencing lifestyle changes. An increasing number of individuals rely on online platforms to acquire health-related information about NAFLD. However, the quality of information regarding NAFLD on these platforms remains unclear.

Objective

This study aimed to investigate the quality of information about NAFLD on TikTok.

Methods

A total of 497 videos were retrieved from TikTok. The basic video information, including the video source, was extracted. Two independent raters evaluated the quality and reliability of the videos using the Global Quality Score system and a modified DISCERN tool. Propensity score matching (PSM) was used to compare video quality across sources.

Results

NAFLD-related videos on TikTok were divided into three groups according to the uploader: health professionals, medical institutions, and science bloggers. Overall, the quality of NAFLD videos on TikTok was not satisfactory. Before PSM, there were no significant differences in video quality or content between the three groups. After PSM, the quality of NAFLD videos from health professionals was significantly better than the videos created by other groups. Besides, the videos of health professionals outperformed those of medical institutions and science bloggers in terms of the definition of disease, risk factors, and treatment, but were inferior to those of medical institutions considering the symptoms and tests of NAFLD.

Conclusion

The quality of NAFLD-related videos on TikTok needs improvement. Compared with videos created by science bloggers and medical institutions, videos from health professionals may provide accurate guidance on the treatment and prevention of NAFLD.

TikTok and Bilibili as sources of information on Helicobacter pylori in China: A content and quality analysis

BACKGROUND

Helicobacter pylori (H. pylori) is closely associated with gastric diseases and has a high prevalence in China. Public platforms are considered common and important tools to publicize H. pylori-related information. This study aimed to assess and compare the content and quality of H. pylori-related videos on TikTok and Bilibili.

MATERIALS AND METHODS

A search was performed on the TikTok and Bilibili platforms using the keyword "H. pylori". The source of upload was categorized as for-profit organizations, general users, health professionals, news agencies, nonprofit organizations, and science communicators. The Journal of American Medical Association (JAMA), Global Quality Scale (GQS), and modified DISCERN scores were used to evaluate the quality of the included videos.

RESULTS

A total of 93 TikTok videos and 79 Bilibili videos were included and analyzed. TikTok videos had a significantly shorter duration than Bilibili videos (64 vs. 149 s, respectively; p < 0.001). The duration of the video showed a positive correlation with the modified DISCERN and GQS scores (p < 0.001, r = 0.388 and r = 0.437, respectively). The JAMA and modified DISCERN scores of the TikTok video were significantly higher in health professionals and nonprofit organizations than in other sources (p < 0.05). For Bilibili, science communicators had a significantly higher JAMA score than the other video sources (p < 0.001). The videos uploaded by news agencies received more views, comments, shares, and favorites than any other organization or individual (p < 0.001).

CONCLUSIONS

In China, H. pylori-related videos from TikTok and Bilibili tended to provide the information regarding the transmission and eradication of H. pylori. However, many videos scored an average rating in content and quality and need to be improved. We recommend that the public obtain H. pylori-related information through videos uploaded by health professionals, nonprofit organizations, and science communicators.

Can Videos on TikTok Improve Pap Smear Attitudes and Intentions? Effects of Source and Autonomy Support in Short-Form Health Videos

This study was designed to test the effects of two message features (source and level of autonomy support) that are commonly found in short-form social media (e.g. TikTok) videos about Pap tests. The source is defined as who is communicating the message, and autonomy support refers to providing an individual with the independence, respect, and choice to make their own decision. In an online experiment, 636 females aged 21-29 viewed TikTok videos about Pap tests varying in source (doctor vs. peer) and level of autonomy support (either using controlling language to demand getting a Pap test or being supportive of one's choice of whether they receive a Pap test) and then responded to outcomes measures including perceived source credibility, perceived message effectiveness, attitude toward the message, attitude toward Pap tests, intention to engage with the videos, and intention to get a Pap test. Doctors were perceived as more credible than peers, and doctor videos were perceived to be more effective than peer videos. Autonomy support interacted with source, such that autonomy-supportive videos delivered by a doctor improved attitude toward the messaging and attitude toward Pap tests. Regardless of the source, autonomy-supportive videos increased intention to engage with the content on social media. As Pap test rates have recently declined among young women in the United States and viewing of Pap test-related videos has skyrocketed on the TikTok platform, short-form social media sites like TikTok may be an effective health communication tool for health professionals.

The promise and peril of using a large language model to obtain clinical information: ChatGPT performs strongly as a fertility counseling tool with limitations

OBJECTIVE

To compare the responses of the large language model-based "ChatGPT" to reputable sources when given fertility-related clinical prompts.

DESIGN

The "Feb 13" version of ChatGPT by OpenAI was tested against established sources relating to patient-oriented clinical information: 17 "frequently asked questions (FAQs)" about infertility on the Centers for Disease Control (CDC) Website, 2 validated fertility knowledge surveys, the Cardiff Fertility Knowledge Scale and the Fertility and Infertility Treatment Knowledge Score, as well as the American Society for Reproductive Medicine committee opinion "optimizing natural fertility."

SETTING

Academic medical center.

PATIENT(S)

Online AI Chatbot.

INTERVENTION(S)

Frequently asked questions, survey questions and rephrased summary statements were entered as prompts in the chatbot over a 1-week period in February 2023.

MAIN OUTCOME MEASURE(S)

For FAQs from CDC: words/response, sentiment analysis polarity and objectivity, total factual statements, rate of statements that were incorrect, referenced a source, or noted the value of consulting providers.

FOR FERTILITY KNOWLEDGE SURVEYS

Percentile according to published population data.

FOR COMMITTEE OPINION

Whether response to conclusions rephrased as questions identified missing facts.

RESULT(S)

When administered the CDC's 17 infertility FAQ's, ChatGPT produced responses of similar length (207.8 ChatGPT vs. 181.0 CDC words/response), factual content (8.65 factual statements/response vs. 10.41), sentiment polarity (mean 0.11 vs. 0.11 on a scale of -1 (negative) to 1 (positive)), and subjectivity (mean 0.42 vs. 0.35 on a scale of 0 (objective) to 1 (subjective)). In total, 9 (6.12%) of 147 ChatGPT factual statements were categorized as incorrect, and only 1 (0.68%) statement cited a reference. ChatGPT would have been at the 87th percentile of Bunting's 2013 international cohort for the Cardiff Fertility Knowledge Scale and at the 95th percentile on the basis of Kudesia's 2017 cohort for the Fertility and Infertility Treatment Knowledge Score. ChatGPT reproduced the missing facts for all 7 summary statements from "optimizing natural fertility."

CONCLUSION(S)

A February 2023 version of "ChatGPT" demonstrates the ability of generative artificial intelligence to produce relevant, meaningful responses to fertility-related clinical queries comparable to established sources. Although performance may improve with medical domain-specific training, limitations such as the inability to reliably cite sources and the unpredictable possibility of fabricated information may limit its clinical use.