Reliability, Quality, and Educational Suitability of TikTok Videos as a Source of Information about Scoliosis Exercises: A Cross-Sectional Study

Relationship and mechanisms between internet use and physical exercise among middle- and younger-aged groups

The "Internet Plus" era has established a closer connection between sports and individuals. This study used data from the 2018 China Family Panel Studies and focused on the middle- and younger-aged population aged 15 to 59 years. Employing a negative binomial regression model, this study empirically analyzed the impact of Internet use on physical exercise and its internal mechanisms among this population. The findings revealed that (1) Internet use significantly promoted physical exercise in the middle- and younger-aged population, with the frequency of physical exercise increasing to 1.549 times the original value; (2) The positive effects of the internet on physical exercise outweighed the negative effects, with online learning and entertainment enhancing physical exercise and online socialization limiting it. Specifically, online learning and entertainment increased the frequency of physical exercise among the middle- and younger-aged population by 0.063 and 0.018, respectively. Online socialization reduced the frequency by 0.023; and (3) The influence of internet use on physical exercise varies; significantly, it positively affects the exercise frequency among individuals over 35 years old and shows a positive correlation with employment status, including both employed individuals and those out of the labor market. The positive role of Internet use in encouraging physical exercise participation among the middle- and young-aged groups should be valued and enhanced.

Quality assessment of health science-related short videos on TikTok: A scoping review

OBJECTIVE

The aims of this review are to clarify the current state of research in terms of assessment tools and assessors of the quality of health science-related short videos on TikTok, to identify limitations in existing research; and to provide a reference for future studies.

METHODS

A scoping review was conducted. The Cochrane Library, PubMed, MEDLINE, Web of Science, Embase, Scopus, EBSCO, CNKI, VIP, Wanfang Data, and CBM databases were searched from September 2016 to November 2022. Manual searching was also performed to identify additional eligible studies. A total of 2620 documents were initially retrieved, and 29 were ultimately included. The literature was screened and collected, and data were extracted and summarized by 2 researchers.

RESULTS

(1) The quality evaluation tools used in the 29 papers included the DISCERN, PEMAT(A/V), GQS, JAMA, HONcode, guidelines and self-developed tools. Twenty-four of the included articles used the DISCERN for quality assessment, which was the most frequently used evaluation tool. However, most of these tools were not developed to assess health science-related short videos, lacked credibility tests, and had poor applicability; therefore, the accuracy of the evaluation results might be biased. (2) The assessors of the quality of health science-related short videos on TikTok were mainly experts in related fields and medical students, with doctors (12/14) being the most common evaluators. Fifteen studies did not report the identity of the evaluators, and 12 studies did not report interrater reliability.

CONCLUSION

This scoping review found that there is a lack of specific quality assessment tools for health science-related short videos on TikTok. Second, the current quality assessors of health science-related short videos on TikTok are limited. Future research should focus on the development of reliable, scientific quality assessment tools for health science-related short videos; unifying the evaluation standards; inviting users with different backgrounds and different health literacy levels to conduct quality assessments; exploring the quality assessment of health science-related short videos on TikTok from different perspectives.

TikTok content as a source of health education regarding epicondylitis: a content analysis

PURPOSE

This study aimed to assess the validity and informational value of TikTok content about epicondylitis. The hypothesis tested herein was that TikTok video content would not provide adequate and valid information.

METHODS

The term "epicondylitis" was used as a keyword to comprehensively search for TikTok videos, and the first 100 videos that were retrieved were subsequently included for analysis. The duration, number of likes, number of shares and number of views were recorded for each video. Furthermore, the videos were categorized on the basis of their source (medical doctor, physiotherapist, or private user), type of information (physical therapy, anatomy, clinical examination, etiopathogenesis, patient experience, treatment, or other), video content (rehabilitation, education, or patient experience/testimony), and the presence of music or voice. Assessments of video content quality and reliability were conducted using the DISCERN tool, the Journal of the American Medical Association (JAMA) benchmark criteria, and the Global Quality Score (GQS).

RESULTS

A total of 100 videos were included in the analysis: 78 (78.0%) were published by physiotherapists, 18 were published by medical doctors (18.0%), and 4 were published by private users (4.0%). Most of the information pertained to physical therapy (75; 75.0%) and most of the content was about rehabilitation (75; 75.0%). The mean length of the videos was 42.51 ± 24.75 seconds; the mean number of views was 193,207.78 ± 1,300,853.86; and the mean number of comments, likes, and shares were 22.43 ± 62.54, 1578.52 ± 8333.11, and 149.87 ± 577.73, respectively. The mean DISCERN score, JAMA score, and GQS were 18.12 ± 5.73, 0.80 ± 0.53, and 1.30 ± 0.52, respectively. Videos posted by medical doctors/private users had higher scores (p < 0.05) than videos posted by physiotherapists. Videos that focused on education or patient experience had higher scores (p < 0.05) than videos based on rehabilitation.

CONCLUSIONS

TikTok can be an unreliable source of information regarding epicondylitis treatment. It is common to find nonphysicians who share medical advice on the platform, with medical treatments demonstrating the weakest level of supporting evidence. Elbow surgeons should advise their patients that treatment recommendations from TikTok may not align with established guidelines.

LEVEL OF EVIDENCE

Level IV-Cross-sectional study.

Evaluating the Distribution, Quality, and Educational Value of Videos Related to Knee Instability Exercises on the Social Media Platform TikTok

Introduction TikTok, a globally popular short-form video platform, offers a unique space for healthcare professionals to share advice, particularly under common conditions such as knee pain or instability. Despite its popularity, doubts persist regarding the reliability of medical information disseminated on TikTok. This study aimed to evaluate the quality of TikTok videos as a source of patient information on knee instability, recognizing the need for a comprehensive assessment of potential misinformation on this influential social media platform. Methods A search for "knee stability exercises" on TikTok yielded 448 videos, of which 187 met the inclusion criteria. These videos were categorized by source and evaluated using the Knee Exercise Education Scoring Tool (KEEST) and an information analysis questionnaire, DISCERN. Results General user videos (69.84%) had notably lower DISCERN scores than healthcare professional videos (29.1%) across all categories (P < 0.001, P = 0.282, P = 0.131, and P = 0.010). The DISCERN scores were inversely linked to video metrics (views, likes, comments, favorites, and shares). General user videos were largely of poor quality (66.4%), whereas healthcare professional videos spanned poor (61.8%), fair (28.2%), good (9.1%), and excellent (1.8%) categories. Both general users (12.31/25) and healthcare professionals (12.18/25) exhibited average quality according to KEEST standards (P = 0.809), with an intriguing inverse correlation between video popularity and DISCERN score. Conclusion Healthcare professionals demonstrated superior evidence-based content (DISCERN), whereas both groups were comparatively educated on treatment plans and effects (KEEST). TikTok's prevalent knee instability videos lack quality, proper sourcing, treatment risk information, and explanation. Moreover, popularity is inversely correlated with quality, and healthcare professionals appear to offer better evidence-based content. TikTok's role in healthcare highlights the importance of ensuring accurate information and implementing content quality regulations.

Misinformation About Orthopaedic Conditions on Social Media: Analysis of TikTok and Instagram

Introduction Social media outlets such as TikTok (TT) and Instagram (IG) have surged as a method to disseminate information. More recently, healthcare professionals have targeted this space as a means to provide medical education and advice. With the ever-growing content on these applications, there is significant variability and quality of material available, which can lead to the dissemination of misinformation. This study aims to evaluate the accuracy and popularity of content on common orthopaedic pathology on TT and IG. Methods Content on TT and IG related to six common orthopaedic conditions - achilles tendon tear, ACL tear, meniscus tear, tennis elbow, rotator cuff tear, and ankle sprains - was evaluated between April and June 2022. The top ten posts for the top two associated hashtags for each condition were reviewed. The quality of each post was analyzed using the DISCERN instrument, rating each on a scale of 1 to 5. Each post was characterized by the author's profession (physician, physical therapist, chiropractor, etc.) and content type (educational, testimonial, personal, promotional, and entertainment). Popularity and engagement metrics such as "comments," "likes," and "shares" were also collected. Results There were 165,666,490 views on TT and 9,631,015 views on IG amongst the six common aforementioned orthopaedic conditions. Content created by physicians had less overall engagement (16.1%) compared to content created by non-physicians (83.9%). The quality of content on average was low (mean misinformation index 2.04 ± 1.08 (1-5)1. Physician-created posts in comparison to non-physician posts were significantly more accurate (mean misinformation index score 3.38 ± 1.12 vs 1.89 ± 0.94, p<0.0001). Conclusions Common orthopaedic conditions such as Achilles tendon tears, ACL tears, and meniscus tears are frequently the focus of content posted on TT and IG; however, this information is often not medically accurate. Increased physician engagement may help to rectify this misinformation.

Evaluating the Quality and Usability of Artificial Intelligence-Generated Responses to Common Patient Questions in Foot and Ankle Surgery

Background

Artificial intelligence (AI) platforms, such as ChatGPT, have become increasingly popular outlets for the consumption and distribution of health care-related advice. Because of a lack of regulation and oversight, the reliability of health care-related responses has become a topic of controversy in the medical community. To date, no study has explored the quality of AI-derived information as it relates to common foot and ankle pathologies. This study aims to assess the quality and educational benefit of ChatGPT responses to common foot and ankle-related questions.

Methods

ChatGPT was asked a series of 5 questions, including "What is the optimal treatment for ankle arthritis?" "How should I decide on ankle arthroplasty versus ankle arthrodesis?" "Do I need surgery for Jones fracture?" "How can I prevent Charcot arthropathy?" and "Do I need to see a doctor for my ankle sprain?" Five responses (1 per each question) were included after applying the exclusion criteria. The content was graded using DISCERN (a well-validated informational analysis tool) and AIRM (a self-designed tool for exercise evaluation).

Results

Health care professionals graded the ChatGPT-generated responses as bottom tier 4.5% of the time, middle tier 27.3% of the time, and top tier 68.2% of the time.

Conclusion

Although ChatGPT and other related AI platforms have become a popular means for medical information distribution, the educational value of the AI-generated responses related to foot and ankle pathologies was variable. With 4.5% of responses receiving a bottom-tier rating, 27.3% of responses receiving a middle-tier rating, and 68.2% of responses receiving a top-tier rating, health care professionals should be aware of the high viewership of variable-quality content easily accessible on ChatGPT.

Level of Evidence

Level III, cross sectional study.

Evaluating the Distribution, Quality, and Educational Value of Videos Related to Shoulder Instability Exercises on the Social Media Platform TikTok

BACKGROUND

Because of the lack of scientific oversight, the quality, applicability, and consistency of healthcare-related TikTok videos have become a focus of research exploration. The orthopaedic surgery literature lags behind other medical fields in analyzing the widespread utilization of TikTok videos for medical information delivery.

METHODS

TikTok was queried using the hashtag #shoulderstabilityexercises, and 109 videos were included. The videos were collected by two authors and independently evaluated using DISCERN (a well-validated informational analysis tool) and shoulder stability exercise education score (a self-designed tool for the evaluation of shoulder instability-related exercises).

RESULTS

DISCERN scores of videos uploaded by general users had significantly lower scores in all four categories than those uploaded by healthcare professionals (P < 0.001, P = 0.005, P = 0.002, and P < 0.001). For the shoulder stability exercise education score, general users had a significantly lower score than the healthcare professionals at 3.36 and 4.91 on a 25-point scale, respectively (P = 0.034). General users had more videos graded as very poor (84.2%) in comparison to the number of videos uploaded by healthcare professionals deemed very poor (51.5%). However, the remainder of healthcare professionals had their videos graded as poor (48.5%).

CONCLUSION

Despite slightly improved video quality from healthcare professionals, the overall educational of the videos related to shoulder instability exercises was poor.

A New Trend in Social Media and Medicine: The Poor Quality of Videos Related to Ankle Sprain Exercises on TikTok

Background

Social media platforms, like TikTok, have become popular options for the distribution of health care information. Because of the lack of scientific oversight, the quality of health care-related videos has become a focus of the current literature. However, orthopaedic surgery has lagged behind other fields in acknowledging the widespread utilization of TikTok videos for medical information consumption. This study aims to assess the quality and educational benefits of ankle sprain-related TikTok videos.

Methods

TikTok was queried using the hashtag "#anklesprainexercises." One hundred videos were included after applying the exclusion criteria. The number of views, likes, shares, comments, and favorites was recorded. The content was graded using DISCERN (a well-validated informational analysis tool) and ASEES (a self-designed tool for exercise evaluation). We hypothesized that information on TikTok related to ankle sprain exercises would be poor in quality.

Results

The total number of views of the 100 videos was 6 483 412, with a median of 5377.5 (IQR = 1074-20 275). The videos collectively received 385 847 likes, 3642 comments, 55 574 favorites, and 14 918 shares with a median of 267.5 (IQR = 41.5-1678.0), 4.0 (IQR = 0.0-23.0), 42.0 (IQR = 4.8-264.5), and 13.0 (IQR = 1.8-67.8), respectively. General users had a higher percentage of their videos graded as "very poor" (61.8%) in comparison to the number of videos uploaded by health care professionals deemed "very poor" (34.4%). Neither general user nor health care professionals had videos graded as "good" or "excellent." There were significant differences between the 2 groups for DISCERN 1, 3, and ASSES scores.

Conclusion

Although TikTok is a powerful tool for information distribution, the educational value of the videos related to ankle sprain injury exercises was poor. With only 2% of videos receiving a grade of "fair," and no videos reaching a score of "good" or "excellent," health care professionals should be aware of the low-quality content easily accessible on TikTok.

Level of Evidence

Level III, cross-sectional study.

Analyzing the quality and educational value of Achilles tendinopathy-related videos on TikTok

BACKGROUND

Social media platforms, like TikTok, have become popular options for the consumption and distribution of healthcare information. Due to the lack of scientific oversight, the consistency of healthcare-related videos has become a focus of the current literature. However, orthopaedic surgery has lagged behind other specialties in acknowledging the widespread utilization of TikTok videos for medical information. This study aims to assess the quality and educational benefits of Achilles tendinopathy-related TikTok videos.

METHODS

TikTok was queried using the hashtags "#achillestendonexercises", "achillestendonitisexercises", "achillestendinosisexercises", and "achillestendinopathyexercises". 100 videos (25 for each term) were included after applying the exclusion criteria. The number of views, likes, shares, comments, and favorites was recorded. The content was graded using DISCERN (a well-validated informational analysis tool) and ATEES (a self-designed tool for exercise evaluation).

RESULTS

The total number of views of the 100 videos was 1647,148, with a median of 7562.5 (IQR = 2,281- 19,575). The videos collectively received 73,765 likes, 1125 comments, 14,491 favorites and 6897 shares with a median of 283 (IQR= 73.8-957.8), 7 (IQR= 1.8-16.0), 61.5 (IQR= 8.8-184.3), and 18.5 (IQR= 2.0-49.8), respectively. General users uploaded slightly less (48%) when compared to healthcare professionals (52%). Healthcare professionals had more videos graded as "very poor" (43.4%) in comparison to the general users (36.2%). General users had more videos graded as "poor" (63.8%) in comparison to healthcare professionals (54.7%). However, there were no significant differences between the groups on either of the video grading scales.

CONCLUSION

Although TikTok is a powerful tool for information distribution, the educational value of the videos related to Achilles tendinopathy exercises was poor. With only 1% of videos receiving a grade of 'fair,' and no videos reaching a score of 'good' or 'excellent', healthcare professionals should be aware of the high viewership of low-quality content easily accessible on TikTok.

LEVEL OF EVIDENCE: 3

Usefulness of YouTube in Sharing Information about New Gene Therapy for Spinal Muscular Atrophy: A Content Analysis

This study aimed to objectively assess YouTube videos' quality, reliability, and information delivery capability regarding novel spinal muscular atrophy treatments. Using the keywords "nusinersen", "spinraza", "ridisplam", "evrysdi", "onasemnogene abeparvovec", and "zolgensma", we were able to retrieve and screen 360 videos before settling on a final sample of 99 on 25 September 2022. Then, two independent raters used the mDISCERN and GQS instruments to evaluate the videos' reliability and quality and the Information Delivery Capability (IDC) score to assess the videos' accuracy and patient-friendliness. The quality, reliability, and information delivery capability of the videos about the new treatment for SMA were quite heterogeneous, with an average mDISCERN, GQS, and IDC score of 3.172 ± 0.899, 2.980 ± 1.025, and 4.141 ± 1.747, respectively. In-depth analysis showed that healthcare expert videos that explained contents while showing infographic supplements had good quality, reliability, and information delivery capability. As YouTube is already a dominant media platform, the public may obtain new information about novel therapeutics for SMA through YouTube. It is necessary to consider how SMA patients and caregivers can choose trusted sources with reliable information on YouTube, and our results can provide clues. Additionally, experts should strive to provide more accurate, reliable, and patient-oriented videos.