The Content Quality of YouTube Videos for Professional Medical Education: A Systematic Review

YouTube videos on lymphedema as an information source for Spanish speaking breast cancer survivors

BACKGROUND

Breast cancer-related lymphedema in the upper limb remains one of the most distressful complications of breast cancer treatment. YouTube is considered a potential digital resource for population health and decision making. However, access to inadequate information or misinformation could have undesirable impacts. This cross-sectional study aimed to evaluate the reliability, quality and content of YouTube videos on lymphedema as an information source for Spanish-speaking breast cancer survivors.

METHODS

A search of YouTube was conducted in January 2023 using the key words "breast cancer lymphedema" and "lymphedema arm breast cancer." Reliability and quality of the videos were evaluated using the Discern tool, content, source of production, number of likes, comments, views, duration, Video Power Index, likes ratio, view ratio and age on the platform.

RESULTS

Amongst the 300 Spanish language videos identified on YouTube, 35 were selected for analysis based on the inclusion and exclusion criteria. Of the 35 selected videos, 82.9% (n = 29) were developed by healthcare or academic professionals and 17.1% (n = 9) by others. Reliability (p < 0.017) and quality (p < 0.03) were higher in the videos made by professionals. The Discern total score (r = 0.476; p = 0.004), reliability (r = 0.472; p = 0.004) and quality (r = 0.469; p = 0.004) were positively correlated with the duration of the videos.

CONCLUSIONS

Our findings provide a strong rationale for educating breast cancer survivors seeking lymphedema information to select videos made by healthcare or academic professionals. Standardised evaluation prior to video publication is needed to ensure that the end-users receive accurate and quality information from YouTube.

Quality and reliability analysis of videos about ThuLEP on Youtube

OBJECTIVES

To assess the reliability and quality analyses of ThuLEP videos on YouTube, as a source of public information.

MATERIALS AND METHODS

In this study, a YouTube search with the keyword "ThuLEP" was performed on November 15, 2022 and 142 videos were listed according to relevance. Video features and source of upload were recorded. The quality of videos was evaluated by using both the Journal of American Medical Association (JAMA) score and the Global Quality Score(GQS); the reliability of videos was evaluated by using 5-point modified DISCERN tool,respectively. The correlation analysis was performed by using Spearman test between video features and these three scores.

RESULTS

77 videos were analysed after exclusion and the most common source of upload were urologists (54.5%) and the videos containing only ThuLEP surgery (74%) were the majority of the videos. The median JAMA score, 5-point modified DISCERN score, and GQS were 2, 1, 1, respectively. There were no statistical differences in these three scores according to the source of the upload. All three scores were analysed separately by language and no significant statistical difference was found.There was a positive correlation between the video power index and as well as JAMA, GQS and m. DISCERN scores.

CONCLUSIONS

Despite abundant videos on ThuLEP on YouTube, most of these videos are not targeted to public and information provided may not be as useful for patients. Information presented in these videos may be inaccurate and not reliable.

Assessment of the quality of oral biopsy procedure videos shared on YouTube

OBJECTIVE

The aim of this study was to assess the quality of free-to-access videos on oral biopsy procedures on the YouTube platform.

MATERIALS AND METHODS

We conducted a search on YouTube using the term "oral biopsy" and selected the first 100 videos in order of relevance. The following exclusion criteria were applied: language other than English, videos that did not cover oral biopsy techniques, videos on nonhuman specimens, postoperative instructions, personal experiences, exfoliative cytology, or "brush biopsy." Forty-seven selected videos were classified based on their duration, country of origin, date of upload to the system, author, information source and number of views, and likes and dislikes. Video quality was analyzed using DISCERN, the Global Quality Scale (GQS), and the Video Information and Quality Index (VIQI).

RESULTS

The majority (78.7%) of analyzed videos were uploaded by dentists, originating from India (48.9%), with a mean duration of 11.8 min (SD, 20.4), with 104.5 likes (SD, 186.4) and 7.1 dislikes (SD, 10.55). The mean values for DISCERN, GQS, and VIQI were 1.3 (SD, 0.52), 2.1 (SD, 1.04), and 9.62 (SD, 1.69), respectively.

CONCLUSION

The majority of videos on oral biopsy published on YouTube are of low quality.

YouTube/ Bilibili/ TikTok videos as sources of medical information on laryngeal carcinoma: cross-sectional content analysis study

BACKGROUND

YouTube, a widely recognized global video platform, is inaccessible in China, whereas Bilibili and TikTok are popular platforms for long and short videos, respectively. There are many videos related to laryngeal carcinoma on these platforms. This study aims to identify upload sources, contents, and feature information of these videos on YouTube, Bilibili, and TikTok, and further evaluate the video quality.

METHODS

On January 1, 2024, we searched the top 100 videos by default sort order (300 videos in total) with the terms "laryngeal carcinoma" and "throat cancer" on YouTube, "" on Bilibili and TikTok. Videos were screened for relevance and similarity. Video characteristics were documented, and quality was assessed by using the Patient Education Materials Assessment Tool (PEMAT), Video Information and Quality Index (VIQI), Global Quality Score (GQS), and modified DISCERN (mDISCERN).

RESULTS

The analysis included 99 YouTube videos, 76 from Bilibili, and 73 from TikTok. Median video lengths were 193 s (YouTube), 136 s (Bilibili), and 42 s (TikTok). TikTok videos demonstrated higher audience interaction. Bilibili had the lowest ratio of original contents (69.7%). Treatment was the most popular topic on YouTube and Bilibili, while that was the prognosis on TikTok. Solo narration was the most common video style across all platforms. Video uploaders were predominantly non-profit organizations (YouTube), self-media (Bilibili), and doctors (TikTok), with TikTok authors having the highest certification rate (83.3%). Video quality, assessed using PEMAT, VIQI, GQS, and mDISCERN, varied across platforms, with YouTube generally showing the highest scores. Videos from professional authors performed better than videos from non-professionals based on the GQS and mDISCERN scores. Spearman correlation analysis showed no strong relationships between the video quality and the audience interaction.

CONCLUSIONS

Videos on social media platforms can help the public learn about the knowledge of laryngeal cancer to some extent. TikTok achieves the best flow, but videos on YouTube are of the best quality. However, the video quality across all platforms still needs enhancement. We need more professional uploaders to ameliorate the video quality related to laryngeal carcinoma. Content creators also should be aware of the certification, the originality, and the style of video shooting. As for the platforms, refining the algorithm will allow users to receive more high-quality videos.

Assessment of the Quality of Sinus Elevation with Lateral Window Approach Procedure Videos on YouTube: A Content-quality Analysis

Although the lateral window approach allows for greater graft material delivery and bone formation, it is more challenging and invasive, prompting keen interest among dentists to master this method. YouTube is increasingly used for medical training; however, concerns regarding the quality of instructional videos exist. This study proposes new criteria for evaluating YouTube videos on maxillary sinus elevation with the aim of establishing standards for assessing instructional content in the field. We sourced 100 maxillary sinus elevation videos from YouTube and, following exclusion criteria, analyzed 65 remaining videos. The video characteristics, content quality, and newly developed criteria were evaluated. Statistical analyses, employing ordinal logistic regression, identified the factors influencing the quality of instructional videos and evaluated the significance of our new criteria. Although video interaction and view rate exhibited positive relations to content quality, they were not significant ( P =0.818 and 0.826, respectively). Notably, videos of fair and poor quality showed a significant negative relation ( P <0.001). Audio commentary, written commentary, and descriptions of preoperative data displayed positive but statistically insignificant relationships ( P =0.088, 0.228, and 0.612, respectively). The comparison of video evaluation results based on the developed criteria with content quality scores revealed significant negative relationships for good, fair, and poor videos ( P <0.001, Exp(B)=-4.306, -7.853, -10.722, respectively). Among the various video characteristics, only image quality showed a significant relationship with content quality. Importantly, our newly developed criteria demonstrated a significant relationship with video content quality, providing valuable insights for assessing instructional videos on maxillary sinus elevation and laying the foundation for robust standards.

Online video resources pertaining to cerebral palsy: A YouTube-based quality control study

Aim

To assess the content and quality of YouTube videos related to cerebral palsy to provide insights into the online video resources available for individuals affected by cerebral palsy and suggest strategies for improvement.

Methods

YouTube videos were analyzed based on interaction parameters, content characteristics/category, and video source. Video reliability and quality were assessed using the Journal of American Medical Association benchmark, Global Quality Scale, and cerebral palsy-specific score. Statistical analyses examined associations between video characteristics and reliability/quality scores.

Results

The average video (n = 48) length was 6.8 min, with 29 informational and 19 experiential videos. The mean Journal of American Medical Association score was 2.0, indicating moderate reliability. The Global Quality Scale suggested good quality content (average: 3.5), but only 14% were rated as good via cerebral palsy-specific score. Higher views were associated with higher Journal of American Medical Association score and cerebral palsy-specific score (p = 0.002 and p = 0.006), and nonphysician medical expert videos had lower Journal of American Medical Association scores than academic videos (p = 0.042). Video content was not significantly associated with either score.

Conclusion

YouTube provides moderate to good quality information on cerebral palsy. Critical evaluation of video sources and content is essential. Findings can guide strategies to enhance the quality of cerebral palsy-related YouTube content, benefiting individuals with cerebral palsy, health care providers, and caregivers.

YouTube as a Source of Patient and Trainee Education in Vascular Surgery: A Systematic Review

Objective

Due to its video based approach, YouTube has become a widely accessed educational resource for patients and trainees. This systematic review characterised and evaluated the peer reviewed literature investigating YouTube as a source of patient or trainee education in vascular surgery.

Data sources

A comprehensive literature search was conducted using EMBASE, MEDLINE, and Ovid HealthStar from inception until 19 January 2023. All primary studies and conference abstracts evaluating YouTube as a source of vascular surgery education were included.

Review methods

Video educational quality was analysed across several factors, including pathology, video audience, and length.

Results

Overall, 24 studies were identified examining 3 221 videos with 123.1 hours of content and 37.1 million views. Studies primarily examined YouTube videos on diabetic foot care (7/24, 29%), peripheral arterial disease (3/24, 13%), carotid artery stenosis (3/24, 13%), varicose veins (3/24, 13%), and abdominal aortic aneurysm (2/24, 8%). Video educational quality was analysed using standardised assessment tools, author generated scoring systems, or global author reported assessment of quality. Six studies assessed videos for trainee education, while 18 studies evaluated videos for patient education. Among the 20 studies which reported on the overall quality of educational content, 10/20 studies deemed it poor, and 10/20 studies considered it fair, with 53% of studies noting poor educational quality for videos intended for patients and 40% of studies noting poor educational quality in videos intended for trainees. Poor quality videos had more views than fair quality videos (mean 27 348, 95% CI 15 154-39 543 views vs. 11 372, 95% CI 3 115-19 629 views, p = .030).

Conclusion

The overall educational quality of YouTube videos for vascular surgery patient and trainee education is suboptimal. There is significant heterogeneity in the quality assessment tools used in their evaluation. A standardised approach to online education with a consistent quality assessment tool is required to better support online patient and trainee education in vascular surgery.

Are YouTube videos claiming to describe lumbar spinal manipulation techniques adequate?

BACKGROUND AND OBJECTIVE

YouTube has become a digital visual library in almost all fields of life, including medicine. Healthcare professionals and students frequently use YouTube to gain new skills and knowledge; however, the content of these videos has not been scientifically evaluated. Therefore, this study aimed to determine the descriptive adequacy and quality of YouTube videos on lumbar spine manipulation techniques (LSMTs) prepared by different healthcare professionals.

METHODS

The first 50 most relevant videos retrieved on searching YouTube for the keyword 'lumbar spinal manipulation techniques' were included in the study. The video metrics (total duration, number of views, time since upload, number of comments, number of likes, and number of dislikes) that could be accessed from video descriptions were recorded. However the videos were scored according to manipulation definition criteria proposed by the American Academy of Orthopedic Manual Physical Therapists (AAOMPT manipulation description score - AAOMPT-MDS) and benchmark criteria for quality of digital content by the Journal of American Medical Association's (JAMA). The video metrics, AAOMPT-MDS and JAMA scores of the videos prepared by medical doctors, chiropractors, osteopaths, and physiotherapists were compared.

RESULTS

Video metrics of groups were similar. The mean AAOMPT-MDS of the videos was 2.40 ± 1.57 out of 6.00 (higher score was better), and the mean JAMA score was 2.14 ± 1.05 out of 4.00 (higher score was better). Videos created by all professional groups had statistically comparable AAOMPT-MDS and JAMA scores (p > 0.05).

CONCLUSION

Although YouTube videos on LSMTs offer valuable information for professionals and students, creators should follow the proposed recommendations when producing these videos to ensure quality content and systematic presentation.

Assessing the scientific quality and reliability of YouTube videos about chemotherapy

No studies have evaluated the interaction, quality, and reliability of chemotherapy-related videos published on YouTube. The aim was to evaluate the content of YouTube videos about chemotherapy using 5 different scoring tools. In this cross-sectional register-based study, popular videos on YouTube about the following keywords were examined; "chemotherapy," "what is chemotherapy," "types of chemotherapy," "chemotherapy side effects" and "chemotherapy treatments." Quality and reliability of video content were measured using the modified DISCERN (mDISCERN), the Journal of the American Medical Association (JAMA), the Global Quality Score (GQS), the Video Information Quality Index (VIQI), and Health on the Net code (HONcode) scores. A total of 108 videos were analyzed in the study. The median duration was 200 (30-2020) seconds and the median total number of views was 17500 (61-8615000). Among the video publishers, private hospitals were the most (n = 36, 33%). The most (n = 71, 66%) populer category of videos were patient education videos. Half (n = 55, 51%) of the narrators in the videos were only oncology professionals. Mean DISCERN, JAMA, GQS, VIQI, and HONcode scores were 2.73 ± 1.18, 1.97 ± 1.05, 2.94 ± 1.08, 14.03 ± 3.73, and 4.68 ± 2.46, respectively. A positive correlation was found between the 5 scoring points (P < .001 for all pairwise comparisons). There was a significant difference between video quality scores according to video categories and video publishers (P < .001 for both). Although most YouTube videos about chemotherapy were helpful to patients, content quality and reliability were moderate-low. Cancer patients looking for information on chemotherapy may find YouTube videos beneficial, but clinicians must be cautious to clear up any misunderstandings.

Freely Available Training Videos for Suicide Prevention: Scoping Review

BACKGROUND

Freely available and asynchronous implementation supports can reduce the resource burden of evidence-based practice training to facilitate uptake. Freely available web-based training videos have proliferated, yet there have been no efforts to quantify their breadth, depth, and content for suicide prevention.

OBJECTIVE

This study presents results from a scoping review of freely available training videos for suicide prevention and describes a methodological framework for reviewing such videos.

METHODS

A scoping review of freely available training videos (≥2 minutes) for suicide prevention practices was conducted using 4 large video-sharing platforms: YouTube, Vimeo, Bing Video, and Google Video. Identified suicide prevention training videos (N=506) were reviewed and coded.

RESULTS

Most content was targeted toward gatekeepers or other lay providers (n=370) versus clinical providers (n=136). Videos most commonly provided content related to suicidal thoughts or behaviors (n=420). Many videos (n=274, 54.2%) included content designed for certain communities or organizations. Less than half (n=232, 45.8%) of training videos included formal clinical content pertaining to assessment or intervention for suicide prevention.

CONCLUSIONS

Results suggested an abundance of videos providing broad informational content (eg, "signs and symptoms of someone at risk for suicide") and a limited portion of videos with instructional content aimed at clinical providers delivering formal evidence-based assessments or interventions for suicide prevention. Development of resources to address identified gaps may be needed. Future work may leverage machine learning techniques to expedite the review process.

The Emotional Impact of Educational Productivity Videos on YouTube: A Global, Cross-Sectional Survey

Introduction YouTube is the most popular video-sharing website, and many students use it as a resource to find educational content. One type of video category is "productivity," in which the creator teaches viewers how to lead a more productive lifestyle by sharing ways to maximize studying, reshape daily habits, or set achievable goals. Little research has been conducted on whether these videos actually promote positive or negative feelings among viewers. Methods A survey was created through Qualtrics and shared through YouTube and Instagram. The survey asked about exposure to productivity videos and also asked individuals to share their experiences with consuming productivity-related educational content on YouTube. Survey items asked students to rate the helpfulness of these videos and share their feelings about the content. Respondents were asked to share whether YouTube videos on productivity made them feel anxious, motivated, inspired, neutral/indifferent, or inadequate. Participants were also asked to rate how helpful they found productivity videos on YouTube (1-10, with 10 being most helpful). The survey included free response sections to assess viewers' perceptions and attitudes toward productivity videos. Results The cross-sectional survey amassed 595 responses across 60 countries, with 364 responses coming from individuals within the United States. Of the respondents, 397 of the respondents were female, 177 were male, and 21 preferred not to say or identified as non-binary. The average age of participants was 22 years; 79 were in high school, 174 were in college, 223 were in medical school, and the remainder identified as "other" (graduate school, gap year, etc.). Of the 595 completed responses, 494 reported watching videos on YouTube related to improving productivity; when asked how these videos made them feel, 127 participants answered "anxious," 357 answered "motivated," 308 answered "inspired," 95 answered "neutral/indifferent," and 97 answered "inadequate." When rating how helpful they found these videos (1-10), an average score of 6.8 was recorded. Conclusion Most viewers feel motivated or inspired by productivity videos on YouTube. Based on the free responses provided by survey participants, productivity videos can be made more effective by showing more relatable routines and demonstrating what viewers should do when goals are not met.

Use of Videos by Health Care Professionals for Procedure Support in Acute Cardiac Care: A Scoping Review

BACKGROUND

Cardiology procedures are often life-saving and time-critical, but some are so infrequent that health care staff may have rarely encountered them in practice or need to refresh their skills rapidly. Videos demonstrating procedures have the potential to assist health care professionals and support safe patient care. This scoping review explores the research literature involving the use of video by health care professionals in hospitals.

AIM

To identify what is known from research regarding the use of video to support clinical procedures in hospitals or health care facilities.

METHOD

The Joanna Briggs Institute Scoping review methodology guided our systematic search of peer-reviewed evidence related to video use to support procedures in a hospital or health care facility. Data sources included the electronic databases: ProQuest, Cumulative Index of Nursing and Allied Health Literature (CINAHL), Medline, Excerpta Medica dataBASE (EMBASE), Scopus, and PubMed.

FINDINGS

Seventeen (17) studies that met the inclusion criteria were included in the review, all published between 2012 and 2022. Since 2005, YouTube has become the dominant platform for publishing or sourcing videos related to clinical procedures. Studies to date can be summarised under five themes: 1) video content and purpose, 2) target audience, 3) video hosting site-internal websites versus YouTube, 4) curated versus original 'homegrown' video content, and 5) video development process.

DISCUSSION/CONCLUSION

Research on the development and utility of videos to support clinical procedures is emerging, with the ability to host videos on platforms such as YouTube becoming more accessible in recent years. All videos were designed to enhance health care professionals' existing knowledge and skills within their scope of practice. The available literature suggests that video can be a valuable clinical resource for both simple and skilled procedures. Video resources can help clinicians perform or assist with rare procedures, providing 'just in time' patient safety prompts and information.

Assessment of the educational value of endodontic access cavity preparation YouTube video as a learning resource for students

Objective

To evaluate the educational value of YouTube as a learning tool for dental students regarding endodontic access cavity preparation.

Methods and findings

YouTube search was made for videos related to endodontic access cavity preparation using specific terms. After exclusions, 41 videos were chosen and assessed for tooth type, video length, days since upload, country of origin, number of views and likes, source of authorship, and viewing rate. To grade the content of videos, a usefulness score with seven elements was developed. Each element was given a score of 0 or 1. Statistical tests were run by using Kruskal-Wallis and Mann-Whitney tests (SPSS Inc, Chicago, IL, USA) at a 5% significance level. The videos received a mean of 181198.5 views with a mean duration of 686.1 seconds. The mean number of “likes” was 1047.8. Almost half of the videos covered content related to molar teeth. Most videos were provided by health care professionals with almost 50% uploaded from India. The mean usefulness score was 4.29 (range: 1–7) and the most discussed elements were description, instruments used, access cavity demonstration, and evaluation criteria. About a quarter of the videos were classified as good, while 46.3% as moderate and 29.3% as poor. Among the content usefulness categories, no difference was found in the video demographics (p>0.05) except “days since upload” (p = 0.018) in which good quality videos were found to have the highest median. Moreover, although insignificant, good videos were found to have the longest duration and lowest number of views, likes, and viewing rate. The mean usefulness score of videos released during the COVID-19 pandemic was lower than that for pre-pandemic videos (p = 0.042), and videos uploaded by academic institutions had a higher mean usefulness score than videos uploaded by health care professionals (p<0.001).

Conclusions

Information on endodontic access cavity preparation is not comprehensive in most of the reviewed YouTube videos and could be of low educational value.

Quality Assessment of YouTube Videos as an Information Source for Testicular Torsion

Background

Testicular torsion is an acute scrotal disease requiring urgent management, and the COVID-19 pandemic has been demonstrated to lead to poor outcomes for this disease. Presently, many people tend to seek health information via YouTube. This study aims to quantitatively assess the quality of English YouTube video content as an information source of testicular torsion.

Methods

In this cross-sectional study, a search was performed with the search term "testicular torsion" on YouTube, and the first 100 videos listed by relevance were selected for our analysis. Duplicate, non-English, videos without audio and surgical videos were excluded. Video features (duration, number of days online, views, likes, comments), source of the video, and author's country were collected. Each video included in the study was assessed using DISCERN and Journal of the American Medical Association (JAMA) Benchmark Criteria. A correlation analysis was performed considering video features, video source, DISCERN scores and JAMA scores.

Results

A total of 66 videos were included and analyzed. The most common video content was general information, including etiology, symptoms, and treatment. The majority of videos were from education and training websites (30%), physicians (23%), and independent users (21%). The mean DISCERN and JAMA scores were 36.56 and 2.68, respectively. According to DISCERN, the quality of video uploaded by physicians was relatively high (P < 0.001), and the quality of video uploaded by independent users was relatively low (P < 0.001). The JAMA score had no relevance to the video source (P = 0.813). The correlation between the video features, DISCERN and JAMA scores was controversial by different assessment methods.

Conclusions

Despite most of the videos on YouTube being uploaded by medical or education-related authors, the overall quality was poor. The misleading, inaccurate and incomplete information may pose a health risk to the viewers, especially during the COVID-19 pandemic. Much effort needs to be undertaken to improve the quality of health-related videos regarding testicular torsion.

Behind teaching-learning strategies in physiology: perceptions of students and teachers of Brazilian medical courses

The teaching-learning process must constantly overcome the barriers imposed by rapid scientific and technological advances, as well as changes in the profiles of students and access to information. This study intended to analyze the perceptions of students and professors of medical courses of the teaching-learning strategies used in physiology at different Brazilian universities as well as the factors that influence or hinder the learning of this discipline. Questionnaires were analyzed from 174 students and 16 professors of physiology from medical courses of 20 higher education institutions (public and private) in a southern Brazilian state. The teaching strategies most used by physiology teachers coincided with the classroom activities that students consider to have the greatest contribution to their learning (expository classes/lectures, tests and questionnaires, problem-based learning/clinical case studies, and demonstrative/practical classes). It was also evidenced that teachers' didactic is considered as a very influencing factor for the students during their learning process, whereas the teachers pointed out daily pedagogical practice as the most relevant factor in the development of their skills within the classroom. In addition, some factors hindering the teaching-learning process of physiology were identified by the respondents, such as large amounts of information, little time for study outside the classroom, previous knowledge, and intrinsic difficulty of the discipline. Finally, students tended to study alone and generally used teachers' slides and their own notes as study materials. The continuous assessment of the perceptions, needs, and difficulties of students and teachers plays an essential role in improving the teaching-learning process.