Users' Guides to the Medical Literature series on social media (part 2): how to appraise studies using data from platforms

YouTube as a source of education in perioperative anesthesia for patients and trainees: a systematic review

BACKGROUND

Online video sharing platforms like YouTube (Google LLC, San Bruno, CA, USA) have become a substantial source of health information. We sought to conduct a systematic review of studies assessing the overall quality of perioperative anesthesia videos on YouTube.

METHODS

We searched Embase, MEDLINE, and Ovid for articles published from database inception to 1 May 2023. We included primary studies evaluating YouTube videos as a source of information regarding perioperative anesthesia. We excluded studies not published in English and studies assessing acute or chronic pain. Studies were screened and data were extracted in duplicate by two reviewers. We appraised the quality of studies according to the social media framework published in the literature. We used descriptive statistics to report the results using mean, standard deviation, range, and n/total N (%).

RESULTS

Among 8,908 citations, we identified 14 studies that examined 796 videos with 59.7 hr of content and 47.5 million views. Among the 14 studies that evaluated the video content quality, 17 different quality assessment tools were used, only three of which were externally validated (Global Quality Score, modified DISCERN score, and JAMA score). Per global assessment rating of video quality, 11/13 (85%) studies concluded the overall video quality as poor.

CONCLUSIONS

Overall, the educational content quality of YouTube videos evaluated in the literature accessible as an educational resource regarding perioperative anesthesia was poor. While these videos are in demand, their impact on patient and trainee education remains unclear. A standardized methodology for evaluating online videos is merited to improve future reporting. A peer-reviewed approach to online open-access videos is needed to support patient and trainee education in anesthesia.

STUDY REGISTRATION

Open Science Framework ( https://osf.io/ajse9 ); first posted, 1 May 2023.

Misinformation Persists in Complementary Health: Evaluating the Reliability and Quality of YouTube-Based Information on the Use of Acupuncture for Chronic Pain

Introduction

Acupuncture is commonly used to treat chronic pain. Patients often access public social media platforms for healthcare information when querying acupuncture. Our study aims to appraise the utility, accuracy, and quality of information available on YouTube, a popular social media platform, on acupuncture for chronic pain treatment.

Methods

Using search terms such as "acupuncture for chronic pain" and "acupuncture pain relief", the top 54 videos by view count were selected. Included videos were >1 minute duration, contained audio in English, had >7000 views, and was related to acupuncture. One primary outcome of interest was categorizing each video's usefulness as useful, misleading, or neither. Another primary outcome of interest was the quality and reliability of each video using validated instruments, including the modified DISCERN (mDISCERN) tool and the Global Quality Scale (GQS). The means were calculated for the video production characteristics, production sources, and mDISCERN and GQS scores. Continuous and categorical outcomes were compared using Student's t-test and chi-square test, respectively.

Results

Of the 54 videos, 57.4% were categorized as useful, 14.8% were misleading, and 27.8% were neither. Useful videos had a mean GQS and mDISCERN score of 3.77±0.67 and 3.48±0.63, respectively, while misleading videos had mean GQS and mDISCERN score of 2.50±0.53 and 2.38±0.52, respectively. 41.8% of the useful videos were produced by a healthcare institution while none of the misleading videos were produced by a healthcare institution. However, 87.5% of the misleading videos were produced by health media compared to only 25.8% of useful videos from health media.

Discussion

As patients increasingly depend on platforms like YouTube for trustworthy information on complementary health practices such as acupuncture, our study emphasizes the critical need for more higher-quality videos from unbiased healthcare institutions and physicians to ensure patients are receiving reliable information regarding this topic.

YouTube as a Source of Patient and Trainee Education in Vascular Surgery: A Systematic Review

Objective

Due to its video based approach, YouTube has become a widely accessed educational resource for patients and trainees. This systematic review characterised and evaluated the peer reviewed literature investigating YouTube as a source of patient or trainee education in vascular surgery.

Data sources

A comprehensive literature search was conducted using EMBASE, MEDLINE, and Ovid HealthStar from inception until 19 January 2023. All primary studies and conference abstracts evaluating YouTube as a source of vascular surgery education were included.

Review methods

Video educational quality was analysed across several factors, including pathology, video audience, and length.

Results

Overall, 24 studies were identified examining 3 221 videos with 123.1 hours of content and 37.1 million views. Studies primarily examined YouTube videos on diabetic foot care (7/24, 29%), peripheral arterial disease (3/24, 13%), carotid artery stenosis (3/24, 13%), varicose veins (3/24, 13%), and abdominal aortic aneurysm (2/24, 8%). Video educational quality was analysed using standardised assessment tools, author generated scoring systems, or global author reported assessment of quality. Six studies assessed videos for trainee education, while 18 studies evaluated videos for patient education. Among the 20 studies which reported on the overall quality of educational content, 10/20 studies deemed it poor, and 10/20 studies considered it fair, with 53% of studies noting poor educational quality for videos intended for patients and 40% of studies noting poor educational quality in videos intended for trainees. Poor quality videos had more views than fair quality videos (mean 27 348, 95% CI 15 154-39 543 views vs. 11 372, 95% CI 3 115-19 629 views, p = .030).

Conclusion

The overall educational quality of YouTube videos for vascular surgery patient and trainee education is suboptimal. There is significant heterogeneity in the quality assessment tools used in their evaluation. A standardised approach to online education with a consistent quality assessment tool is required to better support online patient and trainee education in vascular surgery.

Evaluating YouTube as a Source of Education for Patients Undergoing Surgery: A Systematic Review

OBJECTIVE

The objective of this systematic review is to characterize the peer-reviewed literature investigating YouTube as a source of patient education for patients undergoing surgery.

SUMMARY BACKGROUND DATA

YouTube is the largest online video sharing platform and has become a substantial source of health information that patients are likely to access before surgery, yet there has been no systematic assessment of peer-reviewed studies. A comprehensive literature search was conducted using EMBASE, MEDLINE, and Ovid HealthStar from inception through to December of 2021.

METHODS

All primary studies evaluating YouTube as a source of patient education relating to surgical procedures (general, cardiac, urology, otolaryngology, plastic, vascular) were included. Study screening and data extraction occurred in duplicate with two reviewers. Characteristics extracted included video length, view count, upload source, overall video educational quality, and quality of individual studies.

RESULTS

Among 6,453 citations, 56 studies were identified that examined 6,797 videos with 547 hours of content and 1.39 billion views. There were 49 studies that evaluated the educational quality of the videos. A total of 43 quality assessment tools were used, with each study using a mean of 1.90 assessment tools. Per the global rating for assessments, 34/49 studies (69%) concluded that the overall quality of educational content was poor.

CONCLUSIONS

While the impact of non-peer-reviewed YouTube videos on patient knowledge for surgery is unclear, the large amount of online content suggests that they are in demand. The overall educational content of these videos is poor, however, and there is substantial heterogeneity in the quality assessment tools used in their evaluation. A peer-reviewed and standardized approach to online education with video content is needed to better support patients.

Neuromodulation Therapy for Chemotherapy-Induced Peripheral Neuropathy: A Systematic Review

Chemotherapy-induced peripheral neuropathy (CIPN) is a debilitating and painful condition in patients who have received chemotherapy. The role of neuromodulation therapy in treating pain and improving neurological function in CIPN remains unclear and warrants evidence appraisal. In compliance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we performed a systematic review to assess change in pain intensity and neurological function after implementation of any neuromodulation intervention for CIPN. Neuromodulation interventions consisted of dorsal column spinal cord stimulation (SCS), dorsal root ganglion stimulation (DRG-S), or peripheral nerve stimulation (PNS). In total, 15 studies utilized SCS (16 participants), 7 studies utilized DRG-S (7 participants), and 1 study utilized PNS (50 participants). Per the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) criteria, there was very low-quality GRADE evidence supporting that dorsal column SCS, DRG-S, and PNS are associated with a reduction in pain severity from CIPN. Results on changes in neurological function remained equivocal due to mixed study findings on thermal sensory thresholds and touch sensation or discrimination. Future prospective, well-powered, and comparative studies assessing neuromodulation for CIPN are warranted.

Quality Assessment of YouTube Videos as an Information Source for Testicular Torsion

Background

Testicular torsion is an acute scrotal disease requiring urgent management, and the COVID-19 pandemic has been demonstrated to lead to poor outcomes for this disease. Presently, many people tend to seek health information via YouTube. This study aims to quantitatively assess the quality of English YouTube video content as an information source of testicular torsion.

Methods

In this cross-sectional study, a search was performed with the search term "testicular torsion" on YouTube, and the first 100 videos listed by relevance were selected for our analysis. Duplicate, non-English, videos without audio and surgical videos were excluded. Video features (duration, number of days online, views, likes, comments), source of the video, and author's country were collected. Each video included in the study was assessed using DISCERN and Journal of the American Medical Association (JAMA) Benchmark Criteria. A correlation analysis was performed considering video features, video source, DISCERN scores and JAMA scores.

Results

A total of 66 videos were included and analyzed. The most common video content was general information, including etiology, symptoms, and treatment. The majority of videos were from education and training websites (30%), physicians (23%), and independent users (21%). The mean DISCERN and JAMA scores were 36.56 and 2.68, respectively. According to DISCERN, the quality of video uploaded by physicians was relatively high (P < 0.001), and the quality of video uploaded by independent users was relatively low (P < 0.001). The JAMA score had no relevance to the video source (P = 0.813). The correlation between the video features, DISCERN and JAMA scores was controversial by different assessment methods.

Conclusions

Despite most of the videos on YouTube being uploaded by medical or education-related authors, the overall quality was poor. The misleading, inaccurate and incomplete information may pose a health risk to the viewers, especially during the COVID-19 pandemic. Much effort needs to be undertaken to improve the quality of health-related videos regarding testicular torsion.