Evaluation of the Quality, Reliability, and Educational Content of YouTube Videos as an Information Source for Soft Contact Lenses

YouTube as a learning source for contact lens insertion and removal

CLINICAL RELEVANCE

Contact lens neophytes often learn about contact lens insertion and removal through YouTube videos of unknown quality.

BACKGROUND

This study evaluates the quality of soft contact lens insertion and removal videos on YouTube.

METHODS

A search for the keywords 'Contact lens insertion', 'Contact lens removal', 'Put in contact lens', and 'Take off contact lens' was performed on YouTube. The first 50 videos for each keyword were evaluated. The number of views, source of the publisher, days since upload, and video quality were scored based on the content in the videos. The maximum score of insertion and removal videos were 7 and 5 respectively. The videos were classified into three groups by publisher category: videos published by eye care professionals, companies and YouTubers.

RESULTS

Only 45 contact lens insertion and 44 removal videos met the inclusion criteria and were analysed. Insertion and removal videos published by YouTubers had the highest view and view rate. However, their quality scores were significantly lower than videos published by eye care professionals and companies. Videos uploaded by companies had the highest scores (insertion: 5.00 ± 1.10; removal: 3.25 ± 0.75). The mean scores of insertion and removal videos published by YouTubers were 1.65 ± 0.93 and 1.00 ± 0.89, respectively, while the insertion and removal videos uploaded by eye care professionals scored 3.58 ± 2.07 and 2.75 ± 1.53, respectively. There was also a negative correlation between the quality scores and view rate (p = 0.008, r = -0.41).

CONCLUSION

Contact lens insertion and removal videos uploaded by YouTubers had the highest view rate but the lowest quality. Videos made by companies included most essential elements.

Dacryocystorhinostomy videos on YouTube as a source of patient education

BACKGROUND

To determine the quality and reliability of DCR YouTube videos as patient education resources and identify any associated factors predictive of video quality.

METHODS

A YouTube search was conducted using the terms "Dacryocystorhinostomy, DCR, surgery" on 12th of January 2022, with the first 50 relevant videos selected for inclusion. For each video, the following was collected: video hyperlink, title, total views, months since the video was posted, video length, total likes/dislikes, authorship (i.e. surgeon, patient experience or media companies) and number of comments. The videos were graded independently by a resident, a registrar and an oculoplastic surgeon using three validated scoring systems: the Journal of the American Medical Association (JAMA), DISCERN, and Health on the Net (HON).

RESULTS

The average number of video views was 22,992, with the mean length being 488.12 s and an average of 18 comments per video. The consensus JAMA, DISCERN and HON scores were 2.1 ± 0.6, 29.1 ± 8.8 and 2.7 ± 1.0, respectively. This indicated that the included videos were of a low quality, however, only DISCERN scores had good interobserver similarity. Videos posted by surgeons were superior to non-surgeons when considering mean JAMA and HON scores. No other factors were associated with the quality of educational content.

CONCLUSION

The quality and reliability of DCR related content for patient education is relatively low. Based on this study's findings, patients should be encouraged to view videos created by surgeons or specialists in preference to other sources on YouTube.

Are artificial intelligence chatbots a reliable source of information about contact lenses?

INTRODUCTION

Artificial Intelligence (AI) chatbots are able to explain complex concepts using plain language. The aim of this study was to assess the accuracy of three AI chatbots answering common questions related to contact lens (CL) wear.

METHODS

Three open access AI chatbots were compared: Perplexity, Open Assistant and ChatGPT 3.5. Ten general CL questions were asked to all AI chatbots on the same day in two different countries, with the questions asked in Spanish from Spain and in English from the U.K. Two independent optometrists with experience working in each country assessed the accuracy of the answers provided. Also, the AI chatbots' responses were assessed if their outputs showed any bias towards (or against) any eye care professional (ECP).

RESULTS

The answers obtained by the same AI chatbots were different in Spain and the U.K. Also, statistically significant differences were found between the AI chatbots for accuracy. In the U.K., ChatGPT 3.5 was the most and Open Assistant least accurate (p < 0.01). In Spain, Perplexity and ChatGPT were statistically more accurate than Open Assistant (p < 0.01). All the AI chatbots presented bias, except ChatGPT 3.5 in Spain.

CONCLUSIONS

AI chatbots do not always consider local CL legislation, and their accuracy seems to be dependent on the language used to interact with them. Hence, at this time, although some AI chatbots might be a good source of information for general CL related questions, they cannot replace an ECP.

YouTube as a source of information for pressure injury: Quality assessment and content analysis

We aimed to assess the quality and reliability of pressure injury-related videos uploaded on YouTube, analyse the sources and contents, and examine the correlation between video parameters. We searched YouTube using two keywords, "pressure ulcer" and "pressure sore", on August 20, 2022. We sorted the videos according to their number of views and included the top 100 videos for each keyword. The quality of videos was assessed using the Global Quality Scale (GQS), while their reliability was evaluated by the modified DISCERN (mDISCERN) tool. In addition, we evaluated the videos in which content was included, analysed the correlations and differences between GQS, mDISCERN, and video parameters. We initially found a total of 100 videos for each keyword and finally included and analysed 77 videos. The mean scores for the mDISCERN and GQS were 2.35 ± 0.98 and 3.09 ± 0.99, respectively. Both GQS and mDISCERN showed statistically significant correlations with each other (rho = 0.54, p < 0.0001*) and with the length of the videos, respectively (rho = 0.36, p = 0.001*), (rho = 0.29, p = 0.01*). Of the videos created by physicians, 8 (57.1%) included content related to treatment, while of the videos created by nonphysician health personnel, 22 (57.9%) included content related to prevention. Analysing whether there were differences in video parameters based on the sources, we observed significant differences between sources in GQS (p < 0.0001*), mDISCERN (p < 0.0001*), and video length (p = 0.001*). In the post-hoc analysis, videos uploaded by physicians or nonphysician health personnel showed higher quality and reliability than videos uploaded by other sources. Therefore, the results of this study could be useful for healthcare providers, as well as patients and caregivers, to search for high-quality and reliable YouTube videos related to pressure injury.

Show don't tell: assessing the impact of co-developed patient information videos in paediatric uveitis

BACKGROUND/OBJECTIVES

There is a paucity of online educational content targeting children and young people with uveitis. We evaluated the impact of a co-designed patient education video on subjective and objective understanding of childhood uveitis.

SUBJECTS/METHODS

Co-designed patient education media were produced in collaboration with the Childhood Uveitis Studies steering group and the Great Ormond Street Hospital Generation R Young People's Advisory Group and narrated by children. Patients managed within the Uveitis service at GOSH were invited to take part in a pre-post survey, undertaken immediately prior to and following viewing of a patient education video.

RESULTS

Forty-three patients participated. These were stratified according to age, duration of disease, and treatment type for analysis. Self-rated knowledge improved across all groups (p = 0.001), particularly in those with a new diagnosis of uveitis (Z = -8.124, p < 0.001). Objective knowledge scores improved across all questions, especially in younger children, those with new disease, and those on steroid only treatment (Z = -3.847, p < 0.001, Z = -3.975, p < 0.001, Z = -3.448, p < 0.001; respectively). Most participants reported the videos to be easy to understand and with the right amount of information. All stated that they learned something new.

CONCLUSIONS

Patient understanding of disease and treatment is crucial to achieving the best possible outcomes for this chronic, relapsing remitting and potentially blinding disorder. Our findings data shows the potential value of co-designed patient information videos, specifically in our study benefitting younger patients and those recently diagnosed. We suggest that other clinical teams could collaborate fruitfully with patient groups to develop similar videos to target possible misinformation and potentially improve patient outcomes.

Assessment of usefulness and reliability of YouTube™ videos on denture care

INTRODUCTION

The world's population is in a demographic transition with a rising ageing population. Tooth loss is frequent among older people resulting in the replacement of natural teeth using complete or partial dentures. YouTube™ is the second most popular website in the world and is being increasingly used to access health care information. The aim of this study is to evaluate the usefulness and reliability of the information in YouTube™ videos regarding denture care.

METHODS

The YouTube™ website was used to systematically search for videos using the keyword 'denture care'. Videos meeting the eligibility criteria were assessed separately by two independent researchers. The usefulness of the videos was assessed using the Global Quality Assessment Scale and a customized usefulness scoring scheme. Based on these scores, the usefulness of the videos was categorized as low, medium and high. A modified DISCERN tool (mDISCERN) was used for assessing reliability with scores ranging from 0 to 5. Other video characteristics like source/ownership of the videos, duration, views, likes, dislikes, number of days posted, like ratio, view ratio, interaction index and Video Power Index were also obtained. Statistical analysis was carried out using the Kruskal-Wallis test, Spearman correlation test and multiple linear regression analysis.

RESULTS

A total of 120 videos were included. Based on the usefulness score, the usefulness of 65.8% of videos were classified as low, 32.5% were medium and 1.6% had high usefulness. The mDISCERN score for 74.2% of videos was 2 or below 2 indicating that the majority of videos had low reliability. Video characteristics did not differ significantly according to the usefulness of videos. Videos uploaded by dentists or dental hygienists had significantly higher usefulness scores (p < 0.001) in comparison to videos uploaded by other sources. However, reliability scores did not differ based on the sources of the videos. Video reliability was found to have a significant (B = 2.08, p < 0.001) positive association with video usefulness.

CONCLUSION

YouTube™ cannot be recommended as the only source of information for denture care as most videos received low usefulness and reliability ratings in our study. Dentists and dental health professionals could take an active part in enhancing denture care-related content on YouTube™ and enable patients to have adequate and reliable knowledge of denture hygiene practices.

Educational quality of YouTube content on brachial plexus injury and treatment

INTRODUCTION

While surgical literature exists on birth-related brachial plexus injury (BPI), there are not validated sources of information on BPI for patients, which can impact patient autonomy and decision-making. With YouTube as a popular source for patients to research diagnoses, this study aims to evaluate the quality of information regarding BPI and its treatment available on the platform.

MATERIALS AND METHODS

BPI YouTube videos were screened independently by two reviewers. Videos were categorized by source: (1) academic, government, and non-profit organizations; (2) private practices, companies, and for-profit organizations; (3) independent users. Each video was evaluated for reliability, credibility, and quality using the modified DISCERN criteria (scale, 0-5), Journal of the American Medical Association (JAMA) criteria (scale, 0-4), and Global Quality Scale (GQS; scale, 1-5). Surgical treatment videos were analyzed by the senior author using a modified "treatment" DISCERN criteria (scale, 8-40). Non-English videos were excluded from this study. Analysis of variance tests were used to compare means.

RESULTS

One hundred and fifteen videos were selected for final analysis. The mean modified DISCERN score was 3.26; JAMA was 2.31; GQS was 3.48. Videos were subdivided according to source. Group 1, 2, and 3 had 45, 24, and 46 videos, respectively. Modified DISCERN score was greater for Group 1 than Group 2 (3.58 vs. 3.04, p < .001) and Group 3 (3.58 vs. 3.07, p < .001). JAMA score was greater for Group 1 than Group 2 (2.63 vs 2.15, p = .041) and Group 3 (2.63 vs. 2.08, p = .002). GQS score was greater for Group 1 than Group 2 (3.93 vs. 3.31, p = .031) and Group 3 (3.93 vs. 3.13, p < .001). Of the 34 videos (44.7%) that mentioned treatment, the DISCERN score was 14.32.

CONCLUSION

The videos analyzed were found to have moderate reliability, credibility, and quality. The reliability of information regarding treatments for BPI was poor. Healthcare providers should supply additional information on treatment of BPI.

Medical Accuracy of Patient Discussions in Oculoplastic Surgery on Social Media

PURPOSE

The aim of this study was to characterize major topics of discussion in oculoplastic surgery on a social media forum and to evaluate the medical accuracy of the content discussed on these platforms.

METHODS

A cross-sectional analysis of oculoplastics key search terms was performed on 2 active forums (r/PlasticSurgery and r/CosmeticSurgery) on Reddit. The content analysis involved the top posts in Reddit's history from 2008 to 2022. Medical accuracy was determined by actively practicing, board-certified, and fellowship-trained oculoplastic surgeons.

RESULTS

The most common topics of patient discussions involved inquiring for advice regarding a procedure (44%) and sharing before-and-after photos (34%). The most common topics of patient discussions included providing support, encouragement, or sympathy for a patient (80%) and the cost of a procedure (62%). Misunderstanding of the medical pathophysiology of the patient's condition was seen in 68% of discussions on this social media platform. Medically inaccurate information was seen in 31% of all analyzed statements. When the type of physician performing a given procedure was disclosed, half reported an oculoplastic surgeon performed the surgery.

CONCLUSIONS

The social media platform, Reddit, is a popular source of advice and information for current and prospective oculoplastic surgery patients. Such social media forums should be used as a sort of psychosocial and psychological support rather than as a primary source of medical information.

Evaluating the quality, utility, and reliability of the information in uveitis videos shared on YouTube

BACKGROUND

This study aimed to analyze the quality of videos on YouTube as educational resources about uveitis.

METHODS

An online YouTube search was performed using the keyword "uveitis". Total view counts, duration of videos, publishing dates, likes and dislikes, numbers of comments, and source of videos were recorded. The quality and accuracy of the video's educational content were evaluated using the DISCERN score, Global Quality Score (GQS), and Journal of the American Medical Association (JAMA) score. Video power index (VPI) was used to evaluate both the view and the like ratio of the videos. All videos were classified according to publishers and types of categories.

RESULTS

From among the 200 videos analyzed, 94 were included. The mean DISCERN score was 38.5 ± 13.2 (poor), the mean JAMA score was 1.8 ± 0.6 (fair), and the GQS was 2.5 ± 0.9 (fair). There were positive correlations between the three checklists (p < .001). VPI was not correlated with each score (p > .05). The most common upload sources were ophthalmologists (24.4%) and YouTube channels about health (20.2%). Regarding content, we identified 47 (50%) medical education, 26 (27.6%) patient education, 16 (17%) patient experience, and five (5.3%) surgical procedure videos involving patients with uveitis. While the most popular videos were uploaded by doctors other than ophthalmologists, the videos uploaded by academic institutions and associations of healthcare professional were found to have higher educational quality and reliability scores.

CONCLUSIONS

Uveitis videos on YouTube are of poor quality and reliability and are not adequately educational for patients. Therefore, physicians must be aware of the limitations of YouTube and ensure the flow of correct medical information to patients.

Usefulness of YouTube in Sharing Information about New Gene Therapy for Spinal Muscular Atrophy: A Content Analysis

This study aimed to objectively assess YouTube videos' quality, reliability, and information delivery capability regarding novel spinal muscular atrophy treatments. Using the keywords "nusinersen", "spinraza", "ridisplam", "evrysdi", "onasemnogene abeparvovec", and "zolgensma", we were able to retrieve and screen 360 videos before settling on a final sample of 99 on 25 September 2022. Then, two independent raters used the mDISCERN and GQS instruments to evaluate the videos' reliability and quality and the Information Delivery Capability (IDC) score to assess the videos' accuracy and patient-friendliness. The quality, reliability, and information delivery capability of the videos about the new treatment for SMA were quite heterogeneous, with an average mDISCERN, GQS, and IDC score of 3.172 ± 0.899, 2.980 ± 1.025, and 4.141 ± 1.747, respectively. In-depth analysis showed that healthcare expert videos that explained contents while showing infographic supplements had good quality, reliability, and information delivery capability. As YouTube is already a dominant media platform, the public may obtain new information about novel therapeutics for SMA through YouTube. It is necessary to consider how SMA patients and caregivers can choose trusted sources with reliable information on YouTube, and our results can provide clues. Additionally, experts should strive to provide more accurate, reliable, and patient-oriented videos.

Analysis of the quality and reliability of trifocal intraocular lens videos on YouTube

OBJECTIVE

This study analyzed the quality and reliability of videos on YouTube as educational resources on trifocal intraocular lenses (IOL).

METHODS

This study is a retrospective, cross-sectional and record-based study. An online YouTube search was performed using the terms "trifocal lens implants" and "trifocal IOL," and a total of 229 videos were recorded. Eighty-six videos that met the study criteria were included. All videos were evaluated with DISCERN, Journal of the American Medical Association (JAMA), and Global Quality Score (GQS) scores.

RESULTS

The mean DISCERN, JAMA, and GQS scores were 37.79±11.92, 2.01±0.87, and 2.17±1.01, respectively. Of all the videos, 39 (45%) were uploaded by physicians, and 47 (55%) were uploaded by non-physicians. While the length of the videos (length) was significantly greater in the physician group (P=0.02), the age of the videos (age) was significantly higher in the non-physician group (P=0.02). However, the differences between the two groups in terms of other general characteristics, DISCERN, JAMA and GQS scores were not significant.

CONCLUSIONS

Our finding suggests that trifocal IOL-related YouTube™ videos are of low quality and reliability, thus inadequate for patient information.

YouTube as a source of patient information for pterygium surgery

Background

Patients use the YouTube platform to get information about pterygium surgery, and this affects the treatment decisions of the patients.

Objectives

The purpose of this study was to analyze the quality and reliability of YouTube videos as educational resources about pterygium surgery.

Design

This is a register-based retrospective study.

Methods

This was a retrospective, record-based study. A YouTube search was performed using the terms 'pterygium surgery' and 'pterygium eye surgery', resulting in the evaluation of a total of 200 videos. In the end, 122 English-language videos about pterygium surgery were recruited to study. All videos were rated with the DISCERN, the Journal of the American Medical Association (JAMA), and the Global Quality Score (GQS) systems.

Results

The mean DISCERN, JAMA, and GQS values were 38.9 ± 10.9, 1.8 ± 0.8, and 2.2 ± 1, respectively. The YouTube videos about pterygium surgery had been uploaded by a physician in 63 (51.6%) and non-physicians in 59 (48.4%) cases. There was no significant difference between the two groups in terms of general characteristics and scores.

Conclusions

Our results show that YouTube videos about pterygium surgery have low quality and credibility and are not sufficient in terms of providing patient information.

Registration

Not applicable.

Kornea nakli konusunda YouTube videoları ne kadar güvenilir bilgi sağlıyor?

Amaç YouTube üzerinden yayınlanan videolarda kornea nakli hakkında verilen bilgilerin ne denli güvenilir olduğunu değerlendirmek. Yöntemler YouTube üzerinden video arama motoruna “kornea nakli” yazıldıktan sonra ekranda beliren ilk 100 video 04.03.2022 tarihinde listelenmiştir. Yükleme tarihi, yayın süresi, toplam izlenme sayısı, günlük izlenme oranı, video kaynağı ve süresi (saniye), beğeni ve yorum sayısı kaydedilen parametrelerdi. İki oftalmolog, videoları JAMA, DISCERN ve Global Quality (GQ) endekslerini kullanarak körü körüne ve bağımsız olarak değerlendirdi ve puanladı. Bulgular Videoların kaynağı değerlendirildiğinde, 10 videonun göz hastalıkları uzmanı tarafından yüklendiği, 35 videonun televizyon programından belli bir bölüm içerdiği, 14 videonun herhangi bir sağlık kuruluşu ve 22 videonun ise diğer kaynaklar tarafından yüklendiği tespit edilmiştir. Kaynağı televizyon programı olan videoların süresinin anlamlı olarak (p

Evaluation of the usage of YouTube videos about Histology and Embryology as an educational material

The use of YouTube videos for educational purposes has been increasingly popular. The quality and accuracy of the information level of these videos should be checked by expert trainers. This study aims to evaluate the content, quality and functionality of YouTube videos on Histology and Embryology and to measure their educational usefulness. In the study, searches were performed using the keywords "Histology" and "Embryology" in the YouTube search tab. Quality and content were evaluated using the Video Power Index (VPI), modified DISCERN scale, JAMA and the Global Quality Scale (GQS). Videos were categorized by educational usefulness. SPSS software was used for statistical analysis. A statistically significant high correlation was observed between modified DISCERN scores and JAMA scores (r = 0.757, p < 0.001) and between modified DISCERN scores and GQS scores (r = 0.743, p < 0.001). A statistically significant high correlation was also determined between JAMA and GQS scores (r = 0.632, p < 0.001). GQS scores were weakly, negatively and significantly correlated with the number of comments (r = -0.302, p < 0.05) and dislikes (r = -0.325, p < 0.05). Based on GQS, the useful and non-useful videos differed significantly in terms of views, likes, dislikes, comments counts and days since upload (p < 0.05). Modified DISCERN and JAMA scores also differed significantly between the useful and non-useful videos (p < 0.001). Educational videos published for Histology and Embryology education on the internet will be more beneficial if they are prepared by expert educators from reliable information sources, by the current literature, and by scoring systems such as DISCERN, JAMA and GQS.

What Hundreds of Millions of Patients With Dry Eye Will Find on YouTube: A Quality and Reliability Research of the YouTube Videos

PURPOSE

The aim of this study was to evaluate the demographic features, quality, and reliability of YouTube videos addressing dry eye disease (DED).

METHODS

The term "dry eye disease" has been searched on YouTube. The first 500 videos that emerged using the defined search term were evaluated. Duplicated-split videos, videos shorter than 60 seconds, videos with a language other than English or videos with an unintelligible English accent, and videos unrelated to DED were excluded. Video uploaders, types, origins, durations, and viewer interactions of the videos were noted. DISCERN, the Global Quality Score, and the Video Quality Score (created by the authors) were used to evaluate the video quality.

RESULTS

Of the 500 videos, 262 videos were excluded, and the remaining 238 videos were evaluated. Videos were of moderate quality on all 3 scoring systems. The medical institute and academic society videos had the highest quality (P < 0.05). The quality of videos uploaded by physicians was significantly lower than medical institute and academic society videos and was higher than the others (P < 0.05). User interactions and video duration were weakly positively correlated with the video quality (P < 0.05).

CONCLUSIONS

Among YouTube videos on DED, only a minority are of good or excellent quality. Videos uploaded by medical institutes or academic societies scored higher in quality than those uploaded by physicians, which, in turn, scored higher than those uploaded by all others. User interactions were weakly correlated with quality values, suggesting user interactions are not good indicators of the quality of YouTube videos on DED.

An Analysis of the Quality, Reliability, and Popularity of YouTube Videos on Glaucoma

PURPOSE

To evaluate the quality, reliability, and popularity of videos relating to glaucoma on YouTube.

DESIGN

Retrospective, cross-sectional study of YouTube videos about glaucoma.

PARTICIPANTS

One hundred YouTube videos were analyzed for this study.

METHODS

An online YouTube search for glaucoma videos was conducted simulating a user search using the keywords glaucoma, high eye pressure, and high intraocular pressure. The first 100 videos were analyzed, and each video was evaluated by 2 independent reviewers using the modified DISCERN (scale, 1-5), Journal of the American Medical Association (JAMA; scale, 0-4), and Global Quality (GQ; scale, 1-5) criteria to assess quality and reliability. Videos were categorized further into 3 groups depending on the source of their upload. Group 1 comprised videos uploaded by academic or government institutions, group 2 comprised videos uploaded by private medical practices, and group 3 comprised videos uploaded by independent users.

MAIN OUTCOME MEASURES

Modified DISCERN, JAMA, and GQ scores for quality and reliability of information and video power index (VPI) for video popularity.

RESULTS

No substantial difference in scoring was observed between the 2 independent reviewers. The overall mean ± standard error (SE) scores were modified DISCERN score, 3.81 ± 0.06; JAMA score, 2.93 ± 0.07; and GQ score, 3.98 ± 0.06. The overall mean ± SE VPI score was 9.9 ± 2.9. Significant positive correlations were found between video popularity and quality of information for all 3 criteria (P < 0.05). The videos in groups 1 and 2 showed higher modified DISCERN scores than those in group 3, but did not score higher with either the JAMA or GQ criteria. Videos in group 3 were the most popular when compared with videos in groups 1 or 2 (P < 0.01).

CONCLUSIONS

Overall, many of the videos had adequate quality and reliability scores. No difference was found among groups 1 through 3 for 2 of the 3 criteria used, suggesting a similar quality of information provided among academic, private, and independent sources.

Evaluation of the Usefulness of YouTube Videos on Retinal Detachment Surgery

Introduction

The aim of this study is to evaluate the usefulness of YouTube videos about retinal detachment surgery as a resource.

Methods

The first 100 videos were evaluated when they were scanned by typing "retinal detachment surgery " in the YouTube search engine. These videos were also analyzed and scored using DISCERN, Journal of the American Medical Association (JAMA), and Global Quality (GQ) scoring systems.

Results

The DISCERN score of the evaluated videos was 39.5±8.4; JAMA score was 1.9±0.5; and the GQ score was 2.1±0.5. According to the results, retinal detachment surgery videos, DISCERN score is medium; The JAMA score was evaluated as low quality and poor quality in the GQ score.

Conclusion

Although there are enough videos on YouTube with retinal detachment surgery, its usefulness as a resource is low, and its quality is poor.