1
|
Giordano M, Caccavella VM, Tariciotti L, Della Pepa GM, Olivi A, Polli FM. The reliability and quality of online patient education videos for vestibular schwannoma. Br J Neurosurg 2024; 38:811-816. [PMID: 34472385 DOI: 10.1080/02688697.2021.1973369] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Revised: 08/05/2021] [Accepted: 08/24/2021] [Indexed: 10/20/2022]
Abstract
BACKGROUND A recent trend of looking for health-related conditions on the Internet has been described, with up 70% of searchers stating that online sources have affected their medical decision-making. Patients with vestibular schwannomas (VS) use online sources, including videos, to seek information about treatment alternatives and outcomes and surgeons experience. Our study investigates the reliability and quality of VS-related online videos. METHODS In April 2020, a search was launched on YouTube for the key terms 'vestibular schwannoma,' 'acoustic neuroma,' 'eighth cranial nerve schwannoma,' and 'eighth cranial nerve neuroma.' Results were screened for possible inclusion. Three authors independently used the DISCERN instrument to evaluate the reliability and quality of the included videos. Factors possibly influencing popularity were investigated. RESULTS The initial search yielded 6416 videos. 38 videos were included in the final analysis. The average DISCERN score was 2.76, indicating overall poor quality and reliability of information. Only 5% scored 4.0 or more (unbiased videos that offer evidence-supported information); 31% scored between 3.0 and 3.99, and 63% scored 2.99 or less. Videos describing symptoms or the patient's clinical presentation were slightly more popular than videos without these characteristics. Surgical videos (videos containing clips of surgical procedures) were significantly more popular than non-surgical videos (p = .024) despite being of similarly poor quality (DISCERN score 2.85 vs. 2.74, respectively). CONCLUSIONS Available patient educational videos for VS are of mixed quality and reliability: the authors describe the strengths and pitfalls of existing YouTube videos. Considering that VS is a pathology with multiple available management modalities, and that patients' decision-making is affected by the information available on the Internet, it is of great importance that good-quality informative material be released by medical, academic, or educational institutions.
Collapse
Affiliation(s)
- Martina Giordano
- Department of Neurosurgery, Fondazione Policlinico Gemelli IRCCS, Università Cattolica del Sacro Cuore - Roma, Rome, Italy
| | - Valerio Maria Caccavella
- Department of Neurosurgery, Fondazione Policlinico Gemelli IRCCS, Università Cattolica del Sacro Cuore - Roma, Rome, Italy
| | - Leonardo Tariciotti
- Unit of Neurosurgery, Fondazione IRCCS Cà Granda Ospedale Maggiore Policlinico, Milan, Italy
- Department of Neurosurgery, University of Milan, Milan, Italy
| | - Giuseppe Maria Della Pepa
- Department of Neurosurgery, Fondazione Policlinico Gemelli IRCCS, Università Cattolica del Sacro Cuore - Roma, Rome, Italy
| | - Alessandro Olivi
- Department of Neurosurgery, Fondazione Policlinico Gemelli IRCCS, Università Cattolica del Sacro Cuore - Roma, Rome, Italy
| | - Filippo Maria Polli
- Department of Neurosurgery, Fondazione Policlinico Gemelli IRCCS, Università Cattolica del Sacro Cuore - Roma, Rome, Italy
| |
Collapse
|
2
|
Alamoudi W, Riordain RN, Fedele S, Porter S. Audiovisual information of oral epithelial dysplasia: Quality, understandability and actionability. Oral Dis 2024; 30:1945-1955. [PMID: 37518951 DOI: 10.1111/odi.14701] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 06/26/2023] [Accepted: 07/18/2023] [Indexed: 08/01/2023]
Abstract
OBJECTIVES Online information on oral epithelial dysplasia (OED) is insufficient and of low quality. While only written information has been previously assessed, this study aims to evaluate the content and quality of audiovisual (AV) online information about OED. METHODS One hundred and twenty-seven materials were initially considered using six key words across two search engines (YouTube and Google). Ultimately, 29 materials remained for the final assessment. These materials were then analysed for content, quality (DISCERN instrument, JAMA benchmarks), understandability and actionability. RESULTS Most contents were scientific (n = 25), while three videos were educational, and one video was a personal experience with OED. On a scale of 1-5, the overall DISCERN score was (mean ± SD = 2.26 ± 0.79), suggesting poor quality of information. Regarding JAMA benchmarks, there was no single material that fulfilled or lacked all four benchmarks. The overall mean understandability score was 82% and the actionability mean score was significantly low at 29%. CONCLUSION Although the vast majority of AV materials on OED were primarily produced for scientific purposes, these materials could be helpful as resources for patient education. Keeping in mind, however, that the desired quality and essential patient information about OED available online remains largely poor and missing.
Collapse
Affiliation(s)
- Waleed Alamoudi
- Faculty of Dentistry, King Abdulaziz University, Jeddah, Saudi Arabia
- UCL Eastman Dental Institute, University College London, London, UK
| | - Richeal Ni Riordain
- UCL Eastman Dental Institute, University College London, London, UK
- Cork University Dental School and Hospital, University College Cork, Cork, Ireland
| | - Stefano Fedele
- UCL Eastman Dental Institute, University College London, London, UK
- Biomedical Research Centre, NIHR, University College London Hospitals, London, UK
| | - Stephen Porter
- UCL Eastman Dental Institute, University College London, London, UK
| |
Collapse
|
3
|
Day ME, Zwemer CH, Pierce AZ, Wanersdorfer K, Kartiko S, LaPorta M, Sarani B, Jackson HT, Estroff JM. Cricothyrotomy Online: Quality Assessment of Educational Videos on YouTube. Am Surg 2023; 89:5957-5963. [PMID: 37285452 DOI: 10.1177/00031348231183122] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
BACKGROUND Medical learners may use YouTube® videos to prepare for procedures. Videos are convenient and readily available, but without any uploading standards, their accuracy and quality for education are uncertain. We assessed the quality of emergency cricothyrotomy videos on YouTube through an expert panel of surgeons with objective quality metrics. METHODS A YouTube® search for "emergency cricothyrotomy" was performed and results were filtered to remove animations and lectures. The 4 most-viewed videos were sent to a panel of trauma surgeons for evaluation. An educational quality (EQ) score was generated for each video based on its ability to explain the procedure indications, orient the viewer to the patient, provide accurate narration, provide clear views of procedure, identify relevant instrumentation and anatomy, and explain critical maneuvers. Reviewers were also asked if safety concerns were present and encouraged to give feedback in a free-response field. RESULTS Four surgical attendings completed the survey. The median EQ score was 6 on a 7-point scale (95% CI [6, 6]). All but one of the individual parameters had a median EQ score of 6 (95% CI: indications [3, 7], orientation [5, 7], narration [6, 7], clarity [6, 7], instruments [6, 7], anatomy [6, 6], critical maneuvers [5, 6]). Safety received a lower EQ score (5.5, 95% CI [2, 6]). CONCLUSIONS The most-viewed cricothyrotomy videos were rated positively by surgical attendings. Still, it is necessary to know if medical learners can distinguish high from low quality videos. If not, this suggests a need for surgical societies to create high-quality videos that can be reliably and efficiently accessed on YouTube®.
Collapse
Affiliation(s)
- Margot E Day
- School of Medicine and Health Sciences, George Washington University, Washington, DC, USA
| | - Catherine H Zwemer
- School of Medicine and Health Sciences, George Washington University, Washington, DC, USA
| | - Ayal Z Pierce
- Department of Emergency Medicine, George Washington University, Washington, DC, USA
| | - Karen Wanersdorfer
- Department of Surgery, George Washington University, Washington, DC, USA
| | - Susan Kartiko
- Department of Surgery, George Washington University, Washington, DC, USA
| | - Matthew LaPorta
- Department of Surgery, George Washington University, Washington, DC, USA
| | - Babak Sarani
- Department of Surgery, George Washington University, Washington, DC, USA
| | - Hope T Jackson
- Department of Surgery, George Washington University, Washington, DC, USA
| | - Jordan M Estroff
- Department of Surgery, George Washington University, Washington, DC, USA
| |
Collapse
|
4
|
Green L, Noll D, Barbaro A, Asokan G, Hewitt J, Ovenden C, Kanhere H, Trochsler M. YouTube-Friend or Foe? A Closer Look at Videos on Inguinal Hernia Surgery as a Source for Patient Education. J Surg Res 2022; 280:510-514. [PMID: 36081310 DOI: 10.1016/j.jss.2022.07.024] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2022] [Revised: 07/14/2022] [Accepted: 07/28/2022] [Indexed: 11/29/2022]
Abstract
INTRODUCTION The Internet is an extensively used source of medical education by the public. In particular, YouTube is a valuable source of information which can be used to improve patient education. However, there is no quality assurance regime for YouTube videos pertaining to medical education. In this study, we aimed to evaluate the quality and accuracy of videos regarding inguinal hernia repair. METHODS Two hundred videos were searched for and viewed on YouTube from the phrases: 'inguinal hernia repair,' 'patient information for inguinal hernia repair,' and 'hernia operation.' After the application of predefined exclusion criteria, 23 videos were selected and the following data were collected: number of views, duration since video was posted, and the number of likes, dislikes, and comments. The educational quality was rated using three scoring systems: Health on the Net code, Journal of the American Medical Association, and DISCERN scoring systems. All three scoring systems have been previously used to evaluate online videos; however, they have not been formally validated. RESULTS The videos were of low quality when using the Health on the Net code, Journal of the American Medical Association, and DISCERN scoring systems. There was no association between video quality as measured by any of the scoring systems and the number of views. The number of days online was independently predictive of the number of views (P = 0.044) and explained 18% of the variance in views. Likewise, there was no significant association between video quality and video length. CONCLUSIONS YouTube videos on inguinal hernia repair are of low quality and accuracy. However, the potential of using YouTube to educate patients cannot be ignored.
Collapse
Affiliation(s)
- Luke Green
- The University of Adelaide, Department of Surgery, The Queen Elizabeth Hospital, Adelaide, South Australia, Australia
| | - Darcy Noll
- The University of Adelaide, Department of Surgery, The Queen Elizabeth Hospital, Adelaide, South Australia, Australia
| | - Antonio Barbaro
- The University of Adelaide, Department of Surgery, The Queen Elizabeth Hospital, Adelaide, South Australia, Australia
| | - Gayatri Asokan
- The University of Adelaide, Department of Surgery, The Queen Elizabeth Hospital, Adelaide, South Australia, Australia
| | - Joseph Hewitt
- The University of Adelaide, Department of Surgery, The Queen Elizabeth Hospital, Adelaide, South Australia, Australia
| | - Christopher Ovenden
- Faculty of Health and Medical Sciences, The University of Adelaide, Adelaide, South Australia, Australia
| | - Harsh Kanhere
- The University of Adelaide, Department of Surgery, The Queen Elizabeth Hospital, Adelaide, South Australia, Australia; Division of Upper GI Surgery, Royal Adelaide Hospital, Adelaide, South Australia, Australia
| | - Markus Trochsler
- The University of Adelaide, Department of Surgery, The Queen Elizabeth Hospital, Adelaide, South Australia, Australia.
| |
Collapse
|
5
|
Kurtuluş İ. Measurement of the Reliability and Quality of Online Surgery Videos with Artificial Neural Networks. ISTANBUL MEDICAL JOURNAL 2022. [DOI: 10.4274/imj.galenos.2022.55492] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
|
6
|
Lima DL, Viscarret V, Velasco J, Lima RNCL, Malcher F. Social media as a tool for surgical education: a qualitative systematic review. Surg Endosc 2022; 36:4674-4684. [PMID: 35230534 PMCID: PMC8886864 DOI: 10.1007/s00464-022-09150-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2021] [Accepted: 02/15/2022] [Indexed: 11/29/2022]
Abstract
Background Social media use has exploded, attaining a significant influence within medicine. Previous studies have denoted the use of social media in various surgical specialties as a means to exchange professional ideas and improve the conference experience and at the same time, some have assessed its feasibility as a method of education. This systematic review aims to characterize the use of social media as a tool for general surgery education. Methods A systematic review of several databases from each database inception was conducted following the PRISMA guidelines. The JBI’s critical appraisal tools were used to assess quality of the studies. Results A total of 861 articles were identified of which 222 were duplicates removed. The titles and abstracts from the remaining 639 abstracts were screened and 589 were excluded. The remaining 51 full articles were analyzed for eligibility, of which 24 met inclusion criteria and were included in the systematic review. These studies covered the general surgery specialty, of which 11 (n = 46%) focused on the laparoscopic surgical approach, 1 (n = 4%) on robotic-assisted surgical procedures, 1 (n = 4%) on both surgical approaches previously mentioned and 11 (n = 46%) on the general surgery specialty regardless of the surgical approach or technique. Conclusions Advantages that SM offers should be considered, and content creators and institutions should help collectively to make sure that the content being published is evidence and guideline-based so its use it is taken to the maximum benefit. Supplementary Information The online version contains supplementary material available at 10.1007/s00464-022-09150-9.
Collapse
Affiliation(s)
- Diego L Lima
- Department of Surgery, Montefiore Medical Center, 1825 Eastchester Rd, Bronx, NY, 10461, USA.
| | - Valentina Viscarret
- Department of Surgery, Montefiore Medical Center, 1825 Eastchester Rd, Bronx, NY, 10461, USA
| | - Juan Velasco
- Department of Surgery, Montefiore Medical Center, 1825 Eastchester Rd, Bronx, NY, 10461, USA
| | | | - Flavio Malcher
- Division of General Surgery, NYU Langone Health, New York, USA
| |
Collapse
|
7
|
Manatakis DK, Mylonakis E, Anagnostopoulos P, Lamprakakis K, Agalianos C, Korkolis DP, Dervenis C. Are YouTube Videos a Reliable Training Method for Safe Laparoscopic Cholecystectomy? A Simulated Decision-Making Exercise to Assess the Critical View of Safety. Surg J (N Y) 2021; 7:e357-e362. [PMID: 34966849 PMCID: PMC8702373 DOI: 10.1055/s-0041-1740627] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Accepted: 10/26/2021] [Indexed: 11/09/2022] Open
Abstract
Background
The present study assesses the educational value of laparoscopic cholecystectomy videos on YouTube regarding the correct application of the critical view of safety (CVS), and evaluates… surgical trainees' perceptions of the CVS criteria in a simulated, operative decision-making exercise.
Methods
YouTube was systematically searched for laparoscopic cholecystectomy videos, explicitly reporting a satisfactory CVS. The top 30 most popular videos, by number of views, were identified and scored on the 6-point scale by three experienced consultants. After watching a training module on CVS rationale and criteria, 10 trainees, blinded to the consultants' assessment, were instructed to view the videos, score each criterion and answer the binary question “Would you divide the cystic structures?” by “yes” or “no.”
Results
An inadequate CVS was found in 30% of the included videos. No statistical association was noted between number of views, likes, or dislikes with successful CVS rates. Inter-observer agreement between consultants and trainees ranged from minimal to moderate (
k
= 0.07–0.60). Discrepancy between trainees' CVS scores and their simulated decision to proceed to division of the cystic structures was found in 15% of assessments, with intra-observer agreement ranging from minimal to excellent (
k
= 0.27–1.0). For the CVS requirements, inter-observer agreement was minimal for the dissection of the cystic plate (
k
= 0.26) and triangle clearance (
k
= 0.39) and moderate for the identification of two and only two structures (
k
= 0.42).
Conclusion
The CVS is central to the culture of safety in laparoscopic cholecystectomy. Surgical videos are a useful training tool as simulated, operative decision-making exercises. However, public video platforms should be used judiciously, since their content is not peer-reviewed or quality-controlled.
Collapse
Affiliation(s)
- Dimitrios K Manatakis
- 2nd Department of Surgery, Athens Naval and Veterans Hospital, Athens, Greece.,Department of Surgical Oncology, Saint Savvas Cancer Hospital, Athens, Greece
| | - Emmanouil Mylonakis
- 2nd Department of Surgery, Athens Naval and Veterans Hospital, Athens, Greece
| | | | | | | | | | - Christos Dervenis
- Department of Surgery, Medical School, University of Cyprus, Nicosia, Cyprus
| |
Collapse
|
8
|
Educational quality of YouTube videos on musculoskeletal ultrasound. Clin Rheumatol 2021; 40:4243-4251. [PMID: 34059985 PMCID: PMC8166370 DOI: 10.1007/s10067-021-05793-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Revised: 05/10/2021] [Accepted: 05/23/2021] [Indexed: 11/29/2022]
Abstract
Introduction/objectives A progressively growing number of rheumatologists have integrated musculoskeletal ultrasound (MSUS) as a prized tool in their daily clinical practice over the past two decades. Lately, YouTube is often used by healthcare professionals as an educational tool. This study aimed to analyze the quality of educational information available on YouTube pertaining to MSUS. Method We performed a search using the keyword “musculoskeletal ultrasound” on YouTube in January 2021. Of the first 200 videos screened, 147 met the inclusion criteria. The quality and reliability of the videos were evaluated using the global quality score (GQS) and modified DISCERN score, and their popularity was assessed using the Video Power Index (VPI). Results Of the 147 videos evaluated, 58 (39.5%) were of high quality, 30 (20.4%) were of moderate quality, while 59 (40.1%) were of low quality. The modified DISCERN score and the duration of the videos were significantly higher in the high-quality videos than the moderate- and low-quality videos (p < 0.001 for all). The median number of views per day, likes, comments, and the popularity of the videos assessed with VPI were significantly higher in the high- and moderate-quality group compared to the low-quality videos (p < 0.001, p < 0.001, p = 0.007, and p < 0.001, respectively). Conclusion The quality of YouTube videos as an educational source on MSUS is unsatisfactory. Professional organizations and physicians should consider creating more high-quality MSUS videos. YouTube should consider filtering out poor-quality videos in collaboration with experts in the field.Key Points • Although rheumatologists are increasingly using ultrasound as an extension of their exam, accessing musculoskeletal ultrasound training is still facing some challenges. • YouTube is commonly used as an educational source by medical students and healthcare professionals. • Approximately 60% of the videos related to musculoskeletal ultrasound on YouTube revealed high and moderate quality, while the remaining 40% were of low quality and not suitable for medical education. • A filtering mechanism is required to improve the quality of YouTube content on MSUS. | |
Collapse
|
9
|
Yilmaz Ferhatoglu S, Kudsioglu T. Evaluation of the reliability, utility, and quality of the information in cardiopulmonary resuscitation videos shared on Open access video sharing platform YouTube. Australas Emerg Care 2020; 23:211-216. [PMID: 32563667 DOI: 10.1016/j.auec.2020.05.005] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2019] [Revised: 05/20/2020] [Accepted: 05/21/2020] [Indexed: 01/08/2023]
Abstract
BACKGROUND The internet is a widely used source for obtaining medical information both by patients and physicians. YouTube is an essential source of information that may be a useful tool to inform the public and may improve the learning experience if used adequately. In this study, we aimed to estimate the quality and accuracy of videos about cardiopulmonary resuscitation videos aired on YouTube, which is the most popular video platform of the online world. METHODS We included the first 100 videos, in English, returned by the YouTube search engine in response to "cardiopulmonary resuscitation" keyword query to the study. The popularity of the videos was evaluated with an index called the video power index. The educational quality, accuracy, and transparency of the visual content were measured using the DISCERN questionnaire (DISCERN), Journal of American Medical Association (JAMA-BC) benchmark criteria, and Global Quality Score (GQS). The technical quality was measured by the Cardiopulmonary Resuscitation Scoring System (CPR-SS), which was utilized by three bariatric surgeons. RESULTS The source in 7% of the videos was medical doctors. The content in 89% of the videos was cardiopulmonary resuscitation technique. According to sources, videos uploaded by physicians had significantly higher quality, transparency, educational and technical value. Unlike, videos uploaded by physicians had a lower video power index than videos uploaded by non-medical professionals. Cardiopulmonary resuscitation technique videos had significantly higher quality, transparency, educational and technical value. Cardiopulmonary resuscitation technique videos also had higher popularity scores than "information or lecture" videos. Also, negative correlations were found between the (popularity index and transparency, education and technical quality scores. CONCLUSIONS Online information on cardiopulmonary resuscitation is of low quality, and its contents are of unknown source and accuracy. However, the educational potential of the online video platform, YouTube, cannot be neglected.
Collapse
Affiliation(s)
- Sibel Yilmaz Ferhatoglu
- University of Health Sciences, Dr. Siyami Ersek Cardiothoracic Surgery Training and Research Hospital, Department of Anesthesiology, Istanbul, Turkey.
| | - Turkan Kudsioglu
- University of Health Sciences, Dr. Siyami Ersek Cardiothoracic Surgery Training and Research Hospital, Department of Anesthesiology, Istanbul, Turkey
| |
Collapse
|