1
|
Ding K, Chen M, Li P, Xie Z, Zhang H, Kou R, Xu J, Zou T, Luo Z, Song H. The effect of simulation of sectional human anatomy using ultrasound on students' learning outcomes and satisfaction in echocardiography education: a pilot randomized controlled trial. BMC MEDICAL EDUCATION 2024; 24:494. [PMID: 38702655 PMCID: PMC11069238 DOI: 10.1186/s12909-024-05337-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/29/2023] [Accepted: 03/21/2024] [Indexed: 05/06/2024]
Abstract
BACKGROUND Effective teaching methods are needed to improve students' abilities in hand-eye coordination and understanding of cardiac anatomy in echocardiography education. Simulation devices have emerged as innovative teaching tools and exhibited distinctive advantages due to their ability to provide vivid and visual learning experiences. This study aimed to investigate the effect of simulation of sectional human anatomy using ultrasound on students' learning outcomes and satisfaction in echocardiography education. METHODS The study included 18 first-year clinical medical students with no prior echocardiography training. After randomization, they underwent a pre-test to assess basic knowledge. Following this, the students were divided into two groups: traditional teaching (traditional group) and simulation of sectional human anatomy using ultrasound (digital group). Each group received 60 min of instruction. Post-tests were assigned to students at two different time points: immediately after the lecture, and one week later (referred to as post-tests 1, and 2). In addition, anonymous questionnaires were distributed to students after class to investigate their satisfaction with teaching. RESULTS Both groups showed significant improvement in their scores on post-test 1 compared to pre-test (traditional group: from 33.1 ± 8.8 to 48.1 ± 13.1, P = 0.034 vs. digital group: from 35.0 ± 6.7 to 58.0 ± 13.2, P = 0.008). However, there were no significant differences between the two groups in several post-test comparisons. Student satisfaction ratings revealed that the digital group experienced significantly greater satisfaction in areas such as subject interest, teaching style, course alignment, and interaction compared to the traditional group. Additionally, 80% of the digital group strongly endorsed the use of simulation of sectional human anatomy using ultrasound for echocardiography teaching, highlighting its effectiveness. CONCLUSIONS Simulation of sectional human anatomy using ultrasound may improve students' understanding of echocardiography and satisfaction with the course. Our study provides evidence supporting the use of simulation teaching devices in medical education. Further research is needed to explore the long-term impact of this teaching method on students' learning outcomes and its integration into the medical curriculum. TRIAL REGISTRATION http://www.chictr.org.cn (registration number: ChiCTR2300074015, 27/07/2023).
Collapse
Affiliation(s)
- Kewen Ding
- West China School of Medicine, Sichuan University, 610041, Chengdu, Sichuan, P. R. China
| | - Mingjing Chen
- Department of Epidemiology, College of Public Health & Health Professions and College of Medicine, University of Florida, Gainesville, FL, USA
| | - Ping Li
- Department of Anesthesiology, West China Hospital, Sichuan University, 610041, Chengdu, Sichuan, China
| | - Zichuan Xie
- West China School of Medicine, Sichuan University, 610041, Chengdu, Sichuan, P. R. China
| | - Haorong Zhang
- West China School of Medicine, Sichuan University, 610041, Chengdu, Sichuan, P. R. China
| | - Ruixing Kou
- West China School of Medicine, Sichuan University, 610041, Chengdu, Sichuan, P. R. China
| | - Jionghui Xu
- Department of Anesthesiology, West China Hospital, Sichuan University, 610041, Chengdu, Sichuan, China
| | - Ting Zou
- Department of Anesthesiology, West China Hospital, Sichuan University, 610041, Chengdu, Sichuan, China
| | - Zhen Luo
- Department of Anesthesiology, West China Hospital, Sichuan University, 610041, Chengdu, Sichuan, China
| | - Haibo Song
- Department of Anesthesiology, West China Hospital, Sichuan University, 610041, Chengdu, Sichuan, China.
| |
Collapse
|
2
|
Dadon Z, Orlev A, Butnaru A, Rosenmann D, Glikson M, Gottlieb S, Alpert EA. Empowering Medical Students: Harnessing Artificial Intelligence for Precision Point-of-Care Echocardiography Assessment of Left Ventricular Ejection Fraction. Int J Clin Pract 2023; 2023:5225872. [PMID: 38078051 PMCID: PMC10699938 DOI: 10.1155/2023/5225872] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 10/14/2023] [Accepted: 11/14/2023] [Indexed: 12/18/2023] Open
Abstract
Introduction Point-of-care ultrasound (POCUS) use is now universal among nonexperts. Artificial intelligence (AI) is currently employed by nonexperts in various imaging modalities to assist in diagnosis and decision making. Aim To evaluate the diagnostic accuracy of POCUS, operated by medical students with the assistance of an AI-based tool for assessing the left ventricular ejection fraction (LVEF) of patients admitted to a cardiology department. Methods Eight students underwent a 6-hour didactic and hands-on training session. Participants used a hand-held ultrasound device (HUD) equipped with an AI-based tool for the automatic evaluation of LVEF. The clips were assessed for LVEF by three methods: visually by the students, by students + the AI-based tool, and by the cardiologists. All LVEF measurements were compared to formal echocardiography completed within 24 hours and were evaluated for LVEF using the Simpson method and eyeballing assessment by expert echocardiographers. Results The study included 88 patients (aged 58.3 ± 16.3 years). The AI-based tool measurement was unsuccessful in 6 cases. Comparing LVEF reported by students' visual evaluation and students + AI vs. cardiologists revealed a correlation of 0.51 and 0.83, respectively. Comparing these three evaluation methods with the echocardiographers revealed a moderate/substantial agreement for the students + AI and cardiologists but only a fair agreement for the students' visual evaluation. Conclusion Medical students' utilization of an AI-based tool with a HUD for LVEF assessment achieved a level of accuracy similar to that of cardiologists. Furthermore, the use of AI by the students achieved moderate to substantial inter-rater reliability with expert echocardiographers' evaluation.
Collapse
Affiliation(s)
- Ziv Dadon
- Jesselson Integrated Heart Center, Shaare Zedek Medical Center, Jerusalem, Israel
- Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
| | - Amir Orlev
- Jesselson Integrated Heart Center, Shaare Zedek Medical Center, Jerusalem, Israel
- Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
| | - Adi Butnaru
- Jesselson Integrated Heart Center, Shaare Zedek Medical Center, Jerusalem, Israel
| | - David Rosenmann
- Jesselson Integrated Heart Center, Shaare Zedek Medical Center, Jerusalem, Israel
| | - Michael Glikson
- Jesselson Integrated Heart Center, Shaare Zedek Medical Center, Jerusalem, Israel
- Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
| | - Shmuel Gottlieb
- Jesselson Integrated Heart Center, Shaare Zedek Medical Center, Jerusalem, Israel
- Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Evan Avraham Alpert
- Faculty of Medicine, Hebrew University of Jerusalem, Jerusalem, Israel
- Department of Emergency Medicine, Shaare Zedek Medical Center, Jerusalem, Israel
| |
Collapse
|
3
|
Fisher R, Zayan A, Gosling J, Ramos J, Nasr M, Garry D, Papachristidis A, Caetano F, Hopkins P. Serial image interpretation tasks improve accuracy and increase confidence in Level 1 echocardiography reporting: a pilot study. Echo Res Pract 2023; 10:6. [PMID: 37020250 PMCID: PMC10076813 DOI: 10.1186/s44156-023-00018-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 03/22/2023] [Indexed: 04/07/2023] Open
Abstract
BACKGROUND Focused echocardiography is increasingly used in acute and emergency care, with point-of-care ultrasound integrated into several specialist training curricula (e.g. Emergency Medicine, Cardiology, Critical Care). Multiple accreditation pathways support development of this skill but there is scant empirical evidence to inform selection of teaching methods, accreditation requirements or quality assurance of education in focussed echocardiography. It has also been noted that access to in-person teaching can be a barrier to completing accreditation programmes, and that this may affect learners disproportionately depending on the location or nature of their institution. The purpose of the study was to determine whether serial image interpretation tasks as a distinct learning tool improved novice echocardiographers' ability to accurately identify potentially life-threatening pathology from focused scans. We also aimed to describe the relationship between accuracy of reporting and participants' confidence in those reports, and to assess users' satisfaction with a learning pathway that could potentially be delivered remotely. METHODS 27 participants from a variety of healthcare roles completed a program of remote lectures and 2 in-person study days. During the program they undertook 4 'packets' of 10 focused echocardiography reporting tasks (total = 40) based on images from a standardised dataset. Participants were randomized to view the scans in varying orders. Reporting accuracy was compared with consensus reports from a panel of expert echocardiographers, and participants self-reported confidence in their image interpretation and their satisfaction with the learning experience. RESULTS There was a stepwise improvement in reporting accuracy with each set of images reported, from an average reporting score of 66% for the 1st packet to 78% for the 4th packet. Participants felt more confident in identifying common life-threatening pathologies as they reported more echocardiograms. The correlation between report accuracy and confidence in the report was weak and did not increase during the study (rs = 0.394 for the 1st packet, rs = 0.321 for the 4th packet). Attrition during the study related primarily to logistical issues. There were high levels of satisfaction amongst participants, with most reporting that they would use and / or recommend a similar teaching package to colleagues. CONCLUSIONS Healthcare professionals undertaking remote training with recorded lectures, followed by multiple reporting tasks were capable of interpreting focused echocardiograms. Reporting accuracy and confidence in identifying life-threatening pathology increased with the number of scans interpreted. The correlation between accuracy and confidence for any given report was weak (and this relationship should be explored further given the potential safety considerations). All components of this package could be delivered via distance learning to enhance the flexibility of echocardiography education.
Collapse
Affiliation(s)
- Richard Fisher
- Department of Critical Care, King's College Hospital NHS Foundation Trust, London, UK.
| | - Amal Zayan
- Department of Critical Care, King's College Hospital NHS Foundation Trust, London, UK
| | - Jennifer Gosling
- North-West London School of Anaesthesia / Pan-London School Intensive Care Medicine, London, UK
| | - Joao Ramos
- Department of Critical Care, King's College Hospital NHS Foundation Trust, London, UK
| | - Mahmoud Nasr
- Department of Critical Care, King's College Hospital NHS Foundation Trust, London, UK
| | - David Garry
- Department of Critical Care, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
| | | | - Francisca Caetano
- Department of Critical Care, Royal Papworth Hospital NHS Foundation Trust, Cambridge, UK
| | - Philip Hopkins
- Department of Critical Care, King's College Hospital NHS Foundation Trust, London, UK
| |
Collapse
|
4
|
Weimer J, Rolef P, Müller L, Bellhäuser H, Göbel S, Buggenhagen H, Weimer A, Waezsada E, Kirchhoff F, Weinmann-Menke J. FoCUS cardiac ultrasound training for undergraduates based on current national guidelines: a prospective, controlled, single-center study on transferability. BMC MEDICAL EDUCATION 2023; 23:80. [PMID: 36726093 PMCID: PMC9893662 DOI: 10.1186/s12909-023-04062-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/28/2022] [Accepted: 01/27/2023] [Indexed: 06/18/2023]
Abstract
INTRODUCTION In emergency and critical-care medicine, focused cardiac ultrasound (FoCUS) is indispensable for assessing a patient's cardiac status. The aim of this study was to establish and validate a peer-to-peer-supported ultrasound course for learning FoCUS-specific skills during undergraduate studies at a German university. METHODS A 1-day, 12 teaching units training course was developed for students in the clinical section of medical college, with content based on the current national guidelines. A total of 217 students participated in the study (97 in the course group and 120 in the control group). The course and the participants' subjective assessment of improved skills were evaluated using a questionnaire (7-point Likert scale; 7 = complete agreement and 1 = no agreement at all). Objective learning gains were assessed by tests before and after the course. These consisted of a test of figural intelligence (eight items) and a test of technical knowledge (13 items). RESULTS The course participants experienced significant improvement (P < 0.001) from before to after the course, with a large effect size of η2part = 0.26. In addition, the course group had significantly better results (P < 0.001) than the control group in the post-test, with a medium to large effect size of η2part = 0.14. No significant differences (P = 0.27) were detected in the test section on figural intelligence. The evaluations showed that the participants had a high degree of satisfaction with the course approach, teaching materials, and tutors. There was also a positive increase in their subjective assessment of their own skills, including areas such as technical knowledge, ultrasound anatomy, and performance of the examination. CONCLUSION The results of both the objective learning assessment and the subjective evaluations suggest that a FoCUS course originally intended for qualified physicians is equally suitable for students. With the development and provision of modern digital teaching media, even more students will be able to benefit from this approach in the future.
Collapse
Affiliation(s)
- Johannes Weimer
- Rudolf-Frey Lernklinik, Department of Medicine, University of Mainz, Langenbeckstraße 1, 55131, Mainz, Germany.
| | - Peter Rolef
- Rudolf-Frey Lernklinik, Department of Medicine, University of Mainz, Langenbeckstraße 1, 55131, Mainz, Germany
| | - Lukas Müller
- Department of Diagnostic and Interventional Radiology, University of Mainz, Mainz, Germany
| | - Henrik Bellhäuser
- Institute of Psychology, Johannes Gutenberg University of Mainz, Mainz, Germany
| | - Sebastian Göbel
- Department of Medicine II, Cardiology Center, Department of Medicine, University of Mainz, Mainz, Germany
| | - Holger Buggenhagen
- Rudolf-Frey Lernklinik, Department of Medicine, University of Mainz, Langenbeckstraße 1, 55131, Mainz, Germany
| | - Andreas Weimer
- Center for Orthopedics, Emergency Surgery, and Paraplegics, Department of Medicine, University of Heidelberg, Heidelberg, Germany
| | - Elias Waezsada
- Department of Cardiology, Kerckhoff Hospital, Bad Nauheim, Germany
| | - Friederike Kirchhoff
- Rudolf-Frey Lernklinik, Department of Medicine, University of Mainz, Langenbeckstraße 1, 55131, Mainz, Germany
| | - Julia Weinmann-Menke
- Department of Medicine I, Nephrology Center, Department of Medicine, University of Mainz, Mainz, Germany
| |
Collapse
|