1
|
Hui ML, Sacoransky E, Chung A, Kwan BYM. Exploring the integration of artificial intelligence in radiology education: A scoping review. Curr Probl Diagn Radiol 2024:S0363-0188(24)00177-4. [PMID: 39379203 DOI: 10.1067/j.cpradiol.2024.10.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2024] [Accepted: 10/02/2024] [Indexed: 10/10/2024]
Abstract
BACKGROUND The integration of Artificial Intelligence (AI) into radiology education presents a transformative opportunity to enhance learning and practice within the field. This scoping review aims to systematically explore and map the current landscape of AI integration in radiology education. METHODS The review process involved systematically searching four databases, including MEDLINE (Ovid), Embase (Ovid), PsychINFO (Ovid), and Scopus. Inclusion criteria focused on research that addresses the use of AI technologies in radiology education, including but not limited to, AI-assisted learning platforms, simulation tools, and automated assessment systems. This scoping review was registered on Open Science Framework using the Preferred Reporting Items for Systematic reviews and Meta-Analysis (PRISMA) extension to scoping review. RESULTS Of the 1081 search results, 9 studies met the inclusion criteria. Key findings indicate a diverse range of AI applications in radiology education, from personalized curriculum generation and diagnostic support tools to automated evaluation systems. The review highlights both the potential benefits, such as enhanced diagnostic accuracy, and the challenges, including technical limitations. CONCLUSION The integration of AI into radiology education, which has significant potential to enhance outcomes and professional practice, requires overcoming existing challenges and ensuring that AI complements rather than replaces traditional methods, with future research needed on longitudinal studies to evaluate its long-term impact.
Collapse
Affiliation(s)
- Muying Lucy Hui
- Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Ethan Sacoransky
- School of Medicine, Faculty of Health Sciences, Queen's University, Kingston, ON, Canada
| | - Andrew Chung
- School of Medicine, Faculty of Health Sciences, Queen's University, Kingston, ON, Canada
| | - Benjamin YM Kwan
- School of Medicine, Faculty of Health Sciences, Queen's University, Kingston, ON, Canada
| |
Collapse
|
2
|
Mistry NP, Saeed H, Rafique S, Le T, Obaid H, Adams SJ. Large Language Models as Tools to Generate Radiology Board-Style Multiple-Choice Questions. Acad Radiol 2024; 31:3872-3878. [PMID: 39013736 DOI: 10.1016/j.acra.2024.06.046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2024] [Revised: 06/24/2024] [Accepted: 06/27/2024] [Indexed: 07/18/2024]
Abstract
RATIONALE AND OBJECTIVES To determine the potential of large language models (LLMs) to be used as tools by radiology educators to create radiology board-style multiple choice questions (MCQs), answers, and rationales. METHODS Two LLMs (Llama 2 and GPT-4) were used to develop 104 MCQs based on the American Board of Radiology exam blueprint. Two board-certified radiologists assessed each MCQ using a 10-point Likert scale across five criteria-clarity, relevance, suitability for a board exam based on level of difficulty, quality of distractors, and adequacy of rationale. For comparison, MCQs from prior American College of Radiology (ACR) Diagnostic Radiology In-Training (DXIT) exams were also assessed using these criteria, with radiologists blinded to the question source. RESULTS Mean scores (±standard deviation) for clarity, relevance, suitability, quality of distractors, and adequacy of rationale were 8.7 (±1.4), 9.2 (±1.3), 9.0 (±1.2), 8.4 (±1.9), and 7.2 (±2.2), respectively, for Llama 2; 9.9 (±0.4), 9.9 (±0.5), 9.9 (±0.4), 9.8 (±0.5), and 9.9 (±0.3), respectively, for GPT-4; and 9.9 (±0.3), 9.9 (±0.2), 9.9 (±0.2), 9.9 (±0.4), and 9.8 (±0.6), respectively, for ACR DXIT items (p < 0.001 for Llama 2 vs. ACR DXIT across all criteria; no statistically significant difference for GPT-4 vs. ACR DXIT). The accuracy of model-generated answers was 69% for Llama 2 and 100% for GPT-4. CONCLUSION A state-of-the art LLM such as GPT-4 may be used to develop radiology board-style MCQs and rationales to enhance exam preparation materials and expand exam banks, and may allow radiology educators to further use MCQs as teaching and learning tools.
Collapse
Affiliation(s)
- Neel P Mistry
- College of Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada (N.P.M., H.S., H.O., S.J.A.); Department of Medical Imaging, Royal University Hospital, Saskatoon, Saskatchewan, Canada (N.P.M., H.O., S.J.A.)
| | - Huzaifa Saeed
- College of Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada (N.P.M., H.S., H.O., S.J.A.)
| | - Sidra Rafique
- Department of Computer Science, University of Saskatchewan, Saskatoon, Saskatchewan, Canada (S.R.)
| | - Thuy Le
- Department of Community Health and Epidemiology, University of Saskatchewan, Saskatoon, Saskatchewan, Canada (T.L.)
| | - Haron Obaid
- College of Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada (N.P.M., H.S., H.O., S.J.A.); Department of Medical Imaging, Royal University Hospital, Saskatoon, Saskatchewan, Canada (N.P.M., H.O., S.J.A.)
| | - Scott J Adams
- College of Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada (N.P.M., H.S., H.O., S.J.A.); Department of Medical Imaging, Royal University Hospital, Saskatoon, Saskatchewan, Canada (N.P.M., H.O., S.J.A.).
| |
Collapse
|
3
|
Johnson CD, Green BN. Education Descriptive Reports: How to Publish Pragmatic Studies in Education. JOURNAL OF CHIROPRACTIC HUMANITIES 2022; 29:15-21. [PMID: 35935806 PMCID: PMC9344319 DOI: 10.1016/j.echu.2022.06.001] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/30/2022] [Revised: 06/23/2022] [Accepted: 06/24/2022] [Indexed: 06/13/2023]
Abstract
OBJECTIVE The purpose of this article is to describe the contents of an education descriptive report and to provide a useful publication format for educators in the health professions. DISCUSSION The education descriptive report is a pragmatic, empirical study that can contribute to the literature. Education descriptive reports describe an event or situation in an education setting, the resulting outcomes, and what new information can be learned. These reports may use quantitative, qualitative, or mixed methods and may be from organizational, academic, instructional, programmatic, or other educational perspectives. CONCLUSION The education descriptive report gives educators in the health professions a mechanism to introduce their scholarly efforts and observations in education environments in a manner that is consistent with the academic literature. This article describes the structure of an education descriptive report and includes a helpful template for academic authors to develop their own report so they may publish observational, reflective, and hypothesis-generating articles.
Collapse
|
4
|
Tran T, Ternov NK, Weber J, Barata C, Berry EG, Doan HQ, Marghoob AA, Seiverling EV, Sinclair S, Stein JA, Stoos ER, Tolsgaard MG, Wolfensperger M, Braun RP, Nelson KC. Instructional Strategies to Enhance Dermoscopic Image Interpretation Education: a Review of the Literature. Dermatol Pract Concept 2022; 12:e2022189. [PMID: 36534542 PMCID: PMC9681169 DOI: 10.5826/dpc.1204a189] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/13/2022] [Indexed: 11/06/2022] Open
Abstract
Introduction In image interpretation education, many educators have shifted away from traditional methods that involve passive instruction and fragmented learning to interactive ones that promote active engagement and integrated knowledge. By training pattern recognition skills in an effective manner, these interactive approaches provide a promising direction for dermoscopy education. Objectives A narrative review of the literature was performed to probe emerging directions in medical image interpretation education that may support dermoscopy education. This article represents the second of a two-part review series. Methods To promote innovation in dermoscopy education, the International Skin Imaging Collaborative (ISIC) assembled an Education Working Group that comprises international dermoscopy experts and educational scientists. Based on a preliminary literature review and their experiences as educators, the group developed and refined a list of innovative approaches through multiple rounds of discussion and feedback. For each approach, literature searches were performed for relevant articles. Results Through a consensus-based approach, the group identified a number of theory-based approaches, as discussed in the first part of this series. The group also acknowledged the role of motivation, metacognition, and early failures in optimizing the learning process. Other promising teaching tools included gamification, social media, and perceptual and adaptive learning modules (PALMs). Conclusions Over the years, many dermoscopy educators may have intuitively adopted these instructional strategies in response to learner feedback, personal observations, and changes in the learning environment. For dermoscopy training, PALMs may be especially valuable in that they provide immediate feedback and adapt the training schedule to the individual's performance.
Collapse
Affiliation(s)
- Tiffaney Tran
- Department of Dermatology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Niels K Ternov
- Department of Plastic Surgery, Herlev Hospital, Herlev, Denmark
| | - Jochen Weber
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Catarina Barata
- Institute for Systems and Robotics; Instituto Superior Técnico, University of Lisbon, Lisbon, Portugal
| | - Elizabeth G Berry
- Department of Dermatology, Oregon Health & Science University, Portland, OR, USA
| | - Hung Q Doan
- Department of Dermatology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Ashfaq A Marghoob
- Dermatology Service, Memorial Sloan Kettering Cancer Center, New York, NY, USA
| | - Elizabeth V Seiverling
- Division of Dermatology, Maine Medical Center, Portland, ME, USA; Department of Dermatology, Tufts University School of Medicine, Boston, MA, USA
| | | | - Jennifer A Stein
- The Ronald O. Perelman Department of Dermatology, New York University School of Medicine, New York, NY, USA
| | - Elizabeth R Stoos
- Department of Dermatology, Oregon Health & Science University, Portland, OR, USA
| | - Martin G Tolsgaard
- Copenhagen Academy for Medical Education and Simulation; Department of Obstetrics, Copenhagen University Hospital Rigshospitalet, Copenhagen, Denmark
| | - Maya Wolfensperger
- Department of Dermatology, University Hospital of Zürich, University of Zürich, Zürich, Switzerland
| | - Ralph P Braun
- Department of Dermatology, University Hospital of Zürich, University of Zürich, Zürich, Switzerland
| | - Kelly C Nelson
- Department of Dermatology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| |
Collapse
|
5
|
Kioh SH, Pooke TG, Chong SV. Use of Radiography for New Patients Presenting to a Chiropractic Teaching Clinic: A Cross-sectional Analysis. JOURNAL OF CHIROPRACTIC HUMANITIES 2021; 28:9-14. [PMID: 35002573 PMCID: PMC8720650 DOI: 10.1016/j.echu.2021.09.002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Revised: 09/13/2021] [Accepted: 09/14/2021] [Indexed: 06/13/2023]
Abstract
OBJECTIVE The aim of this study was to identify the number and type of indications for radiographs ordered in a chiropractic teaching clinic in Malaysia. METHODS A cross-sectional retrospective analysis was conducted using the medical health records of new patients who presented to the International Medical University Bukit Jalil teaching clinic for chiropractic care between August 2018 and July 2019. Data about sociodemographic characteristics, region of presenting complaint, radiography ordering rates, and referral indications were collected. We compared indications reported in the patient records with those listed in the International Medical University Chiropractic Clinical Manual. We conducted χ2 and logistic regression analysis to identify the association between radiography indications and the number of radiographs ordered. RESULTS Data were collected for 1451 patients (741 [51.1%] women and 700 [48.9%] men). The most common body region for the presenting complaint was the lumbar/pelvic region (39.0%), and the overall radiograph use rate was 2.7%, with the highest number of radiographs for the lumbar spine. CONCLUSION For the patient files sampled in this study, the overall radiograph order rate in the International Medical University Bukit Jalil Chiropractic teaching clinic was 2.7%.
Collapse
Affiliation(s)
- Sheng Hui Kioh
- Corresponding author: Sheng Hui Kioh, Department of Chiropractic, International Medical University, 126, Jln Jalil Perkasa 19, Bukit Jalil, 57000 Kuala Lumpur, Federal Territory of Kuala Lumpur, Kuala Lumpur, Malaysia
| | | | | |
Collapse
|
6
|
Limchareon S, Kongprompsuk S. A Single Static Breast Model Education of Ultrasound Skill in Final Year Medical Students of Burapha University. J Med Ultrasound 2018; 26:143-146. [PMID: 30283200 PMCID: PMC6159323 DOI: 10.4103/jmu.jmu_11_18] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2017] [Accepted: 12/13/2017] [Indexed: 11/04/2022] Open
Abstract
Background: Ultrasound (US) is widely used among physicians. There has been no standardized curriculum in US for undergraduate medical students. This study aimed to assess the US image acquisition skill of final year medical students after adding 2 weeks dedicated radiology rotation. Methods: At our institution, there are two hospital affiliations. Two-week radiology rotation was added for the final-year students of one affiliation. These students had a chance to do the US in real-life clinical settings proctored by radiologists. At the end of the academic year, US image acquisition skill was assessed by objective structured clinical examination (OSCE) in students from both affiliations. Results: From 48-final-year medical students, 28 students finished the 2 week radiology rotation. OSCE mean score of the students who received radiology rotation was significantly higher than other groups with a score of 65.5 compared to 53.3, respectively (P = 0.006). The student background characteristics had no relationship with the OSCE score (P = 0.565). Conclusion: Results showed that exposure through a dedicated radiology rotation in only 2 weeks is helpful to improve the US skill of the medical students regardless of their background performances. Exposure to live patients is essential for students' experiences. OSCE can be used as a standardized assessment tool.
Collapse
Affiliation(s)
- Sornsupha Limchareon
- Division of Radiology and Nuclear Medicine, Faculty of Medicine, Burapha University, Chonburi, Thailand
| | - Sutasinee Kongprompsuk
- Division of Radiology and Nuclear Medicine, Faculty of Medicine, Burapha University, Chonburi, Thailand
| |
Collapse
|
7
|
Sotardi S, Scheinfeld MH, Burns J, Koenigsberg M, Mantilla JG, Goldberg-Stein S. Radiology-Pathology Conference: Reviving the Art of Oral Case Presentation in Residency. Acad Radiol 2017; 24:757-761. [PMID: 28189506 DOI: 10.1016/j.acra.2016.12.019] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2016] [Revised: 11/24/2016] [Accepted: 12/02/2016] [Indexed: 11/17/2022]
Abstract
RATIONALE AND OBJECTIVES To improve resident oral case communication and preparatory skills by providing residents an opportunity to prepare for and conduct a new interdisciplinary Radiology-Pathology (Rad-Path) conference series. MATERIALS AND METHODS To assess whether conference goals were being achieved, we surveyed trainees and attendings in the radiology and pathology departments. Percentages were examined for each variable. Mann-Whitney U test for ordinal variable significance was applied to determine statistical significance between radiology trainee and attending survey responses. RESULTS Most surveyed radiology trainees (57.1%) strongly agreed or agreed with: "I wish I felt more comfortable with oral presentations." Sixty-five percent of radiology attendings (34 of 52) either agreed or strongly agreed that the residents should be more comfortable with oral case presentations. Of resident Rad-Path conference presenters, 69% (9 of 13) either agreed or strongly agreed that the conference improved their confidence and/or ability to present case information orally. Of responders who attended at least one Rad-Path conference in person, 83% of residents (19/23) and 61% (17/28) of attendings agreed or strongly agreed that the conference improved their ability to formulate a differential diagnosis. Using the Mann-Whitney U test, no significant difference was found between radiology trainees and attendings' responses. CONCLUSIONS Our Rad-Path correlation conference was specifically designed and structured to provide residents with focused experience in formal oral case preparation and presentation. We consider our conference a success, with 69% of resident presenters reporting that the Rad-Path conference improved their confidence and/or ability to present case information orally.
Collapse
Affiliation(s)
- Susan Sotardi
- Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, 111 East 210th Street, Bronx, NY 10467.
| | - Meir H Scheinfeld
- Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, 111 East 210th Street, Bronx, NY 10467
| | - Judah Burns
- Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, 111 East 210th Street, Bronx, NY 10467
| | - Mordecai Koenigsberg
- Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, 111 East 210th Street, Bronx, NY 10467
| | - Jose G Mantilla
- Department of Pathology, Montefiore Medical Center, Albert Einstein College of Medicine, Bronx, New York
| | - Shlomit Goldberg-Stein
- Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, 111 East 210th Street, Bronx, NY 10467
| |
Collapse
|