1
|
Yaïci R, Cieplucha M, Bock R, Moayed F, Bechrakis NE, Berens P, Feltgen N, Friedburg D, Gräf M, Guthoff R, Hoffmann EM, Hoerauf H, Hintschich C, Kohnen T, Messmer EM, Nentwich MM, Pleyer U, Schaudig U, Seitz B, Geerling G, Roth M. [ChatGPT and the German board examination for ophthalmology: an evaluation]. DIE OPHTHALMOLOGIE 2024; 121:554-564. [PMID: 38801461 DOI: 10.1007/s00347-024-02046-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/23/2023] [Revised: 04/18/2024] [Accepted: 04/18/2024] [Indexed: 05/29/2024]
Abstract
PURPOSE In recent years artificial intelligence (AI), as a new segment of computer science, has also become increasingly more important in medicine. The aim of this project was to investigate whether the current version of ChatGPT (ChatGPT 4.0) is able to answer open questions that could be asked in the context of a German board examination in ophthalmology. METHODS After excluding image-based questions, 10 questions from 15 different chapters/topics were selected from the textbook 1000 questions in ophthalmology (1000 Fragen Augenheilkunde 2nd edition, 2014). ChatGPT was instructed by means of a so-called prompt to assume the role of a board certified ophthalmologist and to concentrate on the essentials when answering. A human expert with considerable expertise in the respective topic, evaluated the answers regarding their correctness, relevance and internal coherence. Additionally, the overall performance was rated by school grades and assessed whether the answers would have been sufficient to pass the ophthalmology board examination. RESULTS The ChatGPT would have passed the board examination in 12 out of 15 topics. The overall performance, however, was limited with only 53.3% completely correct answers. While the correctness of the results in the different topics was highly variable (uveitis and lens/cataract 100%; optics and refraction 20%), the answers always had a high thematic fit (70%) and internal coherence (71%). CONCLUSION The fact that ChatGPT 4.0 would have passed the specialist examination in 12 out of 15 topics is remarkable considering the fact that this AI was not specifically trained for medical questions; however, there is a considerable performance variability between the topics, with some serious shortcomings that currently rule out its safe use in clinical practice.
Collapse
Affiliation(s)
- Rémi Yaïci
- Klinik für Augenheilkunde, Medizinische Fakultät, Universitätsklinikum Düsseldorf, Heinrich-Heine Universität Düsseldorf, Moorenstr. 5, 40225, Düsseldorf, Deutschland.
| | - M Cieplucha
- Klinik für Augenheilkunde, Medizinische Fakultät, Universitätsklinikum Düsseldorf, Heinrich-Heine Universität Düsseldorf, Moorenstr. 5, 40225, Düsseldorf, Deutschland
| | - R Bock
- Klinik für Augenheilkunde, Medizinische Fakultät, Universitätsklinikum Düsseldorf, Heinrich-Heine Universität Düsseldorf, Moorenstr. 5, 40225, Düsseldorf, Deutschland
| | - F Moayed
- Klinik für Augenheilkunde, Medizinische Fakultät, Universitätsklinikum Düsseldorf, Heinrich-Heine Universität Düsseldorf, Moorenstr. 5, 40225, Düsseldorf, Deutschland
| | - N E Bechrakis
- Augenklinik, Universitätsklinikum Essen, Essen, Deutschland
| | - P Berens
- Hertie Institute for AI in Brain Health (Hertie AI), Tübingen, Deutschland
| | - N Feltgen
- Augenklinik, Universitätsspital Basel, Basel, Schweiz
| | | | - M Gräf
- Universitätsklinikum Gießen und Marburg, Marburg, Gießen, Deutschland
| | - R Guthoff
- Klinik für Augenheilkunde, Medizinische Fakultät, Universitätsklinikum Düsseldorf, Heinrich-Heine Universität Düsseldorf, Moorenstr. 5, 40225, Düsseldorf, Deutschland
| | - E M Hoffmann
- Augenklinik, Universitätsklinikum Mainz, Mainz, Deutschland
| | - H Hoerauf
- Augenklinik, Universitätsklinikum Göttingen, Göttingen, Deutschland
| | - C Hintschich
- Augenklinik und Poliklinik, LMU Klinikum, Ludwigs-Maximilians-Universität München, München, Deutschland
| | - T Kohnen
- Augenklinik, Universitätsklinikum Frankfurt, Frankfurt, Deutschland
| | - E M Messmer
- Augenklinik und Poliklinik, LMU Klinikum, Ludwigs-Maximilians-Universität München, München, Deutschland
| | - M M Nentwich
- Augenklinik, Universitätsklinikum Würzburg, Würzburg, Deutschland
| | - U Pleyer
- Charité - Universitätsmedizin Berlin, Berlin, Deutschland
| | - U Schaudig
- Asklepios Klinik Barmbek, Hamburg, Deutschland
| | - B Seitz
- Klinik für Augenheilkunde, Universitätsklinikum des Saarlandes, Homburg, Deutschland
| | - G Geerling
- Klinik für Augenheilkunde, Medizinische Fakultät, Universitätsklinikum Düsseldorf, Heinrich-Heine Universität Düsseldorf, Moorenstr. 5, 40225, Düsseldorf, Deutschland
| | - M Roth
- Klinik für Augenheilkunde, Medizinische Fakultät, Universitätsklinikum Düsseldorf, Heinrich-Heine Universität Düsseldorf, Moorenstr. 5, 40225, Düsseldorf, Deutschland
| |
Collapse
|
2
|
Pedersen MRV, Kusk MW, Lysdahlgaard S, Mork-Knudsen H, Malamateniou C, Jensen J. A Nordic survey on artificial intelligence in the radiography profession - Is the profession ready for a culture change? Radiography (Lond) 2024; 30:1106-1115. [PMID: 38781794 DOI: 10.1016/j.radi.2024.04.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2024] [Revised: 04/12/2024] [Accepted: 04/22/2024] [Indexed: 05/25/2024]
Abstract
INTRODUCTION The impact of artificial intelligence (AI) on the radiography profession remains uncertain. Although AI has been increasingly used in clinical radiography, the perspectives of the radiography professionals in Nordic countries have yet to be examined. The primary aim was to examine views of Nordic radiographers 'on AI, with focus on perspectives, engagement, and knowledge of AI. METHODS Radiographers from Denmark, Norway, Sweden, Iceland, Greenland, and the Faroe Island were invited through social media platforms to participate in an online survey from March to June 2023. The survey encompassed 29-items and included 4 sections a) demographics, b) barriers and enablers on AI, c) perspectives and experiences of AI and d) knowledge of AI in radiography. Edgars Schein's model of organizational culture was employed to analyse Nordic radiographers' perspectives on AI. RESULTS Overall, a total of 421 respondents participated in the survey. A majority were positive/somewhat positive towards AI in radiography e.g., 77.9 % (n = 342) thought that AI would have a positive effect on the profession, and 26% thought that AI would reduce the administrative workload. Most radiographers agreed or strongly agreed that clinicians may have access to AI generated reports (76.8 %, n = 297). Nevertheless, a total of 86 (20.1%) agree or somewhat agreed that AI a potential risk for radiography. CONCLUSION Nordic radiographers are generally positive towards AI, yet uncertainties regarding its implementation persist. The findings underscore the importance of understanding these challenges for the responsible integration of AI systems. Carefully weighing the expected influence of AI against key incentives will support a seamless integration of AI for the benefit not just of the patients, but also of the radiography profession. IMPLICATIONS FOR PRACTICE Understanding incentives factors and barriers can help address uncertainties during implementation of AI in clinical practice.
Collapse
Affiliation(s)
- M R V Pedersen
- Department of Radiology, Vejle Hospital - Part of Lillebaelt Hospital, Vejle, Denmark; Department of Regional Health Research, University of Southern Denmark, Odense, Denmark; Discipline of Medical Imaging & Radiation Therapy, School of Medicine, University College Cork, Ireland.
| | - M W Kusk
- Department of Regional Health Research, University of Southern Denmark, Odense, Denmark; Department of Radiology and Nuclear Medicine, University Hospital of Southern Denmark, Esbjerg, Denmark; IRIS - Imaging Research Initiative Southwest, University Hospital of Southern Denmark, Esbjerg, Denmark; Radiography and Diagnostic Imaging, School of Medicine, University College Dublin, Dublin, Ireland
| | - S Lysdahlgaard
- Department of Regional Health Research, University of Southern Denmark, Odense, Denmark; Department of Radiology and Nuclear Medicine, University Hospital of Southern Denmark, Esbjerg, Denmark; IRIS - Imaging Research Initiative Southwest, University Hospital of Southern Denmark, Esbjerg, Denmark
| | - H Mork-Knudsen
- Department of Radiology, Haukeland University Hospital, Norway
| | - C Malamateniou
- Department of Radiography, Division of Midwifery and Radiography, School of Health and Psychological Sciences, University of London, UK; European Federation of Radiographer Societies, Churchilllaan 11, 3527 GV, Utrecht, the Netherlands
| | - J Jensen
- Research and Innovation Unit of Radiology, University Hospital of Southern Denmark, Odense Denmark; Department of Radiology, Odense University Hospital, Odense, Denmark
| |
Collapse
|
3
|
Jarab AS, Al-Qerem W, Al-Hajjeh DM, Abu Heshmeh S, Mukattash TL, Naser AY, Alwafi H, Al Hamarneh YN. Artificial intelligence utilization in the healthcare setting: perceptions of the public in the UAE. INTERNATIONAL JOURNAL OF ENVIRONMENTAL HEALTH RESEARCH 2024:1-9. [PMID: 38832887 DOI: 10.1080/09603123.2024.2363472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Accepted: 05/29/2024] [Indexed: 06/06/2024]
Abstract
Understanding the use of AI in healthcare is essential for the successful implementation of AI-driven healthcare solutions. The aim of this study was to evaluate public perception of AI utilization in healthcare settings. A validated questionnaire assessed general perceptions towards AI utilization, the use of AI by physician , and the use of AI by pharmacists . The study included 770 participants. The median perception score indicated an unfavorable attitude. Participants who had lower education level and those with no employment had a significantly lower perception scores than their counterpart. Participants who reported low income and those who visited the pharmacy five to ten times on average had a higher perception than their counterparts did. The reported negative perception necessitates the implementation of education campaigns to improve AI literacy and dispel any misconceptions and concerns, particularly among individuals with low education, high income, unemployment, and frequent pharmacy visits.
Collapse
Affiliation(s)
- Anan S Jarab
- College of Pharmacy, Al Ain University, Abu Dhabi, United Arab Emirates
- Department of Clinical Pharmacy, Faculty of Pharmacy, Jordan University of Science and Technology, Irbid, Jordan
| | - Walid Al-Qerem
- Department of Pharmacy, Faculty of Pharmacy, Al-Zaytoonah University of Jordan, Amman, Jordan
| | - Dua'a M Al-Hajjeh
- Department of Clinical Pharmacy, Faculty of Pharmacy, Jordan University of Science and Technology, Irbid, Jordan
| | - Shrouq Abu Heshmeh
- Department of Clinical Pharmacy, Faculty of Pharmacy, Jordan University of Science and Technology, Irbid, Jordan
| | - Tareq L Mukattash
- Department of Clinical Pharmacy, Faculty of Pharmacy, Jordan University of Science and Technology, Irbid, Jordan
| | - Abdallah Y Naser
- Department of Applied Pharmaceutical Sciences and Clinical Pharmacy, Faculty of Pharmacy, Isra University, Amman, Jordan
| | - Hassan Alwafi
- Department of Pharmacology and Toxicology, Faculty of Medicine, Umm Al-Qura University, Makkah, Saudi Arabia
| | - Yazid N Al Hamarneh
- Department of Pharmacology, Faculty of Medicine and Dentistry, University of Alberta, Edmonton, Canada
| |
Collapse
|
4
|
Gala D, Behl H, Shah M, Makaryus AN. The Role of Artificial Intelligence in Improving Patient Outcomes and Future of Healthcare Delivery in Cardiology: A Narrative Review of the Literature. Healthcare (Basel) 2024; 12:481. [PMID: 38391856 PMCID: PMC10887513 DOI: 10.3390/healthcare12040481] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2023] [Revised: 02/13/2024] [Accepted: 02/14/2024] [Indexed: 02/24/2024] Open
Abstract
Cardiovascular diseases exert a significant burden on the healthcare system worldwide. This narrative literature review discusses the role of artificial intelligence (AI) in the field of cardiology. AI has the potential to assist healthcare professionals in several ways, such as diagnosing pathologies, guiding treatments, and monitoring patients, which can lead to improved patient outcomes and a more efficient healthcare system. Moreover, clinical decision support systems in cardiology have improved significantly over the past decade. The addition of AI to these clinical decision support systems can improve patient outcomes by processing large amounts of data, identifying subtle associations, and providing a timely, evidence-based recommendation to healthcare professionals. Lastly, the application of AI allows for personalized care by utilizing predictive models and generating patient-specific treatment plans. However, there are several challenges associated with the use of AI in healthcare. The application of AI in healthcare comes with significant cost and ethical considerations. Despite these challenges, AI will be an integral part of healthcare delivery in the near future, leading to personalized patient care, improved physician efficiency, and anticipated better outcomes.
Collapse
Affiliation(s)
- Dhir Gala
- Department of Clinical Science, American University of the Caribbean School of Medicine, Cupecoy, Sint Maarten, The Netherlands
| | - Haditya Behl
- Department of Clinical Science, American University of the Caribbean School of Medicine, Cupecoy, Sint Maarten, The Netherlands
| | - Mili Shah
- Department of Clinical Science, American University of the Caribbean School of Medicine, Cupecoy, Sint Maarten, The Netherlands
| | - Amgad N Makaryus
- Donald and Barbara Zucker School of Medicine at Hofstra/Northwell, Hofstra University, 500 Hofstra Blvd., Hempstead, NY 11549, USA
- Department of Cardiology, Nassau University Medical Center, Hempstead, NY 11554, USA
| |
Collapse
|
5
|
Bohler F, Aggarwal N, Peters G, Taranikanti V. Future Implications of Artificial Intelligence in Medical Education. Cureus 2024; 16:e51859. [PMID: 38327947 PMCID: PMC10848885 DOI: 10.7759/cureus.51859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/06/2024] [Indexed: 02/09/2024] Open
Abstract
Artificial intelligence has experienced explosive growth in the past year that will have implications in all aspects of our lives, including medicine. In order to train a physician workforce that understands these new advancements, medical educators must take steps now to ensure that physicians are adequately trained in medical school, residency, and fellowship programs to become proficient in the usage of artificial intelligence in medical practice. This manuscript discusses the various considerations that leadership within medical training programs should be mindful of when deciding how to best integrate artificial intelligence into their curricula.
Collapse
Affiliation(s)
- Forrest Bohler
- Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Rochester, USA
| | - Nikhil Aggarwal
- Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Rochester, USA
| | - Garrett Peters
- Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Rochester, USA
| | - Varna Taranikanti
- Foundational Medical Studies, Oakland University William Beaumont School of Medicine, Rochester, USA
| |
Collapse
|