1
|
Dihan Q, Chauhan MZ, Eleiwa TK, Hassan AK, Sallam AB, Khouri AS, Chang TC, Elhusseiny AM. Using Large Language Models to Generate Educational Materials on Childhood Glaucoma. Am J Ophthalmol 2024; 265:28-38. [PMID: 38614196 DOI: 10.1016/j.ajo.2024.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Revised: 03/29/2024] [Accepted: 04/03/2024] [Indexed: 04/15/2024]
Abstract
PURPOSE To evaluate the quality, readability, and accuracy of large language model (LLM)-generated patient education materials (PEMs) on childhood glaucoma, and their ability to improve existing the readability of online information. DESIGN Cross-sectional comparative study. METHODS We evaluated responses of ChatGPT-3.5, ChatGPT-4, and Bard to 3 separate prompts requesting that they write PEMs on "childhood glaucoma." Prompt A required PEMs be "easily understandable by the average American." Prompt B required that PEMs be written "at a 6th-grade level using Simple Measure of Gobbledygook (SMOG) readability formula." We then compared responses' quality (DISCERN questionnaire, Patient Education Materials Assessment Tool [PEMAT]), readability (SMOG, Flesch-Kincaid Grade Level [FKGL]), and accuracy (Likert Misinformation scale). To assess the improvement of readability for existing online information, Prompt C requested that LLM rewrite 20 resources from a Google search of keyword "childhood glaucoma" to the American Medical Association-recommended "6th-grade level." Rewrites were compared on key metrics such as readability, complex words (≥3 syllables), and sentence count. RESULTS All 3 LLMs generated PEMs that were of high quality, understandability, and accuracy (DISCERN ≥4, ≥70% PEMAT understandability, Misinformation score = 1). Prompt B responses were more readable than Prompt A responses for all 3 LLM (P ≤ .001). ChatGPT-4 generated the most readable PEMs compared to ChatGPT-3.5 and Bard (P ≤ .001). Although Prompt C responses showed consistent reduction of mean SMOG and FKGL scores, only ChatGPT-4 achieved the specified 6th-grade reading level (4.8 ± 0.8 and 3.7 ± 1.9, respectively). CONCLUSIONS LLMs can serve as strong supplemental tools in generating high-quality, accurate, and novel PEMs, and improving the readability of existing PEMs on childhood glaucoma.
Collapse
Affiliation(s)
- Qais Dihan
- Chicago Medical School (Q.D.), Rosalind Franklin University of Medicine and Science, North Chicago, Illinois, USA; Department of Ophthalmology (Q.D., M.Z.C., A.B.S., A.M.E.), Harvey and Bernice Jones Eye Institute, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA
| | - Muhammad Z Chauhan
- Department of Ophthalmology (Q.D., M.Z.C., A.B.S., A.M.E.), Harvey and Bernice Jones Eye Institute, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA
| | - Taher K Eleiwa
- Department of Ophthalmology (T.K.E.), Benha Faculty of Medicine, Benha University, Benha, Egypt
| | - Amr K Hassan
- Department of Ophthalmology (A.K.H.), Faculty of Medicine, South Valley University, Qena, Egypt
| | - Ahmed B Sallam
- Department of Ophthalmology (Q.D., M.Z.C., A.B.S., A.M.E.), Harvey and Bernice Jones Eye Institute, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA; Department of Ophthalmology (A.B.S.), Faculty of Medicine, Ain Shams University, Cairo, Egypt
| | - Albert S Khouri
- Institute of Ophthalmology & Visual Science (A.S.K.), Rutgers New Jersey Medical School, Newark, New Jersey, USA
| | - Ta C Chang
- Department of Ophthalmology (T.C.C.), Bascom Palmer Eye Institute, University of Miami Miller School of Medicine, Miami, Florida, USA
| | - Abdelrahman M Elhusseiny
- Department of Ophthalmology (Q.D., M.Z.C., A.B.S., A.M.E.), Harvey and Bernice Jones Eye Institute, University of Arkansas for Medical Sciences, Little Rock, Arkansas, USA; Department of Ophthalmology (A.M.E.), Boston Children's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
| |
Collapse
|
2
|
Muse ED, Topol EJ. Transforming the cardiometabolic disease landscape: Multimodal AI-powered approaches in prevention and management. Cell Metab 2024; 36:670-683. [PMID: 38428435 PMCID: PMC10990799 DOI: 10.1016/j.cmet.2024.02.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 01/25/2024] [Accepted: 02/06/2024] [Indexed: 03/03/2024]
Abstract
The rise of artificial intelligence (AI) has revolutionized various scientific fields, particularly in medicine, where it has enabled the modeling of complex relationships from massive datasets. Initially, AI algorithms focused on improved interpretation of diagnostic studies such as chest X-rays and electrocardiograms in addition to predicting patient outcomes and future disease onset. However, AI has evolved with the introduction of transformer models, allowing analysis of the diverse, multimodal data sources existing in medicine today. Multimodal AI holds great promise in more accurate disease risk assessment and stratification as well as optimizing the key driving factors in cardiometabolic disease: blood pressure, sleep, stress, glucose control, weight, nutrition, and physical activity. In this article we outline the current state of medical AI in cardiometabolic disease, highlighting the potential of multimodal AI to augment personalized prevention and treatment strategies in cardiometabolic disease.
Collapse
Affiliation(s)
- Evan D Muse
- Scripps Research Translational Institute, Scripps Research, La Jolla, CA 92037, USA; Division of Cardiovascular Diseases, Scripps Clinic, La Jolla, CA 92037, USA
| | - Eric J Topol
- Scripps Research Translational Institute, Scripps Research, La Jolla, CA 92037, USA; Division of Cardiovascular Diseases, Scripps Clinic, La Jolla, CA 92037, USA.
| |
Collapse
|
3
|
Bourazana A, Xanthopoulos A, Briasoulis A, Magouliotis D, Spiliopoulos K, Athanasiou T, Vassilopoulos G, Skoularigis J, Triposkiadis F. Artificial Intelligence in Heart Failure: Friend or Foe? Life (Basel) 2024; 14:145. [PMID: 38276274 PMCID: PMC10817517 DOI: 10.3390/life14010145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 01/08/2024] [Accepted: 01/17/2024] [Indexed: 01/27/2024] Open
Abstract
In recent times, there have been notable changes in cardiovascular medicine, propelled by the swift advancements in artificial intelligence (AI). The present work provides an overview of the current applications and challenges of AI in the field of heart failure. It emphasizes the "garbage in, garbage out" issue, where AI systems can produce inaccurate results with skewed data. The discussion covers issues in heart failure diagnostic algorithms, particularly discrepancies between existing models. Concerns about the reliance on the left ventricular ejection fraction (LVEF) for classification and treatment are highlighted, showcasing differences in current scientific perceptions. This review also delves into challenges in implementing AI, including variable considerations and biases in training data. It underscores the limitations of current AI models in real-world scenarios and the difficulty in interpreting their predictions, contributing to limited physician trust in AI-based models. The overarching suggestion is that AI can be a valuable tool in clinicians' hands for treating heart failure patients, as far as existing medical inaccuracies have been addressed before integrating AI into these frameworks.
Collapse
Affiliation(s)
- Angeliki Bourazana
- Department of Cardiology, University Hospital of Larissa, 41110 Larissa, Greece
| | - Andrew Xanthopoulos
- Department of Cardiology, University Hospital of Larissa, 41110 Larissa, Greece
| | - Alexandros Briasoulis
- Division of Cardiovascular Medicine, Section of Heart Failure and Transplantation, University of Iowa, Iowa City, IA 52242, USA
| | - Dimitrios Magouliotis
- Department of Cardiothoracic Surgery, University of Thessaly, 41110 Larissa, Greece; (D.M.); (K.S.)
| | - Kyriakos Spiliopoulos
- Department of Cardiothoracic Surgery, University of Thessaly, 41110 Larissa, Greece; (D.M.); (K.S.)
| | - Thanos Athanasiou
- Department of Surgery and Cancer, Imperial College London, St Mary’s Hospital, London W2 1NY, UK
| | - George Vassilopoulos
- Department of Hematology, University Hospital of Larissa, University of Thessaly Medical School, 41110 Larissa, Greece
| | - John Skoularigis
- Department of Cardiology, University Hospital of Larissa, 41110 Larissa, Greece
| | | |
Collapse
|