1
|
Seam N, Chotirmall SH, Martinez FJ, Halayko AJ, Harhay MO, Davis SD, Schumacker PT, Tighe RM, Burkart KM, Cooke C. Editorial Position of the American Thoracic Society Journal Family on the Evolving Role of Artificial Intelligence in Scientific Research and Review. Am J Respir Crit Care Med 2024; 211:1-3. [PMID: 39680927 PMCID: PMC11755372 DOI: 10.1164/rccm.202411-2208ed] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2024] [Accepted: 12/11/2024] [Indexed: 12/18/2024] Open
Affiliation(s)
- Nitin Seam
- National Institutes of Health, Bethesda, Maryland, United States;
| | - Sanjay H Chotirmall
- Lee Kong Chian School of Medicine, Translational Respiratory Research Laboratory, Singapore, Singapore
- Singapore
| | | | - Andrew J Halayko
- University of Manitoba, SECTION OF RESPIRATORY DISEASES, Winnipeg, Manitoba, Canada
- University of Manitoba, Biology of Breathing Group, Children's Hospital Research Institute of Manitoba, Winnipeg, Manitoba, Canada
| | - Michael O Harhay
- University of Pennsylvania, Biostatistics, Epidemiology and Informatics, Philadelphia, Pennsylvania, United States
| | - Stephanie D Davis
- Riley Children's Hospital, Pediatrics, Indianapolis, Indiana, United States
| | - Paul T Schumacker
- Northwestern University, Pediatrics - Neonatology, Chicago, Illinois, United States
| | - Robert M Tighe
- Duke Medicine, Medicine, Durham, North Carolina, United States
| | | | - Colin Cooke
- University of Michigan, Pulmonary and Critical Care Medicine, Ann Arbor, Michigan, United States
| |
Collapse
|
2
|
Wehbe RM. Charting the future of cardiology with large language model artificial intelligence. Nat Rev Cardiol 2024:10.1038/s41569-024-01105-y. [PMID: 39562750 DOI: 10.1038/s41569-024-01105-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/21/2024]
Affiliation(s)
- Ramsey M Wehbe
- Division of Cardiology and Biomedical Informatics Center, Medical University of South Carolina, Charleston, SC, USA.
| |
Collapse
|
3
|
Di Giammarco G, Cammertoni F, Testa N, Massetti M. Understanding Surgeons' Reluctance to Adopt Intraoperative Coronary Graft Verification Procedures: A Literature Review Combined to AI-Driven Insights Under Human Supervision. J Clin Med 2024; 13:6889. [PMID: 39598033 PMCID: PMC11595088 DOI: 10.3390/jcm13226889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2024] [Revised: 11/10/2024] [Accepted: 11/12/2024] [Indexed: 11/29/2024] Open
Abstract
Background: Intraoperative graft verification in coronary surgery is accepted worldwidand equally discussed. In spite of multiple sources of evidence published up to now in favor of clinical benefits following the use of the procedure, there is a persistent skepticism in adopting the available technologies. The object of the present review is to analyze the reluctance of surgeons toward the adoption of assessment methods. Materials and Method: A thorough literature review was carried out on Google Scholar based on the results obtained from AI's answer to the question about the reasons for that reluctance. We took advantage of using ChatGPT-4 since the research based on PubMed Central alone was not able to return a detailed response, maybe because the reasons for the reluctance are veiled in the text of the published papers. Through the items suggested by AI and taken from the literature, we deepened the research, pointing attention to the issues published so far about the various technologies. Results: There are many convincing pieces of evidence about the utility of intraoperative graft control in coronary surgery, involving improved clinical outcome, efficacy and safety, and social cost saving. The opinion that arose through this analysis is that, beyond the objective difficulties in utilizing some technologies and the equally objective limitations of an economic and organizational nature, the reluctance is the result of a real unwillingness based on the various implications that the discovery of the technical error entails. Conclusions: This negative attitude, in light of the convincing scientific and clinical evidence published up to now, appears to overwhelm the benefits for patients.
Collapse
Affiliation(s)
- Gabriele Di Giammarco
- Department of Neuroscience, Imaging and Clinical Science, School of Medicine and Health Science, Università “G.D’Annunzio” Chieti–Pescara, 66100 Chieti, Italy
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy;
| | - Federico Cammertoni
- Department of Cardiovascular Sciences, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, 00168 Rome, Italy; (F.C.); (N.T.)
| | - Nicola Testa
- Department of Cardiovascular Sciences, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, 00168 Rome, Italy; (F.C.); (N.T.)
| | - Massimo Massetti
- Faculty of Medicine and Surgery, Catholic University of Sacred Heart, 00168 Rome, Italy;
- Department of Cardiovascular Sciences, Fondazione Policlinico Universitario “A. Gemelli” IRCCS, 00168 Rome, Italy; (F.C.); (N.T.)
| |
Collapse
|
4
|
Almobayed A, Eleiwa TK, Badla O, Khodor A, Ruiz-Lozano RE, Elhusseiny AM. Do Ophthalmology Journals Have AI Policies for Manuscript Writing? Am J Ophthalmol 2024; 271:38-42. [PMID: 39515455 DOI: 10.1016/j.ajo.2024.11.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2024] [Revised: 10/08/2024] [Accepted: 11/01/2024] [Indexed: 11/16/2024]
Abstract
PURPOSE To assess the prevalence of artificial intelligence (AI) usage policies in manuscript writing in PubMed-indexed ophthalmology journals and examine the relationship between the adoption of these policies and journal characteristics. DESIGN Cross-sectional study. SUBJECTS PubMed-indexed ophthalmology journals. MAIN OUTCOME MEASURES Prevalence of policies in journal guidelines regarding the use of AI in manuscript writing. METHODS We reviewed the guidelines of 84 ophthalmology journals indexed in PubMed to determine the presence of AI-use policies for manuscript generation. We further compared journal metrics, such as CiteScore, Journal Impact Factor (JIF), Journal Citation Indicator (JCI), Source Normalized Impact per Paper (SNIP), and SCImago Journal Rank (SJR), between journals with and without AI policies. Additionally, we analyzed the association between AI policy adoption and journal characteristics, such as MEDLINE indexing and society affiliation. RESULTS Among the 84 journals, 53 (63.1%) had AI policies for manuscript generation, with no significant changes observed during the study period. Journals indexed in MEDLINE were significantly more likely to have AI policies (68.8%) than non-MEDLINE-indexed journals, where no AI policies were found (0%) (P = .0008). There was no significant difference in AI policy adoption between society-affiliated (62.7%) and unaffiliated journals (64.7%) (P = .84). Journals with AI policies had significantly higher metrics, including CiteScore, SNIP, SJR, JIF, and JCI (P < .05). CONCLUSIONS While many ophthalmology journals have adopted AI policies, the lack of guidelines in over one-third of journals highlights a critical need for consistent and comprehensive AI policies, particularly as the AI landscape rapidly advances.
Collapse
Affiliation(s)
- Amr Almobayed
- From the Bascom Palmer Eye Institute, Miller School of Medicine at the University of Miami (A.A., O.B., A.K., R.E.R.-L.), Miami, Florida, USA
| | - Taher K Eleiwa
- Department of Ophthalmology, Benha University (T.K.E.), Benha, Egypt; Department of Ophthalmology, Magrabi Eye and Dental Hospital (T.K.E.), Qassim, Kingdom of Saudi Arabia
| | - Omar Badla
- From the Bascom Palmer Eye Institute, Miller School of Medicine at the University of Miami (A.A., O.B., A.K., R.E.R.-L.), Miami, Florida, USA
| | - Ali Khodor
- From the Bascom Palmer Eye Institute, Miller School of Medicine at the University of Miami (A.A., O.B., A.K., R.E.R.-L.), Miami, Florida, USA
| | - Raul E Ruiz-Lozano
- From the Bascom Palmer Eye Institute, Miller School of Medicine at the University of Miami (A.A., O.B., A.K., R.E.R.-L.), Miami, Florida, USA
| | - Abdelrahman M Elhusseiny
- Department of Ophthalmology, Harvey and Bernice Jones Eye Institute, University of Arkansas for Medical Sciences (A.M.E.), Little Rock, Arkansas, USA; Department of Ophthalmology, Boston Children's Hospital, Harvard Medical School (A.M.E.), Boston, Massachusetts, USA.
| |
Collapse
|
5
|
Inam M, Sheikh S, Khoja A, Abubakar A, Shah R, Samad Z, Ngugi A, Alarakhiya F, Waljee A, Virani SS. Health Data Sciences and Cardiovascular Disease in Africa: Needs and the Way Forward. Curr Atheroscler Rep 2024; 26:659-671. [PMID: 39240493 DOI: 10.1007/s11883-024-01235-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 08/24/2024] [Indexed: 09/07/2024]
Abstract
PURPOSE OF REVIEW The rising burden of cardiovascular disease (CVD) in Africa is of great concern. Health data sciences is a rapidly developing field which has the potential to improve health outcomes, especially in low-middle income countries with burdened healthcare systems. We aim to explore the current CVD landscape in Africa, highlighting the importance of health data sciences in the region and identifying potential opportunities for application and growth by leveraging health data sciences to improve CVD outcomes. RECENT FINDINGS While there have been a number of initiatives aimed at developing health data sciences in Africa over the recent decades, the progress and growth are still in their early stages. Its maximum potential can be leveraged through adequate funding, advanced training programs, focused resource allocation, encouraging bidirectional international partnerships, instituting best ethical practices, and prioritizing data science health research in the region. The findings of this review explore the current landscape of CVD and highlight the potential benefits and utility of health data sciences to address CVD challenges in Africa. By understanding and overcoming the barriers associated with health data sciences training, research, and application in the region, focused initiatives can be developed to promote research and development. These efforts will allow policymakers to form informed, evidence-based frameworks for the prevention and management of CVDs, and ultimately result in improved CVD outcomes in the region.
Collapse
Affiliation(s)
- Maha Inam
- Office of the Vice Provost, Research, Aga Khan University, Karachi, Pakistan
- Department of Medicine, Temple University Hospital, Philadelphia, PA, 19140, USA
| | - Sana Sheikh
- Department of Medicine, Aga Khan University, Karachi, Pakistan
| | - Adeel Khoja
- Department of Medicine, Aga Khan University, Karachi, Pakistan
- Adelaide Medical School, The University of Adelaide, Adelaide, South Australia, 5000, Australia
| | - Amina Abubakar
- Institute for Human Development, Aga Khan University, Nairobi, Kenya
| | - Reena Shah
- Department of Medicine, Aga Khan University, Nairobi, Kenya
| | - Zainab Samad
- Department of Medicine, Aga Khan University, Karachi, Pakistan
- Section of Cardiology, Department of Medicine, Aga Khan University Hospital, Karachi, Pakistan
| | - Anthony Ngugi
- Department of Population Health, Aga Khan University, Nairobi, Kenya
- Centre of Excellence in Women and Child Health, Aga Khan University, Nairobi, Kenya
| | | | - Akbar Waljee
- Department of Learning Health Sciences, University of Michigan, Ann Arbor, USA
- Department of Internal Medicine, Division of Gastroenterology, University of Michigan, Ann Arbor, MI, USA
- Center for Global Health and Equity, University of Michigan, Ann Arbor, USA
| | - Salim S Virani
- Office of the Vice Provost, Research, Aga Khan University, Karachi, Pakistan.
- Department of Medicine, Aga Khan University, Karachi, Pakistan.
- Section of Cardiology, Department of Medicine, Aga Khan University Hospital, Karachi, Pakistan.
- The Texas Heart Institute, Houston, TX, USA.
| |
Collapse
|
6
|
Leon M, Ruaengsri C, Pelletier G, Bethencourt D, Shibata M, Flores MQ, Shudo Y. Harnessing the Power of ChatGPT in Cardiovascular Medicine: Innovations, Challenges, and Future Directions. J Clin Med 2024; 13:6543. [PMID: 39518681 PMCID: PMC11546989 DOI: 10.3390/jcm13216543] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 10/08/2024] [Accepted: 10/29/2024] [Indexed: 11/16/2024] Open
Abstract
Cardiovascular diseases remain the leading cause of morbidity and mortality globally, posing significant challenges to public health. The rapid evolution of artificial intelligence (AI), particularly with large language models such as ChatGPT, has introduced transformative possibilities in cardiovascular medicine. This review examines ChatGPT's broad applications in enhancing clinical decision-making-covering symptom analysis, risk assessment, and differential diagnosis; advancing medical education for both healthcare professionals and patients; and supporting research and academic communication. Key challenges associated with ChatGPT, including potential inaccuracies, ethical considerations, data privacy concerns, and inherent biases, are discussed. Future directions emphasize improving training data quality, developing specialized models, refining AI technology, and establishing regulatory frameworks to enhance ChatGPT's clinical utility and mitigate associated risks. As cardiovascular medicine embraces AI, ChatGPT stands out as a powerful tool with substantial potential to improve therapeutic outcomes, elevate care quality, and advance research innovation. Fully understanding and harnessing this potential is essential for the future of cardiovascular health.
Collapse
Affiliation(s)
| | | | | | | | | | | | - Yasuhiro Shudo
- Department of Cardiothoracic Surgery, Stanford University School of Medicine, 300 Pasteur Drive, Falk CVRB, Stanford, CA 94305, USA; (C.R.); (G.P.); (D.B.); (M.Q.F.)
| |
Collapse
|
7
|
Bhattaru A, Yanamala N, Sengupta PP. Revolutionizing Cardiology With Words: Unveiling the Impact of Large Language Models in Medical Science Writing. Can J Cardiol 2024; 40:1950-1958. [PMID: 38823633 DOI: 10.1016/j.cjca.2024.05.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2024] [Revised: 05/16/2024] [Accepted: 05/24/2024] [Indexed: 06/03/2024] Open
Abstract
Large language models (LLMs) are a unique form of machine learning that facilitates inputs of unstructured text/numerical information for meaningful interpretation and prediction. Recently, LLMs have become commercialized, allowing the average person to access these incredibly powerful tools. Early adopters focused on LLM use in performing logical tasks, including-but not limited to-generating titles, identifying key words, summarizing text, initial editing of scientific work, improving statistical protocols, and performing statistical analysis. More recently, LLMs have been expanded to clinical practice and academia to perform higher cognitive and creative tasks. LLMs provide personalized assistance in learning, facilitate the management of electronic medical records, and offer valuable insights into clinical decision making in cardiology. They enhance patient education by explaining intricate medical conditions in lay terms, have a vast library of knowledge to help clinicians expedite administrative tasks, provide useful feedback regarding content of scientific writing, and assist in the peer-review process. Despite their impressive capabilities, LLMs are not without limitations. They are susceptible to generating incorrect or plagiarized content, face challenges in handling tasks without detailed prompts, and lack originality. These limitations underscore the importance of human oversight in using LLMs in medical science and clinical practice. As LLMs continue to evolve, addressing these challenges will be crucial in maximizing their potential benefits while mitigating risks. This review explores the functions, opportunities, and constraints of LLMs, with a focus on their impact on cardiology, illustrating both the transformative power and the boundaries of current technology in medicine.
Collapse
Affiliation(s)
- Abhijit Bhattaru
- Department of Cardiology, Rutgers Robert Wood Johnson Medical School and Robert Wood Johnson University Hospital, New Brunswick, New Jersey, USA; Department of Medicine, Rutgers New Jersey Medical School, Newark, New Jersey, USA
| | - Naveena Yanamala
- Department of Cardiology, Rutgers Robert Wood Johnson Medical School and Robert Wood Johnson University Hospital, New Brunswick, New Jersey, USA
| | - Partho P Sengupta
- Department of Cardiology, Rutgers Robert Wood Johnson Medical School and Robert Wood Johnson University Hospital, New Brunswick, New Jersey, USA.
| |
Collapse
|
8
|
Silva GS, Khera R, Schwamm LH. Reviewer Experience Detecting and Judging Human Versus Artificial Intelligence Content: The Stroke Journal Essay Contest. Stroke 2024; 55:2573-2578. [PMID: 39224979 PMCID: PMC11529699 DOI: 10.1161/strokeaha.124.045012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Revised: 07/10/2024] [Accepted: 07/31/2024] [Indexed: 09/04/2024]
Abstract
Artificial intelligence (AI) large language models (LLMs) now produce human-like general text and images. LLMs' ability to generate persuasive scientific essays that undergo evaluation under traditional peer review has not been systematically studied. To measure perceptions of quality and the nature of authorship, we conducted a competitive essay contest in 2024 with both human and AI participants. Human authors and 4 distinct LLMs generated essays on controversial topics in stroke care and outcomes research. A panel of Stroke Editorial Board members (mostly vascular neurologists), blinded to author identity and with varying levels of AI expertise, rated the essays for quality, persuasiveness, best in topic, and author type. Among 34 submissions (22 human and 12 LLM) scored by 38 reviewers, human and AI essays received mostly similar ratings, though AI essays were rated higher for composition quality. Author type was accurately identified only 50% of the time, with prior LLM experience associated with improved accuracy. In multivariable analyses adjusted for author attributes and essay quality, only persuasiveness was independently associated with odds of a reviewer assigning AI as author type (adjusted odds ratio, 1.53 [95% CI, 1.09-2.16]; P=0.01). In conclusion, a group of experienced editorial board members struggled to distinguish human versus AI authorship, with a bias against best in topic for essays judged to be AI generated. Scientific journals may benefit from educating reviewers on the types and uses of AI in scientific writing and developing thoughtful policies on the appropriate use of AI in authoring manuscripts.
Collapse
Affiliation(s)
- Gisele S Silva
- Hospital Israelita Albert Einstein and Universidade Federal de São Paulo (UNIFESP)
| | - Rohan Khera
- Section of Cardiovascular Medicine, Yale School of Medicine, New Haven, CT
- Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT
- Section of Health Informatics, Department of Biostatistics, Yale School of Public Health, New Haven, CT
| | - Lee H Schwamm
- Biomedical Informatics and Data Science, Yale School of Medicine, New Haven, CT
- Department of Neurology, Yale School of Medicine, New Haven, CT
- Digital and Technology Solutions, Yale New Haven Health System, New Haven, CT
| |
Collapse
|
9
|
Zago Ribeiro L, Nakayama LF, Malerbi FK, Regatieri CVS. Automated machine learning model for fundus image classification by health-care professionals with no coding experience. Sci Rep 2024; 14:10395. [PMID: 38710726 PMCID: PMC11074250 DOI: 10.1038/s41598-024-60807-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 04/26/2024] [Indexed: 05/08/2024] Open
Abstract
To assess the feasibility of code-free deep learning (CFDL) platforms in the prediction of binary outcomes from fundus images in ophthalmology, evaluating two distinct online-based platforms (Google Vertex and Amazon Rekognition), and two distinct datasets. Two publicly available datasets, Messidor-2 and BRSET, were utilized for model development. The Messidor-2 consists of fundus photographs from diabetic patients and the BRSET is a multi-label dataset. The CFDL platforms were used to create deep learning models, with no preprocessing of the images, by a single ophthalmologist without coding expertise. The performance metrics employed to evaluate the models were F1 score, area under curve (AUC), precision and recall. The performance metrics for referable diabetic retinopathy and macular edema were above 0.9 for both tasks and CDFL. The Google Vertex models demonstrated superior performance compared to the Amazon models, with the BRSET dataset achieving the highest accuracy (AUC of 0.994). Multi-classification tasks using only BRSET achieved similar overall performance between platforms, achieving AUC of 0.994 for laterality, 0.942 for age grouping, 0.779 for genetic sex identification, 0.857 for optic, and 0.837 for normality with Google Vertex. The study demonstrates the feasibility of using automated machine learning platforms for predicting binary outcomes from fundus images in ophthalmology. It highlights the high accuracy achieved by the models in some tasks and the potential of CFDL as an entry-friendly platform for ophthalmologists to familiarize themselves with machine learning concepts.
Collapse
Affiliation(s)
- Lucas Zago Ribeiro
- Department of Ophthalmology and Visual Sciences, Federal University of São Paulo, São Paulo, SP, Brazil.
| | - Luis Filipe Nakayama
- Department of Ophthalmology and Visual Sciences, Federal University of São Paulo, São Paulo, SP, Brazil
- Massachusetts Institute of Technology, Institute for Medical Engineering and Science, Cambridge, MA, USA
| | - Fernando Korn Malerbi
- Department of Ophthalmology and Visual Sciences, Federal University of São Paulo, São Paulo, SP, Brazil
| | | |
Collapse
|
10
|
Vlachopoulos C, Antonopoulos A, Terentes-Printzios D. Generative artificial intelligence tools in scientific writing: entering a brave new world? Hellenic J Cardiol 2024; 77:120-121. [PMID: 38797284 DOI: 10.1016/j.hjc.2024.05.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Accepted: 05/22/2024] [Indexed: 05/29/2024] Open
|
11
|
Guo D, Fu Y, Zhu Z. Letter to the editor "A review of top cardiology and cardiovascular medicine journal guidelines regarding the use of generative artificial intelligence tools in scientific writing". Curr Probl Cardiol 2024; 49:102408. [PMID: 38237816 DOI: 10.1016/j.cpcardiol.2024.102408] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2024] [Accepted: 01/14/2024] [Indexed: 02/01/2024]
Affiliation(s)
- Dongke Guo
- Department of Clinical Research, the First People's Hospital of Xiaoshan District, Xiaoshan Affiliated Hospital of Wenzhou Medical University, Hangzhou, China
| | - Yonghua Fu
- Department of General Practice, Community Health Service Center of Guali Town of Xiaoshan, Hangzhou, China
| | - Zhongxin Zhu
- Department of Clinical Research, the First People's Hospital of Xiaoshan District, Xiaoshan Affiliated Hospital of Wenzhou Medical University, Hangzhou, China..
| |
Collapse
|