1
|
Allam AH, Eltewacy NK, Alabdallat YJ, Owais TA, Salman S, Ebada MA. Knowledge, attitude, and perception of Arab medical students towards artificial intelligence in medicine and radiology: A multi-national cross-sectional study. Eur Radiol 2024; 34:1-14. [PMID: 38150076 PMCID: PMC11213794 DOI: 10.1007/s00330-023-10509-2] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Revised: 09/26/2023] [Accepted: 11/02/2023] [Indexed: 12/28/2023]
Abstract
OBJECTIVES We aimed to assess undergraduate medical students' knowledge, attitude, and perception regarding artificial intelligence (AI) in medicine. METHODS A multi-national, multi-center cross-sectional study was conducted from March to April 2022, targeting undergraduate medical students in nine Arab countries. The study utilized a web-based questionnaire, with data collection carried out with the help of national leaders and local collaborators. Logistic regression analysis was performed to identify predictors of knowledge, attitude, and perception among the participants. Additionally, cluster analysis was employed to identify shared patterns within their responses. RESULTS Of the 4492 students surveyed, 92.4% had not received formal AI training. Regarding AI and deep learning (DL), 87.1% exhibited a low level of knowledge. Most students (84.9%) believed AI would revolutionize medicine and radiology, with 48.9% agreeing that it could reduce the need for radiologists. Students with high/moderate AI knowledge and training had higher odds of agreeing to endorse AI replacing radiologists, reducing their numbers, and being less likely to consider radiology as a career compared to those with low knowledge/no AI training. Additionally, the majority agreed that AI would aid in the automated detection and diagnosis of pathologies. CONCLUSIONS Arab medical students exhibit a notable deficit in their knowledge and training pertaining to AI. Despite this, they hold a positive perception of AI implementation in medicine and radiology, demonstrating a clear understanding of its significance for the healthcare system and medical curriculum. CLINICAL RELEVANCE STATEMENT This study highlights the need for widespread education and training in artificial intelligence for Arab medical students, indicating its significance for healthcare systems and medical curricula. KEY POINTS • Arab medical students demonstrate a significant knowledge and training gap when it comes to using AI in the fields of medicine and radiology. • Arab medical students recognize the importance of integrating AI into the medical curriculum. Students with a deeper understanding of AI were more likely to agree that all medical students should receive AI education. However, those with previous AI training were less supportive of this idea. • Students with moderate/high AI knowledge and training displayed increased odds of agreeing that AI has the potential to replace radiologists, reduce the demand for their services, and were less inclined to pursue a career in radiology, when compared to students with low knowledge/no AI training.
Collapse
Affiliation(s)
- Ahmed Hafez Allam
- Faculty of Medicine, Menoufia University, Shebin El-Kom, Menoufia, Egypt.
- Eltewacy Arab Research Group, Cairo, Egypt.
| | - Nael Kamel Eltewacy
- Eltewacy Arab Research Group, Cairo, Egypt
- Faculty of Pharmacy, Beni-Suef University, Beni-Suef, Egypt
| | - Yasmeen Jamal Alabdallat
- Eltewacy Arab Research Group, Cairo, Egypt
- Faculty of Medicine, Hashemite University, Zarqa, Jordan
| | - Tarek A Owais
- Eltewacy Arab Research Group, Cairo, Egypt
- Faculty of Pharmacy, Beni-Suef University, Beni-Suef, Egypt
| | - Saif Salman
- Eltewacy Arab Research Group, Cairo, Egypt
- Mayo Clinic College of Medicine, Jacksonville, FL, USA
| | - Mahmoud A Ebada
- Eltewacy Arab Research Group, Cairo, Egypt
- Faculty of Medicine, Zagazig University, Zagazig, El-Sharkia, Egypt
- Egyptian Fellowship of Neurology, Nasr City Hospital for Health Insurance, Nasr City, Cairo, Egypt
| |
Collapse
|
2
|
Wenderott K, Krups J, Luetkens JA, Weigl M. Radiologists' perspectives on the workflow integration of an artificial intelligence-based computer-aided detection system: A qualitative study. APPLIED ERGONOMICS 2024; 117:104243. [PMID: 38306741 DOI: 10.1016/j.apergo.2024.104243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Revised: 12/18/2023] [Accepted: 01/23/2024] [Indexed: 02/04/2024]
Abstract
In healthcare, artificial intelligence (AI) is expected to improve work processes, yet most research focuses on the technical features of AI rather than its real-world clinical implementation. To evaluate the implementation process of an AI-based computer-aided detection system (AI-CAD) for prostate MRI readings, we interviewed German radiologists in a pre-post design. We embedded our findings in the Model of Workflow Integration and the Technology Acceptance Model to analyze workflow effects, facilitators, and barriers. The most prominent barriers were: (i) a time delay in the work process, (ii) additional work steps to be taken, and (iii) an unstable performance of the AI-CAD. Most frequently named facilitators were (i) good self-organization, and (ii) good usability of the software. Our results underline the importance of a holistic approach to AI implementation considering the sociotechnical work system and provide valuable insights into key factors of the successful adoption of AI technologies in work systems.
Collapse
Affiliation(s)
- Katharina Wenderott
- Institute for Patient Safety, University Hospital Bonn, Venusberg-Campus 1, 53127, Bonn, Germany.
| | - Jim Krups
- Institute for Patient Safety, University Hospital Bonn, Venusberg-Campus 1, 53127, Bonn, Germany
| | - Julian A Luetkens
- Department of Diagnostic and Interventional Radiology, University Hospital Bonn, Germany; Quantitative Imaging Lab Bonn (QILaB), University Hospital Bonn, Germany
| | - Matthias Weigl
- Institute for Patient Safety, University Hospital Bonn, Venusberg-Campus 1, 53127, Bonn, Germany
| |
Collapse
|
3
|
Rawashdeh MA, Almazrouei S, Zaitoun M, Kumar P, Saade C. Empowering Radiographers: A Call for Integrated AI Training in University Curricula. Int J Biomed Imaging 2024; 2024:7001343. [PMID: 38496776 PMCID: PMC10942819 DOI: 10.1155/2024/7001343] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 02/07/2024] [Accepted: 02/14/2024] [Indexed: 03/19/2024] Open
Abstract
Background Artificial intelligence (AI) applications are rapidly advancing in the field of medical imaging. This study is aimed at investigating the perception and knowledge of radiographers towards artificial intelligence. Methods An online survey employing Google Forms consisting of 20 questions regarding the radiographers' perception of AI. The questionnaire was divided into two parts. The first part consisted of demographic information as well as whether the participants think AI should be part of medical training, their previous knowledge of the technologies used in AI, and whether they prefer to receive training on AI. The second part of the questionnaire consisted of two fields. The first one consisted of 16 questions regarding radiographers' perception of AI applications in radiology. Descriptive analysis and logistic regression analysis were used to evaluate the effect of gender on the items of the questionnaire. Results Familiarity with AI was low, with only 52 out of 100 respondents (52%) reporting good familiarity with AI. Many participants considered AI useful in the medical field (74%). The findings of the study demonstrate that nearly most of the participants (98%) believed that AI should be integrated into university education, with 87% of the respondents preferring to receive training on AI, with some already having prior knowledge of AI used in technologies. The logistic regression analysis indicated a significant association between male gender and experience within the range of 23-27 years with the degree of familiarity with AI technology, exhibiting respective odds ratios of 1.89 (COR = 1.89) and 1.87 (COR = 1.87). Conclusions This study suggests that medical practices have a favorable attitude towards AI in the radiology field. Most participants surveyed believed that AI should be part of radiography education. AI training programs for undergraduate and postgraduate radiographers may be necessary to prepare them for AI tools in radiology development.
Collapse
Affiliation(s)
- Mohammad A. Rawashdeh
- Faculty of Health Sciences, Gulf Medical University, Ajman, UAE
- Faculty of Applied Medical Sciences, Jordan University of Science and Technology, Irbid 222110, Jordan
| | - Sara Almazrouei
- Faculty of Health Sciences, Gulf Medical University, Ajman, UAE
| | - Maha Zaitoun
- Faculty of Health Sciences, Gulf Medical University, Ajman, UAE
- Faculty of Applied Medical Sciences, Jordan University of Science and Technology, Irbid 222110, Jordan
| | - Praveen Kumar
- Faculty of Health Sciences, Gulf Medical University, Ajman, UAE
| | - Charbel Saade
- Department of Diagnostic Radiography, UG 12 Aras Watson, Brookfield Health Sciences, T12 AK54, University College Cork, Cork, Ireland
| |
Collapse
|
4
|
Lombi L, Rossero E. How artificial intelligence is reshaping the autonomy and boundary work of radiologists. A qualitative study. SOCIOLOGY OF HEALTH & ILLNESS 2024; 46:200-218. [PMID: 37573551 DOI: 10.1111/1467-9566.13702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Accepted: 07/19/2023] [Indexed: 08/15/2023]
Abstract
The application of artificial intelligence (AI) in medical practice is spreading, especially in technologically dense fields such as radiology, which could consequently undergo profound transformations in the near future. This article aims to qualitatively explore the potential influence of AI technologies on the professional identity of radiologists. Drawing on 12 in-depth interviews with a subgroup of radiologists who participated in a larger study, this article investigated (1) whether radiologists perceived AI as a threat to their decision-making autonomy; and (2) how radiologists perceived the future of their profession compared to other health-care professions. The findings revealed that while AI did not generally affect radiologists' decision-making autonomy, it threatened their professional and epistemic authority. Two discursive strategies were identified to explain these findings. The first strategy emphasised radiologists' specific expertise and knowledge that extends beyond interpreting images, a task performed with high accuracy by AI machines. The second strategy underscored the fostering of radiologists' professional prestige through developing expertise in using AI technologies, a skill that would distinguish them from other clinicians who did not pose this knowledge. This study identifies AI machines as status objects and useful tools in performing boundary work in and around the radiological profession.
Collapse
Affiliation(s)
- Linda Lombi
- Department of Sociology, Università Cattolica del Sacro Cuore, Milan, Italy
| | - Eleonora Rossero
- Fundamental Rights Laboratory, Collegio Carlo Alberto, Turin, Italy
| |
Collapse
|
5
|
Hellström T. AI and its consequences for the written word. Front Artif Intell 2024; 6:1326166. [PMID: 38239498 PMCID: PMC10794589 DOI: 10.3389/frai.2023.1326166] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2023] [Accepted: 12/07/2023] [Indexed: 01/22/2024] Open
Abstract
The latest developments of chatbots driven by Large Language Models (LLMs), more specifically ChatGPT, have shaken the foundations of how text is created, and may drastically reduce and change the need, ability, and valuation of human writing. Furthermore, our trust in the written word is likely to decrease, as an increasing proportion of all written text will be AI-generated - and potentially incorrect. In this essay, I discuss these implications and possible scenarios for us humans, and for AI itself.
Collapse
|
6
|
Elhakim MT, Stougaard SW, Graumann O, Nielsen M, Lång K, Gerke O, Larsen LB, Rasmussen BSB. Breast cancer detection accuracy of AI in an entire screening population: a retrospective, multicentre study. Cancer Imaging 2023; 23:127. [PMID: 38124111 PMCID: PMC10731688 DOI: 10.1186/s40644-023-00643-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 12/04/2023] [Indexed: 12/23/2023] Open
Abstract
BACKGROUND Artificial intelligence (AI) systems are proposed as a replacement of the first reader in double reading within mammography screening. We aimed to assess cancer detection accuracy of an AI system in a Danish screening population. METHODS We retrieved a consecutive screening cohort from the Region of Southern Denmark including all participating women between Aug 4, 2014, and August 15, 2018. Screening mammograms were processed by a commercial AI system and detection accuracy was evaluated in two scenarios, Standalone AI and AI-integrated screening replacing first reader, with first reader and double reading with arbitration (combined reading) as comparators, respectively. Two AI-score cut-off points were applied by matching at mean first reader sensitivity (AIsens) and specificity (AIspec). Reference standard was histopathology-proven breast cancer or cancer-free follow-up within 24 months. Coprimary endpoints were sensitivity and specificity, and secondary endpoints were positive predictive value (PPV), negative predictive value (NPV), recall rate, and arbitration rate. Accuracy estimates were calculated using McNemar's test or exact binomial test. RESULTS Out of 272,008 screening mammograms from 158,732 women, 257,671 (94.7%) with adequate image data were included in the final analyses. Sensitivity and specificity were 63.7% (95% CI 61.6%-65.8%) and 97.8% (97.7-97.8%) for first reader, and 73.9% (72.0-75.8%) and 97.9% (97.9-98.0%) for combined reading, respectively. Standalone AIsens showed a lower specificity (-1.3%) and PPV (-6.1%), and a higher recall rate (+ 1.3%) compared to first reader (p < 0.0001 for all), while Standalone AIspec had a lower sensitivity (-5.1%; p < 0.0001), PPV (-1.3%; p = 0.01) and NPV (-0.04%; p = 0.0002). Compared to combined reading, Integrated AIsens achieved higher sensitivity (+ 2.3%; p = 0.0004), but lower specificity (-0.6%) and PPV (-3.9%) as well as higher recall rate (+ 0.6%) and arbitration rate (+ 2.2%; p < 0.0001 for all). Integrated AIspec showed no significant difference in any outcome measures apart from a slightly higher arbitration rate (p < 0.0001). Subgroup analyses showed higher detection of interval cancers by Standalone AI and Integrated AI at both thresholds (p < 0.0001 for all) with a varying composition of detected cancers across multiple subgroups of tumour characteristics. CONCLUSIONS Replacing first reader in double reading with an AI could be feasible but choosing an appropriate AI threshold is crucial to maintaining cancer detection accuracy and workload.
Collapse
Affiliation(s)
- Mohammad Talal Elhakim
- Department of Radiology, Odense University Hospital, Kløvervaenget 47, Entrance 27, Ground floor, 5000, Odense C, Denmark.
- Department of Clinical Research, University of Southern Denmark, Kløvervaenget 10, Entrance 112, 2nd floor, 5000, Odense C, Denmark.
| | - Sarah Wordenskjold Stougaard
- Department of Clinical Research, University of Southern Denmark, Kløvervaenget 10, Entrance 112, 2nd floor, 5000, Odense C, Denmark
| | - Ole Graumann
- Department of Clinical Research, University of Southern Denmark, Kløvervaenget 10, Entrance 112, 2nd floor, 5000, Odense C, Denmark
- Department of Radiology, Aarhus University Hospital, Palle Juul-Jensens Blvd. 99, 8200, Aarhus N, Denmark
- Department of Clinical Research, Aarhus University, Palle Juul-Jensens Blvd. 99, 8200, Aarhus N, Denmark
| | - Mads Nielsen
- Department of Computer Science, University of Copenhagen, Universitetsparken 1, 2100, København Ø, Denmark
| | - Kristina Lång
- Department of Translational Medicine, Lund University, Inga Maria Nilssons gata 47, SE-20502, Malmö, Sweden
- Unilabs Mammography Unit, Skåne University Hospital, Jan Waldenströms gata 22, SE-20502, Malmö, Sweden
| | - Oke Gerke
- Department of Clinical Research, University of Southern Denmark, Kløvervaenget 10, Entrance 112, 2nd floor, 5000, Odense C, Denmark
- Department of Nuclear Medicine, Odense University Hospital, Kløvervaenget 47, Entrance 44, 5000, Odense C, Denmark
| | - Lisbet Brønsro Larsen
- Department of Radiology, Odense University Hospital, Kløvervaenget 47, Entrance 27, Ground floor, 5000, Odense C, Denmark
| | - Benjamin Schnack Brandt Rasmussen
- Department of Radiology, Odense University Hospital, Kløvervaenget 47, Entrance 27, Ground floor, 5000, Odense C, Denmark
- Department of Clinical Research, University of Southern Denmark, Kløvervaenget 10, Entrance 112, 2nd floor, 5000, Odense C, Denmark
- CAI-X - Centre for Clinical Artificial Intelligence, Odense University Hospital, Kløvervaenget 8C, Entrance 102, 5000, Odense C, Denmark
| |
Collapse
|
7
|
Pirocca U, Vinchon F, Beregi JP, Jacques T, Delabrousse E, Gouy E, Rolland F, Truong LN, Frajerman A, Ohana M, Malakhia A, Hadouiri N. How do medical students, residents and graduated physicians really perceive radiologists? A cross-national study. Eur J Radiol 2023; 168:111115. [PMID: 37832193 DOI: 10.1016/j.ejrad.2023.111115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2023] [Revised: 09/08/2023] [Accepted: 09/25/2023] [Indexed: 10/15/2023]
Abstract
BACKGROUND Radiology has always been an attractive specialty for residents, but its attractiveness has recently decreased in France regarding the median choice rank after at the National Residency Board. AIM To study Radiologists' perceptions and social representations (SRs) among a group of medical students, residents and graduated physicians in France, to better understand the view of Radiologists to debunk stereotypes. METHODS The nationwide web-based survey was based on valid hierarchical evocation methods. We determined the corpus's central core and SRs' principal themes with prototypical and correspondence factor analysis (CFA), respectively. RESULTS Overall, 419 answers were analyzed. Radiologists' SRs were divided into 3 classes: negative stereotypes of Radiologists, negative stereotypes of the Radiologists' daily practice and Radiologists' skills. After multivariate analysis, variables that seemed to have a positive influence on Radiologists' SRs were considering radiology as a potential choice of specialty (p < 0.001) and the existence of practical experience in Radiology (p = 0.008). Women seemed to have a more negative SR of Radiologists than men (p = 0.035). DISCUSSION This was the largest qualitative study on the subject and the only one among medical students, residents and graduated physicians, allowing a global picture. SRs of Radiologists seemed to be negative, potentially caused by poor knowledge of the Radiologists' profession. CONCLUSION SRs of Radiologists among medical students and graduated physicians appears to be negative. Promoting the specialty among medical students and encouraging their immersion in a Radiology department could help to debunk many stereotypes about the daily life and missions of Radiologists.
Collapse
Affiliation(s)
- Ugo Pirocca
- Department of Radiology, Centre Hospitalier Universitaire de Besançon, 25030 Besançon, France; Department of Vascular & Interventional Radiology, University Hospital of Dijon, Dijon, France
| | - Florent Vinchon
- Université Paris Cité et Université Gustave Eiffel, LaPEA, F-92100 Boulogne-Billancourt, France
| | - Jean Paul Beregi
- Department of Radiology, Nîmes Carémeau University Hospital, 30900 Nimes, France
| | - Thibaut Jacques
- Service de radiologie et d'imagerie musculo-squelettique, centre de consultation et d'imagerie de l'appareil locomoteur, CHU de Lille, avenue du Professeur Emile-Laine, 59000 Lille, France; Faculté de médecine, université de Lille, Lille, France
| | - Eric Delabrousse
- Department of Radiology, Centre Hospitalier Universitaire de Besançon, 25030 Besançon, France
| | - Evan Gouy
- Genetics Department, University Hospital of Lyon, Bron, France; Genetics and Neurobiology of C. elegans, Mechanisms in Integrated Life Sciences (CNRS UMR 5284 - INSERM U1314 - Claude Bernard University Lyon 1), NeuroMyoGene Institute, Lyon, France
| | - Franck Rolland
- CESP-Inserm, U1018, Research in Ethics and Epistemology (R2E), Paris-Sud University, Paris-Saclay University, Inserm, Paris, France
| | - Linh Nam Truong
- Faculté de Médecine, Université de Bourgogne-Franche-Comté, 7 boulevard Jeanne D'Arc, Dijon, France
| | - Ariel Frajerman
- Université Paris-Saclay, AP-HP, Service Hospitalo-Universitaire de Psychiatrie, Hôpital de Bicêtre, Equipe MOODS, Inserm U1178, CESP (Centre de Recherche en Epidémiologie et Sante des Populations), Le Kremlin-Bicêtre, France
| | - Mickael Ohana
- Radiology Department, Nouvel Hôpital Civil, 1 Place de l'Hôpital, 67000 Strasbourg, France
| | - Alexandre Malakhia
- Department of Radiology, Centre Hospitalier Universitaire de Besançon, 25030 Besançon, France; Department of Vascular & Interventional Radiology, University Hospital of Dijon, Dijon, France
| | - Nawale Hadouiri
- Department of Physical Medicine and Rehabilitation, Center Hospitalier Universitaire de Dijon, 21000 Dijon, France.
| |
Collapse
|
8
|
Hussain S, Lafarga-Osuna Y, Ali M, Naseem U, Ahmed M, Tamez-Peña JG. Deep learning, radiomics and radiogenomics applications in the digital breast tomosynthesis: a systematic review. BMC Bioinformatics 2023; 24:401. [PMID: 37884877 PMCID: PMC10605943 DOI: 10.1186/s12859-023-05515-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Accepted: 10/02/2023] [Indexed: 10/28/2023] Open
Abstract
BACKGROUND Recent advancements in computing power and state-of-the-art algorithms have helped in more accessible and accurate diagnosis of numerous diseases. In addition, the development of de novo areas in imaging science, such as radiomics and radiogenomics, have been adding more to personalize healthcare to stratify patients better. These techniques associate imaging phenotypes with the related disease genes. Various imaging modalities have been used for years to diagnose breast cancer. Nonetheless, digital breast tomosynthesis (DBT), a state-of-the-art technique, has produced promising results comparatively. DBT, a 3D mammography, is replacing conventional 2D mammography rapidly. This technological advancement is key to AI algorithms for accurately interpreting medical images. OBJECTIVE AND METHODS This paper presents a comprehensive review of deep learning (DL), radiomics and radiogenomics in breast image analysis. This review focuses on DBT, its extracted synthetic mammography (SM), and full-field digital mammography (FFDM). Furthermore, this survey provides systematic knowledge about DL, radiomics, and radiogenomics for beginners and advanced-level researchers. RESULTS A total of 500 articles were identified, with 30 studies included as the set criteria. Parallel benchmarking of radiomics, radiogenomics, and DL models applied to the DBT images could allow clinicians and researchers alike to have greater awareness as they consider clinical deployment or development of new models. This review provides a comprehensive guide to understanding the current state of early breast cancer detection using DBT images. CONCLUSION Using this survey, investigators with various backgrounds can easily seek interdisciplinary science and new DL, radiomics, and radiogenomics directions towards DBT.
Collapse
Affiliation(s)
- Sadam Hussain
- School of Engineering and Sciences, Tecnológico de Monterrey, Ave. Eugenio Garza Sada 2501, 64849, Monterrey, Mexico.
| | - Yareth Lafarga-Osuna
- School of Engineering and Sciences, Tecnológico de Monterrey, Ave. Eugenio Garza Sada 2501, 64849, Monterrey, Mexico
| | - Mansoor Ali
- School of Engineering and Sciences, Tecnológico de Monterrey, Ave. Eugenio Garza Sada 2501, 64849, Monterrey, Mexico
| | - Usman Naseem
- College of Science and Engineering, James Cook University, Cairns, Australia
| | - Masroor Ahmed
- School of Engineering and Sciences, Tecnológico de Monterrey, Ave. Eugenio Garza Sada 2501, 64849, Monterrey, Mexico
| | - Jose Gerardo Tamez-Peña
- School of Medicine and Health Sciences, Tecnológico de Monterrey, Ave. Eugenio Garza Sada 2501, 64849, Monterrey, Mexico
| |
Collapse
|
9
|
Chen Y, Wu Z, Wang P, Xie L, Yan M, Jiang M, Yang Z, Zheng J, Zhang J, Zhu J. Radiology Residents' Perceptions of Artificial Intelligence: Nationwide Cross-Sectional Survey Study. J Med Internet Res 2023; 25:e48249. [PMID: 37856181 PMCID: PMC10623237 DOI: 10.2196/48249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2023] [Revised: 07/07/2023] [Accepted: 09/01/2023] [Indexed: 10/20/2023] Open
Abstract
BACKGROUND Artificial intelligence (AI) is transforming various fields, with health care, especially diagnostic specialties such as radiology, being a key but controversial battleground. However, there is limited research systematically examining the response of "human intelligence" to AI. OBJECTIVE This study aims to comprehend radiologists' perceptions regarding AI, including their views on its potential to replace them, its usefulness, and their willingness to accept it. We examine the influence of various factors, encompassing demographic characteristics, working status, psychosocial aspects, personal experience, and contextual factors. METHODS Between December 1, 2020, and April 30, 2021, a cross-sectional survey was completed by 3666 radiology residents in China. We used multivariable logistic regression models to examine factors and associations, reporting odds ratios (ORs) and 95% CIs. RESULTS In summary, radiology residents generally hold a positive attitude toward AI, with 29.90% (1096/3666) agreeing that AI may reduce the demand for radiologists, 72.80% (2669/3666) believing AI improves disease diagnosis, and 78.18% (2866/3666) feeling that radiologists should embrace AI. Several associated factors, including age, gender, education, region, eye strain, working hours, time spent on medical images, resilience, burnout, AI experience, and perceptions of residency support and stress, significantly influence AI attitudes. For instance, burnout symptoms were associated with greater concerns about AI replacement (OR 1.89; P<.001), less favorable views on AI usefulness (OR 0.77; P=.005), and reduced willingness to use AI (OR 0.71; P<.001). Moreover, after adjusting for all other factors, perceived AI replacement (OR 0.81; P<.001) and AI usefulness (OR 5.97; P<.001) were shown to significantly impact the intention to use AI. CONCLUSIONS This study profiles radiology residents who are accepting of AI. Our comprehensive findings provide insights for a multidimensional approach to help physicians adapt to AI. Targeted policies, such as digital health care initiatives and medical education, can be developed accordingly.
Collapse
Affiliation(s)
- Yanhua Chen
- Vanke School of Public Health, Tsinghua University, Beijing, China
- School of Medicine, Tsinghua University, Beijing, China
| | - Ziye Wu
- Vanke School of Public Health, Tsinghua University, Beijing, China
| | - Peicheng Wang
- Vanke School of Public Health, Tsinghua University, Beijing, China
- School of Medicine, Tsinghua University, Beijing, China
| | - Linbo Xie
- Vanke School of Public Health, Tsinghua University, Beijing, China
- School of Medicine, Tsinghua University, Beijing, China
| | - Mengsha Yan
- Vanke School of Public Health, Tsinghua University, Beijing, China
| | - Maoqing Jiang
- Department of Radiology, Ningbo No. 2 Hospital, Ningbo, China
| | - Zhenghan Yang
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Jianjun Zheng
- Department of Radiology, Ningbo No. 2 Hospital, Ningbo, China
| | - Jingfeng Zhang
- Department of Radiology, Ningbo No. 2 Hospital, Ningbo, China
| | - Jiming Zhu
- Vanke School of Public Health, Tsinghua University, Beijing, China
- Institute for Healthy China, Tsinghua University, Beijing, China
| |
Collapse
|
10
|
Becker M. How to prepare for a bright future of radiology in Europe. Insights Imaging 2023; 14:168. [PMID: 37816908 PMCID: PMC10564684 DOI: 10.1186/s13244-023-01525-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 09/16/2023] [Indexed: 10/12/2023] Open
Abstract
Because artificial intelligence (AI)-powered algorithms allow automated image analysis in a growing number of diagnostic scenarios, some healthcare stakeholders have raised doubts about the future of the entire radiologic profession. Their view disregards not only the role of radiologists in the diagnostic service chain beyond reporting, but also the many multidisciplinary and patient-related consulting tasks for which radiologists are solicited. The time commitment for these non-reporting tasks is considerable but difficult to quantify and often impossible to fulfil considering the current mismatch between workload and workforce in many countries. Nonetheless, multidisciplinary, and patient-centred consulting activities could move up on radiologists' agendas as soon as AI-based tools can save time in daily routine. Although there are many reasons why AI will assist and not replace radiologists as imaging experts in the future, it is important to position the next generation of European radiologists in view of this expected trend. To ensure radiologists' personal professional recognition and fulfilment in multidisciplinary environments, the focus of training should go beyond diagnostic reporting, concentrating on clinical backgrounds, specific communication skills with referrers and patients, and integration of imaging findings with those of other disciplines. Close collaboration between the European Society of Radiology (ESR) and European national radiologic societies can help to achieve these goals. Although each adequate treatment begins with a correct diagnosis, many health politicians see radiologic procedures mainly as a cost factor. Radiologic research should, therefore, increasingly investigate the imaging impact on treatment and outcome rather than focusing mainly on technical improvements and diagnostic accuracy alone.Critical relevance statement Strategies are presented to prepare for a successful future of the radiologic profession in Europe, if AI-powered tools can alleviate the current reporting overload: engaging in multidisciplinary activities (clinical and integrative diagnostics), enhancing the value and recognition of radiologists' role through clinical expertise, focusing radiological research on the impact on diagnosis and outcome, and promoting patient-centred radiology by enhancing communication skills.Key points • AI-powered tools will not replace radiologists but hold promise to reduce the current reporting burden, enabling them to reinvest liberated time in multidisciplinary clinical and patient-related tasks.• The skills and resources for these tasks should be considered when recruiting and teaching the next generation of radiologists, when organising departments and planning staffing.• Communication skills will play an increasing role in both multidisciplinary activities and patient-centred radiology.• The value and importance of a correct and integrative diagnosis and the cost of an incorrect imaging diagnosis should be emphasised when discussing with non-medical stakeholders in healthcare.• The radiologic community in Europe should start now to prepare for a bright future of the profession for the benefit of patients and medical colleagues alike.
Collapse
Affiliation(s)
- Minerva Becker
- Unit of Head and Neck and Maxilofacial Radiology, Division of Radiology, Diagnostic Department, Geneva University Hospitals, University of Geneva, Rue Gabrielle Perret Gentil 4, Geneva 14, CH 1211, Switzerland.
| |
Collapse
|
11
|
Hameed MY, Al-Hindi L, Ali S, Jensen HK, Shoults CC. Broadening the Understanding of Medical Students' Discussion of Radiology Online: A Social Listening Study of Reddit. Curr Probl Diagn Radiol 2023; 52:377-382. [PMID: 37179205 DOI: 10.1067/j.cpradiol.2023.04.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2023] [Accepted: 04/13/2023] [Indexed: 05/15/2023]
Abstract
Reddit.com contains one of the largest online social forums for medical students, the 'r/medicalschool' subreddit. The platform provides an opportunity to share news and discuss a variety of topics including specialty choice and residency applications. In this study we analyze posts on the subreddit r/medicalschool with the aim of understanding how medical students perceive radiology as a career and what factors influence their decision to pursue radiology. Reddit posts to were collected from the r/medicalschool subreddit (2009-2022) and a randomized sample of the corpus was labeled to yield 2000 posts that discussed radiology as career and 1542 posts not discussing radiology. Sentiment analysis of the labeled corpus was conducted using the SiEBRT RoBERTa transformer sentiment pipeline, a machine trained English language text analyzer. Student's t-test was used to compare sentiment of posts discussing radiology to nonradiology posts by career keywords. Posts discussing radiology as a career had an overall positive sentiment but were lower than nonradiology posts' sentiment (p<.001). Key words associated with a positive sentiment score were "procedure", "lifestyle", "income", "fit", "personality", "anatomy", "tech", "physics", "research," and "match." Negative sentiment score included key words "AI", "burnout", "culture", "job market", "midlevel", "sue", "teleradiology." "Procedures" had the most positive sentiment score, while "AI" had the most negative score. Our study highlights aspects of radiology as a career that are discussed positively and negatively on Reddit. These posts are read by medical students around the world and may influence their choice of specialty.
Collapse
Affiliation(s)
- Muhammad Y Hameed
- College of Medicine, University of Arkansas for Medical Sciences, Little Rock, AR.
| | - Layth Al-Hindi
- College of Medicine, University of Arkansas for Medical Sciences, Little Rock, AR.
| | - Sumera Ali
- Department of Radiology, University of Arkansas for Medical Sciences, Little Rock, AR.
| | - Hanna K Jensen
- Department of Radiology, University of Arkansas for Medical Sciences, Little Rock, AR.
| | - Catherine C Shoults
- Department of Biomedical Informatics, University of Arkansas for Medical Sciences, Little Rock, AR.
| |
Collapse
|
12
|
Alvarado R. AI as an Epistemic Technology. SCIENCE AND ENGINEERING ETHICS 2023; 29:32. [PMID: 37603120 DOI: 10.1007/s11948-023-00451-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 07/12/2023] [Indexed: 08/22/2023]
Abstract
In this paper I argue that Artificial Intelligence and the many data science methods associated with it, such as machine learning and large language models, are first and foremost epistemic technologies. In order to establish this claim, I first argue that epistemic technologies can be conceptually and practically distinguished from other technologies in virtue of what they are designed for, what they do and how they do it. I then proceed to show that unlike other kinds of technology (including other epistemic technologies) AI can be uniquely positioned as an epistemic technology in that it is primarily designed, developed and deployed to be used in epistemic contexts such as inquiry, it is specifically designed, developed and deployed to manipulate epistemic content such as data, and it is designed, developed and deployed to do so particularly through epistemic operations such as prediction and analysis. As has been shown in recent work in the philosophy and ethics of AI (Alvarado, AI and Ethics, 2022a), understanding AI as an epistemic technology will also have significant implications for important debates regarding our relationship to AI technologies. This paper includes a brief overview of such implications, particularly those pertaining to explainability, opacity, trust and even epistemic harms related to AI technologies.
Collapse
Affiliation(s)
- Ramón Alvarado
- Philosophy Department, University of Oregon, Eugene, OR, USA.
| |
Collapse
|
13
|
Ayad N, Schwendicke F, Krois J, van den Bosch S, Bergé S, Bohner L, Hanisch M, Vinayahalingam S. Patients' perspectives on the use of artificial intelligence in dentistry: a regional survey. Head Face Med 2023; 19:23. [PMID: 37349791 PMCID: PMC10288769 DOI: 10.1186/s13005-023-00368-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2023] [Accepted: 06/13/2023] [Indexed: 06/24/2023] Open
Abstract
The use of artificial intelligence (AI) in dentistry is rapidly evolving and could play a major role in a variety of dental fields. This study assessed patients' perceptions and expectations regarding AI use in dentistry. An 18-item questionnaire survey focused on demographics, expectancy, accountability, trust, interaction, advantages and disadvantages was responded to by 330 patients; 265 completed questionnaires were included in this study. Frequencies and differences between age groups were analysed using a two-sided chi-squared or Fisher's exact tests with Monte Carlo approximation. Patients' perceived top three disadvantages of AI use in dentistry were (1) the impact on workforce needs (37.7%), (2) new challenges on doctor-patient relationships (36.2%) and (3) increased dental care costs (31.7%). Major expected advantages were improved diagnostic confidence (60.8%), time reduction (48.3%) and more personalised and evidencebased disease management (43.0%). Most patients expected AI to be part of the dental workflow in 1-5 (42.3%) or 5-10 (46.8%) years. Older patients (> 35 years) expected higher AI performance standards than younger patients (18-35 years) (p < 0.05). Overall, patients showed a positive attitude towards AI in dentistry. Understanding patients' perceptions may allow professionals to shape AI-driven dentistry in the future.
Collapse
Affiliation(s)
- Nasim Ayad
- Department of Oral and Maxillofacial Surgery, Hospital University Münster, 48149 Münster, Germany
| | - Falk Schwendicke
- Department of Oral Diagnostics and Digital Health and Health Services Research, Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität Zu Berlin, Aßmannshauser Str. 4-6, 14197 Berlin, Germany
| | - Joachim Krois
- Department of Oral Diagnostics and Digital Health and Health Services Research, Charité—Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt-Universität Zu Berlin, Aßmannshauser Str. 4-6, 14197 Berlin, Germany
| | - Stefanie van den Bosch
- Department of Oral and Maxillofacial Surgery, Radboud University Nijmegen Medical Centre, P.O. Box 9101, 6500 HB Nijmegen, the Netherlands
| | - Stefaan Bergé
- Department of Oral and Maxillofacial Surgery, Radboud University Nijmegen Medical Centre, P.O. Box 9101, 6500 HB Nijmegen, the Netherlands
| | - Lauren Bohner
- Department of Oral and Maxillofacial Surgery, Hospital University Münster, 48149 Münster, Germany
| | - Marcel Hanisch
- Department of Oral and Maxillofacial Surgery, Hospital University Münster, 48149 Münster, Germany
| | - Shankeeth Vinayahalingam
- Department of Oral and Maxillofacial Surgery, Hospital University Münster, 48149 Münster, Germany
- Department of Oral and Maxillofacial Surgery, Radboud University Nijmegen Medical Centre, P.O. Box 9101, 6500 HB Nijmegen, the Netherlands
| |
Collapse
|
14
|
Mirkin S, Albensi BC. Should artificial intelligence be used in conjunction with Neuroimaging in the diagnosis of Alzheimer's disease? Front Aging Neurosci 2023; 15:1094233. [PMID: 37187577 PMCID: PMC10177660 DOI: 10.3389/fnagi.2023.1094233] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Accepted: 03/27/2023] [Indexed: 05/17/2023] Open
Abstract
Alzheimer's disease (AD) is a progressive, neurodegenerative disorder that affects memory, thinking, behavior, and other cognitive functions. Although there is no cure, detecting AD early is important for the development of a therapeutic plan and a care plan that may preserve cognitive function and prevent irreversible damage. Neuroimaging, such as magnetic resonance imaging (MRI), computed tomography (CT), and positron emission tomography (PET), has served as a critical tool in establishing diagnostic indicators of AD during the preclinical stage. However, as neuroimaging technology quickly advances, there is a challenge in analyzing and interpreting vast amounts of brain imaging data. Given these limitations, there is great interest in using artificial Intelligence (AI) to assist in this process. AI introduces limitless possibilities in the future diagnosis of AD, yet there is still resistance from the healthcare community to incorporate AI in the clinical setting. The goal of this review is to answer the question of whether AI should be used in conjunction with neuroimaging in the diagnosis of AD. To answer the question, the possible benefits and disadvantages of AI are discussed. The main advantages of AI are its potential to improve diagnostic accuracy, improve the efficiency in analyzing radiographic data, reduce physician burnout, and advance precision medicine. The disadvantages include generalization and data shortage, lack of in vivo gold standard, skepticism in the medical community, potential for physician bias, and concerns over patient information, privacy, and safety. Although the challenges present fundamental concerns and must be addressed when the time comes, it would be unethical not to use AI if it can improve patient health and outcome.
Collapse
Affiliation(s)
- Sophia Mirkin
- Dr. Kiran C. Patel College of Osteopathic Medicine, Nova Southeastern University, Fort Lauderdale, FL, United States
| | - Benedict C. Albensi
- Barry and Judy Silverman College of Pharmacy, Nova Southeastern University, Fort Lauderdale, FL, United States
- St. Boniface Hospital Research, Winnipeg, MB, Canada
- University of Manitoba, Winnipeg, MB, Canada
| |
Collapse
|
15
|
Perchik JD, Rothenberg SA, Tridandapani S, Perchik LM, Smith AD. Artificial Intelligence in Body Imaging: An Overview of Commercially Available Tools. Semin Roentgenol 2023; 58:196-202. [PMID: 37087140 DOI: 10.1053/j.ro.2023.02.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2022] [Revised: 02/18/2023] [Accepted: 02/23/2023] [Indexed: 03/29/2023]
|
16
|
Affiliation(s)
| | - Athena Ko
- University of Ottawa, Department of Psychiatry, Ottawa, ON, Canada
| |
Collapse
|
17
|
Santomartino SM, Yi PH. Systematic Review of Radiologist and Medical Student Attitudes on the Role and Impact of AI in Radiology. Acad Radiol 2022; 29:1748-1756. [PMID: 35105524 DOI: 10.1016/j.acra.2021.12.032] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2021] [Revised: 12/30/2021] [Accepted: 12/30/2021] [Indexed: 12/28/2022]
Abstract
RATIONALE AND OBJECTIVES The introduction of AI in radiology has prompted both excitement and hesitation within the field. We performed a systematic review of original studies evaluating the attitudes of radiologists, radiology trainees, and medical students towards AI in radiology. MATERIALS AND METHODS We searched PubMed for studies published as of August 24, 2021 for original studies evaluating attitudes of radiologists (attendings and trainees) and medical students towards AI in radiology. We summarized the baseline article characteristics and performed thematic analysis of the questions asked in each study. RESULTS Nineteen studies were included evaluating attitudes across different levels of training (medical students, radiology trainees, and radiology attendings) with representation from nearly every continent. Medical students and radiologists alike favored increased educational initiatives, and displayed interest in learning about and implementing AI solutions themselves, despite reporting of a current gap in formal AI training. There was general optimism about the role of AI in radiology, although radiologists and trainees had greater consensus than medical students. CONCLUSION Although there is interest in incorporating AI into medical education and optimism among radiologists towards AI, medical students are more divided in their views. We propose that outreach to and AI education for medical students may help improve their attitudes towards the potentially transformative technology of AI for radiology.
Collapse
Affiliation(s)
- Samantha M Santomartino
- Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland Medical Intelligent Imaging (UM2ii) Center, University of Maryland School of Medicine, Baltimore, Maryland
| | - Paul H Yi
- Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland Medical Intelligent Imaging (UM2ii) Center, University of Maryland School of Medicine, Baltimore, Maryland; Malone Center for Engineering in Healthcare, Johns Hopkins University, Baltimore, Maryland.
| |
Collapse
|
18
|
Pecqueux M, Riediger C, Distler M, Oehme F, Bork U, Kolbinger FR, Schöffski O, van Wijngaarden P, Weitz J, Schweipert J, Kahlert C. The use and future perspective of Artificial Intelligence-A survey among German surgeons. Front Public Health 2022; 10:982335. [PMID: 36276381 PMCID: PMC9580562 DOI: 10.3389/fpubh.2022.982335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Accepted: 09/05/2022] [Indexed: 01/25/2023] Open
Abstract
Purpose Clinical abundance of artificial intelligence has increased significantly in the last decade. This survey aims to provide an overview of the current state of knowledge and acceptance of AI applications among surgeons in Germany. Methods A total of 357 surgeons from German university hospitals, academic teaching hospitals and private practices were contacted by e-mail and asked to participate in the anonymous survey. Results A total of 147 physicians completed the survey. The majority of respondents (n = 85, 52.8%) stated that they were familiar with AI applications in medicine. Personal knowledge was self-rated as average (n = 67, 41.6%) or rudimentary (n = 60, 37.3%) by the majority of participants. On the basis of various application scenarios, it became apparent that the respondents have different demands on AI applications in the area of "diagnosis confirmation" as compared to the area of "therapy decision." For the latter category, the requirements in terms of the error level are significantly higher and more respondents view their application in medical practice rather critically. Accordingly, most of the participants hope that AI systems will primarily improve diagnosis confirmation, while they see their ethical and legal problems with regard to liability as the main obstacle to extensive clinical application. Conclusion German surgeons are in principle positively disposed toward AI applications. However, many surgeons see a deficit in their own knowledge and in the implementation of AI applications in their own professional environment. Accordingly, medical education programs targeting both medical students and healthcare professionals should convey basic knowledge about the development and clinical implementation process of AI applications in different medical fields, including surgery.
Collapse
Affiliation(s)
- Mathieu Pecqueux
- Department of Visceral, Thoracic and Vascular Surgery, University Hospital Carl Gustav Carus Dresden, Technische Universität Dresden, National Center for Tumor Diseases Dresden (NCT/UCC), Dresden, Germany
| | - Carina Riediger
- Department of Visceral, Thoracic and Vascular Surgery, University Hospital Carl Gustav Carus Dresden, Technische Universität Dresden, National Center for Tumor Diseases Dresden (NCT/UCC), Dresden, Germany
| | - Marius Distler
- Department of Visceral, Thoracic and Vascular Surgery, University Hospital Carl Gustav Carus Dresden, Technische Universität Dresden, National Center for Tumor Diseases Dresden (NCT/UCC), Dresden, Germany
| | - Florian Oehme
- Department of Visceral, Thoracic and Vascular Surgery, University Hospital Carl Gustav Carus Dresden, Technische Universität Dresden, National Center for Tumor Diseases Dresden (NCT/UCC), Dresden, Germany
| | - Ulrich Bork
- Department of Visceral, Thoracic and Vascular Surgery, University Hospital Carl Gustav Carus Dresden, Technische Universität Dresden, National Center for Tumor Diseases Dresden (NCT/UCC), Dresden, Germany
| | - Fiona R. Kolbinger
- Department of Visceral, Thoracic and Vascular Surgery, University Hospital Carl Gustav Carus Dresden, Technische Universität Dresden, National Center for Tumor Diseases Dresden (NCT/UCC), Dresden, Germany
- Else Kröner Fresenius Center for Digital Health (EKFZ) Dresden, Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, National Center for Tumor Diseases Dresden (NCT/UCC), Dresden, Germany
| | - Oliver Schöffski
- Chair of Health Management, Friedrich-Alexander-Universität Erlangen-Nürnberg, Nürnberg, Germany
| | - Peter van Wijngaarden
- Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, Melbourne, VIC, Australia
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, VIC, Australia
| | - Jürgen Weitz
- Department of Visceral, Thoracic and Vascular Surgery, University Hospital Carl Gustav Carus Dresden, Technische Universität Dresden, National Center for Tumor Diseases Dresden (NCT/UCC), Dresden, Germany
- German Cancer Consortium (DKTK), Partner Site Dresden, German Cancer Research Center (DKFZ), National Center for Tumor Diseases Dresden (NCT/UCC), Heidelberg, Germany
| | - Johannes Schweipert
- Department of Visceral, Thoracic and Vascular Surgery, University Hospital Carl Gustav Carus Dresden, Technische Universität Dresden, National Center for Tumor Diseases Dresden (NCT/UCC), Dresden, Germany
| | - Christoph Kahlert
- Department of Visceral, Thoracic and Vascular Surgery, University Hospital Carl Gustav Carus Dresden, Technische Universität Dresden, National Center for Tumor Diseases Dresden (NCT/UCC), Dresden, Germany
- German Cancer Consortium (DKTK), Partner Site Dresden, German Cancer Research Center (DKFZ), National Center for Tumor Diseases Dresden (NCT/UCC), Heidelberg, Germany
| |
Collapse
|
19
|
Bell RJ. Changes to health screening - we need to remain vigilant. Climacteric 2022; 25:319-320. [PMID: 35801652 DOI: 10.1080/13697137.2022.2073812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
|
20
|
Mulryan P, Ni Chleirigh N, O'Mahony AT, Crowley C, Ryan D, McLaughlin P, McEntee M, Maher M, O'Connor OJ. An evaluation of information online on artificial intelligence in medical imaging. Insights Imaging 2022; 13:79. [PMID: 35467250 PMCID: PMC9038977 DOI: 10.1186/s13244-022-01209-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Accepted: 03/12/2022] [Indexed: 08/24/2023] Open
Abstract
Background Opinions seem somewhat divided when considering the effect of artificial intelligence (AI) on medical imaging. The aim of this study was to characterise viewpoints presented online relating to the impact of AI on the field of radiology and to assess who is engaging in this discourse.
Methods Two search methods were used to identify online information relating to AI and radiology. Firstly, 34 terms were searched using Google and the first two pages of results for each term were evaluated. Secondly, a Rich Search Site (RSS) feed evaluated incidental information over 3 weeks. Webpages were evaluated and categorized as having a positive, negative, balanced, or neutral viewpoint based on study criteria. Results Of the 680 webpages identified using the Google search engine, 248 were deemed relevant and accessible. 43.2% had a positive viewpoint, 38.3% a balanced viewpoint, 15.3% a neutral viewpoint, and 3.2% a negative viewpoint. Peer-reviewed journals represented the most common webpage source (48%), followed by media (29%), commercial sources (12%), and educational sources (8%). Commercial webpages had the highest proportion of positive viewpoints (66%). Radiologists were identified as the most common author group (38.9%). The RSS feed identified 177 posts of which were relevant and accessible. 86% of posts were of media origin expressing positive viewpoints (64%). Conclusion The overall opinion of the impact of AI on radiology presented online is a positive one. Consistency across a range of sources and author groups exists. Radiologists were significant contributors to this online discussion and the results may impact future recruitment. Supplementary Information The online version contains supplementary material available at 10.1186/s13244-022-01209-4.
Collapse
Affiliation(s)
- Philip Mulryan
- Cork University Hospital/Mercy University Hospital, Cork, Ireland
| | | | | | - Claire Crowley
- Cork University Hospital/Mercy University Hospital, Cork, Ireland
| | | | | | | | - Michael Maher
- Cork University Hospital/Mercy University Hospital, Cork, Ireland.,University College Cork, Cork, Ireland
| | - Owen J O'Connor
- Cork University Hospital/Mercy University Hospital, Cork, Ireland.,University College Cork, Cork, Ireland
| |
Collapse
|
21
|
Čartolovni A, Tomičić A, Lazić Mosler E. Ethical, legal, and social considerations of AI-based medical decision-support tools: A scoping review. Int J Med Inform 2022; 161:104738. [PMID: 35299098 DOI: 10.1016/j.ijmedinf.2022.104738] [Citation(s) in RCA: 45] [Impact Index Per Article: 22.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Revised: 02/11/2022] [Accepted: 03/10/2022] [Indexed: 10/18/2022]
Abstract
INTRODUCTION Recent developments in the field of Artificial Intelligence (AI) applied to healthcare promise to solve many of the existing global issues in advancing human health and managing global health challenges. This comprehensive review aims not only to surface the underlying ethical and legal but also social implications (ELSI) that have been overlooked in recent reviews while deserving equal attention in the development stage, and certainly ahead of implementation in healthcare. It is intended to guide various stakeholders (eg. designers, engineers, clinicians) in addressing the ELSI of AI at the design stage using the Ethics by Design (EbD) approach. METHODS The authors followed a systematised scoping methodology and searched the following databases: Pubmed, Web of science, Ovid, Scopus, IEEE Xplore, EBSCO Search (Academic Search Premier, CINAHL, PSYCINFO, APA PsycArticles, ERIC) for the ELSI of AI in healthcare through January 2021. Data were charted and synthesised, and the authors conducted a descriptive and thematic analysis of the collected data. RESULTS After reviewing 1108 papers, 94 were included in the final analysis. Our results show a growing interest in the academic community for ELSI in the field of AI. The main issues of concern identified in our analysis fall into four main clusters of impact: AI algorithms, physicians, patients, and healthcare in general. The most prevalent issues are patient safety, algorithmic transparency, lack of proper regulation, liability & accountability, impact on patient-physician relationship and governance of AI empowered healthcare. CONCLUSIONS The results of our review confirm the potential of AI to significantly improve patient care, but the drawbacks to its implementation relate to complex ELSI that have yet to be addressed. Most ELSI refer to the impact on and extension of the reciprocal and fiduciary patient-physician relationship. With the integration of AIbased decision making tools, a bilateral patient-physician relationship may shift into a trilateral one.
Collapse
Affiliation(s)
- Anto Čartolovni
- Digital Healthcare Ethics Laboratory (Digit-HeaL), Catholic University of Croatia, Ilica 242, 10 000 Zagreb, Croatia; School of Medicine, Catholic University of Croatia, Ilica 242, 10 000 Zagreb, Croatia.
| | - Ana Tomičić
- Digital Healthcare Ethics Laboratory (Digit-HeaL), Catholic University of Croatia, Ilica 242, 10 000 Zagreb, Croatia.
| | - Elvira Lazić Mosler
- School of Medicine, Catholic University of Croatia, Ilica 242, 10 000 Zagreb, Croatia; General Hospital Dr. Ivo Pedišić, Sisak, Croatia.
| |
Collapse
|
22
|
The current state of knowledge on imaging informatics: a survey among Spanish radiologists. Insights Imaging 2022; 13:34. [PMID: 35235068 PMCID: PMC8891400 DOI: 10.1186/s13244-022-01164-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2021] [Accepted: 01/22/2022] [Indexed: 11/22/2022] Open
Abstract
Background There is growing concern about the impact of artificial intelligence (AI) on radiology and the future of the profession. The aim of this study is to evaluate general knowledge and concerns about trends on imaging informatics among radiologists working in Spain (residents and attending physicians). For this purpose, an online survey among radiologists working in Spain was conducted with questions related to: knowledge about terminology and technologies, need for a regulated academic training on AI and concerns about the implications of the use of these technologies. Results A total of 223 radiologists answered the survey, of whom 76.7% were attending physicians and 23.3% residents. General terms such as AI and algorithm had been heard of or read in at least 75.8% and 57.4% of the cases, respectively, while more specific terms were scarcely known. All the respondents consider that they should pursue academic training in medical informatics and new technologies, and 92.9% of them reckon this preparation should be incorporated in the training program of the specialty. Patient safety was found to be the main concern for 54.2% of the respondents. Job loss was not seen as a peril by 45.7% of the participants.
Conclusions Although there is a lack of knowledge about AI among Spanish radiologists, there is a will to explore such topics and a general belief that radiologists should be trained in these matters. Based on the results, a consensus is needed to change the current training curriculum to better prepare future radiologists.
Collapse
|
23
|
Yang L, Ene IC, Arabi Belaghi R, Koff D, Stein N, Santaguida PL. Stakeholders' perspectives on the future of artificial intelligence in radiology: a scoping review. Eur Radiol 2022; 32:1477-1495. [PMID: 34545445 DOI: 10.1007/s00330-021-08214-z] [Citation(s) in RCA: 29] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Revised: 06/11/2021] [Accepted: 07/12/2021] [Indexed: 12/31/2022]
Abstract
OBJECTIVES Artificial intelligence (AI) has the potential to impact clinical practice and healthcare delivery. AI is of particular significance in radiology due to its use in automatic analysis of image characteristics. This scoping review examines stakeholder perspectives on AI use in radiology, the benefits, risks, and challenges to its integration. METHODS A search was conducted from 1960 to November 2019 in EMBASE, PubMed/MEDLINE, Web of Science, Cochrane Library, CINAHL, and grey literature. Publications reflecting stakeholder attitudes toward AI were included with no restrictions. RESULTS Commentaries (n = 32), surveys (n = 13), presentation abstracts (n = 8), narrative reviews (n = 8), and a social media study (n = 1) were included from 62 eligible publications. These represent the views of radiologists, surgeons, medical students, patients, computer scientists, and the general public. Seven themes were identified (predicted impact, potential replacement, trust in AI, knowledge of AI, education, economic considerations, and medicolegal implications). Stakeholders anticipate a significant impact on radiology, though replacement of radiologists is unlikely in the near future. Knowledge of AI is limited for non-computer scientists and further education is desired. Many expressed the need for collaboration between radiologists and AI specialists to successfully improve patient care. CONCLUSIONS Stakeholder views generally suggest that AI can improve the practice of radiology and consider the replacement of radiologists unlikely. Most stakeholders identified the need for education and training on AI, as well as collaborative efforts to improve AI implementation. Further research is needed to gain perspectives from non-Western countries, non-radiologist stakeholders, on economic considerations, and medicolegal implications. KEY POINTS Stakeholders generally expressed that AI alone cannot be used to replace radiologists. The scope of practice is expected to shift with AI use affecting areas from image interpretation to patient care. Patients and the general public do not know how to address potential errors made by AI systems while radiologists believe that they should be "in-the-loop" in terms of responsibility. Ethical accountability strategies must be developed across governance levels. Students, residents, and radiologists believe that there is a lack in AI education during medical school and residency. The radiology community should work with IT specialists to ensure that AI technology benefits their work and centres patients.
Collapse
Affiliation(s)
- Ling Yang
- McMaster University, 1280 Main St W, Hamilton, ON, L8S 4L8, Canada
| | - Ioana Cezara Ene
- McMaster University, 1280 Main St W, Hamilton, ON, L8S 4L8, Canada
| | - Reza Arabi Belaghi
- University of Tabriz, 29 Bahman Boulevard, Tabriz, East Azerbaijan Province, Iran
| | - David Koff
- Department of Radiology, McMaster University, 1280 Main St W, Hamilton, ON, L8S 4L8, Canada
| | - Nina Stein
- McMaster Children's Hospital, McMaster University, 1280 Main St W, Hamilton, ON, L8N 3Z5, Canada
| | | |
Collapse
|
24
|
Spilseth B, McKnight CD, Li MD, Park CJ, Fried JG, Yi PH, Brian JM, Lehman CD, Wang XJ, Phalke V, Pakkal M, Baruah D, Khine PP, Fajardo LL. AUR-RRA Review: Logistics of Academic-Industry Partnerships in Artificial Intelligence. Acad Radiol 2022; 29:119-128. [PMID: 34561163 DOI: 10.1016/j.acra.2021.08.002] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2021] [Revised: 07/29/2021] [Accepted: 08/07/2021] [Indexed: 12/27/2022]
Abstract
The Radiology Research Alliance (RRA) of the Association of University Radiologists (AUR) convenes Task Forces to address current topics in radiology. In this article, the AUR-RRA Task Force on Academic-Industry Partnerships for Artificial Intelligence, considered issues of importance to academic radiology departments contemplating industry partnerships in artificial intelligence (AI) development, testing and evaluation. Our goal was to create a framework encompassing the domains of clinical, technical, regulatory, legal and financial considerations that impact the arrangement and success of such partnerships.
Collapse
Affiliation(s)
- Benjamin Spilseth
- Department of Radiology, University of Minnesota Medical School, Minneapolis, Minnesota
| | - Colin D McKnight
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, Tennessee
| | - Matthew D Li
- Department of Radiology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts
| | - Christian J Park
- Department of Radiology, Penn State Health, Milton S. Hershey Center, Hershey, Pennsylvania
| | - Jessica G Fried
- Department of Radiology, University of Michigan, Ann Arbor, Michigan
| | - Paul H Yi
- Department of Radiology and Diagnostic Imaging, University of Maryland Intelligent Imaging (UMII) Center, University of Maryland School of Medicine & Malone Center for Engineering in Healthcare, Johns Hopkins University Whiting School of Engineering, Baltimore, Maryland
| | - James M Brian
- Department of Radiology, Penn State Health, Penn State Children's Hospital, Penn State Milton S. Hershey Medical Center, Hershey, Pennsylvania
| | - Constance D Lehman
- Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts
| | | | - Vaishali Phalke
- Department of Radiology, University of Florida, Gainesville, Florida
| | - Mini Pakkal
- Department of Radiology, University of Toronto, Toronto, Canada
| | - Dhiraj Baruah
- Department of Radiology and Radiological Science; Medical University of South Carolina, Charleston, South Carolina
| | - Pwint Phyu Khine
- Penn State Health Milton S. Hershey Medical Center, Hershey, PA, USA
| | - Laurie L Fajardo
- Department of Radiology and Radiological Sciences, University of Utah, 1950 Circle of Hope - 3rd floor Breast Imaging Clinic, Salt Lake City, UT 84112.
| |
Collapse
|
25
|
Lidströmer N, Aresu F, Ashrafian H. Introductory Approaches for Applying Artificial Intelligence in Clinical Medicine. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_18] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
26
|
Rainey C, O'Regan T, Matthew J, Skelton E, Woznitza N, Chu KY, Goodman S, McConnell J, Hughes C, Bond R, McFadden S, Malamateniou C. Beauty Is in the AI of the Beholder: Are We Ready for the Clinical Integration of Artificial Intelligence in Radiography? An Exploratory Analysis of Perceived AI Knowledge, Skills, Confidence, and Education Perspectives of UK Radiographers. Front Digit Health 2021; 3:739327. [PMID: 34859245 PMCID: PMC8631824 DOI: 10.3389/fdgth.2021.739327] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2021] [Accepted: 10/19/2021] [Indexed: 12/19/2022] Open
Abstract
Introduction: The use of artificial intelligence (AI) in medical imaging and radiotherapy has been met with both scepticism and excitement. However, clinical integration of AI is already well-underway. Many authors have recently reported on the AI knowledge and perceptions of radiologists/medical staff and students however there is a paucity of information regarding radiographers. Published literature agrees that AI is likely to have significant impact on radiology practice. As radiographers are at the forefront of radiology service delivery, an awareness of the current level of their perceived knowledge, skills, and confidence in AI is essential to identify any educational needs necessary for successful adoption into practice. Aim: The aim of this survey was to determine the perceived knowledge, skills, and confidence in AI amongst UK radiographers and highlight priorities for educational provisions to support a digital healthcare ecosystem. Methods: A survey was created on Qualtrics® and promoted via social media (Twitter®/LinkedIn®). This survey was open to all UK radiographers, including students and retired radiographers. Participants were recruited by convenience, snowball sampling. Demographic information was gathered as well as data on the perceived, self-reported, knowledge, skills, and confidence in AI of respondents. Insight into what the participants understand by the term “AI” was gained by means of a free text response. Quantitative analysis was performed using SPSS® and qualitative thematic analysis was performed on NVivo®. Results: Four hundred and eleven responses were collected (80% from diagnostic radiography and 20% from a radiotherapy background), broadly representative of the workforce distribution in the UK. Although many respondents stated that they understood the concept of AI in general (78.7% for diagnostic and 52.1% for therapeutic radiography respondents, respectively) there was a notable lack of sufficient knowledge of AI principles, understanding of AI terminology, skills, and confidence in the use of AI technology. Many participants, 57% of diagnostic and 49% radiotherapy respondents, do not feel adequately trained to implement AI in the clinical setting. Furthermore 52% and 64%, respectively, said they have not developed any skill in AI whilst 62% and 55%, respectively, stated that there is not enough AI training for radiographers. The majority of the respondents indicate that there is an urgent need for further education (77.4% of diagnostic and 73.9% of therapeutic radiographers feeling they have not had adequate training in AI), with many respondents stating that they had to educate themselves to gain some basic AI skills. Notable correlations between confidence in working with AI and gender, age, and highest qualification were reported. Conclusion: Knowledge of AI terminology, principles, and applications by healthcare practitioners is necessary for adoption and integration of AI applications. The results of this survey highlight the perceived lack of knowledge, skills, and confidence for radiographers in applying AI solutions but also underline the need for formalised education on AI to prepare the current and prospective workforce for the upcoming clinical integration of AI in healthcare, to safely and efficiently navigate a digital future. Focus should be given on different needs of learners depending on age, gender, and highest qualification to ensure optimal integration.
Collapse
Affiliation(s)
- Clare Rainey
- Faculty of Life and Health Sciences, School of Health Sciences, Ulster University, Newtownabbey, United Kingdom
| | - Tracy O'Regan
- The Society and College of Radiographers, London, United Kingdom
| | - Jacqueline Matthew
- School of Biomedical Engineering and Imaging Sciences, King's College London, St Thomas' Hospital, London, United Kingdom
| | - Emily Skelton
- School of Biomedical Engineering and Imaging Sciences, King's College London, St Thomas' Hospital, London, United Kingdom.,Department of Radiography, Division of Midwifery and Radiography, School of Health Sciences, University of London, London, United Kingdom
| | - Nick Woznitza
- University College London Hospitals, London, United Kingdom.,School of Allied and Public Health Professions, Canterbury Christ Church University, Canterbury, United Kingdom
| | - Kwun-Ye Chu
- Department of Oncology, Oxford Institute for Radiation Oncology, University of Oxford, Oxford, United Kingdom.,Radiotherapy Department, Churchill Hospital, Oxford University Hospitals NHS FT, Oxford, United Kingdom
| | - Spencer Goodman
- The Society and College of Radiographers, London, United Kingdom
| | | | - Ciara Hughes
- Faculty of Life and Health Sciences, School of Health Sciences, Ulster University, Newtownabbey, United Kingdom
| | - Raymond Bond
- Faculty of Computing, Engineering and the Built Environment, School of Computing, Ulster University, Newtownabbey, United Kingdom
| | - Sonyia McFadden
- Faculty of Life and Health Sciences, School of Health Sciences, Ulster University, Newtownabbey, United Kingdom
| | - Christina Malamateniou
- School of Biomedical Engineering and Imaging Sciences, King's College London, St Thomas' Hospital, London, United Kingdom.,Department of Radiography, Division of Midwifery and Radiography, School of Health Sciences, University of London, London, United Kingdom
| |
Collapse
|
27
|
Prakash AV, Das S. Medical practitioner's adoption of intelligent clinical diagnostic decision support systems: A mixed-methods study. INFORMATION & MANAGEMENT 2021. [DOI: 10.1016/j.im.2021.103524] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
28
|
Bhandari A, Purchuri SN, Sharma C, Ibrahim M, Prior M. Knowledge and attitudes towards artificial intelligence in imaging: a look at the quantitative survey literature. Clin Imaging 2021; 80:413-419. [PMID: 34537484 DOI: 10.1016/j.clinimag.2021.08.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 07/31/2021] [Accepted: 08/05/2021] [Indexed: 10/20/2022]
Abstract
RATIONALE AND OBJECTIVES There exists many single sample perspectives on artificial intelligence (AI). The aim of this review was to collate the current data on attitudes/knowledge towards AI in three unique populations: medical students, clinicians and patients. MATERIALS AND METHODS A literature search was performed on PubMed, Scopus and Web of Science pertaining to survey data on AI in radiology. Quality assessment was performed by an adapted version of the assessment tool from the National Heart, Lung and Blood Institute for Observational Studies. RESULTS Fourteen studies were found on attitudes/knowledge towards AI in radiology. Four studies examined medical students, seven on clinicians and three on patient populations. Deficiencies in the literature mainly related to sampling bias. Students had anxiety relating to future job prospects. Clinicians were optimistic and viewed AI as an aid to the diagnosis and wanted to further their knowledge. Patients were concerned about the lack of human interaction and accountability during error. CONCLUSION Attitudes and knowledge regarding AI in radiology remains a topic that needs to be researched further and education given pertaining to its use in a clinical setting.
Collapse
Affiliation(s)
- Abhishta Bhandari
- Townsville University Hospital, 100 Angus Smith Drive, Douglas, Townsville, QLD, Australia.
| | | | - Chinmay Sharma
- Townsville University Hospital, 100 Angus Smith Drive, Douglas, Townsville, QLD, Australia
| | - Muhammad Ibrahim
- Townsville University Hospital, 100 Angus Smith Drive, Douglas, Townsville, QLD, Australia
| | - Marita Prior
- Royal Brisbane and Women's Hospital, Herston, Queensland, Australia
| |
Collapse
|
29
|
Freeman K, Geppert J, Stinton C, Todkill D, Johnson S, Clarke A, Taylor-Phillips S. Use of artificial intelligence for image analysis in breast cancer screening programmes: systematic review of test accuracy. BMJ 2021; 374:n1872. [PMID: 34470740 PMCID: PMC8409323 DOI: 10.1136/bmj.n1872] [Citation(s) in RCA: 103] [Impact Index Per Article: 34.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Abstract
OBJECTIVE To examine the accuracy of artificial intelligence (AI) for the detection of breast cancer in mammography screening practice. DESIGN Systematic review of test accuracy studies. DATA SOURCES Medline, Embase, Web of Science, and Cochrane Database of Systematic Reviews from 1 January 2010 to 17 May 2021. ELIGIBILITY CRITERIA Studies reporting test accuracy of AI algorithms, alone or in combination with radiologists, to detect cancer in women's digital mammograms in screening practice, or in test sets. Reference standard was biopsy with histology or follow-up (for screen negative women). Outcomes included test accuracy and cancer type detected. STUDY SELECTION AND SYNTHESIS Two reviewers independently assessed articles for inclusion and assessed the methodological quality of included studies using the QUality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool. A single reviewer extracted data, which were checked by a second reviewer. Narrative data synthesis was performed. RESULTS Twelve studies totalling 131 822 screened women were included. No prospective studies measuring test accuracy of AI in screening practice were found. Studies were of poor methodological quality. Three retrospective studies compared AI systems with the clinical decisions of the original radiologist, including 79 910 women, of whom 1878 had screen detected cancer or interval cancer within 12 months of screening. Thirty four (94%) of 36 AI systems evaluated in these studies were less accurate than a single radiologist, and all were less accurate than consensus of two or more radiologists. Five smaller studies (1086 women, 520 cancers) at high risk of bias and low generalisability to the clinical context reported that all five evaluated AI systems (as standalone to replace radiologist or as a reader aid) were more accurate than a single radiologist reading a test set in the laboratory. In three studies, AI used for triage screened out 53%, 45%, and 50% of women at low risk but also 10%, 4%, and 0% of cancers detected by radiologists. CONCLUSIONS Current evidence for AI does not yet allow judgement of its accuracy in breast cancer screening programmes, and it is unclear where on the clinical pathway AI might be of most benefit. AI systems are not sufficiently specific to replace radiologist double reading in screening programmes. Promising results in smaller studies are not replicated in larger studies. Prospective studies are required to measure the effect of AI in clinical practice. Such studies will require clear stopping rules to ensure that AI does not reduce programme specificity. STUDY REGISTRATION Protocol registered as PROSPERO CRD42020213590.
Collapse
Affiliation(s)
- Karoline Freeman
- Division of Health Sciences, University of Warwick, Coventry, UK
| | - Julia Geppert
- Division of Health Sciences, University of Warwick, Coventry, UK
| | - Chris Stinton
- Division of Health Sciences, University of Warwick, Coventry, UK
| | - Daniel Todkill
- Division of Health Sciences, University of Warwick, Coventry, UK
| | - Samantha Johnson
- Division of Health Sciences, University of Warwick, Coventry, UK
| | - Aileen Clarke
- Division of Health Sciences, University of Warwick, Coventry, UK
| | | |
Collapse
|
30
|
Shlivko IL, Garanina OY, Klemenova IA, Uskova KA, Mironycheva AM, Dardyk VI, Laskov VN. Artificial intelligence: how it works and criteria for assessment. CONSILIUM MEDICUM 2021. [DOI: 10.26442/20751753.2021.8.201148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Artificial intelligence is a term used to describe computer technology in the modeling of intelligent behavior and critical thinking comparable to that of humans. To date, some of the first areas of medicine to be influenced by advances in artificial intelligence technologies will be those most dependent on imaging. These include ophthalmology, radiology, and dermatology. In connection with the emergence of numerous medical applications, scientists have formulated criteria for their assessment. This list included: clinical validation, regular application updates, functional focus, cost, availability of an information block for specialists and patients, compliance with the conditions of government regulation, and registration. One of the applications that meet all the requirements is the ProRodinki software package, developed for use by patients and specialists in the Russian Federation. Taking into account a widespread and rapidly developing competitive environment, it is necessary to soberly treat the resources of such applications, not exaggerating their capabilities and not considering them as a substitute for a specialist.
Collapse
|
31
|
Thrall JH, Fessell D, Pandharipande PV. Rethinking the Approach to Artificial Intelligence for Medical Image Analysis: The Case for Precision Diagnosis. J Am Coll Radiol 2021; 18:174-179. [PMID: 33413896 DOI: 10.1016/j.jacr.2020.07.010] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2020] [Accepted: 07/07/2020] [Indexed: 02/08/2023]
Abstract
To date, widely generalizable artificial intelligence (AI) programs for medical image analysis have not been demonstrated, including for mammography. Rather than pursuing a strategy of collecting ever-larger databases in the attempt to build generalizable programs, we suggest three possible avenues for exploring a precision medicine or precision imaging approach. First, it is now technologically feasible to collect hundreds of thousands of multi-institutional cases along with other patient data, allowing stratification of patients into subpopulations that have similar characteristics in the manner discussed by the National Research Council in its white paper on precision medicine. A family of AI programs could be developed across different examination types that are matched to specific patient subpopulations. Such stratification can help address bias, including racial or ethnic bias, by allowing unbiased data aggregation for creation of subpopulations. Second, for common examinations, larger institutions may be able to collect enough of their own data to train AI programs that reflect disease prevalence and variety in their respective unique patient subpopulations. Third, high- and low-probability subpopulations can be identified by application of AI programs, thereby allowing their triage off the radiology work list. This would reduce radiologists' workloads, providing more time for interpretation of the remaining examinations. For high-volume procedures, investigators should come together to define reference standards, collect data, and compare the merits of pursuing generalizability versus a precision medicine subpopulation-based strategy.
Collapse
Affiliation(s)
- James H Thrall
- Chair Emeritus, Department of Radiology, Massachusetts General Hospital, Boston, Massachusetts.
| | - David Fessell
- Associate Professor, Department of Radiology, University of Michigan, Ann Arbor, Michigan
| | - Pari V Pandharipande
- Director, MGH Institute for Technology Assessment; Associate Chair, Integrated Imaging & Imaging Sciences, MGH Radiology; Executive Director, Clinical Enterprise Integration, Mass General Brigham (MGB) Radiology, Boston, Massachusetts
| |
Collapse
|
32
|
Kapoor N, Lacson R, Khorasani R. Workflow Applications of Artificial Intelligence in Radiology and an Overview of Available Tools. J Am Coll Radiol 2021; 17:1363-1370. [PMID: 33153540 DOI: 10.1016/j.jacr.2020.08.016] [Citation(s) in RCA: 29] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2020] [Revised: 08/21/2020] [Accepted: 08/25/2020] [Indexed: 12/18/2022]
Abstract
In the past decade, there has been tremendous interest in applying artificial intelligence (AI) to improve the field of radiology. Currently, numerous AI applications are in development, with potential benefits spanning all steps of the imaging chain from test ordering to report communication. AI has been proposed as a means to optimize patient scheduling, improve worklist management, enhance image acquisition, and help radiologists interpret diagnostic studies. Although the potential for AI in radiology appears almost endless, the field is still in the early stages, with many uses still theoretical, in development, or limited to single institutions. Moreover, although the current use of AI in radiology has emphasized its clinical applications, some of which are in the distant future, it is increasingly clear that AI algorithms could also be used in the more immediate future for a variety of noninterpretive and quality improvement uses. Such uses include the integration of AI into electronic health record systems to reduce unwarranted variation in radiologists' follow-up recommendations and to improve other dimensions of radiology report quality. In the end, the potential of AI in radiology must be balanced with acknowledgment of its current limitations regarding generalizability and data privacy.
Collapse
Affiliation(s)
- Neena Kapoor
- Director of Diversity, Inclusion, and Equity, Department of Radiology, Brigham and Women's Hospital; Quality and Patient Safety Officer, Department of Radiology, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts.
| | - Ronilda Lacson
- Director of Education, Center for Evidence-Based Imaging, Brigham and Women's Hospital; Director of Clinical Informatics, Harvard Medical School Library of Evidence, Boston, Massachusetts
| | - Ramin Khorasani
- Director of the Center of Evidence Imaging and Vice Chair of Quality/Safety, Department of Radiology, Center for Evidence Based Imaging, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|
33
|
Wadden JJ. What Kind of Artificial Intelligence Should We Want for Use in Healthcare
Decision-Making Applications? CANADIAN JOURNAL OF BIOETHICS 2021. [DOI: 10.7202/1077636ar] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
The prospect of including artificial intelligence (AI) in clinical decision-making
is an exciting next step for some areas of healthcare. This article provides an analysis of
the available kinds of AI systems, focusing on macro-level characteristics. This includes
examining the strengths and weaknesses of opaque systems and fully explainable systems.
Ultimately, the article argues that “grey box” systems, which include some combination of
opacity and transparency, ought to be used in healthcare settings.
Collapse
Affiliation(s)
- Jordan Joseph Wadden
- Department of Philosophy, University of British Columbia, Vancouver,
Canada
- Ethics Services, Providence Health Care, British Columbia, Canada
| |
Collapse
|
34
|
Pai VV, Pai RB. Artificial intelligence in dermatology and healthcare: An overview. Indian J Dermatol Venereol Leprol 2021; 87:457-467. [PMID: 34114421 DOI: 10.25259/ijdvl_518_19] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2019] [Accepted: 12/01/2020] [Indexed: 12/15/2022]
Abstract
Many aspects of our life are affected by technology. One of the most discussed advancements of modern technologies is artificial intelligence. It involves computational methods which in some way mimic the human thought process. Just like other branches, the medical field also has come under the ambit of artificial intelligence. Almost every field in medicine has been touched by its effect in one way or the other. Prominent among them are medical diagnosis, medical statistics, robotics, and human biology. Medical imaging is one of the foremost specialties with artificial intelligence applications, wherein deep learning methods like artificial neural networks are commonly used. artificial intelligence application in dermatology was initially restricted to the analysis of melanoma and pigmentary skin lesions, has now expanded and covers many dermatoses. Though the applications of artificial intelligence are ever increasing, large data requirements, interpretation of data and ethical concerns are some of its limitations in the present day.
Collapse
Affiliation(s)
| | - Rohini Bhat Pai
- Department of Anaesthesiology, Goa Medical College, Bambolim, Goa, India
| |
Collapse
|
35
|
Kim JY, Kim D, Jeon KJ, Kim H, Huh JK. Using deep learning to predict temporomandibular joint disc perforation based on magnetic resonance imaging. Sci Rep 2021; 11:6680. [PMID: 33758266 PMCID: PMC7988137 DOI: 10.1038/s41598-021-86115-3] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2020] [Accepted: 03/08/2021] [Indexed: 12/22/2022] Open
Abstract
The goal of this study was to develop a deep learning-based algorithm to predict temporomandibular joint (TMJ) disc perforation based on the findings of magnetic resonance imaging (MRI) and to validate its performance through comparison with previously reported results. The study objects were obtained by reviewing medical records from January 2005 to June 2018. 299 joints from 289 patients were divided into perforated and non-perforated groups based on the existence of disc perforation confirmed during surgery. Experienced observers interpreted the TMJ MRI images to extract features. Data containing those features were applied to build and validate prediction models using random forest and multilayer perceptron (MLP) techniques, the latter using the Keras framework, a recent deep learning architecture. The area under the receiver operating characteristic (ROC) curve (AUC) was used to compare the performances of the models. MLP produced the best performance (AUC 0.940), followed by random forest (AUC 0.918) and disc shape alone (AUC 0.791). The MLP and random forest were also superior to previously reported results using MRI (AUC 0.808) and MRI-based nomogram (AUC 0.889). Implementing deep learning showed superior performance in predicting disc perforation in TMJ compared to conventional methods and previous reports.
Collapse
Affiliation(s)
- Jae-Young Kim
- Department of Oral and Maxillofacial Surgery, Gangnam Severance Hospital, Yonsei University College of Dentistry, Seoul, Republic of Korea
| | - Dongwook Kim
- Department of Oral and Maxillofacial Surgery, Yonsei University College of Dentistry, Seoul, Republic of Korea
| | - Kug Jin Jeon
- Department of Oral and Maxillofacial Radiology, Yonsei University College of Dentistry, Seoul, Republic of Korea
| | - Hwiyoung Kim
- Department of Radiological Science, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Jong-Ki Huh
- Department of Oral and Maxillofacial Surgery, Gangnam Severance Hospital, Yonsei University College of Dentistry, 211 Eonju-ro, Gangnam-gu, Seoul, 06273, Republic of Korea.
| |
Collapse
|
36
|
Scheetz J, Rothschild P, McGuinness M, Hadoux X, Soyer HP, Janda M, Condon JJJ, Oakden-Rayner L, Palmer LJ, Keel S, van Wijngaarden P. A survey of clinicians on the use of artificial intelligence in ophthalmology, dermatology, radiology and radiation oncology. Sci Rep 2021; 11:5193. [PMID: 33664367 PMCID: PMC7933437 DOI: 10.1038/s41598-021-84698-5] [Citation(s) in RCA: 84] [Impact Index Per Article: 28.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2020] [Accepted: 02/12/2021] [Indexed: 12/13/2022] Open
Abstract
Artificial intelligence technology has advanced rapidly in recent years and has the potential to improve healthcare outcomes. However, technology uptake will be largely driven by clinicians, and there is a paucity of data regarding the attitude that clinicians have to this new technology. In June-August 2019 we conducted an online survey of fellows and trainees of three specialty colleges (ophthalmology, radiology/radiation oncology, dermatology) in Australia and New Zealand on artificial intelligence. There were 632 complete responses (n = 305, 230, and 97, respectively), equating to a response rate of 20.4%, 5.1%, and 13.2% for the above colleges, respectively. The majority (n = 449, 71.0%) believed artificial intelligence would improve their field of medicine, and that medical workforce needs would be impacted by the technology within the next decade (n = 542, 85.8%). Improved disease screening and streamlining of monotonous tasks were identified as key benefits of artificial intelligence. The divestment of healthcare to technology companies and medical liability implications were the greatest concerns. Education was identified as a priority to prepare clinicians for the implementation of artificial intelligence in healthcare. This survey highlights parallels between the perceptions of different clinician groups in Australia and New Zealand about artificial intelligence in medicine. Artificial intelligence was recognized as valuable technology that will have wide-ranging impacts on healthcare.
Collapse
Affiliation(s)
- Jane Scheetz
- Level 7, Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, 32 Gisborne Street, Melbourne, VIC, 3002, Australia
| | - Philip Rothschild
- Level 7, Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, 32 Gisborne Street, Melbourne, VIC, 3002, Australia
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, Australia
| | - Myra McGuinness
- Level 7, Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, 32 Gisborne Street, Melbourne, VIC, 3002, Australia
- Centre for Epidemiology and Biostatistics, Melbourne School of Population and Global Health, University of Melbourne, Melbourne, Australia
| | - Xavier Hadoux
- Level 7, Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, 32 Gisborne Street, Melbourne, VIC, 3002, Australia
| | - H Peter Soyer
- Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia
- Dermatology Department, Princess Alexandra Hospital, Brisbane, QLD, Australia
| | - Monika Janda
- Centre for Health Services Research, The University of Queensland, Brisbane, Australia
| | - James J J Condon
- School of Public Health, University of Adelaide, Adelaide, Australia
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, Australia
| | - Luke Oakden-Rayner
- School of Public Health, University of Adelaide, Adelaide, Australia
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, Australia
| | - Lyle J Palmer
- School of Public Health, University of Adelaide, Adelaide, Australia
- Australian Institute for Machine Learning, University of Adelaide, Adelaide, Australia
| | - Stuart Keel
- Level 7, Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, 32 Gisborne Street, Melbourne, VIC, 3002, Australia
| | - Peter van Wijngaarden
- Level 7, Centre for Eye Research Australia, Royal Victorian Eye and Ear Hospital, 32 Gisborne Street, Melbourne, VIC, 3002, Australia.
- Ophthalmology, Department of Surgery, University of Melbourne, Melbourne, Australia.
| |
Collapse
|
37
|
Chan HP, Hadjiiski LM, Samala RK. Computer-aided diagnosis in the era of deep learning. Med Phys 2021; 47:e218-e227. [PMID: 32418340 DOI: 10.1002/mp.13764] [Citation(s) in RCA: 99] [Impact Index Per Article: 33.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2019] [Revised: 05/13/2019] [Accepted: 05/13/2019] [Indexed: 12/15/2022] Open
Abstract
Computer-aided diagnosis (CAD) has been a major field of research for the past few decades. CAD uses machine learning methods to analyze imaging and/or nonimaging patient data and makes assessment of the patient's condition, which can then be used to assist clinicians in their decision-making process. The recent success of the deep learning technology in machine learning spurs new research and development efforts to improve CAD performance and to develop CAD for many other complex clinical tasks. In this paper, we discuss the potential and challenges in developing CAD tools using deep learning technology or artificial intelligence (AI) in general, the pitfalls and lessons learned from CAD in screening mammography and considerations needed for future implementation of CAD or AI in clinical use. It is hoped that the past experiences and the deep learning technology will lead to successful advancement and lasting growth in this new era of CAD, thereby enabling CAD to deliver intelligent aids to improve health care.
Collapse
Affiliation(s)
- Heang-Ping Chan
- Department of Radiology, University of Michigan, Ann Arbor, MI, 48109-5842, USA
| | - Lubomir M Hadjiiski
- Department of Radiology, University of Michigan, Ann Arbor, MI, 48109-5842, USA
| | - Ravi K Samala
- Department of Radiology, University of Michigan, Ann Arbor, MI, 48109-5842, USA
| |
Collapse
|
38
|
Ahmad R. Reviewing the relationship between machines and radiology: the application of artificial intelligence. Acta Radiol Open 2021; 10:2058460121990296. [PMID: 33623711 PMCID: PMC7876935 DOI: 10.1177/2058460121990296] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Accepted: 01/07/2021] [Indexed: 12/13/2022] Open
Abstract
Background The scope and productivity of artificial intelligence applications in health
science and medicine, particularly in medical imaging, are rapidly
progressing, with relatively recent developments in big data and deep
learning and increasingly powerful computer algorithms. Accordingly, there
are a number of opportunities and challenges for the radiological
community. Purpose To provide review on the challenges and barriers experienced in diagnostic
radiology on the basis of the key clinical applications of machine learning
techniques. Material and Methods Studies published in 2010–2019 were selected that report on the efficacy of
machine learning models. A single contingency table was selected for each
study to report the highest accuracy of radiology professionals and machine
learning algorithms, and a meta-analysis of studies was conducted based on
contingency tables. Results The specificity for all the deep learning models ranged from 39% to 100%,
whereas sensitivity ranged from 85% to 100%. The pooled sensitivity and
specificity were 89% and 85% for the deep learning algorithms for detecting
abnormalities compared to 75% and 91% for radiology experts, respectively.
The pooled specificity and sensitivity for comparison between radiology
professionals and deep learning algorithms were 91% and 81% for deep
learning models and 85% and 73% for radiology professionals (p < 0.000),
respectively. The pooled sensitivity detection was 82% for health-care
professionals and 83% for deep learning algorithms (p < 0.005). Conclusion Radiomic information extracted through machine learning programs form images
that may not be discernible through visual examination, thus may improve the
prognostic and diagnostic value of data sets.
Collapse
Affiliation(s)
- Rani Ahmad
- King Abdulaziz University, King Abdulaziz University Hospital, Jeddah, Saudi Arabia
| |
Collapse
|
39
|
Introductory Approaches for Applying Artificial Intelligence in Clinical Medicine. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-58080-3_18-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
40
|
Bin Dahmash A, Alabdulkareem M, Alfutais A, Kamel AM, Alkholaiwi F, Alshehri S, Al Zahrani Y, Almoaiqel M. Artificial intelligence in radiology: does it impact medical students preference for radiology as their future career? BJR Open 2020; 2:20200037. [PMID: 33367198 PMCID: PMC7748985 DOI: 10.1259/bjro.20200037] [Citation(s) in RCA: 21] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2020] [Revised: 09/02/2020] [Accepted: 09/08/2020] [Indexed: 01/19/2023] Open
Abstract
Objective To test medical students' perceptions of the impact of artificial intelligence (AI) on radiology and the influence of these perceptions on their choice of radiology as a lifetime career. Methods A cross-sectional multicenter survey of medical students in Saudi Arabia was conducted in April 2019. Results Of the 476 respondents, 34 considered radiology their first specialty choice, 26 considered it their second choice, and 65 considered it their third choice. Only 31% believed that AI would replace radiologists in their lifetime, while 44.8% believed that AI would minimize the number of radiologists needed in the future. Approximately 50% believed they had a good understanding of AI; however, when knowledge of AI was tested using five questions, on average, only 22% of the questions were answered correctly. Among the respondents who ranked radiology as their first choice, 58.8% were anxious about the uncertain impact of AI on radiology. The number of respondents who ranked radiology as one of their top three choices increased by 14 when AI was not a consideration. Radiology conferences and the opinions of radiologists had the most influence on the respondents' preferences for radiology. Conclusion The worry that AI might displace radiologists in the future had a negative influence on medical students' consideration of radiology as a career. Academic radiologists are encouraged to educate their students about AI and its potential impact when students are considering radiology as a lifetime career choice. Advances in knowledge Rapid advances of AI in radiology will certainly impact the specialty, the concern of AI impact on radiology had negative influence in our participants and investing in AI education and is highly recommended.
Collapse
Affiliation(s)
| | - Mohammed Alabdulkareem
- Neuroradiology Division, Department of Medical Imaging, King Abdulaziz Medical City & King Abdullah Specialized Children's Hospital, Ministry of National Guard-Health Affairs, Riyadh, Saudi Arabia
| | - Aljabriyah Alfutais
- Vascular and Interventional Radiology Unit, Department of Medical Imaging, King Abdulaziz Medical City & King Abdullah Specialized Children's Hospital, Ministry of National Guard-Health Affairs, Riyadh, Saudi Arabia
| | - Ahmed M Kamel
- Department of Clinical Pharmacy, Faculty of Pharmacy, Cairo University, Cairo, Egypt
| | - Feras Alkholaiwi
- College of Medicine, Imam Mohammad ibn Saud Islamic University, Riyadh, Saudi Arabia
| | - Shaker Alshehri
- Vascular and Interventional Radiology Unit, Department of Medical Imaging, King Abdulaziz Medical City & King Abdullah Specialized Children's Hospital, Ministry of National Guard-Health Affairs, Riyadh, Saudi Arabia
| | - Yousof Al Zahrani
- Vascular and Interventional Radiology Unit, Department of Medical Imaging, King Abdulaziz Medical City & King Abdullah Specialized Children's Hospital, Ministry of National Guard-Health Affairs, Riyadh, Saudi Arabia
| | - Mohammed Almoaiqel
- Vascular and Interventional Radiology Unit, Department of Medical Imaging, King Abdulaziz Medical City & King Abdullah Specialized Children's Hospital, Ministry of National Guard-Health Affairs, Riyadh, Saudi Arabia
| |
Collapse
|
41
|
Social media's role in the perception of radiologists and artificial intelligence. Clin Imaging 2020; 68:158-160. [DOI: 10.1016/j.clinimag.2020.06.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2020] [Revised: 05/11/2020] [Accepted: 06/01/2020] [Indexed: 11/23/2022]
|
42
|
Lucini FR, dos Reis MA, da Silveira GJC, Fogliatto FS, Anzanello MJ, Andrioli GG, Nicolaidis R, Beltrame RCF, Neyeloff JL, Schaan BD. Man vs. machine: Predicting hospital bed demand from an emergency department. PLoS One 2020; 15:e0237937. [PMID: 32853217 PMCID: PMC7451657 DOI: 10.1371/journal.pone.0237937] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2020] [Accepted: 08/05/2020] [Indexed: 11/19/2022] Open
Abstract
Background The recent literature reports promising results from using intelligent systems to support decision making in healthcare operations. Using these systems may lead to improved diagnostic and treatment protocols and to predict hospital bed demand. Predicting hospital bed demand in emergency department (ED) attendances could help resource allocation and reduce pressure on busy hospitals. However, there is still limited knowledge on whether intelligent systems can operate as fully autonomous, user-independent systems. Objective Compare the performance of a computer-based algorithm and humans in predicting hospital bed demand (admissions and discharges) based on the initial SOAP (Subjective, Objective, Assessment, Plan) records of the ED. Methods This was a retrospective cohort study that compared the performance of humans and machines in predicting hospital bed demand from an ED. It considered electronic medical records (EMR) of 9030 patients (230 used as a testing set, and hence evaluated both by humans and by an algorithm, and 8800 used as a training set exclusively by the algorithm) who visited the ED of a tertiary care and teaching public hospital located in Porto Alegre, Brazil between January and December 2014. The machine role was played by Support Vector Machine Classifier and the human prediction was performed by four ED physicians. Predictions were compared in terms of sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve (AUROC). Results All graders achieved similar accuracies. The accuracy by AUROC for the testing set was 0.82 [95% confidence interval (CI) of 0.77–0.87], 0.80 (95% CI: 0.75–0.85), 0.76 (95% CI: 0.71–0.81) for novice physicians, machine, experienced physicians, respectively. Processing time per test EMR was 0.00812±0.0009 seconds. In contrast, novice physicians took on average 156.80 seconds per test EMR, while experienced physicians took on average 56.40 seconds per test EMR. Conclusions Our data indicated that the system could predict patient admission or discharge states with 80% accuracy, which was similar the performance of novice and experienced physicians. These results suggested that the algorithm could operate as an autonomous and independent system to complete this task.
Collapse
Affiliation(s)
- Filipe Rissieri Lucini
- Department of Critical Care Medicine, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
- Data Intelligence for Health Lab, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| | - Mateus Augusto dos Reis
- Hospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- Department of Internal Medicine, Faculty of Medicine, Postgraduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- * E-mail:
| | | | - Flavio Sanson Fogliatto
- Industrial Engineering Department, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Michel José Anzanello
- Industrial Engineering Department, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Giordanna Guerra Andrioli
- Hospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Rafael Nicolaidis
- Hospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | | | - Jeruza Lavanholi Neyeloff
- Hospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| | - Beatriz D'Agord Schaan
- Hospital de Clínicas de Porto Alegre, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
- Department of Internal Medicine, Faculty of Medicine, Postgraduate Program in Medical Sciences: Endocrinology, Universidade Federal do Rio Grande do Sul, Porto Alegre, RS, Brazil
| |
Collapse
|
43
|
Tajaldeen A, Alghamdi S. Evaluation of radiologist's knowledge about the Artificial Intelligence in diagnostic radiology: a survey-based study. Acta Radiol Open 2020; 9:2058460120945320. [PMID: 32821436 PMCID: PMC7412626 DOI: 10.1177/2058460120945320] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2020] [Accepted: 07/02/2020] [Indexed: 12/31/2022] Open
Abstract
Background Advanced developments in diagnostic radiology have provided a rapid increase in the number of radiological investigations worldwide. Recently, Artificial Intelligence (AI) has been applied in diagnostic radiology. The purpose of developing such applications is to clinically validate and make them feasible for the current practice of diagnostic radiology, in which there is less time for diagnosis. Purpose To assess radiologists’ knowledge about AI’s role and establish a baseline to help in providing educational activities on AI in diagnostic radiology in Saudi Arabia. Material and Methods An online questionnaire was designed using QuestionPro software. The study was conducted in large hospitals located in different regions in Saudi Arabia. A total of 93 participants completed the questionnaire, of which 32 (34%) were trainee radiologists from year 1 to year 4 (R1–R4) of the residency programme, 33 (36%) were radiologists and fellows, and 28 (30%) were consultants. Results The responses to the question related to the use of AI on a daily basis illustrated that 76 (82%) of the participants were not using any AI software at all during daily interpretation of diagnostic images. Only 17 (18%) reported that they used AI software for diagnostic radiology. Conclusion There is a significant lack of knowledge about AI in our residency programme and radiology departments at hospitals. Due to the rapid development of AI and its application in diagnostic radiology, there is an urgent need to enhance awareness about its role in different diagnostic fields.
Collapse
Affiliation(s)
- Abdulrahman Tajaldeen
- Radiological Science Department, College of Applied Medical Science, Imam Abdulrahman Bin Faisal University, Dammam, Saudi Arabia
| | - Salem Alghamdi
- Department of Medical Imaging and Radiation Sciences, Collage of Applied Medical Sciences, University of Jeddah, Jeddah, Saudi Arabia
| |
Collapse
|
44
|
Banja J. AI Hype and Radiology: A Plea for Realism and Accuracy. Radiol Artif Intell 2020; 2:e190223. [PMID: 33937835 PMCID: PMC8082301 DOI: 10.1148/ryai.2020190223] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2019] [Revised: 01/11/2020] [Accepted: 01/27/2020] [Indexed: 11/11/2022]
Affiliation(s)
- John Banja
- From the Center for Ethics, Emory University, 1531 Dickey Dr, Atlanta, GA 30322
| |
Collapse
|
45
|
Yun D, Xiang Y, Liu Z, Lin D, Zhao L, Guo C, Xie P, Lin H, Liu Y, Zou Y, Wu X. Attitudes towards medical artificial intelligence talent cultivation: an online survey study. ANNALS OF TRANSLATIONAL MEDICINE 2020; 8:708. [PMID: 32617328 PMCID: PMC7327345 DOI: 10.21037/atm.2019.12.149] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Background To investigate the attitude and formal suggestions on talent cultivation in the field of medical artificial intelligence (AI). Methods An electronic questionnaire was sent to both medical-related field or non-medical field population using the WenJuanXing web-application via social media. The questionnaire was designed to collect: (I) demographic information; (II) perception of medical AI; (III) willingness to participate in the medical AI related teaching activities; (IV) teaching content of medical AI; (V) the role of medical AI teaching; (VI) future career planning. Respondents’ anonymity was ensured. Results A total of 710 respondents provided valid answers to the questionnaire (57.75% medical related, 42.25% non-medical). About 73.8% of respondents acquired related information from network and social platform. More than half the respondents had basic perception of AI applicational scenarios and specialties in medicine, meanwhile were willing to participate in related general science activities (conference and lectures). Respondents from medical healthcare related fields, with high academic qualifications of male ones demonstrated showed significant better understanding and stronger willingness (P<0.05). The majority agreed medical AI courses should be set as major elective (42.82%) during undergraduate stages (89.58%) involving medical and computer science contents. An overwhelming majority of respondents (>80%) acknowledged the potential roles of medical AI teaching. Surgeon, ophthalmologist, physicians and researchers are the top tier considerations for ideal career regardless of AI influence. Radiology and clinical laboratory subjects are more preferred considering the development of medical AI (P>0.05). Conclusions The potential role of medical AI talent cultivation is widely acknowledged by public. Medical related professions demonstrated higher level of perception and stronger willingness for medical AI educational events. Merging subjects as radiology and clinical laboratory subjects are preferred with broad talents demands and bright prospects.
Collapse
Affiliation(s)
- Dongyuan Yun
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| | - Yifan Xiang
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| | - Zhenzhen Liu
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| | - Duoru Lin
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| | - Lanqin Zhao
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| | - Chong Guo
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| | - Peichen Xie
- Zhongshan School of Medicine, Sun Yat-sen University, Guangzhou, China
| | - Haotian Lin
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China.,Center for Precision Medicine, Sun Yat-sen University, Guangzhou, China
| | - Yizhi Liu
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| | - Yuxian Zou
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| | - Xiaohang Wu
- State Key Laboratory of Ophthalmology, Zhongshan Ophthalmic Center, Sun Yat-sen University, Guangzhou, China
| |
Collapse
|
46
|
Implementation of artificial intelligence (AI) applications in radiology: hindering and facilitating factors. Eur Radiol 2020; 30:5525-5532. [PMID: 32458173 PMCID: PMC7476917 DOI: 10.1007/s00330-020-06946-y] [Citation(s) in RCA: 103] [Impact Index Per Article: 25.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2019] [Revised: 04/03/2020] [Accepted: 05/08/2020] [Indexed: 12/22/2022]
Abstract
Objective The objective was to identify barriers and facilitators to the implementation of artificial intelligence (AI) applications in clinical radiology in The Netherlands. Materials and methods Using an embedded multiple case study, an exploratory, qualitative research design was followed. Data collection consisted of 24 semi-structured interviews from seven Dutch hospitals. The analysis of barriers and facilitators was guided by the recently published Non-adoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework for new medical technologies in healthcare organizations. Results Among the most important facilitating factors for implementation were the following: (i) pressure for cost containment in the Dutch healthcare system, (ii) high expectations of AI’s potential added value, (iii) presence of hospital-wide innovation strategies, and (iv) presence of a “local champion.” Among the most prominent hindering factors were the following: (i) inconsistent technical performance of AI applications, (ii) unstructured implementation processes, (iii) uncertain added value for clinical practice of AI applications, and (iv) large variance in acceptance and trust of direct (the radiologists) and indirect (the referring clinicians) adopters. Conclusion In order for AI applications to contribute to the improvement of the quality and efficiency of clinical radiology, implementation processes need to be carried out in a structured manner, thereby providing evidence on the clinical added value of AI applications. Key Points • Successful implementation of AI in radiology requires collaboration between radiologists and referring clinicians. • Implementation of AI in radiology is facilitated by the presence of a local champion. • Evidence on the clinical added value of AI in radiology is needed for successful implementation. Electronic supplementary material The online version of this article (10.1007/s00330-020-06946-y) contains supplementary material, which is available to authorized users.
Collapse
|
47
|
Pesapane F, Tantrige P, Patella F, Biondetti P, Nicosia L, Ianniello A, Rossi UG, Carrafiello G, Ierardi AM. Myths and facts about artificial intelligence: why machine- and deep-learning will not replace interventional radiologists. Med Oncol 2020; 37:40. [DOI: 10.1007/s12032-020-01368-8] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2020] [Accepted: 03/18/2020] [Indexed: 12/13/2022]
|
48
|
Recht MP, Dewey M, Dreyer K, Langlotz C, Niessen W, Prainsack B, Smith JJ. Integrating artificial intelligence into the clinical practice of radiology: challenges and recommendations. Eur Radiol 2020; 30:3576-3584. [PMID: 32064565 DOI: 10.1007/s00330-020-06672-5] [Citation(s) in RCA: 107] [Impact Index Per Article: 26.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2019] [Revised: 12/21/2019] [Accepted: 01/23/2020] [Indexed: 12/31/2022]
Abstract
Artificial intelligence (AI) has the potential to significantly disrupt the way radiology will be practiced in the near future, but several issues need to be resolved before AI can be widely implemented in daily practice. These include the role of the different stakeholders in the development of AI for imaging, the ethical development and use of AI in healthcare, the appropriate validation of each developed AI algorithm, the development of effective data sharing mechanisms, regulatory hurdles for the clearance of AI algorithms, and the development of AI educational resources for both practicing radiologists and radiology trainees. This paper details these issues and presents possible solutions based on discussions held at the 2019 meeting of the International Society for Strategic Studies in Radiology. KEY POINTS: • Radiologists should be aware of the different types of bias commonly encountered in AI studies, and understand their possible effects. • Methods for effective data sharing to train, validate, and test AI algorithms need to be developed. • It is essential for all radiologists to gain an understanding of the basic principles, potentials, and limits of AI.
Collapse
Affiliation(s)
- Michael P Recht
- Department of Radiology, New York University Robert I Grossman School of Medicine, New York, NY, USA.
| | - Marc Dewey
- Charité - Universitätsmedizin Berlin, Humboldt-Universität and Freie Universität zu Berlin, Berlin, Germany
| | - Keith Dreyer
- Department of Radiology, Massachusetts General Hospital, Boston, MA, USA
| | - Curtis Langlotz
- Department of Radiology and Biomedical Informatics, Stanford University, Palo Alto, CA, USA
| | - Wiro Niessen
- Department of Radiology, Erasmus MC, University Medical Center Rotterdam, Rotterdam, The Netherlands
- Faculty of Applied Sciences, Delft University of Technology, Delft, The Netherlands
| | - Barbara Prainsack
- Department of Political Science, University of Vienna, Vienna, Austria
- Department of Global Health & Social Medicine, King's College, London, UK
| | | |
Collapse
|
49
|
Allen B, Dreyer K, McGinty GB. Integrating Artificial Intelligence Into Radiologic Practice: A Look to the Future. J Am Coll Radiol 2020; 17:280-283. [DOI: 10.1016/j.jacr.2019.10.010] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2019] [Accepted: 10/13/2019] [Indexed: 01/12/2023]
|
50
|
Walton DM. Physiotherapy's Place in a Rapidly Changing World: A Pan-Canadian Perspective of Threats Facing Practice from the Physio Moves Canada Project, Part 2. Physiother Can 2020; 72:34-42. [PMID: 34385747 PMCID: PMC8330986 DOI: 10.3138/ptc-2018-0060] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
Abstract
Purpose: In the latter half of 2017, a qualitative exploration of innovations, threats, opportunities, educational priorities, and research needs was conducted by directly engaging 117 physiotherapy (PT) clinicians across Canada. The Physio Moves Canada project was set up to explore, capture, and synthesize the perspectives of academics, front-line clinicians, and administrators on the future of the profession. Method: Participants provided their perceptions of and ideas about the threats expected to face PT practice in the next 5-15 years. The data were collected from a series of nominal-group-technique-based focus groups and one-on-one interviews and then analyzed to condense the ideas generated into themes. Results: Eight themes and 28 sub-themes were identified and are described in a series of three articles. This article, the second, describes the findings identified by the participants on the threats with the following themes: the disruptive role of technology, the influence of changing funding models, and the rapidly changing values and characteristics of PT's consumer base. These themes and their 9 sub-themes suggest that physiotherapists expect a dramatic shift in their practice settings, roles, and patients in the coming years - an outlook for which the profession may not be prepared. Conclusions: The presentation of these perspectives derived from members of the professional community is expected to enable leaders, educators, and regulators to begin to position PT to address the threats to the profession, identify opportunities for professional growth, and ensure the profession remains relevant in a changing society.
Collapse
Affiliation(s)
- David M Walton
- School of Physical Therapy, Western University, London, Ont
| |
Collapse
|