1
|
Krones F, Walker B. From theoretical models to practical deployment: A perspective and case study of opportunities and challenges in AI-driven cardiac auscultation research for low-income settings. PLOS DIGITAL HEALTH 2024; 3:e0000437. [PMID: 39630646 PMCID: PMC11616830 DOI: 10.1371/journal.pdig.0000437] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Accepted: 10/17/2024] [Indexed: 12/07/2024]
Abstract
This article includes a literature review and a case study of artificial intelligence (AI) heart murmur detection models to analyse the opportunities and challenges in deploying AI in cardiovascular healthcare in low- or medium-income countries (LMICs). This study has two parallel components: (1) The literature review assesses the capacity of AI to aid in addressing the observed disparity in healthcare between high- and low-income countries. Reasons for the limited deployment of machine learning models are discussed, as well as model generalisation. Moreover, the literature review discusses how emerging human-centred deployment research is a promising avenue for overcoming deployment barriers. (2) A predictive AI screening model is developed and tested in a case study on heart murmur detection in rural Brazil. Our binary Bayesian ResNet model leverages overlapping log mel spectrograms of patient heart sound recordings and integrates demographic data and signal features via XGBoost to optimise performance. This is followed by a discussion of the model's limitations, its robustness, and the obstacles preventing its practical application. The difficulty with which this model, and other state-of-the-art models, generalise to out-of-distribution data is also discussed. By integrating the results of the case study with those of the literature review, the NASSS framework was applied to evaluate the key challenges in deploying AI-supported heart murmur detection in low-income settings. The research accentuates the transformative potential of AI-enabled healthcare, particularly for affordable point-of-care screening systems in low-income settings. It also emphasises the necessity of effective implementation and integration strategies to guarantee the successful deployment of these technologies.
Collapse
Affiliation(s)
- Felix Krones
- Oxford Internet Institute, University of Oxford, Oxford, United Kingdom
| | - Benjamin Walker
- Mathematical Institute, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
2
|
Dean TB, Seecheran R, Badgett RG, Zackula R, Symons J. Perceptions and attitudes toward artificial intelligence among frontline physicians and physicians' assistants in Kansas: a cross-sectional survey. JAMIA Open 2024; 7:ooae100. [PMID: 39386068 PMCID: PMC11458514 DOI: 10.1093/jamiaopen/ooae100] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Revised: 04/22/2024] [Accepted: 09/12/2024] [Indexed: 10/12/2024] Open
Abstract
Objective This survey aims to understand frontline healthcare professionals' perceptions of artificial intelligence (AI) in healthcare and assess how AI familiarity influences these perceptions. Materials and Methods We conducted a survey from February to March 2023 of physicians and physician assistants registered with the Kansas State Board of Healing Arts. Participants rated their perceptions toward AI-related domains and constructs on a 5-point Likert scale, with higher scores indicating stronger agreement. Two sub-groups were created for analysis to assess the impact of participants' familiarity and experience with AI on the survey results. Results From 532 respondents, key concerns were Perceived Communication Barriers (median = 4.0, IQR = 2.8-4.8), Unregulated Standards (median = 4.0, IQR = 3.6-4.8), and Liability Issues (median = 4.0, IQR = 3.5-4.8). Lower levels of agreement were noted for Trust in AI Mechanisms (median = 3.0, IQR = 2.2-3.4), Perceived Risks of AI (median = 3.2, IQR = 2.6-4.0), and Privacy Concerns (median = 3.3, IQR = 2.3-4.0). Positive correlations existed between Intention to use AI and Perceived Benefits (r = 0.825) and Trust in AI Mechanisms (r = 0.777). Perceived risk negatively correlated with Intention to Use AI (r = -0.718). There was no difference in perceptions between AI experienced and AI naïve subgroups. Discussion The findings suggest that perceptions of benefits, trust, risks, communication barriers, regulation, and liability issues influence healthcare professionals' intention to use AI, regardless of their AI familiarity. Conclusion The study highlights key factors affecting AI adoption in healthcare from the frontline healthcare professionals' perspective. These insights can guide strategies for successful AI implementation in healthcare.
Collapse
Affiliation(s)
- Tanner B Dean
- Department of Internal Medicine, Intermountain Health, Salt Lake City, UT 84120, United States
| | - Rajeev Seecheran
- Department of Internal Medicine, University of New Mexico Health Sciences Center, Albuquerque, NM 87106, United States
| | - Robert G Badgett
- Department of Internal Medicine, University of Kansas School of Medicine—Wichita, Wichita, KS 67214, United States
| | - Rosey Zackula
- Center for Clinical Research—Wichita, University of Kansas School of Medicine—Wichita, Wichita, KS 67214, United States
| | - John Symons
- Center for Cyber Social Dynamics, University of Kansas, Lawrence, KS 66045, United States
| |
Collapse
|
3
|
Badawy W, Shaban M. Exploring geriatric nurses' perspectives on the adoption of AI in elderly care a qualitative study. Geriatr Nurs 2024; 61:41-49. [PMID: 39541631 DOI: 10.1016/j.gerinurse.2024.10.078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Revised: 10/25/2024] [Accepted: 10/28/2024] [Indexed: 11/16/2024]
Abstract
This phenomenological study explored the perspectives of geriatric nurses on the adoption of artificial intelligence (AI) in elderly care. Thematic analysis of semi-structured interviews with 17 nurses revealed perceived benefits, challenges, ethical considerations, and practical implications. Participants acknowledged AI's potential for improving diagnostic accuracy, personalized care, continuous monitoring, and data pattern insights. However, concerns were raised regarding workflow integration, cost barriers, resistance to change, data privacy, diminishment of human elements, and the need for ethical guidelines. A cautious optimism was expressed, emphasizing the importance of addressing practical challenges, maintaining the human touch, and fostering a collaborative approach. The findings highlight the need for comprehensive training, user-centered design, ethical frameworks, and strategies to overcome financial and implementation barriers. Future research should focus on evaluating the impact of AI implementation on patient outcomes and nursing experiences.
Collapse
Affiliation(s)
- Walaa Badawy
- Department of Psychology, College of Education, King Khaled University, Abha, Saudi Arabia.
| | - Mostafa Shaban
- Community Health Nursing Department, College of Nursing, Jouf University, Sakak, Saudi Arabia.
| |
Collapse
|
4
|
Li S, Chen M, Liu PL, Xu J. Following Medical Advice of an AI or a Human Doctor? Experimental Evidence Based on Clinician-Patient Communication Pathway Model. HEALTH COMMUNICATION 2024:1-13. [PMID: 39494686 DOI: 10.1080/10410236.2024.2423114] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/05/2024]
Abstract
Medical large language models are being introduced to the public in collaboration with governments, medical institutions, and artificial intelligence (AI) researchers. However, a crucial question remains: Will patients follow the medical advice provided by AI doctors? The lack of user research makes it difficult to provide definitive answers. Based on the clinician-patient communication pathway model, this study conducted a factorial experiment with a 2 (medical provider, AI vs. human) × 2 (information support, low vs. high) × 2 (response latency, slow vs. fast) between-subjects design (n = 535). The results showed that participants exhibited significantly lower adherence to AI doctors' advice than to human doctors. In addition, the interaction effect suggested that, under the slow-response latency condition, subjects perceived greater health benefits and patient-centeredness from human doctors, while the opposite was observed for AI doctors.
Collapse
Affiliation(s)
- Shuoshuo Li
- School of Media and Communication, Shanghai Jiao Tong University
| | - Meng Chen
- School of Media and Communication, Shanghai Jiao Tong University
| | | | - Jian Xu
- School of Media and Communication, Shanghai Jiao Tong University
| |
Collapse
|
5
|
Ma Y, Zeng Y, Liu T, Sun R, Xiao M, Wang J. Integrating large language models in mental health practice: a qualitative descriptive study based on expert interviews. Front Public Health 2024; 12:1475867. [PMID: 39559378 PMCID: PMC11571062 DOI: 10.3389/fpubh.2024.1475867] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2024] [Accepted: 10/15/2024] [Indexed: 11/20/2024] Open
Abstract
Background Progress in developing artificial intelligence (AI) products represented by large language models (LLMs) such as OpenAI's ChatGPT has sparked enthusiasm for their potential use in mental health practice. However, the perspectives on the integration of LLMs within mental health practice remain an underreported topic. Therefore, this study aimed to explore how mental health and AI experts conceptualize LLMs and perceive the use of integrating LLMs into mental health practice. Method In February-April 2024, online semi-structured interviews were conducted with 21 experts (12 psychiatrists, 7 mental health nurses, 2 researchers in medical artificial intelligence) from four provinces in China, using snowballing and purposive selection sampling. Respondents' discussions about their perspectives and expectations of integrating LLMs in mental health were analyzed with conventional content analysis. Results Four themes and eleven sub-themes emerged from this study. Firstly, participants discussed the (1) practice and application reform brought by LLMs into mental health (fair access to mental health services, enhancement of patient participation, improvement in work efficiency and quality), and then analyzed the (2) technological-mental health gap (misleading information, lack of professional nuance and depth, user risk). Based on these points, they provided a range of (3) prerequisites for the integration of LLMs in mental health (training and competence, guidelines for use and management, patient engagement and transparency) and expressed their (4) expectations for future developments (reasonable allocation of workload, upgrades and revamps of LLMs). Conclusion These findings provide valuable insights into integrating LLMs within mental health practice, offering critical guidance for institutions to effectively implement, manage, and optimize these tools, thereby enhancing the quality and accessibility of mental health services.
Collapse
Affiliation(s)
| | | | | | | | - Mingzhao Xiao
- Department of Nursing, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Jun Wang
- Department of Nursing, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China
| |
Collapse
|
6
|
Allam RM, Abdelfatah D, Khalil MIM, Elsaieed MM, El Desouky ED. Medical students and house officers' perception, attitude and potential barriers towards artificial intelligence in Egypt, cross sectional survey. BMC MEDICAL EDUCATION 2024; 24:1244. [PMID: 39482613 PMCID: PMC11529482 DOI: 10.1186/s12909-024-06201-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/03/2024] [Accepted: 10/15/2024] [Indexed: 11/03/2024]
Abstract
BACKGROUND Artificial intelligence (AI) is one of the sectors of medical research that is expanding the fastest right now in healthcare. AI has rapidly advanced in the field of medicine, helping to treat a variety of illnesses and reducing the number of diagnostic and follow-up errors. OBJECTIVE This study aims to assess the perception and attitude towards artificial intelligence (AI) among medical students & house officers in Egypt. METHODS An online cross-sectional study was done using a questionnaire on the Google Form website. The survey collected demographic data and explored participants' perception, attitude & potential barriers towards AI. RESULTS There are 1,346 responses from Egyptian medical students (25.8%) & house officers (74.2%). Most participants have inadequate perception (76.4%) about the importance and usage of AI in the medical field, while the majority (87.4%) have a negative attitude. Multivariate analysis revealed that age is the only independent predictor of AI perception (AOR = 1.07, 95% CI 1.01-1.13). However, perception level and gender are both independent predictors of attitude towards AI (AOR = 1.93, 95% CI 1.37-2.74 & AOR = 1.80, 95% CI 1.30-2.49, respectively). CONCLUSION The study found that medical students and house officers in Egypt have an overall negative attitude towards the integration of AI technologies in healthcare. Despite the potential benefits of AI-driven digital medicine, most respondents expressed concerns about the practical application of these technologies in the clinical setting. The current study highlights the need to address the concerns of medical students and house officers towards AI integration in Egypt. A multi-pronged approach, including education, targeted training, and addressing specific concerns, is necessary to facilitate the wider adoption of AI-enabled healthcare.
Collapse
Affiliation(s)
- Rasha Mahmoud Allam
- Cancer Epidemiology & Biostatistics Department, National Cancer Institute, Cairo University, Cairo, Egypt
| | - Dalia Abdelfatah
- Cancer Epidemiology & Biostatistics Department, National Cancer Institute, Cairo University, Cairo, Egypt.
| | | | | | - Eman D El Desouky
- Cancer Epidemiology & Biostatistics Department, National Cancer Institute, Cairo University, Cairo, Egypt
| |
Collapse
|
7
|
Tao W, Yang J, Qu X. Utilization of, Perceptions on, and Intention to Use AI Chatbots Among Medical Students in China: National Cross-Sectional Study. JMIR MEDICAL EDUCATION 2024; 10:e57132. [PMID: 39466038 PMCID: PMC11533383 DOI: 10.2196/57132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Revised: 06/23/2024] [Accepted: 08/15/2024] [Indexed: 10/29/2024]
Abstract
Background Artificial intelligence (AI) chatbots are poised to have a profound impact on medical education. Medical students, as early adopters of technology and future health care providers, play a crucial role in shaping the future of health care. However, little is known about the utilization of, perceptions on, and intention to use AI chatbots among medical students in China. Objective This study aims to explore the utilization of, perceptions on, and intention to use generative AI chatbots among medical students in China, using the Unified Theory of Acceptance and Use of Technology (UTAUT) framework. By conducting a national cross-sectional survey, we sought to identify the key determinants that influence medical students' acceptance of AI chatbots, thereby providing a basis for enhancing their integration into medical education. Understanding these factors is crucial for educators, policy makers, and technology developers to design and implement effective AI-driven educational tools that align with the needs and expectations of future health care professionals. Methods A web-based electronic survey questionnaire was developed and distributed via social media to medical students across the country. The UTAUT was used as a theoretical framework to design the questionnaire and analyze the data. The relationship between behavioral intention to use AI chatbots and UTAUT predictors was examined using multivariable regression. Results A total of 693 participants were from 57 universities covering 21 provinces or municipalities in China. Only a minority (199/693, 28.72%) reported using AI chatbots for studying, with ChatGPT (129/693, 18.61%) being the most commonly used. Most of the participants used AI chatbots for quickly obtaining medical information and knowledge (631/693, 91.05%) and increasing learning efficiency (594/693, 85.71%). Utilization behavior, social influence, facilitating conditions, perceived risk, and personal innovativeness showed significant positive associations with the behavioral intention to use AI chatbots (all P values were <.05). Conclusions Chinese medical students hold positive perceptions toward and high intentions to use AI chatbots, but there are gaps between intention and actual adoption. This highlights the need for strategies to improve access, training, and support and provide peer usage examples to fully harness the potential benefits of chatbot technology.
Collapse
Affiliation(s)
- Wenjuan Tao
- Institute of Hospital Management, West China Hospital, Sichuan University, No. 37, Guoxue Xiang, Chengdu, 610041, China, 86 13880713452
| | - Jinming Yang
- West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
- Med-X Center for Informatics, Sichuan University, Chengdu, China
| | - Xing Qu
- Institute of Hospital Management, West China Hospital, Sichuan University, No. 37, Guoxue Xiang, Chengdu, 610041, China, 86 13880713452
| |
Collapse
|
8
|
Alves M, Seringa J, Silvestre T, Magalhães T. Use of Artificial Intelligence tools in supporting decision-making in hospital management. BMC Health Serv Res 2024; 24:1282. [PMID: 39456040 PMCID: PMC11515352 DOI: 10.1186/s12913-024-11602-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2024] [Accepted: 09/18/2024] [Indexed: 10/28/2024] Open
Abstract
BACKGROUND The use of Artificial Intelligence (AI) tools in hospital management holds potential for enhancing decision-making processes. This study investigates the current state of decision-making in hospital management, explores the potential benefits of AI integration, and examines hospital managers' perceptions of AI as a decision-support tool. METHODS A descriptive and exploratory study was conducted using a qualitative approach. Data were collected through semi-structured interviews with 15 hospital managers from various departments and institutions. The interviews were transcribed, anonymized, and analyzed using thematic coding to identify key themes and patterns in the responses. RESULTS Hospital managers highlighted the current inefficiencies in decision-making processes, often characterized by poor communication, isolated decision-making, and limited data access. The use of traditional tools like spreadsheet applications and business intelligence systems remains prevalent, but there is a clear need for more advanced, integrated solutions. Managers expressed both optimism and skepticism about AI, acknowledging its potential to improve efficiency and decision-making while raising concerns about data privacy, ethical issues, and the loss of human empathy. The study identified key challenges, including the variability in technical skills, data fragmentation, and resistance to change. Managers emphasized the importance of robust data infrastructure and adequate training to ensure successful AI integration. CONCLUSIONS The study reveals a complex landscape where the potential benefits of AI in hospital management are balanced with significant challenges and concerns. Effective integration of AI requires addressing technical, ethical, and cultural issues, with a focus on maintaining human elements in decision-making. AI is seen as a powerful tool to support, not replace, human judgment in hospital management, promising improvements in efficiency, data accessibility, and analytical capacity. Preparing healthcare institutions with the necessary infrastructure and providing specialized training for managers are crucial for maximizing the benefits of AI while mitigating associated risks.
Collapse
Affiliation(s)
- Maurício Alves
- Unidade Local de Saúde de Coimbra, Coimbra, Portugal.
- NOVA National School of Public Health, NOVA University Lisbon, Lisbon, Portugal.
| | - Joana Seringa
- Public Health Research Centre, Comprehensive Health Research Center, CHRC, REAL, CCAL, NOVA National School of Public Health, NOVA University Lisbon, Lisbon, Portugal
| | | | - Teresa Magalhães
- Public Health Research Centre, Comprehensive Health Research Center, CHRC, REAL, CCAL, NOVA National School of Public Health, NOVA University Lisbon, Lisbon, Portugal
| |
Collapse
|
9
|
Botha NN, Segbedzi CE, Dumahasi VK, Maneen S, Kodom RV, Tsedze IS, Akoto LA, Atsu FS, Lasim OU, Ansah EW. Artificial intelligence in healthcare: a scoping review of perceived threats to patient rights and safety. Arch Public Health 2024; 82:188. [PMID: 39444019 PMCID: PMC11515716 DOI: 10.1186/s13690-024-01414-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Accepted: 10/01/2024] [Indexed: 10/25/2024] Open
Abstract
BACKGROUND The global health system remains determined to leverage on every workable opportunity, including artificial intelligence (AI) to provide care that is consistent with patients' needs. Unfortunately, while AI models generally return high accuracy within the trials in which they are trained, their ability to predict and recommend the best course of care for prospective patients is left to chance. PURPOSE This review maps evidence between January 1, 2010 to December 31, 2023, on the perceived threats posed by the usage of AI tools in healthcare on patients' rights and safety. METHODS We deployed the guidelines of Tricco et al. to conduct a comprehensive search of current literature from Nature, PubMed, Scopus, ScienceDirect, Dimensions AI, Web of Science, Ebsco Host, ProQuest, JStore, Semantic Scholar, Taylor & Francis, Emeralds, World Health Organisation, and Google Scholar. In all, 80 peer reviewed articles qualified and were included in this study. RESULTS We report that there is a real chance of unpredictable errors, inadequate policy and regulatory regime in the use of AI technologies in healthcare. Moreover, medical paternalism, increased healthcare cost and disparities in insurance coverage, data security and privacy concerns, and bias and discriminatory services are imminent in the use of AI tools in healthcare. CONCLUSIONS Our findings have some critical implications for achieving the Sustainable Development Goals (SDGs) 3.8, 11.7, and 16. We recommend that national governments should lead in the roll-out of AI tools in their healthcare systems. Also, other key actors in the healthcare industry should contribute to developing policies on the use of AI in healthcare systems.
Collapse
Affiliation(s)
- Nkosi Nkosi Botha
- Department of Health, Physical Education and Recreation, University of Cape Coast, Cape Coast, Ghana.
- Air Force Medical Centre, Armed Forces Medical Services, Air Force Base, Takoradi, Ghana.
| | - Cynthia E Segbedzi
- Department of Health, Physical Education and Recreation, University of Cape Coast, Cape Coast, Ghana
| | - Victor K Dumahasi
- Institute of Environmental and Sanitation Studies, Environmental Science, College of Basic and Applied Sciences, University of Ghana, Legon, Ghana
| | - Samuel Maneen
- Department of Health, Physical Education and Recreation, University of Cape Coast, Cape Coast, Ghana
| | - Ruby V Kodom
- Department of Health Services Management/Distance Education, University of Ghana, Legon, Ghana
| | - Ivy S Tsedze
- Department of Adult Health, School of Nursing and Midwifery, University of Cape Coast, Cape Coast, Ghana
| | - Lucy A Akoto
- Air Force Medical Centre, Armed Forces Medical Services, Air Force Base, Takoradi, Ghana
| | | | - Obed U Lasim
- Department of Health Information Management, School of Allied Health Sciences, University of Cape Coast, Cape Coast, Ghana
| | - Edward W Ansah
- Department of Health, Physical Education and Recreation, University of Cape Coast, Cape Coast, Ghana
| |
Collapse
|
10
|
Funer F, Tinnemeyer S, Liedtke W, Salloch S. Clinicians' roles and necessary levels of understanding in the use of artificial intelligence: A qualitative interview study with German medical students. BMC Med Ethics 2024; 25:107. [PMID: 39375660 PMCID: PMC11457475 DOI: 10.1186/s12910-024-01109-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2023] [Accepted: 09/26/2024] [Indexed: 10/09/2024] Open
Abstract
BACKGROUND Artificial intelligence-driven Clinical Decision Support Systems (AI-CDSS) are being increasingly introduced into various domains of health care for diagnostic, prognostic, therapeutic and other purposes. A significant part of the discourse on ethically appropriate conditions relate to the levels of understanding and explicability needed for ensuring responsible clinical decision-making when using AI-CDSS. Empirical evidence on stakeholders' viewpoints on these issues is scarce so far. The present study complements the empirical-ethical body of research by, on the one hand, investigating the requirements for understanding and explicability in depth with regard to the rationale behind them. On the other hand, it surveys medical students at the end of their studies as stakeholders, of whom little data is available so far, but for whom AI-CDSS will be an important part of their medical practice. METHODS Fifteen semi-structured qualitative interviews (each lasting an average of 56 min) were conducted with German medical students to investigate their perspectives and attitudes on the use of AI-CDSS. The problem-centred interviews draw on two hypothetical case vignettes of AI-CDSS employed in nephrology and surgery. Interviewees' perceptions and convictions of their own clinical role and responsibilities in dealing with AI-CDSS were elicited as well as viewpoints on explicability as well as the necessary level of understanding and competencies needed on the clinicians' side. The qualitative data were analysed according to key principles of qualitative content analysis (Kuckartz). RESULTS In response to the central question about the necessary understanding of AI-CDSS tools and the emergence of their outputs as well as the reasons for the requirements placed on them, two types of argumentation could be differentiated inductively from the interviewees' statements: the first type, the clinician as a systemic trustee (or "the one relying"), highlights that there needs to be empirical evidence and adequate approval processes that guarantee minimised harm and a clinical benefit from the employment of an AI-CDSS. Based on proof of these requirements, the use of an AI-CDSS would be appropriate, as according to "the one relying", clinicians should choose those measures that statistically cause the least harm. The second type, the clinician as an individual expert (or "the one controlling"), sets higher prerequisites that go beyond ensuring empirical evidence and adequate approval processes. These higher prerequisites relate to the clinician's necessary level of competence and understanding of how a specific AI-CDSS works and how to use it properly in order to evaluate its outputs and to mitigate potential risks for the individual patient. Both types are unified in their high esteem of evidence-based clinical practice and the need to communicate with the patient on the use of medical AI. However, the interviewees' different conceptions of the clinician's role and responsibilities cause them to have different requirements regarding the clinician's understanding and explicability of an AI-CDSS beyond the proof of benefit. CONCLUSIONS The study results highlight two different types among (future) clinicians regarding their view of the necessary levels of understanding and competence. These findings should inform the debate on appropriate training programmes and professional standards (e.g. clinical practice guidelines) that enable the safe and effective clinical employment of AI-CDSS in various clinical fields. While current approaches search for appropriate minimum requirements of the necessary understanding and competence, the differences between (future) clinicians in terms of their information and understanding needs described here can lead to more differentiated approaches to solutions.
Collapse
Affiliation(s)
- F Funer
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School (MHH), Carl-Neuberg-Str. 1, 30625, Hannover, Germany
- Institute for Ethics and History of Medicine, Eberhard Karls University Tübingen, Gartenstr. 47, 72074, Tübingen, Germany
| | - S Tinnemeyer
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School (MHH), Carl-Neuberg-Str. 1, 30625, Hannover, Germany
| | - W Liedtke
- Faculty of Theology, University of Greifswald, Am Rubenowplatz 2/3, 17489, Greifswald, Germany
| | - S Salloch
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School (MHH), Carl-Neuberg-Str. 1, 30625, Hannover, Germany.
| |
Collapse
|
11
|
McClean M, Panciu TC, Lange C, Duarte R, Theis F. Artificial intelligence in tuberculosis: a new ally in disease control. Breathe (Sheff) 2024; 20:240056. [PMID: 39660086 PMCID: PMC11629172 DOI: 10.1183/20734735.0056-2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2024] [Accepted: 08/07/2024] [Indexed: 12/12/2024] Open
Abstract
The challenges to effective tuberculosis (TB) disease control are considerable, and the current global targets for reductions in disease burden seem unattainable. The combination of complex pathophysiology and technical limitations results in difficulties in achieving consistent, reliable diagnoses, and long treatment regimens imply serious physiological and socioeconomic consequences for patients. Artificial intelligence (AI) applications in healthcare have significantly improved patient care regarding diagnostics, treatment and basic research. However, their success relies on infrastructures prioritising comprehensive data generation and collaborative research environments to foster stakeholder engagement. This viewpoint article briefly outlines the current and potential applications of advanced AI models in global TB control and the considerations and implications of adopting these tools within the public health community.
Collapse
Affiliation(s)
- Mairi McClean
- Helmholtz Zentrum München, German Research Center for Environmental Health, Institute of Computational Biology, Neuherberg, Munich, Germany
- Division of Infectious Diseases and Tropical Medicine, University Hospital, LMU Munich, Munich, Germany
| | | | - Christoph Lange
- Division of Clinical Infectious Diseases, Research Center Borstel, Borstel, Germany
- German Center for Infection Research (DZIF), Partner Site Borstel-Hamburg-Lübeck-Riems, Borstel, Germany
- Respiratory Medicine and International Health, University of Lübeck, Lübeck, Germany
- Department of Pediatrics, Global and Immigrant Health, Global Tuberculosis Program, Baylor College of Medicine and Texas Children's Hospital, Houston, TX, USA
| | - Raquel Duarte
- Unidade de Investigação em Epidemiologia (EPI Unit), Instituto de Saúde Pública da Universidade do Porto, Porto, Portugal
- Laboratório associado para a Investigação Integrativa e Translacional em Saúde Populacional (ITR) Porto, Porto, Portugal
- ICBAS - Instituto de Ciências Biomédicas Abel Salazar, Universidade do Porto, Porto,Portugal
- Centro de Saúde Pública Doutor Gonçalves Ferreira. Instituto de Saúde Pública Doutor Ricardo Jorge - INSA Porto, Porto, Portugal
| | - Fabian Theis
- Helmholtz Zentrum München, German Research Center for Environmental Health, Institute of Computational Biology, Neuherberg, Munich, Germany
- Respiratory Medicine and International Health, University of Lübeck, Lübeck, Germany
- Department of Mathematics, Technische Universität München, Munich, Germany
| |
Collapse
|
12
|
Oikonomou EK, Khera R. Artificial intelligence-enhanced patient evaluation: bridging art and science. Eur Heart J 2024; 45:3204-3218. [PMID: 38976371 PMCID: PMC11400875 DOI: 10.1093/eurheartj/ehae415] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/11/2024] [Revised: 04/23/2024] [Accepted: 06/18/2024] [Indexed: 07/10/2024] Open
Abstract
The advent of digital health and artificial intelligence (AI) has promised to revolutionize clinical care, but real-world patient evaluation has yet to witness transformative changes. As history taking and physical examination continue to rely on long-established practices, a growing pipeline of AI-enhanced digital tools may soon augment the traditional clinical encounter into a data-driven process. This article presents an evidence-backed vision of how promising AI applications may enhance traditional practices, streamlining tedious tasks while elevating diverse data sources, including AI-enabled stethoscopes, cameras, and wearable sensors, to platforms for personalized medicine and efficient care delivery. Through the lens of traditional patient evaluation, we illustrate how digital technologies may soon be interwoven into routine clinical workflows, introducing a novel paradigm of longitudinal monitoring. Finally, we provide a skeptic's view on the practical, ethical, and regulatory challenges that limit the uptake of such technologies.
Collapse
Affiliation(s)
- Evangelos K Oikonomou
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale School of Medicine, 333 Cedar Street, PO Box 208017, New Haven, 06520-8017 CT, USA
| | - Rohan Khera
- Section of Cardiovascular Medicine, Department of Internal Medicine, Yale School of Medicine, 333 Cedar Street, PO Box 208017, New Haven, 06520-8017 CT, USA
- Center for Outcomes Research and Evaluation, Yale New Haven Hospital, New Haven, 195 Church St, 6th Floor, New Haven, CT 06510, USA
- Section of Biomedical Informatics and Data Science, Yale School of Medicine, 100 College Street, New Haven, 06511 CT, USA
- Section of Health Informatics, Department of Biostatistics, Yale School of Public Health, 60 College Street, New Haven, 06510 CT, USA
| |
Collapse
|
13
|
Pham TD, Teh MT, Chatzopoulou D, Holmes S, Coulthard P. Artificial Intelligence in Head and Neck Cancer: Innovations, Applications, and Future Directions. Curr Oncol 2024; 31:5255-5290. [PMID: 39330017 PMCID: PMC11430806 DOI: 10.3390/curroncol31090389] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2024] [Revised: 09/01/2024] [Accepted: 09/03/2024] [Indexed: 09/28/2024] Open
Abstract
Artificial intelligence (AI) is revolutionizing head and neck cancer (HNC) care by providing innovative tools that enhance diagnostic accuracy and personalize treatment strategies. This review highlights the advancements in AI technologies, including deep learning and natural language processing, and their applications in HNC. The integration of AI with imaging techniques, genomics, and electronic health records is explored, emphasizing its role in early detection, biomarker discovery, and treatment planning. Despite noticeable progress, challenges such as data quality, algorithmic bias, and the need for interdisciplinary collaboration remain. Emerging innovations like explainable AI, AI-powered robotics, and real-time monitoring systems are poised to further advance the field. Addressing these challenges and fostering collaboration among AI experts, clinicians, and researchers is crucial for developing equitable and effective AI applications. The future of AI in HNC holds significant promise, offering potential breakthroughs in diagnostics, personalized therapies, and improved patient outcomes.
Collapse
Affiliation(s)
- Tuan D. Pham
- Barts and The London School of Medicine and Dentistry, Queen Mary University of London, Turner Street, London E1 2AD, UK; (M.-T.T.); (D.C.); (S.H.); (P.C.)
| | | | | | | | | |
Collapse
|
14
|
Janssen Daalen JM, Doesburg D, Hunik L, Kessel R, Herngreen T, Knol D, Ruys T, van den Bemt BJF, Schers HJ. Model-Informed Precision Dosing Using Machine Learning for Levothyroxine in General Practice: Development, Validation and Clinical Simulation Trial. Clin Pharmacol Ther 2024; 116:824-833. [PMID: 38711388 DOI: 10.1002/cpt.3293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2023] [Accepted: 04/22/2024] [Indexed: 05/08/2024]
Abstract
Levothyroxine is one of the most prescribed drugs in the western world. Dosing is challenging due to high-interindividual differences in effective dosage and the narrow therapeutic window. Model-informed precision dosing (MIPD) using machine learning could assist general practitioners (GPs), but no such models exist for primary care. Furthermore, introduction of decision-support algorithms in healthcare is limited due to the substantial gap between developers and clinicians' perspectives. We report the development, validation, and a clinical simulation trial of the first MIPD application for primary care. Stable maintenance dosage of levothyroxine was the model target. The multiclass model generates predictions for individual patients, for different dosing classes. Random forest was trained and tested on a national primary care database (n = 19,004) with a final weighted AUC across dosing options of 0.71, even in subclinical hypothyroidism. TSH, fT4, weight, and age were most predictive. To assess the safety, feasibility, and clinical impact of MIPD for levothyroxine, we performed clinical simulation studies in GPs and compared MIPD to traditional prescription. Fifty-one GPs selected starting dosages for 20 primary hypothyroidism cases without and then with MIPD 2 weeks later. Overdosage and underdosage were defined as higher and lower than 12.5 μg relative to stable maintenance dosage. MIPD decreased overdosage in number (30.5 to 23.9%, P < 0.01) and magnitude (median 50 to 37.5 μg, P < 0.01) and increased optimal starting dosages (18.3 to 30.2%, P < 0.01). GPs considered lab results more often with MIPD and most would use the model frequently. This study demonstrates the clinical relevance, safety, and effectiveness of MIPD for levothyroxine in primary care.
Collapse
Affiliation(s)
- Jules M Janssen Daalen
- Department of Neurology, Donders Institute for Brain, Cognition and Behaviour, Radboud University Medical Center, Nijmegen, The Netherlands
| | | | - Liesbeth Hunik
- Department of Primary and Community Care, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Rogier Kessel
- Amsterdam Data Collective, Amsterdam, The Netherlands
| | | | - Dennis Knol
- Amsterdam Data Collective, Amsterdam, The Netherlands
| | - Thony Ruys
- Amsterdam Data Collective, Amsterdam, The Netherlands
| | - Bart J F van den Bemt
- Department of Primary and Community Care, Radboud University Medical Center, Nijmegen, The Netherlands
- Department of Pharmacy, Sint Maartenskliniek, Nijmegen, The Netherlands
- Department of Clinical Pharmacy and Toxicology, Maastricht University Medical Center+, Maastricht, The Netherlands
| | - Henk J Schers
- Department of Primary and Community Care, Radboud University Medical Center, Nijmegen, The Netherlands
| |
Collapse
|
15
|
Salloch S, Eriksen A. What Are Humans Doing in the Loop? Co-Reasoning and Practical Judgment When Using Machine Learning-Driven Decision Aids. THE AMERICAN JOURNAL OF BIOETHICS : AJOB 2024; 24:67-78. [PMID: 38767971 DOI: 10.1080/15265161.2024.2353800] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2024]
Abstract
Within the ethical debate on Machine Learning-driven decision support systems (ML_CDSS), notions such as "human in the loop" or "meaningful human control" are often cited as being necessary for ethical legitimacy. In addition, ethical principles usually serve as the major point of reference in ethical guidance documents, stating that conflicts between principles need to be weighed and balanced against each other. Starting from a neo-Kantian viewpoint inspired by Onora O'Neill, this article makes a concrete suggestion of how to interpret the role of the "human in the loop" and to overcome the perspective of rivaling ethical principles in the evaluation of AI in health care. We argue that patients should be perceived as "fellow workers" and epistemic partners in the interpretation of ML_CDSS outputs. We further highlight that a meaningful process of integrating (rather than weighing and balancing) ethical principles is most appropriate in the evaluation of medical AI.
Collapse
|
16
|
Chen Z, Liang N, Li H, Zhang H, Li H, Yan L, Hu Z, Chen Y, Zhang Y, Wang Y, Ke D, Shi N. Exploring explainable AI features in the vocal biomarkers of lung disease. Comput Biol Med 2024; 179:108844. [PMID: 38981214 DOI: 10.1016/j.compbiomed.2024.108844] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2024] [Revised: 05/15/2024] [Accepted: 06/04/2024] [Indexed: 07/11/2024]
Abstract
This review delves into the burgeoning field of explainable artificial intelligence (XAI) in the detection and analysis of lung diseases through vocal biomarkers. Lung diseases, often elusive in their early stages, pose a significant public health challenge. Recent advancements in AI have ushered in innovative methods for early detection, yet the black-box nature of many AI models limits their clinical applicability. XAI emerges as a pivotal tool, enhancing transparency and interpretability in AI-driven diagnostics. This review synthesizes current research on the application of XAI in analyzing vocal biomarkers for lung diseases, highlighting how these techniques elucidate the connections between specific vocal features and lung pathology. We critically examine the methodologies employed, the types of lung diseases studied, and the performance of various XAI models. The potential for XAI to aid in early detection, monitor disease progression, and personalize treatment strategies in pulmonary medicine is emphasized. Furthermore, this review identifies current challenges, including data heterogeneity and model generalizability, and proposes future directions for research. By offering a comprehensive analysis of explainable AI features in the context of lung disease detection, this review aims to bridge the gap between advanced computational approaches and clinical practice, paving the way for more transparent, reliable, and effective diagnostic tools.
Collapse
Affiliation(s)
- Zhao Chen
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Ning Liang
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Haoyuan Li
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Haili Zhang
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Huizhen Li
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Lijiao Yan
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Ziteng Hu
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Yaxin Chen
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Yujing Zhang
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Yanping Wang
- Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China
| | - Dandan Ke
- Special Disease Clinic, Huaishuling Branch of Beijing Fengtai Hospital of Integrated Traditional Chinese and Western Medicine, Beijing, China.
| | - Nannan Shi
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China; Institute of Basic Research in Clinical Medicine, China Academy of Chinese Medical Sciences, Beijing, China.
| |
Collapse
|
17
|
Haitjema S, Nijman SWJ, Verkouter I, Jacobs JJL, Asselbergs FW, Moons KGM, Beekers I, Debray TPA, Bots ML. The use of imputation in clinical decision support systems: a cardiovascular risk management pilot vignette study among clinicians. EUROPEAN HEART JOURNAL. DIGITAL HEALTH 2024; 5:572-581. [PMID: 39318684 PMCID: PMC11417486 DOI: 10.1093/ehjdh/ztae058] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Revised: 05/06/2024] [Accepted: 06/01/2024] [Indexed: 09/26/2024]
Abstract
Aims A major challenge of the use of prediction models in clinical care is missing data. Real-time imputation may alleviate this. However, to what extent clinicians accept this solution remains unknown. We aimed to assess acceptance of real-time imputation for missing patient data in a clinical decision support system (CDSS) including 10-year cardiovascular absolute risk for the individual patient. Methods and results We performed a vignette study extending an existing CDSS with the real-time imputation method joint modelling imputation (JMI). We included 17 clinicians to use the CDSS with three different vignettes, describing potential use cases (missing data, no risk estimate; imputed values, risk estimate based on imputed data; complete information). In each vignette, missing data were introduced to mimic a situation as could occur in clinical practice. Acceptance of end-users was assessed on three different axes: clinical realism, comfortableness, and added clinical value. Overall, the imputed predictor values were found to be clinically reasonable and according to the expectations. However, for binary variables, use of a probability scale to express uncertainty was deemed inconvenient. The perceived comfortableness with imputed risk prediction was low, and confidence intervals were deemed too wide for reliable decision-making. The clinicians acknowledged added value for using JMI in clinical practice when used for educational, research, or informative purposes. Conclusion Handling missing data in CDSS via JMI is useful, but more accurate imputations are needed to generate comfort in clinicians for use in routine care. Only then can CDSS create clinical value by improving decision-making.
Collapse
Affiliation(s)
- Saskia Haitjema
- Central Diagnostic Laboratory, University Medical Center Utrecht, Utrecht University, Heidelberglaan 100, 3584 CX Utrecht, The Netherlands
| | - Steven W J Nijman
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Inge Verkouter
- Department Clinical Care & Research, Ortec B.V., Zoetermeer, The Netherlands
| | - John J L Jacobs
- Department Clinical Care & Research, Ortec B.V., Zoetermeer, The Netherlands
| | - Folkert W Asselbergs
- Department of Cardiology, Amsterdam Cardiovascular Sciences, Amsterdam University Medical Centre, University of Amsterdam, Amsterdam, The Netherlands
- Department of Cardiology, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
- Institute of Health Informatics, University College London, London, UK
| | - Karel G M Moons
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Ines Beekers
- Department Clinical Care & Research, Ortec B.V., Zoetermeer, The Netherlands
| | - Thomas P A Debray
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
- Institute of Health Informatics, University College London, London, UK
| | - Michiel L Bots
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| |
Collapse
|
18
|
Kutbi M. Artificial Intelligence-Based Applications for Bone Fracture Detection Using Medical Images: A Systematic Review. Diagnostics (Basel) 2024; 14:1879. [PMID: 39272664 PMCID: PMC11394268 DOI: 10.3390/diagnostics14171879] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2024] [Revised: 08/19/2024] [Accepted: 08/26/2024] [Indexed: 09/15/2024] Open
Abstract
Artificial intelligence (AI) is making notable advancements in the medical field, particularly in bone fracture detection. This systematic review compiles and assesses existing research on AI applications aimed at identifying bone fractures through medical imaging, encompassing studies from 2010 to 2023. It evaluates the performance of various AI models, such as convolutional neural networks (CNNs), in diagnosing bone fractures, highlighting their superior accuracy, sensitivity, and specificity compared to traditional diagnostic methods. Furthermore, the review explores the integration of advanced imaging techniques like 3D CT and MRI with AI algorithms, which has led to enhanced diagnostic accuracy and improved patient outcomes. The potential of Generative AI and Large Language Models (LLMs), such as OpenAI's GPT, to enhance diagnostic processes through synthetic data generation, comprehensive report creation, and clinical scenario simulation is also discussed. The review underscores the transformative impact of AI on diagnostic workflows and patient care, while also identifying research gaps and suggesting future research directions to enhance data quality, model robustness, and ethical considerations.
Collapse
Affiliation(s)
- Mohammed Kutbi
- College of Computing and Informatics, Saudi Electronic University, Riyadh 13316, Saudi Arabia
| |
Collapse
|
19
|
Dingel J, Kleine AK, Cecil J, Sigl AL, Lermer E, Gaube S. Predictors of Health Care Practitioners' Intention to Use AI-Enabled Clinical Decision Support Systems: Meta-Analysis Based on the Unified Theory of Acceptance and Use of Technology. J Med Internet Res 2024; 26:e57224. [PMID: 39102675 PMCID: PMC11333871 DOI: 10.2196/57224] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2024] [Revised: 05/03/2024] [Accepted: 05/13/2024] [Indexed: 08/07/2024] Open
Abstract
BACKGROUND Artificial intelligence-enabled clinical decision support systems (AI-CDSSs) offer potential for improving health care outcomes, but their adoption among health care practitioners remains limited. OBJECTIVE This meta-analysis identified predictors influencing health care practitioners' intention to use AI-CDSSs based on the Unified Theory of Acceptance and Use of Technology (UTAUT). Additional predictors were examined based on existing empirical evidence. METHODS The literature search using electronic databases, forward searches, conference programs, and personal correspondence yielded 7731 results, of which 17 (0.22%) studies met the inclusion criteria. Random-effects meta-analysis, relative weight analyses, and meta-analytic moderation and mediation analyses were used to examine the relationships between relevant predictor variables and the intention to use AI-CDSSs. RESULTS The meta-analysis results supported the application of the UTAUT to the context of the intention to use AI-CDSSs. The results showed that performance expectancy (r=0.66), effort expectancy (r=0.55), social influence (r=0.66), and facilitating conditions (r=0.66) were positively associated with the intention to use AI-CDSSs, in line with the predictions of the UTAUT. The meta-analysis further identified positive attitude (r=0.63), trust (r=0.73), anxiety (r=-0.41), perceived risk (r=-0.21), and innovativeness (r=0.54) as additional relevant predictors. Trust emerged as the most influential predictor overall. The results of the moderation analyses show that the relationship between social influence and use intention becomes weaker with increasing age. In addition, the relationship between effort expectancy and use intention was stronger for diagnostic AI-CDSSs than for devices that combined diagnostic and treatment recommendations. Finally, the relationship between facilitating conditions and use intention was mediated through performance and effort expectancy. CONCLUSIONS This meta-analysis contributes to the understanding of the predictors of intention to use AI-CDSSs based on an extended UTAUT model. More research is needed to substantiate the identified relationships and explain the observed variations in effect sizes by identifying relevant moderating factors. The research findings bear important implications for the design and implementation of training programs for health care practitioners to ease the adoption of AI-CDSSs into their practice.
Collapse
Affiliation(s)
- Julius Dingel
- Human-AI-Interaction Group, Center for Leadership and People Management, Ludwig Maximilian University of Munich, Munich, Germany
| | - Anne-Kathrin Kleine
- Human-AI-Interaction Group, Center for Leadership and People Management, Ludwig Maximilian University of Munich, Munich, Germany
| | - Julia Cecil
- Human-AI-Interaction Group, Center for Leadership and People Management, Ludwig Maximilian University of Munich, Munich, Germany
| | - Anna Leonie Sigl
- Department of Liberal Arts and Sciences, Technical University of Applied Sciences Augsburg, Augsburg, Germany
| | - Eva Lermer
- Human-AI-Interaction Group, Center for Leadership and People Management, Ludwig Maximilian University of Munich, Munich, Germany
- Department of Liberal Arts and Sciences, Technical University of Applied Sciences Augsburg, Augsburg, Germany
| | - Susanne Gaube
- Human Factors in Healthcare, Global Business School for Health, University College London, London, United Kingdom
| |
Collapse
|
20
|
Rony MKK, Numan SM, Johra FT, Akter K, Akter F, Debnath M, Mondal S, Wahiduzzaman M, Das M, Ullah M, Rahman MH, Das Bala S, Parvin MR. Perceptions and attitudes of nurse practitioners toward artificial intelligence adoption in health care. Health Sci Rep 2024; 7:e70006. [PMID: 39175600 PMCID: PMC11339127 DOI: 10.1002/hsr2.70006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2024] [Revised: 07/31/2024] [Accepted: 08/06/2024] [Indexed: 08/24/2024] Open
Abstract
Background With the ever-increasing integration of artificial intelligence (AI) into health care, it becomes imperative to gain an in-depth understanding of how health care professionals, specifically nurse practitioners, perceive and approach this transformative technology. Objectives This study aimed to gain insights into nurse practitioners' perceptions and attitudes toward AI adoption in health care. Methods This qualitative research employed a descriptive and phenomenological approach using in-depth interviews. Data were collected through a semi-structured questionnaire with 37 nurse practitioners selected through purposive sampling, specifically Maximum Variation Sampling and Expert Sampling techniques, to ensure diversity in characteristics. Trustworthiness of the research was maintained through member checking and peer debriefing. Thematic analysis was employed to uncover recurring themes and patterns in the data. Results The thematic analysis revealed nine main themes that encapsulated nurse practitioners' perceptions and attitudes toward AI adoption in health care. These included nurse practitioners' perceptions of AI implementation, attitudes toward AI adoption, patient-centered care and AI, quality of health care delivery and AI, ethical and regulatory aspects of AI, education and training needs, collaboration and interdisciplinary relationships, obstacles in integrating AI, and AI and health care policy. While this study found that nurse practitioners held a wide range of perspectives, with many viewings AI as a tool to enhance patient care. Conclusions This research provides a valuable contribution to the evolving discourse surrounding AI adoption in health care. The findings underscore the necessity for comprehensive education and training in AI, accompanied by clear and robust ethical and regulatory guidelines to ensure the responsible integration of AI in health care practice. Furthermore, fostering collaboration and interdisciplinary relationships is pivotal for the successful incorporation of AI in health care. Policymakers should also address the challenges and opportunities that AI presents in the health care sector. This study enhances the ongoing conversation on AI adoption in health care by shedding light on the perspectives of nurses, thereby shaping future strategies for AI integration.
Collapse
Affiliation(s)
| | - Sharker Md. Numan
- School of Science and TechnologyBangladesh Open UniversityGazipurBangladesh
| | - Fateha tuj Johra
- Masters in Disaster ManagementUniversity of DhakaDhakaBangladesh
| | - Khadiza Akter
- Master of Public HealthDaffodil International UniversityDhakaBangladesh
| | - Fazila Akter
- Dhaka Nursing Collegeaffiliated with the University of DhakaDhakaBangladesh
| | - Mitun Debnath
- Master of Public HealthNational Institute of Preventive and Social MedicineDhakaBangladesh
| | - Sujit Mondal
- Master of Science in NursingNational Institute of Advanced Nursing Education and Research MugdaDhakaBangladesh
| | - Md. Wahiduzzaman
- School of Medical SciencesShahjalal University of Science and TechnologySylhetBangladesh
| | - Mousumi Das
- Master of Public HealthLeading UniversitySylhetBangladesh
| | - Mohammad Ullah
- College of NursingInternational University of Business Agriculture and TechnologyDhakaBangladesh
| | | | - Shuvashish Das Bala
- College of NursingInternational University of Business Agriculture and TechnologyDhakaBangladesh
| | - Mst. Rina Parvin
- Bangladesh Army (AFNS Officer)Combined Military Hospital DhakaDhakaBangladesh
| |
Collapse
|
21
|
Hanna JJ, Medford RJ. Navigating the future: machine learning's role in revolutionizing antimicrobial stewardship and infection prevention and control. Curr Opin Infect Dis 2024; 37:290-295. [PMID: 38820069 PMCID: PMC11211045 DOI: 10.1097/qco.0000000000001028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/02/2024]
Abstract
PURPOSE OF REVIEW This review examines the current state and future prospects of machine learning (ML) in infection prevention and control (IPC) and antimicrobial stewardship (ASP), highlighting its potential to transform healthcare practices by enhancing the precision, efficiency, and effectiveness of interventions against infections and antimicrobial resistance. RECENT FINDINGS ML has shown promise in improving surveillance and detection of infections, predicting infection risk, and optimizing antimicrobial use through the development of predictive analytics, natural language processing, and personalized medicine approaches. However, challenges remain, including issues related to data quality, model interpretability, ethical considerations, and integration into clinical workflows. SUMMARY Despite these challenges, the future of ML in IPC and ASP is promising, with interdisciplinary collaboration identified as a key factor in overcoming existing barriers. ML's role in advancing personalized medicine, real-time disease monitoring, and effective IPC and ASP strategies signifies a pivotal shift towards safer, more efficient healthcare environments and improved patient care in the face of global antimicrobial resistance challenges.
Collapse
Affiliation(s)
- John J Hanna
- Division of Infectious Diseases, Department of Internal Medicine, Brody School of Medicine
- Information Services, ECU Health, Greenville, North Carolina, USA
| | - Richard J Medford
- Division of Infectious Diseases, Department of Internal Medicine, Brody School of Medicine
- Information Services, ECU Health, Greenville, North Carolina, USA
| |
Collapse
|
22
|
Federico CA, Trotsyuk AA. Biomedical Data Science, Artificial Intelligence, and Ethics: Navigating Challenges in the Face of Explosive Growth. Annu Rev Biomed Data Sci 2024; 7:1-14. [PMID: 38598860 DOI: 10.1146/annurev-biodatasci-102623-104553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/12/2024]
Abstract
Advances in biomedical data science and artificial intelligence (AI) are profoundly changing the landscape of healthcare. This article reviews the ethical issues that arise with the development of AI technologies, including threats to privacy, data security, consent, and justice, as they relate to donors of tissue and data. It also considers broader societal obligations, including the importance of assessing the unintended consequences of AI research in biomedicine. In addition, this article highlights the challenge of rapid AI development against the backdrop of disparate regulatory frameworks, calling for a global approach to address concerns around data misuse, unintended surveillance, and the equitable distribution of AI's benefits and burdens. Finally, a number of potential solutions to these ethical quandaries are offered. Namely, the merits of advocating for a collaborative, informed, and flexible regulatory approach that balances innovation with individual rights and public welfare, fostering a trustworthy AI-driven healthcare ecosystem, are discussed.
Collapse
Affiliation(s)
- Carole A Federico
- Center for Biomedical Ethics, Stanford University School of Medicine, Stanford, California, USA; ,
| | - Artem A Trotsyuk
- Center for Biomedical Ethics, Stanford University School of Medicine, Stanford, California, USA; ,
| |
Collapse
|
23
|
Benzinger L, Epping J, Ursin F, Salloch S. Artificial Intelligence to support ethical decision-making for incapacitated patients: a survey among German anesthesiologists and internists. BMC Med Ethics 2024; 25:78. [PMID: 39026308 PMCID: PMC11256615 DOI: 10.1186/s12910-024-01079-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2024] [Accepted: 07/03/2024] [Indexed: 07/20/2024] Open
Abstract
BACKGROUND Artificial intelligence (AI) has revolutionized various healthcare domains, where AI algorithms sometimes even outperform human specialists. However, the field of clinical ethics has remained largely untouched by AI advances. This study explores the attitudes of anesthesiologists and internists towards the use of AI-driven preference prediction tools to support ethical decision-making for incapacitated patients. METHODS A questionnaire was developed and pretested among medical students. The questionnaire was distributed to 200 German anesthesiologists and 200 German internists, thereby focusing on physicians who often encounter patients lacking decision-making capacity. The questionnaire covered attitudes toward AI-driven preference prediction, availability and utilization of Clinical Ethics Support Services (CESS), and experiences with ethically challenging situations. Descriptive statistics and bivariate analysis was performed. Qualitative responses were analyzed using content analysis in a mixed inductive-deductive approach. RESULTS Participants were predominantly male (69.3%), with ages ranging from 27 to 77. Most worked in nonacademic hospitals (82%). Physicians generally showed hesitance toward AI-driven preference prediction, citing concerns about the loss of individuality and humanity, lack of explicability in AI results, and doubts about AI's ability to encompass the ethical deliberation process. In contrast, physicians had a more positive opinion of CESS. Availability of CESS varied, with 81.8% of participants reporting access. Among those without access, 91.8% expressed a desire for CESS. Physicians' reluctance toward AI-driven preference prediction aligns with concerns about transparency, individuality, and human-machine interaction. While AI could enhance the accuracy of predictions and reduce surrogate burden, concerns about potential biases, de-humanisation, and lack of explicability persist. CONCLUSIONS German physicians frequently encountering incapacitated patients exhibit hesitance toward AI-driven preference prediction but hold a higher esteem for CESS. Addressing concerns about individuality, explicability, and human-machine roles may facilitate the acceptance of AI in clinical ethics. Further research into patient and surrogate perspectives is needed to ensure AI aligns with patient preferences and values in complex medical decisions.
Collapse
Affiliation(s)
- Lasse Benzinger
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School (MHH), Carl-Neuberg-Str. 1, Hannover, 30625, Germany.
| | - Jelena Epping
- Department of Medical Sociology, Hannover Medical School (MHH), Carl-Neuberg-Str. 1, Hannover, 30625, Germany
| | - Frank Ursin
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School (MHH), Carl-Neuberg-Str. 1, Hannover, 30625, Germany
| | - Sabine Salloch
- Institute for Ethics, History and Philosophy of Medicine, Hannover Medical School (MHH), Carl-Neuberg-Str. 1, Hannover, 30625, Germany
| |
Collapse
|
24
|
Huang Z, Lim HYF, Ow JT, Sun SHL, Chow A. Doctors' perception on the ethical use of AI-enabled clinical decision support systems for antibiotic prescribing recommendations in Singapore. Front Public Health 2024; 12:1420032. [PMID: 39011326 PMCID: PMC11246905 DOI: 10.3389/fpubh.2024.1420032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2024] [Accepted: 06/18/2024] [Indexed: 07/17/2024] Open
Abstract
Objectives The increased utilization of Artificial intelligence (AI) in healthcare changes practice and introduces ethical implications for AI adoption in medicine. We assess medical doctors' ethical stance in situations that arise in adopting an AI-enabled Clinical Decision Support System (AI-CDSS) for antibiotic prescribing decision support in a healthcare institution in Singapore. Methods We conducted in-depth interviews with 30 doctors of varying medical specialties and designations between October 2022 and January 2023. Our interview guide was anchored on the four pillars of medical ethics. We used clinical vignettes with the following hypothetical scenarios: (1) Using an antibiotic AI-enabled CDSS's recommendations for a tourist, (2) Uncertainty about the AI-CDSS's recommendation of a narrow-spectrum antibiotic vs. concerns about antimicrobial resistance, (3) Patient refusing the "best treatment" recommended by the AI-CDSS, (4) Data breach. Results More than half of the participants only realized that the AI-enabled CDSS could have misrepresented non-local populations after being probed to think about the AI-CDSS's data source. Regarding prescribing a broad- or narrow-spectrum antibiotic, most participants preferred to exercise their clinical judgment over the AI-enabled CDSS's recommendations in their patients' best interest. Two-thirds of participants prioritized beneficence over patient autonomy by convincing patients who refused the best practice treatment to accept it. Many were unaware of the implications of data breaches. Conclusion The current position on the legal liability concerning the use of AI-enabled CDSS is unclear in relation to doctors, hospitals and CDSS providers. Having a comprehensive ethical legal and regulatory framework, perceived organizational support, and adequate knowledge of AI and ethics are essential for successfully implementing AI in healthcare.
Collapse
Affiliation(s)
- Zhilian Huang
- Department of Preventive and Population Medicine, Office of Clinical Epidemiology, Analytics, and Knowledge [OCEAN], Tan Tock Seng Hospital, Singapore, Singapore
| | - Hannah Yee-Fen Lim
- Nanyang Business School, Nanyang Technological University, Singapore, Singapore
| | - Jing Teng Ow
- Department of Preventive and Population Medicine, Office of Clinical Epidemiology, Analytics, and Knowledge [OCEAN], Tan Tock Seng Hospital, Singapore, Singapore
| | - Shirley Hsiao-Li Sun
- School of Social Sciences, Nanyang Technological University, Singapore, Singapore
| | - Angela Chow
- Department of Preventive and Population Medicine, Office of Clinical Epidemiology, Analytics, and Knowledge [OCEAN], Tan Tock Seng Hospital, Singapore, Singapore
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore
- Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore
| |
Collapse
|
25
|
Rojas-Carabali W, Cifuentes-González C, Gutierrez-Sinisterra L, Heng LY, Tsui E, Gangaputra S, Sadda S, Nguyen QD, Kempen JH, Pavesio CE, Gupta V, Raman R, Miao C, Lee B, de-la-Torre A, Agrawal R. Managing a patient with uveitis in the era of artificial intelligence: Current approaches, emerging trends, and future perspectives. Asia Pac J Ophthalmol (Phila) 2024; 13:100082. [PMID: 39019261 DOI: 10.1016/j.apjo.2024.100082] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2024] [Revised: 06/30/2024] [Accepted: 07/04/2024] [Indexed: 07/19/2024] Open
Abstract
The integration of artificial intelligence (AI) with healthcare has opened new avenues for diagnosing, treating, and managing medical conditions with remarkable precision. Uveitis, a diverse group of rare eye conditions characterized by inflammation of the uveal tract, exemplifies the complexities in ophthalmology due to its varied causes, clinical presentations, and responses to treatments. Uveitis, if not managed promptly and effectively, can lead to significant visual impairment. However, its management requires specialized knowledge, which is often lacking, particularly in regions with limited access to health services. AI's capabilities in pattern recognition, data analysis, and predictive modelling offer significant potential to revolutionize uveitis management. AI can classify disease etiologies, analyze multimodal imaging data, predict outcomes, and identify new therapeutic targets. However, transforming these AI models into clinical applications and meeting patient expectations involves overcoming challenges like acquiring extensive, annotated datasets, ensuring algorithmic transparency, and validating these models in real-world settings. This review delves into the complexities of uveitis and the current AI landscape, discussing the development, opportunities, and challenges of AI from theoretical models to bedside application. It also examines the epidemiology of uveitis, the global shortage of uveitis specialists, and the disease's socioeconomic impacts, underlining the critical need for AI-driven approaches. Furthermore, it explores the integration of AI in diagnostic imaging and future directions in ophthalmology, aiming to highlight emerging trends that could transform management of a patient with uveitis and suggesting collaborative efforts to enhance AI applications in clinical practice.
Collapse
Affiliation(s)
- William Rojas-Carabali
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore; Department of Ophthalmology, Tan Tock Seng Hospital, National Healthcare Group Eye Institute, Singapore.
| | - Carlos Cifuentes-González
- Department of Ophthalmology, Tan Tock Seng Hospital, National Healthcare Group Eye Institute, Singapore.
| | - Laura Gutierrez-Sinisterra
- Department of Ophthalmology, Tan Tock Seng Hospital, National Healthcare Group Eye Institute, Singapore.
| | - Lim Yuan Heng
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore.
| | - Edmund Tsui
- Stein Eye Institute, David Geffen of Medicine at UCLA, Los Angeles, CA, USA.
| | - Sapna Gangaputra
- Vanderbilt Eye Institute, Vanderbilt University Medical Center, Nashville, TN, USA.
| | - Srinivas Sadda
- Doheny Eye Institute, David Geffen of Medicine at UCLA, Los Angeles, CA, USA.
| | | | - John H Kempen
- Department of Ophthalmology, Massachusetts Eye and Ear/Harvard Medical School; and Schepens Eye Research Institute; Boston, MA, USA; Department of Ophthalmology, Myungsung Medical College/MCM Comprehensive Specialized Hospital, Addis Abeba, Ethiopia; Sight for Souls, Bellevue, WA, USA.
| | | | - Vishali Gupta
- Advanced Eye Centre, Post, graduate Institute of Medical Education and Research (PGIMER), Chandigarh, India.
| | - Rajiv Raman
- Department of Ophthalmology, Sankara Nethralaya, Chennai, India.
| | - Chunyan Miao
- School of Computer Science and Engineering at Nanyang Technological University, Singapore.
| | - Bernett Lee
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore.
| | - Alejandra de-la-Torre
- Neuroscience Research Group (NEUROS), Neurovitae Center for Neuroscience, Institute of Translational Medicine (IMT), Escuela de Medicina y Ciencias de la Salud, Universidad del Rosario, Bogotá, Colombia.
| | - Rupesh Agrawal
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore; Department of Ophthalmology, Tan Tock Seng Hospital, National Healthcare Group Eye Institute, Singapore; Singapore Eye Research Institute, Singapore; Duke NUS Medical School, Singapore.
| |
Collapse
|
26
|
van Genderen ME, van de Sande D, Hooft L, Reis AA, Cornet AD, Oosterhoff JHF, van der Ster BJP, Huiskens J, Townsend R, van Bommel J, Gommers D, van den Hoven J. Charting a new course in healthcare: early-stage AI algorithm registration to enhance trust and transparency. NPJ Digit Med 2024; 7:119. [PMID: 38720011 PMCID: PMC11078921 DOI: 10.1038/s41746-024-01104-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Accepted: 04/15/2024] [Indexed: 05/12/2024] Open
Affiliation(s)
- Michel E van Genderen
- Erasmus MC University Medical Center, Department of Adult Intensive Care, Rotterdam, The Netherlands.
| | - Davy van de Sande
- Erasmus MC University Medical Center, Department of Adult Intensive Care, Rotterdam, The Netherlands
| | - Lotty Hooft
- Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, The Netherlands
| | - Andreas Alois Reis
- Department of Research for Health, Division of the Chief Scientist, World Health Organization, Geneva, Switzerland
| | - Alexander D Cornet
- Section editor Intensive Care at Nederlands Tijdschrift voor Geneeskunde (Dutch Journal of Medicine), Amsterdam, The Netherlands
- Department of Intensive Care, Medisch Spectrum Twente, Enschede, The Netherlands
| | - Jacobien H F Oosterhoff
- Delft University of Technology, Faculty of Technology, Policy and Management, Delft, The Netherlands
| | - Björn J P van der Ster
- Erasmus MC University Medical Center, Department of Adult Intensive Care, Rotterdam, The Netherlands
| | | | - Reggie Townsend
- Vice President Data Ethics Practice, SAS Worldwide Headquarters, Cary, N.C., USA
- National Artificial Intelligence Advisory Committee, Executive Office of the President of the United States, Washington, D.C., USA
| | - Jasper van Bommel
- Erasmus MC University Medical Center, Department of Adult Intensive Care, Rotterdam, The Netherlands
| | - Diederik Gommers
- Erasmus MC University Medical Center, Department of Adult Intensive Care, Rotterdam, The Netherlands
| | - Jeroen van den Hoven
- Delft University of Technology, Faculty of Technology, Policy and Management, Delft, The Netherlands
| |
Collapse
|
27
|
Yamamoto K, Sakaguchi M, Onishi A, Yokoyama S, Matsui Y, Yamamoto W, Onizawa H, Fujii T, Murata K, Tanaka M, Hashimoto M, Matsuda S, Morinobu A. Energy landscape analysis and time-series clustering analysis of patient state multistability related to rheumatoid arthritis drug treatment: The KURAMA cohort study. PLoS One 2024; 19:e0302308. [PMID: 38709812 PMCID: PMC11073743 DOI: 10.1371/journal.pone.0302308] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 04/02/2024] [Indexed: 05/08/2024] Open
Abstract
Rheumatoid arthritis causes joint inflammation due to immune abnormalities, resulting in joint pain and swelling. In recent years, there have been considerable advancements in the treatment of this disease. However, only approximately 60% of patients achieve remission. Patients with multifactorial diseases shift between states from day to day. Patients may remain in a good or poor state with few or no transitions, or they may switch between states frequently. The visualization of time-dependent state transitions, based on the evaluation axis of stable/unstable states, may provide useful information for achieving rheumatoid arthritis treatment goals. Energy landscape analysis can be used to quantitatively determine the stability/instability of each state in terms of energy. Time-series clustering is another method used to classify transitions into different groups to identify potential patterns within a time-series dataset. The objective of this study was to utilize energy landscape analysis and time-series clustering to evaluate multidimensional time-series data in terms of multistability. We profiled each patient's state transitions during treatment using energy landscape analysis and time-series clustering. Energy landscape analysis divided state transitions into two patterns: "good stability leading to remission" and "poor stability leading to treatment dead-end." The number of patients whose disease status improved increased markedly until approximately 6 months after treatment initiation and then plateaued after 1 year. Time-series clustering grouped patients into three clusters: "toward good stability," "toward poor stability," and "unstable." Patients in the "unstable" cluster are considered to have clinical courses that are difficult to predict; therefore, these patients should be treated with more care. Early disease detection and treatment initiation are important. The evaluation of state multistability enables us to understand a patient's current state in the context of overall state transitions related to rheumatoid arthritis drug treatment and to predict future state transitions.
Collapse
Affiliation(s)
- Keiichi Yamamoto
- Division of Data Science, Center for Industrial Research and Innovation, Translational Research Institute for Medical Innovation, Osaka Dental University, Hirakata City, Osaka, Japan
| | - Masahiko Sakaguchi
- Department of Engineering Informatics, Faculty of Information and Communication Engineering, Osaka Electro-Communication University, Neyagawa City, Osaka, Japan
| | - Akira Onishi
- Department of Advanced Medicine for Rheumatic Diseases, Kyoto University Graduate School of Medicine, Sakyo, Kyoto, Japan
| | | | | | - Wataru Yamamoto
- Department of Advanced Medicine for Rheumatic Diseases, Kyoto University Graduate School of Medicine, Sakyo, Kyoto, Japan
- Department of Health Information Management, Kurashiki Sweet Hospital, Nakasho, Kurashiki, Kurashiki City, Okayama Prefecture, Japan
| | - Hideo Onizawa
- Department of Advanced Medicine for Rheumatic Diseases, Kyoto University Graduate School of Medicine, Sakyo, Kyoto, Japan
| | - Takayuki Fujii
- Department of Advanced Medicine for Rheumatic Diseases, Kyoto University Graduate School of Medicine, Sakyo, Kyoto, Japan
| | - Koichi Murata
- Department of Advanced Medicine for Rheumatic Diseases, Kyoto University Graduate School of Medicine, Sakyo, Kyoto, Japan
| | - Masao Tanaka
- Department of Advanced Medicine for Rheumatic Diseases, Kyoto University Graduate School of Medicine, Sakyo, Kyoto, Japan
| | - Motomu Hashimoto
- Department of Clinical Immunology, Osaka Metropolitan University Graduate School of Medicine, Osaka City, Japan
| | - Shuichi Matsuda
- Department of Advanced Medicine for Rheumatic Diseases, Kyoto University Graduate School of Medicine, Sakyo, Kyoto, Japan
| | - Akio Morinobu
- Department of Advanced Medicine for Rheumatic Diseases, Kyoto University Graduate School of Medicine, Sakyo, Kyoto, Japan
| |
Collapse
|
28
|
Visram S, Rogers Y, Sebire NJ. Developing a conceptual framework for the early adoption of healthcare technologies in hospitals. Nat Med 2024; 30:1222-1224. [PMID: 38459179 DOI: 10.1038/s41591-024-02860-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/10/2024]
Affiliation(s)
- Sheena Visram
- Data Research, Innovation and Virtual Environments (DRIVE), NIHR Great Ormond Street Hospital Biomedical Research Centre, London, UK.
- UCL Interaction Centre, Department of Computer Science, University College London, London, UK.
| | - Yvonne Rogers
- UCL Interaction Centre, Department of Computer Science, University College London, London, UK
| | - Neil J Sebire
- Data Research, Innovation and Virtual Environments (DRIVE), NIHR Great Ormond Street Hospital Biomedical Research Centre, London, UK
| |
Collapse
|
29
|
Klawunn R, Albrecht UV, Katzmarzyk D, Dierks ML. Beyond technology acceptance-a focused ethnography on the implementation, acceptance and use of new nursing technology in a German hospital. Front Digit Health 2024; 6:1330988. [PMID: 38736709 PMCID: PMC11085260 DOI: 10.3389/fdgth.2024.1330988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Accepted: 04/11/2024] [Indexed: 05/14/2024] Open
Abstract
Introduction Hospitalised patients could benefit from the emergence of novel technologies for nursing care. There are numerous technical products available, but these rarely find their way into practice. Further knowledge is required about the circumstances under which technology in nursing is accepted and used. In the research project "Centre for Implementing Nursing Care Innovations", technical innovations are implemented on a trauma surgery inpatient ward in Germany. After implementation, it was investigated: Which implemented technologies are accepted/rejected, and which factors influence the acceptance/rejection of technology for nurses? Material and methods A focused ethnography was used, containing two approaches: First, participant observation was conducted to examine nurses' and patients' interaction with technologies. Observations were fixed in a field research diary and analysed using evaluative qualitative content analysis. Second, a questionnaire was used by nurses to provide information about the use frequency and technology suitability. The results of the study were consolidated and analysed using the UTAUT model. Results Seven studied technologies can be summarised in four result categories: (1) A Mobilising mattress, a Special projector and a Sound pillow are accepted and used by nurses and patients, because they offer a way to provide high quality care with little additional effort. (2) A Fall prevention system is consistently used in patient care as a work obligation, but since nurses consider the system error-prone, acceptance is low. (3) An Interactive therapy ball is accepted but nurses cannot use it due to the high workload. (4) An App for nurse-patient communication and a work-equipment tracking system are not used or accepted because nurses do not see a practical benefit in the systems. Discussion Acceptance or rejection of a product does not necessarily equate to use or non-use of the technology. Before implementation, technology acceptance among users occurs as prejudice-when users are given time to experiment with technology, intention-to-use can stabilize into sustained use. Accepted and used technologies can serve to mask problems (such as staff shortages) and encourage problematic developments, such as the reduction of contact time at the bedside. Therefore, technology acceptance should be qualified in asking to what accepted technology contributes.
Collapse
Affiliation(s)
- Ronny Klawunn
- Department for Patient Orientation and Health Education, Institute for Epidemiology, Social Medicine and Health System Research, Hannover Medical School (MHH), Hanover, Germany
| | - Urs-Vito Albrecht
- Department of Digital Medicine, Medical Faculty OWL, Bielefeld University, Bielefeld, Germany
| | - Deliah Katzmarzyk
- Department for Patient Orientation and Health Education, Institute for Epidemiology, Social Medicine and Health System Research, Hannover Medical School (MHH), Hanover, Germany
| | - Marie-Luise Dierks
- Department for Patient Orientation and Health Education, Institute for Epidemiology, Social Medicine and Health System Research, Hannover Medical School (MHH), Hanover, Germany
| |
Collapse
|
30
|
Isangula KG, Haule RJ. Leveraging AI and Machine Learning to Develop and Evaluate a Contextualized User-Friendly Cough Audio Classifier for Detecting Respiratory Diseases: Protocol for a Diagnostic Study in Rural Tanzania. JMIR Res Protoc 2024; 13:e54388. [PMID: 38652526 PMCID: PMC11077412 DOI: 10.2196/54388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 02/14/2024] [Accepted: 02/21/2024] [Indexed: 04/25/2024] Open
Abstract
BACKGROUND Respiratory diseases, including active tuberculosis (TB), asthma, and chronic obstructive pulmonary disease (COPD), constitute substantial global health challenges, necessitating timely and accurate diagnosis for effective treatment and management. OBJECTIVE This research seeks to develop and evaluate a noninvasive user-friendly artificial intelligence (AI)-powered cough audio classifier for detecting these respiratory conditions in rural Tanzania. METHODS This is a nonexperimental cross-sectional research with the primary objective of collection and analysis of cough sounds from patients with active TB, asthma, and COPD in outpatient clinics to generate and evaluate a noninvasive cough audio classifier. Specialized cough sound recording devices, designed to be nonintrusive and user-friendly, will facilitate the collection of diverse cough sound samples from patients attending outpatient clinics in 20 health care facilities in the Shinyanga region. The collected cough sound data will undergo rigorous analysis, using advanced AI signal processing and machine learning techniques. By comparing acoustic features and patterns associated with TB, asthma, and COPD, a robust algorithm capable of automated disease discrimination will be generated facilitating the development of a smartphone-based cough sound classifier. The classifier will be evaluated against the calculated reference standards including clinical assessments, sputum smear, GeneXpert, chest x-ray, culture and sensitivity, spirometry and peak expiratory flow, and sensitivity and predictive values. RESULTS This research represents a vital step toward enhancing the diagnostic capabilities available in outpatient clinics, with the potential to revolutionize the field of respiratory disease diagnosis. Findings from the 4 phases of the study will be presented as descriptions supported by relevant images, tables, and figures. The anticipated outcome of this research is the creation of a reliable, noninvasive diagnostic cough classifier that empowers health care professionals and patients themselves to identify and differentiate these respiratory diseases based on cough sound patterns. CONCLUSIONS Cough sound classifiers use advanced technology for early detection and management of respiratory conditions, offering a less invasive and more efficient alternative to traditional diagnostics. This technology promises to ease public health burdens, improve patient outcomes, and enhance health care access in under-resourced areas, potentially transforming respiratory disease management globally. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) PRR1-10.2196/54388.
Collapse
Affiliation(s)
- Kahabi Ganka Isangula
- School of Nursing and Midwifery, Aga Khan University, Dar Es Salaam, United Republic of Tanzania
| | - Rogers John Haule
- School of Nursing and Midwifery, Aga Khan University, Dar Es Salaam, United Republic of Tanzania
| |
Collapse
|
31
|
Pinsky MR, Bedoya A, Bihorac A, Celi L, Churpek M, Economou-Zavlanos NJ, Elbers P, Saria S, Liu V, Lyons PG, Shickel B, Toral P, Tscholl D, Clermont G. Use of artificial intelligence in critical care: opportunities and obstacles. Crit Care 2024; 28:113. [PMID: 38589940 PMCID: PMC11000355 DOI: 10.1186/s13054-024-04860-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2024] [Accepted: 03/05/2024] [Indexed: 04/10/2024] Open
Abstract
BACKGROUND Perhaps nowhere else in the healthcare system than in the intensive care unit environment are the challenges to create useful models with direct time-critical clinical applications more relevant and the obstacles to achieving those goals more massive. Machine learning-based artificial intelligence (AI) techniques to define states and predict future events are commonplace activities of modern life. However, their penetration into acute care medicine has been slow, stuttering and uneven. Major obstacles to widespread effective application of AI approaches to the real-time care of the critically ill patient exist and need to be addressed. MAIN BODY Clinical decision support systems (CDSSs) in acute and critical care environments support clinicians, not replace them at the bedside. As will be discussed in this review, the reasons are many and include the immaturity of AI-based systems to have situational awareness, the fundamental bias in many large databases that do not reflect the target population of patient being treated making fairness an important issue to address and technical barriers to the timely access to valid data and its display in a fashion useful for clinical workflow. The inherent "black-box" nature of many predictive algorithms and CDSS makes trustworthiness and acceptance by the medical community difficult. Logistically, collating and curating in real-time multidimensional data streams of various sources needed to inform the algorithms and ultimately display relevant clinical decisions support format that adapt to individual patient responses and signatures represent the efferent limb of these systems and is often ignored during initial validation efforts. Similarly, legal and commercial barriers to the access to many existing clinical databases limit studies to address fairness and generalizability of predictive models and management tools. CONCLUSIONS AI-based CDSS are evolving and are here to stay. It is our obligation to be good shepherds of their use and further development.
Collapse
Affiliation(s)
- Michael R Pinsky
- Department of Critical Care Medicine, School of Medicine, University of Pittsburgh, 638 Scaife Hall, 3550 Terrace Street, Pittsburgh, PA, 15261, USA.
| | - Armando Bedoya
- Algorithm-Based Clinical Decision Support (ABCDS) Oversight, Office of Vice Dean of Data Science, School of Medicine, Duke University, Durham, NC, 27705, USA
- Division of Pulmonary Critical Care Medicine, Duke University School of Medicine, Durham, NC, 27713, USA
| | - Azra Bihorac
- Department of Medicine, University of Florida College of Medicine Gainesville, Malachowsky Hall, 1889 Museum Road, Suite 2410, Gainesville, FL, 32611, USA
| | - Leo Celi
- Laboratory for Computational Physiology, Massachusetts Institute of Technology, Cambridge, MA, 02139, USA
| | - Matthew Churpek
- Department of Medicine, University of Wisconsin, 600 Highland Ave, Madison, WI, 53792, USA
| | - Nicoleta J Economou-Zavlanos
- Algorithm-Based Clinical Decision Support (ABCDS) Oversight, Office of Vice Dean of Data Science, School of Medicine, Duke University, Durham, NC, 27705, USA
| | - Paul Elbers
- Department of Intensive Care, Amsterdam UMC, Amsterdam, NL, USA
- Amsterdam UMC, ZH.7D.167, De Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands
| | - Suchi Saria
- Department of Computer Science, Whiting School of Engineering, Johns Hopkins Medical Institutions, Johns Hopkins University, 333 Malone Hall, 300 Wolfe Street, Baltimore, MD, USA
- Department of Medicine, Johns Hopkins School of Medicine, AI and Health Lab, Johns Hopkins University, Baltimore, MD, USA
- Bayesian Health, New york, NY, 10282, USA
| | - Vincent Liu
- Department of Medicine, Oregon Health & Science University, 3181 S.W. Sam Jackson Park Road, Mail Code UHN67, Portland, OR, 97239-3098, USA
- , 2000 Broadway, Oakland, CA, 94612, USA
| | - Patrick G Lyons
- Department of Medicine, Oregon Health & Science University, 3181 S.W. Sam Jackson Park Road, Mail Code UHN67, Portland, OR, 97239-3098, USA
| | - Benjamin Shickel
- Department of Medicine, University of Florida College of Medicine Gainesville, Malachowsky Hall, 1889 Museum Road, Suite 2410, Gainesville, FL, 32611, USA
- Amsterdam UMC, ZH.7D.167, De Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands
| | - Patrick Toral
- Department of Intensive Care, Amsterdam UMC, Amsterdam, NL, USA
- Amsterdam UMC, ZH.7D.165, De Boelelaan 1117, 1081 HV, Amsterdam, The Netherlands
| | - David Tscholl
- Institute of Anesthesiology, University Hospital Zurich, University of Zurich, Frauenklinikstrasse 10, 8091, Zurich, Switzerland
| | - Gilles Clermont
- Department of Critical Care Medicine, School of Medicine, University of Pittsburgh, 638 Scaife Hall, 3550 Terrace Street, Pittsburgh, PA, 15261, USA
- VA Pittsburgh Health System, 131A Building 30, 4100 Allequippa St, Pittsburgh, PA, 15240, USA
| |
Collapse
|
32
|
Maris MT, Koçar A, Willems DL, Pols J, Tan HL, Lindinger GL, Bak MAR. Ethical use of artificial intelligence to prevent sudden cardiac death: an interview study of patient perspectives. BMC Med Ethics 2024; 25:42. [PMID: 38575931 PMCID: PMC10996273 DOI: 10.1186/s12910-024-01042-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Accepted: 03/27/2024] [Indexed: 04/06/2024] Open
Abstract
BACKGROUND The emergence of artificial intelligence (AI) in medicine has prompted the development of numerous ethical guidelines, while the involvement of patients in the creation of these documents lags behind. As part of the European PROFID project we explore patient perspectives on the ethical implications of AI in care for patients at increased risk of sudden cardiac death (SCD). AIM Explore perspectives of patients on the ethical use of AI, particularly in clinical decision-making regarding the implantation of an implantable cardioverter-defibrillator (ICD). METHODS Semi-structured, future scenario-based interviews were conducted among patients who had either an ICD and/or a heart condition with increased risk of SCD in Germany (n = 9) and the Netherlands (n = 15). We used the principles of the European Commission's Ethics Guidelines for Trustworthy AI to structure the interviews. RESULTS Six themes arose from the interviews: the ability of AI to rectify human doctors' limitations; the objectivity of data; whether AI can serve as second opinion; AI explainability and patient trust; the importance of the 'human touch'; and the personalization of care. Overall, our results reveal a strong desire among patients for more personalized and patient-centered care in the context of ICD implantation. Participants in our study express significant concerns about the further loss of the 'human touch' in healthcare when AI is introduced in clinical settings. They believe that this aspect of care is currently inadequately recognized in clinical practice. Participants attribute to doctors the responsibility of evaluating AI recommendations for clinical relevance and aligning them with patients' individual contexts and values, in consultation with the patient. CONCLUSION The 'human touch' patients exclusively ascribe to human medical practitioners extends beyond sympathy and kindness, and has clinical relevance in medical decision-making. Because this cannot be replaced by AI, we suggest that normative research into the 'right to a human doctor' is needed. Furthermore, policies on patient-centered AI integration in clinical practice should encompass the ethics of everyday practice rather than only principle-based ethics. We suggest that an empirical ethics approach grounded in ethnographic research is exceptionally well-suited to pave the way forward.
Collapse
Affiliation(s)
- Menno T Maris
- Department of Ethics, Law and Humanities, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands.
| | - Ayca Koçar
- Institute for Healthcare Management and Health Sciences, University of Bayreuth, Bayreuth, Germany
| | - Dick L Willems
- Department of Ethics, Law and Humanities, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
| | - Jeannette Pols
- Department of Ethics, Law and Humanities, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
- Department of Anthropology, University of Amsterdam, Amsterdam, The Netherlands
| | - Hanno L Tan
- Department of Clinical and Experimental Cardiology, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
- Netherlands Heart Institute, Utrecht, The Netherlands
| | - Georg L Lindinger
- Institute for Healthcare Management and Health Sciences, University of Bayreuth, Bayreuth, Germany
| | - Marieke A R Bak
- Department of Ethics, Law and Humanities, Amsterdam UMC, University of Amsterdam, Amsterdam, The Netherlands
- Institute of History and Ethics in Medicine, TUM School of Medicine, Technical University of Munich, Munich, Germany
| |
Collapse
|
33
|
Kim JP, Yang HJ, Kim B, Ryan K, Roberts LW. Understanding Physician's Perspectives on AI in Health Care: Protocol for a Sequential Multiple Assignment Randomized Vignette Study. JMIR Res Protoc 2024; 13:e54787. [PMID: 38573756 PMCID: PMC11027055 DOI: 10.2196/54787] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Revised: 01/11/2024] [Accepted: 02/06/2024] [Indexed: 04/05/2024] Open
Abstract
BACKGROUND As the availability and performance of artificial intelligence (AI)-based clinical decision support (CDS) systems improve, physicians and other care providers poised to be on the front lines will be increasingly tasked with using these tools in patient care and incorporating their outputs into clinical decision-making processes. Vignette studies provide a means to explore emerging hypotheses regarding how context-specific factors, such as clinical risk, the amount of information provided about the AI, and the AI result, may impact physician acceptance and use of AI-based CDS tools. To best anticipate how such factors influence the decision-making of frontline physicians in clinical scenarios involving AI decision-support tools, hypothesis-driven research is needed that enables scenario testing before the implementation and deployment of these tools. OBJECTIVE This study's objectives are to (1) design an original, web-based vignette-based survey that features hypothetical scenarios based on emerging or real-world applications of AI-based CDS systems that will vary systematically by features related to clinical risk, the amount of information provided about the AI, and the AI result; and (2) test and determine causal effects of specific factors on the judgments and perceptions salient to physicians' clinical decision-making. METHODS US-based physicians with specialties in family or internal medicine will be recruited through email and mail (target n=420). Through a web-based survey, participants will be randomized to a 3-part "sequential multiple assignment randomization trial (SMART) vignette" detailing a hypothetical clinical scenario involving an AI decision support tool. The SMART vignette design is similar to the SMART design but adapted to a survey design. Each respondent will be randomly assigned to 1 of the possible vignette variations of the factors we are testing at each stage, which include the level of clinical risk, the amount of information provided about the AI, and the certainty of the AI output. Respondents will be given questions regarding their hypothetical decision-making in response to the hypothetical scenarios. RESULTS The study is currently in progress and data collection is anticipated to be completed in 2024. CONCLUSIONS The web-based vignette study will provide information on how contextual factors such as clinical risk, the amount of information provided about an AI tool, and the AI result influence physicians' reactions to hypothetical scenarios that are based on emerging applications of AI in frontline health care settings. Our newly proposed "SMART vignette" design offers several benefits not afforded by the extensively used traditional vignette design, due to the 2 aforementioned features. These advantages are (1) increased validity of analyses targeted at understanding the impact of a factor on the decision outcome, given previous outcomes and other contextual factors; and (2) balanced sample sizes across groups. This study will generate a better understanding of physician decision-making within this context. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/54787.
Collapse
Affiliation(s)
- Jane Paik Kim
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, United States
| | - Hyun-Joon Yang
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, United States
| | - Bohye Kim
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, United States
| | - Katie Ryan
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, United States
| | - Laura Weiss Roberts
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, United States
| |
Collapse
|
34
|
Sideris K, Weir CR, Schmalfuss C, Hanson H, Pipke M, Tseng PH, Lewis N, Sallam K, Bozkurt B, Hanff T, Schofield R, Larimer K, Kyriakopoulos CP, Taleb I, Brinker L, Curry T, Knecht C, Butler JM, Stehlik J. Artificial intelligence predictive analytics in heart failure: results of the pilot phase of a pragmatic randomized clinical trial. J Am Med Inform Assoc 2024; 31:919-928. [PMID: 38341800 PMCID: PMC10990545 DOI: 10.1093/jamia/ocae017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Revised: 12/20/2023] [Accepted: 01/17/2024] [Indexed: 02/13/2024] Open
Abstract
OBJECTIVES We conducted an implementation planning process during the pilot phase of a pragmatic trial, which tests an intervention guided by artificial intelligence (AI) analytics sourced from noninvasive monitoring data in heart failure patients (LINK-HF2). MATERIALS AND METHODS A mixed-method analysis was conducted at 2 pilot sites. Interviews were conducted with 12 of 27 enrolled patients and with 13 participating clinicians. iPARIHS constructs were used for interview construction to identify workflow, communication patterns, and clinician's beliefs. Interviews were transcribed and analyzed using inductive coding protocols to identify key themes. Behavioral response data from the AI-generated notifications were collected. RESULTS Clinicians responded to notifications within 24 hours in 95% of instances, with 26.7% resulting in clinical action. Four implementation themes emerged: (1) High anticipatory expectations for reliable patient communications, reduced patient burden, and less proactive provider monitoring. (2) The AI notifications required a differential and tailored balance of trust and action advice related to role. (3) Clinic experience with other home-based programs influenced utilization. (4) Responding to notifications involved significant effort, including electronic health record (EHR) review, patient contact, and consultation with other clinicians. DISCUSSION Clinician's use of AI data is a function of beliefs regarding the trustworthiness and usefulness of the data, the degree of autonomy in professional roles, and the cognitive effort involved. CONCLUSION The implementation planning analysis guided development of strategies that addressed communication technology, patient education, and EHR integration to reduce clinician and patient burden in the subsequent main randomized phase of the trial. Our results provide important insights into the unique implications of implementing AI analytics into clinical workflow.
Collapse
Affiliation(s)
- Konstantinos Sideris
- Cardiology Section, Medical Service, George E. Wahlen Department of Veterans Affairs Medical Center, Salt Lake City, UT 84148, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Utah, Salt Lake City, UT 84112, United States
| | - Charlene R Weir
- Cardiology Section, Medical Service, George E. Wahlen Department of Veterans Affairs Medical Center, Salt Lake City, UT 84148, United States
- Department of Biomedical Informatics, School of Medicine, University of Utah, Salt Lake City, UT 84108, United States
| | - Carsten Schmalfuss
- Cardiology Section, Medical Service, Malcom Randall VA Medical Center, Gainesville, FL 32608, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Florida College of Medicine, Gainesville, FL 32610, United States
| | - Heather Hanson
- Cardiology Section, Medical Service, George E. Wahlen Department of Veterans Affairs Medical Center, Salt Lake City, UT 84148, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Utah, Salt Lake City, UT 84112, United States
| | - Matt Pipke
- PhysIQ, Inc., Chicago, IL 60563, United States
| | - Po-He Tseng
- PhysIQ, Inc., Chicago, IL 60563, United States
| | - Neil Lewis
- Cardiology Section, Medical Service, Hunter Holmes McGuire Veterans Medical Center, Richmond, VA 23249, United States
- Department of Internal Medicine, Division of Cardiovascular Disease, Virginia Commonwealth University, Richmond, VA 23249, United States
| | - Karim Sallam
- Cardiology Section, Medical Service, VA Palo Alto Health Care System, Palo Alto, CA 94304, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, Stanford University School of Medicine, Stanford, CA 94305, United States
| | - Biykem Bozkurt
- Cardiology Section, Medical Service, Michael E. DeBakey VA Medical Center, Houston, TX 77030, United States
- Section of Cardiology, Department of Medicine, Baylor College of Medicine, Houston, TX 77030, United States
| | - Thomas Hanff
- Cardiology Section, Medical Service, George E. Wahlen Department of Veterans Affairs Medical Center, Salt Lake City, UT 84148, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Utah, Salt Lake City, UT 84112, United States
| | - Richard Schofield
- Cardiology Section, Medical Service, Malcom Randall VA Medical Center, Gainesville, FL 32608, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Florida College of Medicine, Gainesville, FL 32610, United States
| | | | - Christos P Kyriakopoulos
- Cardiology Section, Medical Service, George E. Wahlen Department of Veterans Affairs Medical Center, Salt Lake City, UT 84148, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Utah, Salt Lake City, UT 84112, United States
| | - Iosif Taleb
- Cardiology Section, Medical Service, George E. Wahlen Department of Veterans Affairs Medical Center, Salt Lake City, UT 84148, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Utah, Salt Lake City, UT 84112, United States
| | - Lina Brinker
- Cardiology Section, Medical Service, George E. Wahlen Department of Veterans Affairs Medical Center, Salt Lake City, UT 84148, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Utah, Salt Lake City, UT 84112, United States
| | - Tempa Curry
- Cardiology Section, Medical Service, Malcom Randall VA Medical Center, Gainesville, FL 32608, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Florida College of Medicine, Gainesville, FL 32610, United States
| | - Cheri Knecht
- Cardiology Section, Medical Service, Malcom Randall VA Medical Center, Gainesville, FL 32608, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Florida College of Medicine, Gainesville, FL 32610, United States
| | - Jorie M Butler
- Cardiology Section, Medical Service, George E. Wahlen Department of Veterans Affairs Medical Center, Salt Lake City, UT 84148, United States
- Department of Biomedical Informatics, School of Medicine, University of Utah, Salt Lake City, UT 84108, United States
| | - Josef Stehlik
- Cardiology Section, Medical Service, George E. Wahlen Department of Veterans Affairs Medical Center, Salt Lake City, UT 84148, United States
- Division of Cardiovascular Medicine, Department of Internal Medicine, University of Utah, Salt Lake City, UT 84112, United States
| |
Collapse
|
35
|
Fernstad J, Svennberg E, Åberg P, Kemp Gudmundsdottir K, Jansson A, Engdahl J. Validation of a novel smartphone-based photoplethysmographic method for ambulatory heart rhythm diagnostics: the SMARTBEATS study. Europace 2024; 26:euae079. [PMID: 38533836 PMCID: PMC11023506 DOI: 10.1093/europace/euae079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2024] [Accepted: 03/24/2024] [Indexed: 03/28/2024] Open
Abstract
AIMS In the current guidelines, smartphone photoplethysmography (PPG) is not recommended for diagnosis of atrial fibrillation (AF), without a confirmatory electrocardiogram (ECG) recording. Previous validation studies have been performed under supervision in healthcare settings, with limited generalizability of the results. We aim to investigate the diagnostic performance of a smartphone-PPG method in a real-world setting, with ambulatory unsupervised smartphone-PPG recordings, compared with simultaneous ECG recordings and including patients with atrial flutter (AFL). METHODS AND RESULTS Unselected patients undergoing direct current cardioversion for treatment of AF or AFL were asked to perform 1-min heart rhythm recordings post-treatment, at least twice daily for 30 days at home, using an iPhone 7 smartphone running the CORAI Heart Monitor PPG application simultaneously with a single-lead ECG recording (KardiaMobile). Photoplethysmography and ECG recordings were read independently by two experienced readers. In total, 280 patients recorded 18 005 simultaneous PPG and ECG recordings. Sufficient quality for diagnosis was seen in 96.9% (PPG) vs. 95.1% (ECG) of the recordings (P < 0.001). Manual reading of the PPG recordings, compared with manually interpreted ECG recordings, had a sensitivity, specificity, and overall accuracy of 97.7%, 99.4%, and 98.9% with AFL recordings included and 99.0%, 99.7%, and 99.5%, respectively, with AFL recordings excluded. CONCLUSION A novel smartphone-PPG method can be used by patients unsupervised at home to achieve accurate heart rhythm diagnostics of AF and AFL with very high sensitivity and specificity. This smartphone-PPG device can be used as an independent heart rhythm diagnostic device following cardioversion, without the requirement of confirmation with ECG.
Collapse
Affiliation(s)
- Jonatan Fernstad
- Karolinska Institutet, Department of Clinical Sciences, Danderyd University Hospital, Entrévägen 2, 182 88, Stockholm, Sweden
- Department of Cardiology, Danderyd University Hospital, Entrévägen 2, 182 88, Stockholm, Sweden
| | - Emma Svennberg
- Karolinska Institutet, Department of Medicine, Huddinge, Karolinska University Hospital, Stockholm, Sweden
| | - Peter Åberg
- Karolinska Institutet, Department of Clinical Sciences, Danderyd University Hospital, Entrévägen 2, 182 88, Stockholm, Sweden
| | - Katrin Kemp Gudmundsdottir
- Karolinska Institutet, Department of Clinical Sciences, Danderyd University Hospital, Entrévägen 2, 182 88, Stockholm, Sweden
| | - Anders Jansson
- Department of Clinical Physiology, Danderyd University Hospital, Stockholm, Sweden
| | - Johan Engdahl
- Karolinska Institutet, Department of Clinical Sciences, Danderyd University Hospital, Entrévägen 2, 182 88, Stockholm, Sweden
- Department of Cardiology, Danderyd University Hospital, Entrévägen 2, 182 88, Stockholm, Sweden
| |
Collapse
|
36
|
Hölgyesi Á, Zrubka Z, Gulácsi L, Baji P, Haidegger T, Kozlovszky M, Weszl M, Kovács L, Péntek M. Robot-assisted surgery and artificial intelligence-based tumour diagnostics: social preferences with a representative cross-sectional survey. BMC Med Inform Decis Mak 2024; 24:87. [PMID: 38553703 PMCID: PMC10981282 DOI: 10.1186/s12911-024-02470-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2023] [Accepted: 02/26/2024] [Indexed: 04/01/2024] Open
Abstract
BACKGROUND The aim of this study was to assess social preferences for two different advanced digital health technologies and investigate the contextual dependency of the preferences. METHODS A cross-sectional online survey was performed among the general population of Hungary aged 40 years and over. Participants were asked to imagine that they needed a total hip replacement surgery and to indicate whether they would prefer a traditional or a robot-assisted (RA) hip surgery. To better understand preferences for the chosen method, the willingness to pay (WTP) method was used. The same assessment was conducted for preferences between a radiologist's and AI-based image analysis in establishing the radiological diagnosis of a suspected tumour. Respondents' electronic health literacy was assessed with the eHEALS questionnaire. Descriptive methods were used to assess sample characteristics and differences between subgroups. Associations were investigated with correlation analysis and multiple linear regressions. RESULTS Altogether, 1400 individuals (53.7% female) with a mean age of 58.3 (SD = 11.1) years filled in the survey. RA hip surgery was chosen by 762 (54.4%) respondents, but only 470 (33.6%) chose AI-based medical image evaluation. Those who opted for the digital technology had significantly higher educational levels and electronic health literacy (eHEALS). The majority of respondents were willing to pay to secure their preferred surgical (surgeon 67.2%, robot-assisted: 68.8%) and image assessment (radiologist: 70.9%; AI: 77.4%) methods, reporting similar average amounts in the first (p = 0.677), and a significantly higher average amount for radiologist vs. AI in the second task (p = 0.001). The regression showed a significant association between WTP and income, and in the hip surgery task, it also revealed an association with the type of intervention chosen. CONCLUSIONS Individuals with higher education levels seem to accept the advanced digital medical technologies more. However, the greater openness for RA surgery than for AI image assessment highlights that social preferences may depend considerably on the medical situation and the type of advanced digital technology. WTP results suggest rather firm preferences in the great majority of the cases. Determinants of preferences and real-world choices of affected patients should be further investigated in future studies.
Collapse
Affiliation(s)
- Áron Hölgyesi
- Doctoral School, Semmelweis University, Budapest, Hungary.
- Health Economics Research Center, University Research and Innovation Center (EKIK), Óbuda University, Budapest, Hungary.
| | - Zsombor Zrubka
- Health Economics Research Center, University Research and Innovation Center (EKIK), Óbuda University, Budapest, Hungary
| | - László Gulácsi
- Health Economics Research Center, University Research and Innovation Center (EKIK), Óbuda University, Budapest, Hungary
| | - Petra Baji
- Musculoskeletal Research Unit, University of Bristol, Bristol, UK
| | - Tamás Haidegger
- Antal Bejczy Center for Intelligent Robotics, University Research and Innovation Center (EKIK) , Óbuda University, Budapest, Hungary
- Austrian Center for Medical Innovation and Technology (ACMIT) , Wiener Neustadt, Austria
| | - Miklós Kozlovszky
- BioTech Research Center, University Research and Innovation Center (EKIK) , Óbuda University, Budapest, Hungary
- John von Neumann Faculty of Informatics, Óbuda University, Budapest, Hungary
| | - Miklós Weszl
- Department of Translational Medicine, Semmelweis University, Budapest, Hungary
| | - Levente Kovács
- Physiological Controls Research Center, University Research and Innovation Center (EKIK) , Óbuda University, Budapest, Hungary
| | - Márta Péntek
- Health Economics Research Center, University Research and Innovation Center (EKIK), Óbuda University, Budapest, Hungary
| |
Collapse
|
37
|
Reddy S. Generative AI in healthcare: an implementation science informed translational path on application, integration and governance. Implement Sci 2024; 19:27. [PMID: 38491544 PMCID: PMC10941464 DOI: 10.1186/s13012-024-01357-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 03/06/2024] [Indexed: 03/18/2024] Open
Abstract
BACKGROUND Artificial intelligence (AI), particularly generative AI, has emerged as a transformative tool in healthcare, with the potential to revolutionize clinical decision-making and improve health outcomes. Generative AI, capable of generating new data such as text and images, holds promise in enhancing patient care, revolutionizing disease diagnosis and expanding treatment options. However, the utility and impact of generative AI in healthcare remain poorly understood, with concerns around ethical and medico-legal implications, integration into healthcare service delivery and workforce utilisation. Also, there is not a clear pathway to implement and integrate generative AI in healthcare delivery. METHODS This article aims to provide a comprehensive overview of the use of generative AI in healthcare, focusing on the utility of the technology in healthcare and its translational application highlighting the need for careful planning, execution and management of expectations in adopting generative AI in clinical medicine. Key considerations include factors such as data privacy, security and the irreplaceable role of clinicians' expertise. Frameworks like the technology acceptance model (TAM) and the Non-Adoption, Abandonment, Scale-up, Spread and Sustainability (NASSS) model are considered to promote responsible integration. These frameworks allow anticipating and proactively addressing barriers to adoption, facilitating stakeholder participation and responsibly transitioning care systems to harness generative AI's potential. RESULTS Generative AI has the potential to transform healthcare through automated systems, enhanced clinical decision-making and democratization of expertise with diagnostic support tools providing timely, personalized suggestions. Generative AI applications across billing, diagnosis, treatment and research can also make healthcare delivery more efficient, equitable and effective. However, integration of generative AI necessitates meticulous change management and risk mitigation strategies. Technological capabilities alone cannot shift complex care ecosystems overnight; rather, structured adoption programs grounded in implementation science are imperative. CONCLUSIONS It is strongly argued in this article that generative AI can usher in tremendous healthcare progress, if introduced responsibly. Strategic adoption based on implementation science, incremental deployment and balanced messaging around opportunities versus limitations helps promote safe, ethical generative AI integration. Extensive real-world piloting and iteration aligned to clinical priorities should drive development. With conscientious governance centred on human wellbeing over technological novelty, generative AI can enhance accessibility, affordability and quality of care. As these models continue advancing rapidly, ongoing reassessment and transparent communication around their strengths and weaknesses remain vital to restoring trust, realizing positive potential and, most importantly, improving patient outcomes.
Collapse
Affiliation(s)
- Sandeep Reddy
- Deakin School of Medicine, Waurn Ponds, Geelong, VIC, 3215, Australia.
| |
Collapse
|
38
|
Park YJ, Pillai A, Deng J, Guo E, Gupta M, Paget M, Naugler C. Assessing the research landscape and clinical utility of large language models: a scoping review. BMC Med Inform Decis Mak 2024; 24:72. [PMID: 38475802 PMCID: PMC10936025 DOI: 10.1186/s12911-024-02459-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2023] [Accepted: 02/12/2024] [Indexed: 03/14/2024] Open
Abstract
IMPORTANCE Large language models (LLMs) like OpenAI's ChatGPT are powerful generative systems that rapidly synthesize natural language responses. Research on LLMs has revealed their potential and pitfalls, especially in clinical settings. However, the evolving landscape of LLM research in medicine has left several gaps regarding their evaluation, application, and evidence base. OBJECTIVE This scoping review aims to (1) summarize current research evidence on the accuracy and efficacy of LLMs in medical applications, (2) discuss the ethical, legal, logistical, and socioeconomic implications of LLM use in clinical settings, (3) explore barriers and facilitators to LLM implementation in healthcare, (4) propose a standardized evaluation framework for assessing LLMs' clinical utility, and (5) identify evidence gaps and propose future research directions for LLMs in clinical applications. EVIDENCE REVIEW We screened 4,036 records from MEDLINE, EMBASE, CINAHL, medRxiv, bioRxiv, and arXiv from January 2023 (inception of the search) to June 26, 2023 for English-language papers and analyzed findings from 55 worldwide studies. Quality of evidence was reported based on the Oxford Centre for Evidence-based Medicine recommendations. FINDINGS Our results demonstrate that LLMs show promise in compiling patient notes, assisting patients in navigating the healthcare system, and to some extent, supporting clinical decision-making when combined with human oversight. However, their utilization is limited by biases in training data that may harm patients, the generation of inaccurate but convincing information, and ethical, legal, socioeconomic, and privacy concerns. We also identified a lack of standardized methods for evaluating LLMs' effectiveness and feasibility. CONCLUSIONS AND RELEVANCE This review thus highlights potential future directions and questions to address these limitations and to further explore LLMs' potential in enhancing healthcare delivery.
Collapse
Affiliation(s)
- Ye-Jean Park
- Temerty Faculty of Medicine, University of Toronto, 1 King's College Cir, M5S 1A8, Toronto, ON, Canada.
| | - Abhinav Pillai
- Cumming School of Medicine, University of Calgary, 3330 Hospital Dr NW, T2N 4N1, Calgary, AB, Canada
| | - Jiawen Deng
- Temerty Faculty of Medicine, University of Toronto, 1 King's College Cir, M5S 1A8, Toronto, ON, Canada
| | - Eddie Guo
- Cumming School of Medicine, University of Calgary, 3330 Hospital Dr NW, T2N 4N1, Calgary, AB, Canada
| | - Mehul Gupta
- Cumming School of Medicine, University of Calgary, 3330 Hospital Dr NW, T2N 4N1, Calgary, AB, Canada
| | - Mike Paget
- Cumming School of Medicine, University of Calgary, 3330 Hospital Dr NW, T2N 4N1, Calgary, AB, Canada
| | - Christopher Naugler
- Cumming School of Medicine, University of Calgary, 3330 Hospital Dr NW, T2N 4N1, Calgary, AB, Canada
| |
Collapse
|
39
|
Pinker K. Implementing AI in breast imaging: challenges to turn the gadget into gain. Eur Radiol 2024; 34:2093-2095. [PMID: 37667145 DOI: 10.1007/s00330-023-10205-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Revised: 08/07/2023] [Accepted: 08/17/2023] [Indexed: 09/06/2023]
Affiliation(s)
- Katja Pinker
- Department of Radiology - Breast Imaging Service, Memorial Sloan Kettering Cancer Center, 300 E 66Th Street, Room 707, New York, NY, 10065, USA.
| |
Collapse
|
40
|
Barwise AK, Curtis S, Diedrich DA, Pickering BW. Using artificial intelligence to promote equitable care for inpatients with language barriers and complex medical needs: clinical stakeholder perspectives. J Am Med Inform Assoc 2024; 31:611-621. [PMID: 38099504 PMCID: PMC10873784 DOI: 10.1093/jamia/ocad224] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 11/14/2023] [Indexed: 02/18/2024] Open
Abstract
OBJECTIVES Inpatients with language barriers and complex medical needs suffer disparities in quality of care, safety, and health outcomes. Although in-person interpreters are particularly beneficial for these patients, they are underused. We plan to use machine learning predictive analytics to reliably identify patients with language barriers and complex medical needs to prioritize them for in-person interpreters. MATERIALS AND METHODS This qualitative study used stakeholder engagement through semi-structured interviews to understand the perceived risks and benefits of artificial intelligence (AI) in this domain. Stakeholders included clinicians, interpreters, and personnel involved in caring for these patients or for organizing interpreters. Data were coded and analyzed using NVIVO software. RESULTS We completed 49 interviews. Key perceived risks included concerns about transparency, accuracy, redundancy, privacy, perceived stigmatization among patients, alert fatigue, and supply-demand issues. Key perceived benefits included increased awareness of in-person interpreters, improved standard of care and prioritization for interpreter utilization; a streamlined process for accessing interpreters, empowered clinicians, and potential to overcome clinician bias. DISCUSSION This is the first study that elicits stakeholder perspectives on the use of AI with the goal of improved clinical care for patients with language barriers. Perceived benefits and risks related to the use of AI in this domain, overlapped with known hazards and values of AI but some benefits were unique for addressing challenges with providing interpreter services to patients with language barriers. CONCLUSION Artificial intelligence to identify and prioritize patients for interpreter services has the potential to improve standard of care and address healthcare disparities among patients with language barriers.
Collapse
Affiliation(s)
- Amelia K Barwise
- Biomedical Ethics Research Program, Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN 55902, United States
| | - Susan Curtis
- Biomedical Ethics Research Program, Mayo Clinic, Rochester, MN 55902, United States
| | - Daniel A Diedrich
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN 55902, United States
| | - Brian W Pickering
- Department of Anesthesiology and Perioperative Medicine, Mayo Clinic, Rochester, MN 55902, United States
| |
Collapse
|
41
|
Berghea EC, Ionescu MD, Gheorghiu RM, Tincu IF, Cobilinschi CO, Craiu M, Bălgrădean M, Berghea F. Integrating Artificial Intelligence in Pediatric Healthcare: Parental Perceptions and Ethical Implications. CHILDREN (BASEL, SWITZERLAND) 2024; 11:240. [PMID: 38397353 PMCID: PMC10887612 DOI: 10.3390/children11020240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/30/2023] [Revised: 01/30/2024] [Accepted: 02/09/2024] [Indexed: 02/25/2024]
Abstract
BACKGROUND Our study aimed to explore the way artificial intelligence (AI) utilization is perceived in pediatric medicine, examining its acceptance among patients (in this case represented by their adult parents), and identify the challenges it presents in order to understand the factors influencing its adoption in clinical settings. METHODS A structured questionnaire was applied to caregivers (parents or grandparents) of children who presented in tertiary pediatric clinics. RESULTS The most significant differentiations were identified in relation to the level of education (e.g., aversion to AI involvement was 22.2% among those with postgraduate degrees, 43.9% among those with university degrees, and 54.5% among those who only completed high school). The greatest fear among respondents regarding the medical use of AI was related to the possibility of errors occurring (70.1%). CONCLUSIONS The general attitude toward the use of AI can be considered positive, provided that it remains human-supervised, and that the technology used is explained in detail by the physician. However, there were large differences among groups (mainly defined by education level) in the way AI is perceived and accepted.
Collapse
Affiliation(s)
- Elena Camelia Berghea
- “Marie S. Curie” Emergency Children’s Clinical Hospital, Carol Davila University of Medicine and Pharmacy, 041451 Bucharest, Romania; (E.C.B.); (M.B.)
| | - Marcela Daniela Ionescu
- “Marie S. Curie” Emergency Children’s Clinical Hospital, Carol Davila University of Medicine and Pharmacy, 041451 Bucharest, Romania; (E.C.B.); (M.B.)
| | - Radu Marian Gheorghiu
- National Institute for Mother and Child Health “Alessandrescu-Rusescu”, Carol Davila University of Medicine and Pharmacy, 041249 Bucharest, Romania;
| | - Iulia Florentina Tincu
- Dr. Victor Gomoiu Clinical Children Hospital, Carol Davila University of Medicine and Pharmacy, 022102 Bucharest, Romania;
| | - Claudia Oana Cobilinschi
- Sfanta Maria Clinica Hospital, Carol Davila University of Medicine and Pharmacy, 011172 Bucharest, Romania; (C.O.C.); (F.B.)
| | - Mihai Craiu
- National Institute for Mother and Child Health “Alessandrescu-Rusescu”, Carol Davila University of Medicine and Pharmacy, 041249 Bucharest, Romania;
| | - Mihaela Bălgrădean
- “Marie S. Curie” Emergency Children’s Clinical Hospital, Carol Davila University of Medicine and Pharmacy, 041451 Bucharest, Romania; (E.C.B.); (M.B.)
| | - Florian Berghea
- Sfanta Maria Clinica Hospital, Carol Davila University of Medicine and Pharmacy, 011172 Bucharest, Romania; (C.O.C.); (F.B.)
| |
Collapse
|
42
|
Weidener L, Fischer M. Role of Ethics in Developing AI-Based Applications in Medicine: Insights From Expert Interviews and Discussion of Implications. JMIR AI 2024; 3:e51204. [PMID: 38875585 PMCID: PMC11041491 DOI: 10.2196/51204] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Revised: 11/20/2023] [Accepted: 12/09/2023] [Indexed: 06/16/2024]
Abstract
BACKGROUND The integration of artificial intelligence (AI)-based applications in the medical field has increased significantly, offering potential improvements in patient care and diagnostics. However, alongside these advancements, there is growing concern about ethical considerations, such as bias, informed consent, and trust in the development of these technologies. OBJECTIVE This study aims to assess the role of ethics in the development of AI-based applications in medicine. Furthermore, this study focuses on the potential consequences of neglecting ethical considerations in AI development, particularly their impact on patients and physicians. METHODS Qualitative content analysis was used to analyze the responses from expert interviews. Experts were selected based on their involvement in the research or practical development of AI-based applications in medicine for at least 5 years, leading to the inclusion of 7 experts in the study. RESULTS The analysis revealed 3 main categories and 7 subcategories reflecting a wide range of views on the role of ethics in AI development. This variance underscores the subjectivity and complexity of integrating ethics into the development of AI in medicine. Although some experts view ethics as fundamental, others prioritize performance and efficiency, with some perceiving ethics as potential obstacles to technological progress. This dichotomy of perspectives clearly emphasizes the subjectivity and complexity surrounding the role of ethics in AI development, reflecting the inherent multifaceted nature of this issue. CONCLUSIONS Despite the methodological limitations impacting the generalizability of the results, this study underscores the critical importance of consistent and integrated ethical considerations in AI development for medical applications. It advocates further research into effective strategies for ethical AI development, emphasizing the need for transparent and responsible practices, consideration of diverse data sources, physician training, and the establishment of comprehensive ethical and legal frameworks.
Collapse
Affiliation(s)
- Lukas Weidener
- Research Unit for Quality and Ethics in Health Care, UMIT TIROL - Private University for Health Sciences and Health Technology, Hall in Tirol, Austria
| | - Michael Fischer
- Research Unit for Quality and Ethics in Health Care, UMIT TIROL - Private University for Health Sciences and Health Technology, Hall in Tirol, Austria
| |
Collapse
|
43
|
Adelsmayr G, Janisch M, Pohl M, Fuchsjäger M, Schöllnast H. Facing the AI challenge in radiology: Lessons learned from a regional survey among Austrian radiologists in academic and non-academic settings on perceptions and expectations towards artificial intelligence. Digit Health 2024; 10:20552076241298472. [PMID: 39544924 PMCID: PMC11561996 DOI: 10.1177/20552076241298472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2024] [Accepted: 10/23/2024] [Indexed: 11/17/2024] Open
Abstract
Aim This study aimed to evaluate perceptions and expectations towards artificial intelligence (AI) applications in diagnostic radiology among radiologists across academic, non-academic and private practice settings in the Federal State of Styria, Austria. It also sought to determine how participant's characteristics and AI-specific knowledge might influence these views. Methods An online quantitative survey comprising 20 multiple-choice questions in German language was distributed via email to radiologists in outpatient and hospital settings throughout Styria in 2024. Results Out of 149 radiologists contacted, 66 responded. Of these, 75.4% reported having basic knowledge of AI, 13.8% indicated good to very good knowledge and only 10.8% had minimal AI-specific knowledge. The majority (84.4%) expressed willingness to use certified AI software in diagnostics. About half of the respondents (50.8%) believed that AI would not fully replace radiologists in the next 10-15 years, although 46.0% anticipated partial replacement. Additionally, 87.7% did not foresee a decrease in professional income due to AI integration. 64.6% anticipated improvement in diagnostic tasks through AI, with this expectation being significantly linked to an academic career (χ2 = 8.97, p = 0.01). However, opinions varied on AI's potential to outperform radiologists in diagnostics in the near future. There was no statistically significant relationship between participant's AI-specific knowledge and perceptions and expectations towards AI. Conclusion The study reveals a generally positive attitude towards AI among radiologists, with uncertainties about its future performance compared to human radiologists. Although AI is anticipated to positively influence workload without reducing income, there may be a discrepancy between these expectations and actual outcomes.
Collapse
Affiliation(s)
- Gabriel Adelsmayr
- Division of General Radiology, Department of Radiology, Medical University of Graz, Graz, Austria
| | - Michael Janisch
- Division of Neuroradiology, Interventional and Vascular Radiology, Department of Radiology, Medical University of Graz, Graz, Austria
| | - Maximilian Pohl
- Division of General Radiology, Department of Radiology, Medical University of Graz, Graz, Austria
| | - Michael Fuchsjäger
- Division of General Radiology, Department of Radiology, Medical University of Graz, Graz, Austria
| | - Helmut Schöllnast
- Division of General Radiology, Department of Radiology, Medical University of Graz, Graz, Austria
- Institute of Radiology, LKH Graz II, Graz, Austria
| |
Collapse
|
44
|
Hoebel KV, Bridge CP, Ahmed S, Akintola O, Chung C, Huang RY, Johnson JM, Kim A, Ly KI, Chang K, Patel J, Pinho M, Batchelor TT, Rosen BR, Gerstner ER, Kalpathy-Cramer J. Expert-centered Evaluation of Deep Learning Algorithms for Brain Tumor Segmentation. Radiol Artif Intell 2024; 6:e220231. [PMID: 38197800 PMCID: PMC10831514 DOI: 10.1148/ryai.220231] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/31/2022] [Revised: 09/13/2023] [Accepted: 11/01/2023] [Indexed: 01/11/2024]
Abstract
Purpose To present results from a literature survey on practices in deep learning segmentation algorithm evaluation and perform a study on expert quality perception of brain tumor segmentation. Materials and Methods A total of 180 articles reporting on brain tumor segmentation algorithms were surveyed for the reported quality evaluation. Additionally, ratings of segmentation quality on a four-point scale were collected from medical professionals for 60 brain tumor segmentation cases. Results Of the surveyed articles, Dice score, sensitivity, and Hausdorff distance were the most popular metrics to report segmentation performance. Notably, only 2.8% of the articles included clinical experts' evaluation of segmentation quality. The experimental results revealed a low interrater agreement (Krippendorff α, 0.34) in experts' segmentation quality perception. Furthermore, the correlations between the ratings and commonly used quantitative quality metrics were low (Kendall tau between Dice score and mean rating, 0.23; Kendall tau between Hausdorff distance and mean rating, 0.51), with large variability among the experts. Conclusion The results demonstrate that quality ratings are prone to variability due to the ambiguity of tumor boundaries and individual perceptual differences, and existing metrics do not capture the clinical perception of segmentation quality. Keywords: Brain Tumor Segmentation, Deep Learning Algorithms, Glioblastoma, Cancer, Machine Learning Clinical trial registration nos. NCT00756106 and NCT00662506 Supplemental material is available for this article. © RSNA, 2023.
Collapse
Affiliation(s)
- Katharina V. Hoebel
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Christopher P. Bridge
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Sara Ahmed
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Oluwatosin Akintola
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Caroline Chung
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Raymond Y. Huang
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Jason M. Johnson
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Albert Kim
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - K. Ina Ly
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Ken Chang
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Jay Patel
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Marco Pinho
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Tracy T. Batchelor
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Bruce R. Rosen
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Elizabeth R. Gerstner
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| | - Jayashree Kalpathy-Cramer
- From the Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology (K.V.H., C.P.B., A.K., K.I.L., K.C., J.P., B.R.R., E.R.G., J.K.C.), and Stephen E. and Catherine Pappas Center for Neuro-Oncology (O.A., A.K., K.I.L., E.R.G.), Massachusetts General Hospital, 149 13th St, Charlestown, MA 02129; Harvard-MIT Division of Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, Mass (K.V.H., K.C., J.P.); MGH and BWH Center for Clinical Data Science, Boston, Mass (C.P.B., J.K.C.); Department of Radiation Oncology, Division of Radiation Oncology (S.A., C.C.); Department of Diagnostic Radiology, Division of Diagnostic Imaging (C.C.), and Department of Neuroradiology (J.M.J.), Division of Diagnostic Imaging, The University of Texas MD Anderson Cancer Center, Houston, Tex; Departments of Radiology (R.Y.H.) and Neurology (T.T.B.), Brigham and Women’s Hospital, Boston, Mass; Department of Radiology and Advanced Imaging Research Center, University of Texas Southwestern Medical Center, Dallas, Tex (M.P.); and Department of Ophthalmology, University of Colorado Anschutz Medical Campus, Aurora, Colo (J.K.C.)
| |
Collapse
|
45
|
Antweiler D, Albiez D, Bures D, Hosters B, Jovy-Klein F, Nickel K, Reibel T, Schramm J, Sander J, Antons D, Diehl A. [Use of AI-based applications by hospital staff: task profiles and qualification requirements]. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz 2024; 67:66-75. [PMID: 38032516 PMCID: PMC10776476 DOI: 10.1007/s00103-023-03817-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2023] [Accepted: 11/24/2023] [Indexed: 12/01/2023]
Abstract
BACKGROUND Artificial intelligence (AI) is becoming increasingly important for the future development of hospitals. To unlock the large potential of AI, job profiles of hospital staff members need to be further developed in the direction of AI and digitization skills through targeted qualification measures. This affects both medical and non-medical processes along the entire value chain in hospitals. The aim of this paper is to provide an overview of the skills required to deal with smart technologies in a clinical context and to present measures for training employees. METHODS As part of the "SmartHospital.NRW" project in 2022, we conducted a literature review as well as interviews and workshops with experts. AI technologies and fields of application were identified. RESULTS Key findings include adapted and new task profiles, synergies and dependencies between individual task profiles, and the need for a comprehensive interdisciplinary and interprofessional exchange when using AI-based applications in hospitals. DISCUSSION Our article shows that hospitals need to promote digital health literacy skills for hospital staff members at an early stage and at the same time recruit technology- and AI-savvy staff. Interprofessional exchange formats and accompanying change management are essential for the use of AI in hospitals.
Collapse
Affiliation(s)
- Dario Antweiler
- Fraunhofer Institut für Intelligente Analyse und Informationssysteme IAIS, Abteilung Knowledge Discovery, Schloss Birlinghoven 1, 53757, Sankt Augustin, Deutschland.
| | - Daniela Albiez
- Fraunhofer Institut für Intelligente Analyse und Informationssysteme IAIS, Abteilung Adaptive Reflective Teams, Sankt Augustin, Deutschland
| | - Dominik Bures
- Stabsstelle Digitale Transformation, Universitätsmedizin Essen, Essen, Deutschland
| | - Bernadette Hosters
- Stabsstelle Entwicklung und Forschung Pflege, Universitätsmedizin Essen, Essen, Deutschland
| | - Florian Jovy-Klein
- Institut für Technologie- und Innovationsmanagement, RWTH Aachen, Aachen, Deutschland
| | - Kilian Nickel
- Fraunhofer Institut für Intelligente Analyse und Informationssysteme IAIS, Abteilung Adaptive Reflective Teams, Sankt Augustin, Deutschland
| | - Thomas Reibel
- Institut für Technologie- und Innovationsmanagement, RWTH Aachen, Aachen, Deutschland
| | - Johanna Schramm
- Stabsstelle Entwicklung und Forschung Pflege, Universitätsmedizin Essen, Essen, Deutschland
| | - Jil Sander
- Stabsstelle Digitale Transformation, Universitätsmedizin Essen, Essen, Deutschland
| | - David Antons
- Institut für Technologie- und Innovationsmanagement, RWTH Aachen, Aachen, Deutschland
| | - Anke Diehl
- Stabsstelle Digitale Transformation, Universitätsmedizin Essen, Essen, Deutschland
| |
Collapse
|
46
|
Stevens AF, Stetson P. Theory of trust and acceptance of artificial intelligence technology (TrAAIT): An instrument to assess clinician trust and acceptance of artificial intelligence. J Biomed Inform 2023; 148:104550. [PMID: 37981107 PMCID: PMC10815802 DOI: 10.1016/j.jbi.2023.104550] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 11/07/2023] [Accepted: 11/16/2023] [Indexed: 11/21/2023]
Abstract
BACKGROUND Artificial intelligence and machine learning (AI/ML) technologies like generative and ambient AI solutions are proliferating in real-world healthcare settings. Clinician trust affects adoption and impact of these systems. Organizations need a validated method to assess factors underlying trust and acceptance of AI for clinical workflows in order to improve adoption and the impact of AI. OBJECTIVE Our study set out to develop and assess a novel clinician-centered model to measure and explain trust and adoption of AI technology. We hypothesized that clinicians' system-specific Trust in AI is the primary predictor of both Acceptance (i.e., willingness to adopt), and post-adoption Trusting Stance (i.e., general stance towards any AI system). We validated the new model at an urban comprehensive cancer center. We produced an easily implemented survey tool for measuring clinician trust and adoption of AI. METHODS This survey-based, cross-sectional, psychometric study included a model development phase and validation phase. Measurement was done with five-point ascending unidirectional Likert scales. The development sample included N = 93 clinicians (physicians, advanced practice providers, nurses) that used an AI-based communication application. The validation sample included N = 73 clinicians that used a commercially available AI-powered speech-to-text application for note-writing in an electronic health record (EHR). Analytical procedures included exploratory factor analysis (EFA), confirmatory factor analysis (CFA), and partial least squares structural equation modeling (PLS-SEM). The Johnson-Neyman (JN) methodology was used to determine moderator effects. RESULTS In the fully moderated causal model, clinician trust explained a large amount of variance in their acceptance of a specific AI application (56%) and their post-adoption general trusting stance towards AI in general (36%). Moderators included organizational assurances, length of time using the application, and clinician age. The final validated instrument has 20 items and takes 5 min to complete on average. CONCLUSIONS We found that clinician acceptance of AI is determined by their degree of trust formed via information credibility, perceived application value, and reliability. The novel model, TrAAIT, explains factors underlying AI trustworthiness and acceptance for clinicians. With its easy-to-use instrument and Summative Score Dashboard, TrAAIT can help organizations implementing AI to identify and intercept barriers to clinician adoption in real-world settings.
Collapse
Affiliation(s)
- Alexander F Stevens
- Digital Products and Informatics Division, DigITs, Memorial Sloan Kettering Cancer Center, New York, NY.
| | - Pete Stetson
- Digital Products and Informatics Division, DigITs, Memorial Sloan Kettering Cancer Center, New York, NY; Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY
| |
Collapse
|
47
|
Alam F, Lim MA, Zulkipli IN. Integrating AI in medical education: embracing ethical usage and critical understanding. Front Med (Lausanne) 2023; 10:1279707. [PMID: 37901398 PMCID: PMC10611520 DOI: 10.3389/fmed.2023.1279707] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Accepted: 10/02/2023] [Indexed: 10/31/2023] Open
|