An integrative review on the acceptance of artificial intelligence among healthcare professionals in hospitals

An AI-Based Clinical Decision Support System for Antibiotic Therapy in Sepsis (KINBIOTICS): Use Case Analysis

Background

Antimicrobial resistances pose significant challenges in health care systems. Clinical decision support systems (CDSSs) represent a potential strategy for promoting a more targeted and guideline-based use of antibiotics. The integration of artificial intelligence (AI) into these systems has the potential to support physicians in selecting the most effective drug therapy for a given patient.

Objective

This study aimed to analyze the feasibility of an AI-based CDSS pilot version for antibiotic therapy in sepsis patients and identify facilitating and inhibiting conditions for its implementation in intensive care medicine.

Methods

The evaluation was conducted in 2 steps, using a qualitative methodology. Initially, expert interviews were conducted, in which intensive care physicians were asked to assess the AI-based recommendations for antibiotic therapy in terms of plausibility, layout, and design. Subsequently, focus group interviews were conducted to examine the technology acceptance of the AI-based CDSS. The interviews were anonymized and evaluated using content analysis.

Results

In terms of the feasibility, barriers included variability in previous antibiotic administration practices, which affected the predictive ability of AI recommendations, and the increased effort required to justify deviations from these recommendations. Physicians' confidence in accepting or rejecting recommendations depended on their level of professional experience. The ability to re-evaluate CDSS recommendations and an intuitive, user-friendly system design were identified as factors that enhanced acceptance and usability. Overall, barriers included low levels of digitization in clinical practice, limited availability of cross-sectoral data, and negative previous experiences with CDSSs. Conversely, facilitators to CDSS implementation were potential time savings, physicians' openness to adopting new technologies, and positive previous experiences.

Conclusions

Early integration of users is beneficial for both the identification of relevant context factors and the further development of an effective CDSS. Overall, the potential of AI-based CDSSs is offset by inhibiting contextual conditions that impede its acceptance and implementation. The advancement of AI-based CDSSs and the mitigation of these inhibiting conditions are crucial for the realization of its full potential.

The integration of AI in nursing: addressing current applications, challenges, and future directions

Artificial intelligence is increasingly influencing healthcare, providing transformative opportunities and challenges for nursing practice. This review critically evaluates the integration of AI in nursing, focusing on its current applications, limitations, and areas that require further investigation. A comprehensive analysis of recent studies highlights the use of AI in clinical decision support systems, patient monitoring, and nursing education. However, several barriers to successful implementation are identified, including technical constraints, ethical dilemmas, and the need for workforce adaptation. Significant gaps in the literature are also evident, such as the limited development of nursing-specific AI tools, insufficient long-term impact assessments, and the absence of comprehensive ethical frameworks tailored to nursing contexts. The potential of AI to reshape personalized care, advance robotics in nursing, and address global health challenges is explored in depth. This review integrates existing knowledge and identifies critical areas for future research, emphasizing the necessity of aligning AI advancements with the specific needs of nursing. Addressing these gaps is essential to fully harness AI's potential while reducing associated risks, ultimately enhancing nursing practice and improving patient outcomes.

Artificial intelligence conversational agents in mental health: Patients see potential, but prefer humans in the loop

Background

Digital mental health interventions, such as artificial intelligence (AI) conversational agents, hold promise for improving access to care by innovating therapy and supporting delivery. However, little research exists on patient perspectives regarding AI conversational agents, which is crucial for their successful implementation. This study aimed to fill the gap by exploring patients' perceptions and acceptability of AI conversational agents in mental healthcare.

Methods

Adults with self-reported mild to moderate anxiety were recruited from the UMass Memorial Health system. Participants engaged in semi-structured interviews to discuss their experiences, perceptions, and acceptability of AI conversational agents in mental healthcare. Anxiety levels were assessed using the Generalized Anxiety Disorder scale. Data were collected from December 2022 to February 2023, and three researchers conducted rapid qualitative analysis to identify and synthesize themes.

Results

The sample included 29 adults (ages 19-66), predominantly under age 35, non-Hispanic, White, and female. Participants reported a range of positive and negative experiences with AI conversational agents. Most held positive attitudes towards AI conversational agents, appreciating their utility and potential to increase access to care, yet some also expressed cautious optimism. About half endorsed negative opinions, citing AI's lack of empathy, technical limitations in addressing complex mental health situations, and data privacy concerns. Most participants desired some human involvement in AI-driven therapy and expressed concern about the risk of AI conversational agents being seen as replacements for therapy. A subgroup preferred AI conversational agents for administrative tasks rather than care provision.

Conclusions

AI conversational agents were perceived as useful and beneficial for increasing access to care, but concerns about AI's empathy, capabilities, safety, and human involvement in mental healthcare were prevalent. Future implementation and integration of AI conversational agents should consider patient perspectives to enhance their acceptability and effectiveness.

The Willingness of Doctors to Adopt Artificial Intelligence-Driven Clinical Decision Support Systems at Different Hospitals in China: Fuzzy Set Qualitative Comparative Analysis of Survey Data

BACKGROUND

Artificial intelligence-driven clinical decision support systems (AI-CDSSs) are pivotal tools for doctors to improve diagnostic and treatment processes, as well as improve the efficiency and quality of health care services. However, not all doctors trust artificial intelligence (AI) technology, and many remain skeptical and unwilling to adopt these systems.

OBJECTIVE

This study aimed to explore in depth the factors influencing doctors' willingness to adopt AI-CDSSs and assess the causal relationships among these factors to gain a better understanding for promoting the clinical application and widespread implementation of these systems.

METHODS

Based on the unified theory of acceptance and use of technology (UTAUT) and the technology-organization-environment (TOE) framework, we have proposed and designed a framework for doctors' willingness to adopt AI-CDSSs. We conducted a nationwide questionnaire survey in China and performed fuzzy set qualitative comparative analysis to explore the willingness of doctors to adopt AI-CDSSs in different types of medical institutions and assess the factors influencing their willingness.

RESULTS

The survey was administered to doctors working in tertiary hospitals and primary/secondary hospitals across China. We received 450 valid responses out of 578 questionnaires distributed, indicating a robust response rate of 77.9%. Our analysis of the influencing factors and adoption pathways revealed that doctors in tertiary hospitals exhibited 6 distinct pathways for AI-CDSS adoption, which were centered on technology-driven pathways, individual-driven pathways, and technology-individual dual-driven pathways. Doctors in primary/secondary hospitals demonstrated 3 adoption pathways, which were centered on technology-individual and organization-individual dual-driven pathways. There were commonalities in the factors influencing adoption across different medical institutions, such as the positive perception of AI technology's utility and individual readiness to try new technologies. There were also variations in the influence of facilitating conditions among doctors at different medical institutions, especially primary/secondary hospitals.

CONCLUSIONS

From the perspective of the 6 pathways for doctors at tertiary hospitals and the 3 pathways for doctors at primary/secondary hospitals, performance expectancy and personal innovativeness were 2 indispensable and core conditions in the pathways to achieving favorable willingness to adopt AI-CDSSs.

Harnessing artificial intelligence in sepsis care: advances in early detection, personalized treatment, and real-time monitoring

Sepsis remains a leading cause of morbidity and mortality worldwide due to its rapid progression and heterogeneous nature. This review explores the potential of Artificial Intelligence (AI) to transform sepsis management, from early detection to personalized treatment and real-time monitoring. AI, particularly through machine learning (ML) techniques such as random forest models and deep learning algorithms, has shown promise in analyzing electronic health record (EHR) data to identify patterns that enable early sepsis detection. For instance, random forest models have demonstrated high accuracy in predicting sepsis onset in intensive care unit (ICU) patients, while deep learning approaches have been applied to recognize complications such as sepsis-associated acute respiratory distress syndrome (ARDS). Personalized treatment plans developed through AI algorithms predict patient-specific responses to therapies, optimizing therapeutic efficacy and minimizing adverse effects. AI-driven continuous monitoring systems, including wearable devices, provide real-time predictions of sepsis-related complications, enabling timely interventions. Beyond these advancements, AI enhances diagnostic accuracy, predicts long-term outcomes, and supports dynamic risk assessment in clinical settings. However, ethical challenges, including data privacy concerns and algorithmic biases, must be addressed to ensure fair and effective implementation. The significance of this review lies in addressing the current limitations in sepsis management and highlighting how AI can overcome these hurdles. By leveraging AI, healthcare providers can significantly enhance diagnostic accuracy, optimize treatment protocols, and improve overall patient outcomes. Future research should focus on refining AI algorithms with diverse datasets, integrating emerging technologies, and fostering interdisciplinary collaboration to address these challenges and realize AI's transformative potential in sepsis care.

Overcoming barriers and enabling artificial intelligence adoption in allied health clinical practice: A qualitative study

Background

Artificial intelligence (AI) has the potential to revolutionise healthcare. If the implementation is successful it has the potential to improve healthcare outcomes for patients and organisations. Little is known about the perceptions of allied health professionals (AHPs) towards AI in healthcare.

Objective

This study investigated barriers and enablers to AI implementation in the delivery of healthcare from the AHPs perspective.

Methods

Qualitative methodology informed by behaviour change theory using focus groups with AHPs at a health service in Queensland, Australia.

Results

Twenty-four barriers and 24 enablers were identified by 25 participants across four focus groups. Barriers included: lack of AI knowledge, explainability challenges, risk to professional practice, negative impact on professional practice, and role replacement. Enablers include AI training and education, regulation, reputation, understanding the healthcare benefits of AI and engaging clinical champions.

Conclusions

AHPs have concerns about the impact and trustworthiness of AI and the readiness of organisations to support its use. Organisations must take a proactive approach and adopt targeted and multifaceted strategies to address barriers. This may include workforce upskilling, clear communication of the benefits of AI use of local champions and ongoing research.

Exploring geriatric nurses' perspectives on the adoption of AI in elderly care a qualitative study

This phenomenological study explored the perspectives of geriatric nurses on the adoption of artificial intelligence (AI) in elderly care. Thematic analysis of semi-structured interviews with 17 nurses revealed perceived benefits, challenges, ethical considerations, and practical implications. Participants acknowledged AI's potential for improving diagnostic accuracy, personalized care, continuous monitoring, and data pattern insights. However, concerns were raised regarding workflow integration, cost barriers, resistance to change, data privacy, diminishment of human elements, and the need for ethical guidelines. A cautious optimism was expressed, emphasizing the importance of addressing practical challenges, maintaining the human touch, and fostering a collaborative approach. The findings highlight the need for comprehensive training, user-centered design, ethical frameworks, and strategies to overcome financial and implementation barriers. Future research should focus on evaluating the impact of AI implementation on patient outcomes and nursing experiences.

Allied Health Professionals' Perceptions of Artificial Intelligence in the Clinical Setting: Cross-Sectional Survey

BACKGROUND

Artificial intelligence (AI) has the potential to address growing logistical and economic pressures on the health care system by reducing risk, increasing productivity, and improving patient safety; however, implementing digital health technologies can be disruptive. Workforce perception is a powerful indicator of technology use and acceptance, however, there is little research available on the perceptions of allied health professionals (AHPs) toward AI in health care.

OBJECTIVE

This study aimed to explore AHP perceptions of AI and the opportunities and challenges for its use in health care delivery.

METHODS

A cross-sectional survey was conducted at a health service in, Queensland, Australia, using the Shinners Artificial Intelligence Perception tool.

RESULTS

A total of 231 (22.1%) participants from 11 AHPs responded to the survey. Participants were mostly younger than 40 years (157/231, 67.9%), female (189/231, 81.8%), working in a clinical role (196/231, 84.8%) with a median of 10 years' experience in their profession. Most participants had not used AI (185/231, 80.1%), had little to no knowledge about AI (201/231, 87%), and reported workforce knowledge and skill as the greatest challenges to incorporating AI in health care (178/231, 77.1%). Age (P=.01), profession (P=.009), and AI knowledge (P=.02) were strong predictors of the perceived professional impact of AI. AHPs generally felt unprepared for the implementation of AI in health care, with concerns about a lack of workforce knowledge on AI and losing valued tasks to AI. Prior use of AI (P=.02) and years of experience as a health care professional (P=.02) were significant predictors of perceived preparedness for AI. Most participants had not received education on AI (190/231, 82.3%) and desired training (170/231, 73.6%) and believed AI would improve health care. Ideas and opportunities suggested for the use of AI within the allied health setting were predominantly nonclinical, administrative, and to support patient assessment tasks, with a view to improving efficiencies and increasing clinical time for direct patient care.

CONCLUSIONS

Education and experience with AI are needed in health care to support its implementation across allied health, the second largest workforce in health. Industry and academic partnerships with clinicians should not be limited to AHPs with high AI literacy as clinicians across all knowledge levels can identify many opportunities for AI in health care.

From theoretical models to practical deployment: A perspective and case study of opportunities and challenges in AI-driven cardiac auscultation research for low-income settings

This article includes a literature review and a case study of artificial intelligence (AI) heart murmur detection models to analyse the opportunities and challenges in deploying AI in cardiovascular healthcare in low- or medium-income countries (LMICs). This study has two parallel components: (1) The literature review assesses the capacity of AI to aid in addressing the observed disparity in healthcare between high- and low-income countries. Reasons for the limited deployment of machine learning models are discussed, as well as model generalisation. Moreover, the literature review discusses how emerging human-centred deployment research is a promising avenue for overcoming deployment barriers. (2) A predictive AI screening model is developed and tested in a case study on heart murmur detection in rural Brazil. Our binary Bayesian ResNet model leverages overlapping log mel spectrograms of patient heart sound recordings and integrates demographic data and signal features via XGBoost to optimise performance. This is followed by a discussion of the model's limitations, its robustness, and the obstacles preventing its practical application. The difficulty with which this model, and other state-of-the-art models, generalise to out-of-distribution data is also discussed. By integrating the results of the case study with those of the literature review, the NASSS framework was applied to evaluate the key challenges in deploying AI-supported heart murmur detection in low-income settings. The research accentuates the transformative potential of AI-enabled healthcare, particularly for affordable point-of-care screening systems in low-income settings. It also emphasises the necessity of effective implementation and integration strategies to guarantee the successful deployment of these technologies.

Perceptions and attitudes toward artificial intelligence among frontline physicians and physicians' assistants in Kansas: a cross-sectional survey

Objective

This survey aims to understand frontline healthcare professionals' perceptions of artificial intelligence (AI) in healthcare and assess how AI familiarity influences these perceptions.

Materials and Methods

We conducted a survey from February to March 2023 of physicians and physician assistants registered with the Kansas State Board of Healing Arts. Participants rated their perceptions toward AI-related domains and constructs on a 5-point Likert scale, with higher scores indicating stronger agreement. Two sub-groups were created for analysis to assess the impact of participants' familiarity and experience with AI on the survey results.

Results

From 532 respondents, key concerns were Perceived Communication Barriers (median = 4.0, IQR = 2.8-4.8), Unregulated Standards (median = 4.0, IQR = 3.6-4.8), and Liability Issues (median = 4.0, IQR = 3.5-4.8). Lower levels of agreement were noted for Trust in AI Mechanisms (median = 3.0, IQR = 2.2-3.4), Perceived Risks of AI (median = 3.2, IQR = 2.6-4.0), and Privacy Concerns (median = 3.3, IQR = 2.3-4.0). Positive correlations existed between Intention to use AI and Perceived Benefits (r = 0.825) and Trust in AI Mechanisms (r = 0.777). Perceived risk negatively correlated with Intention to Use AI (r = -0.718). There was no difference in perceptions between AI experienced and AI naïve subgroups.

Discussion

The findings suggest that perceptions of benefits, trust, risks, communication barriers, regulation, and liability issues influence healthcare professionals' intention to use AI, regardless of their AI familiarity.

Conclusion

The study highlights key factors affecting AI adoption in healthcare from the frontline healthcare professionals' perspective. These insights can guide strategies for successful AI implementation in healthcare.

Following Medical Advice of an AI or a Human Doctor? Experimental Evidence Based on Clinician-Patient Communication Pathway Model

Medical large language models are being introduced to the public in collaboration with governments, medical institutions, and artificial intelligence (AI) researchers. However, a crucial question remains: Will patients follow the medical advice provided by AI doctors? The lack of user research makes it difficult to provide definitive answers. Based on the clinician-patient communication pathway model, this study conducted a factorial experiment with a 2 (medical provider, AI vs. human) × 2 (information support, low vs. high) × 2 (response latency, slow vs. fast) between-subjects design (n = 535). The results showed that participants exhibited significantly lower adherence to AI doctors' advice than to human doctors. In addition, the interaction effect suggested that, under the slow-response latency condition, subjects perceived greater health benefits and patient-centeredness from human doctors, while the opposite was observed for AI doctors.

Integrating large language models in mental health practice: a qualitative descriptive study based on expert interviews

Background

Progress in developing artificial intelligence (AI) products represented by large language models (LLMs) such as OpenAI's ChatGPT has sparked enthusiasm for their potential use in mental health practice. However, the perspectives on the integration of LLMs within mental health practice remain an underreported topic. Therefore, this study aimed to explore how mental health and AI experts conceptualize LLMs and perceive the use of integrating LLMs into mental health practice.

Method

In February-April 2024, online semi-structured interviews were conducted with 21 experts (12 psychiatrists, 7 mental health nurses, 2 researchers in medical artificial intelligence) from four provinces in China, using snowballing and purposive selection sampling. Respondents' discussions about their perspectives and expectations of integrating LLMs in mental health were analyzed with conventional content analysis.

Results

Four themes and eleven sub-themes emerged from this study. Firstly, participants discussed the (1) practice and application reform brought by LLMs into mental health (fair access to mental health services, enhancement of patient participation, improvement in work efficiency and quality), and then analyzed the (2) technological-mental health gap (misleading information, lack of professional nuance and depth, user risk). Based on these points, they provided a range of (3) prerequisites for the integration of LLMs in mental health (training and competence, guidelines for use and management, patient engagement and transparency) and expressed their (4) expectations for future developments (reasonable allocation of workload, upgrades and revamps of LLMs).

Conclusion

These findings provide valuable insights into integrating LLMs within mental health practice, offering critical guidance for institutions to effectively implement, manage, and optimize these tools, thereby enhancing the quality and accessibility of mental health services.

Medical students and house officers' perception, attitude and potential barriers towards artificial intelligence in Egypt, cross sectional survey

BACKGROUND

Artificial intelligence (AI) is one of the sectors of medical research that is expanding the fastest right now in healthcare. AI has rapidly advanced in the field of medicine, helping to treat a variety of illnesses and reducing the number of diagnostic and follow-up errors.

OBJECTIVE

This study aims to assess the perception and attitude towards artificial intelligence (AI) among medical students & house officers in Egypt.

METHODS

An online cross-sectional study was done using a questionnaire on the Google Form website. The survey collected demographic data and explored participants' perception, attitude & potential barriers towards AI.

RESULTS

There are 1,346 responses from Egyptian medical students (25.8%) & house officers (74.2%). Most participants have inadequate perception (76.4%) about the importance and usage of AI in the medical field, while the majority (87.4%) have a negative attitude. Multivariate analysis revealed that age is the only independent predictor of AI perception (AOR = 1.07, 95% CI 1.01-1.13). However, perception level and gender are both independent predictors of attitude towards AI (AOR = 1.93, 95% CI 1.37-2.74 & AOR = 1.80, 95% CI 1.30-2.49, respectively).

CONCLUSION

The study found that medical students and house officers in Egypt have an overall negative attitude towards the integration of AI technologies in healthcare. Despite the potential benefits of AI-driven digital medicine, most respondents expressed concerns about the practical application of these technologies in the clinical setting. The current study highlights the need to address the concerns of medical students and house officers towards AI integration in Egypt. A multi-pronged approach, including education, targeted training, and addressing specific concerns, is necessary to facilitate the wider adoption of AI-enabled healthcare.

Utilization of, Perceptions on, and Intention to Use AI Chatbots Among Medical Students in China: National Cross-Sectional Study

Background

Artificial intelligence (AI) chatbots are poised to have a profound impact on medical education. Medical students, as early adopters of technology and future health care providers, play a crucial role in shaping the future of health care. However, little is known about the utilization of, perceptions on, and intention to use AI chatbots among medical students in China.

Objective

This study aims to explore the utilization of, perceptions on, and intention to use generative AI chatbots among medical students in China, using the Unified Theory of Acceptance and Use of Technology (UTAUT) framework. By conducting a national cross-sectional survey, we sought to identify the key determinants that influence medical students' acceptance of AI chatbots, thereby providing a basis for enhancing their integration into medical education. Understanding these factors is crucial for educators, policy makers, and technology developers to design and implement effective AI-driven educational tools that align with the needs and expectations of future health care professionals.

Methods

A web-based electronic survey questionnaire was developed and distributed via social media to medical students across the country. The UTAUT was used as a theoretical framework to design the questionnaire and analyze the data. The relationship between behavioral intention to use AI chatbots and UTAUT predictors was examined using multivariable regression.

Results

A total of 693 participants were from 57 universities covering 21 provinces or municipalities in China. Only a minority (199/693, 28.72%) reported using AI chatbots for studying, with ChatGPT (129/693, 18.61%) being the most commonly used. Most of the participants used AI chatbots for quickly obtaining medical information and knowledge (631/693, 91.05%) and increasing learning efficiency (594/693, 85.71%). Utilization behavior, social influence, facilitating conditions, perceived risk, and personal innovativeness showed significant positive associations with the behavioral intention to use AI chatbots (all P values were <.05).

Conclusions

Chinese medical students hold positive perceptions toward and high intentions to use AI chatbots, but there are gaps between intention and actual adoption. This highlights the need for strategies to improve access, training, and support and provide peer usage examples to fully harness the potential benefits of chatbot technology.

Use of Artificial Intelligence tools in supporting decision-making in hospital management

BACKGROUND

The use of Artificial Intelligence (AI) tools in hospital management holds potential for enhancing decision-making processes. This study investigates the current state of decision-making in hospital management, explores the potential benefits of AI integration, and examines hospital managers' perceptions of AI as a decision-support tool.

METHODS

A descriptive and exploratory study was conducted using a qualitative approach. Data were collected through semi-structured interviews with 15 hospital managers from various departments and institutions. The interviews were transcribed, anonymized, and analyzed using thematic coding to identify key themes and patterns in the responses.

RESULTS

Hospital managers highlighted the current inefficiencies in decision-making processes, often characterized by poor communication, isolated decision-making, and limited data access. The use of traditional tools like spreadsheet applications and business intelligence systems remains prevalent, but there is a clear need for more advanced, integrated solutions. Managers expressed both optimism and skepticism about AI, acknowledging its potential to improve efficiency and decision-making while raising concerns about data privacy, ethical issues, and the loss of human empathy. The study identified key challenges, including the variability in technical skills, data fragmentation, and resistance to change. Managers emphasized the importance of robust data infrastructure and adequate training to ensure successful AI integration.

CONCLUSIONS

The study reveals a complex landscape where the potential benefits of AI in hospital management are balanced with significant challenges and concerns. Effective integration of AI requires addressing technical, ethical, and cultural issues, with a focus on maintaining human elements in decision-making. AI is seen as a powerful tool to support, not replace, human judgment in hospital management, promising improvements in efficiency, data accessibility, and analytical capacity. Preparing healthcare institutions with the necessary infrastructure and providing specialized training for managers are crucial for maximizing the benefits of AI while mitigating associated risks.

Artificial intelligence in healthcare: a scoping review of perceived threats to patient rights and safety

BACKGROUND

The global health system remains determined to leverage on every workable opportunity, including artificial intelligence (AI) to provide care that is consistent with patients' needs. Unfortunately, while AI models generally return high accuracy within the trials in which they are trained, their ability to predict and recommend the best course of care for prospective patients is left to chance.

PURPOSE

This review maps evidence between January 1, 2010 to December 31, 2023, on the perceived threats posed by the usage of AI tools in healthcare on patients' rights and safety.

METHODS

We deployed the guidelines of Tricco et al. to conduct a comprehensive search of current literature from Nature, PubMed, Scopus, ScienceDirect, Dimensions AI, Web of Science, Ebsco Host, ProQuest, JStore, Semantic Scholar, Taylor & Francis, Emeralds, World Health Organisation, and Google Scholar. In all, 80 peer reviewed articles qualified and were included in this study.

RESULTS

We report that there is a real chance of unpredictable errors, inadequate policy and regulatory regime in the use of AI technologies in healthcare. Moreover, medical paternalism, increased healthcare cost and disparities in insurance coverage, data security and privacy concerns, and bias and discriminatory services are imminent in the use of AI tools in healthcare.

CONCLUSIONS

Our findings have some critical implications for achieving the Sustainable Development Goals (SDGs) 3.8, 11.7, and 16. We recommend that national governments should lead in the roll-out of AI tools in their healthcare systems. Also, other key actors in the healthcare industry should contribute to developing policies on the use of AI in healthcare systems.

Clinicians' roles and necessary levels of understanding in the use of artificial intelligence: A qualitative interview study with German medical students

BACKGROUND

Artificial intelligence-driven Clinical Decision Support Systems (AI-CDSS) are being increasingly introduced into various domains of health care for diagnostic, prognostic, therapeutic and other purposes. A significant part of the discourse on ethically appropriate conditions relate to the levels of understanding and explicability needed for ensuring responsible clinical decision-making when using AI-CDSS. Empirical evidence on stakeholders' viewpoints on these issues is scarce so far. The present study complements the empirical-ethical body of research by, on the one hand, investigating the requirements for understanding and explicability in depth with regard to the rationale behind them. On the other hand, it surveys medical students at the end of their studies as stakeholders, of whom little data is available so far, but for whom AI-CDSS will be an important part of their medical practice.

METHODS

Fifteen semi-structured qualitative interviews (each lasting an average of 56 min) were conducted with German medical students to investigate their perspectives and attitudes on the use of AI-CDSS. The problem-centred interviews draw on two hypothetical case vignettes of AI-CDSS employed in nephrology and surgery. Interviewees' perceptions and convictions of their own clinical role and responsibilities in dealing with AI-CDSS were elicited as well as viewpoints on explicability as well as the necessary level of understanding and competencies needed on the clinicians' side. The qualitative data were analysed according to key principles of qualitative content analysis (Kuckartz).

RESULTS

In response to the central question about the necessary understanding of AI-CDSS tools and the emergence of their outputs as well as the reasons for the requirements placed on them, two types of argumentation could be differentiated inductively from the interviewees' statements: the first type, the clinician as a systemic trustee (or "the one relying"), highlights that there needs to be empirical evidence and adequate approval processes that guarantee minimised harm and a clinical benefit from the employment of an AI-CDSS. Based on proof of these requirements, the use of an AI-CDSS would be appropriate, as according to "the one relying", clinicians should choose those measures that statistically cause the least harm. The second type, the clinician as an individual expert (or "the one controlling"), sets higher prerequisites that go beyond ensuring empirical evidence and adequate approval processes. These higher prerequisites relate to the clinician's necessary level of competence and understanding of how a specific AI-CDSS works and how to use it properly in order to evaluate its outputs and to mitigate potential risks for the individual patient. Both types are unified in their high esteem of evidence-based clinical practice and the need to communicate with the patient on the use of medical AI. However, the interviewees' different conceptions of the clinician's role and responsibilities cause them to have different requirements regarding the clinician's understanding and explicability of an AI-CDSS beyond the proof of benefit.

CONCLUSIONS

The study results highlight two different types among (future) clinicians regarding their view of the necessary levels of understanding and competence. These findings should inform the debate on appropriate training programmes and professional standards (e.g. clinical practice guidelines) that enable the safe and effective clinical employment of AI-CDSS in various clinical fields. While current approaches search for appropriate minimum requirements of the necessary understanding and competence, the differences between (future) clinicians in terms of their information and understanding needs described here can lead to more differentiated approaches to solutions.

Artificial intelligence in tuberculosis: a new ally in disease control

The challenges to effective tuberculosis (TB) disease control are considerable, and the current global targets for reductions in disease burden seem unattainable. The combination of complex pathophysiology and technical limitations results in difficulties in achieving consistent, reliable diagnoses, and long treatment regimens imply serious physiological and socioeconomic consequences for patients. Artificial intelligence (AI) applications in healthcare have significantly improved patient care regarding diagnostics, treatment and basic research. However, their success relies on infrastructures prioritising comprehensive data generation and collaborative research environments to foster stakeholder engagement. This viewpoint article briefly outlines the current and potential applications of advanced AI models in global TB control and the considerations and implications of adopting these tools within the public health community.

Artificial intelligence-enhanced patient evaluation: bridging art and science

The advent of digital health and artificial intelligence (AI) has promised to revolutionize clinical care, but real-world patient evaluation has yet to witness transformative changes. As history taking and physical examination continue to rely on long-established practices, a growing pipeline of AI-enhanced digital tools may soon augment the traditional clinical encounter into a data-driven process. This article presents an evidence-backed vision of how promising AI applications may enhance traditional practices, streamlining tedious tasks while elevating diverse data sources, including AI-enabled stethoscopes, cameras, and wearable sensors, to platforms for personalized medicine and efficient care delivery. Through the lens of traditional patient evaluation, we illustrate how digital technologies may soon be interwoven into routine clinical workflows, introducing a novel paradigm of longitudinal monitoring. Finally, we provide a skeptic's view on the practical, ethical, and regulatory challenges that limit the uptake of such technologies.

Artificial Intelligence in Head and Neck Cancer: Innovations, Applications, and Future Directions

Artificial intelligence (AI) is revolutionizing head and neck cancer (HNC) care by providing innovative tools that enhance diagnostic accuracy and personalize treatment strategies. This review highlights the advancements in AI technologies, including deep learning and natural language processing, and their applications in HNC. The integration of AI with imaging techniques, genomics, and electronic health records is explored, emphasizing its role in early detection, biomarker discovery, and treatment planning. Despite noticeable progress, challenges such as data quality, algorithmic bias, and the need for interdisciplinary collaboration remain. Emerging innovations like explainable AI, AI-powered robotics, and real-time monitoring systems are poised to further advance the field. Addressing these challenges and fostering collaboration among AI experts, clinicians, and researchers is crucial for developing equitable and effective AI applications. The future of AI in HNC holds significant promise, offering potential breakthroughs in diagnostics, personalized therapies, and improved patient outcomes.

What Are Humans Doing in the Loop? Co-Reasoning and Practical Judgment When Using Machine Learning-Driven Decision Aids

Within the ethical debate on Machine Learning-driven decision support systems (ML_CDSS), notions such as "human in the loop" or "meaningful human control" are often cited as being necessary for ethical legitimacy. In addition, ethical principles usually serve as the major point of reference in ethical guidance documents, stating that conflicts between principles need to be weighed and balanced against each other. Starting from a neo-Kantian viewpoint inspired by Onora O'Neill, this article makes a concrete suggestion of how to interpret the role of the "human in the loop" and to overcome the perspective of rivaling ethical principles in the evaluation of AI in health care. We argue that patients should be perceived as "fellow workers" and epistemic partners in the interpretation of ML_CDSS outputs. We further highlight that a meaningful process of integrating (rather than weighing and balancing) ethical principles is most appropriate in the evaluation of medical AI.

Model-Informed Precision Dosing Using Machine Learning for Levothyroxine in General Practice: Development, Validation and Clinical Simulation Trial

Levothyroxine is one of the most prescribed drugs in the western world. Dosing is challenging due to high-interindividual differences in effective dosage and the narrow therapeutic window. Model-informed precision dosing (MIPD) using machine learning could assist general practitioners (GPs), but no such models exist for primary care. Furthermore, introduction of decision-support algorithms in healthcare is limited due to the substantial gap between developers and clinicians' perspectives. We report the development, validation, and a clinical simulation trial of the first MIPD application for primary care. Stable maintenance dosage of levothyroxine was the model target. The multiclass model generates predictions for individual patients, for different dosing classes. Random forest was trained and tested on a national primary care database (n = 19,004) with a final weighted AUC across dosing options of 0.71, even in subclinical hypothyroidism. TSH, fT4, weight, and age were most predictive. To assess the safety, feasibility, and clinical impact of MIPD for levothyroxine, we performed clinical simulation studies in GPs and compared MIPD to traditional prescription. Fifty-one GPs selected starting dosages for 20 primary hypothyroidism cases without and then with MIPD 2 weeks later. Overdosage and underdosage were defined as higher and lower than 12.5 μg relative to stable maintenance dosage. MIPD decreased overdosage in number (30.5 to 23.9%, P < 0.01) and magnitude (median 50 to 37.5 μg, P < 0.01) and increased optimal starting dosages (18.3 to 30.2%, P < 0.01). GPs considered lab results more often with MIPD and most would use the model frequently. This study demonstrates the clinical relevance, safety, and effectiveness of MIPD for levothyroxine in primary care.

Exploring explainable AI features in the vocal biomarkers of lung disease

This review delves into the burgeoning field of explainable artificial intelligence (XAI) in the detection and analysis of lung diseases through vocal biomarkers. Lung diseases, often elusive in their early stages, pose a significant public health challenge. Recent advancements in AI have ushered in innovative methods for early detection, yet the black-box nature of many AI models limits their clinical applicability. XAI emerges as a pivotal tool, enhancing transparency and interpretability in AI-driven diagnostics. This review synthesizes current research on the application of XAI in analyzing vocal biomarkers for lung diseases, highlighting how these techniques elucidate the connections between specific vocal features and lung pathology. We critically examine the methodologies employed, the types of lung diseases studied, and the performance of various XAI models. The potential for XAI to aid in early detection, monitor disease progression, and personalize treatment strategies in pulmonary medicine is emphasized. Furthermore, this review identifies current challenges, including data heterogeneity and model generalizability, and proposes future directions for research. By offering a comprehensive analysis of explainable AI features in the context of lung disease detection, this review aims to bridge the gap between advanced computational approaches and clinical practice, paving the way for more transparent, reliable, and effective diagnostic tools.

The use of imputation in clinical decision support systems: a cardiovascular risk management pilot vignette study among clinicians

Aims

A major challenge of the use of prediction models in clinical care is missing data. Real-time imputation may alleviate this. However, to what extent clinicians accept this solution remains unknown. We aimed to assess acceptance of real-time imputation for missing patient data in a clinical decision support system (CDSS) including 10-year cardiovascular absolute risk for the individual patient.

Methods and results

We performed a vignette study extending an existing CDSS with the real-time imputation method joint modelling imputation (JMI). We included 17 clinicians to use the CDSS with three different vignettes, describing potential use cases (missing data, no risk estimate; imputed values, risk estimate based on imputed data; complete information). In each vignette, missing data were introduced to mimic a situation as could occur in clinical practice. Acceptance of end-users was assessed on three different axes: clinical realism, comfortableness, and added clinical value. Overall, the imputed predictor values were found to be clinically reasonable and according to the expectations. However, for binary variables, use of a probability scale to express uncertainty was deemed inconvenient. The perceived comfortableness with imputed risk prediction was low, and confidence intervals were deemed too wide for reliable decision-making. The clinicians acknowledged added value for using JMI in clinical practice when used for educational, research, or informative purposes.

Conclusion

Handling missing data in CDSS via JMI is useful, but more accurate imputations are needed to generate comfort in clinicians for use in routine care. Only then can CDSS create clinical value by improving decision-making.

Artificial Intelligence-Based Applications for Bone Fracture Detection Using Medical Images: A Systematic Review

Artificial intelligence (AI) is making notable advancements in the medical field, particularly in bone fracture detection. This systematic review compiles and assesses existing research on AI applications aimed at identifying bone fractures through medical imaging, encompassing studies from 2010 to 2023. It evaluates the performance of various AI models, such as convolutional neural networks (CNNs), in diagnosing bone fractures, highlighting their superior accuracy, sensitivity, and specificity compared to traditional diagnostic methods. Furthermore, the review explores the integration of advanced imaging techniques like 3D CT and MRI with AI algorithms, which has led to enhanced diagnostic accuracy and improved patient outcomes. The potential of Generative AI and Large Language Models (LLMs), such as OpenAI's GPT, to enhance diagnostic processes through synthetic data generation, comprehensive report creation, and clinical scenario simulation is also discussed. The review underscores the transformative impact of AI on diagnostic workflows and patient care, while also identifying research gaps and suggesting future research directions to enhance data quality, model robustness, and ethical considerations.

Predictors of Health Care Practitioners' Intention to Use AI-Enabled Clinical Decision Support Systems: Meta-Analysis Based on the Unified Theory of Acceptance and Use of Technology

BACKGROUND

Artificial intelligence-enabled clinical decision support systems (AI-CDSSs) offer potential for improving health care outcomes, but their adoption among health care practitioners remains limited.

OBJECTIVE

This meta-analysis identified predictors influencing health care practitioners' intention to use AI-CDSSs based on the Unified Theory of Acceptance and Use of Technology (UTAUT). Additional predictors were examined based on existing empirical evidence.

METHODS

The literature search using electronic databases, forward searches, conference programs, and personal correspondence yielded 7731 results, of which 17 (0.22%) studies met the inclusion criteria. Random-effects meta-analysis, relative weight analyses, and meta-analytic moderation and mediation analyses were used to examine the relationships between relevant predictor variables and the intention to use AI-CDSSs.

RESULTS

The meta-analysis results supported the application of the UTAUT to the context of the intention to use AI-CDSSs. The results showed that performance expectancy (r=0.66), effort expectancy (r=0.55), social influence (r=0.66), and facilitating conditions (r=0.66) were positively associated with the intention to use AI-CDSSs, in line with the predictions of the UTAUT. The meta-analysis further identified positive attitude (r=0.63), trust (r=0.73), anxiety (r=-0.41), perceived risk (r=-0.21), and innovativeness (r=0.54) as additional relevant predictors. Trust emerged as the most influential predictor overall. The results of the moderation analyses show that the relationship between social influence and use intention becomes weaker with increasing age. In addition, the relationship between effort expectancy and use intention was stronger for diagnostic AI-CDSSs than for devices that combined diagnostic and treatment recommendations. Finally, the relationship between facilitating conditions and use intention was mediated through performance and effort expectancy.

CONCLUSIONS

This meta-analysis contributes to the understanding of the predictors of intention to use AI-CDSSs based on an extended UTAUT model. More research is needed to substantiate the identified relationships and explain the observed variations in effect sizes by identifying relevant moderating factors. The research findings bear important implications for the design and implementation of training programs for health care practitioners to ease the adoption of AI-CDSSs into their practice.

Perceptions and attitudes of nurse practitioners toward artificial intelligence adoption in health care

Background

With the ever-increasing integration of artificial intelligence (AI) into health care, it becomes imperative to gain an in-depth understanding of how health care professionals, specifically nurse practitioners, perceive and approach this transformative technology.

Objectives

This study aimed to gain insights into nurse practitioners' perceptions and attitudes toward AI adoption in health care.

Methods

This qualitative research employed a descriptive and phenomenological approach using in-depth interviews. Data were collected through a semi-structured questionnaire with 37 nurse practitioners selected through purposive sampling, specifically Maximum Variation Sampling and Expert Sampling techniques, to ensure diversity in characteristics. Trustworthiness of the research was maintained through member checking and peer debriefing. Thematic analysis was employed to uncover recurring themes and patterns in the data.

Results

The thematic analysis revealed nine main themes that encapsulated nurse practitioners' perceptions and attitudes toward AI adoption in health care. These included nurse practitioners' perceptions of AI implementation, attitudes toward AI adoption, patient-centered care and AI, quality of health care delivery and AI, ethical and regulatory aspects of AI, education and training needs, collaboration and interdisciplinary relationships, obstacles in integrating AI, and AI and health care policy. While this study found that nurse practitioners held a wide range of perspectives, with many viewings AI as a tool to enhance patient care.

Conclusions

This research provides a valuable contribution to the evolving discourse surrounding AI adoption in health care. The findings underscore the necessity for comprehensive education and training in AI, accompanied by clear and robust ethical and regulatory guidelines to ensure the responsible integration of AI in health care practice. Furthermore, fostering collaboration and interdisciplinary relationships is pivotal for the successful incorporation of AI in health care. Policymakers should also address the challenges and opportunities that AI presents in the health care sector. This study enhances the ongoing conversation on AI adoption in health care by shedding light on the perspectives of nurses, thereby shaping future strategies for AI integration.

Navigating the future: machine learning's role in revolutionizing antimicrobial stewardship and infection prevention and control

PURPOSE OF REVIEW

This review examines the current state and future prospects of machine learning (ML) in infection prevention and control (IPC) and antimicrobial stewardship (ASP), highlighting its potential to transform healthcare practices by enhancing the precision, efficiency, and effectiveness of interventions against infections and antimicrobial resistance.

RECENT FINDINGS

ML has shown promise in improving surveillance and detection of infections, predicting infection risk, and optimizing antimicrobial use through the development of predictive analytics, natural language processing, and personalized medicine approaches. However, challenges remain, including issues related to data quality, model interpretability, ethical considerations, and integration into clinical workflows.

SUMMARY

Despite these challenges, the future of ML in IPC and ASP is promising, with interdisciplinary collaboration identified as a key factor in overcoming existing barriers. ML's role in advancing personalized medicine, real-time disease monitoring, and effective IPC and ASP strategies signifies a pivotal shift towards safer, more efficient healthcare environments and improved patient care in the face of global antimicrobial resistance challenges.

Biomedical Data Science, Artificial Intelligence, and Ethics: Navigating Challenges in the Face of Explosive Growth

Advances in biomedical data science and artificial intelligence (AI) are profoundly changing the landscape of healthcare. This article reviews the ethical issues that arise with the development of AI technologies, including threats to privacy, data security, consent, and justice, as they relate to donors of tissue and data. It also considers broader societal obligations, including the importance of assessing the unintended consequences of AI research in biomedicine. In addition, this article highlights the challenge of rapid AI development against the backdrop of disparate regulatory frameworks, calling for a global approach to address concerns around data misuse, unintended surveillance, and the equitable distribution of AI's benefits and burdens. Finally, a number of potential solutions to these ethical quandaries are offered. Namely, the merits of advocating for a collaborative, informed, and flexible regulatory approach that balances innovation with individual rights and public welfare, fostering a trustworthy AI-driven healthcare ecosystem, are discussed.

Artificial Intelligence to support ethical decision-making for incapacitated patients: a survey among German anesthesiologists and internists

BACKGROUND

Artificial intelligence (AI) has revolutionized various healthcare domains, where AI algorithms sometimes even outperform human specialists. However, the field of clinical ethics has remained largely untouched by AI advances. This study explores the attitudes of anesthesiologists and internists towards the use of AI-driven preference prediction tools to support ethical decision-making for incapacitated patients.

METHODS

A questionnaire was developed and pretested among medical students. The questionnaire was distributed to 200 German anesthesiologists and 200 German internists, thereby focusing on physicians who often encounter patients lacking decision-making capacity. The questionnaire covered attitudes toward AI-driven preference prediction, availability and utilization of Clinical Ethics Support Services (CESS), and experiences with ethically challenging situations. Descriptive statistics and bivariate analysis was performed. Qualitative responses were analyzed using content analysis in a mixed inductive-deductive approach.

RESULTS

Participants were predominantly male (69.3%), with ages ranging from 27 to 77. Most worked in nonacademic hospitals (82%). Physicians generally showed hesitance toward AI-driven preference prediction, citing concerns about the loss of individuality and humanity, lack of explicability in AI results, and doubts about AI's ability to encompass the ethical deliberation process. In contrast, physicians had a more positive opinion of CESS. Availability of CESS varied, with 81.8% of participants reporting access. Among those without access, 91.8% expressed a desire for CESS. Physicians' reluctance toward AI-driven preference prediction aligns with concerns about transparency, individuality, and human-machine interaction. While AI could enhance the accuracy of predictions and reduce surrogate burden, concerns about potential biases, de-humanisation, and lack of explicability persist.

CONCLUSIONS

German physicians frequently encountering incapacitated patients exhibit hesitance toward AI-driven preference prediction but hold a higher esteem for CESS. Addressing concerns about individuality, explicability, and human-machine roles may facilitate the acceptance of AI in clinical ethics. Further research into patient and surrogate perspectives is needed to ensure AI aligns with patient preferences and values in complex medical decisions.

Doctors' perception on the ethical use of AI-enabled clinical decision support systems for antibiotic prescribing recommendations in Singapore

Objectives

The increased utilization of Artificial intelligence (AI) in healthcare changes practice and introduces ethical implications for AI adoption in medicine. We assess medical doctors' ethical stance in situations that arise in adopting an AI-enabled Clinical Decision Support System (AI-CDSS) for antibiotic prescribing decision support in a healthcare institution in Singapore.

Methods

We conducted in-depth interviews with 30 doctors of varying medical specialties and designations between October 2022 and January 2023. Our interview guide was anchored on the four pillars of medical ethics. We used clinical vignettes with the following hypothetical scenarios: (1) Using an antibiotic AI-enabled CDSS's recommendations for a tourist, (2) Uncertainty about the AI-CDSS's recommendation of a narrow-spectrum antibiotic vs. concerns about antimicrobial resistance, (3) Patient refusing the "best treatment" recommended by the AI-CDSS, (4) Data breach.

Results

More than half of the participants only realized that the AI-enabled CDSS could have misrepresented non-local populations after being probed to think about the AI-CDSS's data source. Regarding prescribing a broad- or narrow-spectrum antibiotic, most participants preferred to exercise their clinical judgment over the AI-enabled CDSS's recommendations in their patients' best interest. Two-thirds of participants prioritized beneficence over patient autonomy by convincing patients who refused the best practice treatment to accept it. Many were unaware of the implications of data breaches.

Conclusion

The current position on the legal liability concerning the use of AI-enabled CDSS is unclear in relation to doctors, hospitals and CDSS providers. Having a comprehensive ethical legal and regulatory framework, perceived organizational support, and adequate knowledge of AI and ethics are essential for successfully implementing AI in healthcare.

Managing a patient with uveitis in the era of artificial intelligence: Current approaches, emerging trends, and future perspectives

The integration of artificial intelligence (AI) with healthcare has opened new avenues for diagnosing, treating, and managing medical conditions with remarkable precision. Uveitis, a diverse group of rare eye conditions characterized by inflammation of the uveal tract, exemplifies the complexities in ophthalmology due to its varied causes, clinical presentations, and responses to treatments. Uveitis, if not managed promptly and effectively, can lead to significant visual impairment. However, its management requires specialized knowledge, which is often lacking, particularly in regions with limited access to health services. AI's capabilities in pattern recognition, data analysis, and predictive modelling offer significant potential to revolutionize uveitis management. AI can classify disease etiologies, analyze multimodal imaging data, predict outcomes, and identify new therapeutic targets. However, transforming these AI models into clinical applications and meeting patient expectations involves overcoming challenges like acquiring extensive, annotated datasets, ensuring algorithmic transparency, and validating these models in real-world settings. This review delves into the complexities of uveitis and the current AI landscape, discussing the development, opportunities, and challenges of AI from theoretical models to bedside application. It also examines the epidemiology of uveitis, the global shortage of uveitis specialists, and the disease's socioeconomic impacts, underlining the critical need for AI-driven approaches. Furthermore, it explores the integration of AI in diagnostic imaging and future directions in ophthalmology, aiming to highlight emerging trends that could transform management of a patient with uveitis and suggesting collaborative efforts to enhance AI applications in clinical practice.

Energy landscape analysis and time-series clustering analysis of patient state multistability related to rheumatoid arthritis drug treatment: The KURAMA cohort study

Rheumatoid arthritis causes joint inflammation due to immune abnormalities, resulting in joint pain and swelling. In recent years, there have been considerable advancements in the treatment of this disease. However, only approximately 60% of patients achieve remission. Patients with multifactorial diseases shift between states from day to day. Patients may remain in a good or poor state with few or no transitions, or they may switch between states frequently. The visualization of time-dependent state transitions, based on the evaluation axis of stable/unstable states, may provide useful information for achieving rheumatoid arthritis treatment goals. Energy landscape analysis can be used to quantitatively determine the stability/instability of each state in terms of energy. Time-series clustering is another method used to classify transitions into different groups to identify potential patterns within a time-series dataset. The objective of this study was to utilize energy landscape analysis and time-series clustering to evaluate multidimensional time-series data in terms of multistability. We profiled each patient's state transitions during treatment using energy landscape analysis and time-series clustering. Energy landscape analysis divided state transitions into two patterns: "good stability leading to remission" and "poor stability leading to treatment dead-end." The number of patients whose disease status improved increased markedly until approximately 6 months after treatment initiation and then plateaued after 1 year. Time-series clustering grouped patients into three clusters: "toward good stability," "toward poor stability," and "unstable." Patients in the "unstable" cluster are considered to have clinical courses that are difficult to predict; therefore, these patients should be treated with more care. Early disease detection and treatment initiation are important. The evaluation of state multistability enables us to understand a patient's current state in the context of overall state transitions related to rheumatoid arthritis drug treatment and to predict future state transitions.

Beyond technology acceptance-a focused ethnography on the implementation, acceptance and use of new nursing technology in a German hospital

Introduction

Hospitalised patients could benefit from the emergence of novel technologies for nursing care. There are numerous technical products available, but these rarely find their way into practice. Further knowledge is required about the circumstances under which technology in nursing is accepted and used. In the research project "Centre for Implementing Nursing Care Innovations", technical innovations are implemented on a trauma surgery inpatient ward in Germany. After implementation, it was investigated: Which implemented technologies are accepted/rejected, and which factors influence the acceptance/rejection of technology for nurses?

Material and methods

A focused ethnography was used, containing two approaches: First, participant observation was conducted to examine nurses' and patients' interaction with technologies. Observations were fixed in a field research diary and analysed using evaluative qualitative content analysis. Second, a questionnaire was used by nurses to provide information about the use frequency and technology suitability. The results of the study were consolidated and analysed using the UTAUT model.

Results

Seven studied technologies can be summarised in four result categories: (1) A Mobilising mattress, a Special projector and a Sound pillow are accepted and used by nurses and patients, because they offer a way to provide high quality care with little additional effort. (2) A Fall prevention system is consistently used in patient care as a work obligation, but since nurses consider the system error-prone, acceptance is low. (3) An Interactive therapy ball is accepted but nurses cannot use it due to the high workload. (4) An App for nurse-patient communication and a work-equipment tracking system are not used or accepted because nurses do not see a practical benefit in the systems.

Discussion

Acceptance or rejection of a product does not necessarily equate to use or non-use of the technology. Before implementation, technology acceptance among users occurs as prejudice-when users are given time to experiment with technology, intention-to-use can stabilize into sustained use. Accepted and used technologies can serve to mask problems (such as staff shortages) and encourage problematic developments, such as the reduction of contact time at the bedside. Therefore, technology acceptance should be qualified in asking to what accepted technology contributes.

Leveraging AI and Machine Learning to Develop and Evaluate a Contextualized User-Friendly Cough Audio Classifier for Detecting Respiratory Diseases: Protocol for a Diagnostic Study in Rural Tanzania

BACKGROUND

Respiratory diseases, including active tuberculosis (TB), asthma, and chronic obstructive pulmonary disease (COPD), constitute substantial global health challenges, necessitating timely and accurate diagnosis for effective treatment and management.

OBJECTIVE

This research seeks to develop and evaluate a noninvasive user-friendly artificial intelligence (AI)-powered cough audio classifier for detecting these respiratory conditions in rural Tanzania.

METHODS

This is a nonexperimental cross-sectional research with the primary objective of collection and analysis of cough sounds from patients with active TB, asthma, and COPD in outpatient clinics to generate and evaluate a noninvasive cough audio classifier. Specialized cough sound recording devices, designed to be nonintrusive and user-friendly, will facilitate the collection of diverse cough sound samples from patients attending outpatient clinics in 20 health care facilities in the Shinyanga region. The collected cough sound data will undergo rigorous analysis, using advanced AI signal processing and machine learning techniques. By comparing acoustic features and patterns associated with TB, asthma, and COPD, a robust algorithm capable of automated disease discrimination will be generated facilitating the development of a smartphone-based cough sound classifier. The classifier will be evaluated against the calculated reference standards including clinical assessments, sputum smear, GeneXpert, chest x-ray, culture and sensitivity, spirometry and peak expiratory flow, and sensitivity and predictive values.

RESULTS

This research represents a vital step toward enhancing the diagnostic capabilities available in outpatient clinics, with the potential to revolutionize the field of respiratory disease diagnosis. Findings from the 4 phases of the study will be presented as descriptions supported by relevant images, tables, and figures. The anticipated outcome of this research is the creation of a reliable, noninvasive diagnostic cough classifier that empowers health care professionals and patients themselves to identify and differentiate these respiratory diseases based on cough sound patterns.

CONCLUSIONS

Cough sound classifiers use advanced technology for early detection and management of respiratory conditions, offering a less invasive and more efficient alternative to traditional diagnostics. This technology promises to ease public health burdens, improve patient outcomes, and enhance health care access in under-resourced areas, potentially transforming respiratory disease management globally.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/54388.

Use of artificial intelligence in critical care: opportunities and obstacles

BACKGROUND

Perhaps nowhere else in the healthcare system than in the intensive care unit environment are the challenges to create useful models with direct time-critical clinical applications more relevant and the obstacles to achieving those goals more massive. Machine learning-based artificial intelligence (AI) techniques to define states and predict future events are commonplace activities of modern life. However, their penetration into acute care medicine has been slow, stuttering and uneven. Major obstacles to widespread effective application of AI approaches to the real-time care of the critically ill patient exist and need to be addressed.

MAIN BODY

Clinical decision support systems (CDSSs) in acute and critical care environments support clinicians, not replace them at the bedside. As will be discussed in this review, the reasons are many and include the immaturity of AI-based systems to have situational awareness, the fundamental bias in many large databases that do not reflect the target population of patient being treated making fairness an important issue to address and technical barriers to the timely access to valid data and its display in a fashion useful for clinical workflow. The inherent "black-box" nature of many predictive algorithms and CDSS makes trustworthiness and acceptance by the medical community difficult. Logistically, collating and curating in real-time multidimensional data streams of various sources needed to inform the algorithms and ultimately display relevant clinical decisions support format that adapt to individual patient responses and signatures represent the efferent limb of these systems and is often ignored during initial validation efforts. Similarly, legal and commercial barriers to the access to many existing clinical databases limit studies to address fairness and generalizability of predictive models and management tools.

CONCLUSIONS

AI-based CDSS are evolving and are here to stay. It is our obligation to be good shepherds of their use and further development.

Ethical use of artificial intelligence to prevent sudden cardiac death: an interview study of patient perspectives

BACKGROUND

The emergence of artificial intelligence (AI) in medicine has prompted the development of numerous ethical guidelines, while the involvement of patients in the creation of these documents lags behind. As part of the European PROFID project we explore patient perspectives on the ethical implications of AI in care for patients at increased risk of sudden cardiac death (SCD).

AIM

Explore perspectives of patients on the ethical use of AI, particularly in clinical decision-making regarding the implantation of an implantable cardioverter-defibrillator (ICD).

METHODS

Semi-structured, future scenario-based interviews were conducted among patients who had either an ICD and/or a heart condition with increased risk of SCD in Germany (n = 9) and the Netherlands (n = 15). We used the principles of the European Commission's Ethics Guidelines for Trustworthy AI to structure the interviews.

RESULTS

Six themes arose from the interviews: the ability of AI to rectify human doctors' limitations; the objectivity of data; whether AI can serve as second opinion; AI explainability and patient trust; the importance of the 'human touch'; and the personalization of care. Overall, our results reveal a strong desire among patients for more personalized and patient-centered care in the context of ICD implantation. Participants in our study express significant concerns about the further loss of the 'human touch' in healthcare when AI is introduced in clinical settings. They believe that this aspect of care is currently inadequately recognized in clinical practice. Participants attribute to doctors the responsibility of evaluating AI recommendations for clinical relevance and aligning them with patients' individual contexts and values, in consultation with the patient.

CONCLUSION

The 'human touch' patients exclusively ascribe to human medical practitioners extends beyond sympathy and kindness, and has clinical relevance in medical decision-making. Because this cannot be replaced by AI, we suggest that normative research into the 'right to a human doctor' is needed. Furthermore, policies on patient-centered AI integration in clinical practice should encompass the ethics of everyday practice rather than only principle-based ethics. We suggest that an empirical ethics approach grounded in ethnographic research is exceptionally well-suited to pave the way forward.

Understanding Physician's Perspectives on AI in Health Care: Protocol for a Sequential Multiple Assignment Randomized Vignette Study

BACKGROUND

As the availability and performance of artificial intelligence (AI)-based clinical decision support (CDS) systems improve, physicians and other care providers poised to be on the front lines will be increasingly tasked with using these tools in patient care and incorporating their outputs into clinical decision-making processes. Vignette studies provide a means to explore emerging hypotheses regarding how context-specific factors, such as clinical risk, the amount of information provided about the AI, and the AI result, may impact physician acceptance and use of AI-based CDS tools. To best anticipate how such factors influence the decision-making of frontline physicians in clinical scenarios involving AI decision-support tools, hypothesis-driven research is needed that enables scenario testing before the implementation and deployment of these tools.

OBJECTIVE

This study's objectives are to (1) design an original, web-based vignette-based survey that features hypothetical scenarios based on emerging or real-world applications of AI-based CDS systems that will vary systematically by features related to clinical risk, the amount of information provided about the AI, and the AI result; and (2) test and determine causal effects of specific factors on the judgments and perceptions salient to physicians' clinical decision-making.

METHODS

US-based physicians with specialties in family or internal medicine will be recruited through email and mail (target n=420). Through a web-based survey, participants will be randomized to a 3-part "sequential multiple assignment randomization trial (SMART) vignette" detailing a hypothetical clinical scenario involving an AI decision support tool. The SMART vignette design is similar to the SMART design but adapted to a survey design. Each respondent will be randomly assigned to 1 of the possible vignette variations of the factors we are testing at each stage, which include the level of clinical risk, the amount of information provided about the AI, and the certainty of the AI output. Respondents will be given questions regarding their hypothetical decision-making in response to the hypothetical scenarios.

RESULTS

The study is currently in progress and data collection is anticipated to be completed in 2024.

CONCLUSIONS

The web-based vignette study will provide information on how contextual factors such as clinical risk, the amount of information provided about an AI tool, and the AI result influence physicians' reactions to hypothetical scenarios that are based on emerging applications of AI in frontline health care settings. Our newly proposed "SMART vignette" design offers several benefits not afforded by the extensively used traditional vignette design, due to the 2 aforementioned features. These advantages are (1) increased validity of analyses targeted at understanding the impact of a factor on the decision outcome, given previous outcomes and other contextual factors; and (2) balanced sample sizes across groups. This study will generate a better understanding of physician decision-making within this context.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/54787.

Artificial intelligence predictive analytics in heart failure: results of the pilot phase of a pragmatic randomized clinical trial

OBJECTIVES

We conducted an implementation planning process during the pilot phase of a pragmatic trial, which tests an intervention guided by artificial intelligence (AI) analytics sourced from noninvasive monitoring data in heart failure patients (LINK-HF2).

MATERIALS AND METHODS

A mixed-method analysis was conducted at 2 pilot sites. Interviews were conducted with 12 of 27 enrolled patients and with 13 participating clinicians. iPARIHS constructs were used for interview construction to identify workflow, communication patterns, and clinician's beliefs. Interviews were transcribed and analyzed using inductive coding protocols to identify key themes. Behavioral response data from the AI-generated notifications were collected.

RESULTS

Clinicians responded to notifications within 24 hours in 95% of instances, with 26.7% resulting in clinical action. Four implementation themes emerged: (1) High anticipatory expectations for reliable patient communications, reduced patient burden, and less proactive provider monitoring. (2) The AI notifications required a differential and tailored balance of trust and action advice related to role. (3) Clinic experience with other home-based programs influenced utilization. (4) Responding to notifications involved significant effort, including electronic health record (EHR) review, patient contact, and consultation with other clinicians.

DISCUSSION

Clinician's use of AI data is a function of beliefs regarding the trustworthiness and usefulness of the data, the degree of autonomy in professional roles, and the cognitive effort involved.

CONCLUSION

The implementation planning analysis guided development of strategies that addressed communication technology, patient education, and EHR integration to reduce clinician and patient burden in the subsequent main randomized phase of the trial. Our results provide important insights into the unique implications of implementing AI analytics into clinical workflow.

Validation of a novel smartphone-based photoplethysmographic method for ambulatory heart rhythm diagnostics: the SMARTBEATS study

AIMS

In the current guidelines, smartphone photoplethysmography (PPG) is not recommended for diagnosis of atrial fibrillation (AF), without a confirmatory electrocardiogram (ECG) recording. Previous validation studies have been performed under supervision in healthcare settings, with limited generalizability of the results. We aim to investigate the diagnostic performance of a smartphone-PPG method in a real-world setting, with ambulatory unsupervised smartphone-PPG recordings, compared with simultaneous ECG recordings and including patients with atrial flutter (AFL).

METHODS AND RESULTS

Unselected patients undergoing direct current cardioversion for treatment of AF or AFL were asked to perform 1-min heart rhythm recordings post-treatment, at least twice daily for 30 days at home, using an iPhone 7 smartphone running the CORAI Heart Monitor PPG application simultaneously with a single-lead ECG recording (KardiaMobile). Photoplethysmography and ECG recordings were read independently by two experienced readers. In total, 280 patients recorded 18 005 simultaneous PPG and ECG recordings. Sufficient quality for diagnosis was seen in 96.9% (PPG) vs. 95.1% (ECG) of the recordings (P < 0.001). Manual reading of the PPG recordings, compared with manually interpreted ECG recordings, had a sensitivity, specificity, and overall accuracy of 97.7%, 99.4%, and 98.9% with AFL recordings included and 99.0%, 99.7%, and 99.5%, respectively, with AFL recordings excluded.

CONCLUSION

A novel smartphone-PPG method can be used by patients unsupervised at home to achieve accurate heart rhythm diagnostics of AF and AFL with very high sensitivity and specificity. This smartphone-PPG device can be used as an independent heart rhythm diagnostic device following cardioversion, without the requirement of confirmation with ECG.

Robot-assisted surgery and artificial intelligence-based tumour diagnostics: social preferences with a representative cross-sectional survey

BACKGROUND

The aim of this study was to assess social preferences for two different advanced digital health technologies and investigate the contextual dependency of the preferences.

METHODS

A cross-sectional online survey was performed among the general population of Hungary aged 40 years and over. Participants were asked to imagine that they needed a total hip replacement surgery and to indicate whether they would prefer a traditional or a robot-assisted (RA) hip surgery. To better understand preferences for the chosen method, the willingness to pay (WTP) method was used. The same assessment was conducted for preferences between a radiologist's and AI-based image analysis in establishing the radiological diagnosis of a suspected tumour. Respondents' electronic health literacy was assessed with the eHEALS questionnaire. Descriptive methods were used to assess sample characteristics and differences between subgroups. Associations were investigated with correlation analysis and multiple linear regressions.

RESULTS

Altogether, 1400 individuals (53.7% female) with a mean age of 58.3 (SD = 11.1) years filled in the survey. RA hip surgery was chosen by 762 (54.4%) respondents, but only 470 (33.6%) chose AI-based medical image evaluation. Those who opted for the digital technology had significantly higher educational levels and electronic health literacy (eHEALS). The majority of respondents were willing to pay to secure their preferred surgical (surgeon 67.2%, robot-assisted: 68.8%) and image assessment (radiologist: 70.9%; AI: 77.4%) methods, reporting similar average amounts in the first (p = 0.677), and a significantly higher average amount for radiologist vs. AI in the second task (p = 0.001). The regression showed a significant association between WTP and income, and in the hip surgery task, it also revealed an association with the type of intervention chosen.

CONCLUSIONS

Individuals with higher education levels seem to accept the advanced digital medical technologies more. However, the greater openness for RA surgery than for AI image assessment highlights that social preferences may depend considerably on the medical situation and the type of advanced digital technology. WTP results suggest rather firm preferences in the great majority of the cases. Determinants of preferences and real-world choices of affected patients should be further investigated in future studies.

Generative AI in healthcare: an implementation science informed translational path on application, integration and governance

BACKGROUND

Artificial intelligence (AI), particularly generative AI, has emerged as a transformative tool in healthcare, with the potential to revolutionize clinical decision-making and improve health outcomes. Generative AI, capable of generating new data such as text and images, holds promise in enhancing patient care, revolutionizing disease diagnosis and expanding treatment options. However, the utility and impact of generative AI in healthcare remain poorly understood, with concerns around ethical and medico-legal implications, integration into healthcare service delivery and workforce utilisation. Also, there is not a clear pathway to implement and integrate generative AI in healthcare delivery.

METHODS

This article aims to provide a comprehensive overview of the use of generative AI in healthcare, focusing on the utility of the technology in healthcare and its translational application highlighting the need for careful planning, execution and management of expectations in adopting generative AI in clinical medicine. Key considerations include factors such as data privacy, security and the irreplaceable role of clinicians' expertise. Frameworks like the technology acceptance model (TAM) and the Non-Adoption, Abandonment, Scale-up, Spread and Sustainability (NASSS) model are considered to promote responsible integration. These frameworks allow anticipating and proactively addressing barriers to adoption, facilitating stakeholder participation and responsibly transitioning care systems to harness generative AI's potential.

RESULTS

Generative AI has the potential to transform healthcare through automated systems, enhanced clinical decision-making and democratization of expertise with diagnostic support tools providing timely, personalized suggestions. Generative AI applications across billing, diagnosis, treatment and research can also make healthcare delivery more efficient, equitable and effective. However, integration of generative AI necessitates meticulous change management and risk mitigation strategies. Technological capabilities alone cannot shift complex care ecosystems overnight; rather, structured adoption programs grounded in implementation science are imperative.

CONCLUSIONS

It is strongly argued in this article that generative AI can usher in tremendous healthcare progress, if introduced responsibly. Strategic adoption based on implementation science, incremental deployment and balanced messaging around opportunities versus limitations helps promote safe, ethical generative AI integration. Extensive real-world piloting and iteration aligned to clinical priorities should drive development. With conscientious governance centred on human wellbeing over technological novelty, generative AI can enhance accessibility, affordability and quality of care. As these models continue advancing rapidly, ongoing reassessment and transparent communication around their strengths and weaknesses remain vital to restoring trust, realizing positive potential and, most importantly, improving patient outcomes.

Assessing the research landscape and clinical utility of large language models: a scoping review

IMPORTANCE

Large language models (LLMs) like OpenAI's ChatGPT are powerful generative systems that rapidly synthesize natural language responses. Research on LLMs has revealed their potential and pitfalls, especially in clinical settings. However, the evolving landscape of LLM research in medicine has left several gaps regarding their evaluation, application, and evidence base.

OBJECTIVE

This scoping review aims to (1) summarize current research evidence on the accuracy and efficacy of LLMs in medical applications, (2) discuss the ethical, legal, logistical, and socioeconomic implications of LLM use in clinical settings, (3) explore barriers and facilitators to LLM implementation in healthcare, (4) propose a standardized evaluation framework for assessing LLMs' clinical utility, and (5) identify evidence gaps and propose future research directions for LLMs in clinical applications.

EVIDENCE REVIEW

We screened 4,036 records from MEDLINE, EMBASE, CINAHL, medRxiv, bioRxiv, and arXiv from January 2023 (inception of the search) to June 26, 2023 for English-language papers and analyzed findings from 55 worldwide studies. Quality of evidence was reported based on the Oxford Centre for Evidence-based Medicine recommendations.

FINDINGS

Our results demonstrate that LLMs show promise in compiling patient notes, assisting patients in navigating the healthcare system, and to some extent, supporting clinical decision-making when combined with human oversight. However, their utilization is limited by biases in training data that may harm patients, the generation of inaccurate but convincing information, and ethical, legal, socioeconomic, and privacy concerns. We also identified a lack of standardized methods for evaluating LLMs' effectiveness and feasibility.

CONCLUSIONS AND RELEVANCE

This review thus highlights potential future directions and questions to address these limitations and to further explore LLMs' potential in enhancing healthcare delivery.

Using artificial intelligence to promote equitable care for inpatients with language barriers and complex medical needs: clinical stakeholder perspectives

OBJECTIVES

Inpatients with language barriers and complex medical needs suffer disparities in quality of care, safety, and health outcomes. Although in-person interpreters are particularly beneficial for these patients, they are underused. We plan to use machine learning predictive analytics to reliably identify patients with language barriers and complex medical needs to prioritize them for in-person interpreters.

MATERIALS AND METHODS

This qualitative study used stakeholder engagement through semi-structured interviews to understand the perceived risks and benefits of artificial intelligence (AI) in this domain. Stakeholders included clinicians, interpreters, and personnel involved in caring for these patients or for organizing interpreters. Data were coded and analyzed using NVIVO software.

RESULTS

We completed 49 interviews. Key perceived risks included concerns about transparency, accuracy, redundancy, privacy, perceived stigmatization among patients, alert fatigue, and supply-demand issues. Key perceived benefits included increased awareness of in-person interpreters, improved standard of care and prioritization for interpreter utilization; a streamlined process for accessing interpreters, empowered clinicians, and potential to overcome clinician bias.

DISCUSSION

This is the first study that elicits stakeholder perspectives on the use of AI with the goal of improved clinical care for patients with language barriers. Perceived benefits and risks related to the use of AI in this domain, overlapped with known hazards and values of AI but some benefits were unique for addressing challenges with providing interpreter services to patients with language barriers.

CONCLUSION

Artificial intelligence to identify and prioritize patients for interpreter services has the potential to improve standard of care and address healthcare disparities among patients with language barriers.

Integrating Artificial Intelligence in Pediatric Healthcare: Parental Perceptions and Ethical Implications

BACKGROUND

Our study aimed to explore the way artificial intelligence (AI) utilization is perceived in pediatric medicine, examining its acceptance among patients (in this case represented by their adult parents), and identify the challenges it presents in order to understand the factors influencing its adoption in clinical settings.

METHODS

A structured questionnaire was applied to caregivers (parents or grandparents) of children who presented in tertiary pediatric clinics.

RESULTS

The most significant differentiations were identified in relation to the level of education (e.g., aversion to AI involvement was 22.2% among those with postgraduate degrees, 43.9% among those with university degrees, and 54.5% among those who only completed high school). The greatest fear among respondents regarding the medical use of AI was related to the possibility of errors occurring (70.1%).

CONCLUSIONS

The general attitude toward the use of AI can be considered positive, provided that it remains human-supervised, and that the technology used is explained in detail by the physician. However, there were large differences among groups (mainly defined by education level) in the way AI is perceived and accepted.

Role of Ethics in Developing AI-Based Applications in Medicine: Insights From Expert Interviews and Discussion of Implications

BACKGROUND

The integration of artificial intelligence (AI)-based applications in the medical field has increased significantly, offering potential improvements in patient care and diagnostics. However, alongside these advancements, there is growing concern about ethical considerations, such as bias, informed consent, and trust in the development of these technologies.

OBJECTIVE

This study aims to assess the role of ethics in the development of AI-based applications in medicine. Furthermore, this study focuses on the potential consequences of neglecting ethical considerations in AI development, particularly their impact on patients and physicians.

METHODS

Qualitative content analysis was used to analyze the responses from expert interviews. Experts were selected based on their involvement in the research or practical development of AI-based applications in medicine for at least 5 years, leading to the inclusion of 7 experts in the study.

RESULTS

The analysis revealed 3 main categories and 7 subcategories reflecting a wide range of views on the role of ethics in AI development. This variance underscores the subjectivity and complexity of integrating ethics into the development of AI in medicine. Although some experts view ethics as fundamental, others prioritize performance and efficiency, with some perceiving ethics as potential obstacles to technological progress. This dichotomy of perspectives clearly emphasizes the subjectivity and complexity surrounding the role of ethics in AI development, reflecting the inherent multifaceted nature of this issue.

CONCLUSIONS

Despite the methodological limitations impacting the generalizability of the results, this study underscores the critical importance of consistent and integrated ethical considerations in AI development for medical applications. It advocates further research into effective strategies for ethical AI development, emphasizing the need for transparent and responsible practices, consideration of diverse data sources, physician training, and the establishment of comprehensive ethical and legal frameworks.

Facing the AI challenge in radiology: Lessons learned from a regional survey among Austrian radiologists in academic and non-academic settings on perceptions and expectations towards artificial intelligence

Aim

This study aimed to evaluate perceptions and expectations towards artificial intelligence (AI) applications in diagnostic radiology among radiologists across academic, non-academic and private practice settings in the Federal State of Styria, Austria. It also sought to determine how participant's characteristics and AI-specific knowledge might influence these views.

Methods

An online quantitative survey comprising 20 multiple-choice questions in German language was distributed via email to radiologists in outpatient and hospital settings throughout Styria in 2024.

Results

Out of 149 radiologists contacted, 66 responded. Of these, 75.4% reported having basic knowledge of AI, 13.8% indicated good to very good knowledge and only 10.8% had minimal AI-specific knowledge. The majority (84.4%) expressed willingness to use certified AI software in diagnostics. About half of the respondents (50.8%) believed that AI would not fully replace radiologists in the next 10-15 years, although 46.0% anticipated partial replacement. Additionally, 87.7% did not foresee a decrease in professional income due to AI integration. 64.6% anticipated improvement in diagnostic tasks through AI, with this expectation being significantly linked to an academic career (χ2 = 8.97, p = 0.01). However, opinions varied on AI's potential to outperform radiologists in diagnostics in the near future. There was no statistically significant relationship between participant's AI-specific knowledge and perceptions and expectations towards AI.

Conclusion

The study reveals a generally positive attitude towards AI among radiologists, with uncertainties about its future performance compared to human radiologists. Although AI is anticipated to positively influence workload without reducing income, there may be a discrepancy between these expectations and actual outcomes.