Investigating Students' Perceptions towards Artificial Intelligence in Medical Education

Understanding Health Care Students' Perceptions, Beliefs, and Attitudes Toward AI-Powered Language Models: Cross-Sectional Study

BACKGROUND

ChatGPT was not intended for use in health care, but it has potential benefits that depend on end-user understanding and acceptability, which is where health care students become crucial. There is still a limited amount of research in this area.

OBJECTIVE

The primary aim of our study was to assess the frequency of ChatGPT use, the perceived level of knowledge, the perceived risks associated with its use, and the ethical issues, as well as attitudes toward the use of ChatGPT in the context of education in the field of health. In addition, we aimed to examine whether there were differences across groups based on demographic variables. The second part of the study aimed to assess the association between the frequency of use, the level of perceived knowledge, the level of risk perception, and the level of perception of ethics as predictive factors for participants' attitudes toward the use of ChatGPT.

METHODS

A cross-sectional survey was conducted from May to June 2023 encompassing students of medicine, nursing, dentistry, nutrition, and laboratory science across the Americas. The study used descriptive analysis, chi-square tests, and ANOVA to assess statistical significance across different categories. The study used several ordinal logistic regression models to analyze the impact of predictive factors (frequency of use, perception of knowledge, perception of risk, and ethics perception scores) on attitude as the dependent variable. The models were adjusted for gender, institution type, major, and country. Stata was used to conduct all the analyses.

RESULTS

Of 2661 health care students, 42.99% (n=1144) were unaware of ChatGPT. The median score of knowledge was "minimal" (median 2.00, IQR 1.00-3.00). Most respondents (median 2.61, IQR 2.11-3.11) regarded ChatGPT as neither ethical nor unethical. Most participants (median 3.89, IQR 3.44-4.34) "somewhat agreed" that ChatGPT (1) benefits health care settings, (2) provides trustworthy data, (3) is a helpful tool for clinical and educational medical information access, and (4) makes the work easier. In total, 70% (7/10) of people used it for homework. As the perceived knowledge of ChatGPT increased, there was a stronger tendency with regard to having a favorable attitude toward ChatGPT. Higher ethical consideration perception ratings increased the likelihood of considering ChatGPT as a source of trustworthy health care information (odds ratio [OR] 1.620, 95% CI 1.498-1.752), beneficial in medical issues (OR 1.495, 95% CI 1.452-1.539), and useful for medical literature (OR 1.494, 95% CI 1.426-1.564; P<.001 for all results).

CONCLUSIONS

Over 40% of American health care students (1144/2661, 42.99%) were unaware of ChatGPT despite its extensive use in the health field. Our data revealed the positive attitudes toward ChatGPT and the desire to learn more about it. Medical educators must explore how chatbots may be included in undergraduate health care education programs.

Artificial intelligence utilization in the healthcare setting: perceptions of the public in the UAE

Understanding the use of AI in healthcare is essential for the successful implementation of AI-driven healthcare solutions. The aim of this study was to evaluate public perception of AI utilization in healthcare settings. A validated questionnaire assessed general perceptions towards AI utilization, the use of AI by physician , and the use of AI by pharmacists . The study included 770 participants. The median perception score indicated an unfavorable attitude. Participants who had lower education level and those with no employment had a significantly lower perception scores than their counterpart. Participants who reported low income and those who visited the pharmacy five to ten times on average had a higher perception than their counterparts did. The reported negative perception necessitates the implementation of education campaigns to improve AI literacy and dispel any misconceptions and concerns, particularly among individuals with low education, high income, unemployment, and frequent pharmacy visits.

Comparing the Performance of ChatGPT-4 and Medical Students on MCQs at Varied Levels of Bloom's Taxonomy

Introduction

This research investigated the capabilities of ChatGPT-4 compared to medical students in answering MCQs using the revised Bloom's Taxonomy as a benchmark.

Methods

A cross-sectional study was conducted at The University of the West Indies, Barbados. ChatGPT-4 and medical students were assessed on MCQs from various medical courses using computer-based testing.

Results

The study included 304 MCQs. Students demonstrated good knowledge, with 78% correctly answering at least 90% of the questions. However, ChatGPT-4 achieved a higher overall score (73.7%) compared to students (66.7%). Course type significantly affected ChatGPT-4's performance, but revised Bloom's Taxonomy levels did not. A detailed association check between program levels and Bloom's taxonomy levels for correct answers by ChatGPT-4 showed a highly significant correlation (p<0.001), reflecting a concentration of "remember-level" questions in preclinical and "evaluate-level" questions in clinical courses.

Discussion

The study highlights ChatGPT-4's proficiency in standardized tests but indicates limitations in clinical reasoning and practical skills. This performance discrepancy suggests that the effectiveness of artificial intelligence (AI) varies based on course content.

Conclusion

While ChatGPT-4 shows promise as an educational tool, its role should be supplementary, with strategic integration into medical education to leverage its strengths and address limitations. Further research is needed to explore AI's impact on medical education and student performance across educational levels and courses.

Perceptions of undergraduate medical students on artificial intelligence in medicine: mixed-methods survey study from Palestine

BACKGROUND

The current applications of artificial intelligence (AI) in medicine continue to attract the attention of medical students. This study aimed to identify undergraduate medical students' attitudes toward AI in medicine, explore present AI-related training opportunities, investigate the need for AI inclusion in medical curricula, and determine preferred methods for teaching AI curricula.

METHODS

This study uses a mixed-method cross-sectional design, including a quantitative study and a qualitative study, targeting Palestinian undergraduate medical students in the academic year 2022-2023. In the quantitative part, we recruited a convenience sample of undergraduate medical students from universities in Palestine from June 15, 2022, to May 30, 2023. We collected data by using an online, well-structured, and self-administered questionnaire with 49 items. In the qualitative part, 15 undergraduate medical students were interviewed by trained researchers. Descriptive statistics and an inductive content analysis approach were used to analyze quantitative and qualitative data, respectively.

RESULTS

From a total of 371 invitations sent, 362 responses were received (response rate = 97.5%), and 349 were included in the analysis. The mean age of participants was 20.38 ± 1.97, with 40.11% (140) in their second year of medical school. Most participants (268, 76.79%) did not receive formal education on AI before or during medical study. About two-thirds of students strongly agreed or agreed that AI would become common in the future (67.9%, 237) and would revolutionize medical fields (68.7%, 240). Participants stated that they had not previously acquired training in the use of AI in medicine during formal medical education (260, 74.5%), confirming a dire need to include AI training in medical curricula (247, 70.8%). Most participants (264, 75.7%) think that learning opportunities for AI in medicine have not been adequate; therefore, it is very important to study more about employing AI in medicine (228, 65.3%). Male students (3.15 ± 0.87) had higher perception scores than female students (2.81 ± 0.86) (p < 0.001). The main themes that resulted from the qualitative analysis of the interview questions were an absence of AI learning opportunities, the necessity of including AI in medical curricula, optimism towards the future of AI in medicine, and expected challenges related to AI in medical fields.

CONCLUSION

Medical students lack access to educational opportunities for AI in medicine; therefore, AI should be included in formal medical curricula in Palestine.

Attitude and Understanding of Artificial Intelligence Among Saudi Medical Students: An Online Cross-Sectional Study

Purpose

Artificial Intelligence is drastically used nowadays in healthcare, but little is known about the attitude and perception of medical students towards AI in Saudi Arabia. This study aimed to explore undergraduate medical student's views on AI, assessed their understanding of AI, and the level of confidence of using basic AI tools in the future.

Methods

This cross-sectional study invited 303 medical undergraduate students to complete an anonymous electronic survey, which consists of questions related to attitude, understanding and confidence of using basic AI tools. We examined the statistical association between the categorical variables by using Chi-square test.

Results

The results of the study indicate that eighty-seven percent of participants believed that AI will play significant role in healthcare. Thirty-eight percent respondents reported that they have an understanding of the basic computational principle of AI. 71.29% respondents agreed that teaching in AI would be favorable for their career. More than half of the participants were confident in using basic AI tools in the future, Male students (p = 0.00), 26-30 years old participants (p = 0.03), intern students (p = 0.00), and Imam Abdulrahman Bin Faisal University medical students (p = 0.04) had positive attitude of artificial intelligence. Male participants (p = 0.02), and intern students (p = 0.00) had the highest proportion of confidence in using basic healthcare AI tool. Nearly 14% students received training on AI. Participants who received training on AI reported better understanding of AI (p = 0.03), develops positive attitude towards teaching in AI (p = 0.05), more confidence in using basic healthcare AI tools (p = 0.05).

Conclusion

Saudi medical undergraduate students understand the significance of AI and demonstrated a positive attitude towards AI. Medical students training on AI should be expanded and improved to avoid threats for seeking jobs by adapting artificial intelligence.

Perceptions of Faculty and Students About Use of Artificial Intelligence in Medical Education: A Qualitative Study

BACKGROUND

Artificial intelligence (AI) implies using a computer to model intelligent behavior with minimal human intervention. With the advances of AI use in healthcare comes the need to reform medical education to produce doctors competent in AI use. Therefore, this qualitative study was conducted to explore faculty and students' perspectives on AI, their use of AI applications, and their perspective on its value and impact on medical education at a Saudi faculty of medicine.

METHODS

This qualitative study was conducted at the Faculty of Medicine, Jazan University in Saudi Arabia. A direct interview was held with 11 faculty members, and six focus group discussions were conducted with students from the second to sixth year (34 students). Data were collected using semi-structured open-ended interview questions based on relevant literature.

FINDINGS

Most respondents (91.11%) believed AI systems would positively impact medical education, especially in research, knowledge gain, assessment, and simulation. However, ethical concerns were raised about threats to academic integrity, plagiarism, privacy/confidentiality issues, and AI's lacking cultural sensitivity. Faculty and students felt a need for training on AI use (80%) and that the curriculum could adapt to integrate AI (64.44%), though resources were seen as currently needing to be improved.

CONCLUSION

AI's potential to enhance medical education is generally viewed positively in the study, but ethical concerns must be addressed. Integrating AI into medical education programs requires adequate resources, training, and curriculum adaptation. There is still a need for further research in this area to develop comprehensive strategies.

A scoping review of artificial intelligence in medical education: BEME Guide No. 84

BACKGROUND

Artificial Intelligence (AI) is rapidly transforming healthcare, and there is a critical need for a nuanced understanding of how AI is reshaping teaching, learning, and educational practice in medical education. This review aimed to map the literature regarding AI applications in medical education, core areas of findings, potential candidates for formal systematic review and gaps for future research.

METHODS

This rapid scoping review, conducted over 16 weeks, employed Arksey and O'Malley's framework and adhered to STORIES and BEME guidelines. A systematic and comprehensive search across PubMed/MEDLINE, EMBASE, and MedEdPublish was conducted without date or language restrictions. Publications included in the review spanned undergraduate, graduate, and continuing medical education, encompassing both original studies and perspective pieces. Data were charted by multiple author pairs and synthesized into various thematic maps and charts, ensuring a broad and detailed representation of the current landscape.

RESULTS

The review synthesized 278 publications, with a majority (68%) from North American and European regions. The studies covered diverse AI applications in medical education, such as AI for admissions, teaching, assessment, and clinical reasoning. The review highlighted AI's varied roles, from augmenting traditional educational methods to introducing innovative practices, and underscores the urgent need for ethical guidelines in AI's application in medical education.

CONCLUSION

The current literature has been charted. The findings underscore the need for ongoing research to explore uncharted areas and address potential risks associated with AI use in medical education. This work serves as a foundational resource for educators, policymakers, and researchers in navigating AI's evolving role in medical education. A framework to support future high utility reporting is proposed, the FACETS framework.

Ethical considerations for artificial intelligence use in nursing informatics

Artificial intelligence revolutionizes nursing informatics and healthcare by enhancing patient outcomes and healthcare access while streamlining nursing workflow. These advancements, while promising, have sparked debates on traditional nursing ethics like patient data handling and implicit bias. The key to unlocking the next frontier in holistic nursing care lies in nurses navigating the delicate balance between artificial intelligence and the core values of empathy and compassion. Mindful utilization of artificial intelligence coupled with an unwavering ethical commitment by nurses may transform the very essence of nursing.

Transformative Potential of AI in Healthcare: Definitions, Applications, and Navigating the Ethical Landscape and Public Perspectives

Artificial intelligence (AI) has emerged as a crucial tool in healthcare with the primary aim of improving patient outcomes and optimizing healthcare delivery. By harnessing machine learning algorithms, natural language processing, and computer vision, AI enables the analysis of complex medical data. The integration of AI into healthcare systems aims to support clinicians, personalize patient care, and enhance population health, all while addressing the challenges posed by rising costs and limited resources. As a subdivision of computer science, AI focuses on the development of advanced algorithms capable of performing complex tasks that were once reliant on human intelligence. The ultimate goal is to achieve human-level performance with improved efficiency and accuracy in problem-solving and task execution, thereby reducing the need for human intervention. Various industries, including engineering, media/entertainment, finance, and education, have already reaped significant benefits by incorporating AI systems into their operations. Notably, the healthcare sector has witnessed rapid growth in the utilization of AI technology. Nevertheless, there remains untapped potential for AI to truly revolutionize the industry. It is important to note that despite concerns about job displacement, AI in healthcare should not be viewed as a threat to human workers. Instead, AI systems are designed to augment and support healthcare professionals, freeing up their time to focus on more complex and critical tasks. By automating routine and repetitive tasks, AI can alleviate the burden on healthcare professionals, allowing them to dedicate more attention to patient care and meaningful interactions. However, legal and ethical challenges must be addressed when embracing AI technology in medicine, alongside comprehensive public education to ensure widespread acceptance.

Exploring knowledge, attitudes, and practices towards artificial intelligence among health professions' students in Jordan

INTRODUCTION

The integration of Artificial Intelligence (AI) in medical education and practice is a significant development. This study examined the Knowledge, Attitudes, and Practices (KAP) of health professions' students in Jordan concerning AI, providing insights into their preparedness and perceptions.

METHODS

An online questionnaire was distributed to 483 Jordanian health professions' students via social media. Demographic data, AI-related KAP, and barriers were collected. Quantile regression models analyzed associations between variables and KAP scores.

RESULTS

Moderate AI knowledge was observed among participants, with specific understanding of data requirements and barriers. Attitudes varied, combining skepticism about AI replacing human teachers with recognition of its value. While AI tools were used for specific tasks, broader integration in medical education and practice was limited. Barriers included lack of knowledge, access, time constraints, and curriculum gaps.

CONCLUSIONS

This study highlights the need to enhance medical education with AI topics and address barriers. Students need to be better prepared for AI integration, in order to enable medical education to harness AI's potential for improved patient care and training.

Assessing the Utilization of Large Language Models in Medical Education: Insights From Undergraduate Medical Students

Background Artificial intelligence (AI) has the potential to be integrated into medical education. Among AI-based technology, large language models (LLMs) such as ChatGPT, Google Bard, Microsoft Bing, and Perplexity have emerged as powerful tools with capabilities in natural language processing. With this background, this study investigates the knowledge, attitude, and practice of undergraduate medical students regarding the utilization of LLMs in medical education in a medical college in Jharkhand, India. Methods A cross-sectional online survey was sent to 370 undergraduate medical students on Google Forms. The questionnaire comprised the following three domains: knowledge, attitude, and practice, each containing six questions. Cronbach's alphas for knowledge, attitude, and practice domains were 0.703, 0.707, and 0.809, respectively. Intraclass correlation coefficients for knowledge, attitude, and practice domains were 0.82, 0.87, and 0.78, respectively. The average scores in the three domains were compared using ANOVA. Results A total of 172 students participated in the study (response rate: 46.49%). The majority of the students (45.93%) rarely used the LLMs for their teaching-learning purposes (chi-square (3) = 41.44, p < 0.0001). The overall score of knowledge (3.21±0.55), attitude (3.47±0.54), and practice (3.26±0.61) were statistically significantly different (ANOVA F (2, 513) = 10.2, p < 0.0001), with the highest score in attitude and lowest in knowledge. Conclusion While there is a generally positive attitude toward the incorporation of LLMs in medical education, concerns about overreliance and potential inaccuracies are evident. LLMs offer the potential to enhance learning resources and provide accessible education, but their integration requires further planning. Further studies are required to explore the long-term impact of LLMs in diverse educational contexts.