Expert-led and artificial intelligence (AI) system-assisted tutoring course increase confidence of Chinese medical interns on suturing and ligature skills: prospective pilot study

Topics and Trends of Health Informatics Education Research: Scientometric Analysis

BACKGROUND

Academic and educational institutions are making significant contributions toward training health informatics professionals. As research in health informatics education (HIE) continues to grow, it is useful to have a clearer understanding of this research field.

OBJECTIVE

This study aims to comprehensively explore the research topics and trends of HIE from 2014 to 2023. Specifically, it aims to explore (1) the trends of annual articles, (2) the prolific countries/regions, institutions, and publication sources, (3) the scientific collaborations of countries/regions and institutions, and (4) the major research themes and their developmental tendencies.

METHODS

Using publications in Web of Science Core Collection, a scientometric analysis of 575 articles related to the field of HIE was conducted. The structural topic model was used to identify topics discussed in the literature and to reveal the topic structure and evolutionary trends of HIE research.

RESULTS

Research interest in HIE has clearly increased from 2014 to 2023, and is continually expanding. The United States was found to be the most prolific country in this field. Harvard University was found to be the leading institution with the highest publication productivity. Journal of Medical Internet Research, Journal of The American Medical Informatics Association, and Applied Clinical Informatics were the top 3 journals with the highest articles in this field. Countries/regions and institutions having higher levels of international collaboration were more impactful. Research on HIE could be modeled into 7 topics related to the following areas: clinical (130/575, 22.6%), mobile application (123/575, 21.4%), consumer (99/575, 17.2%), teaching (61/575, 10.6%), public health (56/575, 9.7%), discipline (55/575, 9.6%), and nursing (51/575, 8.9%). The results clearly indicate the unique foci for each year, depicting the process of development for health informatics research.

CONCLUSIONS

This is believed to be the first scientometric analysis exploring the research topics and trends in HIE. This study provides useful insights and implications, and the findings could be used as a guide for HIE contributors.

Artificial Intelligence in Medical Education and Mentoring in Rehabilitation Medicine

ABSTRACT

Artificial intelligence emerges as a transformative force, offering novel solutions to enhance medical education and mentorship in the specialty of physical medicine and rehabilitation. Artificial intelligence is a transformative technology that is being adopted in nearly every industry. In medicine, the use of artificial intelligence in medical education is growing. Artificial intelligence may also assist with some of the challenges of mentorship, including the limited availability of experienced mentors, and the logistical difficulties of time and geography are some constraints of traditional mentorship. In this commentary, we discuss various models of artificial intelligence in medical education and mentoring, including expert systems, conversational agents, and hybrid models. These models enable tailored guidance, broaden outreach within the physical medicine and rehabilitation community, and support continuous learning and development. Balancing artificial intelligence's technical advantages with the essential human elements while addressing ethical considerations, artificial intelligence integration into medical education and mentorship presents a paradigm shift toward a more accessible, responsive, and enriched experience in rehabilitation medicine.

The Role of Artificial Intelligence in Medical Education: A Systematic Review

BACKGROUND

To examine the artificial intelligence (AI) tools currently being studied in modern medical education, and critically evaluate the level of validation and the quality of evidence presented in each individual study.

METHODS

This review (PROSPERO ID: CRD42023410752) was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. A database search was conducted using PubMed, Embase, and Cochrane Library. Articles written in the English language between 2000 and March 2023 were reviewed retrospectively using the MeSH Terms "AI" and "medical education" A total of 4642 potentially relevant studies were found.

RESULTS

After a thorough screening process, 36 studies were included in the final analysis. These studies consisted of 26 quantitative studies and 10 studies investigated the development and validation of AI tools. When examining the results of studies in which Support vector machines (SVMs) were employed, it has demonstrated high accuracy in assessing students' experiences, diagnosing acute abdominal pain, classifying skilled and novice participants, and evaluating surgical training levels. Particularly in the comparison of surgical skill levels, it has achieved an accuracy rate of over 92%.

CONCLUSION

AI tools demonstrated effectiveness in improving practical skills, diagnosing diseases, and evaluating student performance. However, further research with rigorous validation is required to identify the most effective AI tools for medical education.

Application value of an artificial intelligence-based diagnosis and recognition system in gastroscopy training for graduate students in gastroenterology: a preliminary study

OBJECTIVE

This study aimed to discuss the application value of an artificial intelligence-based diagnosis and recognition system (AIDRS) in the teaching activities for Bachelor of Medicine and Bachelor of Surgery (MBBS) in China. The learning performance of graduate students in gastroenterology during gastroscopy training with and without AIDRS was assessed.

METHODS

The study recruited 32 graduate students of the gastroenterology program at Jiangsu province hospital of Chinese medicine and Xiangyang No. 1 People's Hospital from March 2018 to March 2022 and randomly divided them into AIDRS (n = 16) and non-AIDRS (n = 16) groups. The AIDRS software was used for real-time monitoring of blind spots of gastroscopy to aid in lesion diagnosis and recognition in the AIDRS group. Only a conventional gastroscopic procedure was implemented in the non-AIDRS group. The final performance score, success rate of gastroscopy, lesion detection rate, and pain score of patients were compared between the two groups during gastroscopy. A self-prepared teaching and learning satisfaction questionnaire was administered to the two groups of students.

RESULTS

The AIDRS group had a higher final performance score (92.60 ± 2.83 vs. 89.21 ± 3.57, t = 2.98, P < 0.05), a higher success rate of gastroscopy (448/480 vs. 417/480, χ2 = 11.23, P < 0.05), and a higher detection rate of lesions (51/52 vs. 41/53, χ2 = 8.56, P < 0.05) compared with the non-AIDRS group. The pain scores of patients were lower in the AIDRS group than in the non-AIDRS group (3.40 [2.23, 3.98] vs. 4.45 [3.72, 4.75], Z = 3.04, P < 0.05). Besides, the average time for gastroscopy was lower in the AIDRS group than in the non-AIDRS group (7.15 ± 1.24 vs. 8.21 ± 1.26, t = 2.38, P = 0.02). The overall satisfaction level with the teaching program was higher in the AIDRS group (43.51 ± 2.29 vs. 40.93 ± 2.07, t = 3.33, P < 0.05).

CONCLUSION

In the context of medicine-education cooperation, AIDRS offered valuable assistance in gastroscopy training and increased the success rate of gastroscopy and teaching and learning satisfaction. AIDRS is worthy of wider-scale promotion.

Development of an Artificial Intelligence Teaching Assistant System for Undergraduate Nursing Students: A Field Testing Study

Keeping students engaged and motivated during online or class discussion may be challenging. Artificial intelligence has potential to facilitate active learning by enhancing student engagement, motivation, and learning outcomes. The purpose of this study was to develop, test usability of, and explore undergraduate nursing students' perceptions toward the Artificial Intelligence-Teaching Assistant System. The system was developed based on three main components: machine tutor intelligence, a graphical user interface, and a communication connector. They were included in the system to support contextual machine tutoring. A field-testing study design, a mixed-method approach, was utilized with questionnaires and focus group interview. Twenty-one undergraduate nursing students participated in this study, and they interacted with the system for 2 hours following the required activity checklist. The students completed the validated usability questionnaires and then participated in the focus group interview. Descriptive statistics were used to analyze quantitative data, and thematic analysis was used to analyze qualitative data from the focus group interviews. The results showed that the Artificial Intelligence-Teaching Assistant System was user-friendly. Four main themes emerged, namely, functionality, feasibility, artificial unintelligence, and suggested learning modality. However, Artificial Intelligence-Teaching Assistant System functions, user interface, and content can be improved before full implementation.

Dental student application of artificial intelligence technology in detecting proximal caries lesions

OBJECTIVES

This study aimed to investigate the caries diagnosis performances of dental students after training with an artificial intelligence (AI) application utilizing deep learning techniques, a type of artificial neural network.

METHODS

A total of 1200 bitewing radiographs were obtained from the institution's database and two specialist dentists labeled the caries lesions in the images. Randomly selected 1000 images were used for training purposes and the remaining 200 radiographs were used to evaluate the caries diagnostic performance of the AI. Then, a convolutional neural network, a deep learning algorithm commonly employed to analyze visual imagery problems, called "You Only Look Once," was modified and trained to detect enamel and dentin caries lesions in the radiographs. Forty dental students were selected voluntarily and randomly divided into two groups. The pre-test results of dental caries diagnosis performances of both groups were recorded. After 1 week, group 2 students were trained using an AI application. Then, the post-test results of both groups were recorded. The labeling duration of the students was also measured and analyzed.

RESULTS

When both groups' pre-test and post-test results were evaluated, a statistically significant improvement was found for all parameters examined except precision score (p < 0.05). However, the trained group's accuracy, sensitivity, specificity, and F1 scores were significantly higher than the non-trained group in terms of post-test scores (p < 0.05). In group 2 (trained group), the post-test labeling time was considerably increased (p < 0.05).

CONCLUSIONS

The students trained by AI showed promising results in detecting caries lesions. The use of AI can also contribute to the clinical education of dental students.

Technological advancements in surgical laparoscopy considering artificial intelligence: a survey among surgeons in Germany

PURPOSE

The integration of artificial intelligence (AI) into surgical laparoscopy has shown promising results in recent years. This survey aims to investigate the inconveniences of current conventional laparoscopy and to evaluate the attitudes and desires of surgeons in Germany towards new AI-based laparoscopic systems.

METHODS

A 12-item web-based questionnaire was distributed to 38 German university hospitals as well as to a Germany-wide voluntary hospital association (CLINOTEL) consisting of 66 hospitals between July and November 2022.

RESULTS

A total of 202 questionnaires were completed. The majority of respondents (88.1%) stated that they needed one assistant during laparoscopy and rated the assistants' skillfulness as "very important" (39.6%) or "important" (49.5%). The most uncomfortable aspects of conventional laparoscopy were inappropriate camera movement (73.8%) and lens condensation (73.3%). Selected features that should be included in a new laparoscopic system were simple and intuitive maneuverability (81.2%), automatic de-fogging (80.7%), and self-cleaning of camera (77.2%). Furthermore, AI-based features were improvement of camera positioning (71.3%), visualization of anatomical landmarks (67.3%), image stabilization (66.8%), and tissue damage protection (59.4%). The reason for purchasing an AI-based system was to improve patient safety (86.1%); the reasonable price was €50.000-100.000 (34.2%), and it was expected to replace the existing assistants' workflow up to 25% (41.6%).

CONCLUSION

Simple and intuitive maneuverability with improved and image-stabilized camera guidance in combination with a lens cleaning system as well as AI-based augmentation of anatomical landmarks and tissue damage protection seem to be significant requirements for the further development of laparoscopic systems.

The use and future perspective of Artificial Intelligence-A survey among German surgeons

Purpose

Clinical abundance of artificial intelligence has increased significantly in the last decade. This survey aims to provide an overview of the current state of knowledge and acceptance of AI applications among surgeons in Germany.

Methods

A total of 357 surgeons from German university hospitals, academic teaching hospitals and private practices were contacted by e-mail and asked to participate in the anonymous survey.

Results

A total of 147 physicians completed the survey. The majority of respondents (n = 85, 52.8%) stated that they were familiar with AI applications in medicine. Personal knowledge was self-rated as average (n = 67, 41.6%) or rudimentary (n = 60, 37.3%) by the majority of participants. On the basis of various application scenarios, it became apparent that the respondents have different demands on AI applications in the area of "diagnosis confirmation" as compared to the area of "therapy decision." For the latter category, the requirements in terms of the error level are significantly higher and more respondents view their application in medical practice rather critically. Accordingly, most of the participants hope that AI systems will primarily improve diagnosis confirmation, while they see their ethical and legal problems with regard to liability as the main obstacle to extensive clinical application.

Conclusion

German surgeons are in principle positively disposed toward AI applications. However, many surgeons see a deficit in their own knowledge and in the implementation of AI applications in their own professional environment. Accordingly, medical education programs targeting both medical students and healthcare professionals should convey basic knowledge about the development and clinical implementation process of AI applications in different medical fields, including surgery.

Artificial Intelligence Methods and Artificial Intelligence-Enabled Metrics for Surgical Education: A Multidisciplinary Consensus

BACKGROUND

Artificial intelligence (AI) methods and AI-enabled metrics hold tremendous potential to advance surgical education. Our objective was to generate consensus guidance on specific needs for AI methods and AI-enabled metrics for surgical education.

STUDY DESIGN

The study included a systematic literature search, a virtual conference, and a 3-round Delphi survey of 40 representative multidisciplinary stakeholders with domain expertise selected through purposeful sampling. The accelerated Delphi process was completed within 10 days. The survey covered overall utility, anticipated future (10-year time horizon), and applications for surgical training, assessment, and feedback. Consensus was agreement among 80% or more respondents. We coded survey questions into 11 themes and descriptively analyzed the responses.

RESULTS

The respondents included surgeons (40%), engineers (15%), affiliates of industry (27.5%), professional societies (7.5%), regulatory agencies (7.5%), and a lawyer (2.5%). The survey included 155 questions; consensus was achieved on 136 (87.7%). The panel listed 6 deliverables each for AI-enhanced learning curve analytics and surgical skill assessment. For feedback, the panel identified 10 priority deliverables spanning 2-year (n = 2), 5-year (n = 4), and 10-year (n = 4) timeframes. Within 2 years, the panel expects development of methods to recognize anatomy in images of the surgical field and to provide surgeons with performance feedback immediately after an operation. The panel also identified 5 essential that should be included in operative performance reports for surgeons.

CONCLUSIONS

The Delphi panel consensus provides a specific, bold, and forward-looking roadmap for AI methods and AI-enabled metrics for surgical education.

Application of Artificial Intelligence in Medicine: An Overview

Artificial intelligence (AI) is a new technical discipline that uses computer technology to research and develop the theory, method, technique, and application system for the simulation, extension, and expansion of human intelligence. With the assistance of new AI technology, the traditional medical environment has changed a lot. For example, a patient's diagnosis based on radiological, pathological, endoscopic, ultrasonographic, and biochemical examinations has been effectively promoted with a higher accuracy and a lower human workload. The medical treatments during the perioperative period, including the preoperative preparation, surgical period, and postoperative recovery period, have been significantly enhanced with better surgical effects. In addition, AI technology has also played a crucial role in medical drug production, medical management, and medical education, taking them into a new direction. The purpose of this review is to introduce the application of AI in medicine and to provide an outlook of future trends.

An Educational Network for Surgical Education Supported by Gamification Elements: Protocol for a Randomized Controlled Trial

Background

Traditionally, medical students have learned surgical skills by observing a resident physician or surgeon who is performing the technique. Due to inconsistent practice opportunities in the clinical setting, a disparity of skill levels among students has been observed. In addition, the poor availability of faculty professors is a limiting factor in teaching and adequately preparing medical students for their clerkship years. With the ongoing COVID-19 pandemic, medical students do not have access to traditional suturing learning opportunities. Didactic courses are available on videoconferencing platforms; however, these courses do not include technical training.

Objective

Our overarching goal is to evaluate the efficacy and usability of web-based peer-learning for advanced suturing techniques (ie, running subcuticular sutures). We will use the Gamified Educational Network (GEN), a newly developed web-based learning tool. We will assess students’ ability to identify and perform the correct technique. We will also assess the students’ satisfaction with regard to GEN.

Methods

We will conduct a prospective randomized controlled trial with blinding of expert examiners. First-year medical students in the Faculty of Medicine of Université de Montréal will be randomized into four groups: (1) control, (2) self-learning, (3) peer-learning, and (4) peer-learning with expert feedback. Each arm will have 15 participants who will learn how to perform running subcuticular sutures through videos on GEN. For our primary outcome, the students’ ability to identify the correct technique will be evaluated before and after the intervention on GEN. The students will view eight videos and rate the surgical techniques using the Objective Structured Assessment of Technical Skills Global Rating Scale and the Subcuticular Suture Checklist as evaluation criteria. For our secondary outcomes, students will anonymously record themselves performing a running subcuticular suture and will be evaluated using the same scales. Then, a survey will be sent to assess the students’ acceptance of the intervention.

Results

The study will be conducted in accordance with the Declaration of Helsinki and has been approved by our institutional review board (CERSES 20-068-D). No participants have been recruited yet.

Conclusions

Peer learning through GEN has the potential to overcome significant limitations related to the COVID-19 pandemic and the lack of availability of faculty professors. Further, a decrease of the anxiety related to traditional suturing classes can be expected. We aim to create an innovative and sustainable method of teaching surgical skills to improve the efficiency and quality of surgical training in medical faculties. In the context of the COVID-19 pandemic, the need for such tools is imperative.

Trial Registration

ClinicalTrials.gov NCT04425499; https://clinicaltrials.gov/ct2/show/NCT04425499

International Registered Report Identifier (IRRID)

PRR1-10.2196/21273

Scientific Development of Educational Artificial Intelligence in Web of Science

The social and technological changes that society is undergoing in this century are having a global influence on important aspects such as the economy, health and education. An example of this is the inclusion of artificial intelligence in the teaching–learning processes. The objective of this study was to analyze the importance and the projection that artificial intelligence has acquired in the scientific literature in the Web of Science categories related to the field of education. For this, scientific mapping of the reported documents was carried out. Different bibliometric indicators were analyzed and a word analysis was carried out. We worked with an analysis unit of 379 publications. The results show that scientific production is irregular from its beginnings in 1956 to the present. The language of greatest development is English. The most significant publication area is Education Educational Research, with conference papers as document types. The underlying organization is the Open University UK. It can be concluded that there is an evolution in artificial intelligence (AI) research in the educational field, focusing in the last years on the performance and influence of AI in the educational processes.

Artificial Intelligence Education and Tools for Medical and Health Informatics Students: Systematic Review

BACKGROUND

The use of artificial intelligence (AI) in medicine will generate numerous application possibilities to improve patient care, provide real-time data analytics, and enable continuous patient monitoring. Clinicians and health informaticians should become familiar with machine learning and deep learning. Additionally, they should have a strong background in data analytics and data visualization to use, evaluate, and develop AI applications in clinical practice.

OBJECTIVE

The main objective of this study was to evaluate the current state of AI training and the use of AI tools to enhance the learning experience.

METHODS

A comprehensive systematic review was conducted to analyze the use of AI in medical and health informatics education, and to evaluate existing AI training practices. PRISMA-P (Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols) guidelines were followed. The studies that focused on the use of AI tools to enhance medical education and the studies that investigated teaching AI as a new competency were categorized separately to evaluate recent developments.

RESULTS

This systematic review revealed that recent publications recommend the integration of AI training into medical and health informatics curricula.

CONCLUSIONS

To the best of our knowledge, this is the first systematic review exploring the current state of AI education in both medicine and health informatics. Since AI curricula have not been standardized and competencies have not been determined, a framework for specialized AI training in medical and health informatics education is proposed.