Interactive algorithms for teaching and learning acute medicine in the network of medical faculties MEFANET

Comparison of the effects of burn assessment mission game with feedback lecture on nursing students' knowledge and skills in the burn patients' assessment: a randomized clinical trial

BACKGROUND

Learning of burn patient assessment is very important, but heart-breaking for nursing students. This study aimed to compare the effects of feedback lecture method with a serious game (BAM Game) on nursing students' knowledge and skills in the assessment of burn patients.

METHOD

In this randomized controlled clinical trial, 42 nursing students in their 5th semester at Mashhad University of Medical Sciences School of Nursing and Midwifery, were randomly assigned to intervention (BAM game, available for two weeks) and control (feedback lecture method presented in two 90-minute sessions) groups. Two weeks after the intervention, all students were evaluated for their knowledge (using knowledge assessment test) and skills (using an Objective Structured Clinical Examination). Statistical analysis involved independent t-test, Fisher's exact test, analysis of covariance (ANCOVA), and univariable and multivariable ordinal logistic regression models.

RESULTS

Following the intervention, the skill scores were 16.4 (SD 2.2) for the intervention group and 11.8 (SD 3.8) for the control group. Similarly, the knowledge scores were 17.4 (SD 2.2) for the intervention group and 14.7 (SD 2.6) for the control group. Both differences were statistically significant (P < .001). These differences remained significant even after adjusting for various factors such as age, gender, marital status, residence, university entrance exam rank, and annual GPA (P < .05). Furthermore, the BAM game group showed significantly higher skills rank than the feedback lecture group across most stations (eight of ten) (P < .05) in the univariable analysis. Multivariable analysis also revealed a significantly higher skills score across most stations even after adjusting for the mentioned factors (P < .05). These results suggest that the BAM game group had higher skills scores over a range of 1.5 to 3.9 compared to the feedback lecture group.

CONCLUSIONS

This study demonstrated that nursing students who participated in the BAM game group exhibited superior performance in knowledge acquisition and skill development, compared to those in the control group. These results underscore a significant enhancement in educational outcomes for students involved with the BAM game, confirming its utility as a potent and effective pedagogical instrument within the realm of nursing education.

TRIAL REGISTRATION

Iranian Registry of Clinical Trials: IRCT20220410054483N1, Registration date: 18/04/2022.

Developing a simulation-based learning model for acute medical education during COVID-19 pandemic with Simulation via Instant Messaging - Birmingham Advance (SIMBA)

Simulation-based learning (SBL) is well-established in medical education and has gained popularity, particularly during the COVID-19 pandemic when in-person teaching is infeasible. SBL replicates real-life scenarios and provides a fully immersive yet safe learning environment to develop clinical competency. Simulation via Instant Messaging - Birmingham Advance (SIMBA) is an exemplar of SBL, which we previously showed to be effective in endocrinology and diabetes. Previous studies reported the efficacy of SBL in acute medicine. We studied SIMBA as a learning intervention for healthcare professionals interested in acute medicine and defined our aims using the Kirkpatrick model: (i) develop an SBL tool to improve case management; (ii) evaluate experiences and confidence before and after; and (iii) compare efficacy across training levels.Three sessions were conducted, each representing a PDSA cycle (Plan-Do-Study-Act), consisting of four cases and advertised to healthcare professionals at our hospital and social media. Moderators facilitated progression through 25 min simulations and adopted patient and clinical roles as appropriate. Consultants chaired discussion sessions using relevant guidelines. Presimulation and postsimulation questionnaires evaluated self-reported confidence, feedback and intended changes to clinical practice.Improvements were observed in self-reported confidence managing simulated cases across all sessions. Of participants, 93.3% found SIMBA applicable to clinical practice, while 89.3% and 88.0% felt SIMBA aided personal and professional development, respectively. Interestingly, 68.0% preferred SIMBA to traditional teaching methods. Following participant feedback, more challenging cases were included, and we extended the time for simulation and discussion. The transcripts were amended to facilitate more participant-moderator interaction representing clinical practice. In addition, we refined participant recruitment over the three sessions. In cycle 1, we advertised incentives: participation counted towards teaching requirements, certificates and feedback. To rectify the reduction in participants in cycle 2, we implemented new advertisement methods in cycle 3, including on-site posters, reminder emails and recruitment of the defence deanery cohort.

A Web Platform (MOSAICO) to Design, Perform, and Assess Collaborative Clinical Scenarios for Medical Students: Viewpoint

BACKGROUND

The collaborative clinical simulation (CCS) model is a structured method for the development and assessment of clinical competencies through small groups working collaboratively in simulated environments. From 2016 onward, the CCS model has been applied successfully among undergraduate and graduate medical students from the Universidad de Talca, Chile; the Universität de Barcelona, Spain; and the Universidad de Vic-Manresa, Spain. All the templates for building the clinical cases and the assessment instruments with CCS were printed on paper. Considering the large number of CCS sessions and the number of participating students that are required throughout the medical degree curriculum, it is impossible to keep an organized record when the instruments are printed on paper. Moreover, with the COVID-19 pandemic, web platforms have become important as safe training environments for students and medical faculties; this new educational environment should include the consolidation and adaptation of didactic sessions that create and use available virtual cases and use different web platforms.

OBJECTIVE

The goal of this study is to describe the design and development of a web platform that was created to strengthen the CCS model.

METHODS

The design of the web platform aimed to support each phase of the CCS by incorporating functional requirements (ie, features that the web platform will be able to perform) and nonfunctional requirements (ie, how the web platform should behave) that are needed to run collaborative sessions. The software was developed under the Model-View-Controller architecture to separate the views from the data model and the business logic.

RESULTS

MOSAICO is a web platform used to design, perform, and assess collaborative clinical scenarios for medical students. MOSAICO has four modules: educational design, students' collaborative design, collaborative simulation, and collaborative debriefing. The web platform has three different user profiles: academic simulation unit, teacher, and student. These users interact under different roles in collaborative simulations. MOSAICO enables a collaborative environment, which is connected via the internet, to design clinical scenarios guided by the teacher and enables the use of all data generated to be discussed in the debriefing session with the teacher as a guide. The web platform is running at the Universidad de Talca in Chile and is supporting collaborative simulation activities via the internet for two medical courses: (1) Semiology for third-year students (70 students in total) and (2) Medical Genetics for fifth-year students (30 students in total).

CONCLUSIONS

MOSAICO is applicable within the CCS model and is used frequently in different simulation sessions at the Universidad de Talca, where medical students can work collaboratively via the internet. MOSAICO simplifies the application and reuse of clinical simulation scenarios, allowing its use in multiple simulation centers. Moreover, its applications in different courses (ie, a large part of the medical curriculum) support the automatic tracking of simulation activities and their assessment.

Mapping Behavioral Health Serious Game Interventions for Adults With Chronic Illness: Scoping Review

BACKGROUND

Serious games for health are increasingly being used to address health outcomes in patients with chronic illnesses. These studies vary in their study designs, patient populations, frameworks, outcome variables, and degree of specificity of the serious game intervention.

OBJECTIVE

This scoping review aims to clarify the conceptual features of the existing research related to serious games designed to improve cognitive and behavioral outcomes in adults with chronic illness.

METHODS

We applied the Preferred Reporting Items of Systematic Reviews and Meta-Analysis for scoping reviews (PRISMA-ScR) methodology, including an a priori research question. We searched 4 electronic databases to identify articles published through November 2019. Inclusion criteria encompassed (1) adults 18 years or older; (2) patients with a diagnosis of chronic illness; (3) a serious game intervention; and (4) defined patient outcomes that assess patients' behavioral, cognitive, or health outcomes.

RESULTS

Of the 3305 articles identified, 38 were included in the review. We charted and analyzed the theoretical frameworks, key concepts, and outcome variables of these studies with summaries of features across articles. The majority of studies used a randomized controlled trial design (23/38, 61%), included a custom serious game intervention (22/38, 58%), and lacked a theoretical framework (25/38, 66%). Common outcome variables included quality of life (16/38, 42%), mood (15/38, 39%), cognitive function (13/38, 34%), symptoms (12/38, 32%), and physical activity (9/38, 24%). Key differences between studies included whether or not serious games aimed to train versus teach patients, be widely accessible versus tailored interventions, or replace versus complement current treatments.

CONCLUSIONS

This scoping review defines the current landscape of research in serious games for health research targeting behavioral and cognitive outcomes in adults with chronic disease. Studies have addressed a variety of patient populations and diverse patient outcomes. Researchers wanting to build on the current research should integrate theoretical frameworks into the design of the intervention and trial to more clearly articulate the active ingredients and mechanisms of serious games.

What Can Be Achieved With Motivation-Based Teaching of Medical Students? A Monocentric Retrospective Audit of Retention Among Highly Motivated Graduates Who Underwent the Learning-by-Doing Concept in Anesthesiology and Intensive Care Medicine

Background

Medical education, in general, is undergoing a significant shift from traditional methods. It becomes very difficult to discover effective teaching methods within the limited possibilities in patient hands-on education, especially as seen in anesthesiology and intensive care medicine (AIM) teaching. Motivation-based teaching is very popular in all other aspects of education, but it has received scant attention in medical education literature, even though it can make a real difference for both students and physicians.

Objective

The primary aim of this retrospective audit was to find out if proper motivation-based teaching of students via the development of AKUTNE.CZ’s serious games can help retain graduates of the Faculty of Medicine of Masaryk University (FMMU) for the AIM specialty.

Methods

Motivation-based teaching and the learning-by-doing concept were applied to a subject called Individual Project. Our topic, The Development of the Multimedia Educational Portal, AKUTNE.CZ, has been offered since 2010. The objective has been the development of supportive material in the form of interactive algorithms, serious games, and virtual patients for problem-based learning or team-based learning lectures aimed at acute medicine. We performed a retrospective questionnaire evaluation of all participants from the 2010-2017 period, focusing on their choice of medical specialty in 2017. The data were reported descriptively.

Results

We evaluated 142 students who passed Individual Project with topic The Development of the Multimedia Educational Portal, AKUTNE.CZ during 2010 to 2017. In this period, they developed up to 77 electronic serious games in the form of interactive multimedia algorithms. Out of 139 students in general medicine, 108 students (77.7%) had already graduated and 37 graduates (34.3%) worked in the AIM specialty. Furthermore, 57 graduates (52.8%) chose the same specialty after graduation, matching the topic of their algorithm, and 37 (65%) of these graduates decided to pursue AIM.

Conclusions

Motivation-based teaching and the concept of learning-by-doing by the algorithm/serious game development led to the significant retention of FMMU graduates in the AIM specialty. This concept could be considered successful, and as the concept itself can also be well integrated into the teaching of other medical specialties, the potential of motivation-based teaching should be used more broadly within medical education.

Serious Games in Surgical Medical Education: A Virtual Emergency Department as a Tool for Teaching Clinical Reasoning to Medical Students

Background

Serious games enable the simulation of daily working practices and constitute a potential tool for teaching both declarative and procedural knowledge. The availability of educational serious games offering a high-fidelity, three-dimensional environment in combination with profound medical background is limited, and most published studies have assessed student satisfaction rather than learning outcome as a function of game use.

Objective

This study aimed to test the effect of a serious game simulating an emergency department (“EMERGE”) on students’ declarative and procedural knowledge, as well as their satisfaction with the serious game.

Methods

This nonrandomized trial was performed at the Department of General, Visceral and Cancer Surgery at University Hospital Cologne, Germany. A total of 140 medical students in the clinical part of their training (5th to 12th semester) self-selected to participate in this experimental study. Declarative knowledge (measured with 20 multiple choice questions) and procedural knowledge (measured with written questions derived from an Objective Structured Clinical Examination station) were assessed before and after working with EMERGE. Students’ impression of the effectiveness and applicability of EMERGE were measured on a 6-point Likert scale.

Results

A pretest-posttest comparison yielded a significant increase in declarative knowledge. The percentage of correct answers to multiple choice questions increased from before (mean 60.4, SD 16.6) to after (mean 76.0, SD 11.6) playing EMERGE (P<.001). The effect on declarative knowledge was larger in students in lower semesters than in students in higher semesters (P<.001). Additionally, students’ overall impression of EMERGE was positive.

Conclusions

Students self-selecting to use a serious game in addition to formal teaching gain declarative and procedural knowledge.

Teaching Pediatric Peritoneal Dialysis Globally through Virtual Simulation

BACKGROUND AND OBJECTIVES

Despite the increasing prevalence of childhood kidney disease worldwide, there is a shortage of clinicians trained to provide peritoneal dialysis (PD). E-learning technologies may provide a solution to improve knowledge in PD. We describe the development of a virtual PD simulator and report the first 22 months of online usage.

DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS

The PD simulator was developed and released on OPENPediatrics in January of 2016. A prospective study of international, multidisciplinary healthcare providers was conducted from January of 2016 through October of 2017. User action data were analyzed with descriptive statistics and linear regression. Paired t tests compared user pre- and post-test scores. User satisfaction was assessed by survey.

RESULTS

The simulator was accessed by 1066 users in 70 countries. Users spent a median of 35 minutes (interquartile range [IQR] 14-84) in the simulator. Users who completed the structured learning curriculum (n=300) spent a median of 85 minutes (IQR 46-95), and those who completed the entire simulator (n=63) spent a median of 122 minutes (IQR 69-195). Users who completed the simulator were more likely to scroll through text and access the simulator in multiple sessions. The 300 users that completed testing showed statistically significant increases in the post- versus pretest scores, with a mean increase of 36.4 of 100 points, SD 19.9 (95% confidence interval, 34.1 to 38.6, P<0.001). Eighty-seven percent (20 of 23) of survey respondents felt the simulator was relevant to their clinical practice, and 78% (18 of 23) would recommend it to others.

CONCLUSIONS

This is the first reported virtual PD simulator. Increased test scores were observed between pre- and post-tests by clinicians who completed testing, across disciplines, training levels, and resource settings.

Serious Gaming in Medical Education: A Proposed Structured Framework for Game Development

STATEMENT

Serious games are increasingly being used for medical education. However, the design and development of serious games for the education of health professionals is highly variable, and very few articles report the development process used for game development. There are many established processes for software development that can improve and streamline development, and incorporating the best practices from educational pedagogy and software development may enhance teamwork and communication, decrease development costs, and improve the quality of serious games. In this article, we review and summarize the literature for serious game development for medical education, and combining the best practices, we propose a structured three-phase iterative development framework for serious game development.

Cardiopulmonary Resuscitation Training by Avatars: A Qualitative Study of Medical Students' Experiences Using a Multiplayer Virtual World

Background

Emergency medical practices are often team efforts. Training for various tasks and collaborations may be carried out in virtual environments. Although promising results exist from studies of serious games, little is known about the subjective reactions of learners when using multiplayer virtual world (MVW) training in medicine.

Objective

The objective of this study was to reach a better understanding of the learners’ reactions and experiences when using an MVW for team training of cardiopulmonary resuscitation (CPR).

Methods

Twelve Swedish medical students participated in semistructured focus group discussions after CPR training in an MVW with partially preset options. The students’ perceptions and feelings related to use of this educational tool were investigated. Using qualitative methodology, discussions were analyzed by a phenomenological data-driven approach. Quality measures included negotiations, back-and-forth reading, triangulation, and validation with the informants.

Results

Four categories characterizing the students’ experiences could be defined: (1) Focused Mental Training, (2) Interface Diverting Focus From Training, (3) Benefits of Practicing in a Group, and (4) Easy Loss of Focus When Passive. We interpreted the results, compared them to findings of others, and propose advantages and risks of using virtual worlds for learning.

Conclusions

Beneficial aspects of learning CPR in a virtual world were confirmed. To achieve high participant engagement and create good conditions for training, well-established procedures should be practiced. Furthermore, students should be kept in an active mode and frequent feedback should be utilized. It cannot be completely ruled out that the use of virtual training may contribute to erroneous self-beliefs that can affect later clinical performance.

What Are We Looking for in Computer-Based Learning Interventions in Medical Education? A Systematic Review

Background

Computer-based learning (CBL) has been widely used in medical education, and reports regarding its usage and effectiveness have ranged broadly. Most work has been done on the effectiveness of CBL approaches versus traditional methods, and little has been done on the comparative effects of CBL versus CBL methodologies. These findings urged other authors to recommend such studies in hopes of improving knowledge about which CBL methods work best in which settings.

Objective

In this systematic review, we aimed to characterize recent studies of the development of software platforms and interventions in medical education, search for common points among studies, and assess whether recommendations for CBL research are being taken into consideration.

Methods

We conducted a systematic review of the literature published from 2003 through 2013. We included studies written in English, specifically in medical education, regarding either the development of instructional software or interventions using instructional software, during training or practice, that reported learner attitudes, satisfaction, knowledge, skills, or software usage. We conducted 2 latent class analyses to group articles according to platform features and intervention characteristics. In addition, we analyzed references and citations for abstracted articles.

Results

We analyzed 251 articles. The number of publications rose over time, and they encompassed most medical disciplines, learning settings, and training levels, totaling 25 different platforms specifically for medical education. We uncovered 4 latent classes for educational software, characteristically making use of multimedia (115/251, 45.8%), text (64/251, 25.5%), Web conferencing (54/251, 21.5%), and instructional design principles (18/251, 7.2%). We found 3 classes for intervention outcomes: knowledge and attitudes (175/212, 82.6%), knowledge, attitudes, and skills (11.8%), and online activity (12/212, 5.7%). About a quarter of the articles (58/227, 25.6%) did not hold references or citations in common with other articles. The number of common references and citations increased in articles reporting instructional design principles (P=.03), articles measuring online activities (P=.01), and articles citing a review by Cook and colleagues on CBL (P=.04). There was an association between number of citations and studies comparing CBL versus CBL, independent of publication date (P=.02).

Conclusions

Studies in this field vary highly, and a high number of software systems are being developed. It seems that past recommendations regarding CBL interventions are being taken into consideration. A move into a more student-centered model, a focus on implementing reusable software platforms for specific learning contexts, and the analysis of online activity to track and predict outcomes are relevant areas for future research in this field.

Surviving sepsis--a 3D integrative educational simulator

Computer technology offers greater educational possibilities, notably simulation and virtual reality. This paper presents a technology which serves to integrate multiple modalities, namely 3D virtual reality, node-based simulator, Physiomodel explorer and explanatory physiological simulators employing Modelica language and Unity3D platform. This emerging tool chain should allow the authors to concentrate more on educational content instead of application development. The technology is demonstrated through Surviving sepsis educational scenario, targeted on Microsoft Windows Store platform.

Medical Content Searching, Retrieving, and Sharing Over the Internet: Lessons Learned From the mEducator Through a Scenario-Based Evaluation

BACKGROUND

The mEducator Best Practice Network (BPN) implemented and extended standards and reference models in e-learning to develop innovative frameworks as well as solutions that enable specialized state-of-the-art medical educational content to be discovered, retrieved, shared, and re-purposed across European Institutions, targeting medical students, doctors, educators and health care professionals. Scenario-based evaluation for usability testing, complemented with data from online questionnaires and field notes of users' performance, was designed and utilized for the evaluation of these solutions.

OBJECTIVE

The objective of this work is twofold: (1) to describe one instantiation of the mEducator BPN solutions (mEducator3.0 - "MEdical Education LINnked Arena" MELINA+) with a focus on the metadata schema used, as well as on other aspects of the system that pertain to usability and acceptance, and (2) to present evaluation results on the suitability of the proposed metadata schema for searching, retrieving, and sharing of medical content and with respect to the overall usability and acceptance of the system from the target users.

METHODS

A comprehensive evaluation methodology framework was developed and applied to four case studies, which were conducted in four different countries (ie, Greece, Cyprus, Bulgaria and Romania), with a total of 126 participants. In these case studies, scenarios referring to creating, sharing, and retrieving medical educational content using mEducator3.0 were used. The data were collected through two online questionnaires, consisting of 36 closed-ended questions and two open-ended questions that referred to mEducator 3.0 and through the use of field notes during scenario-based evaluations.

RESULTS

The main findings of the study showed that even though the informational needs of the mEducator target groups were addressed to a satisfactory extent and the metadata schema supported content creation, sharing, and retrieval from an end-user perspective, users faced difficulties in achieving a shared understanding of the meaning of some metadata fields and in correctly managing the intellectual property rights of repurposed content.

CONCLUSIONS

The results of this evaluation impact researchers, medical professionals, and designers interested in using similar systems for educational content sharing in medical and other domains. Recommendations on how to improve the search, retrieval, identification, and obtaining of medical resources are provided, by addressing issues of content description metadata, content description procedures, and intellectual property rights for re-purposed content.

A Virtual Emergency Telemedicine Serious Game in Medical Training: A Quantitative, Professional Feedback-Informed Evaluation Study

Background

Serious games involving virtual patients in medical education can provide a controlled setting within which players can learn in an engaging way, while avoiding the risks associated with real patients. Moreover, serious games align with medical students’ preferred learning styles. The Virtual Emergency TeleMedicine (VETM) game is a simulation-based game that was developed in collaboration with the mEducator Best Practice network in response to calls to integrate serious games in medical education and training. The VETM game makes use of data from an electrocardiogram to train practicing doctors, nurses, or medical students for problem-solving in real-life clinical scenarios through a telemedicine system and virtual patients. The study responds to two gaps: the limited number of games in emergency cardiology and the lack of evaluations by professionals.

Objective

The objective of this study is a quantitative, professional feedback-informed evaluation of one scenario of VETM, involving cardiovascular complications. The study has the following research question: “What are professionals’ perceptions of the potential of the Virtual Emergency Telemedicine game for training people involved in the assessment and management of emergency cases?”

Methods

The evaluation of the VETM game was conducted with 90 professional ambulance crew nursing personnel specializing in the assessment and management of emergency cases. After collaboratively trying out one VETM scenario, participants individually completed an evaluation of the game (36 questions on a 5-point Likert scale) and provided written and verbal comments. The instrument assessed six dimensions of the game: (1) user interface, (2) difficulty level, (3) feedback, (4) educational value, (5) user engagement, and (6) terminology. Data sources of the study were 90 questionnaires, including written comments from 51 participants, 24 interviews with 55 participants, and 379 log files of their interaction with the game.

Results

Overall, the results were positive in all dimensions of the game that were assessed as means ranged from 3.2 to 3.99 out of 5, with user engagement receiving the highest score (mean 3.99, SD 0.87). Users’ perceived difficulty level received the lowest score (mean 3.20, SD 0.65), a finding which agrees with the analysis of log files that showed a rather low success rate (20.6%). Even though professionals saw the educational value and usefulness of the tool for pre-hospital emergency training (mean 3.83, SD 1.05), they identified confusing features and provided input for improving them.

Conclusions

Overall, the results of the professional feedback-informed evaluation of the game provide a strong indication of its potential as an educational tool for emergency training. Professionals’ input will serve to improve the game. Further research will aim to validate VETM, in a randomized pre-test, post-test control group study to examine possible learning gains in participants’ problem-solving skills in treating a patient’s symptoms in an emergency situation.

Educational technologies in problem-based learning in health sciences education: a systematic review

Background

As a modern pedagogical philosophy, problem-based learning (PBL) is increasingly being recognized as a major research area in student learning and pedagogical innovation in health sciences education. A new area of research interest has been the role of emerging educational technologies in PBL. Although this field is growing, no systematic reviews of studies of the usage and effects of educational technologies in PBL in health sciences education have been conducted to date.

Objective

The aim of this paper is to review new and emerging educational technologies in problem-based curricula, with a specific focus on 3 cognate clinical disciplines: medicine, dentistry, and speech and hearing sciences. Analysis of the studies reviewed focused on the effects of educational technologies in PBL contexts while addressing the particular issue of scaffolding of student learning.

Methods

A comprehensive computerized database search of full-text articles published in English from 1996 to 2014 was carried out using 3 databases: ProQuest, Scopus, and EBSCOhost. Eligibility criteria for selection of studies for review were also determined in light of the population, intervention, comparison, and outcomes (PICO) guidelines. The population was limited to postsecondary education, specifically in dentistry, medicine, and speech and hearing sciences, in which PBL was the key educational pedagogy and curriculum design. Three types of educational technologies were identified as interventions used to support student inquiry: learning software and digital learning objects; interactive whiteboards (IWBs) and plasma screens; and learning management systems (LMSs).

Results

Of 470 studies, 28 were selected for analysis. Most studies examined the effects of learning software and digital learning objects (n=20) with integration of IWB (n=5) and LMS (n=3) for PBL receiving relatively less attention. The educational technologies examined in these studies were seen as potentially fit for problem-based health sciences education. Positive outcomes for student learning included providing rich, authentic problems and/or case contexts for learning; supporting student development of medical expertise through the accessing and structuring of expert knowledge and skills; making disciplinary thinking and strategies explicit; providing a platform to elicit articulation, collaboration, and reflection; and reducing perceived cognitive load. Limitations included cumbersome scenarios, infrastructure requirements, and the need for staff and student support in light of the technological demands of new affordances.

Conclusions

This literature review demonstrates the generally positive effect of educational technologies in PBL. Further research into the various applications of educational technology in PBL curricula is needed to fully realize its potential to enhance problem-based approaches in health sciences education.

Improvement in American Board of Surgery in-training examination performance with a multidisciplinary surgeon-directed integrated learning platform

BACKGROUND

The American Board of Surgery In-Training Examination (ABSITE) is a predictor of resident performance on the general surgery-qualifying examination and plays a role in obtaining competitive fellowships. A learning management system (LMS) permits the delivery of a structured curriculum that appeals to the modern resident owing to the ease of accessibility and all-in-one organization. This study hypothesizes that trainees using a structured surgeon-directed LMS will achieve improved ABSITE scores compared with those using an unstructured approach to the examination.

STUDY DESIGN

A multidisciplinary print and digital review course with practice questions, review textbooks, weekly reading assignments, and slide and audio reviews integrated within an online LMS was made available to postgraduate year (PGY)-3 and PGY-4 residents in 2008 and 2009. Surveys were emailed requesting ABSITE scores to compare outcomes in those trainees that used the course with those who used an unstructured approach. Statistical analysis was conducted via descriptive statistics and Pearson chi-square with p < 0.05 deemed statistically significant.

RESULTS

Surveys were mailed to 508 trainees. There was an 80% (408) response rate. Residents who used structured approaches in both the years achieved the highest scores, followed by those who adopted a structured approach in PGY-4. The residents using an unstructured approach in both the years showed no significant improvement.

CONCLUSION

Residents who used a structured LMS performed significantly better than their counterparts who used an unstructured approach. A properly constructed online education curriculum has the potential to improve ABSITE scores.

A framework for different levels of integration of computational models into web-based virtual patients

BACKGROUND

Virtual patients are increasingly common tools used in health care education to foster learning of clinical reasoning skills. One potential way to expand their functionality is to augment virtual patients' interactivity by enriching them with computational models of physiological and pathological processes.

OBJECTIVE

The primary goal of this paper was to propose a conceptual framework for the integration of computational models within virtual patients, with particular focus on (1) characteristics to be addressed while preparing the integration, (2) the extent of the integration, (3) strategies to achieve integration, and (4) methods for evaluating the feasibility of integration. An additional goal was to pilot the first investigation of changing framework variables on altering perceptions of integration.

METHODS

The framework was constructed using an iterative process informed by Soft System Methodology. The Virtual Physiological Human (VPH) initiative has been used as a source of new computational models. The technical challenges associated with development of virtual patients enhanced by computational models are discussed from the perspectives of a number of different stakeholders. Concrete design and evaluation steps are discussed in the context of an exemplar virtual patient employing the results of the VPH ARCH project, as well as improvements for future iterations.

RESULTS

The proposed framework consists of four main elements. The first element is a list of feasibility features characterizing the integration process from three perspectives: the computational modelling researcher, the health care educationalist, and the virtual patient system developer. The second element included three integration levels: basic, where a single set of simulation outcomes is generated for specific nodes in the activity graph; intermediate, involving pre-generation of simulation datasets over a range of input parameters; advanced, including dynamic solution of the model. The third element is the description of four integration strategies, and the last element consisted of evaluation profiles specifying the relevant feasibility features and acceptance thresholds for specific purposes. The group of experts who evaluated the virtual patient exemplar found higher integration more interesting, but at the same time they were more concerned with the validity of the result. The observed differences were not statistically significant.

CONCLUSIONS

This paper outlines a framework for the integration of computational models into virtual patients. The opportunities and challenges of model exploitation are discussed from a number of user perspectives, considering different levels of model integration. The long-term aim for future research is to isolate the most crucial factors in the framework and to determine their influence on the integration outcome.